2023-11-28T16:39:24.333 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T16:39:24.334 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --name vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi --owner scheduled_vshankar@teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341 -- /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/orig.config.yaml 2023-11-28T16:39:24.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T16:39:24.466 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341 branch: wip-vshankar-testing-20231127.102654 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7469341' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102654 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 47c1c547372ed5bff7984647dc200bac0e019caf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 47c1c547372ed5bff7984647dc200bac0e019caf kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102654 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1098 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf sleep_before_teardown: 0 subset: 854/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102654 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 47c1c547372ed5bff7984647dc200bac0e019caf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLK3cX0awvivqTMUFkURLHddCrMc/pmBFAc5kbAgjc742Jlu9mQEpYaCnrOIp5A6nJfvIrcDJpq5ncDEiBbVJqs= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkI0GmXf2v+DH9KZbHKOKZwdFQ2zsfNU5G18ubT4762ZNaW6hZTTZhBQV1ZbjUbsu9CmQOg87uJZ9NqbEL0ZSs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:23:42 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T16:39:24.467 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa; will attempt to use it 2023-11-28T16:39:24.467 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks 2023-11-28T16:39:24.468 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T16:39:24.469 INFO:teuthology.task.internal:Checking packages... 2023-11-28T16:39:24.492 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '47c1c547372ed5bff7984647dc200bac0e019caf' 2023-11-28T16:39:24.492 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T16:39:24.492 INFO:teuthology.packaging:ref: None 2023-11-28T16:39:24.492 INFO:teuthology.packaging:tag: None 2023-11-28T16:39:24.492 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102654 2023-11-28T16:39:24.492 INFO:teuthology.packaging:sha1: 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T16:39:24.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102654 2023-11-28T16:39:24.632 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:39:24.632 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T16:39:24.639 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T16:39:24.639 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T16:39:24.646 INFO:teuthology.task.internal:Saving configuration 2023-11-28T16:39:24.665 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T16:39:24.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T16:39:24.697 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 16:33:46.581883', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILgziWFiTbqq5KcDDU9ujKqXPLdbR5jB9HaHl+ERJ9GH'} 2023-11-28T16:39:24.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 16:33:46.583841', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA4SsfknO39HbCobIrICptoPVTtb8BBjuOa+EVLI31Tl'} 2023-11-28T16:39:24.723 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T16:39:24.730 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-28T16:39:24.730 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-11-28T16:39:24.730 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T16:39:24.800 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7eff738fb0d0>, signals=[15]) 2023-11-28T16:39:24.801 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T16:39:24.807 INFO:teuthology.task.internal:Opening connections... 2023-11-28T16:39:24.807 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:39:24.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:39:24.884 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:39:24.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:39:24.959 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T16:39:24.965 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-11-28T16:39:24.971 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-11-28T16:39:24.971 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-11-28T16:39:25.018 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T16:39:25.018 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-11-28T16:39:25.018 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2023-11-28T16:39:25.018 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T16:39:25.019 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2023-11-28T16:39:25.020 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-11-28T16:39:25.045 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-11-28T16:39:25.052 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-11-28T16:39:25.052 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T16:39:25.100 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T16:39:25.101 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T16:39:25.101 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T16:39:25.101 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2023-11-28T16:39:25.101 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-11-28T16:39:25.120 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T16:39:25.129 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T16:39:25.142 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T16:39:25.142 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2023-11-28T16:39:25.145 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2023-11-28T16:39:25.151 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T16:39:25.157 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T16:39:25.157 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2023-11-28T16:39:25.192 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2023-11-28T16:39:25.223 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T16:39:25.274 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T16:39:25.289 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T16:39:25.290 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-11-28T16:39:25.290 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-28T16:39:25.290 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T16:39:25.291 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T16:39:25.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:39:25.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:39:25.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T16:39:25.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T16:39:25.504 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T16:39:25.505 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T16:39:25.505 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-11-28T16:39:25.510 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2023-11-28T16:39:25.510 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T16:39:25.511 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T16:39:25.511 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-28T16:39:25.511 DEBUG:teuthology.orchestra.run.smithi079:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T16:39:25.521 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T16:39:25.521 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T16:39:25.521 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-11-28T16:39:25.526 INFO:teuthology.orchestra.run.smithi026.stdout:5.15.0-56-generic 2023-11-28T16:39:25.527 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T16:39:25.527 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T16:39:25.527 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-28T16:39:25.527 DEBUG:teuthology.orchestra.run.smithi026:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T16:39:25.569 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T16:39:25.588 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T16:39:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: git config --global init.defaultBranch 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: 2023-11-28T16:39:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:hint: git branch -m 2023-11-28T16:39:25.701 INFO:teuthology.orchestra.run.smithi079.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T16:39:25.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T16:39:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T16:39:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T16:39:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T16:39:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 2023-11-28T16:39:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:hint: git config --global init.defaultBranch 2023-11-28T16:39:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 2023-11-28T16:39:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T16:39:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T16:39:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:hint: 2023-11-28T16:39:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:hint: git branch -m 2023-11-28T16:39:25.717 INFO:teuthology.orchestra.run.smithi026.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T16:39:25.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T16:39:25.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T16:39:25.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T16:39:25.824 DEBUG:teuthology.orchestra.run.smithi079:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T16:39:25.839 DEBUG:teuthology.orchestra.run.smithi026:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T16:40:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T16:40:32.548 INFO:teuthology.orchestra.run.smithi079.stderr: * [new branch] main -> origin/main 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T16:40:32.580 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T16:40:32.583 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T16:40:32.583 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T16:40:32.584 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T16:40:32.584 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T16:40:32.584 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T16:40:32.585 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T16:40:32.586 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T16:40:32.587 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T16:40:32.587 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T16:40:32.588 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T16:40:32.588 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T16:40:32.588 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T16:40:32.589 INFO:teuthology.orchestra.run.smithi079.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T16:40:36.558 INFO:teuthology.orchestra.run.smithi079.stderr:Updating files: 51% (1669/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 65% (2118/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2655/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T16:40:36.563 INFO:teuthology.orchestra.run.smithi079.stdout:HEAD is now at 5aadb590 Merge branch 'robot/patch-0-1701175489' into 'main' 2023-11-28T16:40:36.584 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T16:40:36.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T16:40:36.728 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T16:40:36.728 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T16:40:36.730 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi079.front.sepia.ceph.com to complete... 2023-11-28T16:40:38.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28 16:40:38 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T16:40:38.386 INFO:teuthology.orchestra.run.smithi079.stderr:FINISHED --2023-11-28 16:40:38-- 2023-11-28T16:40:38.386 INFO:teuthology.orchestra.run.smithi079.stderr:Total wall clock time: 1.6s 2023-11-28T16:40:38.386 INFO:teuthology.orchestra.run.smithi079.stderr:Downloaded: 1 files, 37M in 1.5s (25.0 MB/s) 2023-11-28T16:40:38.389 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T16:40:38.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T16:40:38.598 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T16:40:40.646 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T16:40:40.650 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T16:40:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T16:40:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T16:40:42.257 INFO:teuthology.orchestra.run.smithi026.stderr: * [new branch] main -> origin/main 2023-11-28T16:40:42.282 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T16:40:42.282 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T16:40:42.283 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T16:40:42.283 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T16:40:42.283 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T16:40:42.283 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T16:40:42.283 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T16:40:42.283 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T16:40:42.290 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T16:40:42.290 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T16:40:42.290 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T16:40:42.291 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T16:40:42.291 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T16:40:42.291 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T16:40:42.291 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T16:40:42.291 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T16:40:42.292 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T16:40:42.292 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T16:40:42.292 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T16:40:42.292 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T16:40:42.292 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T16:40:42.292 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T16:40:42.292 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T16:40:42.293 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T16:40:42.293 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T16:40:42.293 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T16:40:42.293 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T16:40:42.293 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T16:40:42.293 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T16:40:42.294 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T16:40:42.294 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T16:40:42.294 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T16:40:42.295 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T16:40:42.295 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T16:40:42.295 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T16:40:42.295 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T16:40:42.295 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T16:40:42.296 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T16:40:42.296 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T16:40:42.296 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T16:40:42.296 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T16:40:42.296 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T16:40:42.296 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T16:40:42.297 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T16:40:42.297 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T16:40:42.297 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T16:40:42.297 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T16:40:42.297 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T16:40:42.298 INFO:teuthology.orchestra.run.smithi026.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T16:40:44.248 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T16:40:44.354 INFO:teuthology.orchestra.run.smithi079.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T16:40:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:Updating files: 49% (1596/3250) Updating files: 50% (1625/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 63% (2077/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2638/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 89% (2894/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T16:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:HEAD is now at 5aadb590 Merge branch 'robot/patch-0-1701175489' into 'main' 2023-11-28T16:40:46.503 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T16:40:46.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T16:40:46.724 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T16:40:46.724 DEBUG:teuthology.orchestra.run.smithi026:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T16:40:46.727 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi026.front.sepia.ceph.com to complete... 2023-11-28T16:40:49.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28 16:40:49 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T16:40:49.808 INFO:teuthology.orchestra.run.smithi026.stderr:FINISHED --2023-11-28 16:40:49-- 2023-11-28T16:40:49.808 INFO:teuthology.orchestra.run.smithi026.stderr:Total wall clock time: 3.1s 2023-11-28T16:40:49.809 INFO:teuthology.orchestra.run.smithi026.stderr:Downloaded: 1 files, 37M in 2.9s (13.0 MB/s) 2023-11-28T16:40:49.811 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T16:40:49.812 DEBUG:teuthology.orchestra.run.smithi026:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T16:40:50.143 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T16:40:52.081 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T16:40:52.085 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T16:40:52.192 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T16:40:55.369 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T16:40:55.463 INFO:teuthology.orchestra.run.smithi026.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T16:41:05.272 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2023-11-28T16:41:05.296 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T16:41:05.320 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2023-11-28T16:41:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T16:41:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T16:41:05.936 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T16:41:05.946 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T16:41:06.007 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T16:41:06.012 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T16:41:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T16:41:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T16:41:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T16:41:06.198 INFO:teuthology.orchestra.run.smithi079.stderr:done 2023-11-28T16:41:06.387 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T16:41:06.395 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T16:41:06.395 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T16:41:06.395 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T16:41:06.408 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T16:41:06.426 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T16:41:06.426 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T16:41:06.426 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T16:41:06.426 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T16:41:06.426 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T16:41:06.426 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T16:41:06.426 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T16:41:06.427 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T16:41:06.427 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T16:41:06.427 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T16:41:06.427 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T16:41:06.427 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T16:41:06.427 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T16:41:06.427 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T16:41:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T16:41:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T16:41:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T16:41:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T16:41:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T16:41:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T16:41:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T16:41:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T16:41:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T16:41:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T16:41:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T16:41:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T16:41:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T16:41:06.516 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T16:41:06.517 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T16:41:06.517 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T16:41:06.517 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T16:41:06.517 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T16:41:06.517 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T16:41:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T16:41:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T16:41:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T16:41:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T16:41:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T16:41:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T16:41:06.519 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T16:41:06.519 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T16:41:06.519 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T16:41:06.519 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T16:41:06.519 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T16:41:06.520 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T16:41:06.520 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T16:41:06.520 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T16:41:06.520 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T16:41:06.520 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T16:41:06.520 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T16:41:06.521 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T16:41:06.521 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T16:41:06.521 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T16:41:06.521 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T16:41:06.521 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T16:41:06.521 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T16:41:06.522 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T16:41:06.522 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T16:41:06.522 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T16:41:06.522 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T16:41:06.522 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T16:41:06.522 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T16:41:06.523 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T16:41:06.523 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T16:41:06.523 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T16:41:06.523 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T16:41:06.523 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T16:41:06.523 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T16:41:06.524 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T16:41:06.524 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T16:41:06.524 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T16:41:06.524 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T16:41:06.524 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T16:41:06.524 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T16:41:06.525 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T16:41:06.525 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T16:41:06.525 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T16:41:06.525 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T16:41:06.525 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T16:41:06.525 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T16:41:06.526 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T16:41:06.526 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T16:41:06.526 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T16:41:06.526 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T16:41:06.526 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T16:41:06.527 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T16:41:06.527 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T16:41:06.527 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T16:41:06.527 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T16:41:06.527 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T16:41:06.527 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T16:41:06.528 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T16:41:06.528 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T16:41:06.529 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T16:41:06.529 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T16:41:06.529 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T16:41:06.531 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T16:41:06.531 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T16:41:06.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T16:41:06.533 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T16:41:06.533 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T16:41:06.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T16:41:06.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T16:41:06.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T16:41:06.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T16:41:06.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T16:41:06.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T16:41:06.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T16:41:06.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T16:41:06.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T16:41:06.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T16:41:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T16:41:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T16:41:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T16:41:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T16:41:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T16:41:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T16:41:06.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T16:41:06.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T16:41:06.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T16:41:06.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T16:41:06.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T16:41:06.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T16:41:06.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T16:41:06.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T16:41:06.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T16:41:06.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T16:41:06.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T16:41:06.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T16:41:06.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T16:41:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T16:41:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T16:41:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T16:41:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T16:41:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T16:41:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T16:41:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T16:41:06.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T16:41:06.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T16:41:06.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T16:41:06.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T16:41:06.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T16:41:06.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T16:41:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T16:41:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T16:41:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T16:41:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T16:41:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T16:41:06.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T16:41:06.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T16:41:06.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T16:41:06.544 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T16:41:06.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T16:41:06.545 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T16:41:06.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T16:41:06.545 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T16:41:06.545 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T16:41:06.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T16:41:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T16:41:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T16:41:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T16:41:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T16:41:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T16:41:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T16:41:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T16:41:06.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T16:41:06.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T16:41:06.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T16:41:06.547 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T16:41:06.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T16:41:06.548 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T16:41:06.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T16:41:06.548 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T16:41:06.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T16:41:06.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T16:41:06.549 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T16:41:06.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T16:41:06.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T16:41:06.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T16:41:06.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T16:41:06.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T16:41:06.550 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T16:41:06.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T16:41:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T16:41:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T16:41:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T16:41:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T16:41:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T16:41:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T16:41:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T16:41:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T16:41:06.554 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T16:41:06.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T16:41:06.554 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T16:41:06.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T16:41:06.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T16:41:06.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T16:41:06.555 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T16:41:06.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T16:41:06.555 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T16:41:06.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T16:41:06.555 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T16:41:06.555 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T16:41:06.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T16:41:06.556 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T16:41:06.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T16:41:06.556 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T16:41:06.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T16:41:06.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T16:41:06.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T16:41:06.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T16:41:06.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T16:41:06.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T16:41:06.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T16:41:06.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T16:41:06.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T16:41:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T16:41:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T16:41:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T16:41:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T16:41:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T16:41:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T16:41:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T16:41:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T16:41:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T16:41:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T16:41:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T16:41:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T16:41:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T16:41:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T16:41:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T16:41:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T16:41:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T16:41:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T16:41:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T16:41:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T16:41:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T16:41:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T16:41:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T16:41:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T16:41:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T16:41:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T16:41:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T16:41:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T16:41:06.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T16:41:06.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T16:41:06.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T16:41:06.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T16:41:06.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T16:41:06.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T16:41:06.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T16:41:06.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T16:41:06.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T16:41:06.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T16:41:06.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T16:41:06.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T16:41:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T16:41:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T16:41:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T16:41:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T16:41:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T16:41:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T16:41:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T16:41:06.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T16:41:06.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T16:41:06.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T16:41:06.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T16:41:06.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T16:41:06.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T16:41:06.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T16:41:06.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T16:41:06.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T16:41:06.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T16:41:06.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T16:41:06.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T16:41:06.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T16:41:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T16:41:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T16:41:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T16:41:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T16:41:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T16:41:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T16:41:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T16:41:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T16:41:06.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T16:41:06.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T16:41:06.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T16:41:06.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T16:41:06.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T16:41:06.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T16:41:06.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T16:41:06.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T16:41:06.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T16:41:06.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T16:41:06.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T16:41:06.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T16:41:06.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T16:41:06.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T16:41:06.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T16:41:06.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T16:41:06.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T16:41:06.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T16:41:06.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T16:41:06.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T16:41:06.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T16:41:06.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T16:41:06.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T16:41:06.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T16:41:06.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T16:41:06.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T16:41:06.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T16:41:06.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T16:41:06.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T16:41:06.575 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T16:41:06.575 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T16:41:06.575 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T16:41:06.575 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T16:41:06.575 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T16:41:06.575 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T16:41:06.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T16:41:06.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T16:41:06.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T16:41:06.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T16:41:06.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T16:41:06.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T16:41:06.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T16:41:06.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T16:41:06.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T16:41:06.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T16:41:06.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T16:41:06.578 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T16:41:06.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T16:41:06.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T16:41:06.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T16:41:06.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T16:41:06.579 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T16:41:06.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T16:41:06.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T16:41:06.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T16:41:06.580 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T16:41:06.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T16:41:06.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T16:41:06.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T16:41:06.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T16:41:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T16:41:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T16:41:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T16:41:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T16:41:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T16:41:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T16:41:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T16:41:06.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T16:41:06.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T16:41:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T16:41:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T16:41:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T16:41:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T16:41:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T16:41:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T16:41:06.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T16:41:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T16:41:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T16:41:06.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T16:41:06.595 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T16:41:06.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T16:41:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T16:41:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T16:41:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T16:41:06.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T16:41:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T16:41:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T16:41:06.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T16:41:06.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T16:41:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T16:41:06.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T16:41:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T16:41:06.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T16:41:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T16:41:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T16:41:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T16:41:06.612 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T16:41:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T16:41:06.614 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T16:41:06.615 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T16:41:06.616 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T16:41:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T16:41:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T16:41:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T16:41:06.620 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T16:41:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T16:41:06.622 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T16:41:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T16:41:06.624 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T16:41:06.625 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T16:41:06.729 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T16:41:06.730 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T16:41:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T16:41:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T16:41:06.733 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T16:41:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T16:41:06.735 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T16:41:06.735 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T16:41:06.735 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T16:41:06.735 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T16:41:06.735 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T16:41:06.736 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T16:41:06.736 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T16:41:06.736 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T16:41:06.736 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T16:41:06.736 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T16:41:06.736 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T16:41:06.737 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T16:41:06.737 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T16:41:06.737 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T16:41:06.737 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T16:41:06.737 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T16:41:06.738 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T16:41:06.738 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T16:41:06.738 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T16:41:06.738 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T16:41:06.738 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T16:41:06.738 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T16:41:06.739 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T16:41:06.739 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T16:41:06.739 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T16:41:06.739 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T16:41:06.739 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T16:41:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T16:41:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T16:41:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T16:41:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T16:41:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T16:41:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T16:41:06.741 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T16:41:06.741 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T16:41:06.741 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T16:41:06.741 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T16:41:06.741 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T16:41:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T16:41:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T16:41:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T16:41:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T16:41:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T16:41:06.743 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T16:41:06.743 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T16:41:06.743 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T16:41:06.743 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T16:41:06.743 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T16:41:06.743 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T16:41:06.744 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T16:41:06.744 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T16:41:06.744 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T16:41:06.744 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T16:41:06.744 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T16:41:06.744 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T16:41:06.745 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T16:41:06.745 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T16:41:06.745 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T16:41:06.745 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T16:41:06.745 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T16:41:06.745 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T16:41:06.746 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T16:41:06.746 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T16:41:06.746 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T16:41:06.746 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T16:41:06.746 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T16:41:06.747 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T16:41:06.747 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T16:41:06.747 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T16:41:06.747 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T16:41:06.747 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T16:41:06.748 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T16:41:06.748 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T16:41:06.748 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T16:41:06.748 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T16:41:06.749 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T16:41:06.749 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T16:41:06.749 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T16:41:06.749 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T16:41:06.749 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T16:41:06.750 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T16:41:06.750 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T16:41:06.750 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T16:41:06.750 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T16:41:06.750 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T16:41:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T16:41:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T16:41:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T16:41:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T16:41:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T16:41:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T16:41:06.752 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T16:41:06.752 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T16:41:06.752 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T16:41:06.752 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T16:41:06.752 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T16:41:06.753 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T16:41:06.753 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T16:41:06.753 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T16:41:06.753 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T16:41:06.753 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T16:41:06.754 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T16:41:06.754 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T16:41:06.754 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T16:41:06.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T16:41:06.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T16:41:06.756 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T16:41:06.756 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T16:41:06.756 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T16:41:06.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T16:41:06.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T16:41:06.757 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T16:41:06.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T16:41:06.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T16:41:06.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T16:41:06.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T16:41:06.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T16:41:06.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T16:41:06.758 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T16:41:06.758 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T16:41:06.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T16:41:06.759 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T16:41:06.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T16:41:06.759 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T16:41:06.759 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T16:41:06.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T16:41:06.760 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T16:41:06.760 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T16:41:06.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T16:41:06.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T16:41:06.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T16:41:06.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T16:41:06.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T16:41:06.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T16:41:06.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T16:41:06.761 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T16:41:06.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T16:41:06.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T16:41:06.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T16:41:06.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T16:41:06.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T16:41:06.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T16:41:06.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T16:41:06.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T16:41:06.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T16:41:06.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T16:41:06.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T16:41:06.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T16:41:06.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T16:41:06.764 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T16:41:06.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T16:41:06.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T16:41:06.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T16:41:06.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T16:41:06.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T16:41:06.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T16:41:06.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T16:41:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T16:41:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T16:41:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T16:41:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T16:41:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T16:41:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T16:41:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T16:41:06.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T16:41:06.769 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T16:41:06.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T16:41:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T16:41:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T16:41:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T16:41:06.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T16:41:06.775 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T16:41:06.776 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T16:41:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T16:41:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T16:41:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T16:41:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T16:41:06.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T16:41:06.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T16:41:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T16:41:06.784 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T16:41:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T16:41:06.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T16:41:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T16:41:06.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T16:41:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T16:41:06.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T16:41:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T16:41:06.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T16:41:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T16:41:06.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T16:41:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T16:41:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T16:41:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T16:41:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T16:41:06.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T16:41:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T16:41:06.801 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T16:41:06.802 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T16:41:06.803 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T16:41:06.804 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T16:41:06.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T16:41:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T16:41:06.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T16:41:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T16:41:06.809 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T16:41:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T16:41:06.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T16:41:06.812 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T16:41:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T16:41:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T16:41:06.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T16:41:06.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T16:41:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T16:41:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T16:41:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T16:41:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T16:41:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T16:41:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T16:41:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T16:41:06.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T16:41:06.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T16:41:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T16:41:06.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T16:41:06.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T16:41:06.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T16:41:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T16:41:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T16:41:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T16:41:06.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T16:41:06.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T16:41:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T16:41:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T16:41:06.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T16:41:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T16:41:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T16:41:06.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T16:41:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T16:41:06.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T16:41:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T16:41:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T16:41:06.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T16:41:06.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T16:41:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T16:41:06.848 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T16:41:06.849 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T16:41:06.850 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T16:41:06.851 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T16:41:06.852 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T16:41:06.853 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T16:41:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T16:41:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T16:41:06.856 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T16:41:06.857 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T16:41:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T16:41:06.859 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T16:41:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T16:41:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T16:41:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T16:41:06.863 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T16:41:06.864 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T16:41:06.865 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T16:41:06.865 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T16:41:06.865 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T16:41:06.865 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T16:41:06.865 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T16:41:06.865 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T16:41:06.866 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T16:41:06.866 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T16:41:06.866 DEBUG:teuthology.orchestra.run.smithi079:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T16:41:06.873 INFO:teuthology.orchestra.run.smithi079.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T16:41:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T16:41:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T16:41:06.874 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T16:41:06.874 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T16:41:06.874 DEBUG:teuthology.orchestra.run.smithi079:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T16:41:06.916 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi079.front.sepia.ceph.com to complete... 2023-11-28T16:41:07.349 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2023-11-28T16:41:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T16:41:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2023-11-28T16:41:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T16:41:07.561 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T16:41:07.787 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T16:41:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T16:41:07.833 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T16:41:07.838 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T16:41:07.956 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T16:41:07.956 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T16:41:07.957 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T16:41:07.988 INFO:teuthology.orchestra.run.smithi079.stderr:done 2023-11-28T16:41:16.394 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub' 2023-11-28T16:41:16.407 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T16:41:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2023-11-28T16:41:16.826 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T16:41:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T16:41:17.264 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T16:41:17.271 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T16:41:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T16:41:17.349 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T16:41:17.504 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T16:41:17.504 INFO:teuthology.orchestra.run.smithi026.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T16:41:17.504 INFO:teuthology.orchestra.run.smithi026.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T16:41:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:done 2023-11-28T16:41:17.742 DEBUG:teuthology.orchestra.run.smithi026:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T16:41:17.750 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T16:41:17.750 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T16:41:17.750 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T16:41:17.762 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T16:41:17.763 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T16:41:17.788 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T16:41:17.788 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T16:41:17.788 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T16:41:17.788 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T16:41:17.788 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T16:41:17.789 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T16:41:17.789 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T16:41:17.789 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T16:41:17.789 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T16:41:17.789 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T16:41:17.790 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T16:41:17.790 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T16:41:17.790 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T16:41:17.790 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T16:41:17.790 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T16:41:17.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T16:41:17.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T16:41:17.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T16:41:17.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T16:41:17.791 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T16:41:17.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T16:41:17.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T16:41:17.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T16:41:17.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T16:41:17.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T16:41:17.792 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T16:41:17.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T16:41:17.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T16:41:17.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T16:41:17.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T16:41:17.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T16:41:17.793 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T16:41:17.794 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T16:41:17.794 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T16:41:17.794 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T16:41:17.794 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T16:41:17.794 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T16:41:17.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T16:41:17.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T16:41:17.795 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T16:41:17.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T16:41:17.795 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T16:41:17.894 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T16:41:17.894 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T16:41:17.894 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T16:41:17.894 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T16:41:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T16:41:17.896 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T16:41:17.897 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T16:41:17.898 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T16:41:17.899 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T16:41:17.900 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T16:41:17.901 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T16:41:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T16:41:17.903 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T16:41:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T16:41:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T16:41:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T16:41:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T16:41:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T16:41:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T16:41:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T16:41:17.911 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T16:41:17.912 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T16:41:17.913 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T16:41:17.914 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T16:41:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T16:41:17.916 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T16:41:17.917 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T16:41:17.918 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T16:41:17.919 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T16:41:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T16:41:17.921 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T16:41:17.922 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T16:41:17.923 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T16:41:17.924 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T16:41:17.925 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T16:41:17.926 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T16:41:17.927 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T16:41:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T16:41:17.929 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T16:41:17.930 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T16:41:17.931 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T16:41:17.932 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T16:41:17.933 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T16:41:17.934 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T16:41:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T16:41:17.936 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T16:41:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T16:41:17.938 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T16:41:17.939 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T16:41:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T16:41:17.941 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T16:41:17.942 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T16:41:17.943 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T16:41:17.944 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T16:41:17.945 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T16:41:17.946 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T16:41:17.947 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T16:41:17.948 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T16:41:17.949 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T16:41:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T16:41:17.951 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T16:41:17.952 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T16:41:17.953 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T16:41:17.954 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T16:41:17.955 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T16:41:17.956 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T16:41:17.957 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T16:41:17.958 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T16:41:17.959 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T16:41:17.960 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T16:41:17.961 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T16:41:17.962 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T16:41:17.963 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T16:41:17.964 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T16:41:17.965 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T16:41:17.966 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T16:41:17.967 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T16:41:17.968 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T16:41:17.969 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T16:41:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T16:41:17.971 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T16:41:17.972 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T16:41:17.973 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T16:41:17.974 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T16:41:17.975 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T16:41:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T16:41:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T16:41:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T16:41:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T16:41:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T16:41:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T16:41:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T16:41:17.984 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T16:41:17.984 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T16:41:17.984 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T16:41:17.984 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T16:41:18.116 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T16:41:18.116 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T16:41:18.116 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T16:41:18.116 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T16:41:18.117 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T16:41:18.118 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T16:41:18.119 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T16:41:18.120 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T16:41:18.120 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T16:41:18.120 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T16:41:18.120 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T16:41:18.121 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T16:41:18.122 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T16:41:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T16:41:18.124 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T16:41:18.125 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T16:41:18.126 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T16:41:18.127 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T16:41:18.128 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T16:41:18.129 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T16:41:18.130 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T16:41:18.131 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T16:41:18.132 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T16:41:18.133 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T16:41:18.134 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T16:41:18.134 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T16:41:18.134 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T16:41:18.137 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T16:41:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T16:41:18.139 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T16:41:18.140 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T16:41:18.141 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T16:41:18.142 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T16:41:18.143 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T16:41:18.144 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T16:41:18.145 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T16:41:18.146 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T16:41:18.147 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T16:41:18.148 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T16:41:18.149 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T16:41:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T16:41:18.151 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T16:41:18.152 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T16:41:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T16:41:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T16:41:18.155 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T16:41:18.156 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T16:41:18.157 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T16:41:18.158 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T16:41:18.159 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T16:41:18.160 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T16:41:18.161 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T16:41:18.162 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T16:41:18.163 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T16:41:18.164 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T16:41:18.165 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T16:41:18.166 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T16:41:18.167 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T16:41:18.168 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T16:41:18.169 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T16:41:18.170 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T16:41:18.171 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T16:41:18.172 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T16:41:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T16:41:18.174 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T16:41:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T16:41:18.176 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T16:41:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T16:41:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T16:41:18.179 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T16:41:18.180 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T16:41:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T16:41:18.182 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T16:41:18.183 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T16:41:18.184 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T16:41:18.185 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T16:41:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T16:41:18.187 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T16:41:18.188 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T16:41:18.189 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T16:41:18.190 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T16:41:18.191 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T16:41:18.192 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T16:41:18.193 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T16:41:18.194 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T16:41:18.195 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T16:41:18.196 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T16:41:18.197 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T16:41:18.198 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T16:41:18.199 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T16:41:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T16:41:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T16:41:18.202 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T16:41:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T16:41:18.204 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T16:41:18.205 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T16:41:18.206 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T16:41:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T16:41:18.208 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T16:41:18.209 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T16:41:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T16:41:18.211 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T16:41:18.212 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T16:41:18.213 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T16:41:18.214 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T16:41:18.215 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T16:41:18.216 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T16:41:18.217 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T16:41:18.218 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T16:41:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T16:41:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T16:41:18.221 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T16:41:18.222 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T16:41:18.223 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T16:41:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T16:41:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T16:41:18.226 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T16:41:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T16:41:18.228 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T16:41:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T16:41:18.230 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T16:41:18.231 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T16:41:18.232 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T16:41:18.233 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T16:41:18.234 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T16:41:18.235 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T16:41:18.236 INFO:teuthology.orchestra.run.smithi026.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T16:41:18.237 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T16:41:18.237 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T16:41:18.237 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T16:41:18.237 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T16:41:18.237 DEBUG:teuthology.orchestra.run.smithi026:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T16:41:18.244 INFO:teuthology.orchestra.run.smithi026.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T16:41:18.244 INFO:teuthology.orchestra.run.smithi026.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T16:41:18.245 INFO:teuthology.orchestra.run.smithi026.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T16:41:18.245 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T16:41:18.245 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T16:41:18.245 DEBUG:teuthology.orchestra.run.smithi026:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T16:41:18.287 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi026.front.sepia.ceph.com to complete... 2023-11-28T16:41:18.809 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub' 2023-11-28T16:41:18.810 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T16:41:18.835 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2023-11-28T16:41:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T16:41:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T16:41:19.308 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T16:41:19.314 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T16:41:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T16:41:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T16:41:19.492 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T16:41:19.492 INFO:teuthology.orchestra.run.smithi026.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T16:41:19.492 INFO:teuthology.orchestra.run.smithi026.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T16:41:19.510 INFO:teuthology.orchestra.run.smithi026.stderr:done 2023-11-28T16:41:39.098 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-28T16:41:39.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-11-28T16:41:39.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:41:50.642 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-28T16:41:50.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T16:41:50.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:41:57.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-11-28T16:42:06.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-11-28T16:42:06.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:42:09.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-11-28T16:42:09.666 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-11-28T16:42:18.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T16:42:18.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:42:21.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-11-28T16:42:21.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:42:40.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-11-28T16:42:55.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-11-28T16:42:55.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:42:55.357 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-11-28T16:42:56.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-11-28T16:42:56.177 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-28T16:42:56.177 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-11-28T16:42:56.226 INFO:teuthology.orchestra.run.smithi079.stdout:6.6.0-g8247bbb5b470 2023-11-28T16:42:56.226 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T16:42:56.226 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T16:42:56.226 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T16:42:57.227 DEBUG:teuthology.parallel:result is None 2023-11-28T16:43:18.133 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T16:43:30.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T16:43:30.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:43:30.453 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-11-28T16:43:31.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T16:43:31.200 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-28T16:43:31.200 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-11-28T16:43:31.250 INFO:teuthology.orchestra.run.smithi026.stdout:6.6.0-g8247bbb5b470 2023-11-28T16:43:31.250 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T16:43:31.250 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T16:43:31.250 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T16:43:32.251 DEBUG:teuthology.parallel:result is None 2023-11-28T16:43:32.251 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T16:43:32.259 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T16:43:32.259 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T16:43:32.262 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T16:43:32.272 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T16:43:32.282 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T16:43:32.291 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T16:43:32.291 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T16:43:32.313 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T16:43:32.342 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T16:43:32.349 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T16:43:32.349 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T16:43:32.377 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T16:43:32.460 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T16:43:32.484 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T16:43:32.485 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T16:43:32.505 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T16:43:32.507 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T16:43:32.516 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T16:43:32.516 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T16:43:32.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T16:43:32.542 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T16:43:32.555 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T16:43:32.555 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T16:43:32.585 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T16:43:32.593 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T16:43:32.643 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T16:43:32.695 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:43:32.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T16:43:32.771 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T16:43:32.781 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T16:43:32.830 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:43:32.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T16:43:32.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2023-11-28T16:43:32.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2023-11-28T16:43:33.067 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T16:43:33.075 INFO:teuthology.task.internal:Starting timer... 2023-11-28T16:43:33.075 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T16:43:33.085 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T16:43:33.093 DEBUG:teuthology.task.selinux:Excluding smithi026: OS 'ubuntu' does not support SELinux 2023-11-28T16:43:33.093 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2023-11-28T16:43:33.094 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T16:43:33.094 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T16:43:33.094 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T16:43:33.095 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T16:43:33.103 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-28T16:43:33.103 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T16:43:33.122 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T16:43:33.123 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi079.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T16:52:24.844 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com')] 2023-11-28T16:52:24.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T16:52:24.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:52:24.968 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-11-28T16:52:25.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T16:52:25.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-11-28T16:52:25.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T16:52:25.161 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-11-28T16:52:25.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-11-28T16:52:25.301 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T16:52:25.311 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T16:52:25.311 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T16:52:25.312 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T16:52:25.315 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T16:52:25.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Command line: ntpd -gq 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: ---------------------------------------------------- 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: corporation. Support and training for ntp-4 are 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: available at https://www.nwtime.org/support 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: ---------------------------------------------------- 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: proto: precision = 0.044 usec (-24) 2023-11-28T16:52:25.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: basedate set to 2022-02-04 2023-11-28T16:52:25.357 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: gps base set to 2022-02-06 (week 2196) 2023-11-28T16:52:25.357 INFO:teuthology.orchestra.run.smithi026.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T16:52:25.357 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T16:52:25.357 INFO:teuthology.orchestra.run.smithi026.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T16:52:25.358 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T16:52:25.358 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T16:52:25.359 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T16:52:25.359 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T16:52:25.359 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Listen normally on 3 ens1f0 172.21.15.26:123 2023-11-28T16:52:25.359 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Listen normally on 4 lo [::1]:123 2023-11-28T16:52:25.359 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:cac0%4]:123 2023-11-28T16:52:25.359 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:25 ntpd[27873]: Listening on routing socket on fd #22 for interface updates 2023-11-28T16:52:25.379 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T16:52:25.380 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Command line: ntpd -gq 2023-11-28T16:52:25.380 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: ---------------------------------------------------- 2023-11-28T16:52:25.380 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T16:52:25.380 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T16:52:25.380 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: corporation. Support and training for ntp-4 are 2023-11-28T16:52:25.380 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: available at https://www.nwtime.org/support 2023-11-28T16:52:25.380 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: ---------------------------------------------------- 2023-11-28T16:52:25.381 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: proto: precision = 0.044 usec (-24) 2023-11-28T16:52:25.381 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: basedate set to 2022-02-04 2023-11-28T16:52:25.381 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: gps base set to 2022-02-06 (week 2196) 2023-11-28T16:52:25.381 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T16:52:25.382 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T16:52:25.382 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T16:52:25.382 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T16:52:25.383 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T16:52:25.383 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T16:52:25.383 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T16:52:25.383 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2023-11-28T16:52:25.383 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Listen normally on 4 lo [::1]:123 2023-11-28T16:52:25.383 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2023-11-28T16:52:25.383 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:25 ntpd[28021]: Listening on routing socket on fd #22 for interface updates 2023-11-28T16:52:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:26 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:27 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:27 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:27 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:27.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:27 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:27.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:27 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:27.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:27 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:27.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:27 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:27.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:27 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:27 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:27 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:27 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:27 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:28.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:28 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:28 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:29 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:29 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:29 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:29 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:29 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:29 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:29 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:29 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:29 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:29.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:29 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:29.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:29 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:29.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:29 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:30.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:30.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:30 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:30.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:30.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:30.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:30.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:30.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:30 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:31 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:31 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:31 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:31 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:31 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:31 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:31 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:31 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:31 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:31 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:31 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:31 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stdout:28 Nov 16:52:32 ntpd[27873]: ntpd: time slew -0.000426 s 2023-11-28T16:52:32.356 INFO:teuthology.orchestra.run.smithi026.stdout:ntpd: time slew -0.000426s 2023-11-28T16:52:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T16:52:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:28 Nov 16:52:32 ntpd[27873]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T16:52:32.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:32 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:32.466 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T16:52:32.466 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2023-11-28T16:52:32.466 INFO:teuthology.orchestra.run.smithi026.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:32.466 INFO:teuthology.orchestra.run.smithi026.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:32.466 INFO:teuthology.orchestra.run.smithi026.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:32.466 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:33.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:33.380 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:33.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T16:52:33.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T16:52:33.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T16:52:33.381 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T16:52:33.381 INFO:teuthology.orchestra.run.smithi079.stdout:28 Nov 16:52:33 ntpd[28021]: ntpd: time slew -0.002640 s 2023-11-28T16:52:33.381 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew -0.002640s 2023-11-28T16:52:33.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T16:52:33.382 INFO:teuthology.orchestra.run.smithi079.stderr:28 Nov 16:52:33 ntpd[28021]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T16:52:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T16:52:33.482 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2023-11-28T16:52:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T16:52:33.483 INFO:teuthology.run_tasks:Running task install... 2023-11-28T16:52:33.492 DEBUG:teuthology.task.install:project ceph 2023-11-28T16:52:33.492 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}} 2023-11-28T16:52:33.492 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'} 2023-11-28T16:52:33.492 INFO:teuthology.task.install:Using flavor: default 2023-11-28T16:52:33.498 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T16:52:33.498 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T16:52:33.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-key list | grep Ceph 2023-11-28T16:52:33.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2023-11-28T16:52:33.613 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T16:52:33.630 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T16:52:33.669 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T16:52:33.669 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T16:52:33.669 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T16:52:33.669 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T16:52:33.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T16:52:33.682 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T16:52:33.683 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T16:52:33.684 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T16:52:33.684 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T16:52:33.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T16:52:33.813 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-11-28T16:52:33.813 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:52:33.905 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-11-28T16:52:33.905 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:52:33.920 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:52:33.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T16:52:33.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2023-11-28T16:52:34.039 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:52:34.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T16:52:34.059 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2023-11-28T16:52:34.130 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T16:52:34.138 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T16:52:34.157 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T16:52:34.199 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T16:52:34.238 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T16:52:34.252 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T16:52:34.261 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T16:52:34.275 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-28T16:52:34.280 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T16:52:34.296 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T16:52:34.311 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T16:52:34.317 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-28T16:52:34.339 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T16:52:34.349 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T16:52:34.360 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T16:52:34.372 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T16:52:34.393 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-28T16:52:34.439 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-28T16:52:34.764 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 28.6 kB in 1s (47.8 kB/s) 2023-11-28T16:52:34.856 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 28.6 kB in 1s (49.8 kB/s) 2023-11-28T16:52:35.754 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2023-11-28T16:52:35.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:52:35.770 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-11-28T16:52:35.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:52:35.846 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2023-11-28T16:52:35.857 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-11-28T16:52:36.017 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2023-11-28T16:52:36.018 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2023-11-28T16:52:36.021 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2023-11-28T16:52:36.022 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2023-11-28T16:52:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T16:52:36.174 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T16:52:36.174 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T16:52:36.174 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T16:52:36.174 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T16:52:36.175 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T16:52:36.175 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T16:52:36.175 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2023-11-28T16:52:36.176 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T16:52:36.176 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T16:52:36.176 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T16:52:36.176 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T16:52:36.178 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T16:52:36.178 INFO:teuthology.orchestra.run.smithi079.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T16:52:36.178 INFO:teuthology.orchestra.run.smithi079.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T16:52:36.178 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T16:52:36.179 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T16:52:36.179 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T16:52:36.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T16:52:36.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T16:52:36.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T16:52:36.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T16:52:36.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T16:52:36.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T16:52:36.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T16:52:36.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T16:52:36.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T16:52:36.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T16:52:36.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T16:52:36.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T16:52:36.183 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T16:52:36.183 INFO:teuthology.orchestra.run.smithi079.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T16:52:36.183 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2023-11-28T16:52:36.183 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T16:52:36.184 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T16:52:36.184 INFO:teuthology.orchestra.run.smithi079.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T16:52:36.184 INFO:teuthology.orchestra.run.smithi079.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T16:52:36.184 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T16:52:36.184 INFO:teuthology.orchestra.run.smithi079.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T16:52:36.185 INFO:teuthology.orchestra.run.smithi079.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T16:52:36.185 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2023-11-28T16:52:36.185 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2023-11-28T16:52:36.188 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T16:52:36.189 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T16:52:36.189 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T16:52:36.189 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T16:52:36.189 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T16:52:36.189 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T16:52:36.190 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T16:52:36.190 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2023-11-28T16:52:36.190 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T16:52:36.190 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T16:52:36.190 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T16:52:36.191 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T16:52:36.191 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T16:52:36.192 INFO:teuthology.orchestra.run.smithi026.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T16:52:36.192 INFO:teuthology.orchestra.run.smithi026.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T16:52:36.192 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T16:52:36.192 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T16:52:36.192 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T16:52:36.193 INFO:teuthology.orchestra.run.smithi026.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T16:52:36.193 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T16:52:36.193 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T16:52:36.193 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T16:52:36.193 INFO:teuthology.orchestra.run.smithi026.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T16:52:36.194 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T16:52:36.194 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T16:52:36.194 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T16:52:36.194 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T16:52:36.194 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T16:52:36.195 INFO:teuthology.orchestra.run.smithi026.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T16:52:36.196 INFO:teuthology.orchestra.run.smithi026.stdout:Recommended packages: 2023-11-28T16:52:36.196 INFO:teuthology.orchestra.run.smithi026.stdout: btrfs-tools 2023-11-28T16:52:36.324 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2023-11-28T16:52:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T16:52:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T16:52:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T16:52:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T16:52:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T16:52:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T16:52:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T16:52:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T16:52:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T16:52:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T16:52:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T16:52:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T16:52:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T16:52:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T16:52:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T16:52:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: socat unzip xmlstarlet zip 2023-11-28T16:52:36.335 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2023-11-28T16:52:36.335 INFO:teuthology.orchestra.run.smithi026.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T16:52:36.335 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T16:52:36.336 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T16:52:36.336 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T16:52:36.337 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T16:52:36.338 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T16:52:36.338 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T16:52:36.338 INFO:teuthology.orchestra.run.smithi026.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T16:52:36.338 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T16:52:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T16:52:36.340 INFO:teuthology.orchestra.run.smithi026.stdout: socat unzip xmlstarlet zip 2023-11-28T16:52:36.398 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T16:52:36.398 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 187 MB of archives. 2023-11-28T16:52:36.398 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T16:52:36.398 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T16:52:36.408 INFO:teuthology.orchestra.run.smithi026.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T16:52:36.408 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 187 MB of archives. 2023-11-28T16:52:36.408 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T16:52:36.408 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T16:52:36.420 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T16:52:36.425 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T16:52:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T16:52:36.436 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T16:52:36.474 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-11-28T16:52:36.477 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T16:52:36.480 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T16:52:36.490 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-11-28T16:52:36.497 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T16:52:36.502 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T16:52:36.503 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T16:52:36.507 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T16:52:36.513 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T16:52:36.519 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T16:52:36.552 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T16:52:36.554 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T16:52:36.561 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T16:52:36.563 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T16:52:36.564 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T16:52:36.566 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T16:52:36.569 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T16:52:36.570 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T16:52:36.572 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T16:52:36.574 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T16:52:36.575 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T16:52:36.575 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T16:52:36.579 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T16:52:36.581 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T16:52:36.581 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T16:52:36.587 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T16:52:36.588 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T16:52:36.589 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T16:52:36.590 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T16:52:36.591 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T16:52:36.591 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T16:52:36.593 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T16:52:36.594 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T16:52:36.594 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T16:52:36.603 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T16:52:36.604 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T16:52:36.605 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T16:52:36.606 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T16:52:36.606 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T16:52:36.606 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T16:52:36.612 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T16:52:36.615 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T16:52:36.616 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T16:52:36.617 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T16:52:36.617 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T16:52:36.620 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T16:52:36.620 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T16:52:36.622 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T16:52:36.623 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T16:52:36.633 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T16:52:36.633 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T16:52:36.634 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T16:52:36.634 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T16:52:36.634 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T16:52:36.636 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T16:52:36.637 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T16:52:36.637 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T16:52:36.638 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T16:52:36.638 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T16:52:36.639 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T16:52:36.652 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T16:52:36.653 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T16:52:36.653 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T16:52:36.653 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T16:52:36.655 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T16:52:36.656 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T16:52:36.657 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T16:52:36.658 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T16:52:36.658 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T16:52:36.670 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T16:52:36.671 INFO:teuthology.orchestra.run.smithi026.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T16:52:36.672 INFO:teuthology.orchestra.run.smithi026.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T16:52:36.672 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T16:52:36.674 INFO:teuthology.orchestra.run.smithi026.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T16:52:36.674 INFO:teuthology.orchestra.run.smithi026.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T16:52:36.674 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T16:52:36.674 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T16:52:36.674 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T16:52:36.675 INFO:teuthology.orchestra.run.smithi026.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T16:52:36.675 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T16:52:36.687 INFO:teuthology.orchestra.run.smithi026.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T16:52:36.689 INFO:teuthology.orchestra.run.smithi026.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T16:52:36.689 INFO:teuthology.orchestra.run.smithi026.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T16:52:36.690 INFO:teuthology.orchestra.run.smithi026.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T16:52:36.692 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T16:52:36.692 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T16:52:36.698 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T16:52:36.698 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T16:52:36.698 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T16:52:36.703 INFO:teuthology.orchestra.run.smithi026.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T16:52:36.711 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T16:52:36.713 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T16:52:36.715 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T16:52:36.716 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T16:52:36.717 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T16:52:36.731 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T16:52:36.733 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T16:52:36.734 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T16:52:36.735 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T16:52:36.737 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T16:52:36.749 INFO:teuthology.orchestra.run.smithi026.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T16:52:36.750 INFO:teuthology.orchestra.run.smithi026.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T16:52:36.754 INFO:teuthology.orchestra.run.smithi026.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T16:52:36.754 INFO:teuthology.orchestra.run.smithi026.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T16:52:36.755 INFO:teuthology.orchestra.run.smithi026.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T16:52:36.772 INFO:teuthology.orchestra.run.smithi026.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T16:52:36.774 INFO:teuthology.orchestra.run.smithi026.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T16:52:36.775 INFO:teuthology.orchestra.run.smithi026.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T16:52:36.784 INFO:teuthology.orchestra.run.smithi026.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-11-28T16:52:36.790 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-11-28T16:52:36.792 INFO:teuthology.orchestra.run.smithi026.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T16:52:36.792 INFO:teuthology.orchestra.run.smithi026.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T16:52:36.792 INFO:teuthology.orchestra.run.smithi026.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T16:52:36.793 INFO:teuthology.orchestra.run.smithi026.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T16:52:36.794 INFO:teuthology.orchestra.run.smithi026.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T16:52:36.794 INFO:teuthology.orchestra.run.smithi026.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T16:52:36.794 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T16:52:36.795 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T16:52:36.797 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T16:52:36.798 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T16:52:36.799 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T16:52:36.802 INFO:teuthology.orchestra.run.smithi026.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T16:52:36.802 INFO:teuthology.orchestra.run.smithi026.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T16:52:36.806 INFO:teuthology.orchestra.run.smithi026.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T16:52:36.819 INFO:teuthology.orchestra.run.smithi026.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T16:52:36.820 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T16:52:36.820 INFO:teuthology.orchestra.run.smithi026.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T16:52:36.821 INFO:teuthology.orchestra.run.smithi026.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T16:52:36.822 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T16:52:36.823 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T16:52:36.824 INFO:teuthology.orchestra.run.smithi026.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T16:52:36.827 INFO:teuthology.orchestra.run.smithi026.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T16:52:36.828 INFO:teuthology.orchestra.run.smithi026.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T16:52:36.829 INFO:teuthology.orchestra.run.smithi026.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T16:52:36.835 INFO:teuthology.orchestra.run.smithi026.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T16:52:36.839 INFO:teuthology.orchestra.run.smithi026.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T16:52:36.840 INFO:teuthology.orchestra.run.smithi026.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T16:52:36.842 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T16:52:36.843 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T16:52:36.844 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T16:52:36.844 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T16:52:36.845 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T16:52:36.845 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T16:52:36.852 INFO:teuthology.orchestra.run.smithi026.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T16:52:36.852 INFO:teuthology.orchestra.run.smithi026.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T16:52:36.853 INFO:teuthology.orchestra.run.smithi026.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T16:52:36.853 INFO:teuthology.orchestra.run.smithi026.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T16:52:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T16:52:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T16:52:36.860 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T16:52:36.860 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T16:52:36.862 INFO:teuthology.orchestra.run.smithi026.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T16:52:36.865 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T16:52:36.868 INFO:teuthology.orchestra.run.smithi026.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T16:52:36.869 INFO:teuthology.orchestra.run.smithi026.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T16:52:36.871 INFO:teuthology.orchestra.run.smithi026.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T16:52:36.879 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T16:52:36.881 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T16:52:36.882 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T16:52:36.885 INFO:teuthology.orchestra.run.smithi026.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T16:52:36.887 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T16:52:36.890 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T16:52:36.891 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T16:52:36.892 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T16:52:36.900 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T16:52:36.904 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T16:52:36.905 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T16:52:36.919 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T16:52:36.919 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T16:52:36.920 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T16:52:36.921 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T16:52:36.923 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T16:52:36.924 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T16:52:36.932 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T16:52:36.939 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T16:52:36.939 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T16:52:36.941 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T16:52:36.958 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T16:52:36.974 INFO:teuthology.orchestra.run.smithi026.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-11-28T16:52:36.993 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-11-28T16:52:37.014 INFO:teuthology.orchestra.run.smithi026.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-11-28T16:52:37.034 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-11-28T16:52:37.046 INFO:teuthology.orchestra.run.smithi026.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-11-28T16:52:37.047 INFO:teuthology.orchestra.run.smithi026.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-11-28T16:52:37.053 INFO:teuthology.orchestra.run.smithi026.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-11-28T16:52:37.055 INFO:teuthology.orchestra.run.smithi026.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-11-28T16:52:37.066 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-11-28T16:52:37.068 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-11-28T16:52:37.074 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-11-28T16:52:37.076 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-11-28T16:52:37.088 INFO:teuthology.orchestra.run.smithi026.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-11-28T16:52:37.109 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-11-28T16:52:37.474 INFO:teuthology.orchestra.run.smithi026.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-11-28T16:52:37.502 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-11-28T16:52:37.503 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-11-28T16:52:37.506 INFO:teuthology.orchestra.run.smithi026.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-11-28T16:52:37.520 INFO:teuthology.orchestra.run.smithi026.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-11-28T16:52:37.550 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-11-28T16:52:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-11-28T16:52:39.065 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-11-28T16:52:39.413 INFO:teuthology.orchestra.run.smithi026.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-11-28T16:52:39.419 INFO:teuthology.orchestra.run.smithi026.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-11-28T16:52:39.423 INFO:teuthology.orchestra.run.smithi026.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-11-28T16:52:39.527 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-11-28T16:52:39.539 INFO:teuthology.orchestra.run.smithi026.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-11-28T16:52:39.562 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-11-28T16:52:39.571 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-11-28T16:52:39.657 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-11-28T16:52:40.182 INFO:teuthology.orchestra.run.smithi026.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-11-28T16:52:40.318 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-11-28T16:52:42.253 INFO:teuthology.orchestra.run.smithi026.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-11-28T16:52:42.253 INFO:teuthology.orchestra.run.smithi026.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-11-28T16:52:42.309 INFO:teuthology.orchestra.run.smithi026.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-11-28T16:52:42.420 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-11-28T16:52:42.420 INFO:teuthology.orchestra.run.smithi079.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-11-28T16:52:42.465 INFO:teuthology.orchestra.run.smithi079.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-11-28T16:52:42.471 INFO:teuthology.orchestra.run.smithi026.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-11-28T16:52:42.527 INFO:teuthology.orchestra.run.smithi026.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-11-28T16:52:42.565 INFO:teuthology.orchestra.run.smithi026.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-11-28T16:52:42.570 INFO:teuthology.orchestra.run.smithi079.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-11-28T16:52:42.622 INFO:teuthology.orchestra.run.smithi079.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-11-28T16:52:42.626 INFO:teuthology.orchestra.run.smithi079.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-11-28T16:52:42.708 INFO:teuthology.orchestra.run.smithi026.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-11-28T16:52:42.747 INFO:teuthology.orchestra.run.smithi079.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-11-28T16:52:43.245 INFO:teuthology.orchestra.run.smithi079.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-11-28T16:52:43.246 INFO:teuthology.orchestra.run.smithi079.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-11-28T16:52:43.359 INFO:teuthology.orchestra.run.smithi026.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-11-28T16:52:43.359 INFO:teuthology.orchestra.run.smithi026.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-11-28T16:52:46.143 INFO:teuthology.orchestra.run.smithi079.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-11-28T16:52:46.144 INFO:teuthology.orchestra.run.smithi079.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-11-28T16:52:46.147 INFO:teuthology.orchestra.run.smithi079.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-11-28T16:52:46.147 INFO:teuthology.orchestra.run.smithi079.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-11-28T16:52:46.148 INFO:teuthology.orchestra.run.smithi079.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-11-28T16:52:46.148 INFO:teuthology.orchestra.run.smithi079.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-11-28T16:52:46.893 INFO:teuthology.orchestra.run.smithi079.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-11-28T16:52:46.929 INFO:teuthology.orchestra.run.smithi026.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-11-28T16:52:46.930 INFO:teuthology.orchestra.run.smithi026.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-11-28T16:52:46.932 INFO:teuthology.orchestra.run.smithi026.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-11-28T16:52:46.933 INFO:teuthology.orchestra.run.smithi026.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-11-28T16:52:46.933 INFO:teuthology.orchestra.run.smithi026.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-11-28T16:52:46.934 INFO:teuthology.orchestra.run.smithi026.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-11-28T16:52:47.460 INFO:teuthology.orchestra.run.smithi026.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-11-28T16:52:47.526 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 187 MB in 11s (17.7 MB/s) 2023-11-28T16:52:47.670 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T16:52:47.739 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T16:52:47.743 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T16:52:47.794 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T16:52:48.096 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T16:52:48.110 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T16:52:48.135 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 187 MB in 11s (16.8 MB/s) 2023-11-28T16:52:48.146 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T16:52:48.289 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T16:52:48.359 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T16:52:48.362 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T16:52:48.404 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T16:52:48.466 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T16:52:48.480 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T16:52:48.549 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T16:52:48.707 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T16:52:48.721 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T16:52:48.765 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T16:52:48.894 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T16:52:48.909 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T16:52:48.994 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T16:52:49.085 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T16:52:49.099 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T16:52:49.135 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T16:52:49.364 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T16:52:49.379 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T16:52:49.422 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T16:52:49.429 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T16:52:49.443 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T16:52:49.538 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T16:52:49.792 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T16:52:49.807 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T16:52:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T16:52:49.867 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T16:52:49.882 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T16:52:49.925 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T16:52:50.270 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T16:52:50.285 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T16:52:50.286 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T16:52:50.301 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T16:52:50.329 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:52:50.344 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T16:52:50.732 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T16:52:50.746 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T16:52:50.765 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T16:52:50.780 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T16:52:50.790 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:52:50.823 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:52:51.209 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T16:52:51.225 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T16:52:51.227 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T16:52:51.241 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T16:52:51.293 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:52:51.293 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:52:51.629 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T16:52:51.644 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T16:52:51.687 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:52:51.722 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T16:52:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T16:52:51.788 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T16:52:52.049 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T16:52:52.064 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T16:52:52.099 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T16:52:52.166 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2023-11-28T16:52:52.181 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:52.224 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:52.403 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librados2. 2023-11-28T16:52:52.418 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:52.459 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:52.712 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2023-11-28T16:52:52.725 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:52.777 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:52.879 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librbd1. 2023-11-28T16:52:52.894 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:52.938 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:53.288 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T16:52:53.303 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:53.355 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:53.515 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T16:52:53.531 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:53.598 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:53.716 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2023-11-28T16:52:53.730 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:53.783 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:53.851 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rados. 2023-11-28T16:52:53.866 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:53.901 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:54.093 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T16:52:54.108 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:52:54.152 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:54.220 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T16:52:54.235 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:52:54.278 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:54.471 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T16:52:54.485 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:54.531 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T16:52:54.537 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:54.547 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:54.589 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:54.925 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T16:52:54.941 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:52:54.948 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T16:52:54.963 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:52:54.984 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:55.015 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:55.362 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T16:52:55.377 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T16:52:55.412 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T16:52:55.435 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T16:52:55.449 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T16:52:55.502 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T16:52:55.623 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T16:52:55.639 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:55.681 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:55.812 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T16:52:55.827 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:55.870 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:56.100 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T16:52:56.116 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T16:52:56.159 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T16:52:56.240 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T16:52:56.255 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T16:52:56.331 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T16:52:56.436 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T16:52:56.451 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T16:52:56.511 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T16:52:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T16:52:56.674 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T16:52:56.726 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T16:52:56.823 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T16:52:56.838 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T16:52:56.889 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T16:52:57.104 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T16:52:57.119 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T16:52:57.170 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T16:52:57.318 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua5.1. 2023-11-28T16:52:57.334 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T16:52:57.384 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T16:52:57.507 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua5.1. 2023-11-28T16:52:57.522 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T16:52:57.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T16:52:57.770 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-any. 2023-11-28T16:52:57.786 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T16:52:57.829 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T16:52:57.893 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-any. 2023-11-28T16:52:57.908 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T16:52:57.952 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T16:52:58.106 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package zip. 2023-11-28T16:52:58.122 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T16:52:58.187 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package zip. 2023-11-28T16:52:58.202 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T16:52:58.204 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T16:52:58.246 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T16:52:58.591 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package unzip. 2023-11-28T16:52:58.593 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package unzip. 2023-11-28T16:52:58.606 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T16:52:58.608 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T16:52:58.649 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T16:52:58.659 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T16:52:59.011 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package luarocks. 2023-11-28T16:52:59.026 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T16:52:59.069 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T16:52:59.147 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package luarocks. 2023-11-28T16:52:59.162 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T16:52:59.205 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T16:52:59.427 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2023-11-28T16:52:59.441 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:59.502 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:59.613 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librgw2. 2023-11-28T16:52:59.627 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:52:59.663 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:52:59.963 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T16:52:59.977 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:00.038 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:00.132 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T16:53:00.146 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:00.190 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:00.365 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T16:53:00.380 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T16:53:00.432 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T16:53:00.610 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T16:53:00.624 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T16:53:00.676 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T16:53:00.735 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T16:53:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:00.785 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:01.054 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T16:53:01.069 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:01.155 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:01.205 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2023-11-28T16:53:01.220 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:01.263 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:01.608 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-common. 2023-11-28T16:53:01.623 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:01.705 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:02.385 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2023-11-28T16:53:02.400 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:02.453 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:02.846 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-base. 2023-11-28T16:53:02.862 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:02.923 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:03.156 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T16:53:03.169 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T16:53:03.214 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T16:53:03.542 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T16:53:03.556 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T16:53:03.609 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T16:53:03.742 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T16:53:03.757 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T16:53:03.953 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T16:53:03.968 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T16:53:04.001 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T16:53:04.011 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T16:53:04.289 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T16:53:04.304 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T16:53:04.364 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T16:53:04.378 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T16:53:04.394 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T16:53:04.445 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T16:53:04.625 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T16:53:04.640 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T16:53:04.684 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T16:53:04.798 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T16:53:04.813 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T16:53:04.856 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T16:53:05.020 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T16:53:05.035 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T16:53:05.078 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T16:53:05.167 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T16:53:05.183 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T16:53:05.225 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T16:53:05.406 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2023-11-28T16:53:05.421 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T16:53:05.464 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T16:53:05.495 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T16:53:05.511 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T16:53:05.545 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T16:53:05.726 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T16:53:05.741 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T16:53:05.775 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T16:53:05.873 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T16:53:05.889 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T16:53:05.931 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T16:53:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T16:53:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T16:53:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T16:53:06.234 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-portend. 2023-11-28T16:53:06.249 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T16:53:06.318 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T16:53:06.515 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T16:53:06.533 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T16:53:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T16:53:06.604 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T16:53:06.619 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T16:53:06.654 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T16:53:06.860 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T16:53:06.875 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T16:53:06.910 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T16:53:06.973 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T16:53:06.989 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T16:53:07.032 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T16:53:07.229 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T16:53:07.244 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T16:53:07.287 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T16:53:07.385 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T16:53:07.400 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T16:53:07.468 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T16:53:07.623 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2023-11-28T16:53:07.638 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T16:53:07.682 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T16:53:07.746 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T16:53:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T16:53:07.805 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T16:53:08.044 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T16:53:08.058 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T16:53:08.102 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T16:53:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T16:53:08.148 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T16:53:08.191 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T16:53:08.371 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T16:53:08.386 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T16:53:08.421 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T16:53:08.724 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2023-11-28T16:53:08.739 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T16:53:08.782 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T16:53:09.085 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-mako. 2023-11-28T16:53:09.101 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T16:53:09.144 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T16:53:09.160 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T16:53:09.174 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T16:53:09.221 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T16:53:09.497 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T16:53:09.513 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T16:53:09.572 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T16:53:09.858 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T16:53:09.874 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T16:53:09.916 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T16:53:10.172 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T16:53:10.187 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T16:53:10.202 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webob. 2023-11-28T16:53:10.219 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T16:53:10.230 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T16:53:10.260 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T16:53:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2023-11-28T16:53:10.574 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T16:53:10.597 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T16:53:10.613 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T16:53:10.616 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T16:53:10.682 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T16:53:10.952 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T16:53:10.967 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T16:53:10.991 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T16:53:11.007 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T16:53:11.011 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T16:53:11.050 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T16:53:11.314 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T16:53:11.329 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T16:53:11.374 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T16:53:11.403 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-paste. 2023-11-28T16:53:11.419 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T16:53:11.461 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T16:53:11.675 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T16:53:11.690 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T16:53:11.725 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T16:53:11.781 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T16:53:11.796 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T16:53:11.856 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T16:53:12.077 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T16:53:12.092 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T16:53:12.136 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T16:53:12.158 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T16:53:12.174 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T16:53:12.216 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T16:53:12.516 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T16:53:12.519 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T16:53:12.531 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T16:53:12.534 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T16:53:12.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T16:53:12.569 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T16:53:12.839 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T16:53:12.854 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T16:53:12.869 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2023-11-28T16:53:12.884 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T16:53:12.897 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T16:53:12.926 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T16:53:13.262 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T16:53:13.263 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T16:53:13.275 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T16:53:13.278 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T16:53:13.319 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T16:53:13.329 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T16:53:13.666 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2023-11-28T16:53:13.681 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T16:53:13.724 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T16:53:13.772 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-idna. 2023-11-28T16:53:13.787 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T16:53:13.830 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T16:53:14.060 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T16:53:14.076 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T16:53:14.118 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T16:53:14.149 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T16:53:14.165 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T16:53:14.233 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T16:53:14.413 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T16:53:14.428 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:14.471 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:14.678 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests. 2023-11-28T16:53:14.693 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T16:53:14.736 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T16:53:14.868 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T16:53:14.882 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:14.926 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:15.081 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T16:53:15.096 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T16:53:15.155 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T16:53:15.212 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T16:53:15.227 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T16:53:15.279 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T16:53:15.477 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T16:53:15.491 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:15.533 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:15.598 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T16:53:15.613 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T16:53:15.657 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T16:53:15.880 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T16:53:15.895 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:15.954 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:15.993 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T16:53:16.008 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:16.051 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:16.257 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T16:53:16.273 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T16:53:16.316 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T16:53:16.413 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T16:53:16.428 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:16.462 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:16.618 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T16:53:16.635 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T16:53:16.677 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T16:53:17.013 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T16:53:17.028 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:17.096 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:17.333 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T16:53:17.348 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:17.391 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:17.449 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T16:53:17.465 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:17.508 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:18.336 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T16:53:18.352 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:18.394 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:18.669 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2023-11-28T16:53:18.684 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:18.727 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:19.055 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T16:53:19.070 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:19.104 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:19.424 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T16:53:19.438 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:19.507 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:19.606 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph. 2023-11-28T16:53:19.622 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:19.656 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:19.877 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2023-11-28T16:53:19.891 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:19.935 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:19.958 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T16:53:19.974 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:20.017 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:20.272 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T16:53:20.286 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T16:53:20.329 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T16:53:20.378 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T16:53:20.394 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:20.436 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:20.676 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T16:53:20.691 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T16:53:20.751 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T16:53:20.822 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephadm. 2023-11-28T16:53:20.838 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:20.881 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:21.217 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T16:53:21.233 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T16:53:21.275 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T16:53:21.586 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T16:53:21.601 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T16:53:21.669 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T16:53:22.115 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2023-11-28T16:53:22.129 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T16:53:22.173 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T16:53:22.493 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T16:53:22.507 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T16:53:22.568 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T16:53:22.607 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-babel. 2023-11-28T16:53:22.622 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T16:53:22.665 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T16:53:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T16:53:22.902 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:22.938 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:23.010 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T16:53:23.024 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T16:53:23.068 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T16:53:23.283 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T16:53:23.298 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T16:53:23.333 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T16:53:23.455 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T16:53:23.471 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:23.505 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:23.671 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2023-11-28T16:53:23.685 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T16:53:23.728 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T16:53:23.800 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T16:53:23.814 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T16:53:23.849 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T16:53:24.039 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T16:53:24.055 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:24.098 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:24.177 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-routes. 2023-11-28T16:53:24.192 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T16:53:24.235 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T16:53:24.560 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T16:53:24.574 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T16:53:24.614 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T16:53:24.630 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:24.642 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T16:53:24.672 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:25.080 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T16:53:25.094 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T16:53:25.127 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T16:53:25.142 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T16:53:25.154 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T16:53:25.184 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T16:53:25.510 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T16:53:25.523 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T16:53:25.629 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T16:53:25.644 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T16:53:25.678 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T16:53:25.712 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T16:53:25.948 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T16:53:25.962 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T16:53:26.006 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T16:53:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T16:53:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T16:53:26.274 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T16:53:26.537 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T16:53:26.553 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T16:53:26.595 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T16:53:26.674 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T16:53:26.689 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:26.758 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:27.265 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T16:53:27.279 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:27.323 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:27.744 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T16:53:27.760 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T16:53:27.827 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T16:53:28.098 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T16:53:28.113 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T16:53:28.148 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T16:53:28.310 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T16:53:28.326 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T16:53:28.367 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T16:53:28.501 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T16:53:28.517 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T16:53:28.559 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T16:53:28.679 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T16:53:28.696 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T16:53:28.737 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T16:53:28.904 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T16:53:28.920 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T16:53:28.963 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T16:53:29.074 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T16:53:29.090 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T16:53:29.132 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T16:53:29.283 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T16:53:29.299 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T16:53:29.366 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T16:53:29.443 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T16:53:29.459 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T16:53:29.501 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T16:53:29.729 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T16:53:29.744 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T16:53:29.778 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T16:53:30.031 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T16:53:30.047 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T16:53:30.089 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T16:53:30.107 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T16:53:30.123 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T16:53:30.165 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T16:53:30.442 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T16:53:30.458 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T16:53:30.477 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T16:53:30.493 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T16:53:30.500 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T16:53:30.527 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T16:53:30.795 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T16:53:30.811 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T16:53:30.853 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T16:53:31.189 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T16:53:31.205 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T16:53:31.248 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T16:53:31.249 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T16:53:31.264 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:31.308 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:31.661 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T16:53:31.675 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T16:53:31.719 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T16:53:31.953 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T16:53:31.968 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:32.011 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:32.039 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T16:53:32.053 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T16:53:32.089 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T16:53:32.317 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2023-11-28T16:53:32.332 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T16:53:32.364 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T16:53:32.375 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T16:53:32.378 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T16:53:32.422 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T16:53:32.662 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2023-11-28T16:53:32.677 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T16:53:32.720 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T16:53:32.800 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T16:53:32.816 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T16:53:32.858 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T16:53:33.057 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T16:53:33.072 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T16:53:33.111 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package jq. 2023-11-28T16:53:33.115 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T16:53:33.127 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T16:53:33.161 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T16:53:33.414 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package socat. 2023-11-28T16:53:33.430 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T16:53:33.472 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T16:53:33.514 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2023-11-28T16:53:33.526 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:33.570 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:33.775 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T16:53:33.791 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T16:53:33.833 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T16:53:34.179 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-test. 2023-11-28T16:53:34.194 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:34.237 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:35.507 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T16:53:35.523 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:35.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:35.962 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T16:53:35.977 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:36.020 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:36.141 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T16:53:36.157 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:36.200 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:36.331 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T16:53:36.347 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T16:53:36.381 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T16:53:36.587 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T16:53:36.603 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:36.609 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T16:53:36.624 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:36.647 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:36.676 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:36.954 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T16:53:36.969 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:36.994 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T16:53:37.010 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T16:53:37.011 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:37.056 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T16:53:37.284 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T16:53:37.289 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T16:53:37.299 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:37.305 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:37.342 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:37.348 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:37.620 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T16:53:37.635 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T16:53:37.676 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T16:53:37.678 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:37.691 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T16:53:37.768 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T16:53:37.930 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T16:53:37.946 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:37.990 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:38.072 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T16:53:38.088 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T16:53:38.122 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T16:53:38.324 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T16:53:38.340 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T16:53:38.382 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T16:53:38.535 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T16:53:38.551 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T16:53:38.593 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T16:53:38.654 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T16:53:38.669 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T16:53:38.745 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T16:53:39.024 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package pkg-config. 2023-11-28T16:53:39.039 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T16:53:39.082 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T16:53:39.116 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T16:53:39.132 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T16:53:39.174 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T16:53:39.360 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T16:53:39.376 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T16:53:39.419 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T16:53:39.596 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package pkg-config. 2023-11-28T16:53:39.611 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T16:53:39.654 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T16:53:39.839 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T16:53:39.854 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T16:53:39.897 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T16:53:39.965 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T16:53:39.981 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T16:53:40.023 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T16:53:40.200 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T16:53:40.216 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T16:53:40.258 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T16:53:40.451 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T16:53:40.467 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T16:53:40.510 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T16:53:40.612 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T16:53:40.627 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T16:53:40.670 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T16:53:40.812 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T16:53:40.829 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T16:53:40.870 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T16:53:40.990 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T16:53:41.006 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T16:53:41.040 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T16:53:41.215 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T16:53:41.232 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T16:53:41.273 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T16:53:41.435 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2023-11-28T16:53:41.451 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T16:53:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T16:53:41.618 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T16:53:41.634 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T16:53:41.676 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T16:53:41.813 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T16:53:41.829 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T16:53:41.863 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T16:53:42.022 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-py. 2023-11-28T16:53:42.038 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T16:53:42.079 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T16:53:42.309 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T16:53:42.325 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T16:53:42.367 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T16:53:42.399 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T16:53:42.414 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T16:53:42.457 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T16:53:42.687 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2023-11-28T16:53:42.703 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T16:53:42.737 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T16:53:42.895 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T16:53:42.910 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T16:53:42.945 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T16:53:43.040 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T16:53:43.056 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T16:53:43.098 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T16:53:43.222 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-toml. 2023-11-28T16:53:43.237 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T16:53:43.280 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T16:53:43.402 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T16:53:43.417 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T16:53:43.452 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T16:53:43.616 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T16:53:43.632 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T16:53:43.674 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T16:53:43.696 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T16:53:43.711 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T16:53:43.747 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T16:53:43.995 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T16:53:44.011 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T16:53:44.053 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T16:53:44.306 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T16:53:44.322 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T16:53:44.364 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T16:53:44.451 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2023-11-28T16:53:44.465 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:44.509 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:45.163 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T16:53:45.179 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:45.221 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:45.268 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package radosgw. 2023-11-28T16:53:45.283 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:45.318 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:45.515 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T16:53:45.768 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T16:53:45.894 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T16:53:45.896 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T16:53:45.911 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T16:53:45.954 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:46.152 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T16:53:46.241 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T16:53:46.563 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T16:53:46.567 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T16:53:46.685 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T16:53:46.938 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T16:53:47.149 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T16:53:47.181 INFO:teuthology.orchestra.run.smithi079.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T16:53:47.229 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:47.353 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T16:53:47.800 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2023-11-28T16:53:47.961 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T16:53:48.000 INFO:teuthology.orchestra.run.smithi026.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T16:53:48.015 INFO:teuthology.orchestra.run.smithi026.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T16:53:48.071 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:48.263 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T16:53:48.514 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T16:53:48.631 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T16:53:48.758 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user cephadm....done 2023-11-28T16:53:48.883 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T16:53:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T16:53:49.159 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T16:53:49.319 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T16:53:49.366 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T16:53:49.637 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T16:53:49.712 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T16:53:49.941 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T16:53:49.989 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T16:53:50.249 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T16:53:50.270 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T16:53:50.526 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T16:53:50.575 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T16:53:50.701 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T16:53:50.827 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T16:53:51.019 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T16:53:51.078 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T16:53:51.380 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T16:53:51.397 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T16:53:51.673 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T16:53:51.698 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T16:53:51.940 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:51.974 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T16:53:52.192 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T16:53:52.292 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T16:53:52.351 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T16:53:52.478 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T16:53:52.552 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T16:53:52.853 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T16:53:52.962 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T16:53:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T16:53:53.121 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T16:53:53.306 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T16:53:53.422 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:53.681 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T16:53:53.685 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T16:53:53.736 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T16:53:53.801 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T16:53:53.832 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T16:53:53.927 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T16:53:53.958 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T16:53:54.251 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T16:53:54.329 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T16:53:54.402 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T16:53:54.438 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T16:53:54.669 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T16:53:54.731 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T16:53:55.030 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T16:53:55.032 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T16:53:55.083 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T16:53:55.139 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T16:53:55.342 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T16:53:55.448 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T16:53:55.476 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T16:53:55.908 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T16:53:56.068 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T16:53:56.187 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T16:53:56.369 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T16:53:56.455 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T16:53:56.597 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T16:53:56.678 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T16:53:56.698 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T16:53:56.999 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T16:53:57.021 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T16:53:57.172 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T16:53:57.434 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T16:53:57.694 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T16:53:57.916 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T16:53:58.121 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T16:53:58.192 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T16:53:58.318 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T16:53:58.397 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T16:53:58.461 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T16:53:58.715 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T16:53:58.795 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T16:53:59.049 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T16:53:59.213 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T16:53:59.343 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T16:53:59.455 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T16:53:59.469 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:53:59.779 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T16:53:59.865 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T16:54:00.146 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T16:54:00.175 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T16:54:00.535 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T16:54:00.970 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T16:54:01.279 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T16:54:01.369 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T16:54:01.380 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:01.613 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:54:01.673 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T16:54:01.756 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T16:54:02.024 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T16:54:02.032 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T16:54:02.200 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T16:54:02.326 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T16:54:02.627 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T16:54:02.920 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T16:54:03.221 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:54:03.330 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T16:54:03.343 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T16:54:03.590 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:54:03.633 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T16:54:03.741 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T16:54:03.934 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T16:54:04.034 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T16:54:04.185 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T16:54:04.210 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T16:54:04.311 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T16:54:04.511 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T16:54:04.629 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T16:54:04.804 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T16:54:04.922 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T16:54:05.080 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T16:54:05.173 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:54:05.181 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T16:54:05.332 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T16:54:05.474 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T16:54:05.602 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T16:54:05.659 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T16:54:05.895 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T16:54:05.951 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T16:54:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T16:54:06.253 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T16:54:06.447 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T16:54:06.537 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T16:54:06.565 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T16:54:06.691 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T16:54:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T16:54:06.813 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T16:54:07.035 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T16:54:07.081 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T16:54:07.136 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T16:54:07.207 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T16:54:07.521 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T16:54:07.534 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T16:54:07.684 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T16:54:07.790 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T16:54:07.948 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T16:54:07.994 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T16:54:08.216 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:54:08.337 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T16:54:08.342 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T16:54:08.638 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T16:54:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T16:54:08.797 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T16:54:08.898 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T16:54:08.986 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T16:54:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T16:54:09.233 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T16:54:09.288 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T16:54:09.384 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T16:54:09.507 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T16:54:09.776 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T16:54:09.794 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T16:54:10.044 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T16:54:10.103 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T16:54:10.221 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T16:54:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T16:54:10.480 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T16:54:10.581 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T16:54:10.681 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T16:54:10.924 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T16:54:11.007 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T16:54:11.276 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T16:54:11.360 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T16:54:11.519 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:11.568 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T16:54:11.637 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:11.747 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T16:54:11.805 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T16:54:12.081 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T16:54:12.092 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:12.218 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:12.344 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T16:54:12.349 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T16:54:12.627 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T16:54:12.637 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:12.747 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:12.873 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:13.029 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T16:54:13.081 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T16:54:13.081 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T16:54:13.305 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T16:54:13.674 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T16:54:13.749 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:13.825 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:14.001 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:14.002 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:14.153 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T16:54:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:14.270 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T16:54:14.547 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:14.673 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:14.824 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T16:54:15.143 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:15.268 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:15.395 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:15.524 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:15.614 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T16:54:15.614 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T16:54:15.675 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:15.802 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:15.903 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:16.004 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:16.147 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:16.288 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:16.405 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:16.531 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:16.674 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:16.718 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2023-11-28T16:54:16.850 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T16:54:17.119 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2023-11-28T16:54:17.322 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2023-11-28T16:54:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T16:54:17.485 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T16:54:17.889 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T16:54:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:18.329 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:18.430 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:18.549 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:18.581 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:18.708 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:18.757 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T16:54:18.757 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T16:54:18.833 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:19.384 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:19.404 INFO:teuthology.orchestra.run.smithi026.stdout:Adding group ceph....done 2023-11-28T16:54:19.510 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:19.813 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user ceph....done 2023-11-28T16:54:19.974 INFO:teuthology.orchestra.run.smithi026.stdout:Setting system user ceph properties....done 2023-11-28T16:54:19.990 INFO:teuthology.orchestra.run.smithi026.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T16:54:20.047 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T16:54:20.048 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T16:54:20.140 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T16:54:20.559 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T16:54:20.654 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:21.019 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T16:54:21.210 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:21.444 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T16:54:21.444 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T16:54:21.672 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:21.929 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T16:54:21.929 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T16:54:22.078 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:22.229 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:22.541 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:22.755 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T16:54:22.755 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T16:54:22.779 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T16:54:22.779 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T16:54:23.384 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:23.422 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:23.720 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T16:54:23.720 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T16:54:23.790 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T16:54:24.353 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:24.449 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:24.454 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:24.597 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:24.720 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T16:54:24.720 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T16:54:24.807 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T16:54:24.807 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T16:54:25.342 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:25.465 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:25.604 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T16:54:25.604 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T16:54:25.651 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:25.802 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:25.970 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:26.341 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T16:54:26.521 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T16:54:26.529 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T16:54:26.529 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T16:54:26.805 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T16:54:27.155 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:27.306 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:27.448 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:27.665 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T16:54:27.665 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T16:54:28.062 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T16:54:28.300 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:28.492 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:28.652 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:28.737 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T16:54:28.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T16:54:28.816 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-11-28T16:54:28.828 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T16:54:28.982 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2023-11-28T16:54:28.983 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2023-11-28T16:54:29.134 INFO:teuthology.orchestra.run.smithi079.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T16:54:29.134 INFO:teuthology.orchestra.run.smithi079.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T16:54:29.134 INFO:teuthology.orchestra.run.smithi079.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T16:54:29.135 INFO:teuthology.orchestra.run.smithi079.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T16:54:29.135 INFO:teuthology.orchestra.run.smithi079.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T16:54:29.135 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T16:54:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T16:54:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T16:54:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T16:54:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T16:54:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T16:54:29.136 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T16:54:29.136 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T16:54:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T16:54:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: libengine-pkcs11-openssl 2023-11-28T16:54:29.186 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2023-11-28T16:54:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T16:54:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T16:54:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T16:54:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T16:54:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T16:54:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T16:54:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T16:54:29.188 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2023-11-28T16:54:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: libssl3 2023-11-28T16:54:29.231 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T16:54:29.298 INFO:teuthology.orchestra.run.smithi079.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T16:54:29.298 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 54.6 MB of archives. 2023-11-28T16:54:29.299 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T16:54:29.299 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T16:54:29.348 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T16:54:29.527 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T16:54:29.533 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T16:54:29.606 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T16:54:29.619 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T16:54:29.620 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T16:54:29.622 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T16:54:29.624 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T16:54:29.625 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T16:54:29.626 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T16:54:29.627 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T16:54:29.627 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T16:54:29.634 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T16:54:29.651 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T16:54:29.994 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T16:54:29.996 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T16:54:29.996 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T16:54:29.998 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T16:54:29.999 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T16:54:30.003 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T16:54:30.005 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T16:54:30.012 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T16:54:30.012 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T16:54:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T16:54:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T16:54:30.056 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T16:54:30.083 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T16:54:30.087 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T16:54:30.090 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T16:54:30.091 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T16:54:30.092 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T16:54:30.104 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T16:54:30.119 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T16:54:30.324 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T16:54:30.324 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T16:54:30.324 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T16:54:30.324 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T16:54:30.325 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T16:54:30.325 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T16:54:30.339 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T16:54:30.339 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T16:54:30.617 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T16:54:30.717 INFO:teuthology.orchestra.run.smithi079.stdout:Preconfiguring packages ... 2023-11-28T16:54:30.870 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 54.6 MB in 1s (47.7 MB/s) 2023-11-28T16:54:31.051 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package flex. 2023-11-28T16:54:31.125 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-11-28T16:54:31.127 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T16:54:31.177 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T16:54:31.434 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T16:54:31.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T16:54:31.517 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2023-11-28T16:54:31.688 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2023-11-28T16:54:31.689 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2023-11-28T16:54:31.772 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T16:54:31.847 INFO:teuthology.orchestra.run.smithi026.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T16:54:31.847 INFO:teuthology.orchestra.run.smithi026.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T16:54:31.847 INFO:teuthology.orchestra.run.smithi026.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T16:54:31.848 INFO:teuthology.orchestra.run.smithi026.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T16:54:31.848 INFO:teuthology.orchestra.run.smithi026.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T16:54:31.848 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T16:54:31.848 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T16:54:31.848 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T16:54:31.848 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T16:54:31.848 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T16:54:31.849 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T16:54:31.849 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T16:54:31.849 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2023-11-28T16:54:31.849 INFO:teuthology.orchestra.run.smithi026.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T16:54:31.849 INFO:teuthology.orchestra.run.smithi026.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T16:54:31.849 INFO:teuthology.orchestra.run.smithi026.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T16:54:31.850 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T16:54:31.850 INFO:teuthology.orchestra.run.smithi026.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T16:54:31.850 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2023-11-28T16:54:31.850 INFO:teuthology.orchestra.run.smithi026.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T16:54:31.850 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T16:54:31.850 INFO:teuthology.orchestra.run.smithi026.stdout: libengine-pkcs11-openssl 2023-11-28T16:54:31.900 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2023-11-28T16:54:31.901 INFO:teuthology.orchestra.run.smithi026.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T16:54:31.901 INFO:teuthology.orchestra.run.smithi026.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T16:54:31.902 INFO:teuthology.orchestra.run.smithi026.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T16:54:31.902 INFO:teuthology.orchestra.run.smithi026.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T16:54:31.902 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T16:54:31.902 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T16:54:31.902 INFO:teuthology.orchestra.run.smithi026.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T16:54:31.902 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages will be upgraded: 2023-11-28T16:54:31.903 INFO:teuthology.orchestra.run.smithi026.stdout: libssl3 2023-11-28T16:54:31.933 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T16:54:31.971 INFO:teuthology.orchestra.run.smithi026.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T16:54:31.971 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 54.6 MB of archives. 2023-11-28T16:54:31.971 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T16:54:31.971 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T16:54:32.095 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T16:54:32.167 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T16:54:32.179 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T16:54:32.180 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T16:54:32.181 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T16:54:32.183 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T16:54:32.183 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T16:54:32.185 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T16:54:32.186 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T16:54:32.187 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T16:54:32.196 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T16:54:32.207 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T16:54:32.367 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T16:54:32.605 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T16:54:32.607 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T16:54:32.607 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T16:54:32.610 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T16:54:32.610 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T16:54:32.614 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T16:54:32.616 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T16:54:32.624 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T16:54:32.624 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T16:54:32.661 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T16:54:32.664 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T16:54:32.674 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T16:54:32.703 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T16:54:32.712 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T16:54:32.713 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T16:54:32.714 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T16:54:32.714 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T16:54:32.733 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T16:54:32.743 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T16:54:32.909 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package bison. 2023-11-28T16:54:32.981 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T16:54:32.981 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T16:54:32.982 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-11-28T16:54:32.982 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T16:54:32.982 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T16:54:32.982 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T16:54:32.982 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T16:54:32.985 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T16:54:32.996 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T16:54:32.996 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T16:54:33.029 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T16:54:33.392 INFO:teuthology.orchestra.run.smithi026.stdout:Preconfiguring packages ... 2023-11-28T16:54:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T16:54:33.461 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T16:54:33.505 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T16:54:33.565 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 54.6 MB in 1s (50.3 MB/s) 2023-11-28T16:54:33.741 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package flex. 2023-11-28T16:54:33.817 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-11-28T16:54:33.820 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T16:54:33.882 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T16:54:33.993 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package dump. 2023-11-28T16:54:34.008 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T16:54:34.043 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T16:54:34.355 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package indent. 2023-11-28T16:54:34.370 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:34.414 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T16:54:34.452 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T16:54:34.621 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T16:54:34.683 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T16:54:34.699 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T16:54:34.741 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T16:54:35.038 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T16:54:35.070 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T16:54:35.086 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T16:54:35.129 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T16:54:35.415 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T16:54:35.430 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T16:54:35.473 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T16:54:35.646 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package bison. 2023-11-28T16:54:35.723 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-11-28T16:54:35.726 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T16:54:35.774 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T16:54:35.827 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T16:54:35.842 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T16:54:35.877 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T16:54:36.113 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T16:54:36.128 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T16:54:36.196 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T16:54:36.352 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T16:54:36.367 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T16:54:36.443 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T16:54:36.449 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T16:54:36.464 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T16:54:36.507 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T16:54:36.712 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package dump. 2023-11-28T16:54:36.728 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T16:54:36.771 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T16:54:36.819 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T16:54:36.834 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T16:54:36.869 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T16:54:37.057 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package indent. 2023-11-28T16:54:37.073 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:37.115 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T16:54:37.359 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T16:54:37.376 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T16:54:37.418 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T16:54:37.738 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T16:54:37.754 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T16:54:37.796 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T16:54:38.024 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T16:54:38.040 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T16:54:38.082 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T16:54:38.255 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T16:54:38.271 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T16:54:38.313 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:54:38.402 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T16:54:38.418 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T16:54:38.460 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T16:54:38.599 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T16:54:38.615 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T16:54:38.658 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:54:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T16:54:38.729 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T16:54:38.779 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T16:54:38.999 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T16:54:39.015 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T16:54:39.049 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T16:54:39.070 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T16:54:39.086 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T16:54:39.120 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:54:39.385 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T16:54:39.401 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T16:54:39.443 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T16:54:39.489 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T16:54:39.505 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T16:54:39.548 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T16:54:39.884 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T16:54:39.900 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T16:54:39.934 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T16:54:40.270 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T16:54:40.286 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:40.345 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:40.715 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T16:54:40.731 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:40.773 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:54:40.813 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T16:54:40.829 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T16:54:40.871 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:54:41.118 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T16:54:41.134 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:41.168 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:54:41.181 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T16:54:41.198 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T16:54:41.240 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:54:41.387 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T16:54:41.402 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T16:54:41.445 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T16:54:41.610 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T16:54:41.626 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T16:54:41.693 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:54:41.924 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T16:54:41.939 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T16:54:41.974 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T16:54:42.030 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T16:54:42.045 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T16:54:42.087 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T16:54:42.344 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package modemmanager. 2023-11-28T16:54:42.360 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T16:54:42.402 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:54:42.449 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T16:54:42.465 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T16:54:42.507 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T16:54:42.868 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T16:54:42.884 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:42.926 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:43.034 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package network-manager. 2023-11-28T16:54:43.050 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T16:54:43.126 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T16:54:43.237 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T16:54:43.253 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:43.295 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:54:43.598 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T16:54:43.614 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:43.648 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:54:43.758 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ppp. 2023-11-28T16:54:43.774 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T16:54:43.875 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T16:54:43.891 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T16:54:43.958 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T16:54:44.158 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T16:54:44.465 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T16:54:44.470 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T16:54:44.479 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T16:54:44.487 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T16:54:44.515 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T16:54:44.554 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T16:54:44.784 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T16:54:44.799 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T16:54:44.843 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T16:54:44.906 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package modemmanager. 2023-11-28T16:54:44.923 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T16:54:44.965 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:54:45.162 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T16:54:45.177 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T16:54:45.221 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T16:54:45.517 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T16:54:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:45.575 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:45.596 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager. 2023-11-28T16:54:45.612 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T16:54:45.663 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T16:54:46.097 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T16:54:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T16:54:46.173 INFO:teuthology.orchestra.run.smithi079.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T16:54:46.229 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-common (238) ... 2023-11-28T16:54:46.320 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ppp. 2023-11-28T16:54:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T16:54:46.680 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T16:54:46.687 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T16:54:46.695 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:46.766 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:47.258 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T16:54:47.274 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T16:54:47.325 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T16:54:47.645 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T16:54:47.661 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T16:54:47.713 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T16:54:47.884 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql. 2023-11-28T16:54:47.899 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T16:54:47.975 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql (14+238) ... 2023-11-28T16:54:48.106 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T16:54:48.122 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T16:54:48.172 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T16:54:48.203 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T16:54:48.217 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T16:54:48.261 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T16:54:48.493 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T16:54:48.509 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:48.514 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T16:54:48.529 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T16:54:48.551 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:48.572 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T16:54:48.891 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T16:54:48.907 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T16:54:48.950 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T16:54:49.081 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T16:54:49.097 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T16:54:49.159 INFO:teuthology.orchestra.run.smithi026.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T16:54:49.188 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-common (238) ... 2023-11-28T16:54:49.578 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package tcl. 2023-11-28T16:54:49.594 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T16:54:49.634 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T16:54:49.671 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T16:54:49.688 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T16:54:49.733 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:49.966 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T16:54:49.981 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T16:54:50.024 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T16:54:50.389 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T16:54:50.404 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T16:54:50.438 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T16:54:50.784 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T16:54:50.799 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T16:54:50.833 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql. 2023-11-28T16:54:50.848 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T16:54:50.850 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T16:54:50.891 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql (14+238) ... 2023-11-28T16:54:51.160 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T16:54:51.161 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T16:54:51.175 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T16:54:51.218 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T16:54:51.373 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T16:54:51.471 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T16:54:51.486 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T16:54:51.499 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T16:54:51.529 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T16:54:51.642 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:51.751 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T16:54:51.877 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T16:54:52.014 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:52.033 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T16:54:52.051 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T16:54:52.091 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T16:54:52.369 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl. 2023-11-28T16:54:52.386 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T16:54:52.432 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T16:54:52.772 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T16:54:52.788 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T16:54:52.849 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T16:54:53.015 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T16:54:53.115 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T16:54:53.184 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T16:54:53.201 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T16:54:53.243 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T16:54:53.494 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T16:54:53.494 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T16:54:53.596 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T16:54:53.613 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T16:54:53.655 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T16:54:53.933 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T16:54:54.169 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T16:54:54.204 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T16:54:54.303 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T16:54:54.353 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T16:54:54.412 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:54.478 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T16:54:54.522 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T16:54:54.604 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T16:54:54.681 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T16:54:54.755 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T16:54:54.807 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:54:54.882 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T16:54:54.999 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T16:54:55.671 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T16:54:55.814 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T16:54:55.839 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T16:54:55.909 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T16:54:55.982 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:54:55.988 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T16:54:56.100 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T16:54:56.201 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T16:54:56.343 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T16:54:56.450 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T16:54:56.450 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T16:54:56.486 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T16:54:56.576 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T16:54:56.646 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T16:54:56.797 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T16:54:56.973 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T16:54:57.082 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T16:54:57.099 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:54:57.217 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T16:54:57.217 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T16:54:57.343 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T16:54:57.376 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T16:54:57.494 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T16:54:57.503 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T16:54:57.620 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T16:54:57.729 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T16:54:57.847 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T16:54:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:54:58.054 INFO:teuthology.orchestra.run.smithi079.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T16:54:58.054 INFO:teuthology.orchestra.run.smithi079.stdout:which means they are currently configured by ifupdown: 2023-11-28T16:54:58.054 INFO:teuthology.orchestra.run.smithi079.stdout:- enp3s0f1 2023-11-28T16:54:58.054 INFO:teuthology.orchestra.run.smithi079.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T16:54:58.054 INFO:teuthology.orchestra.run.smithi079.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T16:54:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:54:58.187 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T16:54:58.536 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T16:54:58.570 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T16:54:58.720 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T16:54:58.832 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T16:54:58.897 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:54:58.983 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T16:54:59.048 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T16:54:59.224 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T16:54:59.366 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T16:54:59.492 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T16:54:59.582 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T16:54:59.663 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T16:54:59.830 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T16:55:00.040 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T16:55:00.166 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:55:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T16:55:00.297 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:55:00.482 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T16:55:00.485 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T16:55:00.599 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T16:55:00.611 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T16:55:00.717 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-common (238) ... 2023-11-28T16:55:01.183 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:01.183 INFO:teuthology.orchestra.run.smithi026.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T16:55:01.183 INFO:teuthology.orchestra.run.smithi026.stdout:which means they are currently configured by ifupdown: 2023-11-28T16:55:01.183 INFO:teuthology.orchestra.run.smithi026.stdout:- ens1f0 2023-11-28T16:55:01.183 INFO:teuthology.orchestra.run.smithi026.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T16:55:01.184 INFO:teuthology.orchestra.run.smithi026.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T16:55:01.184 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:01.324 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T16:55:01.697 INFO:teuthology.orchestra.run.smithi079.stdout:Adding user postgres to group ssl-cert 2023-11-28T16:55:01.737 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T16:55:01.964 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:01.964 INFO:teuthology.orchestra.run.smithi079.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T16:55:02.177 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T16:55:02.201 INFO:teuthology.orchestra.run.smithi079.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T16:55:02.201 INFO:teuthology.orchestra.run.smithi079.stdout:Removing obsolete dictionary files: 2023-11-28T16:55:02.948 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T16:55:02.959 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T16:55:03.099 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T16:55:03.250 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T16:55:03.376 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-common (238) ... 2023-11-28T16:55:03.436 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:55:03.776 INFO:teuthology.orchestra.run.smithi079.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T16:55:03.796 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T16:55:03.844 INFO:teuthology.orchestra.run.smithi079.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T16:55:03.844 INFO:teuthology.orchestra.run.smithi079.stdout:This user must also own the server process. 2023-11-28T16:55:03.844 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:03.844 INFO:teuthology.orchestra.run.smithi079.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T16:55:03.844 INFO:teuthology.orchestra.run.smithi079.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T16:55:03.845 INFO:teuthology.orchestra.run.smithi079.stdout:The default text search configuration will be set to "english". 2023-11-28T16:55:03.845 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:03.845 INFO:teuthology.orchestra.run.smithi079.stdout:Data page checksums are disabled. 2023-11-28T16:55:03.845 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:03.845 INFO:teuthology.orchestra.run.smithi079.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T16:55:03.845 INFO:teuthology.orchestra.run.smithi079.stdout:creating subdirectories ... ok 2023-11-28T16:55:03.846 INFO:teuthology.orchestra.run.smithi079.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T16:55:03.869 INFO:teuthology.orchestra.run.smithi079.stdout:selecting default max_connections ... 100 2023-11-28T16:55:03.905 INFO:teuthology.orchestra.run.smithi079.stdout:selecting default shared_buffers ... 128MB 2023-11-28T16:55:03.918 INFO:teuthology.orchestra.run.smithi079.stdout:selecting default time zone ... Etc/UTC 2023-11-28T16:55:03.919 INFO:teuthology.orchestra.run.smithi079.stdout:creating configuration files ... ok 2023-11-28T16:55:04.089 INFO:teuthology.orchestra.run.smithi079.stdout:running bootstrap script ... ok 2023-11-28T16:55:04.344 INFO:teuthology.orchestra.run.smithi026.stdout:Adding user postgres to group ssl-cert 2023-11-28T16:55:04.627 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:04.627 INFO:teuthology.orchestra.run.smithi026.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T16:55:04.694 INFO:teuthology.orchestra.run.smithi079.stdout:performing post-bootstrap initialization ... ok 2023-11-28T16:55:04.888 INFO:teuthology.orchestra.run.smithi026.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T16:55:04.888 INFO:teuthology.orchestra.run.smithi026.stdout:Removing obsolete dictionary files: 2023-11-28T16:55:05.278 INFO:teuthology.orchestra.run.smithi079.stdout:syncing data to disk ... ok 2023-11-28T16:55:05.620 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T16:55:05.790 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T16:55:06.127 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T16:55:06.461 INFO:teuthology.orchestra.run.smithi026.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T16:55:06.488 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T16:55:06.543 INFO:teuthology.orchestra.run.smithi026.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T16:55:06.543 INFO:teuthology.orchestra.run.smithi026.stdout:This user must also own the server process. 2023-11-28T16:55:06.543 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:06.543 INFO:teuthology.orchestra.run.smithi026.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T16:55:06.543 INFO:teuthology.orchestra.run.smithi026.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T16:55:06.543 INFO:teuthology.orchestra.run.smithi026.stdout:The default text search configuration will be set to "english". 2023-11-28T16:55:06.543 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:06.544 INFO:teuthology.orchestra.run.smithi026.stdout:Data page checksums are disabled. 2023-11-28T16:55:06.544 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:06.544 INFO:teuthology.orchestra.run.smithi026.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T16:55:06.544 INFO:teuthology.orchestra.run.smithi026.stdout:creating subdirectories ... ok 2023-11-28T16:55:06.544 INFO:teuthology.orchestra.run.smithi026.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T16:55:06.569 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default max_connections ... 100 2023-11-28T16:55:06.607 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default shared_buffers ... 128MB 2023-11-28T16:55:06.621 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default time zone ... Etc/UTC 2023-11-28T16:55:06.622 INFO:teuthology.orchestra.run.smithi026.stdout:creating configuration files ... ok 2023-11-28T16:55:06.800 INFO:teuthology.orchestra.run.smithi026.stdout:running bootstrap script ... ok 2023-11-28T16:55:07.442 INFO:teuthology.orchestra.run.smithi026.stdout:performing post-bootstrap initialization ... ok 2023-11-28T16:55:08.014 INFO:teuthology.orchestra.run.smithi026.stdout:syncing data to disk ... ok 2023-11-28T16:55:08.537 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T16:55:08.793 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:55:08.919 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T16:55:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql (14+238) ... 2023-11-28T16:55:09.171 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:55:09.322 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:55:09.584 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T16:55:09.584 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T16:55:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T16:55:10.643 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T16:55:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T16:55:11.585 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:55:11.695 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T16:55:11.821 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql (14+238) ... 2023-11-28T16:55:11.980 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T16:55:12.106 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T16:55:12.239 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T16:55:12.339 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T16:55:12.374 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T16:55:12.374 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T16:55:12.892 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T16:55:12.897 DEBUG:teuthology.parallel:result is None 2023-11-28T16:55:13.125 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T16:55:13.460 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T16:55:13.662 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T16:55:15.190 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T16:55:15.332 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T16:55:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T16:55:15.875 DEBUG:teuthology.parallel:result is None 2023-11-28T16:55:15.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T16:55:16.124 DEBUG:teuthology.orchestra.run.smithi026:> dpkg-query -W -f '${Version}' ceph 2023-11-28T16:55:16.147 INFO:teuthology.orchestra.run.smithi026.stdout:18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:55:16.147 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:55:16.147 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-11-28T16:55:16.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T16:55:16.387 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2023-11-28T16:55:16.411 INFO:teuthology.orchestra.run.smithi079.stdout:18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:55:16.412 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T16:55:16.412 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-11-28T16:55:16.412 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T16:55:16.412 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:16.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T16:55:16.434 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:16.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T16:55:16.475 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T16:55:16.476 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:16.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T16:55:16.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T16:55:16.561 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:16.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T16:55:16.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T16:55:16.651 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T16:55:16.651 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:16.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T16:55:16.672 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T16:55:16.737 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:16.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T16:55:16.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T16:55:16.826 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T16:55:16.827 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:16.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T16:55:16.848 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T16:55:16.913 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:16.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T16:55:16.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T16:55:17.003 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T16:55:17.071 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T16:55:17.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2023-11-28T16:55:17.075 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2023-11-28T16:55:17.096 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T16:55:17.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T16:55:17.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T16:55:17.161 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T16:55:17.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T16:55:17.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T16:55:17.235 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T16:55:17.236 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T16:55:17.236 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T16:55:17.236 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:17.236 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T16:55:17.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T16:55:17.373 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:17.373 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T16:55:17.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T16:55:17.485 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T16:55:17.485 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T16:55:17.486 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341', 'branch': 'wip-vshankar-testing-20231127.102654', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469341', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102654'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102654', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1098, 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'sleep_before_teardown': 0, 'subset': '854/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102654', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLK3cX0awvivqTMUFkURLHddCrMc/pmBFAc5kbAgjc742Jlu9mQEpYaCnrOIp5A6nJfvIrcDJpq5ncDEiBbVJqs=', 'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkI0GmXf2v+DH9KZbHKOKZwdFQ2zsfNU5G18ubT4762ZNaW6hZTTZhBQV1ZbjUbsu9CmQOg87uJZ9NqbEL0ZSs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:23:42', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T16:55:17.486 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T16:55:17.490 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T16:55:17.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T16:55:17.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T16:55:17.566 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:17.566 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T16:55:17.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T16:55:17.613 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 903 Links: 1 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-11-28 16:48:44.775950477 +0000 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-11-28 16:48:44.771950513 +0000 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-11-28 16:48:44.771950513 +0000 2023-11-28T16:55:17.666 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-11-28 16:48:44.771950513 +0000 2023-11-28T16:55:17.667 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T16:55:17.728 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-11-28T16:55:17.728 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-11-28T16:55:17.728 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000273161 s, 1.9 MB/s 2023-11-28T16:55:17.730 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T16:55:17.783 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2023-11-28T16:55:17.834 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T16:55:17.834 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:17.834 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-11-28T16:55:17.834 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:17.834 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-11-28 16:48:45.859940795 +0000 2023-11-28T16:55:17.834 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-11-28 16:48:45.447944475 +0000 2023-11-28T16:55:17.834 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-11-28 16:48:45.447944475 +0000 2023-11-28T16:55:17.835 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-11-28 16:48:45.447944475 +0000 2023-11-28T16:55:17.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T16:55:17.897 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-11-28T16:55:17.897 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-11-28T16:55:17.897 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000263024 s, 1.9 MB/s 2023-11-28T16:55:17.899 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T16:55:17.956 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2023-11-28T16:55:18.005 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T16:55:18.006 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:18.006 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-11-28T16:55:18.006 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:18.006 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-11-28 16:48:46.571934435 +0000 2023-11-28T16:55:18.006 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-11-28 16:48:46.115938508 +0000 2023-11-28T16:55:18.006 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-11-28 16:48:46.115938508 +0000 2023-11-28T16:55:18.006 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-11-28 16:48:46.115938508 +0000 2023-11-28T16:55:18.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T16:55:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-11-28T16:55:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-11-28T16:55:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.00026506 s, 1.9 MB/s 2023-11-28T16:55:18.075 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T16:55:18.127 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2023-11-28T16:55:18.177 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T16:55:18.177 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:18.177 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-11-28T16:55:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-11-28 16:48:47.251928360 +0000 2023-11-28T16:55:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-11-28 16:48:46.851931933 +0000 2023-11-28T16:55:18.178 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-11-28 16:48:46.851931933 +0000 2023-11-28T16:55:18.178 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-11-28 16:48:46.851931933 +0000 2023-11-28T16:55:18.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T16:55:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-11-28T16:55:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-11-28T16:55:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000296524 s, 1.7 MB/s 2023-11-28T16:55:18.242 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T16:55:18.295 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:18.296 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:18.296 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T16:55:18.305 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T16:55:18.305 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2023-11-28T16:55:18.354 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T16:55:18.354 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:18.354 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-11-28T16:55:18.355 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:18.355 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-11-28 16:48:40.745031808 +0000 2023-11-28T16:55:18.355 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-11-28 16:48:40.349035347 +0000 2023-11-28T16:55:18.355 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-11-28 16:48:40.349035347 +0000 2023-11-28T16:55:18.355 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-11-28 16:48:40.349035347 +0000 2023-11-28T16:55:18.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T16:55:18.417 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-11-28T16:55:18.417 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-11-28T16:55:18.417 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.0003973 s, 1.3 MB/s 2023-11-28T16:55:18.419 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T16:55:18.472 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2023-11-28T16:55:18.522 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T16:55:18.522 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:18.523 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-11-28T16:55:18.523 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:18.523 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-11-28 16:48:41.413025843 +0000 2023-11-28T16:55:18.523 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-11-28 16:48:41.017029380 +0000 2023-11-28T16:55:18.523 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-11-28 16:48:41.017029380 +0000 2023-11-28T16:55:18.523 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-11-28 16:48:41.017029380 +0000 2023-11-28T16:55:18.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T16:55:18.585 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-11-28T16:55:18.585 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-11-28T16:55:18.585 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000380089 s, 1.3 MB/s 2023-11-28T16:55:18.587 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T16:55:18.644 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2023-11-28T16:55:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T16:55:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:18.695 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-11-28T16:55:18.695 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:18.695 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-11-28 16:48:42.057020091 +0000 2023-11-28T16:55:18.695 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-11-28 16:48:41.641023805 +0000 2023-11-28T16:55:18.695 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-11-28 16:48:41.641023805 +0000 2023-11-28T16:55:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-11-28 16:48:41.641023805 +0000 2023-11-28T16:55:18.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T16:55:18.761 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-11-28T16:55:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-11-28T16:55:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000380093 s, 1.3 MB/s 2023-11-28T16:55:18.763 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T16:55:18.820 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 954 Links: 1 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-11-28 16:48:42.753013873 +0000 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-11-28 16:48:42.325017696 +0000 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-11-28 16:48:42.325017696 +0000 2023-11-28T16:55:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-11-28 16:48:42.325017696 +0000 2023-11-28T16:55:18.872 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T16:55:18.933 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-11-28T16:55:18.933 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-11-28T16:55:18.933 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000386857 s, 1.3 MB/s 2023-11-28T16:55:18.935 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T16:55:18.988 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:18.989 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T16:55:18.989 INFO:tasks.ceph:Generating config... 2023-11-28T16:55:18.990 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T16:55:18.990 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T16:55:18.991 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T16:55:18.991 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T16:55:18.991 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T16:55:18.991 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-28T16:55:18.991 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T16:55:18.991 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T16:55:18.991 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T16:55:18.991 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T16:55:18.991 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T16:55:18.992 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T16:55:18.993 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T16:55:18.993 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T16:55:18.993 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T16:55:18.993 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T16:55:18.993 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T16:55:18.994 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T16:55:18.994 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T16:55:18.994 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T16:55:18.994 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T16:55:18.994 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T16:55:18.994 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T16:55:18.994 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T16:55:18.995 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T16:55:18.995 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T16:55:18.995 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T16:55:18.995 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T16:55:18.995 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T16:55:18.995 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T16:55:18.996 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T16:55:18.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T16:55:19.045 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T16:55:19.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T16:55:19.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T16:55:19.134 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.79'), ('mon.c', '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]')] 2023-11-28T16:55:19.134 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T16:55:19.136 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:19.136 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T16:55:19.185 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.79 --addv c '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:19.281 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:19.281 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee 2023-11-28T16:55:19.281 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = pacific 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:fsid e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2023-11-28T16:55:19.280745+0000 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-11-28T16:55:19.280745+0000 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 16 (pacific) 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-11-28T16:55:19.282 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T16:55:19.284 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T16:55:19.333 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee... 2023-11-28T16:55:19.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T16:55:19.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T16:55:19.423 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2023-11-28T16:55:19.423 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2023-11-28T16:55:19.423 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T16:55:19.424 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2023-11-28T16:55:19.424 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.424 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2023-11-28T16:55:19.424 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.424 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2023-11-28T16:55:19.424 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.425 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2023-11-28T16:55:19.425 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2023-11-28T16:55:19.425 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.425 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2023-11-28T16:55:19.425 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2023-11-28T16:55:19.425 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.425 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T16:55:19.426 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2023-11-28T16:55:19.426 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.426 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T16:55:19.426 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T16:55:19.427 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.427 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2023-11-28T16:55:19.427 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.427 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2023-11-28T16:55:19.427 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2023-11-28T16:55:19.427 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2023-11-28T16:55:19.428 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2023-11-28T16:55:19.428 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2023-11-28T16:55:19.428 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2023-11-28T16:55:19.428 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2023-11-28T16:55:19.428 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T16:55:19.429 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T16:55:19.429 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2023-11-28T16:55:19.429 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.429 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T16:55:19.429 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.429 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2023-11-28T16:55:19.430 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.430 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2023-11-28T16:55:19.430 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.430 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2023-11-28T16:55:19.430 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2023-11-28T16:55:19.430 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on skipped message = False 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2023-11-28T16:55:19.431 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2023-11-28T16:55:19.432 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug trim objects = true 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2023-11-28T16:55:19.433 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 1/20 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 1/20 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-11-28T16:55:19.434 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 4/10 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2023-11-28T16:55:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2023-11-28T16:55:19.436 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T16:55:19.437 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T16:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2023-11-28T16:55:19.439 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-11-28T16:55:19.440 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T16:55:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T16:55:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2023-11-28T16:55:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.26,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2023-11-28T16:55:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2023-11-28T16:55:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-11-28T16:55:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.449 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2023-11-28T16:55:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-11-28T16:55:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2023-11-28T16:55:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-11-28T16:55:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-11-28T16:55:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-11-28T16:55:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-11-28T16:55:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2023-11-28T16:55:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2023-11-28T16:55:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-11-28T16:55:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-11-28T16:55:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2023-11-28T16:55:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-11-28T16:55:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2023-11-28T16:55:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2023-11-28T16:55:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-11-28T16:55:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2023-11-28T16:55:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2023-11-28T16:55:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-11-28T16:55:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T16:55:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T16:55:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T16:55:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T16:55:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T16:55:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2023-11-28T16:55:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-11-28T16:55:19.455 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-11-28T16:55:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-11-28T16:55:19.458 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T16:55:19.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T16:55:19.596 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T16:55:19.596 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:19.596 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T16:55:19.605 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:19.605 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T16:55:19.656 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:55:19.656 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:19.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T16:55:19.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T16:55:19.738 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:19.738 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:19.788 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:55:19.789 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:19.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T16:55:19.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T16:55:19.826 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:19.826 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:19.882 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T16:55:19.882 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T16:55:19.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T16:55:19.941 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T16:55:19.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T16:55:20.006 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T16:55:20.026 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T16:55:20.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T16:55:20.086 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T16:55:20.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T16:55:20.111 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T16:55:20.209 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T16:55:20.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T16:55:20.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T16:55:20.295 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T16:55:20.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T16:55:20.322 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T16:55:20.422 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T16:55:20.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T16:55:20.500 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T16:55:20.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T16:55:20.547 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T16:55:20.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T16:55:20.607 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T16:55:20.624 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T16:55:20.624 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T16:55:20.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T16:55:20.646 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:20.646 INFO:tasks.ceph:role: osd.0 2023-11-28T16:55:20.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:55:20.646 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T16:55:20.709 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:20.709 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:20.709 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:20.710 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:20.710 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:20.710 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:20.711 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:20.711 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:20.711 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:20.711 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:20.732 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-11-28T16:55:20.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-11-28T16:55:20.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T16:55:20.802 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T16:55:20.860 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:20.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:20.862 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T16:55:20.928 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:20.928 INFO:tasks.ceph:role: osd.1 2023-11-28T16:55:20.928 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:55:20.928 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T16:55:20.992 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:20.993 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:21.017 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-11-28T16:55:21.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-11-28T16:55:21.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T16:55:21.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T16:55:21.152 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:21.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:21.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T16:55:21.216 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:21.216 INFO:tasks.ceph:role: osd.2 2023-11-28T16:55:21.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:55:21.217 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T16:55:21.281 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:21.281 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:21.281 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:21.281 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:21.281 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:21.282 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:21.282 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:21.282 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:21.282 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:21.282 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:21.305 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-11-28T16:55:21.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-11-28T16:55:21.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T16:55:21.373 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T16:55:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:21.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:21.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T16:55:21.500 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:21.501 INFO:tasks.ceph:role: osd.3 2023-11-28T16:55:21.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:55:21.501 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T16:55:21.565 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:21.565 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:21.566 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:21.566 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:21.566 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:21.566 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:21.566 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:21.566 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:21.566 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:21.567 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:21.589 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-11-28T16:55:21.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-11-28T16:55:21.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T16:55:21.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T16:55:21.716 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:21.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:21.718 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:21.841+0000 7f56a2a6b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T16:55:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:21.845+0000 7f56a2a6b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T16:55:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:21.845+0000 7f56a2a6b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T16:55:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:21.845+0000 7f56a2a6b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T16:55:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:21.845+0000 7f56a2a6b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T16:55:21.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:21.845+0000 7f56a2a6b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T16:55:24.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T16:55:24.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:24.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:24.961+0000 7f5ddb2d4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T16:55:24.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:24.961+0000 7f5ddb2d4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T16:55:24.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:24.961+0000 7f5ddb2d4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T16:55:24.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:24.961+0000 7f5ddb2d4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T16:55:24.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:24.961+0000 7f5ddb2d4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T16:55:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:24.961+0000 7f5ddb2d4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T16:55:27.949 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T16:55:27.971 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:28.069+0000 7fa080a5b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T16:55:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:28.069+0000 7fa080a5b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T16:55:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:28.069+0000 7fa080a5b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T16:55:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:28.069+0000 7fa080a5b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T16:55:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:28.069+0000 7fa080a5b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T16:55:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:28.069+0000 7fa080a5b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T16:55:31.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T16:55:31.087 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:31.189+0000 7f0b32c80640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T16:55:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:31.189+0000 7f0b32c80640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T16:55:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:31.189+0000 7f0b32c80640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T16:55:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:31.189+0000 7f0b32c80640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T16:55:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:31.189+0000 7f0b32c80640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T16:55:31.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:31.189+0000 7f0b32c80640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T16:55:34.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T16:55:34.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T16:55:34.239 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:34.240 INFO:tasks.ceph:role: osd.4 2023-11-28T16:55:34.240 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:55:34.240 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T16:55:34.311 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:34.311 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:34.312 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:34.312 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:34.312 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:34.774 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-11-28T16:55:34.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-11-28T16:55:34.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T16:55:34.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T16:55:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:34.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:34.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T16:55:34.982 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:34.983 INFO:tasks.ceph:role: osd.5 2023-11-28T16:55:34.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:55:34.983 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T16:55:35.056 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:35.056 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:35.056 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:35.057 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:35.057 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:35.550 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-11-28T16:55:35.553 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-11-28T16:55:35.553 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T16:55:35.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T16:55:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:35.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:35.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T16:55:35.778 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:35.778 INFO:tasks.ceph:role: osd.6 2023-11-28T16:55:35.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:55:35.778 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T16:55:35.850 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:35.851 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:36.333 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-11-28T16:55:36.336 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-11-28T16:55:36.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T16:55:36.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T16:55:36.465 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:36.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:36.466 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T16:55:36.531 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T16:55:36.531 INFO:tasks.ceph:role: osd.7 2023-11-28T16:55:36.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:55:36.532 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T16:55:36.602 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T16:55:36.602 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T16:55:36.602 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T16:55:36.603 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T16:55:36.603 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T16:55:36.603 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-11-28T16:55:36.603 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T16:55:36.603 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T16:55:36.603 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T16:55:36.603 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T16:55:37.050 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-11-28T16:55:37.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-11-28T16:55:37.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T16:55:37.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T16:55:37.186 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T16:55:37.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:55:37.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:37.306+0000 7fb4b3736640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T16:55:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:37.306+0000 7fb4b3736640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T16:55:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:37.306+0000 7fb4b3736640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T16:55:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:37.306+0000 7fb4b3736640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T16:55:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:37.306+0000 7fb4b3736640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T16:55:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:37.310+0000 7fb4b3736640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T16:55:40.290 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T16:55:40.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:40.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:40.410+0000 7f167fdfd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T16:55:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:40.410+0000 7f167fdfd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T16:55:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:40.410+0000 7f167fdfd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T16:55:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:40.410+0000 7f167fdfd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T16:55:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:40.410+0000 7f167fdfd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T16:55:40.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:40.410+0000 7f167fdfd640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T16:55:43.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T16:55:43.433 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:43.530+0000 7fecbc62f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T16:55:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:43.530+0000 7fecbc62f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T16:55:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:43.530+0000 7fecbc62f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T16:55:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:43.530+0000 7fecbc62f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T16:55:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:43.530+0000 7fecbc62f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T16:55:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:43.534+0000 7fecbc62f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T16:55:46.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T16:55:46.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:46.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:46.634+0000 7f0d282ea640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T16:55:46.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:46.634+0000 7f0d282ea640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T16:55:46.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:46.634+0000 7f0d282ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T16:55:46.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:46.634+0000 7f0d282ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T16:55:46.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:46.634+0000 7f0d282ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T16:55:46.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:46.638+0000 7f0d282ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T16:55:47.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:55:47.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:55:49.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T16:55:49.637 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T16:55:49.637 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:49.637 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T16:55:49.661 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:49.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T16:55:49.726 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:49.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T16:55:49.790 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:49.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T16:55:49.854 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:49.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T16:55:49.918 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:49.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T16:55:49.982 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:49.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T16:55:50.046 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T16:55:50.067 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T16:55:50.129 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T16:55:50.189 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T16:55:50.256 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.256 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T16:55:50.320 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.321 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T16:55:50.380 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T16:55:50.441 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:50.442 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T16:55:50.451 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:50.451 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T16:55:50.493 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T16:55:50.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T16:55:50.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T16:55:50.541 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2023-11-28T16:55:50.541 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB3G2ZlahcsOBAA/pu4L5dOusqC3KpdoJVbiQ== 2023-11-28T16:55:50.541 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-11-28T16:55:50.541 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlAikwBRAAQ6/impgMsMbDuSaqtxHLAg== 2023-11-28T16:55:50.541 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-11-28T16:55:50.542 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlN8GNDBAA3+w1QxhoXQo54UQV/ogQ5Q== 2023-11-28T16:55:50.542 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2023-11-28T16:55:50.542 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB5G2Zlm75jMhAAfBhoHD0wXNlVoDshO3cpeg== 2023-11-28T16:55:50.542 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2023-11-28T16:55:50.542 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB8G2ZlFdNYORAAN6gs23w6ngpwiGxRH9wdqA== 2023-11-28T16:55:50.542 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2023-11-28T16:55:50.543 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCAG2ZlPWo/BBAAhIuajQHDwNtFJhJECKL0HA== 2023-11-28T16:55:50.543 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2023-11-28T16:55:50.543 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCDG2ZltllfCxAAqpT3R2HyGu+P4MKWVo9haA== 2023-11-28T16:55:50.543 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2023-11-28T16:55:50.543 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZldwN4ABAAk2OXnh0lwdB6ER6KsTUp+w== 2023-11-28T16:55:50.544 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-11-28T16:55:50.544 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlGkK2ERAAvgQCl4mK38H2G8IG10WC8g== 2023-11-28T16:55:50.544 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-11-28T16:55:50.544 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlCZg+GRAADDsRVkfdQ4/R/d3auYuQLQ== 2023-11-28T16:55:50.544 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2023-11-28T16:55:50.545 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCJG2Zl86hXEhAAVn3jysp8SF3VujHFQXdJZA== 2023-11-28T16:55:50.545 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2023-11-28T16:55:50.545 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCMG2Zldu2MGBAAK/nOy8WbKhJ/e91PhwY4Jg== 2023-11-28T16:55:50.545 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2023-11-28T16:55:50.546 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCPG2ZlMzrZHxAAgwVfHNVLyId5CNs6/llC2w== 2023-11-28T16:55:50.546 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2023-11-28T16:55:50.546 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCSG2ZlzlL/JRAAXY00dUMMj9nNXUjTVsMBQQ== 2023-11-28T16:55:50.546 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-11-28T16:55:50.546 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw== 2023-11-28T16:55:50.546 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-11-28T16:55:50.546 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg== 2023-11-28T16:55:50.554 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2023-11-28T16:55:50.554 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB3G2ZlahcsOBAA/pu4L5dOusqC3KpdoJVbiQ== 2023-11-28T16:55:50.554 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-11-28T16:55:50.554 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB4G2ZlAikwBRAAQ6/impgMsMbDuSaqtxHLAg== 2023-11-28T16:55:50.554 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-11-28T16:55:50.555 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB4G2ZlN8GNDBAA3+w1QxhoXQo54UQV/ogQ5Q== 2023-11-28T16:55:50.555 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2023-11-28T16:55:50.555 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB5G2Zlm75jMhAAfBhoHD0wXNlVoDshO3cpeg== 2023-11-28T16:55:50.555 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2023-11-28T16:55:50.555 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB8G2ZlFdNYORAAN6gs23w6ngpwiGxRH9wdqA== 2023-11-28T16:55:50.556 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2023-11-28T16:55:50.556 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCAG2ZlPWo/BBAAhIuajQHDwNtFJhJECKL0HA== 2023-11-28T16:55:50.556 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2023-11-28T16:55:50.556 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCDG2ZltllfCxAAqpT3R2HyGu+P4MKWVo9haA== 2023-11-28T16:55:50.556 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2023-11-28T16:55:50.556 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB4G2ZldwN4ABAAk2OXnh0lwdB6ER6KsTUp+w== 2023-11-28T16:55:50.557 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-11-28T16:55:50.557 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB4G2ZlGkK2ERAAvgQCl4mK38H2G8IG10WC8g== 2023-11-28T16:55:50.557 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2023-11-28T16:55:50.557 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB4G2ZlCZg+GRAADDsRVkfdQ4/R/d3auYuQLQ== 2023-11-28T16:55:50.557 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2023-11-28T16:55:50.557 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCJG2Zl86hXEhAAVn3jysp8SF3VujHFQXdJZA== 2023-11-28T16:55:50.558 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCMG2Zldu2MGBAAK/nOy8WbKhJ/e91PhwY4Jg== 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCPG2ZlMzrZHxAAgwVfHNVLyId5CNs6/llC2w== 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCSG2ZlzlL/JRAAXY00dUMMj9nNXUjTVsMBQQ== 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw== 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2023-11-28T16:55:50.559 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg== 2023-11-28T16:55:50.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T16:55:50.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T16:55:50.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:50.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:50.718 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:50.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:50.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:50.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:50.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:50.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:50.892 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:50.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:50.949 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:50.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T16:55:51.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T16:55:51.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:51.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:51.125 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:51.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T16:55:51.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T16:55:51.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T16:55:51.424 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T16:55:51.481 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T16:55:51.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T16:55:51.541 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T16:55:51.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T16:55:51.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T16:55:51.678 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T16:55:51.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T16:55:51.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T16:55:51.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T16:55:51.861 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T16:55:51.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T16:55:52.036 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T16:55:52.057 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:52.060 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T16:55:52.109 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T16:55:52.109 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T16:55:52.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T16:55:52.113 INFO:tasks.ceph.mon.a:Started 2023-11-28T16:55:52.113 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T16:55:52.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T16:55:52.156 INFO:tasks.ceph.mon.b:Started 2023-11-28T16:55:52.156 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T16:55:52.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T16:55:52.159 INFO:tasks.ceph.mon.c:Started 2023-11-28T16:55:52.160 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T16:55:52.160 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T16:55:52.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T16:55:52.164 INFO:tasks.ceph.mgr.y:Started 2023-11-28T16:55:52.164 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T16:55:52.164 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T16:55:52.168 INFO:tasks.ceph.mgr.x:Started 2023-11-28T16:55:52.168 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T16:55:52.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T16:55:52.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71ed965640 1 Processor -- start 2023-11-28T16:55:52.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71ed965640 1 -- start start 2023-11-28T16:55:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71ed965640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 0x7f71e815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71ed965640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e80c22c0 con 0x7f71e81524d0 2023-11-28T16:55:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71ed965640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e806d880 con 0x7f71e80c2750 2023-11-28T16:55:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71ed965640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e80c11d0 con 0x7f71e80c4350 2023-11-28T16:55:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71dffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f71e81524d0 0x7f71e80c3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34852/0 (socket says 172.21.15.26:34852) 2023-11-28T16:55:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71dffff640 1 -- 172.21.15.26:0/2795035775 learned_addr learned my addr 172.21.15.26:0/2795035775 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:55:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.313+0000 7f71e77fe640 1 --2- 172.21.15.26:0/2795035775 >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 0x7f71e815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.317+0000 7f71e77fe640 1 -- 172.21.15.26:0/2795035775 >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 msgr2=0x7f71e815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T16:55:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.317+0000 7f71e77fe640 1 -- 172.21.15.26:0/2795035775 >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 msgr2=0x7f71e815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T16:55:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.317+0000 7f71e77fe640 1 --2- 172.21.15.26:0/2795035775 >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 0x7f71e815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T16:55:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.317+0000 7f71e77fe640 1 --2- 172.21.15.26:0/2795035775 >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 0x7f71e815cf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T16:55:52.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547296634 0 0) 0x7f71e80c22c0 con 0x7f71e81524d0 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d4003530 con 0x7f71e81524d0 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879823085 0 0) 0x7f71e806d880 con 0x7f71e80c2750 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e80c22c0 con 0x7f71e80c2750 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2664443104 0 0) 0x7f71e80c22c0 con 0x7f71e80c2750 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 msgr2=0x7f71e815cf40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 --2- 172.21.15.26:0/2795035775 >> v2:172.21.15.79:3300/0 conn(0x7f71e80c4350 0x7f71e815cf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 >> v1:172.21.15.26:6789/0 conn(0x7f71e81524d0 legacy=0x7f71e80c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e80c54a0 con 0x7f71e80c2750 2023-11-28T16:55:52.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f71d8001680 con 0x7f71e80c2750 2023-11-28T16:55:52.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 >> v1:172.21.15.79:6789/0 conn(0x7f71e80c2750 legacy=0x7f71e8151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71d4003bb0 0x7f71d4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d4005350 0x7f71d400dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80c11d0 con 0x7f71d4005350 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d400e4a0 con 0x7f71d40047d0 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d400e660 con 0x7f71d4003bb0 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71dffff640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:52.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e77fe640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d4005350 0x7f71d400dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e6ffd640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71d4003bb0 0x7f71d4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71dffff640 1 -- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71d4003bb0 msgr2=0x7f71d4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71dffff640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71d4003bb0 0x7f71d4003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71dffff640 1 -- 172.21.15.26:0/2795035775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d4005350 msgr2=0x7f71d400dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71dffff640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d4005350 0x7f71d400dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71dffff640 1 -- 172.21.15.26:0/2795035775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e80c22c0 con 0x7f71d40047d0 2023-11-28T16:55:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.477+0000 7f71e77fe640 1 -- 172.21.15.26:0/2795035775 reap_dead start 2023-11-28T16:55:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.481+0000 7f71dffff640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71d4004c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f71d0001930 tx=0x7f71d001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f84357043916c98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.481+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00a7070 con 0x7f71d40047d0 2023-11-28T16:55:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.481+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d00048b0 con 0x7f71d40047d0 2023-11-28T16:55:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.481+0000 7f71e67fc640 1 -- 172.21.15.26:0/2795035775 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0004c60 con 0x7f71d40047d0 2023-11-28T16:55:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 msgr2=0x7f71d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71d4004c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f71d0001930 tx=0x7f71d001c510 comp rx=0 tx=0).stop 2023-11-28T16:55:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- 172.21.15.26:0/2795035775 shutdown_connections 2023-11-28T16:55:52.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 --2- 172.21.15.26:0/2795035775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71d4004c50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- 172.21.15.26:0/2795035775 >> 172.21.15.26:0/2795035775 conn(0x7f71e806a5a0 msgr2=0x7f71e806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:52.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- 172.21.15.26:0/2795035775 shutdown_connections 2023-11-28T16:55:52.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- 172.21.15.26:0/2795035775 wait complete. 2023-11-28T16:55:52.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 Processor -- start 2023-11-28T16:55:52.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- start start 2023-11-28T16:55:52.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71e8149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:52.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71e81534d0 0x7f71e814a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:52.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e8154170 0x7f71e80bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:52.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e8141c10 con 0x7f71e8154170 2023-11-28T16:55:52.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e81419a0 con 0x7f71d40047d0 2023-11-28T16:55:52.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71ed965640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e814abf0 con 0x7f71e81534d0 2023-11-28T16:55:52.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.485+0000 7f71e6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71e8149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:52.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71e8149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:39178/0 (socket says 172.21.15.26:39178) 2023-11-28T16:55:52.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 -- 172.21.15.26:0/1727239909 learned_addr learned my addr 172.21.15.26:0/1727239909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:55:52.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71dffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71e81534d0 0x7f71e814a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:52.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e77fe640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e8154170 0x7f71e80bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:52.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 -- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71e81534d0 msgr2=0x7f71e814a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:52.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71e81534d0 0x7f71e814a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 -- 172.21.15.26:0/1727239909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e8154170 msgr2=0x7f71e80bacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:52.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e8154170 0x7f71e80bacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 -- 172.21.15.26:0/1727239909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8148db0 con 0x7f71d40047d0 2023-11-28T16:55:52.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71dffff640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71e81534d0 0x7f71e814a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:55:52.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.489+0000 7f71e6ffd640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71e8149890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e700 tx=0x7f71d800ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:52.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.493+0000 7f71e4ff9640 1 -- 172.21.15.26:0/1727239909 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80050d0 con 0x7f71d40047d0 2023-11-28T16:55:52.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.493+0000 7f71e4ff9640 1 -- 172.21.15.26:0/1727239909 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8005250 con 0x7f71d40047d0 2023-11-28T16:55:52.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.493+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e8149090 con 0x7f71d40047d0 2023-11-28T16:55:52.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.493+0000 7f71e4ff9640 1 -- 172.21.15.26:0/1727239909 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800c6c0 con 0x7f71d40047d0 2023-11-28T16:55:52.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.493+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e80bcae0 con 0x7f71d40047d0 2023-11-28T16:55:52.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.493+0000 7f71e4ff9640 1 -- 172.21.15.26:0/1727239909 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f71d800cb20 con 0x7f71d40047d0 2023-11-28T16:55:52.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.493+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e80680c0 con 0x7f71d40047d0 2023-11-28T16:55:52.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.497+0000 7f71e4ff9640 1 -- 172.21.15.26:0/1727239909 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f71d8003d80 con 0x7f71d40047d0 2023-11-28T16:55:52.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.497+0000 7f71e4ff9640 1 -- 172.21.15.26:0/1727239909 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f71d8003600 con 0x7f71d40047d0 2023-11-28T16:55:52.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.585+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f71e80c0df0 con 0x7f71d40047d0 2023-11-28T16:55:52.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71e4ff9640 1 -- 172.21.15.26:0/1727239909 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f71d80037a0 con 0x7f71d40047d0 2023-11-28T16:55:52.594 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 msgr2=0x7f71e8149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71e8149890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e700 tx=0x7f71d800ebc0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 shutdown_connections 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e8154170 0x7f71e80bacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71e81534d0 0x7f71e814a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 --2- 172.21.15.26:0/1727239909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71d40047d0 0x7f71e8149890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 >> 172.21.15.26:0/1727239909 conn(0x7f71e806a5a0 msgr2=0x7f71e81555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 shutdown_connections 2023-11-28T16:55:52.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:52.593+0000 7f71ed965640 1 -- 172.21.15.26:0/1727239909 wait complete. 2023-11-28T16:55:52.623 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T16:55:52.624 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T16:55:52.624 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:52.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T16:55:52.645 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:52.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T16:55:52.697 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:52.694+0000 7fa05f721180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T16:55:52.705 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:52.705+0000 7f2fb7dcd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T16:55:52.709 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:52.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T16:55:52.773 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:55:52.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T16:55:52.837 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:52.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T16:55:52.858 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:52.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T16:55:52.925 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:52.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T16:55:52.989 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:55:52.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T16:55:53.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 56c25a03-ca34-49ee-9eeb-6e459cf21572 0 2023-11-28T16:55:53.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.230+0000 7f77027aa640 1 Processor -- start 2023-11-28T16:55:53.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.230+0000 7f77027aa640 1 -- start start 2023-11-28T16:55:53.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f77027aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76fc0c8430 0x7f76fc06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f77027aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc0c7f20 0x7f76fc06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f77027aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc06cf70 con 0x7f76fc151d80 2023-11-28T16:55:53.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f77027aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc152160 con 0x7f76fc0c8430 2023-11-28T16:55:53.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f77027aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0c6a30 con 0x7f76fc0c7f20 2023-11-28T16:55:53.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f7700d47640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc0c7f20 0x7f76fc06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f7700d47640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc0c7f20 0x7f76fc06bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57516/0 (socket says 172.21.15.79:57516) 2023-11-28T16:55:53.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f7700d47640 1 -- 172.21.15.79:0/1938840285 learned_addr learned my addr 172.21.15.79:0/1938840285 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:53.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f76fb7fe640 1 --2- 172.21.15.79:0/1938840285 >> v2:172.21.15.79:3300/0 conn(0x7f76fc0c8430 0x7f76fc06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f7700d47640 1 -- 172.21.15.79:0/1938840285 >> v2:172.21.15.79:3300/0 conn(0x7f76fc0c8430 msgr2=0x7f76fc06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:53.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f7700d47640 1 --2- 172.21.15.79:0/1938840285 >> v2:172.21.15.79:3300/0 conn(0x7f76fc0c8430 0x7f76fc06b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f7700d47640 1 -- 172.21.15.79:0/1938840285 >> v1:172.21.15.79:6789/0 conn(0x7f76fc151d80 legacy=0x7f76fc0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:53.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f7700d47640 1 -- 172.21.15.79:0/1938840285 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc0c72d0 con 0x7f76fc0c7f20 2023-11-28T16:55:53.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.234+0000 7f76fb7fe640 1 --2- 172.21.15.79:0/1938840285 >> v2:172.21.15.79:3300/0 conn(0x7f76fc0c8430 0x7f76fc06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:55:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f7700d47640 1 --2- 172.21.15.79:0/1938840285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc0c7f20 0x7f76fc06bc60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009e50 tx=0x7f76f401c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed4bb666563cf2ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f76faffd640 1 -- 172.21.15.79:0/1938840285 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40a5790 con 0x7f76fc0c7f20 2023-11-28T16:55:53.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f76faffd640 1 -- 172.21.15.79:0/1938840285 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40a58f0 con 0x7f76fc0c7f20 2023-11-28T16:55:53.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f76faffd640 1 -- 172.21.15.79:0/1938840285 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40a5c80 con 0x7f76fc0c7f20 2023-11-28T16:55:53.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 -- 172.21.15.79:0/1938840285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc0c7f20 msgr2=0x7f76fc06bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 --2- 172.21.15.79:0/1938840285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc0c7f20 0x7f76fc06bc60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009e50 tx=0x7f76f401c910 comp rx=0 tx=0).stop 2023-11-28T16:55:53.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 -- 172.21.15.79:0/1938840285 shutdown_connections 2023-11-28T16:55:53.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 --2- 172.21.15.79:0/1938840285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc0c7f20 0x7f76fc06bc60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 --2- 172.21.15.79:0/1938840285 >> v2:172.21.15.79:3300/0 conn(0x7f76fc0c8430 0x7f76fc06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 -- 172.21.15.79:0/1938840285 >> 172.21.15.79:0/1938840285 conn(0x7f76fc0abd00 msgr2=0x7f76fc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:53.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 -- 172.21.15.79:0/1938840285 shutdown_connections 2023-11-28T16:55:53.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 -- 172.21.15.79:0/1938840285 wait complete. 2023-11-28T16:55:53.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 Processor -- start 2023-11-28T16:55:53.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.238+0000 7f77027aa640 1 -- start start 2023-11-28T16:55:53.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76fc0c7f20 0x7f76fc14b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76fc0c8430 0x7f76fc14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc151d80 0x7f76fc1f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc1f1070 con 0x7f76fc0c8430 2023-11-28T16:55:53.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0af460 con 0x7f76fc0c7f20 2023-11-28T16:55:53.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc1edf80 con 0x7f76fc151d80 2023-11-28T16:55:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f7700d47640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc151d80 0x7f76fc1f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76fc0c7f20 0x7f76fc14b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f7700d47640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc151d80 0x7f76fc1f02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57522/0 (socket says 172.21.15.79:57522) 2023-11-28T16:55:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f7700d47640 1 -- 172.21.15.79:0/3695657030 learned_addr learned my addr 172.21.15.79:0/3695657030 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fb7fe640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76fc0c8430 0x7f76fc14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fbfff640 1 -- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc151d80 msgr2=0x7f76fc1f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fbfff640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc151d80 0x7f76fc1f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fbfff640 1 -- 172.21.15.79:0/3695657030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76fc0c8430 msgr2=0x7f76fc14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fbfff640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76fc0c8430 0x7f76fc14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fbfff640 1 -- 172.21.15.79:0/3695657030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4009b30 con 0x7f76fc0c7f20 2023-11-28T16:55:53.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f7700d47640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc151d80 0x7f76fc1f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:55:53.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76fbfff640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76fc0c7f20 0x7f76fc14b1b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b410 tx=0x7f76ec00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:53.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76f8ff9640 1 -- 172.21.15.79:0/3695657030 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec004020 con 0x7f76fc0c7f20 2023-11-28T16:55:53.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76f8ff9640 1 -- 172.21.15.79:0/3695657030 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec004180 con 0x7f76fc0c7f20 2023-11-28T16:55:53.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76f8ff9640 1 -- 172.21.15.79:0/3695657030 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec011630 con 0x7f76fc0c7f20 2023-11-28T16:55:53.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc1ee220 con 0x7f76fc0c7f20 2023-11-28T16:55:53.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc158430 con 0x7f76fc0c7f20 2023-11-28T16:55:53.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76f8ff9640 1 -- 172.21.15.79:0/3695657030 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f76ec011a90 con 0x7f76fc0c7f20 2023-11-28T16:55:53.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f76f8ff9640 1 -- 172.21.15.79:0/3695657030 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f76ec01a750 con 0x7f76fc0c7f20 2023-11-28T16:55:53.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.242+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc04e890 con 0x7f76fc0c7f20 2023-11-28T16:55:53.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.246+0000 7f76f8ff9640 1 -- 172.21.15.79:0/3695657030 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f76ec015030 con 0x7f76fc0c7f20 2023-11-28T16:55:53.260 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:53.258+0000 7fa05f721180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T16:55:53.263 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:53.261+0000 7f2fb7dcd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T16:55:53.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.314+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56c25a03-ca34-49ee-9eeb-6e459cf21572", "id": 0} v 0) v1 -- 0x7f76fc0aff40 con 0x7f76fc0c7f20 2023-11-28T16:55:53.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f76f8ff9640 1 -- 172.21.15.79:0/3695657030 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56c25a03-ca34-49ee-9eeb-6e459cf21572", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f76ec003d30 con 0x7f76fc0c7f20 2023-11-28T16:55:53.323 INFO:teuthology.orchestra.run.smithi079.stdout:0 2023-11-28T16:55:53.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76fc0c7f20 msgr2=0x7f76fc14b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76fc0c7f20 0x7f76fc14b1b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b410 tx=0x7f76ec00b8d0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 shutdown_connections 2023-11-28T16:55:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76fc151d80 0x7f76fc1f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76fc0c8430 0x7f76fc14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 --2- 172.21.15.79:0/3695657030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76fc0c7f20 0x7f76fc14b1b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 >> 172.21.15.79:0/3695657030 conn(0x7f76fc0abd00 msgr2=0x7f76fc150dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:53.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 shutdown_connections 2023-11-28T16:55:53.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.322+0000 7f77027aa640 1 -- 172.21.15.79:0/3695657030 wait complete. 2023-11-28T16:55:53.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new d5224fc5-6a4d-4163-b586-713d635b9a02 1 2023-11-28T16:55:53.477 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:53.477+0000 7f2fb7dcd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T16:55:53.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.478+0000 7f1c167e4640 1 Processor -- start 2023-11-28T16:55:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.478+0000 7f1c167e4640 1 -- start start 2023-11-28T16:55:53.480 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:53.478+0000 7fa05f721180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T16:55:53.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.478+0000 7f1c167e4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.478+0000 7f1c167e4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c100ca8f0 0x7f1c100c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.478+0000 7f1c167e4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c101551a0 con 0x7f1c100c7d80 2023-11-28T16:55:53.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.478+0000 7f1c167e4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c10152080 con 0x7f1c100ca8f0 2023-11-28T16:55:53.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.478+0000 7f1c167e4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c4f60 con 0x7f1c100af5a0 2023-11-28T16:55:53.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c100ca8f0 0x7f1c100c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c100ca8f0 0x7f1c100c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36124/0 (socket says 172.21.15.79:36124) 2023-11-28T16:55:53.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 -- 172.21.15.79:0/2791822635 learned_addr learned my addr 172.21.15.79:0/2791822635 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:53.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c157e2640 1 --2- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 -- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 msgr2=0x7f1c100ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:53.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 --2- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 -- 172.21.15.79:0/2791822635 >> v1:172.21.15.79:6789/0 conn(0x7f1c100c7d80 legacy=0x7f1c100c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 -- 172.21.15.79:0/2791822635 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100c48a0 con 0x7f1c100ca8f0 2023-11-28T16:55:53.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c15fe3640 1 --2- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100ca8f0 0x7f1c100c6e50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009e50 tx=0x7f1c0801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6b50e0df68b093e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:53.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.482+0000 7f1c07fff640 1 -- 172.21.15.79:0/2791822635 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080a56e0 con 0x7f1c100ca8f0 2023-11-28T16:55:53.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c07fff640 1 -- 172.21.15.79:0/2791822635 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c080a5840 con 0x7f1c100ca8f0 2023-11-28T16:55:53.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c07fff640 1 -- 172.21.15.79:0/2791822635 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080a5bd0 con 0x7f1c100ca8f0 2023-11-28T16:55:53.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100ca8f0 msgr2=0x7f1c100c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 --2- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100ca8f0 0x7f1c100c6e50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009e50 tx=0x7f1c0801ca10 comp rx=0 tx=0).stop 2023-11-28T16:55:53.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- 172.21.15.79:0/2791822635 shutdown_connections 2023-11-28T16:55:53.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 --2- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100ca8f0 0x7f1c100c6e50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 --2- 172.21.15.79:0/2791822635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- 172.21.15.79:0/2791822635 >> 172.21.15.79:0/2791822635 conn(0x7f1c100720d0 msgr2=0x7f1c100724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:53.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- 172.21.15.79:0/2791822635 shutdown_connections 2023-11-28T16:55:53.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- 172.21.15.79:0/2791822635 wait complete. 2023-11-28T16:55:53.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 Processor -- start 2023-11-28T16:55:53.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- start start 2023-11-28T16:55:53.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100be230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100c7d80 0x7f1c101f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100ca8f0 0x7f1c101ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c29b0 con 0x7f1c100ca8f0 2023-11-28T16:55:53.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101f0ec0 con 0x7f1c100c7d80 2023-11-28T16:55:53.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c167e4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c2c70 con 0x7f1c100af5a0 2023-11-28T16:55:53.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c157e2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c157e2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100be230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57546/0 (socket says 172.21.15.79:57546) 2023-11-28T16:55:53.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c14fe1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100c7d80 0x7f1c101f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.486+0000 7f1c157e2640 1 -- 172.21.15.79:0/2137629165 learned_addr learned my addr 172.21.15.79:0/2137629165 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:53.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c15fe3640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100ca8f0 0x7f1c101ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c157e2640 1 -- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100c7d80 msgr2=0x7f1c101f0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c157e2640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100c7d80 0x7f1c101f0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c157e2640 1 -- 172.21.15.79:0/2137629165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100ca8f0 msgr2=0x7f1c101ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c157e2640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100ca8f0 0x7f1c101ee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c157e2640 1 -- 172.21.15.79:0/2137629165 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08009b30 con 0x7f1c100af5a0 2023-11-28T16:55:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c14fe1640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100c7d80 0x7f1c101f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:55:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c157e2640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100be230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00d800 tx=0x7f1c0c00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c05ffb640 1 -- 172.21.15.79:0/2137629165 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00b6c0 con 0x7f1c100af5a0 2023-11-28T16:55:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c05ffb640 1 -- 172.21.15.79:0/2137629165 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00b820 con 0x7f1c100af5a0 2023-11-28T16:55:53.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c100c2f50 con 0x7f1c100af5a0 2023-11-28T16:55:53.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c05ffb640 1 -- 172.21.15.79:0/2137629165 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00bb90 con 0x7f1c100af5a0 2023-11-28T16:55:53.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c05ffb640 1 -- 172.21.15.79:0/2137629165 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1c0c01e460 con 0x7f1c100af5a0 2023-11-28T16:55:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100c3750 con 0x7f1c100af5a0 2023-11-28T16:55:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c05ffb640 1 -- 172.21.15.79:0/2137629165 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1c0c01ecc0 con 0x7f1c100af5a0 2023-11-28T16:55:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.490+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10074970 con 0x7f1c100af5a0 2023-11-28T16:55:53.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.526+0000 7f1c05ffb640 1 -- 172.21.15.79:0/2137629165 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1c0c014570 con 0x7f1c100af5a0 2023-11-28T16:55:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.590+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5224fc5-6a4d-4163-b586-713d635b9a02", "id": 1} v 0) v1 -- 0x7f1c1006c9a0 con 0x7f1c100af5a0 2023-11-28T16:55:53.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.594+0000 7f1c05ffb640 1 -- 172.21.15.79:0/2137629165 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5224fc5-6a4d-4163-b586-713d635b9a02", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c0c014710 con 0x7f1c100af5a0 2023-11-28T16:55:53.597 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:55:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 msgr2=0x7f1c100be230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100be230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00d800 tx=0x7f1c0c00dcc0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 shutdown_connections 2023-11-28T16:55:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100ca8f0 0x7f1c101ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c100c7d80 0x7f1c101f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 --2- 172.21.15.79:0/2137629165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c100af5a0 0x7f1c100be230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 >> 172.21.15.79:0/2137629165 conn(0x7f1c100720d0 msgr2=0x7f1c10152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 shutdown_connections 2023-11-28T16:55:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.598+0000 7f1c167e4640 1 -- 172.21.15.79:0/2137629165 wait complete. 2023-11-28T16:55:53.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new da986cc2-83f7-417f-900d-580649b3b2b1 2 2023-11-28T16:55:53.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.750+0000 7f4aa585a640 1 Processor -- start 2023-11-28T16:55:53.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.750+0000 7f4aa585a640 1 -- start start 2023-11-28T16:55:53.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4aa585a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4aa0151d80 0x7f4aa00c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4aa585a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aa00c8430 0x7f4aa006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4aa585a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa006cf70 con 0x7f4aa00c7f20 2023-11-28T16:55:53.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4aa585a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa0152160 con 0x7f4aa0151d80 2023-11-28T16:55:53.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4aa585a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa00c6a30 con 0x7f4aa00c8430 2023-11-28T16:55:53.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aa00c8430 0x7f4aa006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aa00c8430 0x7f4aa006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36138/0 (socket says 172.21.15.79:36138) 2023-11-28T16:55:53.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/3216747390 learned_addr learned my addr 172.21.15.79:0/3216747390 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:53.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9effd640 1 --2- 172.21.15.79:0/3216747390 >> v2:172.21.15.26:3300/0 conn(0x7f4aa0151d80 0x7f4aa00c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/3216747390 >> v2:172.21.15.26:3300/0 conn(0x7f4aa0151d80 msgr2=0x7f4aa00c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9e7fc640 1 --2- 172.21.15.79:0/3216747390 >> v2:172.21.15.26:3300/0 conn(0x7f4aa0151d80 0x7f4aa00c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/3216747390 >> v1:172.21.15.26:6789/0 conn(0x7f4aa00c7f20 legacy=0x7f4aa006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.754+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/3216747390 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00c72d0 con 0x7f4aa00c8430 2023-11-28T16:55:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4a9e7fc640 1 --2- 172.21.15.79:0/3216747390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c8430 0x7f4aa006b720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00c7a40 tx=0x7f4a9401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d7dd5becac2e2e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4a9dffb640 1 -- 172.21.15.79:0/3216747390 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940ab640 con 0x7f4aa00c8430 2023-11-28T16:55:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4a9dffb640 1 -- 172.21.15.79:0/3216747390 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a940a7070 con 0x7f4aa00c8430 2023-11-28T16:55:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4a9dffb640 1 -- 172.21.15.79:0/3216747390 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940ab9c0 con 0x7f4aa00c8430 2023-11-28T16:55:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 -- 172.21.15.79:0/3216747390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c8430 msgr2=0x7f4aa006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 --2- 172.21.15.79:0/3216747390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c8430 0x7f4aa006b720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00c7a40 tx=0x7f4a9401c440 comp rx=0 tx=0).stop 2023-11-28T16:55:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 -- 172.21.15.79:0/3216747390 shutdown_connections 2023-11-28T16:55:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 --2- 172.21.15.79:0/3216747390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c8430 0x7f4aa006b720 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 --2- 172.21.15.79:0/3216747390 >> v2:172.21.15.26:3300/0 conn(0x7f4aa0151d80 0x7f4aa00c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 -- 172.21.15.79:0/3216747390 >> 172.21.15.79:0/3216747390 conn(0x7f4aa00abd00 msgr2=0x7f4aa00ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 -- 172.21.15.79:0/3216747390 shutdown_connections 2023-11-28T16:55:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 -- 172.21.15.79:0/3216747390 wait complete. 2023-11-28T16:55:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 Processor -- start 2023-11-28T16:55:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.758+0000 7f4aa585a640 1 -- start start 2023-11-28T16:55:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c7f20 0x7f4aa0158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00c8430 0x7f4aa01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4aa0151d80 0x7f4aa014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:53.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00ab930 con 0x7f4aa00c8430 2023-11-28T16:55:53.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa01432e0 con 0x7f4aa00c7f20 2023-11-28T16:55:53.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00ab270 con 0x7f4aa0151d80 2023-11-28T16:55:53.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c7f20 0x7f4aa0158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4aa0151d80 0x7f4aa014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00c8430 0x7f4aa01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:53.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00c8430 0x7f4aa01523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.79:33164/0 (socket says 172.21.15.79:33164) 2023-11-28T16:55:53.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/1771253067 learned_addr learned my addr 172.21.15.79:0/1771253067 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:53.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4aa0151d80 0x7f4aa014aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57560/0 (socket says 172.21.15.79:57560) 2023-11-28T16:55:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/1771253067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4aa0151d80 msgr2=0x7f4aa014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 --2- 172.21.15.79:0/1771253067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4aa0151d80 0x7f4aa014aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/1771253067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c7f20 msgr2=0x7f4aa0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 --2- 172.21.15.79:0/1771253067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c7f20 0x7f4aa0158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 -- 172.21.15.79:0/1771253067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a940094d0 con 0x7f4aa00c8430 2023-11-28T16:55:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a9e7fc640 1 --2- 172.21.15.79:0/1771253067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00c8430 0x7f4aa01523d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4a94019050 tx=0x7f4a9401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a87fff640 1 -- 172.21.15.79:0/1771253067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940be3f0 con 0x7f4aa00c8430 2023-11-28T16:55:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a87fff640 1 -- 172.21.15.79:0/1771253067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a940be550 con 0x7f4aa00c8430 2023-11-28T16:55:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa00ab550 con 0x7f4aa00c8430 2023-11-28T16:55:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a87fff640 1 -- 172.21.15.79:0/1771253067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940be900 con 0x7f4aa00c8430 2023-11-28T16:55:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0142f70 con 0x7f4aa00c8430 2023-11-28T16:55:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a87fff640 1 -- 172.21.15.79:0/1771253067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4a940c7440 con 0x7f4aa00c8430 2023-11-28T16:55:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4a87fff640 1 -- 172.21.15.79:0/1771253067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4a940bed60 con 0x7f4aa00c8430 2023-11-28T16:55:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.762+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa00ab0d0 con 0x7f4aa00c8430 2023-11-28T16:55:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.774+0000 7f4a87fff640 1 -- 172.21.15.79:0/1771253067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4aa00ab0d0 con 0x7f4aa00c8430 2023-11-28T16:55:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.842+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da986cc2-83f7-417f-900d-580649b3b2b1", "id": 2} v 0) v1 -- 0x7f4aa00aa3b0 con 0x7f4aa00c8430 2023-11-28T16:55:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.842+0000 7f4a87fff640 1 -- 172.21.15.79:0/1771253067 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da986cc2-83f7-417f-900d-580649b3b2b1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4aa00aa3b0 con 0x7f4aa00c8430 2023-11-28T16:55:53.845 INFO:teuthology.orchestra.run.smithi079.stdout:2 2023-11-28T16:55:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00c8430 msgr2=0x7f4aa01523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 --2- 172.21.15.79:0/1771253067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00c8430 0x7f4aa01523d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4a94019050 tx=0x7f4a9401ac80 comp rx=0 tx=0).stop 2023-11-28T16:55:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 shutdown_connections 2023-11-28T16:55:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 --2- 172.21.15.79:0/1771253067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4aa0151d80 0x7f4aa014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 --2- 172.21.15.79:0/1771253067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00c8430 0x7f4aa01523d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 --2- 172.21.15.79:0/1771253067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00c7f20 0x7f4aa0158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 >> 172.21.15.79:0/1771253067 conn(0x7f4aa00abd00 msgr2=0x7f4aa00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:53.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 shutdown_connections 2023-11-28T16:55:53.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:53.846+0000 7f4aa585a640 1 -- 172.21.15.79:0/1771253067 wait complete. 2023-11-28T16:55:53.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 10ab208d-8315-4e67-ac5b-1fe2b251e52e 3 2023-11-28T16:55:54.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f78365b8640 1 Processor -- start 2023-11-28T16:55:54.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f78365b8640 1 -- start start 2023-11-28T16:55:54.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f78365b8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7830151d80 0x7f78300c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f78365b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78300c7f20 0x7f783006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f78365b8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783006cf70 con 0x7f78300c8430 2023-11-28T16:55:54.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f78365b8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7830152160 con 0x7f7830151d80 2023-11-28T16:55:54.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f78365b8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78300c6a30 con 0x7f78300c7f20 2023-11-28T16:55:54.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f782f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f78300c8430 0x7f783006b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44620/0 (socket says 172.21.15.79:44620) 2023-11-28T16:55:54.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f782f7fe640 1 -- 172.21.15.79:0/1216566473 learned_addr learned my addr 172.21.15.79:0/1216566473 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-11-28T16:55:54.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f7834b55640 1 --2- 172.21.15.79:0/1216566473 >> v2:172.21.15.79:3300/0 conn(0x7f78300c7f20 0x7f783006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f782ffff640 1 --2- 172.21.15.79:0/1216566473 >> v2:172.21.15.26:3300/0 conn(0x7f7830151d80 0x7f78300c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f782effd640 1 -- 172.21.15.79:0/1216566473 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949596244 0 0) 0x7f783006cf70 con 0x7f78300c8430 2023-11-28T16:55:54.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f782effd640 1 -- 172.21.15.79:0/1216566473 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7818003530 con 0x7f78300c8430 2023-11-28T16:55:54.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f7834b55640 1 -- 172.21.15.79:0/1216566473 >> v2:172.21.15.26:3300/0 conn(0x7f7830151d80 msgr2=0x7f78300c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:54.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f7834b55640 1 --2- 172.21.15.79:0/1216566473 >> v2:172.21.15.26:3300/0 conn(0x7f7830151d80 0x7f78300c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f7834b55640 1 -- 172.21.15.79:0/1216566473 >> v1:172.21.15.79:6789/0 conn(0x7f78300c8430 legacy=0x7f783006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.002+0000 7f7834b55640 1 -- 172.21.15.79:0/1216566473 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300c72d0 con 0x7f78300c7f20 2023-11-28T16:55:54.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f7834b55640 1 --2- 172.21.15.79:0/1216566473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78300c7f20 0x7f783006be30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78300c4220 tx=0x7f782801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=898ff93470263f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f782effd640 1 -- 172.21.15.79:0/1216566473 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280a5910 con 0x7f78300c7f20 2023-11-28T16:55:54.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f782effd640 1 -- 172.21.15.79:0/1216566473 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280a5a70 con 0x7f78300c7f20 2023-11-28T16:55:54.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f782effd640 1 -- 172.21.15.79:0/1216566473 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280a5e00 con 0x7f78300c7f20 2023-11-28T16:55:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 -- 172.21.15.79:0/1216566473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78300c7f20 msgr2=0x7f783006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 --2- 172.21.15.79:0/1216566473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78300c7f20 0x7f783006be30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78300c4220 tx=0x7f782801c850 comp rx=0 tx=0).stop 2023-11-28T16:55:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 -- 172.21.15.79:0/1216566473 shutdown_connections 2023-11-28T16:55:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 --2- 172.21.15.79:0/1216566473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78300c7f20 0x7f783006be30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 --2- 172.21.15.79:0/1216566473 >> v2:172.21.15.26:3300/0 conn(0x7f7830151d80 0x7f78300c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 -- 172.21.15.79:0/1216566473 >> 172.21.15.79:0/1216566473 conn(0x7f78300abd00 msgr2=0x7f78300ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 -- 172.21.15.79:0/1216566473 shutdown_connections 2023-11-28T16:55:54.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.006+0000 7f78365b8640 1 -- 172.21.15.79:0/1216566473 wait complete. 2023-11-28T16:55:54.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 Processor -- start 2023-11-28T16:55:54.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 -- start start 2023-11-28T16:55:54.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78300c7f20 0x7f78301ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78300c8430 0x7f78301542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7830151d80 0x7f78300bff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78300bfae0 con 0x7f78300c7f20 2023-11-28T16:55:54.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7830155cd0 con 0x7f7830151d80 2023-11-28T16:55:54.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78301f0870 con 0x7f78300c8430 2023-11-28T16:55:54.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7830151d80 0x7f78300bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7830151d80 0x7f78300bff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36172/0 (socket says 172.21.15.79:36172) 2023-11-28T16:55:54.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 -- 172.21.15.79:0/1896103266 learned_addr learned my addr 172.21.15.79:0/1896103266 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:54.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782ffff640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78300c7f20 0x7f78301ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782f7fe640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78300c8430 0x7f78301542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 -- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78300c8430 msgr2=0x7f78301542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78300c8430 0x7f78301542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 -- 172.21.15.79:0/1896103266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78300c7f20 msgr2=0x7f78301ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78300c7f20 0x7f78301ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 -- 172.21.15.79:0/1896103266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828009a70 con 0x7f7830151d80 2023-11-28T16:55:54.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782ffff640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78300c7f20 0x7f78301ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:55:54.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f7834b55640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7830151d80 0x7f78300bff30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7828019460 tx=0x7f78280195f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782cff9640 1 -- 172.21.15.79:0/1896103266 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b9860 con 0x7f7830151d80 2023-11-28T16:55:54.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782cff9640 1 -- 172.21.15.79:0/1896103266 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280b99c0 con 0x7f7830151d80 2023-11-28T16:55:54.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782cff9640 1 -- 172.21.15.79:0/1896103266 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b9d70 con 0x7f7830151d80 2023-11-28T16:55:54.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78301f0b50 con 0x7f7830151d80 2023-11-28T16:55:54.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78301f1110 con 0x7f7830151d80 2023-11-28T16:55:54.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782cff9640 1 -- 172.21.15.79:0/1896103266 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f78280ad740 con 0x7f7830151d80 2023-11-28T16:55:54.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.010+0000 7f782cff9640 1 -- 172.21.15.79:0/1896103266 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f78280c2aa0 con 0x7f7830151d80 2023-11-28T16:55:54.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.014+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78300bfc50 con 0x7f7830151d80 2023-11-28T16:55:54.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.014+0000 7f782cff9640 1 -- 172.21.15.79:0/1896103266 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f78280e0ce0 con 0x7f7830151d80 2023-11-28T16:55:54.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.082+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10ab208d-8315-4e67-ac5b-1fe2b251e52e", "id": 3} v 0) v1 -- 0x7f78300c4460 con 0x7f7830151d80 2023-11-28T16:55:54.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f782cff9640 1 -- 172.21.15.79:0/1896103266 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10ab208d-8315-4e67-ac5b-1fe2b251e52e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f78280cf030 con 0x7f7830151d80 2023-11-28T16:55:54.087 INFO:teuthology.orchestra.run.smithi079.stdout:3 2023-11-28T16:55:54.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7830151d80 msgr2=0x7f78300bff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7830151d80 0x7f78300bff30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7828019460 tx=0x7f78280195f0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 shutdown_connections 2023-11-28T16:55:54.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7830151d80 0x7f78300bff30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78300c8430 0x7f78301542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 --2- 172.21.15.79:0/1896103266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78300c7f20 0x7f78301ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 >> 172.21.15.79:0/1896103266 conn(0x7f78300abd00 msgr2=0x7f783014cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 shutdown_connections 2023-11-28T16:55:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.086+0000 7f78365b8640 1 -- 172.21.15.79:0/1896103266 wait complete. 2023-11-28T16:55:54.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 95aace8e-79bd-4c68-8370-9676f847bc8a 4 2023-11-28T16:55:54.148 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.146+0000 7fa05f721180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T16:55:54.151 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.148+0000 7f2fb7dcd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T16:55:54.213 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.210+0000 7fa05f721180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T16:55:54.216 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.212+0000 7f2fb7dcd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T16:55:54.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.242+0000 7fa2b67c4640 1 Processor -- start 2023-11-28T16:55:54.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.242+0000 7fa2b67c4640 1 -- start start 2023-11-28T16:55:54.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.242+0000 7fa2b67c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2b00c8430 0x7fa2b006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.242+0000 7fa2b67c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2b00c7f20 0x7fa2b006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.242+0000 7fa2b67c4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b006cf70 con 0x7fa2b0151d80 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.242+0000 7fa2b67c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b0152160 con 0x7fa2b00c8430 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.242+0000 7fa2b67c4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b00c6a30 con 0x7fa2b00c7f20 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2b00c7f20 0x7fa2b006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2b00c7f20 0x7fa2b006bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36182/0 (socket says 172.21.15.79:36182) 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 -- 172.21.15.79:0/3281439946 learned_addr learned my addr 172.21.15.79:0/3281439946 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2af7fe640 1 --2- 172.21.15.79:0/3281439946 >> v2:172.21.15.26:3300/0 conn(0x7fa2b00c8430 0x7fa2b006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 -- 172.21.15.79:0/3281439946 >> v2:172.21.15.26:3300/0 conn(0x7fa2b00c8430 msgr2=0x7fa2b006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 --2- 172.21.15.79:0/3281439946 >> v2:172.21.15.26:3300/0 conn(0x7fa2b00c8430 0x7fa2b006b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 -- 172.21.15.79:0/3281439946 >> v1:172.21.15.79:6789/0 conn(0x7fa2b0151d80 legacy=0x7fa2b00c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 -- 172.21.15.79:0/3281439946 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00c72d0 con 0x7fa2b00c7f20 2023-11-28T16:55:54.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2b4d61640 1 --2- 172.21.15.79:0/3281439946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b00c7f20 0x7fa2b006bc60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00c4220 tx=0x7fa2a801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd6a558ccac1bcd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2aeffd640 1 -- 172.21.15.79:0/3281439946 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80a57d0 con 0x7fa2b00c7f20 2023-11-28T16:55:54.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2aeffd640 1 -- 172.21.15.79:0/3281439946 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a80a5930 con 0x7fa2b00c7f20 2023-11-28T16:55:54.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.246+0000 7fa2aeffd640 1 -- 172.21.15.79:0/3281439946 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80a5cc0 con 0x7fa2b00c7f20 2023-11-28T16:55:54.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 -- 172.21.15.79:0/3281439946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b00c7f20 msgr2=0x7fa2b006bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 --2- 172.21.15.79:0/3281439946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b00c7f20 0x7fa2b006bc60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00c4220 tx=0x7fa2a801c910 comp rx=0 tx=0).stop 2023-11-28T16:55:54.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 -- 172.21.15.79:0/3281439946 shutdown_connections 2023-11-28T16:55:54.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 --2- 172.21.15.79:0/3281439946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b00c7f20 0x7fa2b006bc60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 --2- 172.21.15.79:0/3281439946 >> v2:172.21.15.26:3300/0 conn(0x7fa2b00c8430 0x7fa2b006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 -- 172.21.15.79:0/3281439946 >> 172.21.15.79:0/3281439946 conn(0x7fa2b00abd00 msgr2=0x7fa2b00ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 -- 172.21.15.79:0/3281439946 shutdown_connections 2023-11-28T16:55:54.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 -- 172.21.15.79:0/3281439946 wait complete. 2023-11-28T16:55:54.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 Processor -- start 2023-11-28T16:55:54.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.250+0000 7fa2b67c4640 1 -- start start 2023-11-28T16:55:54.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2b00c7f20 0x7fa2b0156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b00c8430 0x7fa2b01573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b0151d80 0x7fa2b00af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00acbf0 con 0x7fa2b00c8430 2023-11-28T16:55:54.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00ad450 con 0x7fa2b0151d80 2023-11-28T16:55:54.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01edc60 con 0x7fa2b00c7f20 2023-11-28T16:55:54.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2affff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2b00c7f20 0x7fa2b0156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b4d61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b0151d80 0x7fa2b00af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2affff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2b00c7f20 0x7fa2b0156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57590/0 (socket says 172.21.15.79:57590) 2023-11-28T16:55:54.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2affff640 1 -- 172.21.15.79:0/1226851580 learned_addr learned my addr 172.21.15.79:0/1226851580 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:54.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2af7fe640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b00c8430 0x7fa2b01573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b4d61640 1 -- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2b00c7f20 msgr2=0x7fa2b0156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b4d61640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2b00c7f20 0x7fa2b0156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b4d61640 1 -- 172.21.15.79:0/1226851580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b00c8430 msgr2=0x7fa2b01573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b4d61640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b00c8430 0x7fa2b01573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b4d61640 1 -- 172.21.15.79:0/1226851580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8009b30 con 0x7fa2b0151d80 2023-11-28T16:55:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2affff640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2b00c7f20 0x7fa2b0156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:55:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b4d61640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b0151d80 0x7fa2b00af040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80ab000 tx=0x7fa2a80196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2acff9640 1 -- 172.21.15.79:0/1226851580 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8009510 con 0x7fa2b0151d80 2023-11-28T16:55:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2acff9640 1 -- 172.21.15.79:0/1226851580 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a80b8470 con 0x7fa2b0151d80 2023-11-28T16:55:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b00ace00 con 0x7fa2b0151d80 2023-11-28T16:55:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2acff9640 1 -- 172.21.15.79:0/1226851580 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80b8800 con 0x7fa2b0151d80 2023-11-28T16:55:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b014d1e0 con 0x7fa2b0151d80 2023-11-28T16:55:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2acff9640 1 -- 172.21.15.79:0/1226851580 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa2a80b8c60 con 0x7fa2b0151d80 2023-11-28T16:55:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2acff9640 1 -- 172.21.15.79:0/1226851580 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa2a80c1be0 con 0x7fa2b0151d80 2023-11-28T16:55:54.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.254+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b00ad5c0 con 0x7fa2b0151d80 2023-11-28T16:55:54.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.258+0000 7fa2acff9640 1 -- 172.21.15.79:0/1226851580 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa2a80bc030 con 0x7fa2b0151d80 2023-11-28T16:55:54.280 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.278+0000 7fa05f721180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T16:55:54.280 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.276+0000 7f2fb7dcd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T16:55:54.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.326+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "95aace8e-79bd-4c68-8370-9676f847bc8a", "id": 4} v 0) v1 -- 0x7fa2b004e890 con 0x7fa2b0151d80 2023-11-28T16:55:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.330+0000 7fa2acff9640 1 -- 172.21.15.79:0/1226851580 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95aace8e-79bd-4c68-8370-9676f847bc8a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2a80c1da0 con 0x7fa2b0151d80 2023-11-28T16:55:54.333 INFO:teuthology.orchestra.run.smithi079.stdout:4 2023-11-28T16:55:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b0151d80 msgr2=0x7fa2b00af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b0151d80 0x7fa2b00af040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80ab000 tx=0x7fa2a80196b0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 shutdown_connections 2023-11-28T16:55:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2b0151d80 0x7fa2b00af040 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b00c8430 0x7fa2b01573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 --2- 172.21.15.79:0/1226851580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2b00c7f20 0x7fa2b0156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 >> 172.21.15.79:0/1226851580 conn(0x7fa2b00abd00 msgr2=0x7fa2b014ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 shutdown_connections 2023-11-28T16:55:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.334+0000 7fa2b67c4640 1 -- 172.21.15.79:0/1226851580 wait complete. 2023-11-28T16:55:54.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 3d99691f-134a-4c22-ba2b-71a58c467287 5 2023-11-28T16:55:54.373 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.370+0000 7fa05f721180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T16:55:54.373 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.372+0000 7f2fb7dcd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T16:55:54.436 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.434+0000 7fa05f721180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T16:55:54.436 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.436+0000 7f2fb7dcd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T16:55:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dd09b8640 1 Processor -- start 2023-11-28T16:55:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dd09b8640 1 -- start start 2023-11-28T16:55:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dd09b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc151d80 0x7f8dcc0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dd09b8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc06cf70 con 0x7f8dcc0c8430 2023-11-28T16:55:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dd09b8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc152160 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dd09b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0c6a30 con 0x7f8dcc151d80 2023-11-28T16:55:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dcad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8dcc0c7f20 0x7f8dcc06be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44624/0 (socket says 172.21.15.79:44624) 2023-11-28T16:55:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dcad9d640 1 -- 172.21.15.79:0/273188719 learned_addr learned my addr 172.21.15.79:0/273188719 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-11-28T16:55:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dca59c640 1 --2- 172.21.15.79:0/273188719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc151d80 0x7f8dcc0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dc9d9b640 1 -- 172.21.15.79:0/273188719 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434581134 0 0) 0x7f8dc40014a0 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dc9d9b640 1 -- 172.21.15.79:0/273188719 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db8003530 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dc9d9b640 1 -- 172.21.15.79:0/273188719 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187435680 0 0) 0x7f8dcc06cf70 con 0x7f8dcc0c8430 2023-11-28T16:55:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dca59c640 1 -- 172.21.15.79:0/273188719 >> v1:172.21.15.79:6789/0 conn(0x7f8dcc0c7f20 legacy=0x7f8dcc06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dca59c640 1 -- 172.21.15.79:0/273188719 >> v1:172.21.15.26:6789/0 conn(0x7f8dcc0c8430 legacy=0x7f8dcc06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.510+0000 7f8dca59c640 1 -- 172.21.15.79:0/273188719 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0c72d0 con 0x7f8dcc151d80 2023-11-28T16:55:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dca59c640 1 --2- 172.21.15.79:0/273188719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc151d80 0x7f8dcc0c49a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0097f0 tx=0x7f8dbc01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f185b86d3e1e1c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dc9d9b640 1 -- 172.21.15.79:0/273188719 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0ab600 con 0x7f8dcc151d80 2023-11-28T16:55:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dc9d9b640 1 -- 172.21.15.79:0/273188719 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc0a7050 con 0x7f8dcc151d80 2023-11-28T16:55:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dc9d9b640 1 -- 172.21.15.79:0/273188719 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0ab980 con 0x7f8dcc151d80 2023-11-28T16:55:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dd09b8640 1 -- 172.21.15.79:0/273188719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc151d80 msgr2=0x7f8dcc0c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dd09b8640 1 --2- 172.21.15.79:0/273188719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc151d80 0x7f8dcc0c49a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0097f0 tx=0x7f8dbc01c370 comp rx=0 tx=0).stop 2023-11-28T16:55:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dd09b8640 1 -- 172.21.15.79:0/273188719 shutdown_connections 2023-11-28T16:55:54.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dd09b8640 1 --2- 172.21.15.79:0/273188719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc151d80 0x7f8dcc0c49a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dd09b8640 1 -- 172.21.15.79:0/273188719 >> 172.21.15.79:0/273188719 conn(0x7f8dcc0abd00 msgr2=0x7f8dcc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dd09b8640 1 -- 172.21.15.79:0/273188719 shutdown_connections 2023-11-28T16:55:54.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.514+0000 7f8dd09b8640 1 -- 172.21.15.79:0/273188719 wait complete. 2023-11-28T16:55:54.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 Processor -- start 2023-11-28T16:55:54.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 -- start start 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dcc0c7f20 0x7f8dcc0aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc0c8430 0x7f8dcc1eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dcc151d80 0x7f8dcc0c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc1f09d0 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc1f03c0 con 0x7f8dcc151d80 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dd09b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0adc50 con 0x7f8dcc0c8430 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dc3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc0c8430 0x7f8dcc1eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dca59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dcc0c7f20 0x7f8dcc0aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dc3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc0c8430 0x7f8dcc1eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57614/0 (socket says 172.21.15.79:57614) 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dc3fff640 1 -- 172.21.15.79:0/562676761 learned_addr learned my addr 172.21.15.79:0/562676761 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dcad9d640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dcc151d80 0x7f8dcc0c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dca59c640 1 -- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc0c8430 msgr2=0x7f8dcc1eccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dca59c640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc0c8430 0x7f8dcc1eccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dca59c640 1 -- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dcc151d80 msgr2=0x7f8dcc0c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dca59c640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dcc151d80 0x7f8dcc0c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dca59c640 1 -- 172.21.15.79:0/562676761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc009420 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dc3fff640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc0c8430 0x7f8dcc1eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:55:54.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.518+0000 7f8dca59c640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dcc0c7f20 0x7f8dcc0aac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0ab000 tx=0x7f8dbc019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dc2ffd640 1 -- 172.21.15.79:0/562676761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc004030 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dc2ffd640 1 -- 172.21.15.79:0/562676761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc004190 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc0ad970 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dc2ffd640 1 -- 172.21.15.79:0/562676761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc003620 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc0ab190 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dc2ffd640 1 -- 172.21.15.79:0/562676761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8dbc0b2040 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dc2ffd640 1 -- 172.21.15.79:0/562676761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8dbc0b4550 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc1f0220 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.522+0000 7f8dc2ffd640 1 -- 172.21.15.79:0/562676761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8dbc0dbce0 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.530 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.528+0000 7f2fb7dcd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T16:55:54.531 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.530+0000 7fa05f721180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T16:55:54.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.590+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3d99691f-134a-4c22-ba2b-71a58c467287", "id": 5} v 0) v1 -- 0x7f8dcc04e890 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.592 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.590+0000 7fa05f721180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T16:55:54.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.590+0000 7f8dc2ffd640 1 -- 172.21.15.79:0/562676761 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d99691f-134a-4c22-ba2b-71a58c467287", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8dbc0ca030 con 0x7f8dcc0c7f20 2023-11-28T16:55:54.594 INFO:teuthology.orchestra.run.smithi079.stdout:5 2023-11-28T16:55:54.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dcc0c7f20 msgr2=0x7f8dcc0aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dcc0c7f20 0x7f8dcc0aac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0ab000 tx=0x7f8dbc019110 comp rx=0 tx=0).stop 2023-11-28T16:55:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 shutdown_connections 2023-11-28T16:55:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dcc151d80 0x7f8dcc0c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dcc0c8430 0x7f8dcc1eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 --2- 172.21.15.79:0/562676761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dcc0c7f20 0x7f8dcc0aac50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 >> 172.21.15.79:0/562676761 conn(0x7f8dcc0abd00 msgr2=0x7f8dcc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 shutdown_connections 2023-11-28T16:55:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.594+0000 7f8dd09b8640 1 -- 172.21.15.79:0/562676761 wait complete. 2023-11-28T16:55:54.597 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.596+0000 7f2fb7dcd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T16:55:54.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 465da986-7b35-48b9-b557-3703dc726b40 6 2023-11-28T16:55:54.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ed5e79640 1 Processor -- start 2023-11-28T16:55:54.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ed5e79640 1 -- start start 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ed5e79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ed5e79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ed0157e30 0x7f4ed01582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ed5e79640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed0155210 con 0x7f4ed0151d80 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ed5e79640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed006d5d0 con 0x7f4ed0157e30 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ed5e79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed01554e0 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4eceffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ecf7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4ed0151d80 0x7f4ed00abbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44640/0 (socket says 172.21.15.79:44640) 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ecf7fe640 1 -- 172.21.15.79:0/336505556 learned_addr learned my addr 172.21.15.79:0/336505556 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-11-28T16:55:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ecffff640 1 --2- 172.21.15.79:0/336505556 >> v2:172.21.15.79:3300/0 conn(0x7f4ed0157e30 0x7f4ed01582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4eceffd640 1 -- 172.21.15.79:0/336505556 >> v2:172.21.15.79:3300/0 conn(0x7f4ed0157e30 msgr2=0x7f4ed01582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4ece7fc640 1 -- 172.21.15.79:0/336505556 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593206083 0 0) 0x7f4ed0155210 con 0x7f4ed0151d80 2023-11-28T16:55:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4eceffd640 1 --2- 172.21.15.79:0/336505556 >> v2:172.21.15.79:3300/0 conn(0x7f4ed0157e30 0x7f4ed01582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4eceffd640 1 -- 172.21.15.79:0/336505556 >> v1:172.21.15.79:6789/0 conn(0x7f4ed0151d80 legacy=0x7f4ed00abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.750+0000 7f4eceffd640 1 -- 172.21.15.79:0/336505556 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed006d1f0 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4eceffd640 1 --2- 172.21.15.79:0/336505556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00c6310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40097c0 tx=0x7f4ec401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=750806d96fd507a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ece7fc640 1 -- 172.21.15.79:0/336505556 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40ab600 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ece7fc640 1 -- 172.21.15.79:0/336505556 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40a7050 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ece7fc640 1 -- 172.21.15.79:0/336505556 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40ab980 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.759 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.756+0000 7f2fb7dcd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T16:55:54.759 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.758+0000 7fa05f721180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T16:55:54.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 -- 172.21.15.79:0/336505556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 msgr2=0x7f4ed00c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 --2- 172.21.15.79:0/336505556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00c6310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40097c0 tx=0x7f4ec401c360 comp rx=0 tx=0).stop 2023-11-28T16:55:54.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 -- 172.21.15.79:0/336505556 shutdown_connections 2023-11-28T16:55:54.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 --2- 172.21.15.79:0/336505556 >> v2:172.21.15.79:3300/0 conn(0x7f4ed0157e30 0x7f4ed01582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 --2- 172.21.15.79:0/336505556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00c6310 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 -- 172.21.15.79:0/336505556 >> 172.21.15.79:0/336505556 conn(0x7f4ed00c9fe0 msgr2=0x7f4ed00ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 -- 172.21.15.79:0/336505556 shutdown_connections 2023-11-28T16:55:54.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 -- 172.21.15.79:0/336505556 wait complete. 2023-11-28T16:55:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 Processor -- start 2023-11-28T16:55:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.758+0000 7f4ed5e79640 1 -- start start 2023-11-28T16:55:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed0151d80 0x7f4ed014ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ed0157e30 0x7f4ed014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed01542f0 con 0x7f4ed0157e30 2023-11-28T16:55:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed014b6a0 con 0x7f4ed0151d80 2023-11-28T16:55:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0141530 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57632/0 (socket says 172.21.15.79:57632) 2023-11-28T16:55:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4eceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed0151d80 0x7f4ed014ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 -- 172.21.15.79:0/2660581076 learned_addr learned my addr 172.21.15.79:0/2660581076 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecffff640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ed0157e30 0x7f4ed014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 -- 172.21.15.79:0/2660581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed0151d80 msgr2=0x7f4ed014ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed0151d80 0x7f4ed014ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 -- 172.21.15.79:0/2660581076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ed0157e30 msgr2=0x7f4ed014b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ed0157e30 0x7f4ed014b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 -- 172.21.15.79:0/2660581076 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4009420 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ecf7fe640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00aba00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c4b0 tx=0x7f4ec000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4eb7fff640 1 -- 172.21.15.79:0/2660581076 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00074e0 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4eb7fff640 1 -- 172.21.15.79:0/2660581076 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0007660 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed00a9cd0 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4eb7fff640 1 -- 172.21.15.79:0/2660581076 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0004a30 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed0153d50 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4eb7fff640 1 -- 172.21.15.79:0/2660581076 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ec001d440 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4eb7fff640 1 -- 172.21.15.79:0/2660581076 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4ec001dce0 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.762+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed004e890 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.766+0000 7f4eb7fff640 1 -- 172.21.15.79:0/2660581076 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4ec0018070 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.830 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:54.828+0000 7f2fb7dcd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T16:55:54.831 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:54.830+0000 7fa05f721180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T16:55:54.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.834+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "465da986-7b35-48b9-b557-3703dc726b40", "id": 6} v 0) v1 -- 0x7f4ed00738c0 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4eb7fff640 1 -- 172.21.15.79:0/2660581076 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "465da986-7b35-48b9-b557-3703dc726b40", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ec001d6f0 con 0x7f4ed00c7ee0 2023-11-28T16:55:54.840 INFO:teuthology.orchestra.run.smithi079.stdout:6 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 msgr2=0x7f4ed00aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00aba00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c4b0 tx=0x7f4ec000c970 comp rx=0 tx=0).stop 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 shutdown_connections 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ed0157e30 0x7f4ed014b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed0151d80 0x7f4ed014ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 --2- 172.21.15.79:0/2660581076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ed00c7ee0 0x7f4ed00aba00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 >> 172.21.15.79:0/2660581076 conn(0x7f4ed00c9fe0 msgr2=0x7f4ed014f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:54.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 shutdown_connections 2023-11-28T16:55:54.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.838+0000 7f4ed5e79640 1 -- 172.21.15.79:0/2660581076 wait complete. 2023-11-28T16:55:54.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new f2c5d659-554b-4abf-99f7-1f7c5707eb09 7 2023-11-28T16:55:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27cb1d640 1 Processor -- start 2023-11-28T16:55:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27cb1d640 1 -- start start 2023-11-28T16:55:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27cb1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa278151d80 0x7fa2780c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27cb1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa27806be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27cb1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27806cf70 con 0x7fa2780c8430 2023-11-28T16:55:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27cb1d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa278152160 con 0x7fa278151d80 2023-11-28T16:55:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27cb1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780c6a30 con 0x7fa2780c7f20 2023-11-28T16:55:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa278151d80 0x7fa2780c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa276d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa27806be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa278151d80 0x7fa2780c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36232/0 (socket says 172.21.15.79:36232) 2023-11-28T16:55:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27659c640 1 -- 172.21.15.79:0/2728281395 learned_addr learned my addr 172.21.15.79:0/2728281395 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27659c640 1 -- 172.21.15.79:0/2728281395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 msgr2=0x7fa27806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27659c640 1 --2- 172.21.15.79:0/2728281395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa27806be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27659c640 1 -- 172.21.15.79:0/2728281395 >> v1:172.21.15.79:6789/0 conn(0x7fa2780c8430 legacy=0x7fa27806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27659c640 1 -- 172.21.15.79:0/2728281395 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780c72d0 con 0x7fa278151d80 2023-11-28T16:55:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.994+0000 7fa27559a640 1 -- 172.21.15.79:0/2728281395 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495787458 0 0) 0x7fa27806cf70 con 0x7fa2780c8430 2023-11-28T16:55:54.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27659c640 1 --2- 172.21.15.79:0/2728281395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 0x7fa2780c49a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa268009870 tx=0x7fa26801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac2a894d889116b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:54.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27559a640 1 -- 172.21.15.79:0/2728281395 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2680ab680 con 0x7fa278151d80 2023-11-28T16:55:54.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27559a640 1 -- 172.21.15.79:0/2728281395 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2680ab7e0 con 0x7fa278151d80 2023-11-28T16:55:54.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27559a640 1 -- 172.21.15.79:0/2728281395 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2680abb70 con 0x7fa278151d80 2023-11-28T16:55:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2728281395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 msgr2=0x7fa2780c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 --2- 172.21.15.79:0/2728281395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 0x7fa2780c49a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa268009870 tx=0x7fa26801c480 comp rx=0 tx=0).stop 2023-11-28T16:55:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2728281395 shutdown_connections 2023-11-28T16:55:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 --2- 172.21.15.79:0/2728281395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa27806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 --2- 172.21.15.79:0/2728281395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 0x7fa2780c49a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2728281395 >> 172.21.15.79:0/2728281395 conn(0x7fa2780abd00 msgr2=0x7fa2780ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2728281395 shutdown_connections 2023-11-28T16:55:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:54.998+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2728281395 wait complete. 2023-11-28T16:55:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 Processor -- start 2023-11-28T16:55:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 -- start start 2023-11-28T16:55:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa278147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2780c8430 0x7fa2781ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 0x7fa2781ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2781f1420 con 0x7fa2780c8430 2023-11-28T16:55:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2781f0e80 con 0x7fa278151d80 2023-11-28T16:55:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2781f1140 con 0x7fa2780c7f20 2023-11-28T16:55:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa278147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa276d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 0x7fa2781ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa278147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57652/0 (socket says 172.21.15.79:57652) 2023-11-28T16:55:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 -- 172.21.15.79:0/2664756089 learned_addr learned my addr 172.21.15.79:0/2664756089 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-11-28T16:55:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa275d9b640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2780c8430 0x7fa2781ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 -- 172.21.15.79:0/2664756089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 msgr2=0x7fa2781ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 0x7fa2781ed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 -- 172.21.15.79:0/2664756089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2780c8430 msgr2=0x7fa2781ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2780c8430 0x7fa2781ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 -- 172.21.15.79:0/2664756089 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680094d0 con 0x7fa2780c7f20 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27659c640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa278147d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2680ad040 tx=0x7fa26801acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa266ffd640 1 -- 172.21.15.79:0/2664756089 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2680b4800 con 0x7fa2780c7f20 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa266ffd640 1 -- 172.21.15.79:0/2664756089 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2680b4980 con 0x7fa2780c7f20 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2780ab000 con 0x7fa2780c7f20 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa266ffd640 1 -- 172.21.15.79:0/2664756089 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2680b4d30 con 0x7fa2780c7f20 2023-11-28T16:55:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa278149220 con 0x7fa2780c7f20 2023-11-28T16:55:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa266ffd640 1 -- 172.21.15.79:0/2664756089 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa2680be6f0 con 0x7fa2780c7f20 2023-11-28T16:55:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa266ffd640 1 -- 172.21.15.79:0/2664756089 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa2680c7480 con 0x7fa2780c7f20 2023-11-28T16:55:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.002+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2780aae60 con 0x7fa2780c7f20 2023-11-28T16:55:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.006+0000 7fa266ffd640 1 -- 172.21.15.79:0/2664756089 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa2780aae60 con 0x7fa2780c7f20 2023-11-28T16:55:55.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.070+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f2c5d659-554b-4abf-99f7-1f7c5707eb09", "id": 7} v 0) v1 -- 0x7fa27804e890 con 0x7fa2780c7f20 2023-11-28T16:55:55.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.074+0000 7fa266ffd640 1 -- 172.21.15.79:0/2664756089 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2c5d659-554b-4abf-99f7-1f7c5707eb09", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2680cc0b0 con 0x7fa2780c7f20 2023-11-28T16:55:55.079 INFO:teuthology.orchestra.run.smithi079.stdout:7 2023-11-28T16:55:55.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 msgr2=0x7fa278147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa278147d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2680ad040 tx=0x7fa26801acc0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 shutdown_connections 2023-11-28T16:55:55.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa278151d80 0x7fa2781ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2780c8430 0x7fa2781ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 --2- 172.21.15.79:0/2664756089 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2780c7f20 0x7fa278147d50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 >> 172.21.15.79:0/2664756089 conn(0x7fa2780abd00 msgr2=0x7fa2781494b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:55.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 shutdown_connections 2023-11-28T16:55:55.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-11-28T16:55:55.078+0000 7fa27cb1d640 1 -- 172.21.15.79:0/2664756089 wait complete. 2023-11-28T16:55:55.096 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T16:55:55.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T16:55:55.100 INFO:tasks.ceph.osd.0:Started 2023-11-28T16:55:55.100 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T16:55:55.100 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T16:55:55.104 INFO:tasks.ceph.osd.1:Started 2023-11-28T16:55:55.104 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T16:55:55.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T16:55:55.107 INFO:tasks.ceph.osd.2:Started 2023-11-28T16:55:55.107 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T16:55:55.107 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T16:55:55.111 INFO:tasks.ceph.osd.3:Started 2023-11-28T16:55:55.111 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T16:55:55.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T16:55:55.115 INFO:tasks.ceph.osd.4:Started 2023-11-28T16:55:55.115 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T16:55:55.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T16:55:55.119 INFO:tasks.ceph.osd.5:Started 2023-11-28T16:55:55.119 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T16:55:55.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T16:55:55.124 INFO:tasks.ceph.osd.6:Started 2023-11-28T16:55:55.124 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T16:55:55.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T16:55:55.128 INFO:tasks.ceph.osd.7:Started 2023-11-28T16:55:55.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:55:55.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a16e32640 1 Processor -- start 2023-11-28T16:55:55.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a16e32640 1 -- start start 2023-11-28T16:55:55.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a16e32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a10151ee0 0x7f3a1006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:55.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a16e32640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a100c5a30 con 0x7f3a100c65d0 2023-11-28T16:55:55.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a16e32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a101522c0 con 0x7f3a1006b650 2023-11-28T16:55:55.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a16e32640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1006bc70 con 0x7f3a10151ee0 2023-11-28T16:55:55.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a14bce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a10151ee0 0x7f3a1006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a153cf640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a100c65d0 0x7f3a1015f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34882/0 (socket says 172.21.15.26:34882) 2023-11-28T16:55:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.332+0000 7f3a153cf640 1 -- 172.21.15.26:0/2826553106 learned_addr learned my addr 172.21.15.26:0/2826553106 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:55:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a14bce640 1 -- 172.21.15.26:0/2826553106 >> v1:172.21.15.79:6789/0 conn(0x7f3a1006b650 legacy=0x7f3a100c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a14bce640 1 -- 172.21.15.26:0/2826553106 >> v1:172.21.15.26:6789/0 conn(0x7f3a100c65d0 legacy=0x7f3a1015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a14bce640 1 -- 172.21.15.26:0/2826553106 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10155490 con 0x7f3a10151ee0 2023-11-28T16:55:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a14bce640 1 --2- 172.21.15.26:0/2826553106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a10151ee0 0x7f3a1006b110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a040097c0 tx=0x7f3a0401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e324867f5978d48 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a0f7fe640 1 -- 172.21.15.26:0/2826553106 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04004230 con 0x7f3a10151ee0 2023-11-28T16:55:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a0f7fe640 1 -- 172.21.15.26:0/2826553106 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a040a7050 con 0x7f3a10151ee0 2023-11-28T16:55:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a0f7fe640 1 -- 172.21.15.26:0/2826553106 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04003620 con 0x7f3a10151ee0 2023-11-28T16:55:55.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a16e32640 1 -- 172.21.15.26:0/2826553106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a10151ee0 msgr2=0x7f3a1006b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.336+0000 7f3a16e32640 1 --2- 172.21.15.26:0/2826553106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a10151ee0 0x7f3a1006b110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a040097c0 tx=0x7f3a0401c3c0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- 172.21.15.26:0/2826553106 shutdown_connections 2023-11-28T16:55:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 --2- 172.21.15.26:0/2826553106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a10151ee0 0x7f3a1006b110 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- 172.21.15.26:0/2826553106 >> 172.21.15.26:0/2826553106 conn(0x7f3a100ca060 msgr2=0x7f3a100ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- 172.21.15.26:0/2826553106 shutdown_connections 2023-11-28T16:55:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- 172.21.15.26:0/2826553106 wait complete. 2023-11-28T16:55:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 Processor -- start 2023-11-28T16:55:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- start start 2023-11-28T16:55:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a1006b650 0x7f3a101f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a100c65d0 0x7f3a10145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a10151ee0 0x7f3a100c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a10156640 con 0x7f3a100c65d0 2023-11-28T16:55:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a101f1d10 con 0x7f3a10151ee0 2023-11-28T16:55:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a16e32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100c1ca0 con 0x7f3a1006b650 2023-11-28T16:55:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a100c65d0 0x7f3a10145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a100c65d0 0x7f3a10145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38598/0 (socket says 172.21.15.26:38598) 2023-11-28T16:55:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 -- 172.21.15.26:0/1823839106 learned_addr learned my addr 172.21.15.26:0/1823839106 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:55:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a14bce640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a1006b650 0x7f3a101f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a153cf640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a10151ee0 0x7f3a100c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 -- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a1006b650 msgr2=0x7f3a101f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a1006b650 0x7f3a101f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 -- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a10151ee0 msgr2=0x7f3a100c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a10151ee0 0x7f3a100c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 -- 172.21.15.26:0/1823839106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04009420 con 0x7f3a100c65d0 2023-11-28T16:55:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.340+0000 7f3a0ffff640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a100c65d0 0x7f3a10145640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00c3c0 tx=0x7f39fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a0d7fa640 1 -- 172.21.15.26:0/1823839106 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0052d0 con 0x7f3a100c65d0 2023-11-28T16:55:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a0d7fa640 1 -- 172.21.15.26:0/1823839106 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc005430 con 0x7f3a100c65d0 2023-11-28T16:55:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a0d7fa640 1 -- 172.21.15.26:0/1823839106 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc003840 con 0x7f3a100c65d0 2023-11-28T16:55:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a10156290 con 0x7f3a100c65d0 2023-11-28T16:55:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a10155fb0 con 0x7f3a100c65d0 2023-11-28T16:55:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a0d7fa640 1 -- 172.21.15.26:0/1823839106 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f39fc003ca0 con 0x7f3a100c65d0 2023-11-28T16:55:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a0d7fa640 1 -- 172.21.15.26:0/1823839106 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f39fc011c60 con 0x7f3a100c65d0 2023-11-28T16:55:55.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a10067a40 con 0x7f3a100c65d0 2023-11-28T16:55:55.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.344+0000 7f3a0d7fa640 1 -- 172.21.15.26:0/1823839106 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f39fc017070 con 0x7f3a100c65d0 2023-11-28T16:55:55.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a10066ba0 con 0x7f3a100c65d0 2023-11-28T16:55:55.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a0d7fa640 1 -- 172.21.15.26:0/1823839106 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3a10066ba0 con 0x7f3a100c65d0 2023-11-28T16:55:55.427 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:55:55.427 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:55:55.074883+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:55:55.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a100c65d0 msgr2=0x7f3a10145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a100c65d0 0x7f3a10145640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00c3c0 tx=0x7f39fc00c880 comp rx=0 tx=0).stop 2023-11-28T16:55:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 shutdown_connections 2023-11-28T16:55:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a10151ee0 0x7f3a100c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a100c65d0 0x7f3a10145640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 --2- 172.21.15.26:0/1823839106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a1006b650 0x7f3a101f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.424+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 >> 172.21.15.26:0/1823839106 conn(0x7f3a100ca060 msgr2=0x7f3a100aa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.428+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 shutdown_connections 2023-11-28T16:55:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:55:55.428+0000 7f3a16e32640 1 -- 172.21.15.26:0/1823839106 wait complete. 2023-11-28T16:55:55.450 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T16:55:55.450 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T16:55:55.488 INFO:tasks.ceph.mgr.y.smithi026.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T16:55:55.489 INFO:tasks.ceph.mgr.y.smithi026.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T16:55:55.489 INFO:tasks.ceph.mgr.y.smithi026.stderr: from numpy import show_config as show_numpy_config 2023-11-28T16:55:55.507 INFO:tasks.ceph.mgr.x.smithi079.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T16:55:55.507 INFO:tasks.ceph.mgr.x.smithi079.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T16:55:55.507 INFO:tasks.ceph.mgr.x.smithi079.stderr: from numpy import show_config as show_numpy_config 2023-11-28T16:55:55.533 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:55.532+0000 7f2fb7dcd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T16:55:55.543 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:55.542+0000 7fa05f721180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T16:55:55.677 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:55.676+0000 7f2fb7dcd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T16:55:55.677 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:55.674+0000 7fa05f721180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T16:55:55.802 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-11-28T16:55:55.800+0000 7f31a9b59640 -1 Falling back to public interface 2023-11-28T16:55:55.803 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-11-28T16:55:55.802+0000 7f63b00ba640 -1 Falling back to public interface 2023-11-28T16:55:55.810 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-11-28T16:55:55.808+0000 7f6be3695640 -1 Falling back to public interface 2023-11-28T16:55:55.810 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-11-28T16:55:55.808+0000 7f8aa9454640 -1 Falling back to public interface 2023-11-28T16:55:55.829 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-11-28T16:55:55.828+0000 7f49ce02b640 -1 Falling back to public interface 2023-11-28T16:55:55.839 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-11-28T16:55:55.838+0000 7f6b2f7d3640 -1 Falling back to public interface 2023-11-28T16:55:55.854 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-11-28T16:55:55.854+0000 7f3f0722e640 -1 Falling back to public interface 2023-11-28T16:55:55.867 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-11-28T16:55:55.866+0000 7f45bd543640 -1 Falling back to public interface 2023-11-28T16:55:55.871 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:55.868+0000 7f2fb7dcd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T16:55:55.901 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:55.898+0000 7fa05f721180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T16:55:55.948 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:55.944+0000 7f2fb7dcd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T16:55:55.974 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:55.974+0000 7fa05f721180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T16:55:56.094 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:56.092+0000 7f2fb7dcd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T16:55:56.111 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:56.110+0000 7fa05f721180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T16:55:56.256 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T16:55:56.389 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 Processor -- start 2023-11-28T16:55:56.389 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 -- start start 2023-11-28T16:55:56.390 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a08157fa0 0x7f6a08158380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:56.391 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a0806b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:56.391 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a080c55d0 0x7f6a0806b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:56.391 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a080c5450 con 0x7f6a08157fa0 2023-11-28T16:55:56.391 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0806bcb0 con 0x7f6a080c55d0 2023-11-28T16:55:56.391 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a0dabb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c6980 con 0x7f6a080c9c30 2023-11-28T16:55:56.391 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a08157fa0 0x7f6a08158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:56.392 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a08157fa0 0x7f6a08158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38612/0 (socket says 172.21.15.26:38612) 2023-11-28T16:55:56.392 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 -- 172.21.15.26:0/1270986215 learned_addr learned my addr 172.21.15.26:0/1270986215 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:55:56.392 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a06ffd640 1 --2- 172.21.15.26:0/1270986215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a0806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:56.392 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a07fff640 1 --2- 172.21.15.26:0/1270986215 >> v2:172.21.15.79:3300/0 conn(0x7f6a080c55d0 0x7f6a0806b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:56.392 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 -- 172.21.15.26:0/1270986215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 msgr2=0x7f6a0806b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:56.393 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 --2- 172.21.15.26:0/1270986215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a0806b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.393 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 -- 172.21.15.26:0/1270986215 >> v2:172.21.15.79:3300/0 conn(0x7f6a080c55d0 msgr2=0x7f6a0806b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:55:56.393 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 --2- 172.21.15.26:0/1270986215 >> v2:172.21.15.79:3300/0 conn(0x7f6a080c55d0 0x7f6a0806b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.394 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a077fe640 1 -- 172.21.15.26:0/1270986215 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08158c80 con 0x7f6a08157fa0 2023-11-28T16:55:56.394 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.388+0000 7f6a07fff640 1 --2- 172.21.15.26:0/1270986215 >> v2:172.21.15.79:3300/0 conn(0x7f6a080c55d0 0x7f6a0806b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:55:56.395 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a077fe640 1 --2- 172.21.15.26:0/1270986215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a08157fa0 0x7f6a08158380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a0806cfa0 tx=0x7f69f801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d001d3eb1007315 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:56.395 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a067fc640 1 -- 172.21.15.26:0/1270986215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80ab600 con 0x7f6a08157fa0 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a067fc640 1 -- 172.21.15.26:0/1270986215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f80a7050 con 0x7f6a08157fa0 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a067fc640 1 -- 172.21.15.26:0/1270986215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80ab980 con 0x7f6a08157fa0 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 -- 172.21.15.26:0/1270986215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a08157fa0 msgr2=0x7f6a08158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/1270986215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a08157fa0 0x7f6a08158380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a0806cfa0 tx=0x7f69f801c3b0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 -- 172.21.15.26:0/1270986215 shutdown_connections 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/1270986215 >> v2:172.21.15.79:3300/0 conn(0x7f6a080c55d0 0x7f6a0806b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/1270986215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a0806b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/1270986215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a08157fa0 0x7f6a08158380 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 -- 172.21.15.26:0/1270986215 >> 172.21.15.26:0/1270986215 conn(0x7f6a080ca0b0 msgr2=0x7f6a080ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:56.396 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 -- 172.21.15.26:0/1270986215 shutdown_connections 2023-11-28T16:55:56.397 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 -- 172.21.15.26:0/1270986215 wait complete. 2023-11-28T16:55:56.398 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 Processor -- start 2023-11-28T16:55:56.398 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.392+0000 7f6a0dabb640 1 -- start start 2023-11-28T16:55:56.398 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a080c55d0 0x7f6a08157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a08144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a08157fa0 0x7f6a080c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081ede20 con 0x7f6a080c55d0 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081ed210 con 0x7f6a08157fa0 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081ed4f0 con 0x7f6a080c9c30 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a080c55d0 0x7f6a08157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a080c55d0 0x7f6a08157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38620/0 (socket says 172.21.15.26:38620) 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 -- 172.21.15.26:0/2054903142 learned_addr learned my addr 172.21.15.26:0/2054903142 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a07fff640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a08157fa0 0x7f6a080c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:56.399 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a06ffd640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a08144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:55:56.400 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 -- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 msgr2=0x7f6a08144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:56.400 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a08144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.400 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 -- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a08157fa0 msgr2=0x7f6a080c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:56.400 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a08157fa0 0x7f6a080c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.400 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 -- 172.21.15.26:0/2054903142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80094d0 con 0x7f6a080c55d0 2023-11-28T16:55:56.401 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a077fe640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a080c55d0 0x7f6a08157760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69f801aa60 tx=0x7f69f8019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f69effff640 1 -- 172.21.15.26:0/2054903142 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80b4420 con 0x7f6a080c55d0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f69effff640 1 -- 172.21.15.26:0/2054903142 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f80b4580 con 0x7f6a080c55d0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f69effff640 1 -- 172.21.15.26:0/2054903142 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80b4930 con 0x7f6a080c55d0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a081ed7d0 con 0x7f6a080c55d0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a08144970 con 0x7f6a080c55d0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f69effff640 1 -- 172.21.15.26:0/2054903142 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f69f80b2070 con 0x7f6a080c55d0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f69effff640 1 -- 172.21.15.26:0/2054903142 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f69f80b4d90 con 0x7f6a080c55d0 2023-11-28T16:55:56.402 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.396+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a080689b0 con 0x7f6a080c55d0 2023-11-28T16:55:56.403 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.400+0000 7f69effff640 1 -- 172.21.15.26:0/2054903142 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f69f80b0070 con 0x7f6a080c55d0 2023-11-28T16:55:56.480 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.476+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a080c65f0 con 0x7f6a080c55d0 2023-11-28T16:55:56.480 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.476+0000 7f69effff640 1 -- 172.21.15.26:0/2054903142 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f69f80bd400 con 0x7f6a080c55d0 2023-11-28T16:55:56.481 INFO:teuthology.misc.health.smithi026.stdout: 2023-11-28T16:55:56.481 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:55:55.074883+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:55:56.482 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a080c55d0 msgr2=0x7f6a08157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:55:56.482 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a080c55d0 0x7f6a08157760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69f801aa60 tx=0x7f69f8019150 comp rx=0 tx=0).stop 2023-11-28T16:55:56.482 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 shutdown_connections 2023-11-28T16:55:56.482 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a08157fa0 0x7f6a080c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.482 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a080c9c30 0x7f6a08144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.482 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 --2- 172.21.15.26:0/2054903142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a080c55d0 0x7f6a08157760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:55:56.483 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 >> 172.21.15.26:0/2054903142 conn(0x7f6a080ca0b0 msgr2=0x7f6a08152890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:55:56.483 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 shutdown_connections 2023-11-28T16:55:56.483 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:55:56.480+0000 7f6a0dabb640 1 -- 172.21.15.26:0/2054903142 wait complete. 2023-11-28T16:55:56.499 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T16:55:56.793 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:56.790+0000 7fa05f721180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T16:55:56.855 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:56.852+0000 7f2fb7dcd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T16:55:56.880 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:56.878+0000 7fa05f721180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T16:55:56.947 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:56.944+0000 7f2fb7dcd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T16:55:57.070 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:57.070+0000 7fa05f721180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T16:55:57.149 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:57.148+0000 7f2fb7dcd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T16:55:57.155 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:57.154+0000 7fa05f721180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T16:55:57.238 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:57.236+0000 7f2fb7dcd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T16:55:57.484 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:57.482+0000 7fa05f721180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T16:55:57.553 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:57.550+0000 7fa05f721180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T16:55:57.586 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:57.584+0000 7f2fb7dcd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T16:55:57.664 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-11-28T16:55:57.660+0000 7f2fb7dcd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T16:55:58.575 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:58.574+0000 7fa006ea1640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T16:55:58.575 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-11-28T16:55:58.574+0000 7fa006ea1640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T16:55:59.596 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-11-28T16:55:59.592+0000 7f31a9b59640 -1 osd.0 0 log_to_monitors true 2023-11-28T16:55:59.670 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-11-28T16:55:59.666+0000 7f6b2f7d3640 -1 osd.4 0 log_to_monitors true 2023-11-28T16:55:59.701 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-11-28T16:55:59.696+0000 7f49ce02b640 -1 osd.2 0 log_to_monitors true 2023-11-28T16:55:59.784 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-11-28T16:55:59.780+0000 7f8aa9454640 -1 osd.3 0 log_to_monitors true 2023-11-28T16:55:59.816 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-11-28T16:55:59.812+0000 7f6be3695640 -1 osd.1 0 log_to_monitors true 2023-11-28T16:55:59.821 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-11-28T16:55:59.818+0000 7f45bd543640 -1 osd.7 0 log_to_monitors true 2023-11-28T16:55:59.835 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-11-28T16:55:59.834+0000 7f63b00ba640 -1 osd.5 0 log_to_monitors true 2023-11-28T16:55:59.884 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-11-28T16:55:59.882+0000 7f3f0722e640 -1 osd.6 0 log_to_monitors true 2023-11-28T16:56:03.305 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:03.394 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-11-28T16:56:03.392+0000 7f8aa4bda640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T16:56:03.441 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-11-28T16:56:03.440+0000 7f6bdee1b640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T16:56:03.453 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-11-28T16:56:03.452+0000 7f31a52df640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T16:56:03.456 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-11-28T16:56:03.452+0000 7f49c8c46640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T16:56:03.462 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-11-28T16:56:03.460+0000 7f8a9d227640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:03.470 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-11-28T16:56:03.468+0000 7f6bd7468640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:03.487 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-11-28T16:56:03.484+0000 7f319d92c640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:03.487 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-11-28T16:56:03.484+0000 7f49c1293640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:03.492 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.488+0000 7f6a2a548640 1 Processor -- start 2023-11-28T16:56:03.493 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a2a548640 1 -- start start 2023-11-28T16:56:03.496 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a2a548640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a240c4ca0 0x7f6a24155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.496 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a2a548640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 0x7f6a2414e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.496 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a2a548640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a240cad40 con 0x7f6a2414e950 2023-11-28T16:56:03.496 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a2a548640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2406ceb0 con 0x7f6a240c4ca0 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a2a548640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24155750 con 0x7f6a240bd750 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6a2414e950 0x7f6a240c6f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38690/0 (socket says 172.21.15.26:38690) 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 -- 172.21.15.26:0/3561059358 learned_addr learned my addr 172.21.15.26:0/3561059358 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29546640 1 --2- 172.21.15.26:0/3561059358 >> v2:172.21.15.79:3300/0 conn(0x7f6a240c4ca0 0x7f6a24155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a28d45640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 0x7f6a2414e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821807194 0 0) 0x7f6a240cad40 con 0x7f6a2414e950 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a10003530 con 0x7f6a2414e950 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2865775319 0 0) 0x7f6a10003530 con 0x7f6a2414e950 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 msgr2=0x7f6a2414e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 0x7f6a2414e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 >> v2:172.21.15.79:3300/0 conn(0x7f6a240c4ca0 msgr2=0x7f6a24155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 --2- 172.21.15.26:0/3561059358 >> v2:172.21.15.79:3300/0 conn(0x7f6a240c4ca0 0x7f6a24155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.497 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240ca4a0 con 0x7f6a2414e950 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f6a1c001a00 con 0x7f6a2414e950 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 >> v1:172.21.15.26:6789/0 conn(0x7f6a2414e950 legacy=0x7f6a240c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10003980 0x7f6a10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 0x7f6a100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004d10 0x7f6a10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2406ceb0 con 0x7f6a10004d10 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24155750 con 0x7f6a10003980 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1000b9c0 con 0x7f6a240bd750 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004d10 0x7f6a10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a28d45640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 0x7f6a100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.498 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29546640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10003980 0x7f6a10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.499 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 -- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 msgr2=0x7f6a100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:03.499 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240bd750 0x7f6a100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.499 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 -- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10003980 msgr2=0x7f6a10003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:03.499 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10003980 0x7f6a10003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.499 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.492+0000 7f6a29d47640 1 -- 172.21.15.26:0/3561059358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10003530 con 0x7f6a10004d10 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a29d47640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004d10 0x7f6a10005190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00a830 tx=0x7f6a1c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770974fbbf9a8731 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0ad630 con 0x7f6a10004d10 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c0a8070 con 0x7f6a10004d10 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a1bfff640 1 -- 172.21.15.26:0/3561059358 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0ad9f0 con 0x7f6a10004d10 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a2a548640 1 -- 172.21.15.26:0/3561059358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004d10 msgr2=0x7f6a10005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a2a548640 1 --2- 172.21.15.26:0/3561059358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004d10 0x7f6a10005190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00a830 tx=0x7f6a1c01d360 comp rx=0 tx=0).stop 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a29d47640 1 -- 172.21.15.26:0/3561059358 reap_dead start 2023-11-28T16:56:03.500 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a2a548640 1 -- 172.21.15.26:0/3561059358 shutdown_connections 2023-11-28T16:56:03.501 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a2a548640 1 -- 172.21.15.26:0/3561059358 >> 172.21.15.26:0/3561059358 conn(0x7f6a24071e90 msgr2=0x7f6a240722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:03.501 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a2a548640 1 -- 172.21.15.26:0/3561059358 shutdown_connections 2023-11-28T16:56:03.501 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.496+0000 7f6a2a548640 1 -- 172.21.15.26:0/3561059358 wait complete. 2023-11-28T16:56:03.501 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 Processor -- start 2023-11-28T16:56:03.502 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 -- start start 2023-11-28T16:56:03.504 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10004d10 0x7f6a240be800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.504 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240ac540 0x7f6a240c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.504 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a240be270 0x7f6a2414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.504 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240bf780 con 0x7f6a240be270 2023-11-28T16:56:03.505 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240be0e0 con 0x7f6a10004d10 2023-11-28T16:56:03.505 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24152440 con 0x7f6a240ac540 2023-11-28T16:56:03.505 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a240be270 0x7f6a2414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a240be270 0x7f6a2414cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51514/0 (socket says 172.21.15.26:51514) 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 -- 172.21.15.26:0/1100339696 learned_addr learned my addr 172.21.15.26:0/1100339696 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29546640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10004d10 0x7f6a240be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 -- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240ac540 msgr2=0x7f6a240c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a28d45640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240ac540 0x7f6a240c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240ac540 0x7f6a240c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 -- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10004d10 msgr2=0x7f6a240be800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:03.506 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10004d10 0x7f6a240be800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 -- 172.21.15.26:0/1100339696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a241edab0 con 0x7f6a240be270 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a28d45640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240ac540 0x7f6a240c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a29d47640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a240be270 0x7f6a2414cf70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c098d80 tx=0x7f6a10005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a19ffb640 1 -- 172.21.15.26:0/1100339696 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0017c0 con 0x7f6a240be270 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a19ffb640 1 -- 172.21.15.26:0/1100339696 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c001920 con 0x7f6a240be270 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a19ffb640 1 -- 172.21.15.26:0/1100339696 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c004d70 con 0x7f6a240be270 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a240bdbb0 con 0x7f6a240be270 2023-11-28T16:56:03.507 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.500+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a240c0860 con 0x7f6a240be270 2023-11-28T16:56:03.509 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.504+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a240c0b40 con 0x7f6a240be270 2023-11-28T16:56:03.509 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.504+0000 7f6a19ffb640 1 -- 172.21.15.26:0/1100339696 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 86114+0+0 (secure 0 0 0) 0x7f6a1c0aa030 con 0x7f6a240be270 2023-11-28T16:56:03.509 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.504+0000 7f6a19ffb640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a08066870 0x7f6a08068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:03.510 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.504+0000 7f6a19ffb640 1 -- 172.21.15.26:0/1100339696 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f6a1c11cf30 con 0x7f6a240be270 2023-11-28T16:56:03.510 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.504+0000 7f6a29546640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a08066870 0x7f6a08068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:03.510 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.504+0000 7f6a29546640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a08066870 0x7f6a08068d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009b20 tx=0x7f6a20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:03.512 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.508+0000 7f6a19ffb640 1 -- 172.21.15.26:0/1100339696 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a240c0b40 con 0x7f6a240be270 2023-11-28T16:56:03.673 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.668+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a240c0b40 con 0x7f6a240be270 2023-11-28T16:56:03.673 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a19ffb640 1 -- 172.21.15.26:0/1100339696 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6a240c0b40 con 0x7f6a240be270 2023-11-28T16:56:03.674 INFO:teuthology.misc.health.smithi026.stdout: 2023-11-28T16:56:03.674 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":12,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:01.576150+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a08066870 msgr2=0x7f6a08068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a08066870 0x7f6a08068d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009b20 tx=0x7f6a20008040 comp rx=0 tx=0).stop 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a240be270 msgr2=0x7f6a2414cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a240be270 0x7f6a2414cf70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c098d80 tx=0x7f6a10005800 comp rx=0 tx=0).stop 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 shutdown_connections 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a240be270 0x7f6a2414cf70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a08066870 0x7f6a08068d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a240ac540 0x7f6a240c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 --2- 172.21.15.26:0/1100339696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a10004d10 0x7f6a240be800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:03.676 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 >> 172.21.15.26:0/1100339696 conn(0x7f6a24071e90 msgr2=0x7f6a240c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:03.677 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 shutdown_connections 2023-11-28T16:56:03.677 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:03.672+0000 7f6a2a548640 1 -- 172.21.15.26:0/1100339696 wait complete. 2023-11-28T16:56:03.693 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T16:56:03.834 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-11-28T16:56:03.830+0000 7f45b8cc9640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T16:56:03.869 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-11-28T16:56:03.866+0000 7f45b1316640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:03.914 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-11-28T16:56:03.914+0000 7f3f01f54640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T16:56:03.935 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-11-28T16:56:03.934+0000 7f63ab842640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T16:56:03.947 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-11-28T16:56:03.946+0000 7f3efa5a1640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:03.959 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-11-28T16:56:03.958+0000 7f63a3e8f640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:04.122 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-11-28T16:56:04.118+0000 7f6b2c78f640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T16:56:04.155 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-11-28T16:56:04.154+0000 7f6b235a6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T16:56:10.500 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:10.643 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f2e9c640 1 Processor -- start 2023-11-28T16:56:10.643 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f2e9c640 1 -- start start 2023-11-28T16:56:10.646 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f2e9c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23ec0c5230 0x7f23ec155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:10.646 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f2e9c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec06c020 con 0x7f23ec0c80a0 2023-11-28T16:56:10.646 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f2e9c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec0c8a00 con 0x7f23ec151f20 2023-11-28T16:56:10.646 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f2e9c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec0acc50 con 0x7f23ec0c5230 2023-11-28T16:56:10.647 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23ebfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23ec0c5230 0x7f23ec155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:10.647 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f1439640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f23ec0c80a0 0x7f23ec06c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38698/0 (socket says 172.21.15.26:38698) 2023-11-28T16:56:10.647 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f1439640 1 -- 172.21.15.26:0/374465403 learned_addr learned my addr 172.21.15.26:0/374465403 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:10.647 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23ebfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23ec0c5230 0x7f23ec155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51520/0 (socket says 172.21.15.26:51520) 2023-11-28T16:56:10.647 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23f0c38640 1 --1- 172.21.15.26:0/374465403 >> v1:172.21.15.79:6789/0 conn(0x7f23ec151f20 0x7f23ec0c4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:56308/0 (socket says 172.21.15.26:56308) 2023-11-28T16:56:10.648 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23ebfff640 1 -- 172.21.15.26:0/374465403 >> v1:172.21.15.79:6789/0 conn(0x7f23ec151f20 legacy=0x7f23ec0c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:10.648 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23ebfff640 1 -- 172.21.15.26:0/374465403 >> v1:172.21.15.26:6789/0 conn(0x7f23ec0c80a0 legacy=0x7f23ec06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:10.648 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23ebfff640 1 -- 172.21.15.26:0/374465403 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0c6bb0 con 0x7f23ec0c5230 2023-11-28T16:56:10.648 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.639+0000 7f23eb7fe640 1 -- 172.21.15.26:0/374465403 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103786899 0 0) 0x7f23ec06c020 con 0x7f23ec0c80a0 2023-11-28T16:56:10.651 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.643+0000 7f23ebfff640 1 --2- 172.21.15.26:0/374465403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c5230 0x7f23ec155250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097c0 tx=0x7f23d801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b9234e1295715a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:10.651 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.643+0000 7f23eb7fe640 1 -- 172.21.15.26:0/374465403 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80ab600 con 0x7f23ec0c5230 2023-11-28T16:56:10.651 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.643+0000 7f23eb7fe640 1 -- 172.21.15.26:0/374465403 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d80a7050 con 0x7f23ec0c5230 2023-11-28T16:56:10.651 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.643+0000 7f23eb7fe640 1 -- 172.21.15.26:0/374465403 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80ab980 con 0x7f23ec0c5230 2023-11-28T16:56:10.652 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.643+0000 7f23f2e9c640 1 -- 172.21.15.26:0/374465403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c5230 msgr2=0x7f23ec155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:10.652 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.643+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/374465403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c5230 0x7f23ec155250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097c0 tx=0x7f23d801c360 comp rx=0 tx=0).stop 2023-11-28T16:56:10.652 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- 172.21.15.26:0/374465403 shutdown_connections 2023-11-28T16:56:10.652 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/374465403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c5230 0x7f23ec155250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.652 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- 172.21.15.26:0/374465403 >> 172.21.15.26:0/374465403 conn(0x7f23ec0722c0 msgr2=0x7f23ec0abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:10.653 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- 172.21.15.26:0/374465403 shutdown_connections 2023-11-28T16:56:10.653 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- 172.21.15.26:0/374465403 wait complete. 2023-11-28T16:56:10.653 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 Processor -- start 2023-11-28T16:56:10.653 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- start start 2023-11-28T16:56:10.658 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23ec0c5230 0x7f23ec0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:10.659 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c80a0 0x7f23ec0af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:10.659 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec151f20 0x7f23ec156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:10.659 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec147f20 con 0x7f23ec0c80a0 2023-11-28T16:56:10.659 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0adaf0 con 0x7f23ec151f20 2023-11-28T16:56:10.659 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f2e9c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0addd0 con 0x7f23ec0c5230 2023-11-28T16:56:10.660 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c80a0 0x7f23ec0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:10.663 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c80a0 0x7f23ec0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51522/0 (socket says 172.21.15.26:51522) 2023-11-28T16:56:10.663 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 -- 172.21.15.26:0/2090569573 learned_addr learned my addr 172.21.15.26:0/2090569573 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f1439640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec151f20 0x7f23ec156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23f0c38640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23ec0c5230 0x7f23ec0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 -- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23ec0c5230 msgr2=0x7f23ec0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23ec0c5230 0x7f23ec0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 -- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec151f20 msgr2=0x7f23ec156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec151f20 0x7f23ec156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 -- 172.21.15.26:0/2090569573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8009420 con 0x7f23ec0c80a0 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.647+0000 7f23ebfff640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c80a0 0x7f23ec0af250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f23d8018f70 tx=0x7f23d8019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23e97fa640 1 -- 172.21.15.26:0/2090569573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80b4610 con 0x7f23ec0c80a0 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23e97fa640 1 -- 172.21.15.26:0/2090569573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d80abe90 con 0x7f23ec0c80a0 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ec0ae0b0 con 0x7f23ec0c80a0 2023-11-28T16:56:10.664 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23e97fa640 1 -- 172.21.15.26:0/2090569573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80b49d0 con 0x7f23ec0c80a0 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec0af790 con 0x7f23ec0c80a0 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec0ad930 con 0x7f23ec0c80a0 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23e97fa640 1 -- 172.21.15.26:0/2090569573 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f23d80b2040 con 0x7f23ec0c80a0 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23e97fa640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23d0066900 0x7f23d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23e97fa640 1 -- 172.21.15.26:0/2090569573 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23d811e030 con 0x7f23ec0c80a0 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.651+0000 7f23f0c38640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23d0066900 0x7f23d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.655+0000 7f23f0c38640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23d0066900 0x7f23d0068dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23e0000f70 tx=0x7f23e0007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:10.665 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.659+0000 7f23e97fa640 1 -- 172.21.15.26:0/2090569573 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23d80eb700 con 0x7f23ec0c80a0 2023-11-28T16:56:10.821 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.815+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23ec0adf10 con 0x7f23ec0c80a0 2023-11-28T16:56:10.822 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23e97fa640 1 -- 172.21.15.26:0/2090569573 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12778 (secure 0 0 0) 0x7f23ec0adf10 con 0x7f23ec0c80a0 2023-11-28T16:56:10.822 INFO:teuthology.misc.health.smithi026.stdout: 2023-11-28T16:56:10.822 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":16,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:07.640112+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:10.824 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23d0066900 msgr2=0x7f23d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:10.824 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23d0066900 0x7f23d0068dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23e0000f70 tx=0x7f23e0007cb0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.824 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c80a0 msgr2=0x7f23ec0af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:10.824 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c80a0 0x7f23ec0af250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f23d8018f70 tx=0x7f23d8019100 comp rx=0 tx=0).stop 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 shutdown_connections 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec151f20 0x7f23ec156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23ec0c80a0 0x7f23ec0af250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23d0066900 0x7f23d0068dc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 --2- 172.21.15.26:0/2090569573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23ec0c5230 0x7f23ec0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 >> 172.21.15.26:0/2090569573 conn(0x7f23ec0722c0 msgr2=0x7f23ec15fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 shutdown_connections 2023-11-28T16:56:10.825 INFO:teuthology.misc.health.smithi026.stderr:2023-11-28T16:56:10.819+0000 7f23f2e9c640 1 -- 172.21.15.26:0/2090569573 wait complete. 2023-11-28T16:56:10.842 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T16:56:10.842 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T16:56:10.842 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T16:56:10.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T16:56:10.846 INFO:tasks.ceph.mds.a:Started 2023-11-28T16:56:10.846 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T16:56:10.846 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T16:56:10.850 INFO:tasks.ceph.mds.c:Started 2023-11-28T16:56:10.850 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T16:56:10.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T16:56:10.854 INFO:tasks.ceph.mds.b:Started 2023-11-28T16:56:10.854 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T16:56:10.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T16:56:10.858 INFO:tasks.ceph.mds.d:Started 2023-11-28T16:56:10.858 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T16:56:10.858 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:10.950 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-11-28T16:56:10.951 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-11-28T16:56:10.965 INFO:tasks.ceph.mds.d.smithi079.stdout:starting mds.d at 2023-11-28T16:56:10.977 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-11-28T16:56:11.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc07f2a640 1 Processor -- start 2023-11-28T16:56:11.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc07f2a640 1 -- start start 2023-11-28T16:56:11.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc07f2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc00158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc07f2a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc0006cd90 0x7fbc00158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc07f2a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc00155790 con 0x7fbc000ca610 2023-11-28T16:56:11.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc07f2a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000c4b00 con 0x7fbc0006cd90 2023-11-28T16:56:11.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc07f2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000c4de0 con 0x7fbc000bd720 2023-11-28T16:56:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc05cc6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbc000ca610 0x7fbc000c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38700/0 (socket says 172.21.15.26:38700) 2023-11-28T16:56:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc05cc6640 1 -- 172.21.15.26:0/1223549393 learned_addr learned my addr 172.21.15.26:0/1223549393 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc064c7640 1 --2- 172.21.15.26:0/1223549393 >> v2:172.21.15.26:3300/0 conn(0x7fbc0006cd90 0x7fbc00158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc054c5640 1 --2- 172.21.15.26:0/1223549393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc00158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc04cc4640 1 -- 172.21.15.26:0/1223549393 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531310673 0 0) 0x7fbc00155790 con 0x7fbc000ca610 2023-11-28T16:56:11.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc064c7640 1 -- 172.21.15.26:0/1223549393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 msgr2=0x7fbc00158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:11.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc064c7640 1 --2- 172.21.15.26:0/1223549393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc00158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc064c7640 1 -- 172.21.15.26:0/1223549393 >> v1:172.21.15.26:6789/0 conn(0x7fbc000ca610 legacy=0x7fbc000c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.003+0000 7fbc064c7640 1 -- 172.21.15.26:0/1223549393 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00157e30 con 0x7fbc0006cd90 2023-11-28T16:56:11.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc064c7640 1 --2- 172.21.15.26:0/1223549393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0006cd90 0x7fbc00158890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009d90 tx=0x7fbbf801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801bf0d95454f8ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc04cc4640 1 -- 172.21.15.26:0/1223549393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc000c52d0 con 0x7fbc0006cd90 2023-11-28T16:56:11.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc04cc4640 1 -- 172.21.15.26:0/1223549393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf80a5800 con 0x7fbc0006cd90 2023-11-28T16:56:11.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc04cc4640 1 -- 172.21.15.26:0/1223549393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80a5b90 con 0x7fbc0006cd90 2023-11-28T16:56:11.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 -- 172.21.15.26:0/1223549393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0006cd90 msgr2=0x7fbc00158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/1223549393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0006cd90 0x7fbc00158890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009d90 tx=0x7fbbf801c830 comp rx=0 tx=0).stop 2023-11-28T16:56:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 -- 172.21.15.26:0/1223549393 shutdown_connections 2023-11-28T16:56:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/1223549393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0006cd90 0x7fbc00158890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/1223549393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc00158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 -- 172.21.15.26:0/1223549393 >> 172.21.15.26:0/1223549393 conn(0x7fbc00071ea0 msgr2=0x7fbc000722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 -- 172.21.15.26:0/1223549393 shutdown_connections 2023-11-28T16:56:11.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.007+0000 7fbc07f2a640 1 -- 172.21.15.26:0/1223549393 wait complete. 2023-11-28T16:56:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 Processor -- start 2023-11-28T16:56:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 -- start start 2023-11-28T16:56:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0006cd90 0x7fbc000be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc000ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000ca610 0x7fbc000c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000c1870 con 0x7fbc000ca610 2023-11-28T16:56:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000ab570 con 0x7fbc0006cd90 2023-11-28T16:56:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000c1ac0 con 0x7fbc000bd720 2023-11-28T16:56:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000ca610 0x7fbc000c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000ca610 0x7fbc000c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51574/0 (socket says 172.21.15.26:51574) 2023-11-28T16:56:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 -- 172.21.15.26:0/3738399295 learned_addr learned my addr 172.21.15.26:0/3738399295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc05cc6640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0006cd90 0x7fbc000be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc054c5640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc000ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 -- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 msgr2=0x7fbc000ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc000ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 -- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0006cd90 msgr2=0x7fbc000be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0006cd90 0x7fbc000be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 -- 172.21.15.26:0/3738399295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8009a70 con 0x7fbc000ca610 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc064c7640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000ca610 0x7fbc000c2780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80b0040 tx=0x7fbbf80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbbf67fc640 1 -- 172.21.15.26:0/3738399295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80ad650 con 0x7fbc000ca610 2023-11-28T16:56:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbbf67fc640 1 -- 172.21.15.26:0/3738399295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf80ad7b0 con 0x7fbc000ca610 2023-11-28T16:56:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc000ab810 con 0x7fbc000ca610 2023-11-28T16:56:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbbf67fc640 1 -- 172.21.15.26:0/3738399295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80adb80 con 0x7fbc000ca610 2023-11-28T16:56:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.011+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc000c1da0 con 0x7fbc000ca610 2023-11-28T16:56:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.015+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc000abd30 con 0x7fbc000ca610 2023-11-28T16:56:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.015+0000 7fbbf67fc640 1 -- 172.21.15.26:0/3738399295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbbf80b4050 con 0x7fbc000ca610 2023-11-28T16:56:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.015+0000 7fbbf67fc640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbe40668d0 0x7fbbe4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.015+0000 7fbbf67fc640 1 -- 172.21.15.26:0/3738399295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbbf811ef00 con 0x7fbc000ca610 2023-11-28T16:56:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.015+0000 7fbc05cc6640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbe40668d0 0x7fbbe4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.015+0000 7fbc05cc6640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbe40668d0 0x7fbbe4068d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc007fd0 tx=0x7fbbfc007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.019+0000 7fbbf67fc640 1 -- 172.21.15.26:0/3738399295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc000abd30 con 0x7fbc000ca610 2023-11-28T16:56:11.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.175+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc000abd30 con 0x7fbc000ca610 2023-11-28T16:56:11.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbbf67fc640 1 -- 172.21.15.26:0/3738399295 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12778 (secure 0 0 0) 0x7fbc000abd30 con 0x7fbc000ca610 2023-11-28T16:56:11.181 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:11.181 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:07.640112+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:11.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbe40668d0 msgr2=0x7fbbe4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbe40668d0 0x7fbbe4068d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc007fd0 tx=0x7fbbfc007d60 comp rx=0 tx=0).stop 2023-11-28T16:56:11.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000ca610 msgr2=0x7fbc000c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000ca610 0x7fbc000c2780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80b0040 tx=0x7fbbf80195d0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 shutdown_connections 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000ca610 0x7fbc000c2780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbe40668d0 0x7fbbe4068d90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc000bd720 0x7fbc000ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 --2- 172.21.15.26:0/3738399295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0006cd90 0x7fbc000be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 >> 172.21.15.26:0/3738399295 conn(0x7fbc00071ea0 msgr2=0x7fbc00072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 shutdown_connections 2023-11-28T16:56:11.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.179+0000 7fbc07f2a640 1 -- 172.21.15.26:0/3738399295 wait complete. 2023-11-28T16:56:11.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:11.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f65172640 1 Processor -- start 2023-11-28T16:56:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f65172640 1 -- start start 2023-11-28T16:56:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f65172640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f60154000 0x7f7f601543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f65172640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f6006df30 0x7f7f600716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f65172640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f60154920 con 0x7f7f600700f0 2023-11-28T16:56:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f65172640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f600a8710 con 0x7f7f6006df30 2023-11-28T16:56:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f65172640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60071be0 con 0x7f7f60154000 2023-11-28T16:56:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5ed9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f60154000 0x7f7f601543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5f59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f6006df30 0x7f7f600716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5ed9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f60154000 0x7f7f601543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:37038/0 (socket says 172.21.15.26:37038) 2023-11-28T16:56:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5ed9d640 1 -- 172.21.15.26:0/1260024902 learned_addr learned my addr 172.21.15.26:0/1260024902 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5ed9d640 1 -- 172.21.15.26:0/1260024902 >> v2:172.21.15.79:3300/0 conn(0x7f7f6006df30 msgr2=0x7f7f600716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5ed9d640 1 --2- 172.21.15.26:0/1260024902 >> v2:172.21.15.79:3300/0 conn(0x7f7f6006df30 0x7f7f600716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5ed9d640 1 -- 172.21.15.26:0/1260024902 >> v1:172.21.15.79:6789/0 conn(0x7f7f600700f0 legacy=0x7f7f60070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.347+0000 7f7f5ed9d640 1 -- 172.21.15.26:0/1260024902 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f60154b90 con 0x7f7f60154000 2023-11-28T16:56:11.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f5ed9d640 1 --2- 172.21.15.26:0/1260024902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f60154000 0x7f7f601543e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000aa10 tx=0x7f7f5001e900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fbe11e3d01b36e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f5dd9b640 1 -- 172.21.15.26:0/1260024902 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f500a7950 con 0x7f7f60154000 2023-11-28T16:56:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f5dd9b640 1 -- 172.21.15.26:0/1260024902 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f500a7ab0 con 0x7f7f60154000 2023-11-28T16:56:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f5dd9b640 1 -- 172.21.15.26:0/1260024902 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f500a7e40 con 0x7f7f60154000 2023-11-28T16:56:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 -- 172.21.15.26:0/1260024902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f60154000 msgr2=0x7f7f601543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 --2- 172.21.15.26:0/1260024902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f60154000 0x7f7f601543e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000aa10 tx=0x7f7f5001e900 comp rx=0 tx=0).stop 2023-11-28T16:56:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 -- 172.21.15.26:0/1260024902 shutdown_connections 2023-11-28T16:56:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 --2- 172.21.15.26:0/1260024902 >> v2:172.21.15.79:3300/0 conn(0x7f7f6006df30 0x7f7f600716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 --2- 172.21.15.26:0/1260024902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f60154000 0x7f7f601543e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 -- 172.21.15.26:0/1260024902 >> 172.21.15.26:0/1260024902 conn(0x7f7f600c2a60 msgr2=0x7f7f600c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 -- 172.21.15.26:0/1260024902 shutdown_connections 2023-11-28T16:56:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.351+0000 7f7f65172640 1 -- 172.21.15.26:0/1260024902 wait complete. 2023-11-28T16:56:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 Processor -- start 2023-11-28T16:56:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 -- start start 2023-11-28T16:56:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f6006df30 0x7f7f601473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f600700f0 0x7f7f601ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f60154000 0x7f7f6014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f600c4120 con 0x7f7f600700f0 2023-11-28T16:56:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f601ece30 con 0x7f7f60154000 2023-11-28T16:56:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60147a30 con 0x7f7f6006df30 2023-11-28T16:56:11.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f600700f0 0x7f7f601ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5ed9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f6006df30 0x7f7f601473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f600700f0 0x7f7f601ec8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43832/0 (socket says 172.21.15.26:43832) 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5e59c640 1 -- 172.21.15.26:0/1237620649 learned_addr learned my addr 172.21.15.26:0/1237620649 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5f59e640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f60154000 0x7f7f6014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5ed9d640 1 -- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f60154000 msgr2=0x7f7f6014cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5ed9d640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f60154000 0x7f7f6014cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5ed9d640 1 -- 172.21.15.26:0/1237620649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f600700f0 msgr2=0x7f7f601ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5ed9d640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f600700f0 0x7f7f601ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5ed9d640 1 -- 172.21.15.26:0/1237620649 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5000a670 con 0x7f7f6006df30 2023-11-28T16:56:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5e59c640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f600700f0 0x7f7f601ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f5ed9d640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f6006df30 0x7f7f601473e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f60071d20 tx=0x7f7f5001b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f477fe640 1 -- 172.21.15.26:0/1237620649 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50006ee0 con 0x7f7f6006df30 2023-11-28T16:56:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f477fe640 1 -- 172.21.15.26:0/1237620649 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f500afe90 con 0x7f7f6006df30 2023-11-28T16:56:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f477fe640 1 -- 172.21.15.26:0/1237620649 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f500ba690 con 0x7f7f6006df30 2023-11-28T16:56:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f60147d10 con 0x7f7f6006df30 2023-11-28T16:56:11.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.355+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f600c45e0 con 0x7f7f6006df30 2023-11-28T16:56:11.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.359+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6004e890 con 0x7f7f6006df30 2023-11-28T16:56:11.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.359+0000 7f7f477fe640 1 -- 172.21.15.26:0/1237620649 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7f500b6070 con 0x7f7f6006df30 2023-11-28T16:56:11.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.359+0000 7f7f477fe640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f4c0668d0 0x7f7f4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.359+0000 7f7f477fe640 1 -- 172.21.15.26:0/1237620649 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f5011f5c0 con 0x7f7f6006df30 2023-11-28T16:56:11.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.359+0000 7f7f5e59c640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f4c0668d0 0x7f7f4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.359+0000 7f7f5e59c640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f4c0668d0 0x7f7f4c068d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f60151b60 tx=0x7f7f54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.363+0000 7f7f477fe640 1 -- 172.21.15.26:0/1237620649 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f500ecc20 con 0x7f7f6006df30 2023-11-28T16:56:11.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f600aa600 con 0x7f7f6006df30 2023-11-28T16:56:11.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f477fe640 1 -- 172.21.15.26:0/1237620649 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f500f0200 con 0x7f7f6006df30 2023-11-28T16:56:11.527 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f4c0668d0 msgr2=0x7f7f4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f4c0668d0 0x7f7f4c068d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f60151b60 tx=0x7f7f54009040 comp rx=0 tx=0).stop 2023-11-28T16:56:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f6006df30 msgr2=0x7f7f601473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f6006df30 0x7f7f601473e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f60071d20 tx=0x7f7f5001b6a0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 shutdown_connections 2023-11-28T16:56:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f60154000 0x7f7f6014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f600700f0 0x7f7f601ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f4c0668d0 0x7f7f4c068d90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 --2- 172.21.15.26:0/1237620649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f6006df30 0x7f7f601473e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 >> 172.21.15.26:0/1237620649 conn(0x7f7f600c2a60 msgr2=0x7f7f6006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:11.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 shutdown_connections 2023-11-28T16:56:11.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.523+0000 7f7f65172640 1 -- 172.21.15.26:0/1237620649 wait complete. 2023-11-28T16:56:11.549 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.687+0000 7f4a72679640 1 Processor -- start 2023-11-28T16:56:11.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.687+0000 7f4a72679640 1 -- start start 2023-11-28T16:56:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a72679640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a6c14ea60 0x7f4a6c155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a72679640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a6c06bd00 0x7f4a6c0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a72679640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c06c440 con 0x7f4a6c0bf400 2023-11-28T16:56:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a72679640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c154790 con 0x7f4a6c06bd00 2023-11-28T16:56:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a72679640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c06c6e0 con 0x7f4a6c14ea60 2023-11-28T16:56:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a6c06bd00 0x7f4a6c0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a70c16640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4a6c0bf400 0x7f4a6c0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56914/0 (socket says 172.21.15.26:56914) 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a6c06bd00 0x7f4a6c0700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43840/0 (socket says 172.21.15.26:43840) 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a70c16640 1 -- 172.21.15.26:0/3080440369 learned_addr learned my addr 172.21.15.26:0/3080440369 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6bfff640 1 --2- 172.21.15.26:0/3080440369 >> v2:172.21.15.79:3300/0 conn(0x7f4a6c14ea60 0x7f4a6c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6b7fe640 1 -- 172.21.15.26:0/3080440369 >> v2:172.21.15.79:3300/0 conn(0x7f4a6c14ea60 msgr2=0x7f4a6c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6b7fe640 1 --2- 172.21.15.26:0/3080440369 >> v2:172.21.15.79:3300/0 conn(0x7f4a6c14ea60 0x7f4a6c155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6b7fe640 1 -- 172.21.15.26:0/3080440369 >> v1:172.21.15.26:6789/0 conn(0x7f4a6c0bf400 legacy=0x7f4a6c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6b7fe640 1 -- 172.21.15.26:0/3080440369 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c154a50 con 0x7f4a6c06bd00 2023-11-28T16:56:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.691+0000 7f4a6b7fe640 1 --2- 172.21.15.26:0/3080440369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0700a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c06fab0 tx=0x7f4a6001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189928fefc40b198 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a6affd640 1 -- 172.21.15.26:0/3080440369 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600ab600 con 0x7f4a6c06bd00 2023-11-28T16:56:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a6affd640 1 -- 172.21.15.26:0/3080440369 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a600a7050 con 0x7f4a6c06bd00 2023-11-28T16:56:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a6affd640 1 -- 172.21.15.26:0/3080440369 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600ab980 con 0x7f4a6c06bd00 2023-11-28T16:56:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- 172.21.15.26:0/3080440369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 msgr2=0x7f4a6c0700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 --2- 172.21.15.26:0/3080440369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0700a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c06fab0 tx=0x7f4a6001c310 comp rx=0 tx=0).stop 2023-11-28T16:56:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- 172.21.15.26:0/3080440369 shutdown_connections 2023-11-28T16:56:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 --2- 172.21.15.26:0/3080440369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0700a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 --2- 172.21.15.26:0/3080440369 >> v2:172.21.15.79:3300/0 conn(0x7f4a6c14ea60 0x7f4a6c155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- 172.21.15.26:0/3080440369 >> 172.21.15.26:0/3080440369 conn(0x7f4a6c0c2ad0 msgr2=0x7f4a6c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- 172.21.15.26:0/3080440369 shutdown_connections 2023-11-28T16:56:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- 172.21.15.26:0/3080440369 wait complete. 2023-11-28T16:56:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 Processor -- start 2023-11-28T16:56:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- start start 2023-11-28T16:56:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0bf400 0x7f4a6c1eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a6c14ea60 0x7f4a6c1ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c14d120 con 0x7f4a6c06bd00 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c14fed0 con 0x7f4a6c0bf400 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a72679640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c14c5a0 con 0x7f4a6c14ea60 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a6bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a6bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0a8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43854/0 (socket says 172.21.15.26:43854) 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.695+0000 7f4a6bfff640 1 -- 172.21.15.26:0/497346035 learned_addr learned my addr 172.21.15.26:0/497346035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a6b7fe640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0bf400 0x7f4a6c1eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a70c16640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a6c14ea60 0x7f4a6c1ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a6bfff640 1 -- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a6c14ea60 msgr2=0x7f4a6c1ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a6bfff640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a6c14ea60 0x7f4a6c1ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a6bfff640 1 -- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0bf400 msgr2=0x7f4a6c1eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a6bfff640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0bf400 0x7f4a6c1eee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a6bfff640 1 -- 172.21.15.26:0/497346035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009420 con 0x7f4a6c06bd00 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a70c16640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a6c14ea60 0x7f4a6c1ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a6bfff640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0a8b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00d620 tx=0x7f4a5c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a68ff9640 1 -- 172.21.15.26:0/497346035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00b620 con 0x7f4a6c06bd00 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a68ff9640 1 -- 172.21.15.26:0/497346035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c00b780 con 0x7f4a6c06bd00 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a68ff9640 1 -- 172.21.15.26:0/497346035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00bb10 con 0x7f4a6c06bd00 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c14c880 con 0x7f4a6c06bd00 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c14ce40 con 0x7f4a6c06bd00 2023-11-28T16:56:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c04e890 con 0x7f4a6c06bd00 2023-11-28T16:56:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a68ff9640 1 -- 172.21.15.26:0/497346035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4a5c00bc70 con 0x7f4a6c06bd00 2023-11-28T16:56:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a68ff9640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4a58066900 0x7f4a58068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.699+0000 7f4a68ff9640 1 -- 172.21.15.26:0/497346035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a5c084490 con 0x7f4a6c06bd00 2023-11-28T16:56:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.703+0000 7f4a6b7fe640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4a58066900 0x7f4a58068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.703+0000 7f4a6b7fe640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4a58066900 0x7f4a58068dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a600ad000 tx=0x7f4a60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.703+0000 7f4a68ff9640 1 -- 172.21.15.26:0/497346035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a5c051ab0 con 0x7f4a6c06bd00 2023-11-28T16:56:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.891+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a6c1eea70 con 0x7f4a6c06bd00 2023-11-28T16:56:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a68ff9640 1 -- 172.21.15.26:0/497346035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f4a5c007380 con 0x7f4a6c06bd00 2023-11-28T16:56:11.898 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:11.898 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T16:56:11.898 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2023-11-28T16:56:11.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4a58066900 msgr2=0x7f4a58068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4a58066900 0x7f4a58068dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a600ad000 tx=0x7f4a60008040 comp rx=0 tx=0).stop 2023-11-28T16:56:11.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 msgr2=0x7f4a6c0a8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0a8b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00d620 tx=0x7f4a5c00dae0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 shutdown_connections 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4a58066900 0x7f4a58068dc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a6c14ea60 0x7f4a6c1ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0bf400 0x7f4a6c1eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 --2- 172.21.15.26:0/497346035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a6c06bd00 0x7f4a6c0a8b70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 >> 172.21.15.26:0/497346035 conn(0x7f4a6c0c2ad0 msgr2=0x7f4a6c147670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 shutdown_connections 2023-11-28T16:56:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:11.895+0000 7f4a72679640 1 -- 172.21.15.26:0/497346035 wait complete. 2023-11-28T16:56:13.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:14.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f003923a640 1 Processor -- start 2023-11-28T16:56:14.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f003923a640 1 -- start start 2023-11-28T16:56:14.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f003923a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 0x7f00340c8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f003923a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340c4c60 con 0x7f0034158710 2023-11-28T16:56:14.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f003923a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340c4f40 con 0x7f00340c68b0 2023-11-28T16:56:14.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f003923a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00340c57c0 con 0x7f0034151df0 2023-11-28T16:56:14.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f00337fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0034158710 0x7f0034154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56916/0 (socket says 172.21.15.26:56916) 2023-11-28T16:56:14.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f00337fe640 1 -- 172.21.15.26:0/3123435402 learned_addr learned my addr 172.21.15.26:0/3123435402 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0033fff640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 0x7f00340c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696734676 0 0) 0x7f00340c4c60 con 0x7f0034158710 2023-11-28T16:56:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001c003530 con 0x7f0034158710 2023-11-28T16:56:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60660129 0 0) 0x7f001c003530 con 0x7f0034158710 2023-11-28T16:56:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 msgr2=0x7f00340c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 0x7f00340c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 >> v1:172.21.15.79:6789/0 conn(0x7f00340c68b0 legacy=0x7f003415f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00340c5220 con 0x7f0034158710 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f0028001680 con 0x7f0034158710 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 >> v1:172.21.15.26:6789/0 conn(0x7f0034158710 legacy=0x7f0034154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0039b0 0x7f001c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 0x7f001c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c004d10 0x7f001c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c00ba40 con 0x7f001c004d10 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c00bbb0 con 0x7f001c0039b0 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c00bd70 con 0x7f0034151df0 2023-11-28T16:56:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0038a39640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c004d10 0x7f001c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0033fff640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0039b0 0x7f001c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f00337fe640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 0x7f001c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0038a39640 1 -- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 msgr2=0x7f001c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0038a39640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0034151df0 0x7f001c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0038a39640 1 -- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0039b0 msgr2=0x7f001c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0038a39640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0039b0 0x7f001c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.071+0000 7f0038a39640 1 -- 172.21.15.26:0/3123435402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c003530 con 0x7f001c004d10 2023-11-28T16:56:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f0038a39640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c004d10 0x7f001c005190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f002c001f60 tx=0x7f002c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6733b269c93f4119 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0a9640 con 0x7f001c004d10 2023-11-28T16:56:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c0a97a0 con 0x7f001c004d10 2023-11-28T16:56:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f0032ffd640 1 -- 172.21.15.26:0/3123435402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0a9b50 con 0x7f001c004d10 2023-11-28T16:56:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f003923a640 1 -- 172.21.15.26:0/3123435402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c004d10 msgr2=0x7f001c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f003923a640 1 --2- 172.21.15.26:0/3123435402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c004d10 0x7f001c005190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f002c001f60 tx=0x7f002c01c860 comp rx=0 tx=0).stop 2023-11-28T16:56:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f0038a39640 1 -- 172.21.15.26:0/3123435402 reap_dead start 2023-11-28T16:56:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f003923a640 1 -- 172.21.15.26:0/3123435402 shutdown_connections 2023-11-28T16:56:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f003923a640 1 -- 172.21.15.26:0/3123435402 >> 172.21.15.26:0/3123435402 conn(0x7f00340ca140 msgr2=0x7f00340ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f003923a640 1 -- 172.21.15.26:0/3123435402 shutdown_connections 2023-11-28T16:56:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.075+0000 7f003923a640 1 -- 172.21.15.26:0/3123435402 wait complete. 2023-11-28T16:56:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 Processor -- start 2023-11-28T16:56:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 -- start start 2023-11-28T16:56:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f001c004d10 0x7f0034146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0034149380 0x7f00341f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00341f16f0 0x7f0034155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00341570d0 con 0x7f00341f16f0 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034156a50 con 0x7f0034149380 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00341576e0 con 0x7f001c004d10 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00341f16f0 0x7f0034155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00341f16f0 0x7f0034155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43868/0 (socket says 172.21.15.26:43868) 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 -- 172.21.15.26:0/2708324447 learned_addr learned my addr 172.21.15.26:0/2708324447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f00337fe640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0034149380 0x7f00341f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0033fff640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f001c004d10 0x7f0034146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 -- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f001c004d10 msgr2=0x7f0034146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f001c004d10 0x7f0034146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 -- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0034149380 msgr2=0x7f00341f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0034149380 0x7f00341f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 -- 172.21.15.26:0/2708324447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034156cf0 con 0x7f00341f16f0 2023-11-28T16:56:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0033fff640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f001c004d10 0x7f0034146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0038a39640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00341f16f0 0x7f0034155880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f002c001f60 tx=0x7f001c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0030ff9640 1 -- 172.21.15.26:0/2708324447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0b6070 con 0x7f00341f16f0 2023-11-28T16:56:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0030ff9640 1 -- 172.21.15.26:0/2708324447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c0a9910 con 0x7f00341f16f0 2023-11-28T16:56:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00341579c0 con 0x7f00341f16f0 2023-11-28T16:56:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f0030ff9640 1 -- 172.21.15.26:0/2708324447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0a9640 con 0x7f00341f16f0 2023-11-28T16:56:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.079+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0034149800 con 0x7f00341f16f0 2023-11-28T16:56:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.083+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003404e890 con 0x7f00341f16f0 2023-11-28T16:56:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.083+0000 7f0030ff9640 1 -- 172.21.15.26:0/2708324447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f002c0a7070 con 0x7f00341f16f0 2023-11-28T16:56:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.083+0000 7f0030ff9640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f00200668d0 0x7f0020068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.083+0000 7f0030ff9640 1 -- 172.21.15.26:0/2708324447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f002c11d8b0 con 0x7f00341f16f0 2023-11-28T16:56:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.083+0000 7f0033fff640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f00200668d0 0x7f0020068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.083+0000 7f0033fff640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f00200668d0 0x7f0020068d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f003414fd20 tx=0x7f0024008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.087+0000 7f0030ff9640 1 -- 172.21.15.26:0/2708324447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f002c0eaf50 con 0x7f00341f16f0 2023-11-28T16:56:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f003406cda0 con 0x7f00341f16f0 2023-11-28T16:56:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f0030ff9640 1 -- 172.21.15.26:0/2708324447 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f002c0ee570 con 0x7f00341f16f0 2023-11-28T16:56:14.283 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:14.284 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-28T16:56:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2023-11-28T16:56:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f00200668d0 msgr2=0x7f0020068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f00200668d0 0x7f0020068d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f003414fd20 tx=0x7f0024008040 comp rx=0 tx=0).stop 2023-11-28T16:56:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00341f16f0 msgr2=0x7f0034155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00341f16f0 0x7f0034155880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f002c001f60 tx=0x7f001c005800 comp rx=0 tx=0).stop 2023-11-28T16:56:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 shutdown_connections 2023-11-28T16:56:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00341f16f0 0x7f0034155880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0034149380 0x7f00341f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f00200668d0 0x7f0020068d90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 --2- 172.21.15.26:0/2708324447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f001c004d10 0x7f0034146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.279+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 >> 172.21.15.26:0/2708324447 conn(0x7f00340ca140 msgr2=0x7f0034150170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.283+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 shutdown_connections 2023-11-28T16:56:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.283+0000 7f003923a640 1 -- 172.21.15.26:0/2708324447 wait complete. 2023-11-28T16:56:14.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.443+0000 7f63c4f2a640 1 Processor -- start 2023-11-28T16:56:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.443+0000 7f63c4f2a640 1 -- start start 2023-11-28T16:56:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63c4f2a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63c014fcc0 0x7f63c0156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63c4f2a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f63c006d980 0x7f63c00aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63c4f2a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c0152fe0 con 0x7f63c00ab3b0 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63c4f2a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c00aa340 con 0x7f63c014fcc0 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63c4f2a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c01532c0 con 0x7f63c006d980 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63be59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63c014fcc0 0x7f63c0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63be59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63c014fcc0 0x7f63c0156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43870/0 (socket says 172.21.15.26:43870) 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63be59c640 1 -- 172.21.15.26:0/738562576 learned_addr learned my addr 172.21.15.26:0/738562576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63b7fff640 1 --2- 172.21.15.26:0/738562576 >> v2:172.21.15.79:3300/0 conn(0x7f63c006d980 0x7f63c00aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63be59c640 1 -- 172.21.15.26:0/738562576 >> v2:172.21.15.79:3300/0 conn(0x7f63c006d980 msgr2=0x7f63c00aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63be59c640 1 --2- 172.21.15.26:0/738562576 >> v2:172.21.15.79:3300/0 conn(0x7f63c006d980 0x7f63c00aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63be59c640 1 -- 172.21.15.26:0/738562576 >> v1:172.21.15.79:6789/0 conn(0x7f63c00ab3b0 legacy=0x7f63c00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.447+0000 7f63be59c640 1 -- 172.21.15.26:0/738562576 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0155a20 con 0x7f63c014fcc0 2023-11-28T16:56:14.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63be59c640 1 --2- 172.21.15.26:0/738562576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c014fcc0 0x7f63c0156500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f63c006b4e0 tx=0x7f63b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea60a499345a824 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63bdd9b640 1 -- 172.21.15.26:0/738562576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00aa430 con 0x7f63c014fcc0 2023-11-28T16:56:14.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63bdd9b640 1 -- 172.21.15.26:0/738562576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b00aa590 con 0x7f63c014fcc0 2023-11-28T16:56:14.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63bdd9b640 1 -- 172.21.15.26:0/738562576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00aa920 con 0x7f63c014fcc0 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 -- 172.21.15.26:0/738562576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c014fcc0 msgr2=0x7f63c0156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/738562576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c014fcc0 0x7f63c0156500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f63c006b4e0 tx=0x7f63b001c4d0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 -- 172.21.15.26:0/738562576 shutdown_connections 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/738562576 >> v2:172.21.15.79:3300/0 conn(0x7f63c006d980 0x7f63c00aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/738562576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c014fcc0 0x7f63c0156500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 -- 172.21.15.26:0/738562576 >> 172.21.15.26:0/738562576 conn(0x7f63c00c2ad0 msgr2=0x7f63c00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 -- 172.21.15.26:0/738562576 shutdown_connections 2023-11-28T16:56:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 -- 172.21.15.26:0/738562576 wait complete. 2023-11-28T16:56:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 Processor -- start 2023-11-28T16:56:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.451+0000 7f63c4f2a640 1 -- start start 2023-11-28T16:56:14.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63c006d980 0x7f63c015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63c00ab3b0 0x7f63c0148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c01502c0 0x7f63c0148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0070660 con 0x7f63c01502c0 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c014ca00 con 0x7f63c006d980 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c014c520 con 0x7f63c00ab3b0 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c01502c0 0x7f63c0148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63be59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63c006d980 0x7f63c015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c01502c0 0x7f63c0148d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43882/0 (socket says 172.21.15.26:43882) 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 -- 172.21.15.26:0/1430313845 learned_addr learned my addr 172.21.15.26:0/1430313845 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63b7fff640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63c00ab3b0 0x7f63c0148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 -- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63c00ab3b0 msgr2=0x7f63c0148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63c00ab3b0 0x7f63c0148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 -- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63c006d980 msgr2=0x7f63c015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63c006d980 0x7f63c015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 -- 172.21.15.26:0/1430313845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00094d0 con 0x7f63c01502c0 2023-11-28T16:56:14.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63bed9d640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c01502c0 0x7f63c0148d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c7a0 tx=0x7f63b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63b6ffd640 1 -- 172.21.15.26:0/1430313845 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8003b80 con 0x7f63c01502c0 2023-11-28T16:56:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63b6ffd640 1 -- 172.21.15.26:0/1430313845 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8003ce0 con 0x7f63c01502c0 2023-11-28T16:56:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63b6ffd640 1 -- 172.21.15.26:0/1430313845 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800aa30 con 0x7f63c01502c0 2023-11-28T16:56:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c00c0dd0 con 0x7f63c01502c0 2023-11-28T16:56:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c0070380 con 0x7f63c01502c0 2023-11-28T16:56:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c014c380 con 0x7f63c01502c0 2023-11-28T16:56:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.455+0000 7f63b6ffd640 1 -- 172.21.15.26:0/1430313845 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63b800ab90 con 0x7f63c01502c0 2023-11-28T16:56:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.459+0000 7f63b6ffd640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.459+0000 7f63b6ffd640 1 -- 172.21.15.26:0/1430313845 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63b8083e40 con 0x7f63c01502c0 2023-11-28T16:56:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.459+0000 7f63be59c640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.459+0000 7f63be59c640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63b00ae000 tx=0x7f63b00b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.463+0000 7f63b6ffd640 1 -- 172.21.15.26:0/1430313845 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63c014c380 con 0x7f63c01502c0 2023-11-28T16:56:14.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.619+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63c014c380 con 0x7f63c01502c0 2023-11-28T16:56:14.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.619+0000 7f63b6ffd640 1 -- 172.21.15.26:0/1430313845 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12778 (secure 0 0 0) 0x7f63c014c380 con 0x7f63c01502c0 2023-11-28T16:56:14.625 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:14.625 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:07.640112+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:14.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 msgr2=0x7f63a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63b00ae000 tx=0x7f63b00b5040 comp rx=0 tx=0).stop 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c01502c0 msgr2=0x7f63c0148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c01502c0 0x7f63c0148d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c7a0 tx=0x7f63b800cc60 comp rx=0 tx=0).stop 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 shutdown_connections 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c01502c0 0x7f63c0148d50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63c00ab3b0 0x7f63c0148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 --2- 172.21.15.26:0/1430313845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63c006d980 0x7f63c015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 >> 172.21.15.26:0/1430313845 conn(0x7f63c00c2ad0 msgr2=0x7f63c00a8470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 shutdown_connections 2023-11-28T16:56:14.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.623+0000 7f63c4f2a640 1 -- 172.21.15.26:0/1430313845 wait complete. 2023-11-28T16:56:14.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:14.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f3145c5f640 1 Processor -- start 2023-11-28T16:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f3145c5f640 1 -- start start 2023-11-28T16:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f3145c5f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31400c7f20 0x7f314006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f3145c5f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314006cf70 con 0x7f3140151d80 2023-11-28T16:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f3145c5f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3140152160 con 0x7f31400c8430 2023-11-28T16:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f3145c5f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31400c6a30 con 0x7f31400c7f20 2023-11-28T16:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f313f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3140151d80 0x7f31400c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56926/0 (socket says 172.21.15.26:56926) 2023-11-28T16:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f313f7fe640 1 -- 172.21.15.26:0/3764350004 learned_addr learned my addr 172.21.15.26:0/3764350004 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f313ffff640 1 --2- 172.21.15.26:0/3764350004 >> v2:172.21.15.26:3300/0 conn(0x7f31400c7f20 0x7f314006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f313e7fc640 1 -- 172.21.15.26:0/3764350004 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169747284 0 0) 0x7f3134001120 con 0x7f31400c8430 2023-11-28T16:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f313ffff640 1 -- 172.21.15.26:0/3764350004 >> v1:172.21.15.79:6789/0 conn(0x7f31400c8430 legacy=0x7f314006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f313ffff640 1 -- 172.21.15.26:0/3764350004 >> v1:172.21.15.26:6789/0 conn(0x7f3140151d80 legacy=0x7f31400c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.791+0000 7f313ffff640 1 -- 172.21.15.26:0/3764350004 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400c72d0 con 0x7f31400c7f20 2023-11-28T16:56:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f313ffff640 1 --2- 172.21.15.26:0/3764350004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f314006be30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3138009d90 tx=0x7f313801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25de3eb5ac8ccd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f313e7fc640 1 -- 172.21.15.26:0/3764350004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380a5950 con 0x7f31400c7f20 2023-11-28T16:56:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f313e7fc640 1 -- 172.21.15.26:0/3764350004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31380a5ab0 con 0x7f31400c7f20 2023-11-28T16:56:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f313e7fc640 1 -- 172.21.15.26:0/3764350004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380a5e40 con 0x7f31400c7f20 2023-11-28T16:56:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f3145c5f640 1 -- 172.21.15.26:0/3764350004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 msgr2=0x7f314006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3764350004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f314006be30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3138009d90 tx=0x7f313801c890 comp rx=0 tx=0).stop 2023-11-28T16:56:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f3145c5f640 1 -- 172.21.15.26:0/3764350004 shutdown_connections 2023-11-28T16:56:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3764350004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f314006be30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f3145c5f640 1 -- 172.21.15.26:0/3764350004 >> 172.21.15.26:0/3764350004 conn(0x7f31400abd00 msgr2=0x7f31400ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f3145c5f640 1 -- 172.21.15.26:0/3764350004 shutdown_connections 2023-11-28T16:56:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.795+0000 7f3145c5f640 1 -- 172.21.15.26:0/3764350004 wait complete. 2023-11-28T16:56:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 Processor -- start 2023-11-28T16:56:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 -- start start 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f31400c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31400c8430 0x7f3140145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3140151d80 0x7f314014b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314014a890 con 0x7f31400c7f20 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140145c40 con 0x7f3140151d80 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140149c00 con 0x7f31400c8430 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f31400c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f31400c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43892/0 (socket says 172.21.15.26:43892) 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 -- 172.21.15.26:0/3446439236 learned_addr learned my addr 172.21.15.26:0/3446439236 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 -- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31400c8430 msgr2=0x7f3140145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31400c8430 0x7f3140145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313ffff640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3140151d80 0x7f314014b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 -- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3140151d80 msgr2=0x7f314014b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3140151d80 0x7f314014b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 -- 172.21.15.26:0/3446439236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138009a70 con 0x7f31400c7f20 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313ffff640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3140151d80 0x7f314014b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f313f7fe640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f31400c04f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f313000c420 tx=0x7f313000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3127fff640 1 -- 172.21.15.26:0/3446439236 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130005cf0 con 0x7f31400c7f20 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3127fff640 1 -- 172.21.15.26:0/3446439236 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130005e50 con 0x7f31400c7f20 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3140154700 con 0x7f31400c7f20 2023-11-28T16:56:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3127fff640 1 -- 172.21.15.26:0/3446439236 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300072f0 con 0x7f31400c7f20 2023-11-28T16:56:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.799+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3140149640 con 0x7f31400c7f20 2023-11-28T16:56:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.803+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314004e890 con 0x7f31400c7f20 2023-11-28T16:56:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.803+0000 7f3127fff640 1 -- 172.21.15.26:0/3446439236 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3130007450 con 0x7f31400c7f20 2023-11-28T16:56:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.803+0000 7f3127fff640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f312c0668d0 0x7f312c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.803+0000 7f3127fff640 1 -- 172.21.15.26:0/3446439236 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31300836e0 con 0x7f31400c7f20 2023-11-28T16:56:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.803+0000 7f313effd640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f312c0668d0 0x7f312c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.803+0000 7f313effd640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f312c0668d0 0x7f312c068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3140153bc0 tx=0x7f31340077d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:14.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.807+0000 7f3127fff640 1 -- 172.21.15.26:0/3446439236 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3130050bd0 con 0x7f31400c7f20 2023-11-28T16:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31400aff70 con 0x7f31400c7f20 2023-11-28T16:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3127fff640 1 -- 172.21.15.26:0/3446439236 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31300170a0 con 0x7f31400c7f20 2023-11-28T16:56:14.971 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f312c0668d0 msgr2=0x7f312c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f312c0668d0 0x7f312c068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3140153bc0 tx=0x7f31340077d0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 msgr2=0x7f31400c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f31400c04f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f313000c420 tx=0x7f313000c8e0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 shutdown_connections 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3140151d80 0x7f314014b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f312c0668d0 0x7f312c068d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31400c8430 0x7f3140145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 --2- 172.21.15.26:0/3446439236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31400c7f20 0x7f31400c04f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 >> 172.21.15.26:0/3446439236 conn(0x7f31400abd00 msgr2=0x7f31400ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 shutdown_connections 2023-11-28T16:56:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:14.967+0000 7f3145c5f640 1 -- 172.21.15.26:0/3446439236 wait complete. 2023-11-28T16:56:14.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T16:56:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00bbd8640 1 Processor -- start 2023-11-28T16:56:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00bbd8640 1 -- start start 2023-11-28T16:56:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00bbd8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0040a6e50 0x7fe0040c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00bbd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe0041584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00bbd8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0040c70a0 con 0x7fe0041555d0 2023-11-28T16:56:15.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00bbd8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0040c7380 con 0x7fe0040a6e50 2023-11-28T16:56:15.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00bbd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00406c470 con 0x7fe004158010 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00a175640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe0041584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe009173640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0040a6e50 0x7fe0040c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe009974640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe0041555d0 0x7fe0040c3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39010/0 (socket says 172.21.15.26:39010) 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe009974640 1 -- 172.21.15.26:0/847527091 learned_addr learned my addr 172.21.15.26:0/847527091 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe008972640 1 -- 172.21.15.26:0/847527091 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451727273 0 0) 0x7fe0040c70a0 con 0x7fe0041555d0 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe008972640 1 -- 172.21.15.26:0/847527091 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff0003530 con 0x7fe0041555d0 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00a175640 1 -- 172.21.15.26:0/847527091 >> v2:172.21.15.79:3300/0 conn(0x7fe0040a6e50 msgr2=0x7fe0040c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00a175640 1 --2- 172.21.15.26:0/847527091 >> v2:172.21.15.79:3300/0 conn(0x7fe0040a6e50 0x7fe0040c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00a175640 1 -- 172.21.15.26:0/847527091 >> v1:172.21.15.79:6789/0 conn(0x7fe0041555d0 legacy=0x7fe0040c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe00a175640 1 -- 172.21.15.26:0/847527091 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00406c750 con 0x7fe004158010 2023-11-28T16:56:15.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.131+0000 7fe009173640 1 --2- 172.21.15.26:0/847527091 >> v2:172.21.15.79:3300/0 conn(0x7fe0040a6e50 0x7fe0040c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00a175640 1 --2- 172.21.15.26:0/847527091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe0041584a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009d90 tx=0x7fdffc01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9ee2bbbdf4d2ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe008972640 1 -- 172.21.15.26:0/847527091 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0a5920 con 0x7fe004158010 2023-11-28T16:56:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe008972640 1 -- 172.21.15.26:0/847527091 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc0a5a80 con 0x7fe004158010 2023-11-28T16:56:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe008972640 1 -- 172.21.15.26:0/847527091 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0a5e10 con 0x7fe004158010 2023-11-28T16:56:15.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 -- 172.21.15.26:0/847527091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 msgr2=0x7fe0041584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/847527091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe0041584a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009d90 tx=0x7fdffc01c950 comp rx=0 tx=0).stop 2023-11-28T16:56:15.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 -- 172.21.15.26:0/847527091 shutdown_connections 2023-11-28T16:56:15.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/847527091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe0041584a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/847527091 >> v2:172.21.15.79:3300/0 conn(0x7fe0040a6e50 0x7fe0040c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 -- 172.21.15.26:0/847527091 >> 172.21.15.26:0/847527091 conn(0x7fe0040c4960 msgr2=0x7fe0040c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:15.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 -- 172.21.15.26:0/847527091 shutdown_connections 2023-11-28T16:56:15.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.135+0000 7fe00bbd8640 1 -- 172.21.15.26:0/847527091 wait complete. 2023-11-28T16:56:15.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 Processor -- start 2023-11-28T16:56:15.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 -- start start 2023-11-28T16:56:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0040a6e50 0x7fe004070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0041555d0 0x7fe004150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe00414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00406f160 con 0x7fe0040a6e50 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004154940 con 0x7fe0041555d0 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe004154c20 con 0x7fe004158010 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0040a6e50 0x7fe004070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0040a6e50 0x7fe004070030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43906/0 (socket says 172.21.15.26:43906) 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 -- 172.21.15.26:0/280122747 learned_addr learned my addr 172.21.15.26:0/280122747 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 -- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 msgr2=0x7fe00414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe00414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 -- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0041555d0 msgr2=0x7fe004150280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T16:56:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0041555d0 0x7fe004150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 -- 172.21.15.26:0/280122747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4009420 con 0x7fe0040a6e50 2023-11-28T16:56:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe009974640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0040a6e50 0x7fe004070030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe00000c450 tx=0x7fe00000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fdffa7fc640 1 -- 172.21.15.26:0/280122747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000005db0 con 0x7fe0040a6e50 2023-11-28T16:56:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fdffa7fc640 1 -- 172.21.15.26:0/280122747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe000007070 con 0x7fe0040a6e50 2023-11-28T16:56:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fdffa7fc640 1 -- 172.21.15.26:0/280122747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000007400 con 0x7fe0040a6e50 2023-11-28T16:56:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc009a70 con 0x7fe0040a6e50 2023-11-28T16:56:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.139+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00406e890 con 0x7fe0040a6e50 2023-11-28T16:56:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.143+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe004154e10 con 0x7fe0040a6e50 2023-11-28T16:56:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.143+0000 7fdffa7fc640 1 -- 172.21.15.26:0/280122747 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe000007560 con 0x7fe0040a6e50 2023-11-28T16:56:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.143+0000 7fdffa7fc640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfe80668d0 0x7fdfe8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.143+0000 7fdffa7fc640 1 -- 172.21.15.26:0/280122747 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe000083730 con 0x7fe0040a6e50 2023-11-28T16:56:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.143+0000 7fe009173640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfe80668d0 0x7fdfe8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.143+0000 7fe009173640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfe80668d0 0x7fdfe8068d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdff4006e90 tx=0x7fdff4006de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.147+0000 7fdffa7fc640 1 -- 172.21.15.26:0/280122747 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe000050cb0 con 0x7fe0040a6e50 2023-11-28T16:56:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.311+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe00406ea80 con 0x7fe0040a6e50 2023-11-28T16:56:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.311+0000 7fdffa7fc640 1 -- 172.21.15.26:0/280122747 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe000017020 con 0x7fe0040a6e50 2023-11-28T16:56:15.316 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:15.316 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-11-28T16:56:15.316 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:15.316 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-11-28T16:56:15.316 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-11-28T16:56:15.316 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:15.316 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-11-28T16:56:15.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfe80668d0 msgr2=0x7fdfe8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfe80668d0 0x7fdfe8068d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdff4006e90 tx=0x7fdff4006de0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0040a6e50 msgr2=0x7fe004070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0040a6e50 0x7fe004070030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe00000c450 tx=0x7fe00000c910 comp rx=0 tx=0).stop 2023-11-28T16:56:15.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 shutdown_connections 2023-11-28T16:56:15.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfe80668d0 0x7fdfe8068d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe004158010 0x7fe00414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0041555d0 0x7fe004150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 --2- 172.21.15.26:0/280122747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0040a6e50 0x7fe004070030 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 >> 172.21.15.26:0/280122747 conn(0x7fe0040c4960 msgr2=0x7fe0040c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:15.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 shutdown_connections 2023-11-28T16:56:15.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.315+0000 7fe00bbd8640 1 -- 172.21.15.26:0/280122747 wait complete. 2023-11-28T16:56:15.337 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T16:56:15.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T16:56:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.479+0000 7fc31d10f640 1 Processor -- start 2023-11-28T16:56:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.479+0000 7fc31d10f640 1 -- start start 2023-11-28T16:56:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc31d10f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc318151d60 0x7fc318155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc31d10f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318152140 0x7fc3180c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc31d10f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3180c4570 con 0x7fc3180c8770 2023-11-28T16:56:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc31d10f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3180c2670 con 0x7fc318151d60 2023-11-28T16:56:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc31d10f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180c4830 con 0x7fc318152140 2023-11-28T16:56:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc316d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc318151d60 0x7fc318155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc316d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc318151d60 0x7fc318155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43922/0 (socket says 172.21.15.26:43922) 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc316d9d640 1 -- 172.21.15.26:0/3375881909 learned_addr learned my addr 172.21.15.26:0/3375881909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc31759e640 1 --1- 172.21.15.26:0/3375881909 >> v1:172.21.15.26:6789/0 conn(0x7fc3180c8770 0x7fc3180c4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56930/0 (socket says 172.21.15.26:56930) 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc316d9d640 1 -- 172.21.15.26:0/3375881909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318152140 msgr2=0x7fc3180c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc30ffff640 1 --2- 172.21.15.26:0/3375881909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318152140 0x7fc3180c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc316d9d640 1 --2- 172.21.15.26:0/3375881909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318152140 0x7fc3180c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc316d9d640 1 -- 172.21.15.26:0/3375881909 >> v1:172.21.15.26:6789/0 conn(0x7fc3180c8770 legacy=0x7fc3180c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc31659c640 1 -- 172.21.15.26:0/3375881909 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409247610 0 0) 0x7fc3180c4570 con 0x7fc3180c8770 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc316d9d640 1 -- 172.21.15.26:0/3375881909 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180c60f0 con 0x7fc318151d60 2023-11-28T16:56:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.483+0000 7fc30ffff640 1 --2- 172.21.15.26:0/3375881909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318152140 0x7fc3180c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc316d9d640 1 --2- 172.21.15.26:0/3375881909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc318151d60 0x7fc318155140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc308009870 tx=0x7fc30801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f49051fe8bd4a2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31659c640 1 -- 172.21.15.26:0/3375881909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080ac620 con 0x7fc318151d60 2023-11-28T16:56:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31659c640 1 -- 172.21.15.26:0/3375881909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3080ac780 con 0x7fc318151d60 2023-11-28T16:56:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31659c640 1 -- 172.21.15.26:0/3375881909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080acb10 con 0x7fc318151d60 2023-11-28T16:56:15.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 -- 172.21.15.26:0/3375881909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc318151d60 msgr2=0x7fc318155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 --2- 172.21.15.26:0/3375881909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc318151d60 0x7fc318155140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc308009870 tx=0x7fc30801c4b0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 -- 172.21.15.26:0/3375881909 shutdown_connections 2023-11-28T16:56:15.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 --2- 172.21.15.26:0/3375881909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318152140 0x7fc3180c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 --2- 172.21.15.26:0/3375881909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc318151d60 0x7fc318155140 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 -- 172.21.15.26:0/3375881909 >> 172.21.15.26:0/3375881909 conn(0x7fc31806a770 msgr2=0x7fc31806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 -- 172.21.15.26:0/3375881909 shutdown_connections 2023-11-28T16:56:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 -- 172.21.15.26:0/3375881909 wait complete. 2023-11-28T16:56:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 Processor -- start 2023-11-28T16:56:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.487+0000 7fc31d10f640 1 -- start start 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3180c8770 0x7fc3180a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318151d60 0x7fc31814f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31814b700 0x7fc31814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180a8cb0 con 0x7fc31814b700 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31814c350 con 0x7fc3180c8770 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc318156e60 con 0x7fc318151d60 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31814b700 0x7fc31814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31814b700 0x7fc31814bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43938/0 (socket says 172.21.15.26:43938) 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 -- 172.21.15.26:0/66825825 learned_addr learned my addr 172.21.15.26:0/66825825 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc30ffff640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318151d60 0x7fc31814f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc316d9d640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3180c8770 0x7fc3180a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 -- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318151d60 msgr2=0x7fc31814f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318151d60 0x7fc31814f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 -- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3180c8770 msgr2=0x7fc3180a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3180c8770 0x7fc3180a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 -- 172.21.15.26:0/66825825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080094d0 con 0x7fc31814b700 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc30ffff640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318151d60 0x7fc31814f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc316d9d640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3180c8770 0x7fc3180a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31759e640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31814b700 0x7fc31814bbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c7d0 tx=0x7fc31000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc30f7fe640 1 -- 172.21.15.26:0/66825825 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000a640 con 0x7fc31814b700 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc30f7fe640 1 -- 172.21.15.26:0/66825825 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31000a7a0 con 0x7fc31814b700 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc30f7fe640 1 -- 172.21.15.26:0/66825825 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000ab90 con 0x7fc31814b700 2023-11-28T16:56:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31814c5a0 con 0x7fc31814b700 2023-11-28T16:56:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc318155c00 con 0x7fc31814b700 2023-11-28T16:56:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3180a8490 con 0x7fc31814b700 2023-11-28T16:56:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.491+0000 7fc30f7fe640 1 -- 172.21.15.26:0/66825825 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc31000acf0 con 0x7fc31814b700 2023-11-28T16:56:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.495+0000 7fc30f7fe640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc2f80668d0 0x7fc2f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.495+0000 7fc30f7fe640 1 -- 172.21.15.26:0/66825825 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc310083680 con 0x7fc31814b700 2023-11-28T16:56:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.495+0000 7fc316d9d640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc2f80668d0 0x7fc2f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.495+0000 7fc316d9d640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc2f80668d0 0x7fc2f8068d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3080ae000 tx=0x7fc3080a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.499+0000 7fc30f7fe640 1 -- 172.21.15.26:0/66825825 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3180a8490 con 0x7fc31814b700 2023-11-28T16:56:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:15.655+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc3180a8490 con 0x7fc31814b700 2023-11-28T16:56:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.239+0000 7fc30f7fe640 1 -- 172.21.15.26:0/66825825 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc3180a8490 con 0x7fc31814b700 2023-11-28T16:56:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-11-28T16:56:16.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc2f80668d0 msgr2=0x7fc2f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:16.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc2f80668d0 0x7fc2f8068d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3080ae000 tx=0x7fc3080a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:16.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31814b700 msgr2=0x7fc31814bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:16.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31814b700 0x7fc31814bbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c7d0 tx=0x7fc31000cc90 comp rx=0 tx=0).stop 2023-11-28T16:56:16.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 shutdown_connections 2023-11-28T16:56:16.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31814b700 0x7fc31814bbb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:16.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc2f80668d0 0x7fc2f8068d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:16.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc318151d60 0x7fc31814f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:16.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 --2- 172.21.15.26:0/66825825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3180c8770 0x7fc3180a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:16.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 >> 172.21.15.26:0/66825825 conn(0x7fc31806a770 msgr2=0x7fc3180c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:16.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 shutdown_connections 2023-11-28T16:56:16.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.243+0000 7fc31d10f640 1 -- 172.21.15.26:0/66825825 wait complete. 2023-11-28T16:56:16.276 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T16:56:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.423+0000 7f51d0c17640 1 Processor -- start 2023-11-28T16:56:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.423+0000 7f51d0c17640 1 -- start start 2023-11-28T16:56:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51d0c17640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f51cc0c6220 0x7f51cc158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51d0c17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc158580 con 0x7f51cc0c13a0 2023-11-28T16:56:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51d0c17640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc157f50 con 0x7f51cc151bf0 2023-11-28T16:56:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51d0c17640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0c2fd0 con 0x7f51cc0c6220 2023-11-28T16:56:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51c3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f51cc0c13a0 0x7f51cc0c28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56944/0 (socket says 172.21.15.26:56944) 2023-11-28T16:56:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51c3fff640 1 -- 172.21.15.26:0/278985009 learned_addr learned my addr 172.21.15.26:0/278985009 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51ca59c640 1 --2- 172.21.15.26:0/278985009 >> v2:172.21.15.79:3300/0 conn(0x7f51cc0c6220 0x7f51cc158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51c9d9b640 1 -- 172.21.15.26:0/278985009 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121222123 0 0) 0x7f51cc158580 con 0x7f51cc0c13a0 2023-11-28T16:56:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51c9d9b640 1 -- 172.21.15.26:0/278985009 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b8003530 con 0x7f51cc0c13a0 2023-11-28T16:56:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51ca59c640 1 -- 172.21.15.26:0/278985009 >> v1:172.21.15.79:6789/0 conn(0x7f51cc151bf0 legacy=0x7f51cc15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51c9d9b640 1 -- 172.21.15.26:0/278985009 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205395047 0 0) 0x7f51cc157f50 con 0x7f51cc151bf0 2023-11-28T16:56:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51ca59c640 1 -- 172.21.15.26:0/278985009 >> v1:172.21.15.26:6789/0 conn(0x7f51cc0c13a0 legacy=0x7f51cc0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.427+0000 7f51ca59c640 1 -- 172.21.15.26:0/278985009 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0c1f60 con 0x7f51cc0c6220 2023-11-28T16:56:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51ca59c640 1 --2- 172.21.15.26:0/278985009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 0x7f51cc158a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0097c0 tx=0x7f51bc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554aaf7ddf659282 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51c9d9b640 1 -- 172.21.15.26:0/278985009 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0ab650 con 0x7f51cc0c6220 2023-11-28T16:56:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51c9d9b640 1 -- 172.21.15.26:0/278985009 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc0ab7b0 con 0x7f51cc0c6220 2023-11-28T16:56:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51c9d9b640 1 -- 172.21.15.26:0/278985009 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0abb40 con 0x7f51cc0c6220 2023-11-28T16:56:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 -- 172.21.15.26:0/278985009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 msgr2=0x7f51cc158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 --2- 172.21.15.26:0/278985009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 0x7f51cc158a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0097c0 tx=0x7f51bc01c450 comp rx=0 tx=0).stop 2023-11-28T16:56:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 -- 172.21.15.26:0/278985009 shutdown_connections 2023-11-28T16:56:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 --2- 172.21.15.26:0/278985009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 0x7f51cc158a10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 -- 172.21.15.26:0/278985009 >> 172.21.15.26:0/278985009 conn(0x7f51cc06a5a0 msgr2=0x7f51cc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 -- 172.21.15.26:0/278985009 shutdown_connections 2023-11-28T16:56:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 -- 172.21.15.26:0/278985009 wait complete. 2023-11-28T16:56:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.431+0000 7f51d0c17640 1 Processor -- start 2023-11-28T16:56:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 -- start start 2023-11-28T16:56:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51cc0c13a0 0x7f51cc1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 0x7f51cc1edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51cc151bf0 0x7f51cc156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc146830 con 0x7f51cc151bf0 2023-11-28T16:56:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc145820 con 0x7f51cc0c6220 2023-11-28T16:56:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc14f6d0 con 0x7f51cc0c13a0 2023-11-28T16:56:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51cad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51cc151bf0 0x7f51cc156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 0x7f51cc1edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51ca59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51cc0c13a0 0x7f51cc1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51cad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51cc151bf0 0x7f51cc156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43952/0 (socket says 172.21.15.26:43952) 2023-11-28T16:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51cad9d640 1 -- 172.21.15.26:0/2317988082 learned_addr learned my addr 172.21.15.26:0/2317988082 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51ca59c640 1 -- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 msgr2=0x7f51cc1edfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51ca59c640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 0x7f51cc1edfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51ca59c640 1 -- 172.21.15.26:0/2317988082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51cc151bf0 msgr2=0x7f51cc156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51ca59c640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51cc151bf0 0x7f51cc156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51ca59c640 1 -- 172.21.15.26:0/2317988082 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc009420 con 0x7f51cc0c13a0 2023-11-28T16:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51ca59c640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51cc0c13a0 0x7f51cc1406b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0ac000 tx=0x7f51bc01ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51c2ffd640 1 -- 172.21.15.26:0/2317988082 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0bf610 con 0x7f51cc0c13a0 2023-11-28T16:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51c2ffd640 1 -- 172.21.15.26:0/2317988082 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc0bf770 con 0x7f51cc0c13a0 2023-11-28T16:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51c2ffd640 1 -- 172.21.15.26:0/2317988082 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0bfae0 con 0x7f51cc0c13a0 2023-11-28T16:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc144ec0 con 0x7f51cc0c13a0 2023-11-28T16:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc145d50 con 0x7f51cc0c13a0 2023-11-28T16:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.435+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc04e890 con 0x7f51cc0c13a0 2023-11-28T16:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.439+0000 7f51c2ffd640 1 -- 172.21.15.26:0/2317988082 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f51bc0ca430 con 0x7f51cc0c13a0 2023-11-28T16:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.439+0000 7f51c2ffd640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f51ac0668d0 0x7f51ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.439+0000 7f51c2ffd640 1 -- 172.21.15.26:0/2317988082 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f51bc11f5a0 con 0x7f51cc0c13a0 2023-11-28T16:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.439+0000 7f51c3fff640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f51ac0668d0 0x7f51ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.439+0000 7f51c3fff640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f51ac0668d0 0x7f51ac068d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f51cc157df0 tx=0x7f51b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.443+0000 7f51c2ffd640 1 -- 172.21.15.26:0/2317988082 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51bc0ecc00 con 0x7f51cc0c13a0 2023-11-28T16:56:16.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:16.599+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f51cc143f40 con 0x7f51cc0c13a0 2023-11-28T16:56:17.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.251+0000 7f51c2ffd640 1 -- 172.21.15.26:0/2317988082 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f51bc0f0220 con 0x7f51cc0c13a0 2023-11-28T16:56:17.258 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-11-28T16:56:17.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f51ac0668d0 msgr2=0x7f51ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:17.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f51ac0668d0 0x7f51ac068d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f51cc157df0 tx=0x7f51b4009040 comp rx=0 tx=0).stop 2023-11-28T16:56:17.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51cc0c13a0 msgr2=0x7f51cc1406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:17.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51cc0c13a0 0x7f51cc1406b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0ac000 tx=0x7f51bc01ac90 comp rx=0 tx=0).stop 2023-11-28T16:56:17.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 shutdown_connections 2023-11-28T16:56:17.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51cc151bf0 0x7f51cc156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0c6220 0x7f51cc1edfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f51ac0668d0 0x7f51ac068d90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 --2- 172.21.15.26:0/2317988082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51cc0c13a0 0x7f51cc1406b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.259+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 >> 172.21.15.26:0/2317988082 conn(0x7f51cc06a5a0 msgr2=0x7f51cc066410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:17.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.263+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 shutdown_connections 2023-11-28T16:56:17.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.263+0000 7f51d0c17640 1 -- 172.21.15.26:0/2317988082 wait complete. 2023-11-28T16:56:17.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T16:56:17.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.439+0000 7f84bd71d640 1 Processor -- start 2023-11-28T16:56:17.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.439+0000 7f84bd71d640 1 -- start start 2023-11-28T16:56:17.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84bd71d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b80c8430 0x7f84b806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:17.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84bd71d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84b80c7f20 0x7f84b806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:17.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84bd71d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b806cf70 con 0x7f84b8151d80 2023-11-28T16:56:17.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84bd71d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b8152160 con 0x7f84b80c7f20 2023-11-28T16:56:17.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84bd71d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80c6a30 con 0x7f84b80c8430 2023-11-28T16:56:17.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84b77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84b80c7f20 0x7f84b806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:17.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84affff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b80c8430 0x7f84b806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:17.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84b77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84b80c7f20 0x7f84b806bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:57786/0 (socket says 172.21.15.26:57786) 2023-11-28T16:56:17.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84b6ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f84b8151d80 0x7f84b80c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39024/0 (socket says 172.21.15.26:39024) 2023-11-28T16:56:17.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84b77fe640 1 -- 172.21.15.26:0/3459072047 learned_addr learned my addr 172.21.15.26:0/3459072047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:17.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84b67fc640 1 -- 172.21.15.26:0/3459072047 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987526026 0 0) 0x7f84b806cf70 con 0x7f84b8151d80 2023-11-28T16:56:17.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84affff640 1 -- 172.21.15.26:0/3459072047 >> v2:172.21.15.79:3300/0 conn(0x7f84b80c7f20 msgr2=0x7f84b806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:17.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84affff640 1 --2- 172.21.15.26:0/3459072047 >> v2:172.21.15.79:3300/0 conn(0x7f84b80c7f20 0x7f84b806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84affff640 1 -- 172.21.15.26:0/3459072047 >> v1:172.21.15.79:6789/0 conn(0x7f84b8151d80 legacy=0x7f84b80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:17.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84affff640 1 -- 172.21.15.26:0/3459072047 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b80c72d0 con 0x7f84b80c8430 2023-11-28T16:56:17.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.443+0000 7f84b77fe640 1 --2- 172.21.15.26:0/3459072047 >> v2:172.21.15.79:3300/0 conn(0x7f84b80c7f20 0x7f84b806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:17.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84affff640 1 --2- 172.21.15.26:0/3459072047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b80c8430 0x7f84b806b720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097c0 tx=0x7f84a001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5528ba80f5374a3d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:17.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84b67fc640 1 -- 172.21.15.26:0/3459072047 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00ac620 con 0x7f84b80c8430 2023-11-28T16:56:17.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84b67fc640 1 -- 172.21.15.26:0/3459072047 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00ac780 con 0x7f84b80c8430 2023-11-28T16:56:17.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84b67fc640 1 -- 172.21.15.26:0/3459072047 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00acb10 con 0x7f84b80c8430 2023-11-28T16:56:17.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 -- 172.21.15.26:0/3459072047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b80c8430 msgr2=0x7f84b806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:17.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 --2- 172.21.15.26:0/3459072047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b80c8430 0x7f84b806b720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097c0 tx=0x7f84a001c3c0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 -- 172.21.15.26:0/3459072047 shutdown_connections 2023-11-28T16:56:17.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 --2- 172.21.15.26:0/3459072047 >> v2:172.21.15.79:3300/0 conn(0x7f84b80c7f20 0x7f84b806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 --2- 172.21.15.26:0/3459072047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b80c8430 0x7f84b806b720 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 -- 172.21.15.26:0/3459072047 >> 172.21.15.26:0/3459072047 conn(0x7f84b80abd00 msgr2=0x7f84b80ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:17.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 -- 172.21.15.26:0/3459072047 shutdown_connections 2023-11-28T16:56:17.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 -- 172.21.15.26:0/3459072047 wait complete. 2023-11-28T16:56:17.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 Processor -- start 2023-11-28T16:56:17.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.447+0000 7f84bd71d640 1 -- start start 2023-11-28T16:56:17.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84b80c7f20 0x7f84b80c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:17.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84b80c8430 0x7f84b814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:17.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b8151d80 0x7f84b814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:17.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80c2a60 con 0x7f84b80c7f20 2023-11-28T16:56:17.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b81eed10 con 0x7f84b80c8430 2023-11-28T16:56:17.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80c24a0 con 0x7f84b8151d80 2023-11-28T16:56:17.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84b80c7f20 0x7f84b80c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:17.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84b80c7f20 0x7f84b80c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43954/0 (socket says 172.21.15.26:43954) 2023-11-28T16:56:17.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 -- 172.21.15.26:0/28378780 learned_addr learned my addr 172.21.15.26:0/28378780 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:17.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b77fe640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b8151d80 0x7f84b814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:17.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84affff640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84b80c8430 0x7f84b814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:17.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 -- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b8151d80 msgr2=0x7f84b814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b8151d80 0x7f84b814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 -- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84b80c8430 msgr2=0x7f84b814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84b80c8430 0x7f84b814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 -- 172.21.15.26:0/28378780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0009b30 con 0x7f84b80c7f20 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84b6ffd640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84b80c7f20 0x7f84b80c37b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84a80011f0 tx=0x7f84a800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84af7fe640 1 -- 172.21.15.26:0/28378780 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80074e0 con 0x7f84b80c7f20 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84af7fe640 1 -- 172.21.15.26:0/28378780 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a8007640 con 0x7f84b80c7f20 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84af7fe640 1 -- 172.21.15.26:0/28378780 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8004a10 con 0x7f84b80c7f20 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a0009420 con 0x7f84b80c7f20 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b81ee9a0 con 0x7f84b80c7f20 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b81ee800 con 0x7f84b80c7f20 2023-11-28T16:56:17.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.451+0000 7f84af7fe640 1 -- 172.21.15.26:0/28378780 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f84a801b360 con 0x7f84b80c7f20 2023-11-28T16:56:17.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.455+0000 7f84af7fe640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8498066900 0x7f8498068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:17.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.455+0000 7f84af7fe640 1 -- 172.21.15.26:0/28378780 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f84a80836e0 con 0x7f84b80c7f20 2023-11-28T16:56:17.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.455+0000 7f84affff640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8498066900 0x7f8498068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:17.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.455+0000 7f84affff640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8498066900 0x7f8498068dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f84a00ae000 tx=0x7f84a00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:17.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.459+0000 7f84af7fe640 1 -- 172.21.15.26:0/28378780 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84a8050a10 con 0x7f84b80c7f20 2023-11-28T16:56:17.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:56:17.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:56:17.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:17.647+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f84b81ee800 con 0x7f84b80c7f20 2023-11-28T16:56:18.288 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T16:56:18.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.279+0000 7f84af7fe640 1 -- 172.21.15.26:0/28378780 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f84b81ee800 con 0x7f84b80c7f20 2023-11-28T16:56:18.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.287+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8498066900 msgr2=0x7f8498068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.287+0000 7f84bd71d640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8498066900 0x7f8498068dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f84a00ae000 tx=0x7f84a00a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:18.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.287+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84b80c7f20 msgr2=0x7f84b80c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.287+0000 7f84bd71d640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84b80c7f20 0x7f84b80c37b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84a80011f0 tx=0x7f84a800c9b0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.291+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 shutdown_connections 2023-11-28T16:56:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.291+0000 7f84bd71d640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8498066900 0x7f8498068dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.291+0000 7f84bd71d640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b8151d80 0x7f84b814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.291+0000 7f84bd71d640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84b80c8430 0x7f84b814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.291+0000 7f84bd71d640 1 --2- 172.21.15.26:0/28378780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84b80c7f20 0x7f84b80c37b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.291+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 >> 172.21.15.26:0/28378780 conn(0x7f84b80abd00 msgr2=0x7f84b8150050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.295+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 shutdown_connections 2023-11-28T16:56:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.295+0000 7f84bd71d640 1 -- 172.21.15.26:0/28378780 wait complete. 2023-11-28T16:56:18.331 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.471+0000 7f5154cc9640 1 Processor -- start 2023-11-28T16:56:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.471+0000 7f5154cc9640 1 -- start start 2023-11-28T16:56:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5154cc9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f51500ca610 0x7f51500c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5154cc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51500bd720 0x7f51500c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5154cc9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150155790 con 0x7f515006cd90 2023-11-28T16:56:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5154cc9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500c4b00 con 0x7f51500bd720 2023-11-28T16:56:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5154cc9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500c4de0 con 0x7f51500ca610 2023-11-28T16:56:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5147fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51500bd720 0x7f51500c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5147fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51500bd720 0x7f51500c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43958/0 (socket says 172.21.15.26:43958) 2023-11-28T16:56:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5147fff640 1 -- 172.21.15.26:0/2017627117 learned_addr learned my addr 172.21.15.26:0/2017627117 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f514e59c640 1 --2- 172.21.15.26:0/2017627117 >> v2:172.21.15.79:3300/0 conn(0x7f51500ca610 0x7f51500c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5147fff640 1 -- 172.21.15.26:0/2017627117 >> v2:172.21.15.79:3300/0 conn(0x7f51500ca610 msgr2=0x7f51500c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5147fff640 1 --2- 172.21.15.26:0/2017627117 >> v2:172.21.15.79:3300/0 conn(0x7f51500ca610 0x7f51500c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5147fff640 1 -- 172.21.15.26:0/2017627117 >> v1:172.21.15.79:6789/0 conn(0x7f515006cd90 legacy=0x7f5150158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.475+0000 7f5147fff640 1 -- 172.21.15.26:0/2017627117 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150157e30 con 0x7f51500bd720 2023-11-28T16:56:18.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5147fff640 1 --2- 172.21.15.26:0/2017627117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51500c9a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51500acc80 tx=0x7f513801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb39c3dd4df015d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:18.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f514dd9b640 1 -- 172.21.15.26:0/2017627117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500c52d0 con 0x7f51500bd720 2023-11-28T16:56:18.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f514dd9b640 1 -- 172.21.15.26:0/2017627117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51380a4900 con 0x7f51500bd720 2023-11-28T16:56:18.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f514dd9b640 1 -- 172.21.15.26:0/2017627117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380a4c90 con 0x7f51500bd720 2023-11-28T16:56:18.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 -- 172.21.15.26:0/2017627117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 msgr2=0x7f51500c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 --2- 172.21.15.26:0/2017627117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51500c9a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51500acc80 tx=0x7f513801c0c0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 -- 172.21.15.26:0/2017627117 shutdown_connections 2023-11-28T16:56:18.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 --2- 172.21.15.26:0/2017627117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51500c9a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 --2- 172.21.15.26:0/2017627117 >> v2:172.21.15.79:3300/0 conn(0x7f51500ca610 0x7f51500c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 -- 172.21.15.26:0/2017627117 >> 172.21.15.26:0/2017627117 conn(0x7f5150071ea0 msgr2=0x7f51500722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:18.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 -- 172.21.15.26:0/2017627117 shutdown_connections 2023-11-28T16:56:18.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 -- 172.21.15.26:0/2017627117 wait complete. 2023-11-28T16:56:18.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 Processor -- start 2023-11-28T16:56:18.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.479+0000 7f5154cc9640 1 -- start start 2023-11-28T16:56:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f515006cd90 0x7f51500ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51501ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51500ca610 0x7f51501f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ab460 con 0x7f51500bd720 2023-11-28T16:56:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ab6a0 con 0x7f515006cd90 2023-11-28T16:56:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ab980 con 0x7f51500ca610 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51501ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51501ef200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43972/0 (socket says 172.21.15.26:43972) 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 -- 172.21.15.26:0/3314437086 learned_addr learned my addr 172.21.15.26:0/3314437086 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f514e59c640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f515006cd90 0x7f51500ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f514ed9d640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51500ca610 0x7f51501f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 -- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51500ca610 msgr2=0x7f51501f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51500ca610 0x7f51501f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 -- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f515006cd90 msgr2=0x7f51500ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f515006cd90 0x7f51500ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 -- 172.21.15.26:0/3314437086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380094d0 con 0x7f51500bd720 2023-11-28T16:56:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5147fff640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51501ef200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5138018ff0 tx=0x7f5138019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:18.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5146ffd640 1 -- 172.21.15.26:0/3314437086 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380ac8d0 con 0x7f51500bd720 2023-11-28T16:56:18.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5146ffd640 1 -- 172.21.15.26:0/3314437086 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51380aca30 con 0x7f51500bd720 2023-11-28T16:56:18.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5146ffd640 1 -- 172.21.15.26:0/3314437086 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380acdc0 con 0x7f51500bd720 2023-11-28T16:56:18.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51500abc60 con 0x7f51500bd720 2023-11-28T16:56:18.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51501f1f60 con 0x7f51500bd720 2023-11-28T16:56:18.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51500ab7e0 con 0x7f51500bd720 2023-11-28T16:56:18.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.483+0000 7f5146ffd640 1 -- 172.21.15.26:0/3314437086 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f51380b43f0 con 0x7f51500bd720 2023-11-28T16:56:18.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.487+0000 7f5146ffd640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5130066900 0x7f5130068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.487+0000 7f5146ffd640 1 -- 172.21.15.26:0/3314437086 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51500cac00 con 0x7f51500bd720 2023-11-28T16:56:18.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.487+0000 7f514e59c640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5130066900 0x7f5130068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.487+0000 7f514e59c640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5130066900 0x7f5130068dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5140009ac0 tx=0x7f5140009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:18.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.491+0000 7f5146ffd640 1 -- 172.21.15.26:0/3314437086 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51500ab7e0 con 0x7f51500bd720 2023-11-28T16:56:18.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51500ab7e0 con 0x7f51500bd720 2023-11-28T16:56:18.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5146ffd640 1 -- 172.21.15.26:0/3314437086 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16446 (secure 0 0 0) 0x7f51500ab7e0 con 0x7f51500bd720 2023-11-28T16:56:18.655 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:18.655 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:17.652885+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5130066900 msgr2=0x7f5130068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5130066900 0x7f5130068dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5140009ac0 tx=0x7f5140009190 comp rx=0 tx=0).stop 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 msgr2=0x7f51501ef200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51501ef200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5138018ff0 tx=0x7f5138019180 comp rx=0 tx=0).stop 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 shutdown_connections 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5130066900 0x7f5130068dc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51500ca610 0x7f51501f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51500bd720 0x7f51501ef200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 --2- 172.21.15.26:0/3314437086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f515006cd90 0x7f51500ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 >> 172.21.15.26:0/3314437086 conn(0x7f5150071ea0 msgr2=0x7f5150156470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:18.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 shutdown_connections 2023-11-28T16:56:18.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.651+0000 7f5154cc9640 1 -- 172.21.15.26:0/3314437086 wait complete. 2023-11-28T16:56:18.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:18.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14bc65f640 1 Processor -- start 2023-11-28T16:56:18.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14bc65f640 1 -- start start 2023-11-28T16:56:18.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14bc65f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f14b40ca610 0x7f14b40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14bc65f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14b40bd720 0x7f14b40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14bc65f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b4155790 con 0x7f14b406cd90 2023-11-28T16:56:18.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14bc65f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40c4b00 con 0x7f14b40bd720 2023-11-28T16:56:18.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14bc65f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40c4de0 con 0x7f14b40ca610 2023-11-28T16:56:18.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14b9bfa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14b40bd720 0x7f14b40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14b9bfa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14b40bd720 0x7f14b40c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43982/0 (socket says 172.21.15.26:43982) 2023-11-28T16:56:18.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14b9bfa640 1 -- 172.21.15.26:0/1603396873 learned_addr learned my addr 172.21.15.26:0/1603396873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:18.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14ba3fb640 1 --2- 172.21.15.26:0/1603396873 >> v2:172.21.15.79:3300/0 conn(0x7f14b40ca610 0x7f14b40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14b9bfa640 1 -- 172.21.15.26:0/1603396873 >> v2:172.21.15.79:3300/0 conn(0x7f14b40ca610 msgr2=0x7f14b40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:18.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14b9bfa640 1 --2- 172.21.15.26:0/1603396873 >> v2:172.21.15.79:3300/0 conn(0x7f14b40ca610 0x7f14b40c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14b9bfa640 1 -- 172.21.15.26:0/1603396873 >> v1:172.21.15.79:6789/0 conn(0x7f14b406cd90 legacy=0x7f14b4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:18.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.815+0000 7f14b9bfa640 1 -- 172.21.15.26:0/1603396873 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4157e30 con 0x7f14b40bd720 2023-11-28T16:56:18.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14b9bfa640 1 --2- 172.21.15.26:0/1603396873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40bd720 0x7f14b40c9a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14b40acc80 tx=0x7f14a401c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a12b703bd22951 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:18.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14b93f9640 1 -- 172.21.15.26:0/1603396873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40c52d0 con 0x7f14b40bd720 2023-11-28T16:56:18.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14b93f9640 1 -- 172.21.15.26:0/1603396873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a40a4900 con 0x7f14b40bd720 2023-11-28T16:56:18.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14b93f9640 1 -- 172.21.15.26:0/1603396873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40a4c90 con 0x7f14b40bd720 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 -- 172.21.15.26:0/1603396873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40bd720 msgr2=0x7f14b40c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 --2- 172.21.15.26:0/1603396873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40bd720 0x7f14b40c9a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14b40acc80 tx=0x7f14a401c0c0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 -- 172.21.15.26:0/1603396873 shutdown_connections 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 --2- 172.21.15.26:0/1603396873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40bd720 0x7f14b40c9a00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 --2- 172.21.15.26:0/1603396873 >> v2:172.21.15.79:3300/0 conn(0x7f14b40ca610 0x7f14b40c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 -- 172.21.15.26:0/1603396873 >> 172.21.15.26:0/1603396873 conn(0x7f14b4071ea0 msgr2=0x7f14b40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 -- 172.21.15.26:0/1603396873 shutdown_connections 2023-11-28T16:56:18.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.819+0000 7f14bc65f640 1 -- 172.21.15.26:0/1603396873 wait complete. 2023-11-28T16:56:18.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 Processor -- start 2023-11-28T16:56:18.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 -- start start 2023-11-28T16:56:18.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14b406cd90 0x7f14b40ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14b40bd720 0x7f14b41ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40ca610 0x7f14b41f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40ab460 con 0x7f14b40ca610 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40ab6a0 con 0x7f14b40bd720 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40ab980 con 0x7f14b406cd90 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14babfc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40ca610 0x7f14b41f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14babfc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40ca610 0x7f14b41f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43988/0 (socket says 172.21.15.26:43988) 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14babfc640 1 -- 172.21.15.26:0/2831378011 learned_addr learned my addr 172.21.15.26:0/2831378011 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14b9bfa640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14b40bd720 0x7f14b41ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14ba3fb640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14b406cd90 0x7f14b40ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14b9bfa640 1 -- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14b406cd90 msgr2=0x7f14b40ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14b9bfa640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14b406cd90 0x7f14b40ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14b9bfa640 1 -- 172.21.15.26:0/2831378011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40ca610 msgr2=0x7f14b41f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14b9bfa640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40ca610 0x7f14b41f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14b9bfa640 1 -- 172.21.15.26:0/2831378011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40094d0 con 0x7f14b40bd720 2023-11-28T16:56:18.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14babfc640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40ca610 0x7f14b41f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:18.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14b9bfa640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14b40bd720 0x7f14b41ef200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f14a40ab000 tx=0x7f14a4019180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:18.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14aaffd640 1 -- 172.21.15.26:0/2831378011 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40aca10 con 0x7f14b40bd720 2023-11-28T16:56:18.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14aaffd640 1 -- 172.21.15.26:0/2831378011 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a40acbb0 con 0x7f14b40bd720 2023-11-28T16:56:18.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b40abc60 con 0x7f14b40bd720 2023-11-28T16:56:18.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14aaffd640 1 -- 172.21.15.26:0/2831378011 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40b7460 con 0x7f14b40bd720 2023-11-28T16:56:18.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.823+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b41f1f60 con 0x7f14b40bd720 2023-11-28T16:56:18.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.827+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b40ab7e0 con 0x7f14b40bd720 2023-11-28T16:56:18.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.827+0000 7f14aaffd640 1 -- 172.21.15.26:0/2831378011 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f14a40b75c0 con 0x7f14b40bd720 2023-11-28T16:56:18.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.827+0000 7f14aaffd640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1498066900 0x7f1498068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:18.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.827+0000 7f14aaffd640 1 -- 172.21.15.26:0/2831378011 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14b40cac00 con 0x7f14b40bd720 2023-11-28T16:56:18.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.827+0000 7f14ba3fb640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1498066900 0x7f1498068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:18.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.827+0000 7f14ba3fb640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1498066900 0x7f1498068dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f14b000b930 tx=0x7f14b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:18.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.831+0000 7f14aaffd640 1 -- 172.21.15.26:0/2831378011 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14a40eb570 con 0x7f14b40bd720 2023-11-28T16:56:18.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.991+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14b40ab7e0 con 0x7f14b40bd720 2023-11-28T16:56:18.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.991+0000 7f14aaffd640 1 -- 172.21.15.26:0/2831378011 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16446 (secure 0 0 0) 0x7f14b40ab7e0 con 0x7f14b40bd720 2023-11-28T16:56:18.997 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:17.652885+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1498066900 msgr2=0x7f1498068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1498066900 0x7f1498068dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f14b000b930 tx=0x7f14b0008040 comp rx=0 tx=0).stop 2023-11-28T16:56:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14b40bd720 msgr2=0x7f14b41ef200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14b40bd720 0x7f14b41ef200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f14a40ab000 tx=0x7f14a4019180 comp rx=0 tx=0).stop 2023-11-28T16:56:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 shutdown_connections 2023-11-28T16:56:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40ca610 0x7f14b41f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14b40bd720 0x7f14b41ef200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1498066900 0x7f1498068dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 --2- 172.21.15.26:0/2831378011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14b406cd90 0x7f14b40ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 >> 172.21.15.26:0/2831378011 conn(0x7f14b4071ea0 msgr2=0x7f14b4156470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 shutdown_connections 2023-11-28T16:56:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:18.995+0000 7f14bc65f640 1 -- 172.21.15.26:0/2831378011 wait complete. 2023-11-28T16:56:19.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T16:56:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.159+0000 7fd545757640 1 Processor -- start 2023-11-28T16:56:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.159+0000 7fd545757640 1 -- start start 2023-11-28T16:56:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.159+0000 7fd545757640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd54014fd00 0x7fd5400aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.159+0000 7fd545757640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd540152d90 con 0x7fd540156600 2023-11-28T16:56:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.159+0000 7fd545757640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd540152480 con 0x7fd5400a86d0 2023-11-28T16:56:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.159+0000 7fd545757640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5400a9760 con 0x7fd54014fd00 2023-11-28T16:56:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd537fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd540156600 0x7fd54014f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56958/0 (socket says 172.21.15.26:56958) 2023-11-28T16:56:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd537fff640 1 -- 172.21.15.26:0/2499969521 learned_addr learned my addr 172.21.15.26:0/2499969521 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53f7fe640 1 --2- 172.21.15.26:0/2499969521 >> v2:172.21.15.79:3300/0 conn(0x7fd54014fd00 0x7fd5400aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725575947 0 0) 0x7fd540152d90 con 0x7fd540156600 2023-11-28T16:56:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd52c003530 con 0x7fd540156600 2023-11-28T16:56:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1489876808 0 0) 0x7fd52c003530 con 0x7fd540156600 2023-11-28T16:56:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 >> v2:172.21.15.79:3300/0 conn(0x7fd54014fd00 msgr2=0x7fd5400aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:19.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 --2- 172.21.15.26:0/2499969521 >> v2:172.21.15.79:3300/0 conn(0x7fd54014fd00 0x7fd5400aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 >> v1:172.21.15.79:6789/0 conn(0x7fd5400a86d0 legacy=0x7fd5400a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:19.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540152740 con 0x7fd540156600 2023-11-28T16:56:19.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fd528001680 con 0x7fd540156600 2023-11-28T16:56:19.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 >> v1:172.21.15.26:6789/0 conn(0x7fd540156600 legacy=0x7fd54014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:19.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c0039d0 0x7fd52c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0047d0 0x7fd52c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c005190 0x7fd52c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400a9760 con 0x7fd52c0039d0 2023-11-28T16:56:19.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c00c090 con 0x7fd52c0047d0 2023-11-28T16:56:19.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c00c250 con 0x7fd52c005190 2023-11-28T16:56:19.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53effd640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c0039d0 0x7fd52c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd537fff640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0047d0 0x7fd52c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53f7fe640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c005190 0x7fd52c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53effd640 1 -- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c005190 msgr2=0x7fd52c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:19.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53effd640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c005190 0x7fd52c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53effd640 1 -- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0047d0 msgr2=0x7fd52c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:19.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53effd640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0047d0 0x7fd52c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53effd640 1 -- 172.21.15.26:0/2499969521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c003530 con 0x7fd52c0039d0 2023-11-28T16:56:19.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53f7fe640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c005190 0x7fd52c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:19.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.163+0000 7fd53f7fe640 1 -- 172.21.15.26:0/2499969521 reap_dead start 2023-11-28T16:56:19.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd53effd640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c0039d0 0x7fd52c003df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd530001780 tx=0x7fd53001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510945f52b7bf18a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:19.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300052d0 con 0x7fd52c0039d0 2023-11-28T16:56:19.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5300a7050 con 0x7fd52c0039d0 2023-11-28T16:56:19.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd53e7fc640 1 -- 172.21.15.26:0/2499969521 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530003600 con 0x7fd52c0039d0 2023-11-28T16:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 -- 172.21.15.26:0/2499969521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c0039d0 msgr2=0x7fd52c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c0039d0 0x7fd52c003df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd530001780 tx=0x7fd53001c3e0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 -- 172.21.15.26:0/2499969521 shutdown_connections 2023-11-28T16:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 --2- 172.21.15.26:0/2499969521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c0039d0 0x7fd52c003df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 -- 172.21.15.26:0/2499969521 >> 172.21.15.26:0/2499969521 conn(0x7fd5400c2a60 msgr2=0x7fd5400c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 -- 172.21.15.26:0/2499969521 shutdown_connections 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 -- 172.21.15.26:0/2499969521 wait complete. 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 Processor -- start 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.167+0000 7fd545757640 1 -- start start 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c0039d0 0x7fd540154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd540147d40 0x7fd5400c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5400c0f80 0x7fd5401f0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401e3330 con 0x7fd5400c0f80 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd540147bd0 con 0x7fd540147d40 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd540155870 con 0x7fd52c0039d0 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5400c0f80 0x7fd5401f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5400c0f80 0x7fd5401f0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44004/0 (socket says 172.21.15.26:44004) 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 -- 172.21.15.26:0/1893559258 learned_addr learned my addr 172.21.15.26:0/1893559258 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd537fff640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd540147d40 0x7fd5400c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53effd640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c0039d0 0x7fd540154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 -- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c0039d0 msgr2=0x7fd540154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c0039d0 0x7fd540154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 -- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd540147d40 msgr2=0x7fd5400c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd540147d40 0x7fd5400c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 -- 172.21.15.26:0/1893559258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540155590 con 0x7fd5400c0f80 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53effd640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c0039d0 0x7fd540154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd53f7fe640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5400c0f80 0x7fd5401f0780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd5400c6f00 tx=0x7fd538010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd5377fe640 1 -- 172.21.15.26:0/1893559258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53801b070 con 0x7fd5400c0f80 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd5377fe640 1 -- 172.21.15.26:0/1893559258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53800f040 con 0x7fd5400c0f80 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5401e2c70 con 0x7fd5400c0f80 2023-11-28T16:56:19.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd5377fe640 1 -- 172.21.15.26:0/1893559258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800e050 con 0x7fd5400c0f80 2023-11-28T16:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd540154350 con 0x7fd5400c0f80 2023-11-28T16:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5400c0840 con 0x7fd5400c0f80 2023-11-28T16:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.171+0000 7fd5377fe640 1 -- 172.21.15.26:0/1893559258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd538015440 con 0x7fd5400c0f80 2023-11-28T16:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.175+0000 7fd5377fe640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.175+0000 7fd5377fe640 1 -- 172.21.15.26:0/1893559258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5380845b0 con 0x7fd5400c0f80 2023-11-28T16:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.175+0000 7fd53effd640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.175+0000 7fd53effd640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd530001750 tx=0x7fd5300011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.179+0000 7fd5377fe640 1 -- 172.21.15.26:0/1893559258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5380517f0 con 0x7fd5400c0f80 2023-11-28T16:56:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:19.371+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd54004e890 con 0x7fd5400c0f80 2023-11-28T16:56:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.295+0000 7fd5377fe640 1 -- 172.21.15.26:0/1893559258 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd538054e10 con 0x7fd5400c0f80 2023-11-28T16:56:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 msgr2=0x7fd520068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd530001750 tx=0x7fd5300011a0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5400c0f80 msgr2=0x7fd5401f0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5400c0f80 0x7fd5401f0780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd5400c6f00 tx=0x7fd538010590 comp rx=0 tx=0).stop 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 shutdown_connections 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5400c0f80 0x7fd5401f0780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd540147d40 0x7fd5400c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 --2- 172.21.15.26:0/1893559258 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd52c0039d0 0x7fd540154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 >> 172.21.15.26:0/1893559258 conn(0x7fd5400c2a60 msgr2=0x7fd5400c1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 shutdown_connections 2023-11-28T16:56:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.299+0000 7fd545757640 1 -- 172.21.15.26:0/1893559258 wait complete. 2023-11-28T16:56:20.325 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T16:56:20.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T16:56:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.471+0000 7fadf7780640 1 Processor -- start 2023-11-28T16:56:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.471+0000 7fadf7780640 1 -- start start 2023-11-28T16:56:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.471+0000 7fadf7780640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadf0151d80 0x7fadf00c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf7780640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf00c7f20 0x7fadf006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf7780640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf006cf70 con 0x7fadf00c8430 2023-11-28T16:56:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf7780640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf0152160 con 0x7fadf0151d80 2023-11-28T16:56:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf7780640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c6a30 con 0x7fadf00c7f20 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf5d1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf00c7f20 0x7fadf006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf551c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadf0151d80 0x7fadf00c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf5d1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf00c7f20 0x7fadf006be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:37192/0 (socket says 172.21.15.26:37192) 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf5d1d640 1 -- 172.21.15.26:0/1701465598 learned_addr learned my addr 172.21.15.26:0/1701465598 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf551c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadf0151d80 0x7fadf00c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:57868/0 (socket says 172.21.15.26:57868) 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf5d1d640 1 -- 172.21.15.26:0/1701465598 >> v2:172.21.15.79:3300/0 conn(0x7fadf0151d80 msgr2=0x7fadf00c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fade7fff640 1 -- 172.21.15.26:0/1701465598 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052728617 0 0) 0x7fadf006cf70 con 0x7fadf00c8430 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf5d1d640 1 --2- 172.21.15.26:0/1701465598 >> v2:172.21.15.79:3300/0 conn(0x7fadf0151d80 0x7fadf00c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf5d1d640 1 -- 172.21.15.26:0/1701465598 >> v1:172.21.15.79:6789/0 conn(0x7fadf00c8430 legacy=0x7fadf006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.475+0000 7fadf5d1d640 1 -- 172.21.15.26:0/1701465598 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00c72d0 con 0x7fadf00c7f20 2023-11-28T16:56:20.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf5d1d640 1 --2- 172.21.15.26:0/1701465598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf00c7f20 0x7fadf006be30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fade8009e50 tx=0x7fade801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d861a50483c43b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:20.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fade7fff640 1 -- 172.21.15.26:0/1701465598 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80a5810 con 0x7fadf00c7f20 2023-11-28T16:56:20.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fade7fff640 1 -- 172.21.15.26:0/1701465598 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade80a5970 con 0x7fadf00c7f20 2023-11-28T16:56:20.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fade7fff640 1 -- 172.21.15.26:0/1701465598 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80a5d00 con 0x7fadf00c7f20 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- 172.21.15.26:0/1701465598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf00c7f20 msgr2=0x7fadf006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 --2- 172.21.15.26:0/1701465598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf00c7f20 0x7fadf006be30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fade8009e50 tx=0x7fade801c950 comp rx=0 tx=0).stop 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- 172.21.15.26:0/1701465598 shutdown_connections 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 --2- 172.21.15.26:0/1701465598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf00c7f20 0x7fadf006be30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 --2- 172.21.15.26:0/1701465598 >> v2:172.21.15.79:3300/0 conn(0x7fadf0151d80 0x7fadf00c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- 172.21.15.26:0/1701465598 >> 172.21.15.26:0/1701465598 conn(0x7fadf00abd00 msgr2=0x7fadf00ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- 172.21.15.26:0/1701465598 shutdown_connections 2023-11-28T16:56:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- 172.21.15.26:0/1701465598 wait complete. 2023-11-28T16:56:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 Processor -- start 2023-11-28T16:56:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- start start 2023-11-28T16:56:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadf00c7f20 0x7fadf0155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00c8430 0x7fadf01ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf0151d80 0x7fadf00c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01edf30 con 0x7fadf00c7f20 2023-11-28T16:56:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c1ea0 con 0x7fadf00c8430 2023-11-28T16:56:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf7780640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c1290 con 0x7fadf0151d80 2023-11-28T16:56:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf551c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadf00c7f20 0x7fadf0155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf551c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadf00c7f20 0x7fadf0155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44012/0 (socket says 172.21.15.26:44012) 2023-11-28T16:56:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.479+0000 7fadf551c640 1 -- 172.21.15.26:0/1007027709 learned_addr learned my addr 172.21.15.26:0/1007027709 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf5d1d640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf0151d80 0x7fadf00c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf4d1b640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00c8430 0x7fadf01ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf551c640 1 -- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf0151d80 msgr2=0x7fadf00c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf551c640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf0151d80 0x7fadf00c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf551c640 1 -- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00c8430 msgr2=0x7fadf01ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf551c640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00c8430 0x7fadf01ed9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf551c640 1 -- 172.21.15.26:0/1007027709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8009b30 con 0x7fadf00c7f20 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf5d1d640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf0151d80 0x7fadf00c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf4d1b640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00c8430 0x7fadf01ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf551c640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadf00c7f20 0x7fadf0155d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fadec00e870 tx=0x7fadec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fade5ffb640 1 -- 172.21.15.26:0/1007027709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec009510 con 0x7fadf00c7f20 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fade5ffb640 1 -- 172.21.15.26:0/1007027709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00eec0 con 0x7fadf00c7f20 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00c1570 con 0x7fadf00c7f20 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fade5ffb640 1 -- 172.21.15.26:0/1007027709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00cae0 con 0x7fadf00c7f20 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00c1b30 con 0x7fadf00c7f20 2023-11-28T16:56:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf004e890 con 0x7fadf00c7f20 2023-11-28T16:56:20.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.483+0000 7fade5ffb640 1 -- 172.21.15.26:0/1007027709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fadec00cc60 con 0x7fadf00c7f20 2023-11-28T16:56:20.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.487+0000 7fade5ffb640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fadd40668d0 0x7fadd4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:20.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.487+0000 7fade5ffb640 1 -- 172.21.15.26:0/1007027709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadec0845a0 con 0x7fadf00c7f20 2023-11-28T16:56:20.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.487+0000 7fadf4d1b640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fadd40668d0 0x7fadd4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:20.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.487+0000 7fadf4d1b640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fadd40668d0 0x7fadd4068d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadf00bd490 tx=0x7fade0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:20.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.491+0000 7fade5ffb640 1 -- 172.21.15.26:0/1007027709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fadec051740 con 0x7fadf00c7f20 2023-11-28T16:56:20.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:20.683+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fadf014edd0 con 0x7fadf00c7f20 2023-11-28T16:56:21.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.295+0000 7fade5ffb640 1 -- 172.21.15.26:0/1007027709 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fadec054d60 con 0x7fadf00c7f20 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fadd40668d0 msgr2=0x7fadd4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fadd40668d0 0x7fadd4068d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadf00bd490 tx=0x7fade0009040 comp rx=0 tx=0).stop 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadf00c7f20 msgr2=0x7fadf0155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadf00c7f20 0x7fadf0155d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fadec00e870 tx=0x7fadec00ec70 comp rx=0 tx=0).stop 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 shutdown_connections 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fadd40668d0 0x7fadd4068d90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadf0151d80 0x7fadf00c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00c8430 0x7fadf01ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 --2- 172.21.15.26:0/1007027709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadf00c7f20 0x7fadf0155d30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 >> 172.21.15.26:0/1007027709 conn(0x7fadf00abd00 msgr2=0x7fadf00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:21.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 shutdown_connections 2023-11-28T16:56:21.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.299+0000 7fadf7780640 1 -- 172.21.15.26:0/1007027709 wait complete. 2023-11-28T16:56:21.325 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T16:56:21.325 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.467+0000 7ff39be9a640 1 Processor -- start 2023-11-28T16:56:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.467+0000 7ff39be9a640 1 -- start start 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.467+0000 7ff39be9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3940a6e50 0x7ff3940c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.467+0000 7ff39be9a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940c70a0 con 0x7ff394158010 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.467+0000 7ff39be9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940c7380 con 0x7ff3941555d0 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.467+0000 7ff39be9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39406c470 con 0x7ff3940a6e50 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff399435640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3940a6e50 0x7ff3940c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff399435640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3940a6e50 0x7ff3940c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53058/0 (socket says 172.21.15.26:53058) 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff399435640 1 -- 172.21.15.26:0/4229374047 learned_addr learned my addr 172.21.15.26:0/4229374047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff399435640 1 -- 172.21.15.26:0/4229374047 >> v1:172.21.15.79:6789/0 conn(0x7ff3941555d0 legacy=0x7ff3940c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff399435640 1 -- 172.21.15.26:0/4229374047 >> v1:172.21.15.26:6789/0 conn(0x7ff394158010 legacy=0x7ff39415f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff399435640 1 -- 172.21.15.26:0/4229374047 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39406c750 con 0x7ff3940a6e50 2023-11-28T16:56:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff399435640 1 --2- 172.21.15.26:0/4229374047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940c78e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff384009870 tx=0x7ff38401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccc8c60fef6963b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff398c34640 1 -- 172.21.15.26:0/4229374047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840a9620 con 0x7ff3940a6e50 2023-11-28T16:56:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff398c34640 1 -- 172.21.15.26:0/4229374047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3840a9780 con 0x7ff3940a6e50 2023-11-28T16:56:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.471+0000 7ff398c34640 1 -- 172.21.15.26:0/4229374047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840a9b10 con 0x7ff3940a6e50 2023-11-28T16:56:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- 172.21.15.26:0/4229374047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 msgr2=0x7ff3940c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 --2- 172.21.15.26:0/4229374047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940c78e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff384009870 tx=0x7ff38401c500 comp rx=0 tx=0).stop 2023-11-28T16:56:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- 172.21.15.26:0/4229374047 shutdown_connections 2023-11-28T16:56:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 --2- 172.21.15.26:0/4229374047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940c78e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- 172.21.15.26:0/4229374047 >> 172.21.15.26:0/4229374047 conn(0x7ff3940c4960 msgr2=0x7ff3940c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- 172.21.15.26:0/4229374047 shutdown_connections 2023-11-28T16:56:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- 172.21.15.26:0/4229374047 wait complete. 2023-11-28T16:56:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 Processor -- start 2023-11-28T16:56:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- start start 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3941555d0 0x7ff3940a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff394158010 0x7ff3940aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394151840 con 0x7ff3940a6e50 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3941ee340 con 0x7ff394158010 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39be9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff394151a90 con 0x7ff3941555d0 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53070/0 (socket says 172.21.15.26:53070) 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 -- 172.21.15.26:0/1907549808 learned_addr learned my addr 172.21.15.26:0/1907549808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39a437640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff394158010 0x7ff3940aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399435640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3941555d0 0x7ff3940a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 -- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3941555d0 msgr2=0x7ff3940a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3941555d0 0x7ff3940a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 -- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff394158010 msgr2=0x7ff3940aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff394158010 0x7ff3940aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 -- 172.21.15.26:0/1907549808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840094d0 con 0x7ff3940a6e50 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff39a437640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff394158010 0x7ff3940aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.475+0000 7ff399c36640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940ada80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c500 tx=0x7ff39000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff38a7fc640 1 -- 172.21.15.26:0/1907549808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390005220 con 0x7ff3940a6e50 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff38a7fc640 1 -- 172.21.15.26:0/1907549808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff390005380 con 0x7ff3940a6e50 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff38a7fc640 1 -- 172.21.15.26:0/1907549808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390007270 con 0x7ff3940a6e50 2023-11-28T16:56:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3941ee590 con 0x7ff3940a6e50 2023-11-28T16:56:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3941546e0 con 0x7ff3940a6e50 2023-11-28T16:56:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff394154930 con 0x7ff3940a6e50 2023-11-28T16:56:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff38a7fc640 1 -- 172.21.15.26:0/1907549808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff3900073d0 con 0x7ff3940a6e50 2023-11-28T16:56:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff38a7fc640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff3780668d0 0x7ff378068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff38a7fc640 1 -- 172.21.15.26:0/1907549808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff390083830 con 0x7ff3940a6e50 2023-11-28T16:56:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.479+0000 7ff399435640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff3780668d0 0x7ff378068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.483+0000 7ff399435640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff3780668d0 0x7ff378068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3840ae000 tx=0x7ff3840b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:21.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.483+0000 7ff38a7fc640 1 -- 172.21.15.26:0/1907549808 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff394154930 con 0x7ff3940a6e50 2023-11-28T16:56:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.675+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff394154930 con 0x7ff3940a6e50 2023-11-28T16:56:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff38a7fc640 1 -- 172.21.15.26:0/1907549808 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7ff394154930 con 0x7ff3940a6e50 2023-11-28T16:56:21.682 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:21.682 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff3780668d0 msgr2=0x7ff378068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff3780668d0 0x7ff378068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3840ae000 tx=0x7ff3840b3040 comp rx=0 tx=0).stop 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 msgr2=0x7ff3940ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940ada80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c500 tx=0x7ff39000c9c0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 shutdown_connections 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff394158010 0x7ff3940aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff3780668d0 0x7ff378068d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3941555d0 0x7ff3940a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 --2- 172.21.15.26:0/1907549808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940a6e50 0x7ff3940ada80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 >> 172.21.15.26:0/1907549808 conn(0x7ff3940c4960 msgr2=0x7ff3940c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:21.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 shutdown_connections 2023-11-28T16:56:21.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.679+0000 7ff39be9a640 1 -- 172.21.15.26:0/1907549808 wait complete. 2023-11-28T16:56:21.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.839+0000 7f2914432640 1 Processor -- start 2023-11-28T16:56:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.839+0000 7f2914432640 1 -- start start 2023-11-28T16:56:21.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f2914432640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f290c0a8470 0x7f290c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f2914432640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290c06d320 con 0x7f290c14e9d0 2023-11-28T16:56:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f2914432640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290c0721b0 con 0x7f290c070b80 2023-11-28T16:56:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f2914432640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290c0c2830 con 0x7f290c0a8470 2023-11-28T16:56:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29121ce640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f290c14e9d0 0x7f290c0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43892/0 (socket says 172.21.15.26:43892) 2023-11-28T16:56:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29121ce640 1 -- 172.21.15.26:0/3474726332 learned_addr learned my addr 172.21.15.26:0/3474726332 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29129cf640 1 --2- 172.21.15.26:0/3474726332 >> v2:172.21.15.26:3300/0 conn(0x7f290c0a8470 0x7f290c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29111cc640 1 -- 172.21.15.26:0/3474726332 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243191158 0 0) 0x7f290c06d320 con 0x7f290c14e9d0 2023-11-28T16:56:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29111cc640 1 -- 172.21.15.26:0/3474726332 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f8003530 con 0x7f290c14e9d0 2023-11-28T16:56:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29129cf640 1 -- 172.21.15.26:0/3474726332 >> v1:172.21.15.79:6789/0 conn(0x7f290c070b80 legacy=0x7f290c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29111cc640 1 -- 172.21.15.26:0/3474726332 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628141587 0 0) 0x7f290c0721b0 con 0x7f290c070b80 2023-11-28T16:56:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29129cf640 1 -- 172.21.15.26:0/3474726332 >> v1:172.21.15.26:6789/0 conn(0x7f290c14e9d0 legacy=0x7f290c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.843+0000 7f29129cf640 1 -- 172.21.15.26:0/3474726332 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c072450 con 0x7f290c0a8470 2023-11-28T16:56:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f29129cf640 1 --2- 172.21.15.26:0/3474726332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c0a8470 0x7f290c151e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2904009d90 tx=0x7f290401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93918bda22de0a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f29111cc640 1 -- 172.21.15.26:0/3474726332 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040a5890 con 0x7f290c0a8470 2023-11-28T16:56:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f29111cc640 1 -- 172.21.15.26:0/3474726332 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29040a59f0 con 0x7f290c0a8470 2023-11-28T16:56:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f29111cc640 1 -- 172.21.15.26:0/3474726332 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040a5d80 con 0x7f290c0a8470 2023-11-28T16:56:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 -- 172.21.15.26:0/3474726332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c0a8470 msgr2=0x7f290c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 --2- 172.21.15.26:0/3474726332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c0a8470 0x7f290c151e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2904009d90 tx=0x7f290401c8c0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 -- 172.21.15.26:0/3474726332 shutdown_connections 2023-11-28T16:56:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 --2- 172.21.15.26:0/3474726332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c0a8470 0x7f290c151e60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 -- 172.21.15.26:0/3474726332 >> 172.21.15.26:0/3474726332 conn(0x7f290c0c2ad0 msgr2=0x7f290c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 -- 172.21.15.26:0/3474726332 shutdown_connections 2023-11-28T16:56:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 -- 172.21.15.26:0/3474726332 wait complete. 2023-11-28T16:56:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 Processor -- start 2023-11-28T16:56:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.847+0000 7f2914432640 1 -- start start 2023-11-28T16:56:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f290c070b80 0x7f290c1f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f290c0a8470 0x7f290c1481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c14e9d0 0x7f290c1409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c1f0d20 con 0x7f290c14e9d0 2023-11-28T16:56:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c0c56b0 con 0x7f290c0a8470 2023-11-28T16:56:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c14bed0 con 0x7f290c070b80 2023-11-28T16:56:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c14e9d0 0x7f290c1409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c14e9d0 0x7f290c1409e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53076/0 (socket says 172.21.15.26:53076) 2023-11-28T16:56:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 -- 172.21.15.26:0/3308715771 learned_addr learned my addr 172.21.15.26:0/3308715771 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29119cd640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f290c0a8470 0x7f290c1481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29121ce640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f290c070b80 0x7f290c1f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 -- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f290c070b80 msgr2=0x7f290c1f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f290c070b80 0x7f290c1f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 -- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f290c0a8470 msgr2=0x7f290c1481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f290c0a8470 0x7f290c1481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 -- 172.21.15.26:0/3308715771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904009a70 con 0x7f290c14e9d0 2023-11-28T16:56:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f29129cf640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c14e9d0 0x7f290c1409e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2904009d90 tx=0x7f2904019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2902ffd640 1 -- 172.21.15.26:0/3308715771 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904003ba0 con 0x7f290c14e9d0 2023-11-28T16:56:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2902ffd640 1 -- 172.21.15.26:0/3308715771 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904003d00 con 0x7f290c14e9d0 2023-11-28T16:56:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c14c490 con 0x7f290c14e9d0 2023-11-28T16:56:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2902ffd640 1 -- 172.21.15.26:0/3308715771 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040b9860 con 0x7f290c14e9d0 2023-11-28T16:56:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290c0c5be0 con 0x7f290c14e9d0 2023-11-28T16:56:21.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290c04e890 con 0x7f290c14e9d0 2023-11-28T16:56:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.851+0000 7f2902ffd640 1 -- 172.21.15.26:0/3308715771 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f29040b99c0 con 0x7f290c14e9d0 2023-11-28T16:56:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.855+0000 7f2902ffd640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28f00668d0 0x7f28f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.855+0000 7f2902ffd640 1 -- 172.21.15.26:0/3308715771 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f290411f1f0 con 0x7f290c14e9d0 2023-11-28T16:56:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.855+0000 7f29121ce640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28f00668d0 0x7f28f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.855+0000 7f29121ce640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28f00668d0 0x7f28f0068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2908007fd0 tx=0x7f2908009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:21.859+0000 7f2902ffd640 1 -- 172.21.15.26:0/3308715771 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29040ec4d0 con 0x7f290c14e9d0 2023-11-28T16:56:21.990 INFO:tasks.ceph.mds.b.smithi079.stderr:2023-11-28T16:56:21.985+0000 7ff07850c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:56:22.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.015+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f290c0700a0 con 0x7f290c14e9d0 2023-11-28T16:56:22.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.015+0000 7f2902ffd640 1 -- 172.21.15.26:0/3308715771 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f29040a5850 con 0x7f290c14e9d0 2023-11-28T16:56:22.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:22.023 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28f00668d0 msgr2=0x7f28f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28f00668d0 0x7f28f0068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2908007fd0 tx=0x7f2908009040 comp rx=0 tx=0).stop 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c14e9d0 msgr2=0x7f290c1409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c14e9d0 0x7f290c1409e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2904009d90 tx=0x7f2904019660 comp rx=0 tx=0).stop 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 shutdown_connections 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f290c14e9d0 0x7f290c1409e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f290c0a8470 0x7f290c1481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28f00668d0 0x7f28f0068d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 --2- 172.21.15.26:0/3308715771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f290c070b80 0x7f290c1f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 >> 172.21.15.26:0/3308715771 conn(0x7f290c0c2ad0 msgr2=0x7f290c143b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 shutdown_connections 2023-11-28T16:56:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.019+0000 7f2914432640 1 -- 172.21.15.26:0/3308715771 wait complete. 2023-11-28T16:56:22.041 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T16:56:22.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:56:22.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.179+0000 7f3951009640 1 Processor -- start 2023-11-28T16:56:22.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.179+0000 7f3951009640 1 -- start start 2023-11-28T16:56:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3951009640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f394c06e7c0 0x7f394c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3951009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c1580b0 0x7f394c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3951009640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c06e280 con 0x7f394c155360 2023-11-28T16:56:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3951009640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0c2150 con 0x7f394c06e7c0 2023-11-28T16:56:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3951009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c157c60 con 0x7f394c1580b0 2023-11-28T16:56:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f394b59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c1580b0 0x7f394c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3943fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f394c06e7c0 0x7f394c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f394b59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c1580b0 0x7f394c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:43948/0 (socket says 172.21.15.26:43948) 2023-11-28T16:56:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f394b59e640 1 -- 172.21.15.26:0/2537546828 learned_addr learned my addr 172.21.15.26:0/2537546828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f394a59c640 1 -- 172.21.15.26:0/2537546828 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874175072 0 0) 0x7f394c06e280 con 0x7f394c155360 2023-11-28T16:56:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3943fff640 1 -- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c1580b0 msgr2=0x7f394c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3943fff640 1 --2- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c1580b0 0x7f394c158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3943fff640 1 -- 172.21.15.26:0/2537546828 >> v1:172.21.15.79:6789/0 conn(0x7f394c155360 legacy=0x7f394c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f3943fff640 1 -- 172.21.15.26:0/2537546828 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0c1bd0 con 0x7f394c06e7c0 2023-11-28T16:56:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.183+0000 7f394b59e640 1 --2- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c1580b0 0x7f394c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:22.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3943fff640 1 --2- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c06ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39340097c0 tx=0x7f393401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=869bd3aa265d82c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f394a59c640 1 -- 172.21.15.26:0/2537546828 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340ab600 con 0x7f394c06e7c0 2023-11-28T16:56:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f394a59c640 1 -- 172.21.15.26:0/2537546828 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340a7050 con 0x7f394c06e7c0 2023-11-28T16:56:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f394a59c640 1 -- 172.21.15.26:0/2537546828 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340ab980 con 0x7f394c06e7c0 2023-11-28T16:56:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 -- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 msgr2=0x7f394c06ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 --2- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c06ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39340097c0 tx=0x7f393401c480 comp rx=0 tx=0).stop 2023-11-28T16:56:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 -- 172.21.15.26:0/2537546828 shutdown_connections 2023-11-28T16:56:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 --2- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c1580b0 0x7f394c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 --2- 172.21.15.26:0/2537546828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c06ec40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 -- 172.21.15.26:0/2537546828 >> 172.21.15.26:0/2537546828 conn(0x7f394c0c3240 msgr2=0x7f394c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 -- 172.21.15.26:0/2537546828 shutdown_connections 2023-11-28T16:56:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 -- 172.21.15.26:0/2537546828 wait complete. 2023-11-28T16:56:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 Processor -- start 2023-11-28T16:56:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.187+0000 7f3951009640 1 -- start start 2023-11-28T16:56:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c155360 0x7f394c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f394c1580b0 0x7f394c14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0720b0 con 0x7f394c1580b0 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c070860 con 0x7f394c06e7c0 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0a6320 con 0x7f394c155360 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f394c1580b0 0x7f394c14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f394c1580b0 0x7f394c14ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53080/0 (socket says 172.21.15.26:53080) 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 -- 172.21.15.26:0/572706646 learned_addr learned my addr 172.21.15.26:0/572706646 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3943fff640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c155360 0x7f394c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394ad9d640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 -- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c155360 msgr2=0x7f394c14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c155360 0x7f394c14c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 -- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 msgr2=0x7f394c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 -- 172.21.15.26:0/572706646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944009b30 con 0x7f394c1580b0 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394ad9d640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3943fff640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c155360 0x7f394c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f394b59e640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f394c1580b0 0x7f394c14ca20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f394400efc0 tx=0x7f394400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f39437fe640 1 -- 172.21.15.26:0/572706646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944018070 con 0x7f394c1580b0 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f39437fe640 1 -- 172.21.15.26:0/572706646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394400f040 con 0x7f394c1580b0 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f39437fe640 1 -- 172.21.15.26:0/572706646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394400ce00 con 0x7f394c1580b0 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3934009420 con 0x7f394c1580b0 2023-11-28T16:56:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0a6600 con 0x7f394c1580b0 2023-11-28T16:56:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0a6790 con 0x7f394c1580b0 2023-11-28T16:56:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.191+0000 7f39437fe640 1 -- 172.21.15.26:0/572706646 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3944014480 con 0x7f394c1580b0 2023-11-28T16:56:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.195+0000 7f39437fe640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f392c0668d0 0x7f392c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.195+0000 7f39437fe640 1 -- 172.21.15.26:0/572706646 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39440847a0 con 0x7f394c1580b0 2023-11-28T16:56:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.195+0000 7f394ad9d640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f392c0668d0 0x7f392c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.195+0000 7f394ad9d640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f392c0668d0 0x7f392c068d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f393c000f70 tx=0x7f393c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.199+0000 7f39437fe640 1 -- 172.21.15.26:0/572706646 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39440519d0 con 0x7f394c1580b0 2023-11-28T16:56:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.351+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f394c06e520 con 0x7f392c0668d0 2023-11-28T16:56:22.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.363+0000 7f39437fe640 1 -- 172.21.15.26:0/572706646 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264698 (secure 0 0 0) 0x7f393c001c90 con 0x7f392c0668d0 2023-11-28T16:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:22.371 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:56:22.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f392c0668d0 msgr2=0x7f392c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f392c0668d0 0x7f392c068d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f393c000f70 tx=0x7f393c009040 comp rx=0 tx=0).stop 2023-11-28T16:56:22.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f394c1580b0 msgr2=0x7f394c14ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f394c1580b0 0x7f394c14ca20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f394400efc0 tx=0x7f394400c490 comp rx=0 tx=0).stop 2023-11-28T16:56:22.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 shutdown_connections 2023-11-28T16:56:22.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f394c1580b0 0x7f394c14ca20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f392c0668d0 0x7f392c068d90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f394c155360 0x7f394c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 --2- 172.21.15.26:0/572706646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c06e7c0 0x7f394c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 >> 172.21.15.26:0/572706646 conn(0x7f394c0c3240 msgr2=0x7f394c0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:22.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 shutdown_connections 2023-11-28T16:56:22.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.367+0000 7f3951009640 1 -- 172.21.15.26:0/572706646 wait complete. 2023-11-28T16:56:22.390 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T16:56:21.573606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231412,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743308,"statfs":{"total":773094113280,"available":772857147392,"internally_reserved":0,"allocated":2818048,"data_stored":1715036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.326866"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335727+0000","last_change":"2023-11-28T16:56:18.296651+0000","last_active":"2023-11-28T16:56:19.335727+0000","last_peered":"2023-11-28T16:56:19.335727+0000","last_clean":"2023-11-28T16:56:19.335727+0000","last_became_active":"2023-11-28T16:56:18.296364+0000","last_became_peered":"2023-11-28T16:56:18.296364+0000","last_unstale":"2023-11-28T16:56:19.335727+0000","last_undegraded":"2023-11-28T16:56:19.335727+0000","last_fullsized":"2023-11-28T16:56:19.335727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:01.071568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289822+0000","last_change":"2023-11-28T16:56:18.292206+0000","last_active":"2023-11-28T16:56:19.289822+0000","last_peered":"2023-11-28T16:56:19.289822+0000","last_clean":"2023-11-28T16:56:19.289822+0000","last_became_active":"2023-11-28T16:56:18.291849+0000","last_became_peered":"2023-11-28T16:56:18.291849+0000","last_unstale":"2023-11-28T16:56:19.289822+0000","last_undegraded":"2023-11-28T16:56:19.289822+0000","last_fullsized":"2023-11-28T16:56:19.289822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290500+0000","last_change":"2023-11-28T16:56:18.288339+0000","last_active":"2023-11-28T16:56:19.290500+0000","last_peered":"2023-11-28T16:56:19.290500+0000","last_clean":"2023-11-28T16:56:19.290500+0000","last_became_active":"2023-11-28T16:56:18.287985+0000","last_became_peered":"2023-11-28T16:56:18.287985+0000","last_unstale":"2023-11-28T16:56:19.290500+0000","last_undegraded":"2023-11-28T16:56:19.290500+0000","last_fullsized":"2023-11-28T16:56:19.290500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380850+0000","last_change":"2023-11-28T16:56:18.305269+0000","last_active":"2023-11-28T16:56:19.380850+0000","last_peered":"2023-11-28T16:56:19.380850+0000","last_clean":"2023-11-28T16:56:19.380850+0000","last_became_active":"2023-11-28T16:56:18.304177+0000","last_became_peered":"2023-11-28T16:56:18.304177+0000","last_unstale":"2023-11-28T16:56:19.380850+0000","last_undegraded":"2023-11-28T16:56:19.380850+0000","last_fullsized":"2023-11-28T16:56:19.380850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335226+0000","last_change":"2023-11-28T16:56:18.286848+0000","last_active":"2023-11-28T16:56:19.335226+0000","last_peered":"2023-11-28T16:56:19.335226+0000","last_clean":"2023-11-28T16:56:19.335226+0000","last_became_active":"2023-11-28T16:56:18.286539+0000","last_became_peered":"2023-11-28T16:56:18.286539+0000","last_unstale":"2023-11-28T16:56:19.335226+0000","last_undegraded":"2023-11-28T16:56:19.335226+0000","last_fullsized":"2023-11-28T16:56:19.335226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381105+0000","last_change":"2023-11-28T16:56:18.293363+0000","last_active":"2023-11-28T16:56:19.381105+0000","last_peered":"2023-11-28T16:56:19.381105+0000","last_clean":"2023-11-28T16:56:19.381105+0000","last_became_active":"2023-11-28T16:56:18.293105+0000","last_became_peered":"2023-11-28T16:56:18.293105+0000","last_unstale":"2023-11-28T16:56:19.381105+0000","last_undegraded":"2023-11-28T16:56:19.381105+0000","last_fullsized":"2023-11-28T16:56:19.381105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335025+0000","last_change":"2023-11-28T16:56:18.294379+0000","last_active":"2023-11-28T16:56:19.335025+0000","last_peered":"2023-11-28T16:56:19.335025+0000","last_clean":"2023-11-28T16:56:19.335025+0000","last_became_active":"2023-11-28T16:56:18.288865+0000","last_became_peered":"2023-11-28T16:56:18.288865+0000","last_unstale":"2023-11-28T16:56:19.335025+0000","last_undegraded":"2023-11-28T16:56:19.335025+0000","last_fullsized":"2023-11-28T16:56:19.335025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379632+0000","last_change":"2023-11-28T16:56:18.292313+0000","last_active":"2023-11-28T16:56:19.379632+0000","last_peered":"2023-11-28T16:56:19.379632+0000","last_clean":"2023-11-28T16:56:19.379632+0000","last_became_active":"2023-11-28T16:56:18.292008+0000","last_became_peered":"2023-11-28T16:56:18.292008+0000","last_unstale":"2023-11-28T16:56:19.379632+0000","last_undegraded":"2023-11-28T16:56:19.379632+0000","last_fullsized":"2023-11-28T16:56:19.379632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335730+0000","last_change":"2023-11-28T16:56:18.287530+0000","last_active":"2023-11-28T16:56:19.335730+0000","last_peered":"2023-11-28T16:56:19.335730+0000","last_clean":"2023-11-28T16:56:19.335730+0000","last_became_active":"2023-11-28T16:56:18.287193+0000","last_became_peered":"2023-11-28T16:56:18.287193+0000","last_unstale":"2023-11-28T16:56:19.335730+0000","last_undegraded":"2023-11-28T16:56:19.335730+0000","last_fullsized":"2023-11-28T16:56:19.335730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:48.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380554+0000","last_change":"2023-11-28T16:56:18.301134+0000","last_active":"2023-11-28T16:56:19.380554+0000","last_peered":"2023-11-28T16:56:19.380554+0000","last_clean":"2023-11-28T16:56:19.380554+0000","last_became_active":"2023-11-28T16:56:18.300869+0000","last_became_peered":"2023-11-28T16:56:18.300869+0000","last_unstale":"2023-11-28T16:56:19.380554+0000","last_undegraded":"2023-11-28T16:56:19.380554+0000","last_fullsized":"2023-11-28T16:56:19.380554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380564+0000","last_change":"2023-11-28T16:56:18.297402+0000","last_active":"2023-11-28T16:56:19.380564+0000","last_peered":"2023-11-28T16:56:19.380564+0000","last_clean":"2023-11-28T16:56:19.380564+0000","last_became_active":"2023-11-28T16:56:18.297065+0000","last_became_peered":"2023-11-28T16:56:18.297065+0000","last_unstale":"2023-11-28T16:56:19.380564+0000","last_undegraded":"2023-11-28T16:56:19.380564+0000","last_fullsized":"2023-11-28T16:56:19.380564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292538+0000","last_change":"2023-11-28T16:56:18.295149+0000","last_active":"2023-11-28T16:56:19.292538+0000","last_peered":"2023-11-28T16:56:19.292538+0000","last_clean":"2023-11-28T16:56:19.292538+0000","last_became_active":"2023-11-28T16:56:18.294748+0000","last_became_peered":"2023-11-28T16:56:18.294748+0000","last_unstale":"2023-11-28T16:56:19.292538+0000","last_undegraded":"2023-11-28T16:56:19.292538+0000","last_fullsized":"2023-11-28T16:56:19.292538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379738+0000","last_change":"2023-11-28T16:56:18.299824+0000","last_active":"2023-11-28T16:56:19.379738+0000","last_peered":"2023-11-28T16:56:19.379738+0000","last_clean":"2023-11-28T16:56:19.379738+0000","last_became_active":"2023-11-28T16:56:18.299530+0000","last_became_peered":"2023-11-28T16:56:18.299530+0000","last_unstale":"2023-11-28T16:56:19.379738+0000","last_undegraded":"2023-11-28T16:56:19.379738+0000","last_fullsized":"2023-11-28T16:56:19.379738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290067+0000","last_change":"2023-11-28T16:56:18.294327+0000","last_active":"2023-11-28T16:56:19.290067+0000","last_peered":"2023-11-28T16:56:19.290067+0000","last_clean":"2023-11-28T16:56:19.290067+0000","last_became_active":"2023-11-28T16:56:18.291271+0000","last_became_peered":"2023-11-28T16:56:18.291271+0000","last_unstale":"2023-11-28T16:56:19.290067+0000","last_undegraded":"2023-11-28T16:56:19.290067+0000","last_fullsized":"2023-11-28T16:56:19.290067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:57.105359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289240+0000","last_change":"2023-11-28T16:56:18.317151+0000","last_active":"2023-11-28T16:56:19.289240+0000","last_peered":"2023-11-28T16:56:19.289240+0000","last_clean":"2023-11-28T16:56:19.289240+0000","last_became_active":"2023-11-28T16:56:18.314732+0000","last_became_peered":"2023-11-28T16:56:18.314732+0000","last_unstale":"2023-11-28T16:56:19.289240+0000","last_undegraded":"2023-11-28T16:56:19.289240+0000","last_fullsized":"2023-11-28T16:56:19.289240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380376+0000","last_change":"2023-11-28T16:56:18.292779+0000","last_active":"2023-11-28T16:56:19.380376+0000","last_peered":"2023-11-28T16:56:19.380376+0000","last_clean":"2023-11-28T16:56:19.380376+0000","last_became_active":"2023-11-28T16:56:18.292415+0000","last_became_peered":"2023-11-28T16:56:18.292415+0000","last_unstale":"2023-11-28T16:56:19.380376+0000","last_undegraded":"2023-11-28T16:56:19.380376+0000","last_fullsized":"2023-11-28T16:56:19.380376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381358+0000","last_change":"2023-11-28T16:56:18.301370+0000","last_active":"2023-11-28T16:56:19.381358+0000","last_peered":"2023-11-28T16:56:19.381358+0000","last_clean":"2023-11-28T16:56:19.381358+0000","last_became_active":"2023-11-28T16:56:18.301075+0000","last_became_peered":"2023-11-28T16:56:18.301075+0000","last_unstale":"2023-11-28T16:56:19.381358+0000","last_undegraded":"2023-11-28T16:56:19.381358+0000","last_fullsized":"2023-11-28T16:56:19.381358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379398+0000","last_change":"2023-11-28T16:56:18.295704+0000","last_active":"2023-11-28T16:56:19.379398+0000","last_peered":"2023-11-28T16:56:19.379398+0000","last_clean":"2023-11-28T16:56:19.379398+0000","last_became_active":"2023-11-28T16:56:18.294762+0000","last_became_peered":"2023-11-28T16:56:18.294762+0000","last_unstale":"2023-11-28T16:56:19.379398+0000","last_undegraded":"2023-11-28T16:56:19.379398+0000","last_fullsized":"2023-11-28T16:56:19.379398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335491+0000","last_change":"2023-11-28T16:56:18.290479+0000","last_active":"2023-11-28T16:56:19.335491+0000","last_peered":"2023-11-28T16:56:19.335491+0000","last_clean":"2023-11-28T16:56:19.335491+0000","last_became_active":"2023-11-28T16:56:18.289982+0000","last_became_peered":"2023-11-28T16:56:18.289982+0000","last_unstale":"2023-11-28T16:56:19.335491+0000","last_undegraded":"2023-11-28T16:56:19.335491+0000","last_fullsized":"2023-11-28T16:56:19.335491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:11.202868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380969+0000","last_change":"2023-11-28T16:56:18.305161+0000","last_active":"2023-11-28T16:56:19.380969+0000","last_peered":"2023-11-28T16:56:19.380969+0000","last_clean":"2023-11-28T16:56:19.380969+0000","last_became_active":"2023-11-28T16:56:18.304931+0000","last_became_peered":"2023-11-28T16:56:18.304931+0000","last_unstale":"2023-11-28T16:56:19.380969+0000","last_undegraded":"2023-11-28T16:56:19.380969+0000","last_fullsized":"2023-11-28T16:56:19.380969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290248+0000","last_change":"2023-11-28T16:56:18.295103+0000","last_active":"2023-11-28T16:56:19.290248+0000","last_peered":"2023-11-28T16:56:19.290248+0000","last_clean":"2023-11-28T16:56:19.290248+0000","last_became_active":"2023-11-28T16:56:18.294121+0000","last_became_peered":"2023-11-28T16:56:18.294121+0000","last_unstale":"2023-11-28T16:56:19.290248+0000","last_undegraded":"2023-11-28T16:56:19.290248+0000","last_fullsized":"2023-11-28T16:56:19.290248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:01.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380774+0000","last_change":"2023-11-28T16:56:18.300601+0000","last_active":"2023-11-28T16:56:19.380774+0000","last_peered":"2023-11-28T16:56:19.380774+0000","last_clean":"2023-11-28T16:56:19.380774+0000","last_became_active":"2023-11-28T16:56:18.300316+0000","last_became_peered":"2023-11-28T16:56:18.300316+0000","last_unstale":"2023-11-28T16:56:19.380774+0000","last_undegraded":"2023-11-28T16:56:19.380774+0000","last_fullsized":"2023-11-28T16:56:19.380774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379383+0000","last_change":"2023-11-28T16:56:18.298840+0000","last_active":"2023-11-28T16:56:19.379383+0000","last_peered":"2023-11-28T16:56:19.379383+0000","last_clean":"2023-11-28T16:56:19.379383+0000","last_became_active":"2023-11-28T16:56:18.297520+0000","last_became_peered":"2023-11-28T16:56:18.297520+0000","last_unstale":"2023-11-28T16:56:19.379383+0000","last_undegraded":"2023-11-28T16:56:19.379383+0000","last_fullsized":"2023-11-28T16:56:19.379383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380406+0000","last_change":"2023-11-28T16:56:18.298922+0000","last_active":"2023-11-28T16:56:19.380406+0000","last_peered":"2023-11-28T16:56:19.380406+0000","last_clean":"2023-11-28T16:56:19.380406+0000","last_became_active":"2023-11-28T16:56:18.298405+0000","last_became_peered":"2023-11-28T16:56:18.298405+0000","last_unstale":"2023-11-28T16:56:19.380406+0000","last_undegraded":"2023-11-28T16:56:19.380406+0000","last_fullsized":"2023-11-28T16:56:19.380406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380028+0000","last_change":"2023-11-28T16:56:18.299370+0000","last_active":"2023-11-28T16:56:19.380028+0000","last_peered":"2023-11-28T16:56:19.380028+0000","last_clean":"2023-11-28T16:56:19.380028+0000","last_became_active":"2023-11-28T16:56:18.298398+0000","last_became_peered":"2023-11-28T16:56:18.298398+0000","last_unstale":"2023-11-28T16:56:19.380028+0000","last_undegraded":"2023-11-28T16:56:19.380028+0000","last_fullsized":"2023-11-28T16:56:19.380028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380776+0000","last_change":"2023-11-28T16:56:18.308925+0000","last_active":"2023-11-28T16:56:19.380776+0000","last_peered":"2023-11-28T16:56:19.380776+0000","last_clean":"2023-11-28T16:56:19.380776+0000","last_became_active":"2023-11-28T16:56:18.303301+0000","last_became_peered":"2023-11-28T16:56:18.303301+0000","last_unstale":"2023-11-28T16:56:19.380776+0000","last_undegraded":"2023-11-28T16:56:19.380776+0000","last_fullsized":"2023-11-28T16:56:19.380776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289808+0000","last_change":"2023-11-28T16:56:18.290403+0000","last_active":"2023-11-28T16:56:19.289808+0000","last_peered":"2023-11-28T16:56:19.289808+0000","last_clean":"2023-11-28T16:56:19.289808+0000","last_became_active":"2023-11-28T16:56:18.290049+0000","last_became_peered":"2023-11-28T16:56:18.290049+0000","last_unstale":"2023-11-28T16:56:19.289808+0000","last_undegraded":"2023-11-28T16:56:19.289808+0000","last_fullsized":"2023-11-28T16:56:19.289808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379926+0000","last_change":"2023-11-28T16:56:18.296771+0000","last_active":"2023-11-28T16:56:19.379926+0000","last_peered":"2023-11-28T16:56:19.379926+0000","last_clean":"2023-11-28T16:56:19.379926+0000","last_became_active":"2023-11-28T16:56:18.296481+0000","last_became_peered":"2023-11-28T16:56:18.296481+0000","last_unstale":"2023-11-28T16:56:19.379926+0000","last_undegraded":"2023-11-28T16:56:19.379926+0000","last_fullsized":"2023-11-28T16:56:19.379926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290303+0000","last_change":"2023-11-28T16:56:18.295300+0000","last_active":"2023-11-28T16:56:19.290303+0000","last_peered":"2023-11-28T16:56:19.290303+0000","last_clean":"2023-11-28T16:56:19.290303+0000","last_became_active":"2023-11-28T16:56:18.295029+0000","last_became_peered":"2023-11-28T16:56:18.295029+0000","last_unstale":"2023-11-28T16:56:19.290303+0000","last_undegraded":"2023-11-28T16:56:19.290303+0000","last_fullsized":"2023-11-28T16:56:19.290303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381291+0000","last_change":"2023-11-28T16:56:18.300254+0000","last_active":"2023-11-28T16:56:19.381291+0000","last_peered":"2023-11-28T16:56:19.381291+0000","last_clean":"2023-11-28T16:56:19.381291+0000","last_became_active":"2023-11-28T16:56:18.299932+0000","last_became_peered":"2023-11-28T16:56:18.299932+0000","last_unstale":"2023-11-28T16:56:19.381291+0000","last_undegraded":"2023-11-28T16:56:19.381291+0000","last_fullsized":"2023-11-28T16:56:19.381291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379533+0000","last_change":"2023-11-28T16:56:18.286733+0000","last_active":"2023-11-28T16:56:19.379533+0000","last_peered":"2023-11-28T16:56:19.379533+0000","last_clean":"2023-11-28T16:56:19.379533+0000","last_became_active":"2023-11-28T16:56:18.286290+0000","last_became_peered":"2023-11-28T16:56:18.286290+0000","last_unstale":"2023-11-28T16:56:19.379533+0000","last_undegraded":"2023-11-28T16:56:19.379533+0000","last_fullsized":"2023-11-28T16:56:19.379533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380201+0000","last_change":"2023-11-28T16:56:18.303664+0000","last_active":"2023-11-28T16:56:19.380201+0000","last_peered":"2023-11-28T16:56:19.380201+0000","last_clean":"2023-11-28T16:56:19.380201+0000","last_became_active":"2023-11-28T16:56:18.303227+0000","last_became_peered":"2023-11-28T16:56:18.303227+0000","last_unstale":"2023-11-28T16:56:19.380201+0000","last_undegraded":"2023-11-28T16:56:19.380201+0000","last_fullsized":"2023-11-28T16:56:19.380201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292149+0000","last_change":"2023-11-28T16:56:18.296578+0000","last_active":"2023-11-28T16:56:19.292149+0000","last_peered":"2023-11-28T16:56:19.292149+0000","last_clean":"2023-11-28T16:56:19.292149+0000","last_became_active":"2023-11-28T16:56:18.296120+0000","last_became_peered":"2023-11-28T16:56:18.296120+0000","last_unstale":"2023-11-28T16:56:19.292149+0000","last_undegraded":"2023-11-28T16:56:19.292149+0000","last_fullsized":"2023-11-28T16:56:19.292149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:58.898204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379894+0000","last_change":"2023-11-28T16:56:17.277061+0000","last_active":"2023-11-28T16:56:19.379894+0000","last_peered":"2023-11-28T16:56:19.379894+0000","last_clean":"2023-11-28T16:56:19.379894+0000","last_became_active":"2023-11-28T16:56:17.276729+0000","last_became_peered":"2023-11-28T16:56:17.276729+0000","last_unstale":"2023-11-28T16:56:19.379894+0000","last_undegraded":"2023-11-28T16:56:19.379894+0000","last_fullsized":"2023-11-28T16:56:19.379894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290375+0000","last_change":"2023-11-28T16:56:18.296888+0000","last_active":"2023-11-28T16:56:19.290375+0000","last_peered":"2023-11-28T16:56:19.290375+0000","last_clean":"2023-11-28T16:56:19.290375+0000","last_became_active":"2023-11-28T16:56:18.296583+0000","last_became_peered":"2023-11-28T16:56:18.296583+0000","last_unstale":"2023-11-28T16:56:19.290375+0000","last_undegraded":"2023-11-28T16:56:19.290375+0000","last_fullsized":"2023-11-28T16:56:19.290375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380694+0000","last_change":"2023-11-28T16:56:17.274703+0000","last_active":"2023-11-28T16:56:19.380694+0000","last_peered":"2023-11-28T16:56:19.380694+0000","last_clean":"2023-11-28T16:56:19.380694+0000","last_became_active":"2023-11-28T16:56:17.273982+0000","last_became_peered":"2023-11-28T16:56:17.273982+0000","last_unstale":"2023-11-28T16:56:19.380694+0000","last_undegraded":"2023-11-28T16:56:19.380694+0000","last_fullsized":"2023-11-28T16:56:19.380694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379497+0000","last_change":"2023-11-28T16:56:17.270991+0000","last_active":"2023-11-28T16:56:19.379497+0000","last_peered":"2023-11-28T16:56:19.379497+0000","last_clean":"2023-11-28T16:56:19.379497+0000","last_became_active":"2023-11-28T16:56:17.270655+0000","last_became_peered":"2023-11-28T16:56:17.270655+0000","last_unstale":"2023-11-28T16:56:19.379497+0000","last_undegraded":"2023-11-28T16:56:19.379497+0000","last_fullsized":"2023-11-28T16:56:19.379497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379300+0000","last_change":"2023-11-28T16:56:18.300151+0000","last_active":"2023-11-28T16:56:19.379300+0000","last_peered":"2023-11-28T16:56:19.379300+0000","last_clean":"2023-11-28T16:56:19.379300+0000","last_became_active":"2023-11-28T16:56:18.299856+0000","last_became_peered":"2023-11-28T16:56:18.299856+0000","last_unstale":"2023-11-28T16:56:19.379300+0000","last_undegraded":"2023-11-28T16:56:19.379300+0000","last_fullsized":"2023-11-28T16:56:19.379300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380514+0000","last_change":"2023-11-28T16:56:17.276089+0000","last_active":"2023-11-28T16:56:19.380514+0000","last_peered":"2023-11-28T16:56:19.380514+0000","last_clean":"2023-11-28T16:56:19.380514+0000","last_became_active":"2023-11-28T16:56:17.275737+0000","last_became_peered":"2023-11-28T16:56:17.275737+0000","last_unstale":"2023-11-28T16:56:19.380514+0000","last_undegraded":"2023-11-28T16:56:19.380514+0000","last_fullsized":"2023-11-28T16:56:19.380514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:35.781472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289119+0000","last_change":"2023-11-28T16:56:18.290460+0000","last_active":"2023-11-28T16:56:19.289119+0000","last_peered":"2023-11-28T16:56:19.289119+0000","last_clean":"2023-11-28T16:56:19.289119+0000","last_became_active":"2023-11-28T16:56:18.289279+0000","last_became_peered":"2023-11-28T16:56:18.289279+0000","last_unstale":"2023-11-28T16:56:19.289119+0000","last_undegraded":"2023-11-28T16:56:19.289119+0000","last_fullsized":"2023-11-28T16:56:19.289119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380625+0000","last_change":"2023-11-28T16:56:17.285460+0000","last_active":"2023-11-28T16:56:19.380625+0000","last_peered":"2023-11-28T16:56:19.380625+0000","last_clean":"2023-11-28T16:56:19.380625+0000","last_became_active":"2023-11-28T16:56:17.285086+0000","last_became_peered":"2023-11-28T16:56:17.285086+0000","last_unstale":"2023-11-28T16:56:19.380625+0000","last_undegraded":"2023-11-28T16:56:19.380625+0000","last_fullsized":"2023-11-28T16:56:19.380625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381297+0000","last_change":"2023-11-28T16:56:18.305936+0000","last_active":"2023-11-28T16:56:19.381297+0000","last_peered":"2023-11-28T16:56:19.381297+0000","last_clean":"2023-11-28T16:56:19.381297+0000","last_became_active":"2023-11-28T16:56:18.305605+0000","last_became_peered":"2023-11-28T16:56:18.305605+0000","last_unstale":"2023-11-28T16:56:19.381297+0000","last_undegraded":"2023-11-28T16:56:19.381297+0000","last_fullsized":"2023-11-28T16:56:19.381297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381093+0000","last_change":"2023-11-28T16:56:17.281889+0000","last_active":"2023-11-28T16:56:19.381093+0000","last_peered":"2023-11-28T16:56:19.381093+0000","last_clean":"2023-11-28T16:56:19.381093+0000","last_became_active":"2023-11-28T16:56:17.279528+0000","last_became_peered":"2023-11-28T16:56:17.279528+0000","last_unstale":"2023-11-28T16:56:19.381093+0000","last_undegraded":"2023-11-28T16:56:19.381093+0000","last_fullsized":"2023-11-28T16:56:19.381093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290576+0000","last_change":"2023-11-28T16:56:18.293159+0000","last_active":"2023-11-28T16:56:19.290576+0000","last_peered":"2023-11-28T16:56:19.290576+0000","last_clean":"2023-11-28T16:56:19.290576+0000","last_became_active":"2023-11-28T16:56:18.292829+0000","last_became_peered":"2023-11-28T16:56:18.292829+0000","last_unstale":"2023-11-28T16:56:19.290576+0000","last_undegraded":"2023-11-28T16:56:19.290576+0000","last_fullsized":"2023-11-28T16:56:19.290576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289906+0000","last_change":"2023-11-28T16:56:17.284348+0000","last_active":"2023-11-28T16:56:19.289906+0000","last_peered":"2023-11-28T16:56:19.289906+0000","last_clean":"2023-11-28T16:56:19.289906+0000","last_became_active":"2023-11-28T16:56:17.283980+0000","last_became_peered":"2023-11-28T16:56:17.283980+0000","last_unstale":"2023-11-28T16:56:19.289906+0000","last_undegraded":"2023-11-28T16:56:19.289906+0000","last_fullsized":"2023-11-28T16:56:19.289906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292612+0000","last_change":"2023-11-28T16:56:18.303791+0000","last_active":"2023-11-28T16:56:19.292612+0000","last_peered":"2023-11-28T16:56:19.292612+0000","last_clean":"2023-11-28T16:56:19.292612+0000","last_became_active":"2023-11-28T16:56:18.303124+0000","last_became_peered":"2023-11-28T16:56:18.303124+0000","last_unstale":"2023-11-28T16:56:19.292612+0000","last_undegraded":"2023-11-28T16:56:19.292612+0000","last_fullsized":"2023-11-28T16:56:19.292612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380840+0000","last_change":"2023-11-28T16:56:17.278950+0000","last_active":"2023-11-28T16:56:19.380840+0000","last_peered":"2023-11-28T16:56:19.380840+0000","last_clean":"2023-11-28T16:56:19.380840+0000","last_became_active":"2023-11-28T16:56:17.274910+0000","last_became_peered":"2023-11-28T16:56:17.274910+0000","last_unstale":"2023-11-28T16:56:19.380840+0000","last_undegraded":"2023-11-28T16:56:19.380840+0000","last_fullsized":"2023-11-28T16:56:19.380840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335299+0000","last_change":"2023-11-28T16:56:18.290296+0000","last_active":"2023-11-28T16:56:19.335299+0000","last_peered":"2023-11-28T16:56:19.335299+0000","last_clean":"2023-11-28T16:56:19.335299+0000","last_became_active":"2023-11-28T16:56:18.289615+0000","last_became_peered":"2023-11-28T16:56:18.289615+0000","last_unstale":"2023-11-28T16:56:19.335299+0000","last_undegraded":"2023-11-28T16:56:19.335299+0000","last_fullsized":"2023-11-28T16:56:19.335299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290385+0000","last_change":"2023-11-28T16:56:17.274214+0000","last_active":"2023-11-28T16:56:19.290385+0000","last_peered":"2023-11-28T16:56:19.290385+0000","last_clean":"2023-11-28T16:56:19.290385+0000","last_became_active":"2023-11-28T16:56:17.273502+0000","last_became_peered":"2023-11-28T16:56:17.273502+0000","last_unstale":"2023-11-28T16:56:19.290385+0000","last_undegraded":"2023-11-28T16:56:19.290385+0000","last_fullsized":"2023-11-28T16:56:19.290385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290196+0000","last_change":"2023-11-28T16:56:18.286223+0000","last_active":"2023-11-28T16:56:19.290196+0000","last_peered":"2023-11-28T16:56:19.290196+0000","last_clean":"2023-11-28T16:56:19.290196+0000","last_became_active":"2023-11-28T16:56:18.285913+0000","last_became_peered":"2023-11-28T16:56:18.285913+0000","last_unstale":"2023-11-28T16:56:19.290196+0000","last_undegraded":"2023-11-28T16:56:19.290196+0000","last_fullsized":"2023-11-28T16:56:19.290196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:58.506137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381200+0000","last_change":"2023-11-28T16:56:17.281382+0000","last_active":"2023-11-28T16:56:19.381200+0000","last_peered":"2023-11-28T16:56:19.381200+0000","last_clean":"2023-11-28T16:56:19.381200+0000","last_became_active":"2023-11-28T16:56:17.280978+0000","last_became_peered":"2023-11-28T16:56:17.280978+0000","last_unstale":"2023-11-28T16:56:19.381200+0000","last_undegraded":"2023-11-28T16:56:19.381200+0000","last_fullsized":"2023-11-28T16:56:19.381200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335329+0000","last_change":"2023-11-28T16:56:18.297433+0000","last_active":"2023-11-28T16:56:19.335329+0000","last_peered":"2023-11-28T16:56:19.335329+0000","last_clean":"2023-11-28T16:56:19.335329+0000","last_became_active":"2023-11-28T16:56:18.297151+0000","last_became_peered":"2023-11-28T16:56:18.297151+0000","last_unstale":"2023-11-28T16:56:19.335329+0000","last_undegraded":"2023-11-28T16:56:19.335329+0000","last_fullsized":"2023-11-28T16:56:19.335329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380199+0000","last_change":"2023-11-28T16:56:17.274113+0000","last_active":"2023-11-28T16:56:19.380199+0000","last_peered":"2023-11-28T16:56:19.380199+0000","last_clean":"2023-11-28T16:56:19.380199+0000","last_became_active":"2023-11-28T16:56:17.273829+0000","last_became_peered":"2023-11-28T16:56:17.273829+0000","last_unstale":"2023-11-28T16:56:19.380199+0000","last_undegraded":"2023-11-28T16:56:19.380199+0000","last_fullsized":"2023-11-28T16:56:19.380199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380389+0000","last_change":"2023-11-28T16:56:18.298961+0000","last_active":"2023-11-28T16:56:19.380389+0000","last_peered":"2023-11-28T16:56:19.380389+0000","last_clean":"2023-11-28T16:56:19.380389+0000","last_became_active":"2023-11-28T16:56:18.297627+0000","last_became_peered":"2023-11-28T16:56:18.297627+0000","last_unstale":"2023-11-28T16:56:19.380389+0000","last_undegraded":"2023-11-28T16:56:19.380389+0000","last_fullsized":"2023-11-28T16:56:19.380389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379011+0000","last_change":"2023-11-28T16:56:17.269852+0000","last_active":"2023-11-28T16:56:19.379011+0000","last_peered":"2023-11-28T16:56:19.379011+0000","last_clean":"2023-11-28T16:56:19.379011+0000","last_became_active":"2023-11-28T16:56:17.269433+0000","last_became_peered":"2023-11-28T16:56:17.269433+0000","last_unstale":"2023-11-28T16:56:19.379011+0000","last_undegraded":"2023-11-28T16:56:19.379011+0000","last_fullsized":"2023-11-28T16:56:19.379011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:53.668556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335123+0000","last_change":"2023-11-28T16:56:18.289171+0000","last_active":"2023-11-28T16:56:19.335123+0000","last_peered":"2023-11-28T16:56:19.335123+0000","last_clean":"2023-11-28T16:56:19.335123+0000","last_became_active":"2023-11-28T16:56:18.288412+0000","last_became_peered":"2023-11-28T16:56:18.288412+0000","last_unstale":"2023-11-28T16:56:19.335123+0000","last_undegraded":"2023-11-28T16:56:19.335123+0000","last_fullsized":"2023-11-28T16:56:19.335123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292552+0000","last_change":"2023-11-28T16:56:17.271860+0000","last_active":"2023-11-28T16:56:19.292552+0000","last_peered":"2023-11-28T16:56:19.292552+0000","last_clean":"2023-11-28T16:56:19.292552+0000","last_became_active":"2023-11-28T16:56:17.271327+0000","last_became_peered":"2023-11-28T16:56:17.271327+0000","last_unstale":"2023-11-28T16:56:19.292552+0000","last_undegraded":"2023-11-28T16:56:19.292552+0000","last_fullsized":"2023-11-28T16:56:19.292552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:37.653000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335599+0000","last_change":"2023-11-28T16:56:18.296341+0000","last_active":"2023-11-28T16:56:19.335599+0000","last_peered":"2023-11-28T16:56:19.335599+0000","last_clean":"2023-11-28T16:56:19.335599+0000","last_became_active":"2023-11-28T16:56:18.296000+0000","last_became_peered":"2023-11-28T16:56:18.296000+0000","last_unstale":"2023-11-28T16:56:19.335599+0000","last_undegraded":"2023-11-28T16:56:19.335599+0000","last_fullsized":"2023-11-28T16:56:19.335599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:12.212104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379483+0000","last_change":"2023-11-28T16:56:17.262861+0000","last_active":"2023-11-28T16:56:19.379483+0000","last_peered":"2023-11-28T16:56:19.379483+0000","last_clean":"2023-11-28T16:56:19.379483+0000","last_became_active":"2023-11-28T16:56:17.262560+0000","last_became_peered":"2023-11-28T16:56:17.262560+0000","last_unstale":"2023-11-28T16:56:19.379483+0000","last_undegraded":"2023-11-28T16:56:19.379483+0000","last_fullsized":"2023-11-28T16:56:19.379483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:30.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335816+0000","last_change":"2023-11-28T16:56:18.303867+0000","last_active":"2023-11-28T16:56:19.335816+0000","last_peered":"2023-11-28T16:56:19.335816+0000","last_clean":"2023-11-28T16:56:19.335816+0000","last_became_active":"2023-11-28T16:56:18.303566+0000","last_became_peered":"2023-11-28T16:56:18.303566+0000","last_unstale":"2023-11-28T16:56:19.335816+0000","last_undegraded":"2023-11-28T16:56:19.335816+0000","last_fullsized":"2023-11-28T16:56:19.335816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:28:53.866031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289997+0000","last_change":"2023-11-28T16:56:17.270718+0000","last_active":"2023-11-28T16:56:19.289997+0000","last_peered":"2023-11-28T16:56:19.289997+0000","last_clean":"2023-11-28T16:56:19.289997+0000","last_became_active":"2023-11-28T16:56:17.269258+0000","last_became_peered":"2023-11-28T16:56:17.269258+0000","last_unstale":"2023-11-28T16:56:19.289997+0000","last_undegraded":"2023-11-28T16:56:19.289997+0000","last_fullsized":"2023-11-28T16:56:19.289997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381133+0000","last_change":"2023-11-28T16:56:18.306623+0000","last_active":"2023-11-28T16:56:19.381133+0000","last_peered":"2023-11-28T16:56:19.381133+0000","last_clean":"2023-11-28T16:56:19.381133+0000","last_became_active":"2023-11-28T16:56:18.304538+0000","last_became_peered":"2023-11-28T16:56:18.304538+0000","last_unstale":"2023-11-28T16:56:19.381133+0000","last_undegraded":"2023-11-28T16:56:19.381133+0000","last_fullsized":"2023-11-28T16:56:19.381133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379166+0000","last_change":"2023-11-28T16:56:17.284653+0000","last_active":"2023-11-28T16:56:19.379166+0000","last_peered":"2023-11-28T16:56:19.379166+0000","last_clean":"2023-11-28T16:56:19.379166+0000","last_became_active":"2023-11-28T16:56:17.284128+0000","last_became_peered":"2023-11-28T16:56:17.284128+0000","last_unstale":"2023-11-28T16:56:19.379166+0000","last_undegraded":"2023-11-28T16:56:19.379166+0000","last_fullsized":"2023-11-28T16:56:19.379166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:57.892183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335328+0000","last_change":"2023-11-28T16:56:18.285248+0000","last_active":"2023-11-28T16:56:19.335328+0000","last_peered":"2023-11-28T16:56:19.335328+0000","last_clean":"2023-11-28T16:56:19.335328+0000","last_became_active":"2023-11-28T16:56:18.284940+0000","last_became_peered":"2023-11-28T16:56:18.284940+0000","last_unstale":"2023-11-28T16:56:19.335328+0000","last_undegraded":"2023-11-28T16:56:19.335328+0000","last_fullsized":"2023-11-28T16:56:19.335328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T16:56:18.271205+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:56:18.271205+0000","last_peered":"2023-11-28T16:56:18.271205+0000","last_clean":"2023-11-28T16:56:18.271205+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:56:18.271205+0000","last_undegraded":"2023-11-28T16:56:18.271205+0000","last_fullsized":"2023-11-28T16:56:18.271205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380719+0000","last_change":"2023-11-28T16:56:17.282961+0000","last_active":"2023-11-28T16:56:19.380719+0000","last_peered":"2023-11-28T16:56:19.380719+0000","last_clean":"2023-11-28T16:56:19.380719+0000","last_became_active":"2023-11-28T16:56:17.282701+0000","last_became_peered":"2023-11-28T16:56:17.282701+0000","last_unstale":"2023-11-28T16:56:19.380719+0000","last_undegraded":"2023-11-28T16:56:19.380719+0000","last_fullsized":"2023-11-28T16:56:19.380719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379683+0000","last_change":"2023-11-28T16:56:18.303548+0000","last_active":"2023-11-28T16:56:19.379683+0000","last_peered":"2023-11-28T16:56:19.379683+0000","last_clean":"2023-11-28T16:56:19.379683+0000","last_became_active":"2023-11-28T16:56:18.303179+0000","last_became_peered":"2023-11-28T16:56:18.303179+0000","last_unstale":"2023-11-28T16:56:19.379683+0000","last_undegraded":"2023-11-28T16:56:19.379683+0000","last_fullsized":"2023-11-28T16:56:19.379683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334952+0000","last_change":"2023-11-28T16:56:17.277497+0000","last_active":"2023-11-28T16:56:19.334952+0000","last_peered":"2023-11-28T16:56:19.334952+0000","last_clean":"2023-11-28T16:56:19.334952+0000","last_became_active":"2023-11-28T16:56:17.277234+0000","last_became_peered":"2023-11-28T16:56:17.277234+0000","last_unstale":"2023-11-28T16:56:19.334952+0000","last_undegraded":"2023-11-28T16:56:19.334952+0000","last_fullsized":"2023-11-28T16:56:19.334952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290216+0000","last_change":"2023-11-28T16:56:18.296396+0000","last_active":"2023-11-28T16:56:19.290216+0000","last_peered":"2023-11-28T16:56:19.290216+0000","last_clean":"2023-11-28T16:56:19.290216+0000","last_became_active":"2023-11-28T16:56:18.296084+0000","last_became_peered":"2023-11-28T16:56:18.296084+0000","last_unstale":"2023-11-28T16:56:19.290216+0000","last_undegraded":"2023-11-28T16:56:19.290216+0000","last_fullsized":"2023-11-28T16:56:19.290216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:59.283743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379147+0000","last_change":"2023-11-28T16:56:17.262892+0000","last_active":"2023-11-28T16:56:19.379147+0000","last_peered":"2023-11-28T16:56:19.379147+0000","last_clean":"2023-11-28T16:56:19.379147+0000","last_became_active":"2023-11-28T16:56:17.262566+0000","last_became_peered":"2023-11-28T16:56:17.262566+0000","last_unstale":"2023-11-28T16:56:19.379147+0000","last_undegraded":"2023-11-28T16:56:19.379147+0000","last_fullsized":"2023-11-28T16:56:19.379147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:47.727755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.288999+0000","last_change":"2023-11-28T16:56:18.286050+0000","last_active":"2023-11-28T16:56:19.288999+0000","last_peered":"2023-11-28T16:56:19.288999+0000","last_clean":"2023-11-28T16:56:19.288999+0000","last_became_active":"2023-11-28T16:56:18.284464+0000","last_became_peered":"2023-11-28T16:56:18.284464+0000","last_unstale":"2023-11-28T16:56:19.288999+0000","last_undegraded":"2023-11-28T16:56:19.288999+0000","last_fullsized":"2023-11-28T16:56:19.288999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381383+0000","last_change":"2023-11-28T16:56:17.281222+0000","last_active":"2023-11-28T16:56:19.381383+0000","last_peered":"2023-11-28T16:56:19.381383+0000","last_clean":"2023-11-28T16:56:19.381383+0000","last_became_active":"2023-11-28T16:56:17.280742+0000","last_became_peered":"2023-11-28T16:56:17.280742+0000","last_unstale":"2023-11-28T16:56:19.381383+0000","last_undegraded":"2023-11-28T16:56:19.381383+0000","last_fullsized":"2023-11-28T16:56:19.381383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292282+0000","last_change":"2023-11-28T16:56:18.296316+0000","last_active":"2023-11-28T16:56:19.292282+0000","last_peered":"2023-11-28T16:56:19.292282+0000","last_clean":"2023-11-28T16:56:19.292282+0000","last_became_active":"2023-11-28T16:56:18.296015+0000","last_became_peered":"2023-11-28T16:56:18.296015+0000","last_unstale":"2023-11-28T16:56:19.292282+0000","last_undegraded":"2023-11-28T16:56:19.292282+0000","last_fullsized":"2023-11-28T16:56:19.292282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:45.933550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289567+0000","last_change":"2023-11-28T16:56:17.266947+0000","last_active":"2023-11-28T16:56:19.289567+0000","last_peered":"2023-11-28T16:56:19.289567+0000","last_clean":"2023-11-28T16:56:19.289567+0000","last_became_active":"2023-11-28T16:56:17.266373+0000","last_became_peered":"2023-11-28T16:56:17.266373+0000","last_unstale":"2023-11-28T16:56:19.289567+0000","last_undegraded":"2023-11-28T16:56:19.289567+0000","last_fullsized":"2023-11-28T16:56:19.289567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381224+0000","last_change":"2023-11-28T16:56:18.293931+0000","last_active":"2023-11-28T16:56:19.381224+0000","last_peered":"2023-11-28T16:56:19.381224+0000","last_clean":"2023-11-28T16:56:19.381224+0000","last_became_active":"2023-11-28T16:56:18.293631+0000","last_became_peered":"2023-11-28T16:56:18.293631+0000","last_unstale":"2023-11-28T16:56:19.381224+0000","last_undegraded":"2023-11-28T16:56:19.381224+0000","last_fullsized":"2023-11-28T16:56:19.381224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335433+0000","last_change":"2023-11-28T16:56:17.275260+0000","last_active":"2023-11-28T16:56:19.335433+0000","last_peered":"2023-11-28T16:56:19.335433+0000","last_clean":"2023-11-28T16:56:19.335433+0000","last_became_active":"2023-11-28T16:56:17.273841+0000","last_became_peered":"2023-11-28T16:56:17.273841+0000","last_unstale":"2023-11-28T16:56:19.335433+0000","last_undegraded":"2023-11-28T16:56:19.335433+0000","last_fullsized":"2023-11-28T16:56:19.335433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:05.898052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289618+0000","last_change":"2023-11-28T16:56:18.287854+0000","last_active":"2023-11-28T16:56:19.289618+0000","last_peered":"2023-11-28T16:56:19.289618+0000","last_clean":"2023-11-28T16:56:19.289618+0000","last_became_active":"2023-11-28T16:56:18.287506+0000","last_became_peered":"2023-11-28T16:56:18.287506+0000","last_unstale":"2023-11-28T16:56:19.289618+0000","last_undegraded":"2023-11-28T16:56:19.289618+0000","last_fullsized":"2023-11-28T16:56:19.289618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289901+0000","last_change":"2023-11-28T16:56:17.274658+0000","last_active":"2023-11-28T16:56:19.289901+0000","last_peered":"2023-11-28T16:56:19.289901+0000","last_clean":"2023-11-28T16:56:19.289901+0000","last_became_active":"2023-11-28T16:56:17.274438+0000","last_became_peered":"2023-11-28T16:56:17.274438+0000","last_unstale":"2023-11-28T16:56:19.289901+0000","last_undegraded":"2023-11-28T16:56:19.289901+0000","last_fullsized":"2023-11-28T16:56:19.289901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:00.220647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380057+0000","last_change":"2023-11-28T16:56:18.281874+0000","last_active":"2023-11-28T16:56:19.380057+0000","last_peered":"2023-11-28T16:56:19.380057+0000","last_clean":"2023-11-28T16:56:19.380057+0000","last_became_active":"2023-11-28T16:56:18.281487+0000","last_became_peered":"2023-11-28T16:56:18.281487+0000","last_unstale":"2023-11-28T16:56:19.380057+0000","last_undegraded":"2023-11-28T16:56:19.380057+0000","last_fullsized":"2023-11-28T16:56:19.380057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380726+0000","last_change":"2023-11-28T16:56:17.283262+0000","last_active":"2023-11-28T16:56:19.380726+0000","last_peered":"2023-11-28T16:56:19.380726+0000","last_clean":"2023-11-28T16:56:19.380726+0000","last_became_active":"2023-11-28T16:56:17.282998+0000","last_became_peered":"2023-11-28T16:56:17.282998+0000","last_unstale":"2023-11-28T16:56:19.380726+0000","last_undegraded":"2023-11-28T16:56:19.380726+0000","last_fullsized":"2023-11-28T16:56:19.380726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290549+0000","last_change":"2023-11-28T16:56:18.287449+0000","last_active":"2023-11-28T16:56:19.290549+0000","last_peered":"2023-11-28T16:56:19.290549+0000","last_clean":"2023-11-28T16:56:19.290549+0000","last_became_active":"2023-11-28T16:56:18.287148+0000","last_became_peered":"2023-11-28T16:56:18.287148+0000","last_unstale":"2023-11-28T16:56:19.290549+0000","last_undegraded":"2023-11-28T16:56:19.290549+0000","last_fullsized":"2023-11-28T16:56:19.290549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334912+0000","last_change":"2023-11-28T16:56:17.273292+0000","last_active":"2023-11-28T16:56:19.334912+0000","last_peered":"2023-11-28T16:56:19.334912+0000","last_clean":"2023-11-28T16:56:19.334912+0000","last_became_active":"2023-11-28T16:56:17.272927+0000","last_became_peered":"2023-11-28T16:56:17.272927+0000","last_unstale":"2023-11-28T16:56:19.334912+0000","last_undegraded":"2023-11-28T16:56:19.334912+0000","last_fullsized":"2023-11-28T16:56:19.334912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292330+0000","last_change":"2023-11-28T16:56:18.293307+0000","last_active":"2023-11-28T16:56:19.292330+0000","last_peered":"2023-11-28T16:56:19.292330+0000","last_clean":"2023-11-28T16:56:19.292330+0000","last_became_active":"2023-11-28T16:56:18.290847+0000","last_became_peered":"2023-11-28T16:56:18.290847+0000","last_unstale":"2023-11-28T16:56:19.292330+0000","last_undegraded":"2023-11-28T16:56:19.292330+0000","last_fullsized":"2023-11-28T16:56:19.292330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:48.733777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289324+0000","last_change":"2023-11-28T16:56:17.274311+0000","last_active":"2023-11-28T16:56:19.289324+0000","last_peered":"2023-11-28T16:56:19.289324+0000","last_clean":"2023-11-28T16:56:19.289324+0000","last_became_active":"2023-11-28T16:56:17.273978+0000","last_became_peered":"2023-11-28T16:56:17.273978+0000","last_unstale":"2023-11-28T16:56:19.289324+0000","last_undegraded":"2023-11-28T16:56:19.289324+0000","last_fullsized":"2023-11-28T16:56:19.289324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379411+0000","last_change":"2023-11-28T16:56:18.291693+0000","last_active":"2023-11-28T16:56:19.379411+0000","last_peered":"2023-11-28T16:56:19.379411+0000","last_clean":"2023-11-28T16:56:19.379411+0000","last_became_active":"2023-11-28T16:56:18.287795+0000","last_became_peered":"2023-11-28T16:56:18.287795+0000","last_unstale":"2023-11-28T16:56:19.379411+0000","last_undegraded":"2023-11-28T16:56:19.379411+0000","last_fullsized":"2023-11-28T16:56:19.379411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289531+0000","last_change":"2023-11-28T16:56:17.273717+0000","last_active":"2023-11-28T16:56:19.289531+0000","last_peered":"2023-11-28T16:56:19.289531+0000","last_clean":"2023-11-28T16:56:19.289531+0000","last_became_active":"2023-11-28T16:56:17.271544+0000","last_became_peered":"2023-11-28T16:56:17.271544+0000","last_unstale":"2023-11-28T16:56:19.289531+0000","last_undegraded":"2023-11-28T16:56:19.289531+0000","last_fullsized":"2023-11-28T16:56:19.289531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379795+0000","last_change":"2023-11-28T16:56:18.299018+0000","last_active":"2023-11-28T16:56:19.379795+0000","last_peered":"2023-11-28T16:56:19.379795+0000","last_clean":"2023-11-28T16:56:19.379795+0000","last_became_active":"2023-11-28T16:56:18.297543+0000","last_became_peered":"2023-11-28T16:56:18.297543+0000","last_unstale":"2023-11-28T16:56:19.379795+0000","last_undegraded":"2023-11-28T16:56:19.379795+0000","last_fullsized":"2023-11-28T16:56:19.379795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335355+0000","last_change":"2023-11-28T16:56:17.277794+0000","last_active":"2023-11-28T16:56:19.335355+0000","last_peered":"2023-11-28T16:56:19.335355+0000","last_clean":"2023-11-28T16:56:19.335355+0000","last_became_active":"2023-11-28T16:56:17.277482+0000","last_became_peered":"2023-11-28T16:56:17.277482+0000","last_unstale":"2023-11-28T16:56:19.335355+0000","last_undegraded":"2023-11-28T16:56:19.335355+0000","last_fullsized":"2023-11-28T16:56:19.335355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380283+0000","last_change":"2023-11-28T16:56:18.304716+0000","last_active":"2023-11-28T16:56:19.380283+0000","last_peered":"2023-11-28T16:56:19.380283+0000","last_clean":"2023-11-28T16:56:19.380283+0000","last_became_active":"2023-11-28T16:56:18.304418+0000","last_became_peered":"2023-11-28T16:56:18.304418+0000","last_unstale":"2023-11-28T16:56:19.380283+0000","last_undegraded":"2023-11-28T16:56:19.380283+0000","last_fullsized":"2023-11-28T16:56:19.380283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381366+0000","last_change":"2023-11-28T16:56:18.311948+0000","last_active":"2023-11-28T16:56:19.381366+0000","last_peered":"2023-11-28T16:56:19.381366+0000","last_clean":"2023-11-28T16:56:19.381366+0000","last_became_active":"2023-11-28T16:56:18.311642+0000","last_became_peered":"2023-11-28T16:56:18.311642+0000","last_unstale":"2023-11-28T16:56:19.381366+0000","last_undegraded":"2023-11-28T16:56:19.381366+0000","last_fullsized":"2023-11-28T16:56:19.381366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335228+0000","last_change":"2023-11-28T16:56:17.286515+0000","last_active":"2023-11-28T16:56:19.335228+0000","last_peered":"2023-11-28T16:56:19.335228+0000","last_clean":"2023-11-28T16:56:19.335228+0000","last_became_active":"2023-11-28T16:56:17.286203+0000","last_became_peered":"2023-11-28T16:56:17.286203+0000","last_unstale":"2023-11-28T16:56:19.335228+0000","last_undegraded":"2023-11-28T16:56:19.335228+0000","last_fullsized":"2023-11-28T16:56:19.335228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381073+0000","last_change":"2023-11-28T16:56:18.311709+0000","last_active":"2023-11-28T16:56:19.381073+0000","last_peered":"2023-11-28T16:56:19.381073+0000","last_clean":"2023-11-28T16:56:19.381073+0000","last_became_active":"2023-11-28T16:56:18.307023+0000","last_became_peered":"2023-11-28T16:56:18.307023+0000","last_unstale":"2023-11-28T16:56:19.381073+0000","last_undegraded":"2023-11-28T16:56:19.381073+0000","last_fullsized":"2023-11-28T16:56:19.381073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335370+0000","last_change":"2023-11-28T16:56:17.275000+0000","last_active":"2023-11-28T16:56:19.335370+0000","last_peered":"2023-11-28T16:56:19.335370+0000","last_clean":"2023-11-28T16:56:19.335370+0000","last_became_active":"2023-11-28T16:56:17.273306+0000","last_became_peered":"2023-11-28T16:56:17.273306+0000","last_unstale":"2023-11-28T16:56:19.335370+0000","last_undegraded":"2023-11-28T16:56:19.335370+0000","last_fullsized":"2023-11-28T16:56:19.335370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:23.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290507+0000","last_change":"2023-11-28T16:56:18.293608+0000","last_active":"2023-11-28T16:56:19.290507+0000","last_peered":"2023-11-28T16:56:19.290507+0000","last_clean":"2023-11-28T16:56:19.290507+0000","last_became_active":"2023-11-28T16:56:18.293219+0000","last_became_peered":"2023-11-28T16:56:18.293219+0000","last_unstale":"2023-11-28T16:56:19.290507+0000","last_undegraded":"2023-11-28T16:56:19.290507+0000","last_fullsized":"2023-11-28T16:56:19.290507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379965+0000","last_change":"2023-11-28T16:56:17.269059+0000","last_active":"2023-11-28T16:56:19.379965+0000","last_peered":"2023-11-28T16:56:19.379965+0000","last_clean":"2023-11-28T16:56:19.379965+0000","last_became_active":"2023-11-28T16:56:17.268756+0000","last_became_peered":"2023-11-28T16:56:17.268756+0000","last_unstale":"2023-11-28T16:56:19.379965+0000","last_undegraded":"2023-11-28T16:56:19.379965+0000","last_fullsized":"2023-11-28T16:56:19.379965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379889+0000","last_change":"2023-11-28T16:56:18.297186+0000","last_active":"2023-11-28T16:56:19.379889+0000","last_peered":"2023-11-28T16:56:19.379889+0000","last_clean":"2023-11-28T16:56:19.379889+0000","last_became_active":"2023-11-28T16:56:18.295432+0000","last_became_peered":"2023-11-28T16:56:18.295432+0000","last_unstale":"2023-11-28T16:56:19.379889+0000","last_undegraded":"2023-11-28T16:56:19.379889+0000","last_fullsized":"2023-11-28T16:56:19.379889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290693+0000","last_change":"2023-11-28T16:56:17.279529+0000","last_active":"2023-11-28T16:56:19.290693+0000","last_peered":"2023-11-28T16:56:19.290693+0000","last_clean":"2023-11-28T16:56:19.290693+0000","last_became_active":"2023-11-28T16:56:17.279217+0000","last_became_peered":"2023-11-28T16:56:17.279217+0000","last_unstale":"2023-11-28T16:56:19.290693+0000","last_undegraded":"2023-11-28T16:56:19.290693+0000","last_fullsized":"2023-11-28T16:56:19.290693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:56:22.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:56:22.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.571+0000 7f055af1d640 1 Processor -- start 2023-11-28T16:56:22.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.571+0000 7f055af1d640 1 -- start start 2023-11-28T16:56:22.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.571+0000 7f055af1d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f055414e9d0 0x7f0554151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.571+0000 7f055af1d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055406d320 con 0x7f05540a8470 2023-11-28T16:56:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.571+0000 7f055af1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540721b0 con 0x7f0554070b80 2023-11-28T16:56:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.571+0000 7f055af1d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05540c2830 con 0x7f055414e9d0 2023-11-28T16:56:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f0558cb9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f055414e9d0 0x7f0554151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f05594ba640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f05540a8470 0x7f055406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43894/0 (socket says 172.21.15.26:43894) 2023-11-28T16:56:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f05594ba640 1 -- 172.21.15.26:0/3882240999 learned_addr learned my addr 172.21.15.26:0/3882240999 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f0558cb9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f055414e9d0 0x7f0554151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53086/0 (socket says 172.21.15.26:53086) 2023-11-28T16:56:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f0558cb9640 1 -- 172.21.15.26:0/3882240999 >> v1:172.21.15.79:6789/0 conn(0x7f0554070b80 legacy=0x7f05540c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f05537fe640 1 -- 172.21.15.26:0/3882240999 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728016487 0 0) 0x7f055406d320 con 0x7f05540a8470 2023-11-28T16:56:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f0558cb9640 1 -- 172.21.15.26:0/3882240999 >> v1:172.21.15.26:6789/0 conn(0x7f05540a8470 legacy=0x7f055406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f0558cb9640 1 -- 172.21.15.26:0/3882240999 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554072450 con 0x7f055414e9d0 2023-11-28T16:56:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f0558cb9640 1 --2- 172.21.15.26:0/3882240999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f0554151e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05480097c0 tx=0x7f054801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829694ff4dc7e034 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f05537fe640 1 -- 172.21.15.26:0/3882240999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480ab600 con 0x7f055414e9d0 2023-11-28T16:56:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f05537fe640 1 -- 172.21.15.26:0/3882240999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05480a7050 con 0x7f055414e9d0 2023-11-28T16:56:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.575+0000 7f05537fe640 1 -- 172.21.15.26:0/3882240999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480ab980 con 0x7f055414e9d0 2023-11-28T16:56:22.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- 172.21.15.26:0/3882240999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 msgr2=0x7f0554151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 --2- 172.21.15.26:0/3882240999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f0554151e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05480097c0 tx=0x7f054801c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- 172.21.15.26:0/3882240999 shutdown_connections 2023-11-28T16:56:22.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 --2- 172.21.15.26:0/3882240999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f0554151e60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- 172.21.15.26:0/3882240999 >> 172.21.15.26:0/3882240999 conn(0x7f05540c2ad0 msgr2=0x7f05540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:22.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- 172.21.15.26:0/3882240999 shutdown_connections 2023-11-28T16:56:22.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- 172.21.15.26:0/3882240999 wait complete. 2023-11-28T16:56:22.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 Processor -- start 2023-11-28T16:56:22.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- start start 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0554070b80 0x7f05540bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05540a8470 0x7f055414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f055414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055413af50 con 0x7f055414e9d0 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540abec0 con 0x7f05540a8470 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f055af1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055413a2d0 con 0x7f0554070b80 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f055414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f055414fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53100/0 (socket says 172.21.15.26:53100) 2023-11-28T16:56:22.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 -- 172.21.15.26:0/809498319 learned_addr learned my addr 172.21.15.26:0/809498319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:22.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f0558cb9640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0554070b80 0x7f05540bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f0553fff640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05540a8470 0x7f055414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 -- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0554070b80 msgr2=0x7f05540bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0554070b80 0x7f05540bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 -- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05540a8470 msgr2=0x7f055414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05540a8470 0x7f055414f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.579+0000 7f05594ba640 1 -- 172.21.15.26:0/809498319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009420 con 0x7f055414e9d0 2023-11-28T16:56:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f05594ba640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f055414fb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f054c001570 tx=0x7f054c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f05517fa640 1 -- 172.21.15.26:0/809498319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00a640 con 0x7f055414e9d0 2023-11-28T16:56:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f05517fa640 1 -- 172.21.15.26:0/809498319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00a7a0 con 0x7f055414e9d0 2023-11-28T16:56:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f05517fa640 1 -- 172.21.15.26:0/809498319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00ab90 con 0x7f055414e9d0 2023-11-28T16:56:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055413a5b0 con 0x7f055414e9d0 2023-11-28T16:56:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055413ab70 con 0x7f055414e9d0 2023-11-28T16:56:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0554067a40 con 0x7f055414e9d0 2023-11-28T16:56:22.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f05517fa640 1 -- 172.21.15.26:0/809498319 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f054c00acf0 con 0x7f055414e9d0 2023-11-28T16:56:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f05517fa640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05380668d0 0x7f0538068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f05517fa640 1 -- 172.21.15.26:0/809498319 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f054c083920 con 0x7f055414e9d0 2023-11-28T16:56:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.583+0000 7f0558cb9640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05380668d0 0x7f0538068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.587+0000 7f0558cb9640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05380668d0 0x7f0538068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05480ad000 tx=0x7f05480a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.587+0000 7f05517fa640 1 -- 172.21.15.26:0/809498319 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f054c050b70 con 0x7f055414e9d0 2023-11-28T16:56:22.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.747+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f055406dec0 con 0x7f05380668d0 2023-11-28T16:56:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.755+0000 7f05517fa640 1 -- 172.21.15.26:0/809498319 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264698 (secure 0 0 0) 0x7f05480ab680 con 0x7f05380668d0 2023-11-28T16:56:22.762 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:56:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05380668d0 msgr2=0x7f0538068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05380668d0 0x7f0538068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05480ad000 tx=0x7f05480a4f90 comp rx=0 tx=0).stop 2023-11-28T16:56:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 msgr2=0x7f055414fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f055414fb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f054c001570 tx=0x7f054c00cc70 comp rx=0 tx=0).stop 2023-11-28T16:56:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 shutdown_connections 2023-11-28T16:56:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055414e9d0 0x7f055414fb50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05540a8470 0x7f055414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05380668d0 0x7f0538068d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 --2- 172.21.15.26:0/809498319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0554070b80 0x7f05540bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 >> 172.21.15.26:0/809498319 conn(0x7f05540c2ad0 msgr2=0x7f05540c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 shutdown_connections 2023-11-28T16:56:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.759+0000 7f055af1d640 1 -- 172.21.15.26:0/809498319 wait complete. 2023-11-28T16:56:22.782 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T16:56:21.573606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231412,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743308,"statfs":{"total":773094113280,"available":772857147392,"internally_reserved":0,"allocated":2818048,"data_stored":1715036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.326866"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335727+0000","last_change":"2023-11-28T16:56:18.296651+0000","last_active":"2023-11-28T16:56:19.335727+0000","last_peered":"2023-11-28T16:56:19.335727+0000","last_clean":"2023-11-28T16:56:19.335727+0000","last_became_active":"2023-11-28T16:56:18.296364+0000","last_became_peered":"2023-11-28T16:56:18.296364+0000","last_unstale":"2023-11-28T16:56:19.335727+0000","last_undegraded":"2023-11-28T16:56:19.335727+0000","last_fullsized":"2023-11-28T16:56:19.335727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:01.071568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289822+0000","last_change":"2023-11-28T16:56:18.292206+0000","last_active":"2023-11-28T16:56:19.289822+0000","last_peered":"2023-11-28T16:56:19.289822+0000","last_clean":"2023-11-28T16:56:19.289822+0000","last_became_active":"2023-11-28T16:56:18.291849+0000","last_became_peered":"2023-11-28T16:56:18.291849+0000","last_unstale":"2023-11-28T16:56:19.289822+0000","last_undegraded":"2023-11-28T16:56:19.289822+0000","last_fullsized":"2023-11-28T16:56:19.289822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290500+0000","last_change":"2023-11-28T16:56:18.288339+0000","last_active":"2023-11-28T16:56:19.290500+0000","last_peered":"2023-11-28T16:56:19.290500+0000","last_clean":"2023-11-28T16:56:19.290500+0000","last_became_active":"2023-11-28T16:56:18.287985+0000","last_became_peered":"2023-11-28T16:56:18.287985+0000","last_unstale":"2023-11-28T16:56:19.290500+0000","last_undegraded":"2023-11-28T16:56:19.290500+0000","last_fullsized":"2023-11-28T16:56:19.290500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380850+0000","last_change":"2023-11-28T16:56:18.305269+0000","last_active":"2023-11-28T16:56:19.380850+0000","last_peered":"2023-11-28T16:56:19.380850+0000","last_clean":"2023-11-28T16:56:19.380850+0000","last_became_active":"2023-11-28T16:56:18.304177+0000","last_became_peered":"2023-11-28T16:56:18.304177+0000","last_unstale":"2023-11-28T16:56:19.380850+0000","last_undegraded":"2023-11-28T16:56:19.380850+0000","last_fullsized":"2023-11-28T16:56:19.380850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335226+0000","last_change":"2023-11-28T16:56:18.286848+0000","last_active":"2023-11-28T16:56:19.335226+0000","last_peered":"2023-11-28T16:56:19.335226+0000","last_clean":"2023-11-28T16:56:19.335226+0000","last_became_active":"2023-11-28T16:56:18.286539+0000","last_became_peered":"2023-11-28T16:56:18.286539+0000","last_unstale":"2023-11-28T16:56:19.335226+0000","last_undegraded":"2023-11-28T16:56:19.335226+0000","last_fullsized":"2023-11-28T16:56:19.335226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381105+0000","last_change":"2023-11-28T16:56:18.293363+0000","last_active":"2023-11-28T16:56:19.381105+0000","last_peered":"2023-11-28T16:56:19.381105+0000","last_clean":"2023-11-28T16:56:19.381105+0000","last_became_active":"2023-11-28T16:56:18.293105+0000","last_became_peered":"2023-11-28T16:56:18.293105+0000","last_unstale":"2023-11-28T16:56:19.381105+0000","last_undegraded":"2023-11-28T16:56:19.381105+0000","last_fullsized":"2023-11-28T16:56:19.381105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335025+0000","last_change":"2023-11-28T16:56:18.294379+0000","last_active":"2023-11-28T16:56:19.335025+0000","last_peered":"2023-11-28T16:56:19.335025+0000","last_clean":"2023-11-28T16:56:19.335025+0000","last_became_active":"2023-11-28T16:56:18.288865+0000","last_became_peered":"2023-11-28T16:56:18.288865+0000","last_unstale":"2023-11-28T16:56:19.335025+0000","last_undegraded":"2023-11-28T16:56:19.335025+0000","last_fullsized":"2023-11-28T16:56:19.335025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379632+0000","last_change":"2023-11-28T16:56:18.292313+0000","last_active":"2023-11-28T16:56:19.379632+0000","last_peered":"2023-11-28T16:56:19.379632+0000","last_clean":"2023-11-28T16:56:19.379632+0000","last_became_active":"2023-11-28T16:56:18.292008+0000","last_became_peered":"2023-11-28T16:56:18.292008+0000","last_unstale":"2023-11-28T16:56:19.379632+0000","last_undegraded":"2023-11-28T16:56:19.379632+0000","last_fullsized":"2023-11-28T16:56:19.379632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335730+0000","last_change":"2023-11-28T16:56:18.287530+0000","last_active":"2023-11-28T16:56:19.335730+0000","last_peered":"2023-11-28T16:56:19.335730+0000","last_clean":"2023-11-28T16:56:19.335730+0000","last_became_active":"2023-11-28T16:56:18.287193+0000","last_became_peered":"2023-11-28T16:56:18.287193+0000","last_unstale":"2023-11-28T16:56:19.335730+0000","last_undegraded":"2023-11-28T16:56:19.335730+0000","last_fullsized":"2023-11-28T16:56:19.335730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:48.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380554+0000","last_change":"2023-11-28T16:56:18.301134+0000","last_active":"2023-11-28T16:56:19.380554+0000","last_peered":"2023-11-28T16:56:19.380554+0000","last_clean":"2023-11-28T16:56:19.380554+0000","last_became_active":"2023-11-28T16:56:18.300869+0000","last_became_peered":"2023-11-28T16:56:18.300869+0000","last_unstale":"2023-11-28T16:56:19.380554+0000","last_undegraded":"2023-11-28T16:56:19.380554+0000","last_fullsized":"2023-11-28T16:56:19.380554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380564+0000","last_change":"2023-11-28T16:56:18.297402+0000","last_active":"2023-11-28T16:56:19.380564+0000","last_peered":"2023-11-28T16:56:19.380564+0000","last_clean":"2023-11-28T16:56:19.380564+0000","last_became_active":"2023-11-28T16:56:18.297065+0000","last_became_peered":"2023-11-28T16:56:18.297065+0000","last_unstale":"2023-11-28T16:56:19.380564+0000","last_undegraded":"2023-11-28T16:56:19.380564+0000","last_fullsized":"2023-11-28T16:56:19.380564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292538+0000","last_change":"2023-11-28T16:56:18.295149+0000","last_active":"2023-11-28T16:56:19.292538+0000","last_peered":"2023-11-28T16:56:19.292538+0000","last_clean":"2023-11-28T16:56:19.292538+0000","last_became_active":"2023-11-28T16:56:18.294748+0000","last_became_peered":"2023-11-28T16:56:18.294748+0000","last_unstale":"2023-11-28T16:56:19.292538+0000","last_undegraded":"2023-11-28T16:56:19.292538+0000","last_fullsized":"2023-11-28T16:56:19.292538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379738+0000","last_change":"2023-11-28T16:56:18.299824+0000","last_active":"2023-11-28T16:56:19.379738+0000","last_peered":"2023-11-28T16:56:19.379738+0000","last_clean":"2023-11-28T16:56:19.379738+0000","last_became_active":"2023-11-28T16:56:18.299530+0000","last_became_peered":"2023-11-28T16:56:18.299530+0000","last_unstale":"2023-11-28T16:56:19.379738+0000","last_undegraded":"2023-11-28T16:56:19.379738+0000","last_fullsized":"2023-11-28T16:56:19.379738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290067+0000","last_change":"2023-11-28T16:56:18.294327+0000","last_active":"2023-11-28T16:56:19.290067+0000","last_peered":"2023-11-28T16:56:19.290067+0000","last_clean":"2023-11-28T16:56:19.290067+0000","last_became_active":"2023-11-28T16:56:18.291271+0000","last_became_peered":"2023-11-28T16:56:18.291271+0000","last_unstale":"2023-11-28T16:56:19.290067+0000","last_undegraded":"2023-11-28T16:56:19.290067+0000","last_fullsized":"2023-11-28T16:56:19.290067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:57.105359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289240+0000","last_change":"2023-11-28T16:56:18.317151+0000","last_active":"2023-11-28T16:56:19.289240+0000","last_peered":"2023-11-28T16:56:19.289240+0000","last_clean":"2023-11-28T16:56:19.289240+0000","last_became_active":"2023-11-28T16:56:18.314732+0000","last_became_peered":"2023-11-28T16:56:18.314732+0000","last_unstale":"2023-11-28T16:56:19.289240+0000","last_undegraded":"2023-11-28T16:56:19.289240+0000","last_fullsized":"2023-11-28T16:56:19.289240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380376+0000","last_change":"2023-11-28T16:56:18.292779+0000","last_active":"2023-11-28T16:56:19.380376+0000","last_peered":"2023-11-28T16:56:19.380376+0000","last_clean":"2023-11-28T16:56:19.380376+0000","last_became_active":"2023-11-28T16:56:18.292415+0000","last_became_peered":"2023-11-28T16:56:18.292415+0000","last_unstale":"2023-11-28T16:56:19.380376+0000","last_undegraded":"2023-11-28T16:56:19.380376+0000","last_fullsized":"2023-11-28T16:56:19.380376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381358+0000","last_change":"2023-11-28T16:56:18.301370+0000","last_active":"2023-11-28T16:56:19.381358+0000","last_peered":"2023-11-28T16:56:19.381358+0000","last_clean":"2023-11-28T16:56:19.381358+0000","last_became_active":"2023-11-28T16:56:18.301075+0000","last_became_peered":"2023-11-28T16:56:18.301075+0000","last_unstale":"2023-11-28T16:56:19.381358+0000","last_undegraded":"2023-11-28T16:56:19.381358+0000","last_fullsized":"2023-11-28T16:56:19.381358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379398+0000","last_change":"2023-11-28T16:56:18.295704+0000","last_active":"2023-11-28T16:56:19.379398+0000","last_peered":"2023-11-28T16:56:19.379398+0000","last_clean":"2023-11-28T16:56:19.379398+0000","last_became_active":"2023-11-28T16:56:18.294762+0000","last_became_peered":"2023-11-28T16:56:18.294762+0000","last_unstale":"2023-11-28T16:56:19.379398+0000","last_undegraded":"2023-11-28T16:56:19.379398+0000","last_fullsized":"2023-11-28T16:56:19.379398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335491+0000","last_change":"2023-11-28T16:56:18.290479+0000","last_active":"2023-11-28T16:56:19.335491+0000","last_peered":"2023-11-28T16:56:19.335491+0000","last_clean":"2023-11-28T16:56:19.335491+0000","last_became_active":"2023-11-28T16:56:18.289982+0000","last_became_peered":"2023-11-28T16:56:18.289982+0000","last_unstale":"2023-11-28T16:56:19.335491+0000","last_undegraded":"2023-11-28T16:56:19.335491+0000","last_fullsized":"2023-11-28T16:56:19.335491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:11.202868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380969+0000","last_change":"2023-11-28T16:56:18.305161+0000","last_active":"2023-11-28T16:56:19.380969+0000","last_peered":"2023-11-28T16:56:19.380969+0000","last_clean":"2023-11-28T16:56:19.380969+0000","last_became_active":"2023-11-28T16:56:18.304931+0000","last_became_peered":"2023-11-28T16:56:18.304931+0000","last_unstale":"2023-11-28T16:56:19.380969+0000","last_undegraded":"2023-11-28T16:56:19.380969+0000","last_fullsized":"2023-11-28T16:56:19.380969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290248+0000","last_change":"2023-11-28T16:56:18.295103+0000","last_active":"2023-11-28T16:56:19.290248+0000","last_peered":"2023-11-28T16:56:19.290248+0000","last_clean":"2023-11-28T16:56:19.290248+0000","last_became_active":"2023-11-28T16:56:18.294121+0000","last_became_peered":"2023-11-28T16:56:18.294121+0000","last_unstale":"2023-11-28T16:56:19.290248+0000","last_undegraded":"2023-11-28T16:56:19.290248+0000","last_fullsized":"2023-11-28T16:56:19.290248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:01.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380774+0000","last_change":"2023-11-28T16:56:18.300601+0000","last_active":"2023-11-28T16:56:19.380774+0000","last_peered":"2023-11-28T16:56:19.380774+0000","last_clean":"2023-11-28T16:56:19.380774+0000","last_became_active":"2023-11-28T16:56:18.300316+0000","last_became_peered":"2023-11-28T16:56:18.300316+0000","last_unstale":"2023-11-28T16:56:19.380774+0000","last_undegraded":"2023-11-28T16:56:19.380774+0000","last_fullsized":"2023-11-28T16:56:19.380774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379383+0000","last_change":"2023-11-28T16:56:18.298840+0000","last_active":"2023-11-28T16:56:19.379383+0000","last_peered":"2023-11-28T16:56:19.379383+0000","last_clean":"2023-11-28T16:56:19.379383+0000","last_became_active":"2023-11-28T16:56:18.297520+0000","last_became_peered":"2023-11-28T16:56:18.297520+0000","last_unstale":"2023-11-28T16:56:19.379383+0000","last_undegraded":"2023-11-28T16:56:19.379383+0000","last_fullsized":"2023-11-28T16:56:19.379383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380406+0000","last_change":"2023-11-28T16:56:18.298922+0000","last_active":"2023-11-28T16:56:19.380406+0000","last_peered":"2023-11-28T16:56:19.380406+0000","last_clean":"2023-11-28T16:56:19.380406+0000","last_became_active":"2023-11-28T16:56:18.298405+0000","last_became_peered":"2023-11-28T16:56:18.298405+0000","last_unstale":"2023-11-28T16:56:19.380406+0000","last_undegraded":"2023-11-28T16:56:19.380406+0000","last_fullsized":"2023-11-28T16:56:19.380406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380028+0000","last_change":"2023-11-28T16:56:18.299370+0000","last_active":"2023-11-28T16:56:19.380028+0000","last_peered":"2023-11-28T16:56:19.380028+0000","last_clean":"2023-11-28T16:56:19.380028+0000","last_became_active":"2023-11-28T16:56:18.298398+0000","last_became_peered":"2023-11-28T16:56:18.298398+0000","last_unstale":"2023-11-28T16:56:19.380028+0000","last_undegraded":"2023-11-28T16:56:19.380028+0000","last_fullsized":"2023-11-28T16:56:19.380028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380776+0000","last_change":"2023-11-28T16:56:18.308925+0000","last_active":"2023-11-28T16:56:19.380776+0000","last_peered":"2023-11-28T16:56:19.380776+0000","last_clean":"2023-11-28T16:56:19.380776+0000","last_became_active":"2023-11-28T16:56:18.303301+0000","last_became_peered":"2023-11-28T16:56:18.303301+0000","last_unstale":"2023-11-28T16:56:19.380776+0000","last_undegraded":"2023-11-28T16:56:19.380776+0000","last_fullsized":"2023-11-28T16:56:19.380776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289808+0000","last_change":"2023-11-28T16:56:18.290403+0000","last_active":"2023-11-28T16:56:19.289808+0000","last_peered":"2023-11-28T16:56:19.289808+0000","last_clean":"2023-11-28T16:56:19.289808+0000","last_became_active":"2023-11-28T16:56:18.290049+0000","last_became_peered":"2023-11-28T16:56:18.290049+0000","last_unstale":"2023-11-28T16:56:19.289808+0000","last_undegraded":"2023-11-28T16:56:19.289808+0000","last_fullsized":"2023-11-28T16:56:19.289808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379926+0000","last_change":"2023-11-28T16:56:18.296771+0000","last_active":"2023-11-28T16:56:19.379926+0000","last_peered":"2023-11-28T16:56:19.379926+0000","last_clean":"2023-11-28T16:56:19.379926+0000","last_became_active":"2023-11-28T16:56:18.296481+0000","last_became_peered":"2023-11-28T16:56:18.296481+0000","last_unstale":"2023-11-28T16:56:19.379926+0000","last_undegraded":"2023-11-28T16:56:19.379926+0000","last_fullsized":"2023-11-28T16:56:19.379926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290303+0000","last_change":"2023-11-28T16:56:18.295300+0000","last_active":"2023-11-28T16:56:19.290303+0000","last_peered":"2023-11-28T16:56:19.290303+0000","last_clean":"2023-11-28T16:56:19.290303+0000","last_became_active":"2023-11-28T16:56:18.295029+0000","last_became_peered":"2023-11-28T16:56:18.295029+0000","last_unstale":"2023-11-28T16:56:19.290303+0000","last_undegraded":"2023-11-28T16:56:19.290303+0000","last_fullsized":"2023-11-28T16:56:19.290303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381291+0000","last_change":"2023-11-28T16:56:18.300254+0000","last_active":"2023-11-28T16:56:19.381291+0000","last_peered":"2023-11-28T16:56:19.381291+0000","last_clean":"2023-11-28T16:56:19.381291+0000","last_became_active":"2023-11-28T16:56:18.299932+0000","last_became_peered":"2023-11-28T16:56:18.299932+0000","last_unstale":"2023-11-28T16:56:19.381291+0000","last_undegraded":"2023-11-28T16:56:19.381291+0000","last_fullsized":"2023-11-28T16:56:19.381291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379533+0000","last_change":"2023-11-28T16:56:18.286733+0000","last_active":"2023-11-28T16:56:19.379533+0000","last_peered":"2023-11-28T16:56:19.379533+0000","last_clean":"2023-11-28T16:56:19.379533+0000","last_became_active":"2023-11-28T16:56:18.286290+0000","last_became_peered":"2023-11-28T16:56:18.286290+0000","last_unstale":"2023-11-28T16:56:19.379533+0000","last_undegraded":"2023-11-28T16:56:19.379533+0000","last_fullsized":"2023-11-28T16:56:19.379533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380201+0000","last_change":"2023-11-28T16:56:18.303664+0000","last_active":"2023-11-28T16:56:19.380201+0000","last_peered":"2023-11-28T16:56:19.380201+0000","last_clean":"2023-11-28T16:56:19.380201+0000","last_became_active":"2023-11-28T16:56:18.303227+0000","last_became_peered":"2023-11-28T16:56:18.303227+0000","last_unstale":"2023-11-28T16:56:19.380201+0000","last_undegraded":"2023-11-28T16:56:19.380201+0000","last_fullsized":"2023-11-28T16:56:19.380201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292149+0000","last_change":"2023-11-28T16:56:18.296578+0000","last_active":"2023-11-28T16:56:19.292149+0000","last_peered":"2023-11-28T16:56:19.292149+0000","last_clean":"2023-11-28T16:56:19.292149+0000","last_became_active":"2023-11-28T16:56:18.296120+0000","last_became_peered":"2023-11-28T16:56:18.296120+0000","last_unstale":"2023-11-28T16:56:19.292149+0000","last_undegraded":"2023-11-28T16:56:19.292149+0000","last_fullsized":"2023-11-28T16:56:19.292149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:58.898204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379894+0000","last_change":"2023-11-28T16:56:17.277061+0000","last_active":"2023-11-28T16:56:19.379894+0000","last_peered":"2023-11-28T16:56:19.379894+0000","last_clean":"2023-11-28T16:56:19.379894+0000","last_became_active":"2023-11-28T16:56:17.276729+0000","last_became_peered":"2023-11-28T16:56:17.276729+0000","last_unstale":"2023-11-28T16:56:19.379894+0000","last_undegraded":"2023-11-28T16:56:19.379894+0000","last_fullsized":"2023-11-28T16:56:19.379894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290375+0000","last_change":"2023-11-28T16:56:18.296888+0000","last_active":"2023-11-28T16:56:19.290375+0000","last_peered":"2023-11-28T16:56:19.290375+0000","last_clean":"2023-11-28T16:56:19.290375+0000","last_became_active":"2023-11-28T16:56:18.296583+0000","last_became_peered":"2023-11-28T16:56:18.296583+0000","last_unstale":"2023-11-28T16:56:19.290375+0000","last_undegraded":"2023-11-28T16:56:19.290375+0000","last_fullsized":"2023-11-28T16:56:19.290375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380694+0000","last_change":"2023-11-28T16:56:17.274703+0000","last_active":"2023-11-28T16:56:19.380694+0000","last_peered":"2023-11-28T16:56:19.380694+0000","last_clean":"2023-11-28T16:56:19.380694+0000","last_became_active":"2023-11-28T16:56:17.273982+0000","last_became_peered":"2023-11-28T16:56:17.273982+0000","last_unstale":"2023-11-28T16:56:19.380694+0000","last_undegraded":"2023-11-28T16:56:19.380694+0000","last_fullsized":"2023-11-28T16:56:19.380694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379497+0000","last_change":"2023-11-28T16:56:17.270991+0000","last_active":"2023-11-28T16:56:19.379497+0000","last_peered":"2023-11-28T16:56:19.379497+0000","last_clean":"2023-11-28T16:56:19.379497+0000","last_became_active":"2023-11-28T16:56:17.270655+0000","last_became_peered":"2023-11-28T16:56:17.270655+0000","last_unstale":"2023-11-28T16:56:19.379497+0000","last_undegraded":"2023-11-28T16:56:19.379497+0000","last_fullsized":"2023-11-28T16:56:19.379497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379300+0000","last_change":"2023-11-28T16:56:18.300151+0000","last_active":"2023-11-28T16:56:19.379300+0000","last_peered":"2023-11-28T16:56:19.379300+0000","last_clean":"2023-11-28T16:56:19.379300+0000","last_became_active":"2023-11-28T16:56:18.299856+0000","last_became_peered":"2023-11-28T16:56:18.299856+0000","last_unstale":"2023-11-28T16:56:19.379300+0000","last_undegraded":"2023-11-28T16:56:19.379300+0000","last_fullsized":"2023-11-28T16:56:19.379300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380514+0000","last_change":"2023-11-28T16:56:17.276089+0000","last_active":"2023-11-28T16:56:19.380514+0000","last_peered":"2023-11-28T16:56:19.380514+0000","last_clean":"2023-11-28T16:56:19.380514+0000","last_became_active":"2023-11-28T16:56:17.275737+0000","last_became_peered":"2023-11-28T16:56:17.275737+0000","last_unstale":"2023-11-28T16:56:19.380514+0000","last_undegraded":"2023-11-28T16:56:19.380514+0000","last_fullsized":"2023-11-28T16:56:19.380514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:35.781472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289119+0000","last_change":"2023-11-28T16:56:18.290460+0000","last_active":"2023-11-28T16:56:19.289119+0000","last_peered":"2023-11-28T16:56:19.289119+0000","last_clean":"2023-11-28T16:56:19.289119+0000","last_became_active":"2023-11-28T16:56:18.289279+0000","last_became_peered":"2023-11-28T16:56:18.289279+0000","last_unstale":"2023-11-28T16:56:19.289119+0000","last_undegraded":"2023-11-28T16:56:19.289119+0000","last_fullsized":"2023-11-28T16:56:19.289119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380625+0000","last_change":"2023-11-28T16:56:17.285460+0000","last_active":"2023-11-28T16:56:19.380625+0000","last_peered":"2023-11-28T16:56:19.380625+0000","last_clean":"2023-11-28T16:56:19.380625+0000","last_became_active":"2023-11-28T16:56:17.285086+0000","last_became_peered":"2023-11-28T16:56:17.285086+0000","last_unstale":"2023-11-28T16:56:19.380625+0000","last_undegraded":"2023-11-28T16:56:19.380625+0000","last_fullsized":"2023-11-28T16:56:19.380625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381297+0000","last_change":"2023-11-28T16:56:18.305936+0000","last_active":"2023-11-28T16:56:19.381297+0000","last_peered":"2023-11-28T16:56:19.381297+0000","last_clean":"2023-11-28T16:56:19.381297+0000","last_became_active":"2023-11-28T16:56:18.305605+0000","last_became_peered":"2023-11-28T16:56:18.305605+0000","last_unstale":"2023-11-28T16:56:19.381297+0000","last_undegraded":"2023-11-28T16:56:19.381297+0000","last_fullsized":"2023-11-28T16:56:19.381297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381093+0000","last_change":"2023-11-28T16:56:17.281889+0000","last_active":"2023-11-28T16:56:19.381093+0000","last_peered":"2023-11-28T16:56:19.381093+0000","last_clean":"2023-11-28T16:56:19.381093+0000","last_became_active":"2023-11-28T16:56:17.279528+0000","last_became_peered":"2023-11-28T16:56:17.279528+0000","last_unstale":"2023-11-28T16:56:19.381093+0000","last_undegraded":"2023-11-28T16:56:19.381093+0000","last_fullsized":"2023-11-28T16:56:19.381093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290576+0000","last_change":"2023-11-28T16:56:18.293159+0000","last_active":"2023-11-28T16:56:19.290576+0000","last_peered":"2023-11-28T16:56:19.290576+0000","last_clean":"2023-11-28T16:56:19.290576+0000","last_became_active":"2023-11-28T16:56:18.292829+0000","last_became_peered":"2023-11-28T16:56:18.292829+0000","last_unstale":"2023-11-28T16:56:19.290576+0000","last_undegraded":"2023-11-28T16:56:19.290576+0000","last_fullsized":"2023-11-28T16:56:19.290576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289906+0000","last_change":"2023-11-28T16:56:17.284348+0000","last_active":"2023-11-28T16:56:19.289906+0000","last_peered":"2023-11-28T16:56:19.289906+0000","last_clean":"2023-11-28T16:56:19.289906+0000","last_became_active":"2023-11-28T16:56:17.283980+0000","last_became_peered":"2023-11-28T16:56:17.283980+0000","last_unstale":"2023-11-28T16:56:19.289906+0000","last_undegraded":"2023-11-28T16:56:19.289906+0000","last_fullsized":"2023-11-28T16:56:19.289906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292612+0000","last_change":"2023-11-28T16:56:18.303791+0000","last_active":"2023-11-28T16:56:19.292612+0000","last_peered":"2023-11-28T16:56:19.292612+0000","last_clean":"2023-11-28T16:56:19.292612+0000","last_became_active":"2023-11-28T16:56:18.303124+0000","last_became_peered":"2023-11-28T16:56:18.303124+0000","last_unstale":"2023-11-28T16:56:19.292612+0000","last_undegraded":"2023-11-28T16:56:19.292612+0000","last_fullsized":"2023-11-28T16:56:19.292612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380840+0000","last_change":"2023-11-28T16:56:17.278950+0000","last_active":"2023-11-28T16:56:19.380840+0000","last_peered":"2023-11-28T16:56:19.380840+0000","last_clean":"2023-11-28T16:56:19.380840+0000","last_became_active":"2023-11-28T16:56:17.274910+0000","last_became_peered":"2023-11-28T16:56:17.274910+0000","last_unstale":"2023-11-28T16:56:19.380840+0000","last_undegraded":"2023-11-28T16:56:19.380840+0000","last_fullsized":"2023-11-28T16:56:19.380840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335299+0000","last_change":"2023-11-28T16:56:18.290296+0000","last_active":"2023-11-28T16:56:19.335299+0000","last_peered":"2023-11-28T16:56:19.335299+0000","last_clean":"2023-11-28T16:56:19.335299+0000","last_became_active":"2023-11-28T16:56:18.289615+0000","last_became_peered":"2023-11-28T16:56:18.289615+0000","last_unstale":"2023-11-28T16:56:19.335299+0000","last_undegraded":"2023-11-28T16:56:19.335299+0000","last_fullsized":"2023-11-28T16:56:19.335299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290385+0000","last_change":"2023-11-28T16:56:17.274214+0000","last_active":"2023-11-28T16:56:19.290385+0000","last_peered":"2023-11-28T16:56:19.290385+0000","last_clean":"2023-11-28T16:56:19.290385+0000","last_became_active":"2023-11-28T16:56:17.273502+0000","last_became_peered":"2023-11-28T16:56:17.273502+0000","last_unstale":"2023-11-28T16:56:19.290385+0000","last_undegraded":"2023-11-28T16:56:19.290385+0000","last_fullsized":"2023-11-28T16:56:19.290385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290196+0000","last_change":"2023-11-28T16:56:18.286223+0000","last_active":"2023-11-28T16:56:19.290196+0000","last_peered":"2023-11-28T16:56:19.290196+0000","last_clean":"2023-11-28T16:56:19.290196+0000","last_became_active":"2023-11-28T16:56:18.285913+0000","last_became_peered":"2023-11-28T16:56:18.285913+0000","last_unstale":"2023-11-28T16:56:19.290196+0000","last_undegraded":"2023-11-28T16:56:19.290196+0000","last_fullsized":"2023-11-28T16:56:19.290196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:58.506137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381200+0000","last_change":"2023-11-28T16:56:17.281382+0000","last_active":"2023-11-28T16:56:19.381200+0000","last_peered":"2023-11-28T16:56:19.381200+0000","last_clean":"2023-11-28T16:56:19.381200+0000","last_became_active":"2023-11-28T16:56:17.280978+0000","last_became_peered":"2023-11-28T16:56:17.280978+0000","last_unstale":"2023-11-28T16:56:19.381200+0000","last_undegraded":"2023-11-28T16:56:19.381200+0000","last_fullsized":"2023-11-28T16:56:19.381200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335329+0000","last_change":"2023-11-28T16:56:18.297433+0000","last_active":"2023-11-28T16:56:19.335329+0000","last_peered":"2023-11-28T16:56:19.335329+0000","last_clean":"2023-11-28T16:56:19.335329+0000","last_became_active":"2023-11-28T16:56:18.297151+0000","last_became_peered":"2023-11-28T16:56:18.297151+0000","last_unstale":"2023-11-28T16:56:19.335329+0000","last_undegraded":"2023-11-28T16:56:19.335329+0000","last_fullsized":"2023-11-28T16:56:19.335329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380199+0000","last_change":"2023-11-28T16:56:17.274113+0000","last_active":"2023-11-28T16:56:19.380199+0000","last_peered":"2023-11-28T16:56:19.380199+0000","last_clean":"2023-11-28T16:56:19.380199+0000","last_became_active":"2023-11-28T16:56:17.273829+0000","last_became_peered":"2023-11-28T16:56:17.273829+0000","last_unstale":"2023-11-28T16:56:19.380199+0000","last_undegraded":"2023-11-28T16:56:19.380199+0000","last_fullsized":"2023-11-28T16:56:19.380199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380389+0000","last_change":"2023-11-28T16:56:18.298961+0000","last_active":"2023-11-28T16:56:19.380389+0000","last_peered":"2023-11-28T16:56:19.380389+0000","last_clean":"2023-11-28T16:56:19.380389+0000","last_became_active":"2023-11-28T16:56:18.297627+0000","last_became_peered":"2023-11-28T16:56:18.297627+0000","last_unstale":"2023-11-28T16:56:19.380389+0000","last_undegraded":"2023-11-28T16:56:19.380389+0000","last_fullsized":"2023-11-28T16:56:19.380389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379011+0000","last_change":"2023-11-28T16:56:17.269852+0000","last_active":"2023-11-28T16:56:19.379011+0000","last_peered":"2023-11-28T16:56:19.379011+0000","last_clean":"2023-11-28T16:56:19.379011+0000","last_became_active":"2023-11-28T16:56:17.269433+0000","last_became_peered":"2023-11-28T16:56:17.269433+0000","last_unstale":"2023-11-28T16:56:19.379011+0000","last_undegraded":"2023-11-28T16:56:19.379011+0000","last_fullsized":"2023-11-28T16:56:19.379011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:53.668556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335123+0000","last_change":"2023-11-28T16:56:18.289171+0000","last_active":"2023-11-28T16:56:19.335123+0000","last_peered":"2023-11-28T16:56:19.335123+0000","last_clean":"2023-11-28T16:56:19.335123+0000","last_became_active":"2023-11-28T16:56:18.288412+0000","last_became_peered":"2023-11-28T16:56:18.288412+0000","last_unstale":"2023-11-28T16:56:19.335123+0000","last_undegraded":"2023-11-28T16:56:19.335123+0000","last_fullsized":"2023-11-28T16:56:19.335123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292552+0000","last_change":"2023-11-28T16:56:17.271860+0000","last_active":"2023-11-28T16:56:19.292552+0000","last_peered":"2023-11-28T16:56:19.292552+0000","last_clean":"2023-11-28T16:56:19.292552+0000","last_became_active":"2023-11-28T16:56:17.271327+0000","last_became_peered":"2023-11-28T16:56:17.271327+0000","last_unstale":"2023-11-28T16:56:19.292552+0000","last_undegraded":"2023-11-28T16:56:19.292552+0000","last_fullsized":"2023-11-28T16:56:19.292552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:37.653000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335599+0000","last_change":"2023-11-28T16:56:18.296341+0000","last_active":"2023-11-28T16:56:19.335599+0000","last_peered":"2023-11-28T16:56:19.335599+0000","last_clean":"2023-11-28T16:56:19.335599+0000","last_became_active":"2023-11-28T16:56:18.296000+0000","last_became_peered":"2023-11-28T16:56:18.296000+0000","last_unstale":"2023-11-28T16:56:19.335599+0000","last_undegraded":"2023-11-28T16:56:19.335599+0000","last_fullsized":"2023-11-28T16:56:19.335599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:12.212104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379483+0000","last_change":"2023-11-28T16:56:17.262861+0000","last_active":"2023-11-28T16:56:19.379483+0000","last_peered":"2023-11-28T16:56:19.379483+0000","last_clean":"2023-11-28T16:56:19.379483+0000","last_became_active":"2023-11-28T16:56:17.262560+0000","last_became_peered":"2023-11-28T16:56:17.262560+0000","last_unstale":"2023-11-28T16:56:19.379483+0000","last_undegraded":"2023-11-28T16:56:19.379483+0000","last_fullsized":"2023-11-28T16:56:19.379483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:30.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335816+0000","last_change":"2023-11-28T16:56:18.303867+0000","last_active":"2023-11-28T16:56:19.335816+0000","last_peered":"2023-11-28T16:56:19.335816+0000","last_clean":"2023-11-28T16:56:19.335816+0000","last_became_active":"2023-11-28T16:56:18.303566+0000","last_became_peered":"2023-11-28T16:56:18.303566+0000","last_unstale":"2023-11-28T16:56:19.335816+0000","last_undegraded":"2023-11-28T16:56:19.335816+0000","last_fullsized":"2023-11-28T16:56:19.335816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:28:53.866031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289997+0000","last_change":"2023-11-28T16:56:17.270718+0000","last_active":"2023-11-28T16:56:19.289997+0000","last_peered":"2023-11-28T16:56:19.289997+0000","last_clean":"2023-11-28T16:56:19.289997+0000","last_became_active":"2023-11-28T16:56:17.269258+0000","last_became_peered":"2023-11-28T16:56:17.269258+0000","last_unstale":"2023-11-28T16:56:19.289997+0000","last_undegraded":"2023-11-28T16:56:19.289997+0000","last_fullsized":"2023-11-28T16:56:19.289997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381133+0000","last_change":"2023-11-28T16:56:18.306623+0000","last_active":"2023-11-28T16:56:19.381133+0000","last_peered":"2023-11-28T16:56:19.381133+0000","last_clean":"2023-11-28T16:56:19.381133+0000","last_became_active":"2023-11-28T16:56:18.304538+0000","last_became_peered":"2023-11-28T16:56:18.304538+0000","last_unstale":"2023-11-28T16:56:19.381133+0000","last_undegraded":"2023-11-28T16:56:19.381133+0000","last_fullsized":"2023-11-28T16:56:19.381133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379166+0000","last_change":"2023-11-28T16:56:17.284653+0000","last_active":"2023-11-28T16:56:19.379166+0000","last_peered":"2023-11-28T16:56:19.379166+0000","last_clean":"2023-11-28T16:56:19.379166+0000","last_became_active":"2023-11-28T16:56:17.284128+0000","last_became_peered":"2023-11-28T16:56:17.284128+0000","last_unstale":"2023-11-28T16:56:19.379166+0000","last_undegraded":"2023-11-28T16:56:19.379166+0000","last_fullsized":"2023-11-28T16:56:19.379166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:57.892183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335328+0000","last_change":"2023-11-28T16:56:18.285248+0000","last_active":"2023-11-28T16:56:19.335328+0000","last_peered":"2023-11-28T16:56:19.335328+0000","last_clean":"2023-11-28T16:56:19.335328+0000","last_became_active":"2023-11-28T16:56:18.284940+0000","last_became_peered":"2023-11-28T16:56:18.284940+0000","last_unstale":"2023-11-28T16:56:19.335328+0000","last_undegraded":"2023-11-28T16:56:19.335328+0000","last_fullsized":"2023-11-28T16:56:19.335328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T16:56:18.271205+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:56:18.271205+0000","last_peered":"2023-11-28T16:56:18.271205+0000","last_clean":"2023-11-28T16:56:18.271205+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:56:18.271205+0000","last_undegraded":"2023-11-28T16:56:18.271205+0000","last_fullsized":"2023-11-28T16:56:18.271205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380719+0000","last_change":"2023-11-28T16:56:17.282961+0000","last_active":"2023-11-28T16:56:19.380719+0000","last_peered":"2023-11-28T16:56:19.380719+0000","last_clean":"2023-11-28T16:56:19.380719+0000","last_became_active":"2023-11-28T16:56:17.282701+0000","last_became_peered":"2023-11-28T16:56:17.282701+0000","last_unstale":"2023-11-28T16:56:19.380719+0000","last_undegraded":"2023-11-28T16:56:19.380719+0000","last_fullsized":"2023-11-28T16:56:19.380719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379683+0000","last_change":"2023-11-28T16:56:18.303548+0000","last_active":"2023-11-28T16:56:19.379683+0000","last_peered":"2023-11-28T16:56:19.379683+0000","last_clean":"2023-11-28T16:56:19.379683+0000","last_became_active":"2023-11-28T16:56:18.303179+0000","last_became_peered":"2023-11-28T16:56:18.303179+0000","last_unstale":"2023-11-28T16:56:19.379683+0000","last_undegraded":"2023-11-28T16:56:19.379683+0000","last_fullsized":"2023-11-28T16:56:19.379683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334952+0000","last_change":"2023-11-28T16:56:17.277497+0000","last_active":"2023-11-28T16:56:19.334952+0000","last_peered":"2023-11-28T16:56:19.334952+0000","last_clean":"2023-11-28T16:56:19.334952+0000","last_became_active":"2023-11-28T16:56:17.277234+0000","last_became_peered":"2023-11-28T16:56:17.277234+0000","last_unstale":"2023-11-28T16:56:19.334952+0000","last_undegraded":"2023-11-28T16:56:19.334952+0000","last_fullsized":"2023-11-28T16:56:19.334952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290216+0000","last_change":"2023-11-28T16:56:18.296396+0000","last_active":"2023-11-28T16:56:19.290216+0000","last_peered":"2023-11-28T16:56:19.290216+0000","last_clean":"2023-11-28T16:56:19.290216+0000","last_became_active":"2023-11-28T16:56:18.296084+0000","last_became_peered":"2023-11-28T16:56:18.296084+0000","last_unstale":"2023-11-28T16:56:19.290216+0000","last_undegraded":"2023-11-28T16:56:19.290216+0000","last_fullsized":"2023-11-28T16:56:19.290216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:59.283743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379147+0000","last_change":"2023-11-28T16:56:17.262892+0000","last_active":"2023-11-28T16:56:19.379147+0000","last_peered":"2023-11-28T16:56:19.379147+0000","last_clean":"2023-11-28T16:56:19.379147+0000","last_became_active":"2023-11-28T16:56:17.262566+0000","last_became_peered":"2023-11-28T16:56:17.262566+0000","last_unstale":"2023-11-28T16:56:19.379147+0000","last_undegraded":"2023-11-28T16:56:19.379147+0000","last_fullsized":"2023-11-28T16:56:19.379147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:47.727755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.288999+0000","last_change":"2023-11-28T16:56:18.286050+0000","last_active":"2023-11-28T16:56:19.288999+0000","last_peered":"2023-11-28T16:56:19.288999+0000","last_clean":"2023-11-28T16:56:19.288999+0000","last_became_active":"2023-11-28T16:56:18.284464+0000","last_became_peered":"2023-11-28T16:56:18.284464+0000","last_unstale":"2023-11-28T16:56:19.288999+0000","last_undegraded":"2023-11-28T16:56:19.288999+0000","last_fullsized":"2023-11-28T16:56:19.288999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381383+0000","last_change":"2023-11-28T16:56:17.281222+0000","last_active":"2023-11-28T16:56:19.381383+0000","last_peered":"2023-11-28T16:56:19.381383+0000","last_clean":"2023-11-28T16:56:19.381383+0000","last_became_active":"2023-11-28T16:56:17.280742+0000","last_became_peered":"2023-11-28T16:56:17.280742+0000","last_unstale":"2023-11-28T16:56:19.381383+0000","last_undegraded":"2023-11-28T16:56:19.381383+0000","last_fullsized":"2023-11-28T16:56:19.381383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292282+0000","last_change":"2023-11-28T16:56:18.296316+0000","last_active":"2023-11-28T16:56:19.292282+0000","last_peered":"2023-11-28T16:56:19.292282+0000","last_clean":"2023-11-28T16:56:19.292282+0000","last_became_active":"2023-11-28T16:56:18.296015+0000","last_became_peered":"2023-11-28T16:56:18.296015+0000","last_unstale":"2023-11-28T16:56:19.292282+0000","last_undegraded":"2023-11-28T16:56:19.292282+0000","last_fullsized":"2023-11-28T16:56:19.292282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:45.933550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289567+0000","last_change":"2023-11-28T16:56:17.266947+0000","last_active":"2023-11-28T16:56:19.289567+0000","last_peered":"2023-11-28T16:56:19.289567+0000","last_clean":"2023-11-28T16:56:19.289567+0000","last_became_active":"2023-11-28T16:56:17.266373+0000","last_became_peered":"2023-11-28T16:56:17.266373+0000","last_unstale":"2023-11-28T16:56:19.289567+0000","last_undegraded":"2023-11-28T16:56:19.289567+0000","last_fullsized":"2023-11-28T16:56:19.289567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381224+0000","last_change":"2023-11-28T16:56:18.293931+0000","last_active":"2023-11-28T16:56:19.381224+0000","last_peered":"2023-11-28T16:56:19.381224+0000","last_clean":"2023-11-28T16:56:19.381224+0000","last_became_active":"2023-11-28T16:56:18.293631+0000","last_became_peered":"2023-11-28T16:56:18.293631+0000","last_unstale":"2023-11-28T16:56:19.381224+0000","last_undegraded":"2023-11-28T16:56:19.381224+0000","last_fullsized":"2023-11-28T16:56:19.381224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335433+0000","last_change":"2023-11-28T16:56:17.275260+0000","last_active":"2023-11-28T16:56:19.335433+0000","last_peered":"2023-11-28T16:56:19.335433+0000","last_clean":"2023-11-28T16:56:19.335433+0000","last_became_active":"2023-11-28T16:56:17.273841+0000","last_became_peered":"2023-11-28T16:56:17.273841+0000","last_unstale":"2023-11-28T16:56:19.335433+0000","last_undegraded":"2023-11-28T16:56:19.335433+0000","last_fullsized":"2023-11-28T16:56:19.335433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:05.898052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289618+0000","last_change":"2023-11-28T16:56:18.287854+0000","last_active":"2023-11-28T16:56:19.289618+0000","last_peered":"2023-11-28T16:56:19.289618+0000","last_clean":"2023-11-28T16:56:19.289618+0000","last_became_active":"2023-11-28T16:56:18.287506+0000","last_became_peered":"2023-11-28T16:56:18.287506+0000","last_unstale":"2023-11-28T16:56:19.289618+0000","last_undegraded":"2023-11-28T16:56:19.289618+0000","last_fullsized":"2023-11-28T16:56:19.289618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289901+0000","last_change":"2023-11-28T16:56:17.274658+0000","last_active":"2023-11-28T16:56:19.289901+0000","last_peered":"2023-11-28T16:56:19.289901+0000","last_clean":"2023-11-28T16:56:19.289901+0000","last_became_active":"2023-11-28T16:56:17.274438+0000","last_became_peered":"2023-11-28T16:56:17.274438+0000","last_unstale":"2023-11-28T16:56:19.289901+0000","last_undegraded":"2023-11-28T16:56:19.289901+0000","last_fullsized":"2023-11-28T16:56:19.289901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:00.220647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380057+0000","last_change":"2023-11-28T16:56:18.281874+0000","last_active":"2023-11-28T16:56:19.380057+0000","last_peered":"2023-11-28T16:56:19.380057+0000","last_clean":"2023-11-28T16:56:19.380057+0000","last_became_active":"2023-11-28T16:56:18.281487+0000","last_became_peered":"2023-11-28T16:56:18.281487+0000","last_unstale":"2023-11-28T16:56:19.380057+0000","last_undegraded":"2023-11-28T16:56:19.380057+0000","last_fullsized":"2023-11-28T16:56:19.380057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380726+0000","last_change":"2023-11-28T16:56:17.283262+0000","last_active":"2023-11-28T16:56:19.380726+0000","last_peered":"2023-11-28T16:56:19.380726+0000","last_clean":"2023-11-28T16:56:19.380726+0000","last_became_active":"2023-11-28T16:56:17.282998+0000","last_became_peered":"2023-11-28T16:56:17.282998+0000","last_unstale":"2023-11-28T16:56:19.380726+0000","last_undegraded":"2023-11-28T16:56:19.380726+0000","last_fullsized":"2023-11-28T16:56:19.380726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290549+0000","last_change":"2023-11-28T16:56:18.287449+0000","last_active":"2023-11-28T16:56:19.290549+0000","last_peered":"2023-11-28T16:56:19.290549+0000","last_clean":"2023-11-28T16:56:19.290549+0000","last_became_active":"2023-11-28T16:56:18.287148+0000","last_became_peered":"2023-11-28T16:56:18.287148+0000","last_unstale":"2023-11-28T16:56:19.290549+0000","last_undegraded":"2023-11-28T16:56:19.290549+0000","last_fullsized":"2023-11-28T16:56:19.290549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334912+0000","last_change":"2023-11-28T16:56:17.273292+0000","last_active":"2023-11-28T16:56:19.334912+0000","last_peered":"2023-11-28T16:56:19.334912+0000","last_clean":"2023-11-28T16:56:19.334912+0000","last_became_active":"2023-11-28T16:56:17.272927+0000","last_became_peered":"2023-11-28T16:56:17.272927+0000","last_unstale":"2023-11-28T16:56:19.334912+0000","last_undegraded":"2023-11-28T16:56:19.334912+0000","last_fullsized":"2023-11-28T16:56:19.334912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292330+0000","last_change":"2023-11-28T16:56:18.293307+0000","last_active":"2023-11-28T16:56:19.292330+0000","last_peered":"2023-11-28T16:56:19.292330+0000","last_clean":"2023-11-28T16:56:19.292330+0000","last_became_active":"2023-11-28T16:56:18.290847+0000","last_became_peered":"2023-11-28T16:56:18.290847+0000","last_unstale":"2023-11-28T16:56:19.292330+0000","last_undegraded":"2023-11-28T16:56:19.292330+0000","last_fullsized":"2023-11-28T16:56:19.292330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:48.733777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289324+0000","last_change":"2023-11-28T16:56:17.274311+0000","last_active":"2023-11-28T16:56:19.289324+0000","last_peered":"2023-11-28T16:56:19.289324+0000","last_clean":"2023-11-28T16:56:19.289324+0000","last_became_active":"2023-11-28T16:56:17.273978+0000","last_became_peered":"2023-11-28T16:56:17.273978+0000","last_unstale":"2023-11-28T16:56:19.289324+0000","last_undegraded":"2023-11-28T16:56:19.289324+0000","last_fullsized":"2023-11-28T16:56:19.289324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379411+0000","last_change":"2023-11-28T16:56:18.291693+0000","last_active":"2023-11-28T16:56:19.379411+0000","last_peered":"2023-11-28T16:56:19.379411+0000","last_clean":"2023-11-28T16:56:19.379411+0000","last_became_active":"2023-11-28T16:56:18.287795+0000","last_became_peered":"2023-11-28T16:56:18.287795+0000","last_unstale":"2023-11-28T16:56:19.379411+0000","last_undegraded":"2023-11-28T16:56:19.379411+0000","last_fullsized":"2023-11-28T16:56:19.379411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289531+0000","last_change":"2023-11-28T16:56:17.273717+0000","last_active":"2023-11-28T16:56:19.289531+0000","last_peered":"2023-11-28T16:56:19.289531+0000","last_clean":"2023-11-28T16:56:19.289531+0000","last_became_active":"2023-11-28T16:56:17.271544+0000","last_became_peered":"2023-11-28T16:56:17.271544+0000","last_unstale":"2023-11-28T16:56:19.289531+0000","last_undegraded":"2023-11-28T16:56:19.289531+0000","last_fullsized":"2023-11-28T16:56:19.289531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379795+0000","last_change":"2023-11-28T16:56:18.299018+0000","last_active":"2023-11-28T16:56:19.379795+0000","last_peered":"2023-11-28T16:56:19.379795+0000","last_clean":"2023-11-28T16:56:19.379795+0000","last_became_active":"2023-11-28T16:56:18.297543+0000","last_became_peered":"2023-11-28T16:56:18.297543+0000","last_unstale":"2023-11-28T16:56:19.379795+0000","last_undegraded":"2023-11-28T16:56:19.379795+0000","last_fullsized":"2023-11-28T16:56:19.379795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335355+0000","last_change":"2023-11-28T16:56:17.277794+0000","last_active":"2023-11-28T16:56:19.335355+0000","last_peered":"2023-11-28T16:56:19.335355+0000","last_clean":"2023-11-28T16:56:19.335355+0000","last_became_active":"2023-11-28T16:56:17.277482+0000","last_became_peered":"2023-11-28T16:56:17.277482+0000","last_unstale":"2023-11-28T16:56:19.335355+0000","last_undegraded":"2023-11-28T16:56:19.335355+0000","last_fullsized":"2023-11-28T16:56:19.335355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380283+0000","last_change":"2023-11-28T16:56:18.304716+0000","last_active":"2023-11-28T16:56:19.380283+0000","last_peered":"2023-11-28T16:56:19.380283+0000","last_clean":"2023-11-28T16:56:19.380283+0000","last_became_active":"2023-11-28T16:56:18.304418+0000","last_became_peered":"2023-11-28T16:56:18.304418+0000","last_unstale":"2023-11-28T16:56:19.380283+0000","last_undegraded":"2023-11-28T16:56:19.380283+0000","last_fullsized":"2023-11-28T16:56:19.380283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381366+0000","last_change":"2023-11-28T16:56:18.311948+0000","last_active":"2023-11-28T16:56:19.381366+0000","last_peered":"2023-11-28T16:56:19.381366+0000","last_clean":"2023-11-28T16:56:19.381366+0000","last_became_active":"2023-11-28T16:56:18.311642+0000","last_became_peered":"2023-11-28T16:56:18.311642+0000","last_unstale":"2023-11-28T16:56:19.381366+0000","last_undegraded":"2023-11-28T16:56:19.381366+0000","last_fullsized":"2023-11-28T16:56:19.381366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335228+0000","last_change":"2023-11-28T16:56:17.286515+0000","last_active":"2023-11-28T16:56:19.335228+0000","last_peered":"2023-11-28T16:56:19.335228+0000","last_clean":"2023-11-28T16:56:19.335228+0000","last_became_active":"2023-11-28T16:56:17.286203+0000","last_became_peered":"2023-11-28T16:56:17.286203+0000","last_unstale":"2023-11-28T16:56:19.335228+0000","last_undegraded":"2023-11-28T16:56:19.335228+0000","last_fullsized":"2023-11-28T16:56:19.335228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381073+0000","last_change":"2023-11-28T16:56:18.311709+0000","last_active":"2023-11-28T16:56:19.381073+0000","last_peered":"2023-11-28T16:56:19.381073+0000","last_clean":"2023-11-28T16:56:19.381073+0000","last_became_active":"2023-11-28T16:56:18.307023+0000","last_became_peered":"2023-11-28T16:56:18.307023+0000","last_unstale":"2023-11-28T16:56:19.381073+0000","last_undegraded":"2023-11-28T16:56:19.381073+0000","last_fullsized":"2023-11-28T16:56:19.381073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335370+0000","last_change":"2023-11-28T16:56:17.275000+0000","last_active":"2023-11-28T16:56:19.335370+0000","last_peered":"2023-11-28T16:56:19.335370+0000","last_clean":"2023-11-28T16:56:19.335370+0000","last_became_active":"2023-11-28T16:56:17.273306+0000","last_became_peered":"2023-11-28T16:56:17.273306+0000","last_unstale":"2023-11-28T16:56:19.335370+0000","last_undegraded":"2023-11-28T16:56:19.335370+0000","last_fullsized":"2023-11-28T16:56:19.335370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:23.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290507+0000","last_change":"2023-11-28T16:56:18.293608+0000","last_active":"2023-11-28T16:56:19.290507+0000","last_peered":"2023-11-28T16:56:19.290507+0000","last_clean":"2023-11-28T16:56:19.290507+0000","last_became_active":"2023-11-28T16:56:18.293219+0000","last_became_peered":"2023-11-28T16:56:18.293219+0000","last_unstale":"2023-11-28T16:56:19.290507+0000","last_undegraded":"2023-11-28T16:56:19.290507+0000","last_fullsized":"2023-11-28T16:56:19.290507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379965+0000","last_change":"2023-11-28T16:56:17.269059+0000","last_active":"2023-11-28T16:56:19.379965+0000","last_peered":"2023-11-28T16:56:19.379965+0000","last_clean":"2023-11-28T16:56:19.379965+0000","last_became_active":"2023-11-28T16:56:17.268756+0000","last_became_peered":"2023-11-28T16:56:17.268756+0000","last_unstale":"2023-11-28T16:56:19.379965+0000","last_undegraded":"2023-11-28T16:56:19.379965+0000","last_fullsized":"2023-11-28T16:56:19.379965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379889+0000","last_change":"2023-11-28T16:56:18.297186+0000","last_active":"2023-11-28T16:56:19.379889+0000","last_peered":"2023-11-28T16:56:19.379889+0000","last_clean":"2023-11-28T16:56:19.379889+0000","last_became_active":"2023-11-28T16:56:18.295432+0000","last_became_peered":"2023-11-28T16:56:18.295432+0000","last_unstale":"2023-11-28T16:56:19.379889+0000","last_undegraded":"2023-11-28T16:56:19.379889+0000","last_fullsized":"2023-11-28T16:56:19.379889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290693+0000","last_change":"2023-11-28T16:56:17.279529+0000","last_active":"2023-11-28T16:56:19.290693+0000","last_peered":"2023-11-28T16:56:19.290693+0000","last_clean":"2023-11-28T16:56:19.290693+0000","last_became_active":"2023-11-28T16:56:17.279217+0000","last_became_peered":"2023-11-28T16:56:17.279217+0000","last_unstale":"2023-11-28T16:56:19.290693+0000","last_undegraded":"2023-11-28T16:56:19.290693+0000","last_fullsized":"2023-11-28T16:56:19.290693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:56:22.788 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T16:56:22.789 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T16:56:22.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T16:56:22.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T16:56:22.790 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T16:56:22.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.967+0000 7fd99b101640 1 Processor -- start 2023-11-28T16:56:22.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.967+0000 7fd99b101640 1 -- start start 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd99b101640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd99406e7c0 0x7fd99406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd99b101640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9941580b0 0x7fd994158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd99b101640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99406e280 con 0x7fd994155360 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd99b101640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940c2150 con 0x7fd99406e7c0 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd99b101640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd994157c60 con 0x7fd9941580b0 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd99406e7c0 0x7fd99406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd99406e7c0 0x7fd99406ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53110/0 (socket says 172.21.15.26:53110) 2023-11-28T16:56:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 -- 172.21.15.26:0/3125027630 learned_addr learned my addr 172.21.15.26:0/3125027630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:22.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 -- 172.21.15.26:0/3125027630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9941580b0 msgr2=0x7fd994158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:22.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd99969e640 1 --2- 172.21.15.26:0/3125027630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9941580b0 0x7fd994158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 --2- 172.21.15.26:0/3125027630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9941580b0 0x7fd994158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 -- 172.21.15.26:0/3125027630 >> v1:172.21.15.79:6789/0 conn(0x7fd994155360 legacy=0x7fd99406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:22.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 -- 172.21.15.26:0/3125027630 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940c1bd0 con 0x7fd99406e7c0 2023-11-28T16:56:22.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd99969e640 1 --2- 172.21.15.26:0/3125027630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9941580b0 0x7fd994158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:22.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.971+0000 7fd993fff640 1 --2- 172.21.15.26:0/3125027630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99406e7c0 0x7fd99406ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd980009870 tx=0x7fd98001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be8bf21cb161485 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd9937fe640 1 -- 172.21.15.26:0/3125027630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800ac410 con 0x7fd99406e7c0 2023-11-28T16:56:22.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd9937fe640 1 -- 172.21.15.26:0/3125027630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9800ac570 con 0x7fd99406e7c0 2023-11-28T16:56:22.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd9937fe640 1 -- 172.21.15.26:0/3125027630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800ac900 con 0x7fd99406e7c0 2023-11-28T16:56:22.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- 172.21.15.26:0/3125027630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99406e7c0 msgr2=0x7fd99406ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 --2- 172.21.15.26:0/3125027630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99406e7c0 0x7fd99406ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd980009870 tx=0x7fd98001c500 comp rx=0 tx=0).stop 2023-11-28T16:56:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- 172.21.15.26:0/3125027630 shutdown_connections 2023-11-28T16:56:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 --2- 172.21.15.26:0/3125027630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9941580b0 0x7fd994158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 --2- 172.21.15.26:0/3125027630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99406e7c0 0x7fd99406ec40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- 172.21.15.26:0/3125027630 >> 172.21.15.26:0/3125027630 conn(0x7fd9940c3240 msgr2=0x7fd9940c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- 172.21.15.26:0/3125027630 shutdown_connections 2023-11-28T16:56:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- 172.21.15.26:0/3125027630 wait complete. 2023-11-28T16:56:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 Processor -- start 2023-11-28T16:56:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- start start 2023-11-28T16:56:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd99406e7c0 0x7fd99414a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd994155360 0x7fd994071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9941580b0 0x7fd9940a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9941edbb0 con 0x7fd994155360 2023-11-28T16:56:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd994152c20 con 0x7fd9941580b0 2023-11-28T16:56:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99b101640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99414ac80 con 0x7fd99406e7c0 2023-11-28T16:56:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd993fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd994155360 0x7fd994071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd993fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd994155360 0x7fd994071e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53124/0 (socket says 172.21.15.26:53124) 2023-11-28T16:56:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd993fff640 1 -- 172.21.15.26:0/4081187999 learned_addr learned my addr 172.21.15.26:0/4081187999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd998e9d640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd99406e7c0 0x7fd99414a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.975+0000 7fd99969e640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9941580b0 0x7fd9940a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd993fff640 1 -- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd99406e7c0 msgr2=0x7fd99414a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd993fff640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd99406e7c0 0x7fd99414a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd993fff640 1 -- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9941580b0 msgr2=0x7fd9940a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd993fff640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9941580b0 0x7fd9940a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd993fff640 1 -- 172.21.15.26:0/4081187999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800094d0 con 0x7fd994155360 2023-11-28T16:56:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd993fff640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd994155360 0x7fd994071e90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9800af040 tx=0x7fd9800192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd9917fa640 1 -- 172.21.15.26:0/4081187999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800b5630 con 0x7fd994155360 2023-11-28T16:56:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd9917fa640 1 -- 172.21.15.26:0/4081187999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9800b5790 con 0x7fd994155360 2023-11-28T16:56:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd9917fa640 1 -- 172.21.15.26:0/4081187999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800b5b00 con 0x7fd994155360 2023-11-28T16:56:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9941ecc70 con 0x7fd994155360 2023-11-28T16:56:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9941ecf30 con 0x7fd994155360 2023-11-28T16:56:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd994073d20 con 0x7fd994155360 2023-11-28T16:56:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd9917fa640 1 -- 172.21.15.26:0/4081187999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd9800b3070 con 0x7fd994155360 2023-11-28T16:56:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd9917fa640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd9780668d0 0x7fd978068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.979+0000 7fd9917fa640 1 -- 172.21.15.26:0/4081187999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd98011ec30 con 0x7fd994155360 2023-11-28T16:56:22.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.983+0000 7fd998e9d640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd9780668d0 0x7fd978068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:22.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.983+0000 7fd998e9d640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd9780668d0 0x7fd978068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd99414d4a0 tx=0x7fd988009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:22.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:22.983+0000 7fd9917fa640 1 -- 172.21.15.26:0/4081187999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9800ebe90 con 0x7fd994155360 2023-11-28T16:56:23.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.179+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd99404e890 con 0x7fd994155360 2023-11-28T16:56:23.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.183+0000 7fd9917fa640 1 -- 172.21.15.26:0/4081187999 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164960 (secure 0 0 0) 0x7fd9800b1090 con 0x7fd994155360 2023-11-28T16:56:23.189 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.183+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd9780668d0 msgr2=0x7fd978068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.183+0000 7fd99b101640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd9780668d0 0x7fd978068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd99414d4a0 tx=0x7fd988009060 comp rx=0 tx=0).stop 2023-11-28T16:56:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd994155360 msgr2=0x7fd994071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd994155360 0x7fd994071e90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9800af040 tx=0x7fd9800192a0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 shutdown_connections 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9941580b0 0x7fd9940a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd994155360 0x7fd994071e90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd9780668d0 0x7fd978068d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 --2- 172.21.15.26:0/4081187999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd99406e7c0 0x7fd99414a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 >> 172.21.15.26:0/4081187999 conn(0x7fd9940c3240 msgr2=0x7fd9940c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 shutdown_connections 2023-11-28T16:56:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.187+0000 7fd99b101640 1 -- 172.21.15.26:0/4081187999 wait complete. 2023-11-28T16:56:23.209 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":7430110},{"type":"v1","addr":"172.21.15.79:6833","nonce":7430110}]},"active_addr":"172.21.15.79:6833/7430110","active_change":"2023-11-28T16:55:57.556364+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3461552355}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":273002907}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3030723581}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1810753607}]}]} 2023-11-28T16:56:23.212 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T16:56:23.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T16:56:23.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:23.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.351+0000 7f47d3832640 1 Processor -- start 2023-11-28T16:56:23.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.351+0000 7f47d3832640 1 -- start start 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d3832640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47cc14fcc0 0x7f47cc156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d3832640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc0c19e0 0x7f47cc0c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d3832640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0ab580 con 0x7f47cc06d980 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d3832640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0aa340 con 0x7f47cc14fcc0 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d3832640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc152fe0 con 0x7f47cc0c19e0 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47cc14fcc0 0x7f47cc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47cc14fcc0 0x7f47cc156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53138/0 (socket says 172.21.15.26:53138) 2023-11-28T16:56:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 -- 172.21.15.26:0/730170826 learned_addr learned my addr 172.21.15.26:0/730170826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d1dcf640 1 --2- 172.21.15.26:0/730170826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc0c19e0 0x7f47cc0c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 -- 172.21.15.26:0/730170826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc0c19e0 msgr2=0x7f47cc0c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 --2- 172.21.15.26:0/730170826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc0c19e0 0x7f47cc0c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 -- 172.21.15.26:0/730170826 >> v1:172.21.15.79:6789/0 conn(0x7f47cc06d980 legacy=0x7f47cc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 -- 172.21.15.26:0/730170826 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc1532c0 con 0x7f47cc14fcc0 2023-11-28T16:56:23.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.355+0000 7f47d15ce640 1 --2- 172.21.15.26:0/730170826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc14fcc0 0x7f47cc156500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f523ba62a4b8158f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47c3fff640 1 -- 172.21.15.26:0/730170826 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ac600 con 0x7f47cc14fcc0 2023-11-28T16:56:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47c3fff640 1 -- 172.21.15.26:0/730170826 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80a8050 con 0x7f47cc14fcc0 2023-11-28T16:56:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47c3fff640 1 -- 172.21.15.26:0/730170826 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ac980 con 0x7f47cc14fcc0 2023-11-28T16:56:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- 172.21.15.26:0/730170826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc14fcc0 msgr2=0x7f47cc156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 --2- 172.21.15.26:0/730170826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc14fcc0 0x7f47cc156500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c4d0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- 172.21.15.26:0/730170826 shutdown_connections 2023-11-28T16:56:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 --2- 172.21.15.26:0/730170826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc0c19e0 0x7f47cc0c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 --2- 172.21.15.26:0/730170826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc14fcc0 0x7f47cc156500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- 172.21.15.26:0/730170826 >> 172.21.15.26:0/730170826 conn(0x7f47cc0c2ad0 msgr2=0x7f47cc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- 172.21.15.26:0/730170826 shutdown_connections 2023-11-28T16:56:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- 172.21.15.26:0/730170826 wait complete. 2023-11-28T16:56:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 Processor -- start 2023-11-28T16:56:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- start start 2023-11-28T16:56:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47cc06d980 0x7f47cc1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc0c19e0 0x7f47cc146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc14dee0 0x7f47cc14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc14b5a0 con 0x7f47cc0c19e0 2023-11-28T16:56:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1ebb40 con 0x7f47cc06d980 2023-11-28T16:56:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.359+0000 7f47d3832640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc14b7b0 con 0x7f47cc14dee0 2023-11-28T16:56:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc0c19e0 0x7f47cc146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc0c19e0 0x7f47cc146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53146/0 (socket says 172.21.15.26:53146) 2023-11-28T16:56:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 -- 172.21.15.26:0/889647416 learned_addr learned my addr 172.21.15.26:0/889647416 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d15ce640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47cc06d980 0x7f47cc1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d1dcf640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc14dee0 0x7f47cc14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 -- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc14dee0 msgr2=0x7f47cc14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc14dee0 0x7f47cc14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 -- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47cc06d980 msgr2=0x7f47cc1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47cc06d980 0x7f47cc1463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 -- 172.21.15.26:0/889647416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80094d0 con 0x7f47cc0c19e0 2023-11-28T16:56:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d0dcd640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc0c19e0 0x7f47cc146900 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c490 tx=0x7f47bc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47c1ffb640 1 -- 172.21.15.26:0/889647416 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc003600 con 0x7f47cc0c19e0 2023-11-28T16:56:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47c1ffb640 1 -- 172.21.15.26:0/889647416 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc003780 con 0x7f47cc0c19e0 2023-11-28T16:56:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47c1ffb640 1 -- 172.21.15.26:0/889647416 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc003b70 con 0x7f47cc0c19e0 2023-11-28T16:56:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc14ba90 con 0x7f47cc0c19e0 2023-11-28T16:56:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc14a950 con 0x7f47cc0c19e0 2023-11-28T16:56:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc14dc00 con 0x7f47cc0c19e0 2023-11-28T16:56:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47c1ffb640 1 -- 172.21.15.26:0/889647416 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f47bc003cd0 con 0x7f47cc0c19e0 2023-11-28T16:56:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.363+0000 7f47c1ffb640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f47b00668d0 0x7f47b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.367+0000 7f47c1ffb640 1 -- 172.21.15.26:0/889647416 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47bc083560 con 0x7f47cc0c19e0 2023-11-28T16:56:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.367+0000 7f47d15ce640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f47b00668d0 0x7f47b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.367+0000 7f47d15ce640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f47b00668d0 0x7f47b0068d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ae000 tx=0x7f47c80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.367+0000 7f47c1ffb640 1 -- 172.21.15.26:0/889647416 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47cc14dc00 con 0x7f47cc0c19e0 2023-11-28T16:56:23.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.527+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47cc14dc00 con 0x7f47cc0c19e0 2023-11-28T16:56:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.527+0000 7f47c1ffb640 1 -- 172.21.15.26:0/889647416 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f47cc14dc00 con 0x7f47cc0c19e0 2023-11-28T16:56:23.533 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:23.534 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f47b00668d0 msgr2=0x7f47b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f47b00668d0 0x7f47b0068d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ae000 tx=0x7f47c80a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc0c19e0 msgr2=0x7f47cc146900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc0c19e0 0x7f47cc146900 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c490 tx=0x7f47bc001e80 comp rx=0 tx=0).stop 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 shutdown_connections 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f47b00668d0 0x7f47b0068d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f47cc14dee0 0x7f47cc14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47cc0c19e0 0x7f47cc146900 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 --2- 172.21.15.26:0/889647416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47cc06d980 0x7f47cc1463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 >> 172.21.15.26:0/889647416 conn(0x7f47cc0c2ad0 msgr2=0x7f47cc1545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 shutdown_connections 2023-11-28T16:56:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.531+0000 7f47d3832640 1 -- 172.21.15.26:0/889647416 wait complete. 2023-11-28T16:56:23.555 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T16:56:23.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb1a06d6640 1 Processor -- start 2023-11-28T16:56:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb1a06d6640 1 -- start start 2023-11-28T16:56:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb1a06d6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1980bd720 0x7fb198158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb1a06d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 0x7fb198158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb1a06d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb198155790 con 0x7fb1980ca610 2023-11-28T16:56:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb1a06d6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1980c4b00 con 0x7fb1980bd720 2023-11-28T16:56:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb1a06d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c4de0 con 0x7fb19806cd90 2023-11-28T16:56:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19e472640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb1980ca610 0x7fb1980c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43910/0 (socket says 172.21.15.26:43910) 2023-11-28T16:56:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19e472640 1 -- 172.21.15.26:0/291548764 learned_addr learned my addr 172.21.15.26:0/291548764 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19ec73640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 0x7fb198158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19dc71640 1 --2- 172.21.15.26:0/291548764 >> v2:172.21.15.79:3300/0 conn(0x7fb1980bd720 0x7fb198158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466026192 0 0) 0x7fb198155790 con 0x7fb1980ca610 2023-11-28T16:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb184003530 con 0x7fb1980ca610 2023-11-28T16:56:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1890933438 0 0) 0x7fb184003530 con 0x7fb1980ca610 2023-11-28T16:56:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 msgr2=0x7fb198158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 0x7fb198158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 >> v2:172.21.15.79:3300/0 conn(0x7fb1980bd720 msgr2=0x7fb198158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 --2- 172.21.15.26:0/291548764 >> v2:172.21.15.79:3300/0 conn(0x7fb1980bd720 0x7fb198158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198157e30 con 0x7fb1980ca610 2023-11-28T16:56:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fb194001680 con 0x7fb1980ca610 2023-11-28T16:56:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 >> v1:172.21.15.26:6789/0 conn(0x7fb1980ca610 legacy=0x7fb1980c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb184003980 0x7fb184003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 0x7fb1840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb184005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c4b00 con 0x7fb184004d10 2023-11-28T16:56:23.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c4de0 con 0x7fb184003980 2023-11-28T16:56:23.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400ba40 con 0x7fb19806cd90 2023-11-28T16:56:23.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19ec73640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb184005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19e472640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb184003980 0x7fb184003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19dc71640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 0x7fb1840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19ec73640 1 -- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 msgr2=0x7fb1840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:23.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19ec73640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb19806cd90 0x7fb1840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19ec73640 1 -- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb184003980 msgr2=0x7fb184003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:23.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19ec73640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb184003980 0x7fb184003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.695+0000 7fb19ec73640 1 -- 172.21.15.26:0/291548764 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184003530 con 0x7fb184004d10 2023-11-28T16:56:23.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb19ec73640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb184005190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb190009fc0 tx=0x7fb19001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458249c6c36b34c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:23.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980c52d0 con 0x7fb184004d10 2023-11-28T16:56:23.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1900a7050 con 0x7fb184004d10 2023-11-28T16:56:23.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb19d470640 1 -- 172.21.15.26:0/291548764 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900ab840 con 0x7fb184004d10 2023-11-28T16:56:23.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb1a06d6640 1 -- 172.21.15.26:0/291548764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 msgr2=0x7fb184005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb1a06d6640 1 --2- 172.21.15.26:0/291548764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb184005190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb190009fc0 tx=0x7fb19001c940 comp rx=0 tx=0).stop 2023-11-28T16:56:23.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb19ec73640 1 -- 172.21.15.26:0/291548764 reap_dead start 2023-11-28T16:56:23.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb1a06d6640 1 -- 172.21.15.26:0/291548764 shutdown_connections 2023-11-28T16:56:23.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb1a06d6640 1 -- 172.21.15.26:0/291548764 >> 172.21.15.26:0/291548764 conn(0x7fb198071ea0 msgr2=0x7fb1980722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:23.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb1a06d6640 1 -- 172.21.15.26:0/291548764 shutdown_connections 2023-11-28T16:56:23.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.699+0000 7fb1a06d6640 1 -- 172.21.15.26:0/291548764 wait complete. 2023-11-28T16:56:23.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 Processor -- start 2023-11-28T16:56:23.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 -- start start 2023-11-28T16:56:23.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb1980bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1980bdb70 0x7fb19815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb198151240 0x7fb1981516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980bf5b0 con 0x7fb184004d10 2023-11-28T16:56:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980ac460 con 0x7fb198151240 2023-11-28T16:56:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980ac700 con 0x7fb1980bdb70 2023-11-28T16:56:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb1980bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb1980bfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53158/0 (socket says 172.21.15.26:53158) 2023-11-28T16:56:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 -- 172.21.15.26:0/3524532646 learned_addr learned my addr 172.21.15.26:0/3524532646 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 -- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1980bdb70 msgr2=0x7fb19815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1980bdb70 0x7fb19815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 -- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb198151240 msgr2=0x7fb1981516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb198151240 0x7fb1981516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 -- 172.21.15.26:0/3524532646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1980ac9e0 con 0x7fb184004d10 2023-11-28T16:56:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb19e472640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb1980bfe30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb194007310 tx=0x7fb1940077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb18effd640 1 -- 172.21.15.26:0/3524532646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400f940 con 0x7fb184004d10 2023-11-28T16:56:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb18effd640 1 -- 172.21.15.26:0/3524532646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19400fae0 con 0x7fb184004d10 2023-11-28T16:56:23.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb18effd640 1 -- 172.21.15.26:0/3524532646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400fe90 con 0x7fb184004d10 2023-11-28T16:56:23.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1980bf240 con 0x7fb184004d10 2023-11-28T16:56:23.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.703+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb198151c00 con 0x7fb184004d10 2023-11-28T16:56:23.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.707+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19804e890 con 0x7fb184004d10 2023-11-28T16:56:23.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.707+0000 7fb18effd640 1 -- 172.21.15.26:0/3524532646 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb19401d460 con 0x7fb184004d10 2023-11-28T16:56:23.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.707+0000 7fb18effd640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb17c066900 0x7fb17c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.707+0000 7fb18effd640 1 -- 172.21.15.26:0/3524532646 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb194084690 con 0x7fb184004d10 2023-11-28T16:56:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.707+0000 7fb19dc71640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb17c066900 0x7fb17c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.707+0000 7fb19dc71640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb17c066900 0x7fb17c068dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb188006e90 tx=0x7fb188006e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.711+0000 7fb18effd640 1 -- 172.21.15.26:0/3524532646 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb194051830 con 0x7fb184004d10 2023-11-28T16:56:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1980bd500 con 0x7fb184004d10 2023-11-28T16:56:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb18effd640 1 -- 172.21.15.26:0/3524532646 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fb194054e50 con 0x7fb184004d10 2023-11-28T16:56:23.875 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:23.875 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb17c066900 msgr2=0x7fb17c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb17c066900 0x7fb17c068dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb188006e90 tx=0x7fb188006e00 comp rx=0 tx=0).stop 2023-11-28T16:56:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 msgr2=0x7fb1980bfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb1980bfe30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb194007310 tx=0x7fb1940077d0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 shutdown_connections 2023-11-28T16:56:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb198151240 0x7fb1981516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb17c066900 0x7fb17c068dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1980bdb70 0x7fb19815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 --2- 172.21.15.26:0/3524532646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184004d10 0x7fb1980bfe30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 >> 172.21.15.26:0/3524532646 conn(0x7fb198071ea0 msgr2=0x7fb1980ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 shutdown_connections 2023-11-28T16:56:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:23.871+0000 7fb1a06d6640 1 -- 172.21.15.26:0/3524532646 wait complete. 2023-11-28T16:56:23.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T16:56:23.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T16:56:23.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T16:56:23.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T16:56:23.899 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T16:56:23.900 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T16:56:23.900 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T16:56:23.901 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T16:56:24.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.139+0000 7f6543fff640 1 Processor -- start 2023-11-28T16:56:24.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.139+0000 7f6543fff640 1 -- start start 2023-11-28T16:56:24.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe29a7640 1 Processor -- start 2023-11-28T16:56:24.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe29a7640 1 -- start start 2023-11-28T16:56:24.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f6543fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654406cde0 0x7f654414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f6543fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65440713a0 0x7f6544153c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f6543fff640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6544071830 con 0x7f65440c6af0 2023-11-28T16:56:24.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f6543fff640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654406d970 con 0x7f65440713a0 2023-11-28T16:56:24.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f6543fff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654406dc50 con 0x7f654406cde0 2023-11-28T16:56:24.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f6542ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f65440c6af0 0x7f65440c09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43920/0 (socket says 172.21.15.26:43920) 2023-11-28T16:56:24.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f6542ffd640 1 -- 172.21.15.26:0/2237665249 learned_addr learned my addr 172.21.15.26:0/2237665249 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823815022 0 0) 0x7f6544071830 con 0x7f65440c6af0 2023-11-28T16:56:24.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6530003530 con 0x7f65440c6af0 2023-11-28T16:56:24.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726296238 0 0) 0x7f6530003530 con 0x7f65440c6af0 2023-11-28T16:56:24.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe29a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc151ec0 0x7f2fdc0bf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe29a7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0c0060 con 0x7f2fdc06bf00 2023-11-28T16:56:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe29a7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc157df0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe29a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1580d0 con 0x7f2fdc151ec0 2023-11-28T16:56:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe19a5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc151ec0 0x7f2fdc0bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe11a4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2fdc0bf940 0x7f2fdc1547d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:33990/0 (socket says 172.21.15.26:33990) 2023-11-28T16:56:24.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f2fe11a4640 1 -- 172.21.15.26:0/1973093483 learned_addr learned my addr 172.21.15.26:0/1973093483 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654406cde0 msgr2=0x7f654414dcf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T16:56:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654406cde0 0x7f654414dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f2fe09a3640 1 -- 172.21.15.26:0/1973093483 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422311050 0 0) 0x7f2fdc157df0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f2fe09a3640 1 -- 172.21.15.26:0/1973093483 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc8003530 con 0x7f2fdc0bf940 2023-11-28T16:56:24.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 >> v2:172.21.15.26:3300/0 conn(0x7f65440713a0 msgr2=0x7f6544153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 --2- 172.21.15.26:0/2237665249 >> v2:172.21.15.26:3300/0 conn(0x7f65440713a0 0x7f6544153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654406df30 con 0x7f65440c6af0 2023-11-28T16:56:24.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f6534001680 con 0x7f65440c6af0 2023-11-28T16:56:24.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 >> v1:172.21.15.26:6789/0 conn(0x7f65440c6af0 legacy=0x7f65440c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530003980 0x7f6530003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65300047d0 0x7f6530004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300052b0 0x7f653000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.143+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654406d970 con 0x7f65300047d0 2023-11-28T16:56:24.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654406dc50 con 0x7f6530003980 2023-11-28T16:56:24.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653000c190 con 0x7f65300052b0 2023-11-28T16:56:24.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f2fe19a5640 1 -- 172.21.15.26:0/1973093483 >> v1:172.21.15.79:6789/0 conn(0x7f2fdc0bf940 legacy=0x7f2fdc1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f2fe19a5640 1 -- 172.21.15.26:0/1973093483 >> v1:172.21.15.26:6789/0 conn(0x7f2fdc06bf00 legacy=0x7f2fdc154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f2fe19a5640 1 -- 172.21.15.26:0/1973093483 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc1583b0 con 0x7f2fdc151ec0 2023-11-28T16:56:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f653bfff640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65300047d0 0x7f6530004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f6542ffd640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530003980 0x7f6530003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f65437fe640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300052b0 0x7f653000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f653bfff640 1 -- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300052b0 msgr2=0x7f653000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f653bfff640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300052b0 0x7f653000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f653bfff640 1 -- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530003980 msgr2=0x7f6530003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f653bfff640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530003980 0x7f6530003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f653bfff640 1 -- 172.21.15.26:0/2237665249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654406df30 con 0x7f65300047d0 2023-11-28T16:56:24.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.147+0000 7f9a0d955640 1 Processor -- start 2023-11-28T16:56:24.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a0d955640 1 -- start start 2023-11-28T16:56:24.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a0d955640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a08152ce0 0x7f9a0806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a0d955640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a0806db80 0x7f9a080700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a0d955640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0806bea0 con 0x7f9a080705e0 2023-11-28T16:56:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a077fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a080705e0 0x7f9a080c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43926/0 (socket says 172.21.15.26:43926) 2023-11-28T16:56:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a077fe640 1 -- 172.21.15.26:0/4042233070 learned_addr learned my addr 172.21.15.26:0/4042233070 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a067fc640 1 --2- 172.21.15.26:0/4042233070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a0806db80 0x7f9a080700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a06ffd640 1 --2- 172.21.15.26:0/4042233070 >> v2:172.21.15.26:3300/0 conn(0x7f9a08152ce0 0x7f9a0806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a0d955640 1 -- 172.21.15.26:0/4042233070 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a08159b10 con 0x7f9a08152ce0 2023-11-28T16:56:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f2fe19a5640 1 --2- 172.21.15.26:0/1973093483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc151ec0 0x7f2fdc0bf400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009dc0 tx=0x7f2fd401c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ae61cc3673eb508 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.151+0000 7f9a0d955640 1 -- 172.21.15.26:0/4042233070 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08159550 con 0x7f9a0806db80 2023-11-28T16:56:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f9a067fc640 1 -- 172.21.15.26:0/4042233070 >> v2:172.21.15.26:3300/0 conn(0x7f9a08152ce0 msgr2=0x7f9a0806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f9a067fc640 1 --2- 172.21.15.26:0/4042233070 >> v2:172.21.15.26:3300/0 conn(0x7f9a08152ce0 0x7f9a0806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe09a3640 1 -- 172.21.15.26:0/1973093483 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40a57b0 con 0x7f2fdc151ec0 2023-11-28T16:56:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f9a05ffb640 1 -- 172.21.15.26:0/4042233070 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087247620 0 0) 0x7f9a0806bea0 con 0x7f9a080705e0 2023-11-28T16:56:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f9a067fc640 1 -- 172.21.15.26:0/4042233070 >> v1:172.21.15.26:6789/0 conn(0x7f9a080705e0 legacy=0x7f9a080c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f9a067fc640 1 -- 172.21.15.26:0/4042233070 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08159830 con 0x7f9a0806db80 2023-11-28T16:56:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe09a3640 1 -- 172.21.15.26:0/1973093483 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40a5910 con 0x7f2fdc151ec0 2023-11-28T16:56:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe09a3640 1 -- 172.21.15.26:0/1973093483 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40a57b0 con 0x7f2fdc151ec0 2023-11-28T16:56:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f9a06ffd640 1 --2- 172.21.15.26:0/4042233070 >> v2:172.21.15.26:3300/0 conn(0x7f9a08152ce0 0x7f9a0806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:24.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f653bfff640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65300047d0 0x7f6530004c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65440c2aa0 tx=0x7f652c01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef4fccd90325535 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0ab600 con 0x7f65300047d0 2023-11-28T16:56:24.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c0a7050 con 0x7f65300047d0 2023-11-28T16:56:24.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f65427fc640 1 -- 172.21.15.26:0/2237665249 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0ab980 con 0x7f65300047d0 2023-11-28T16:56:24.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f6543fff640 1 -- 172.21.15.26:0/2237665249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65300047d0 msgr2=0x7f6530004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f6543fff640 1 --2- 172.21.15.26:0/2237665249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65300047d0 0x7f6530004c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65440c2aa0 tx=0x7f652c01c220 comp rx=0 tx=0).stop 2023-11-28T16:56:24.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f65437fe640 1 -- 172.21.15.26:0/2237665249 reap_dead start 2023-11-28T16:56:24.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe29a7640 1 -- 172.21.15.26:0/1973093483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc151ec0 msgr2=0x7f2fdc0bf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe29a7640 1 --2- 172.21.15.26:0/1973093483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc151ec0 0x7f2fdc0bf400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009dc0 tx=0x7f2fd401c7e0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe29a7640 1 -- 172.21.15.26:0/1973093483 shutdown_connections 2023-11-28T16:56:24.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe29a7640 1 --2- 172.21.15.26:0/1973093483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc151ec0 0x7f2fdc0bf400 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f2fe29a7640 1 -- 172.21.15.26:0/1973093483 >> 172.21.15.26:0/1973093483 conn(0x7f2fdc0c5fd0 msgr2=0x7f2fdc0c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.155+0000 7f0532059640 1 Processor -- start 2023-11-28T16:56:24.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f6543fff640 1 -- 172.21.15.26:0/2237665249 shutdown_connections 2023-11-28T16:56:24.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f6543fff640 1 -- 172.21.15.26:0/2237665249 >> 172.21.15.26:0/2237665249 conn(0x7f65440c5fd0 msgr2=0x7f65440c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f2fe29a7640 1 -- 172.21.15.26:0/1973093483 shutdown_connections 2023-11-28T16:56:24.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f2fe29a7640 1 -- 172.21.15.26:0/1973093483 wait complete. 2023-11-28T16:56:24.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f6543fff640 1 -- 172.21.15.26:0/2237665249 shutdown_connections 2023-11-28T16:56:24.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f0532059640 1 -- start start 2023-11-28T16:56:24.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f9a067fc640 1 --2- 172.21.15.26:0/4042233070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a0806db80 0x7f9a080700a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0097c0 tx=0x7f99fc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d802fb48f7766c2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f6543fff640 1 -- 172.21.15.26:0/2237665249 wait complete. 2023-11-28T16:56:24.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f9a05ffb640 1 -- 172.21.15.26:0/4042233070 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0ab5f0 con 0x7f9a0806db80 2023-11-28T16:56:24.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f6543fff640 1 Processor -- start 2023-11-28T16:56:24.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f2fe29a7640 1 Processor -- start 2023-11-28T16:56:24.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f2fe29a7640 1 -- start start 2023-11-28T16:56:24.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f0532059640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05240db100 0x7f0524006fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f0532059640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0524032620 con 0x7f05240db850 2023-11-28T16:56:24.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f0532059640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240da360 con 0x7f0524006c00 2023-11-28T16:56:24.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f0532059640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052404b6b0 con 0x7f05240db100 2023-11-28T16:56:24.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f0531057640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0524006c00 0x7f052404a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34006/0 (socket says 172.21.15.26:34006) 2023-11-28T16:56:24.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f0531057640 1 -- 172.21.15.26:0/2502122608 learned_addr learned my addr 172.21.15.26:0/2502122608 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f9a05ffb640 1 -- 172.21.15.26:0/4042233070 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc0ab750 con 0x7f9a0806db80 2023-11-28T16:56:24.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f6543fff640 1 -- start start 2023-11-28T16:56:24.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571615957 0 0) 0x7f05240da360 con 0x7f0524006c00 2023-11-28T16:56:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0518003530 con 0x7f0524006c00 2023-11-28T16:56:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f9a05ffb640 1 -- 172.21.15.26:0/4042233070 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0abae0 con 0x7f9a0806db80 2023-11-28T16:56:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f9a0d955640 1 -- 172.21.15.26:0/4042233070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a0806db80 msgr2=0x7f9a080700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.159+0000 7f9a0d955640 1 --2- 172.21.15.26:0/4042233070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a0806db80 0x7f9a080700a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0097c0 tx=0x7f99fc01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 -- 172.21.15.26:0/4042233070 shutdown_connections 2023-11-28T16:56:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 --2- 172.21.15.26:0/4042233070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a0806db80 0x7f9a080700a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 --2- 172.21.15.26:0/4042233070 >> v2:172.21.15.26:3300/0 conn(0x7f9a08152ce0 0x7f9a0806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6543fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300047d0 0x7f654414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6543fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f654414c640 0x7f6544153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6542ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300047d0 0x7f654414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6542ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300047d0 0x7f654414cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44120/0 (socket says 172.21.15.26:44120) 2023-11-28T16:56:24.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f653bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f654414c640 0x7f6544153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f653bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f654414c640 0x7f6544153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52186/0 (socket says 172.21.15.26:52186) 2023-11-28T16:56:24.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6543fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65440aa420 0x7f654413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6543fff640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6544150dc0 con 0x7f65440aa420 2023-11-28T16:56:24.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6543fff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6544151170 con 0x7f654414c640 2023-11-28T16:56:24.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6543fff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6544162290 con 0x7f65300047d0 2023-11-28T16:56:24.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6542ffd640 1 -- 172.21.15.26:0/1839963449 learned_addr learned my addr 172.21.15.26:0/1839963449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe29a7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fdc06bf00 0x7f2fdc153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe29a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc0bf940 0x7f2fdc0c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe29a7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fdc151ec0 0x7f2fdc071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe11a4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc0bf940 0x7f2fdc0c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe11a4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc0bf940 0x7f2fdc0c3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44110/0 (socket says 172.21.15.26:44110) 2023-11-28T16:56:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe11a4640 1 -- 172.21.15.26:0/3455420343 learned_addr learned my addr 172.21.15.26:0/3455420343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c4320 con 0x7f2fdc151ec0 2023-11-28T16:56:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1578d0 con 0x7f2fdc06bf00 2023-11-28T16:56:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc155e40 con 0x7f2fdc0bf940 2023-11-28T16:56:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3074100375 0 0) 0x7f0518003530 con 0x7f0524006c00 2023-11-28T16:56:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 >> v2:172.21.15.79:3300/0 conn(0x7f05240db100 msgr2=0x7f0524006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T16:56:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 --2- 172.21.15.26:0/2502122608 >> v2:172.21.15.79:3300/0 conn(0x7f05240db100 0x7f0524006fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 >> v1:172.21.15.26:6789/0 conn(0x7f05240db850 legacy=0x7f05240e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052404ae00 con 0x7f0524006c00 2023-11-28T16:56:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f0520001680 con 0x7f0524006c00 2023-11-28T16:56:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 >> v1:172.21.15.79:6789/0 conn(0x7f0524006c00 legacy=0x7f052404a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0518003980 0x7f0518003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05180047d0 0x7f0518004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0518005390 0x7f051800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051800c220 con 0x7f05180047d0 2023-11-28T16:56:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051800c390 con 0x7f0518005390 2023-11-28T16:56:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051800c550 con 0x7f0518003980 2023-11-28T16:56:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f0531858640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0518005390 0x7f051800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f0531057640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0518003980 0x7f0518003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 -- 172.21.15.26:0/4042233070 >> 172.21.15.26:0/4042233070 conn(0x7f9a080c2ad0 msgr2=0x7f9a080c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 -- 172.21.15.26:0/4042233070 shutdown_connections 2023-11-28T16:56:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 -- 172.21.15.26:0/4042233070 wait complete. 2023-11-28T16:56:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff0309d0640 1 Processor -- start 2023-11-28T16:56:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff0309d0640 1 -- start start 2023-11-28T16:56:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff0309d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400a960 0x7ff0240d9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff0309d0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0240da130 0x7ff024006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff0309d0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff024046920 con 0x7ff02400bd30 2023-11-28T16:56:24.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff0309d0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0240473c0 con 0x7ff0240da130 2023-11-28T16:56:24.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff0309d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02404b5b0 con 0x7ff02400a960 2023-11-28T16:56:24.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 Processor -- start 2023-11-28T16:56:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff02bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0240da130 0x7ff024006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff02bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0240da130 0x7ff024006ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52194/0 (socket says 172.21.15.26:52194) 2023-11-28T16:56:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff02bfff640 1 -- 172.21.15.26:0/2717212910 learned_addr learned my addr 172.21.15.26:0/2717212910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f2fe19a5640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fdc06bf00 0x7f2fdc153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6542ffd640 1 -- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f654414c640 msgr2=0x7f6544153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6542ffd640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f654414c640 0x7f6544153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6542ffd640 1 -- 172.21.15.26:0/1839963449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65440aa420 msgr2=0x7f654413e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f6542ffd640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65440aa420 0x7f654413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f9a0d955640 1 -- start start 2023-11-28T16:56:24.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7ff02bfff640 1 -- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400a960 msgr2=0x7ff0240d9bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T16:56:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f6542ffd640 1 -- 172.21.15.26:0/1839963449 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440ab420 con 0x7f65300047d0 2023-11-28T16:56:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f653bfff640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f654414c640 0x7f6544153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe11a4640 1 -- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fdc06bf00 msgr2=0x7f2fdc153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe11a4640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fdc06bf00 0x7f2fdc153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe11a4640 1 -- 172.21.15.26:0/3455420343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fdc151ec0 msgr2=0x7f2fdc071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe11a4640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fdc151ec0 0x7f2fdc071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe11a4640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd4009a70 con 0x7f2fdc0bf940 2023-11-28T16:56:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f0531057640 1 -- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0518005390 msgr2=0x7f051800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f0531057640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0518005390 0x7f051800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f0531057640 1 -- 172.21.15.26:0/2502122608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05180047d0 msgr2=0x7f0518004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T16:56:24.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f0531057640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05180047d0 0x7f0518004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.163+0000 7f0531057640 1 -- 172.21.15.26:0/2502122608 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052404ae00 con 0x7f0518003980 2023-11-28T16:56:24.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f0531858640 1 -- 172.21.15.26:0/2502122608 reap_dead start 2023-11-28T16:56:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7ff02affd640 1 --2- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400a960 0x7ff0240d9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7ff02bfff640 1 --2- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400a960 0x7ff0240d9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7ff02bfff640 1 -- 172.21.15.26:0/2717212910 >> v1:172.21.15.26:6789/0 conn(0x7ff02400bd30 legacy=0x7ff0240d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7ff02bfff640 1 -- 172.21.15.26:0/2717212910 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02404b2d0 con 0x7ff0240da130 2023-11-28T16:56:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe11a4640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc0bf940 0x7f2fdc0c3de0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c520 tx=0x7f2fd800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7fe72c93e640 1 Processor -- start 2023-11-28T16:56:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7ff02affd640 1 --2- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400a960 0x7ff0240d9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7fe72c93e640 1 -- start start 2023-11-28T16:56:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f6542ffd640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300047d0 0x7f654414cc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6534011c00 tx=0x7f653400f540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400fe50 con 0x7f65300047d0 2023-11-28T16:56:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80074e0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc1528c0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc152e30 con 0x7f2fdc0bf940 2023-11-28T16:56:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65441406b0 con 0x7f65300047d0 2023-11-28T16:56:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8007640 con 0x7f2fdc0bf940 2023-11-28T16:56:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534015410 con 0x7f65300047d0 2023-11-28T16:56:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400fe50 con 0x7f65300047d0 2023-11-28T16:56:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80074e0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6544151380 con 0x7f65300047d0 2023-11-28T16:56:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7feed5809640 1 Processor -- start 2023-11-28T16:56:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a0d955640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a0806db80 0x7f9a081f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a0d955640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a080705e0 0x7f9a081f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7feed5809640 1 -- start start 2023-11-28T16:56:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fdc155c10 con 0x7f2fdc0bf940 2023-11-28T16:56:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72c93e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe72806d020 0x7fe728150840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe72814dd10 0x7fe7280c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34022/0 (socket says 172.21.15.26:34022) 2023-11-28T16:56:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72659c640 1 -- 172.21.15.26:0/3403697673 learned_addr learned my addr 172.21.15.26:0/3403697673 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72c93e640 1 --2- 172.21.15.26:0/3403697673 >> v2:172.21.15.79:3300/0 conn(0x7fe728070380 0x7fe728070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feed5809640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feec80dbce0 0x7feec80e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feed5809640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec800b0c0 0x7feec8006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feed5809640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feec8007440 0x7feec80ded20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feeceffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feec80dbce0 0x7feec80e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe725d9b640 1 --2- 172.21.15.26:0/3403697673 >> v2:172.21.15.26:3300/0 conn(0x7fe72806d020 0x7fe728150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feeceffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feec80dbce0 0x7feec80e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52208/0 (socket says 172.21.15.26:52208) 2023-11-28T16:56:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a0d955640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a08152ce0 0x7f9a080c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a0d955640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080c3bc0 con 0x7f9a0806db80 2023-11-28T16:56:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a0d955640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a081f1de0 con 0x7f9a080705e0 2023-11-28T16:56:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a0d955640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a081f20c0 con 0x7f9a08152ce0 2023-11-28T16:56:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72806c070 con 0x7fe72814dd10 2023-11-28T16:56:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280a8b00 con 0x7fe72806d020 2023-11-28T16:56:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72806c350 con 0x7fe728070380 2023-11-28T16:56:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3403697673 >> v2:172.21.15.79:3300/0 conn(0x7fe728070380 0x7fe728070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feece7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec800b0c0 0x7feec8006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feeceffd640 1 -- 172.21.15.26:0/3962305218 learned_addr learned my addr 172.21.15.26:0/3962305218 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80e2c50 con 0x7feec8007440 2023-11-28T16:56:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80de870 con 0x7feec80dbce0 2023-11-28T16:56:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec8047620 con 0x7feec800b0c0 2023-11-28T16:56:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a080705e0 0x7f9a081f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a080705e0 0x7f9a081f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52198/0 (socket says 172.21.15.26:52198) 2023-11-28T16:56:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a067fc640 1 -- 172.21.15.26:0/477486574 learned_addr learned my addr 172.21.15.26:0/477486574 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.167+0000 7f9a077fe640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a08152ce0 0x7f9a080c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a077fe640 1 -- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a080705e0 msgr2=0x7f9a081f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a077fe640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a080705e0 0x7f9a081f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a077fe640 1 -- 172.21.15.26:0/477486574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a0806db80 msgr2=0x7f9a081f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a077fe640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a0806db80 0x7f9a081f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f0531057640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0518003980 0x7f0518003da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f052000c260 tx=0x7f052001cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=760b1188492dac49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feecf7fe640 1 --2- 172.21.15.26:0/3962305218 >> v2:172.21.15.26:3300/0 conn(0x7feec8007440 0x7feec80ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6528000fd0 con 0x7f65300047d0 2023-11-28T16:56:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732727521 0 0) 0x7fe72806c070 con 0x7fe72814dd10 2023-11-28T16:56:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe710003530 con 0x7fe72814dd10 2023-11-28T16:56:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6534015580 con 0x7f65300047d0 2023-11-28T16:56:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feece7fc640 1 -- 172.21.15.26:0/3962305218 >> v2:172.21.15.79:3300/0 conn(0x7feec80dbce0 msgr2=0x7feec80e2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feece7fc640 1 --2- 172.21.15.26:0/3962305218 >> v2:172.21.15.79:3300/0 conn(0x7feec80dbce0 0x7feec80e2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7feece7fc640 1 -- 172.21.15.26:0/3962305218 >> v2:172.21.15.26:3300/0 conn(0x7feec8007440 msgr2=0x7feec80ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520005ae0 con 0x7f0518003980 2023-11-28T16:56:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f051ffff640 1 -- 172.21.15.26:0/2502122608 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520005c40 con 0x7f0518003980 2023-11-28T16:56:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a077fe640 1 -- 172.21.15.26:0/477486574 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00009a70 con 0x7f9a08152ce0 2023-11-28T16:56:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a077fe640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a08152ce0 0x7f9a080c4610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a08070050 tx=0x7f99f800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80074e0 con 0x7f9a08152ce0 2023-11-28T16:56:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8007660 con 0x7f9a08152ce0 2023-11-28T16:56:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8004a30 con 0x7f9a08152ce0 2023-11-28T16:56:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983339895 0 0) 0x7fe710003530 con 0x7fe72814dd10 2023-11-28T16:56:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 >> v2:172.21.15.79:3300/0 conn(0x7fe728070380 msgr2=0x7fe728070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 --2- 172.21.15.26:0/3403697673 >> v2:172.21.15.79:3300/0 conn(0x7fe728070380 0x7fe728070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 >> v2:172.21.15.26:3300/0 conn(0x7fe72806d020 msgr2=0x7fe728150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 --2- 172.21.15.26:0/3403697673 >> v2:172.21.15.26:3300/0 conn(0x7fe72806d020 0x7fe728150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72806c630 con 0x7fe72814dd10 2023-11-28T16:56:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fe720001680 con 0x7fe72814dd10 2023-11-28T16:56:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 >> v1:172.21.15.79:6789/0 conn(0x7fe72814dd10 legacy=0x7fe7280c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe710003770 0x7fe710003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7100040d0 0x7fe71000b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe71000d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280a8b00 con 0x7fe7100040d0 2023-11-28T16:56:24.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72806c350 con 0x7fe71000b560 2023-11-28T16:56:24.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71000e270 con 0x7fe710003770 2023-11-28T16:56:24.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3403697673 >> v2:172.21.15.79:3300/0 conn(0x7fe728070380 0x7fe728070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc009420 con 0x7f9a08152ce0 2023-11-28T16:56:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a080c40f0 con 0x7f9a08152ce0 2023-11-28T16:56:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe72659c640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe710003770 0x7fe710003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe71000d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2fd80047f0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f2fd27fc640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc0066990 0x7f2fc0068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f0532059640 1 -- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0518003980 msgr2=0x7f0518003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7f0532059640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0518003980 0x7f0518003da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f052000c260 tx=0x7f052001cca0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7ff02bfff640 1 --2- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 0x7ff024006ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff02c04fba0 tx=0x7ff02c096c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6190dcb854d3a182 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7ff02a7fc640 1 -- 172.21.15.26:0/2717212910 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c1207b0 con 0x7ff0240da130 2023-11-28T16:56:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7ff02a7fc640 1 -- 172.21.15.26:0/2717212910 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c120910 con 0x7ff0240da130 2023-11-28T16:56:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.171+0000 7ff02a7fc640 1 -- 172.21.15.26:0/2717212910 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c120d40 con 0x7ff0240da130 2023-11-28T16:56:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7feece7fc640 1 --2- 172.21.15.26:0/3962305218 >> v2:172.21.15.26:3300/0 conn(0x7feec8007440 0x7feec80ded20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7feece7fc640 1 -- 172.21.15.26:0/3962305218 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8047900 con 0x7feec800b0c0 2023-11-28T16:56:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fd80839f0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fd27fc640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f2fc006eb30 0x7f2fc0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7fe725d9b640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7100040d0 0x7fe71000b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f653b7fe640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6524066930 0x7f6524068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fc0071600 con 0x7f2fc006eb30 2023-11-28T16:56:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fd80074e0 con 0x7f2fdc0bf940 2023-11-28T16:56:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fe21a6640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f2fc006eb30 0x7f2fc0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 -- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 msgr2=0x7ff024006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 --2- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 0x7ff024006ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff02c04fba0 tx=0x7ff02c096c20 comp rx=0 tx=0).stop 2023-11-28T16:56:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7fe726d9d640 1 -- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe710003770 msgr2=0x7fe710003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe710003770 0x7fe710003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7fe726d9d640 1 -- 172.21.15.26:0/3403697673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7100040d0 msgr2=0x7fe71000b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7100040d0 0x7fe71000b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7fe726d9d640 1 -- 172.21.15.26:0/3403697673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710003530 con 0x7fe71000b560 2023-11-28T16:56:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7fe72659c640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe710003770 0x7fe710003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7feecf7fe640 1 --2- 172.21.15.26:0/3962305218 >> v2:172.21.15.26:3300/0 conn(0x7feec8007440 0x7feec80ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6534087490 con 0x7f65300047d0 2023-11-28T16:56:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f653bfff640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6524066930 0x7f6524068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f653b7fe640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f652406ead0 0x7f6524070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 --> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65240715a0 con 0x7f652406ead0 2023-11-28T16:56:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6534089b50 con 0x7f65300047d0 2023-11-28T16:56:24.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f0532059640 1 -- 172.21.15.26:0/2502122608 shutdown_connections 2023-11-28T16:56:24.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f0532059640 1 --2- 172.21.15.26:0/2502122608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0518003980 0x7f0518003da0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fe19a5640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc0066990 0x7f2fc0068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f0532059640 1 -- 172.21.15.26:0/2502122608 >> 172.21.15.26:0/2502122608 conn(0x7f0524005ec0 msgr2=0x7f05240062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f65437fe640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f652406ead0 0x7f6524070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fe21a6640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f2fc006eb30 0x7f2fc0070f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f0532059640 1 -- 172.21.15.26:0/2502122608 shutdown_connections 2023-11-28T16:56:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f653bfff640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6524066930 0x7f6524068df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f652c0ad000 tx=0x7f652c004780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fe19a5640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc0066990 0x7f2fc0068e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40af000 tx=0x7f2fd40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 -- 172.21.15.26:0/2717212910 shutdown_connections 2023-11-28T16:56:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 --2- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 0x7ff024006ed0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 --2- 172.21.15.26:0/2717212910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400a960 0x7ff0240d9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 -- 172.21.15.26:0/2717212910 >> 172.21.15.26:0/2717212910 conn(0x7ff024048230 msgr2=0x7ff024048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 -- 172.21.15.26:0/2717212910 shutdown_connections 2023-11-28T16:56:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7ff0309d0640 1 -- 172.21.15.26:0/2717212910 wait complete. 2023-11-28T16:56:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a08157f50 con 0x7f9a08152ce0 2023-11-28T16:56:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f99f8004b90 con 0x7f9a08152ce0 2023-11-28T16:56:24.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f65437fe640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f652406ead0 0x7f6524070ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== osd.1 v2:172.21.15.26:6808/428800688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2fc0071600 con 0x7f2fc006eb30 2023-11-28T16:56:24.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.175+0000 7f0532059640 1 -- 172.21.15.26:0/2502122608 wait complete. 2023-11-28T16:56:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f99effff640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99f40669a0 0x7f99f4068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99f8084110 con 0x7f9a08152ce0 2023-11-28T16:56:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f9a06ffd640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99f40669a0 0x7f99f4068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f99effff640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7f99f406ebc0 0x7f99f4070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 --> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99f4071690 con 0x7f99f406ebc0 2023-11-28T16:56:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f8086670 con 0x7f9a08152ce0 2023-11-28T16:56:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f9a067fc640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7f99f406ebc0 0x7f99f4070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f0532059640 1 Processor -- start 2023-11-28T16:56:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f9a06ffd640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99f40669a0 0x7f99f4068e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a08157a50 tx=0x7f9a0000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== osd.0 v2:172.21.15.26:6800/3368065621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f65240715a0 con 0x7f652406ead0 2023-11-28T16:56:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f0532059640 1 -- start start 2023-11-28T16:56:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7ff0309d0640 1 Processor -- start 2023-11-28T16:56:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7feece7fc640 1 --2- 172.21.15.26:0/3962305218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec800b0c0 0x7feec8006f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feec800c000 tx=0x7feec001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a8706378337f878 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f9a067fc640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7f99f406ebc0 0x7f99f4070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7f0532059640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0518003980 0x7f05240d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7ff0309d0640 1 -- start start 2023-11-28T16:56:24.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7fe726d9d640 1 -- 172.21.15.26:0/3403697673 reap_dead start 2023-11-28T16:56:24.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7feecdffb640 1 -- 172.21.15.26:0/3962305218 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00ab600 con 0x7feec800b0c0 2023-11-28T16:56:24.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7feecdffb640 1 -- 172.21.15.26:0/3962305218 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00a7050 con 0x7feec800b0c0 2023-11-28T16:56:24.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7feecdffb640 1 -- 172.21.15.26:0/3962305218 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00ab980 con 0x7feec800b0c0 2023-11-28T16:56:24.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe71000d950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe718010880 tx=0x7fe718021160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d53440075e9818 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec800b0c0 msgr2=0x7feec8006f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.179+0000 7feed5809640 1 --2- 172.21.15.26:0/3962305218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec800b0c0 0x7feec8006f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feec800c000 tx=0x7feec001c3a0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0531057640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0518003980 0x7f05240d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718003ba0 con 0x7fe71000b560 2023-11-28T16:56:24.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180ac050 con 0x7fe71000b560 2023-11-28T16:56:24.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72559a640 1 -- 172.21.15.26:0/3403697673 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718004020 con 0x7fe71000b560 2023-11-28T16:56:24.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== osd.3 v2:172.21.15.26:6809/3338490031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f99f4071690 con 0x7f99f406ebc0 2023-11-28T16:56:24.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff0309d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff02400a960 0x7ff0240db020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff0309d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400bd30 0x7ff024040690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff0309d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 0x7ff024176a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff0309d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240dd530 con 0x7ff02400a960 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff0309d0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024041640 con 0x7ff0240da130 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff0309d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff024041900 con 0x7ff02400bd30 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 shutdown_connections 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7feed5809640 1 --2- 172.21.15.26:0/3962305218 >> v2:172.21.15.26:3300/0 conn(0x7feec8007440 0x7feec80ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7feed5809640 1 --2- 172.21.15.26:0/3962305218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec800b0c0 0x7feec8006f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7feed5809640 1 --2- 172.21.15.26:0/3962305218 >> v2:172.21.15.79:3300/0 conn(0x7feec80dbce0 0x7feec80e2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 >> 172.21.15.26:0/3962305218 conn(0x7feec8048260 msgr2=0x7feec8048670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0532059640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f052417ad60 0x7f0524176140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0532059640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0524046180 0x7f05240ddf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0532059640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240d9ea0 con 0x7f0518003980 2023-11-28T16:56:24.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0532059640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052417a5a0 con 0x7f052417ad60 2023-11-28T16:56:24.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0532059640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240d98e0 con 0x7f0524046180 2023-11-28T16:56:24.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0531057640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0518003980 0x7f05240d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53252/0 (socket says 172.21.15.26:53252) 2023-11-28T16:56:24.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02affd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400bd30 0x7ff024040690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02affd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400bd30 0x7ff024040690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44168/0 (socket says 172.21.15.26:44168) 2023-11-28T16:56:24.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02affd640 1 -- 172.21.15.26:0/2193429664 learned_addr learned my addr 172.21.15.26:0/2193429664 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02bfff640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 0x7ff024176a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f052417ad60 0x7f0524176140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f052417ad60 0x7f0524176140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52238/0 (socket says 172.21.15.26:52238) 2023-11-28T16:56:24.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 -- 172.21.15.26:0/3985052958 learned_addr learned my addr 172.21.15.26:0/3985052958 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0531858640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0524046180 0x7f05240ddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 shutdown_connections 2023-11-28T16:56:24.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 -- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0524046180 msgr2=0x7f05240ddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0524046180 0x7f05240ddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 -- 172.21.15.26:0/3985052958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0518003980 msgr2=0x7f05240d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02bfff640 1 -- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400bd30 msgr2=0x7ff024040690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02bfff640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02400bd30 0x7ff024040690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02bfff640 1 -- 172.21.15.26:0/2193429664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff02400a960 msgr2=0x7ff0240db020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02bfff640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff02400a960 0x7ff0240db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff02bfff640 1 -- 172.21.15.26:0/2193429664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0687b0 con 0x7ff0240da130 2023-11-28T16:56:24.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0518003980 0x7f05240d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 -- 172.21.15.26:0/3985052958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240d9bc0 con 0x7f052417ad60 2023-11-28T16:56:24.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 msgr2=0x7fe71000d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72c93e640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe71000d950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe718010880 tx=0x7fe718021160 comp rx=0 tx=0).stop 2023-11-28T16:56:24.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0530856640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f052417ad60 0x7f0524176140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f052c079b30 tx=0x7f052c068000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7feed5809640 1 -- 172.21.15.26:0/3962305218 wait complete. 2023-11-28T16:56:24.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c06bd00 con 0x7f052417ad60 2023-11-28T16:56:24.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c06be80 con 0x7f052417ad60 2023-11-28T16:56:24.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052417a840 con 0x7f052417ad60 2023-11-28T16:56:24.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c092640 con 0x7f052417ad60 2023-11-28T16:56:24.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 shutdown_connections 2023-11-28T16:56:24.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72c93e640 1 --2- 172.21.15.26:0/3403697673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe71000d950 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 >> 172.21.15.26:0/3403697673 conn(0x7fe7280c2ad0 msgr2=0x7fe7280c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff6df901640 1 Processor -- start 2023-11-28T16:56:24.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05240ccf70 con 0x7f052417ad60 2023-11-28T16:56:24.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.183+0000 7ff6df901640 1 -- start start 2023-11-28T16:56:24.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff02bfff640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 0x7ff024176a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff02c04fe80 tx=0x7ff02c0690f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f052417a400 con 0x7f052417ad60 2023-11-28T16:56:24.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 Processor -- start 2023-11-28T16:56:24.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 shutdown_connections 2023-11-28T16:56:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c128970 con 0x7ff0240da130 2023-11-28T16:56:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c128ad0 con 0x7ff0240da130 2023-11-28T16:56:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c128e80 con 0x7ff0240da130 2023-11-28T16:56:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7fe72c93e640 1 -- 172.21.15.26:0/3403697673 wait complete. 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 -- start start 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec8007440 0x7feec8177f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feec800b0c0 0x7feec80d9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec80dbce0 0x7feec803f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec802e5d0 con 0x7feec8007440 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8178470 con 0x7feec800b0c0 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feed5809640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec802f120 con 0x7feec80dbce0 2023-11-28T16:56:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec8007440 0x7feec8177f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec8007440 0x7feec8177f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53260/0 (socket says 172.21.15.26:53260) 2023-11-28T16:56:24.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 -- 172.21.15.26:0/3835780240 learned_addr learned my addr 172.21.15.26:0/3835780240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6df901640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6d80bd720 0x7ff6d8158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feecf7fe640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec80dbce0 0x7feec803f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 -- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec80dbce0 msgr2=0x7feec803f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feec80dbce0 0x7feec803f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 -- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feec800b0c0 msgr2=0x7feec80d9f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T16:56:24.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feec800b0c0 0x7feec80d9f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 -- 172.21.15.26:0/3835780240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009420 con 0x7feec8007440 2023-11-28T16:56:24.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6df901640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d806cd90 0x7ff6d8158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6dce9c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6d80bd720 0x7ff6d8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6dd69d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff6d80ca610 0x7ff6d80c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43952/0 (socket says 172.21.15.26:43952) 2023-11-28T16:56:24.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6dce9c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6d80bd720 0x7ff6d8158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53266/0 (socket says 172.21.15.26:53266) 2023-11-28T16:56:24.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeceffd640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec8007440 0x7feec8177f30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feec400e890 tx=0x7feec400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400c940 con 0x7feec8007440 2023-11-28T16:56:24.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6dd69d640 1 -- 172.21.15.26:0/698891692 learned_addr learned my addr 172.21.15.26:0/698891692 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d8155790 con 0x7ff6d80ca610 2023-11-28T16:56:24.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec400caa0 con 0x7feec8007440 2023-11-28T16:56:24.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400c940 con 0x7feec8007440 2023-11-28T16:56:24.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d80c4b00 con 0x7ff6d80bd720 2023-11-28T16:56:24.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c4de0 con 0x7ff6d806cd90 2023-11-28T16:56:24.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff6dde9e640 1 --2- 172.21.15.26:0/698891692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d806cd90 0x7ff6d8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff024041be0 con 0x7ff0240da130 2023-11-28T16:56:24.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff024040170 con 0x7ff0240da130 2023-11-28T16:56:24.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec80da4a0 con 0x7feec8007440 2023-11-28T16:56:24.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0240d5220 con 0x7ff0240da130 2023-11-28T16:56:24.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80413b0 con 0x7feec8007440 2023-11-28T16:56:24.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.187+0000 7fe72c93e640 1 Processor -- start 2023-11-28T16:56:24.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72c93e640 1 -- start start 2023-11-28T16:56:24.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feec8008ce0 con 0x7feec8007440 2023-11-28T16:56:24.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72c93e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe7281ec230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72c93e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7280c0350 0x7fe7280ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72c93e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728141d10 0x7fe7280abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72c93e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728142aa0 con 0x7fe728141d10 2023-11-28T16:56:24.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72c93e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280a9f60 con 0x7fe71000b560 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72c93e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280aa240 con 0x7fe7280c0350 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe7281ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe7281ec230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52262/0 (socket says 172.21.15.26:52262) 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 -- 172.21.15.26:0/3376730343 learned_addr learned my addr 172.21.15.26:0/3376730343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728141d10 0x7fe7280abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 -- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7280c0350 msgr2=0x7fe7280ab6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7280c0350 0x7fe7280ab6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 -- 172.21.15.26:0/3376730343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728141d10 msgr2=0x7fe7280abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728141d10 0x7fe7280abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 -- 172.21.15.26:0/3376730343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7281eca80 con 0x7fe71000b560 2023-11-28T16:56:24.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7ff6dce9c640 1 -- 172.21.15.26:0/698891692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d806cd90 msgr2=0x7ff6d8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7ff6dce9c640 1 --2- 172.21.15.26:0/698891692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d806cd90 0x7ff6d8158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7ff6dce9c640 1 -- 172.21.15.26:0/698891692 >> v1:172.21.15.26:6789/0 conn(0x7ff6d80ca610 legacy=0x7ff6d80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7ff6dce9c640 1 -- 172.21.15.26:0/698891692 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8157e30 con 0x7ff6d80bd720 2023-11-28T16:56:24.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728141d10 0x7fe7280abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:24.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe72659c640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe7281ec230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7200072c0 tx=0x7fe720007780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000fa80 con 0x7fe71000b560 2023-11-28T16:56:24.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72000fbe0 con 0x7fe71000b560 2023-11-28T16:56:24.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7200133f0 con 0x7fe71000b560 2023-11-28T16:56:24.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7281ecd60 con 0x7fe71000b560 2023-11-28T16:56:24.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f052c092860 con 0x7f052417ad60 2023-11-28T16:56:24.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.191+0000 7f051dffb640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05100669d0 0x7f0510068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f052c0fe020 con 0x7f052417ad60 2023-11-28T16:56:24.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7f051dffb640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f051006ebf0 0x7f0510071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 --> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05100716c0 con 0x7f051006ebf0 2023-11-28T16:56:24.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f052c1005e0 con 0x7f052417ad60 2023-11-28T16:56:24.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7281ec770 con 0x7fe71000b560 2023-11-28T16:56:24.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7f0531858640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f051006ebf0 0x7f0510071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7f0531057640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05100669d0 0x7f0510068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7ff6dce9c640 1 --2- 172.21.15.26:0/698891692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d80bd720 0x7ff6d8158350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80097c0 tx=0x7ff6c801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f967c85c34510b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7ff6cffff640 1 -- 172.21.15.26:0/698891692 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80c52d0 con 0x7ff6d80bd720 2023-11-28T16:56:24.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7ff6cffff640 1 -- 172.21.15.26:0/698891692 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c80a7050 con 0x7ff6d80bd720 2023-11-28T16:56:24.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7ff6cffff640 1 -- 172.21.15.26:0/698891692 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80ab820 con 0x7ff6d80bd720 2023-11-28T16:56:24.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff02c13d450 con 0x7ff0240da130 2023-11-28T16:56:24.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe728066360 con 0x7fe71000b560 2023-11-28T16:56:24.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe720013550 con 0x7fe71000b560 2023-11-28T16:56:24.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feec400cc10 con 0x7feec8007440 2023-11-28T16:56:24.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d80bd720 msgr2=0x7ff6d8158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7ff6df901640 1 --2- 172.21.15.26:0/698891692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d80bd720 0x7ff6d8158350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80097c0 tx=0x7ff6c801c380 comp rx=0 tx=0).stop 2023-11-28T16:56:24.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7f0531057640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05100669d0 0x7f0510068e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f05200ab000 tx=0x7f05200b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7feeb7fff640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feebc066960 0x7feebc068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.195+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feec4084510 con 0x7feec8007440 2023-11-28T16:56:24.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 shutdown_connections 2023-11-28T16:56:24.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7ff6df901640 1 --2- 172.21.15.26:0/698891692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d806cd90 0x7ff6d8158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7ff6df901640 1 --2- 172.21.15.26:0/698891692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d80bd720 0x7ff6d8158350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7f0531858640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f051006ebf0 0x7f0510071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 >> 172.21.15.26:0/698891692 conn(0x7ff6d8071ea0 msgr2=0x7ff6d80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7feece7fc640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feebc066960 0x7feebc068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7feeb7fff640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7feebc06eb00 0x7feebc070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 --> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feebc0715d0 con 0x7feebc06eb00 2023-11-28T16:56:24.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec4084880 con 0x7feec8007440 2023-11-28T16:56:24.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 shutdown_connections 2023-11-28T16:56:24.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7feecf7fe640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7feebc06eb00 0x7feebc070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7ff6df901640 1 -- 172.21.15.26:0/698891692 wait complete. 2023-11-28T16:56:24.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe716ffd640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7080669a0 0x7fe708068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe720085100 con 0x7fe71000b560 2023-11-28T16:56:24.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7feece7fc640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feebc066960 0x7feebc068e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feec00ad000 tx=0x7feec00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe716ffd640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fe70806ebc0 0x7fe708070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 --> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe708071690 con 0x7fe70806ebc0 2023-11-28T16:56:24.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7200854b0 con 0x7fe71000b560 2023-11-28T16:56:24.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== osd.2 v2:172.21.15.26:6824/210401114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f05100716c0 con 0x7f051006ebf0 2023-11-28T16:56:24.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fe70806ebc0 0x7fe708070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7feecf7fe640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7feebc06eb00 0x7feebc070f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe726d9d640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fe70806ebc0 0x7fe708070fe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7ff017fff640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff010066920 0x7ff010068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.199+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== osd.5 v2:172.21.15.79:6800/1334116605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe708071690 con 0x7fe70806ebc0 2023-11-28T16:56:24.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== osd.6 v2:172.21.15.79:6816/179635764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feebc0715d0 con 0x7feebc06eb00 2023-11-28T16:56:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7fe725d9b640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7080669a0 0x7fe708068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff02c124070 con 0x7ff0240da130 2023-11-28T16:56:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff02b7fe640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff010066920 0x7ff010068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff017fff640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7ff01006eb40 0x7ff010070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 --> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff010071610 con 0x7ff01006eb40 2023-11-28T16:56:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff02c199300 con 0x7ff0240da130 2023-11-28T16:56:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6df901640 1 Processor -- start 2023-11-28T16:56:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff02affd640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7ff01006eb40 0x7ff010070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6df901640 1 -- start start 2023-11-28T16:56:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6df901640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d806cd90 0x7ff6d81f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff02affd640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7ff01006eb40 0x7ff010070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6df901640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d80bd720 0x7ff6d814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6dd69d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d806cd90 0x7ff6d81f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6df901640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d80ca610 0x7ff6d814c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6dd69d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d806cd90 0x7ff6d81f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53270/0 (socket says 172.21.15.26:53270) 2023-11-28T16:56:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6dce9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d80bd720 0x7ff6d814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.203+0000 7ff6dce9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d80bd720 0x7ff6d814c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44204/0 (socket says 172.21.15.26:44204) 2023-11-28T16:56:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dd69d640 1 -- 172.21.15.26:0/671397941 learned_addr learned my addr 172.21.15.26:0/671397941 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dde9e640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d80ca610 0x7ff6d814c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6df901640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80be6f0 con 0x7ff6d806cd90 2023-11-28T16:56:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6df901640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d814cc70 con 0x7ff6d80ca610 2023-11-28T16:56:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6df901640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d81f15e0 con 0x7ff6d80bd720 2023-11-28T16:56:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff02b7fe640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff010066920 0x7ff010068de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff018000f70 tx=0x7ff0180079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7fe725d9b640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7080669a0 0x7fe708068e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7280c4f20 tx=0x7fe71c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dce9c640 1 -- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d80ca610 msgr2=0x7ff6d814c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dce9c640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d80ca610 0x7ff6d814c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dce9c640 1 -- 172.21.15.26:0/671397941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d806cd90 msgr2=0x7ff6d81f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== osd.4 v2:172.21.15.79:6808/3750285918 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff010071610 con 0x7ff01006eb40 2023-11-28T16:56:24.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dce9c640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d806cd90 0x7ff6d81f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dce9c640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8009420 con 0x7ff6d80bd720 2023-11-28T16:56:24.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7ff6dd69d640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d806cd90 0x7ff6d81f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:24.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.207+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 --> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fdc04e890 con 0x7f2fc006eb30 2023-11-28T16:56:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7ff6dce9c640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d80bd720 0x7ff6d814c1f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80ab000 tx=0x7ff6c801abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fd27fc640 1 -- 172.21.15.26:0/3455420343 <== osd.1 v2:172.21.15.26:6808/428800688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fdc04e890 con 0x7f2fc006eb30 2023-11-28T16:56:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80b7650 con 0x7ff6d80bd720 2023-11-28T16:56:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c80b77b0 con 0x7ff6d80bd720 2023-11-28T16:56:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80b7b60 con 0x7ff6d80bd720 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f2fc006eb30 msgr2=0x7f2fc0070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f2fc006eb30 0x7f2fc0070f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc0066990 msgr2=0x7f2fc0068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc0066990 0x7f2fc0068e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40af000 tx=0x7f2fd40a7070 comp rx=0 tx=0).stop 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc0bf940 msgr2=0x7f2fdc0c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 --2- 172.21.15.26:0/3455420343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fdc0bf940 0x7f2fdc0c3de0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c520 tx=0x7f2fd800c9e0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe21a6640 1 -- 172.21.15.26:0/3455420343 reap_dead start 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 shutdown_connections 2023-11-28T16:56:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.215+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 >> 172.21.15.26:0/3455420343 conn(0x7f2fdc0c5fd0 msgr2=0x7f2fdc06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.219+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 shutdown_connections 2023-11-28T16:56:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.219+0000 7f2fe29a7640 1 -- 172.21.15.26:0/3455420343 wait complete. 2023-11-28T16:56:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.219+0000 7ff6df901640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d80be310 con 0x7ff6d80bd720 2023-11-28T16:56:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.219+0000 7ff6df901640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d80c0890 con 0x7ff6d80bd720 2023-11-28T16:56:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.219+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6d80c5340 con 0x7ff6d80bd720 2023-11-28T16:56:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.219+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 --> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a080c42e0 con 0x7f99f406ebc0 2023-11-28T16:56:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 --> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6528002cc0 con 0x7f652406ead0 2023-11-28T16:56:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f99effff640 1 -- 172.21.15.26:0/477486574 <== osd.3 v2:172.21.15.26:6809/3338490031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a080c42e0 con 0x7f99f406ebc0 2023-11-28T16:56:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.219+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff6c80b7cc0 con 0x7ff6d80bd720 2023-11-28T16:56:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f653b7fe640 1 -- 172.21.15.26:0/1839963449 <== osd.0 v2:172.21.15.26:6800/3368065621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6528002cc0 con 0x7f652406ead0 2023-11-28T16:56:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6cdffb640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff6bc0668d0 0x7ff6bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6c811eb10 con 0x7ff6d80bd720 2023-11-28T16:56:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f652406ead0 msgr2=0x7f6524070ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f652406ead0 0x7f6524070ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6524066930 msgr2=0x7f6524068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6524066930 0x7f6524068df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f652c0ad000 tx=0x7f652c004780 comp rx=0 tx=0).stop 2023-11-28T16:56:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300047d0 msgr2=0x7f654414cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 --2- 172.21.15.26:0/1839963449 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65300047d0 0x7f654414cc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6534011c00 tx=0x7f653400f540 comp rx=0 tx=0).stop 2023-11-28T16:56:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6cdffb640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7ff6bc06eaf0 0x7ff6bc070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6bc0715c0 con 0x7ff6bc06eaf0 2023-11-28T16:56:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6c81232a0 con 0x7ff6d80bd720 2023-11-28T16:56:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6dd69d640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff6bc0668d0 0x7ff6bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f65437fe640 1 -- 172.21.15.26:0/1839963449 reap_dead start 2023-11-28T16:56:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 shutdown_connections 2023-11-28T16:56:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 >> 172.21.15.26:0/1839963449 conn(0x7f65440c5fd0 msgr2=0x7f65440c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6dde9e640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7ff6bc06eaf0 0x7ff6bc070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7ff6dd69d640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff6bc0668d0 0x7ff6bc068d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4005890 tx=0x7ff6d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 shutdown_connections 2023-11-28T16:56:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f6543fff640 1 -- 172.21.15.26:0/1839963449 wait complete. 2023-11-28T16:56:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7f99f406ebc0 msgr2=0x7f99f4070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.223+0000 7f9a0d955640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7f99f406ebc0 0x7f99f4070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99f40669a0 msgr2=0x7f99f4068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99f40669a0 0x7f99f4068e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a08157a50 tx=0x7f9a0000b040 comp rx=0 tx=0).stop 2023-11-28T16:56:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a08152ce0 msgr2=0x7f9a080c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 --2- 172.21.15.26:0/477486574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a08152ce0 0x7f9a080c4610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a08070050 tx=0x7f99f800c890 comp rx=0 tx=0).stop 2023-11-28T16:56:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a077fe640 1 -- 172.21.15.26:0/477486574 reap_dead start 2023-11-28T16:56:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 shutdown_connections 2023-11-28T16:56:24.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 >> 172.21.15.26:0/477486574 conn(0x7f9a080c2ad0 msgr2=0x7f9a08156710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 shutdown_connections 2023-11-28T16:56:24.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f9a0d955640 1 -- 172.21.15.26:0/477486574 wait complete. 2023-11-28T16:56:24.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 --> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05240052a0 con 0x7f051006ebf0 2023-11-28T16:56:24.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f051dffb640 1 -- 172.21.15.26:0/3985052958 <== osd.2 v2:172.21.15.26:6824/210401114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05240052a0 con 0x7f051006ebf0 2023-11-28T16:56:24.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f051006ebf0 msgr2=0x7f0510071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7f0532059640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f051006ebf0 0x7f0510071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.227+0000 7ff6dde9e640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7ff6bc06eaf0 0x7ff6bc070f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05100669d0 msgr2=0x7f0510068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05100669d0 0x7f0510068e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f05200ab000 tx=0x7f05200b1040 comp rx=0 tx=0).stop 2023-11-28T16:56:24.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f052417ad60 msgr2=0x7f0524176140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 --2- 172.21.15.26:0/3985052958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f052417ad60 0x7f0524176140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f052c079b30 tx=0x7f052c068000 comp rx=0 tx=0).stop 2023-11-28T16:56:24.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0531858640 1 -- 172.21.15.26:0/3985052958 reap_dead start 2023-11-28T16:56:24.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 shutdown_connections 2023-11-28T16:56:24.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 >> 172.21.15.26:0/3985052958 conn(0x7f0524005ec0 msgr2=0x7f0524042c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== osd.7 v2:172.21.15.79:6824/3002149091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff6bc0715c0 con 0x7ff6bc06eaf0 2023-11-28T16:56:24.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 --> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7280c27c0 con 0x7fe70806ebc0 2023-11-28T16:56:24.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 shutdown_connections 2023-11-28T16:56:24.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 --> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feec8046870 con 0x7feebc06eb00 2023-11-28T16:56:24.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7f0532059640 1 -- 172.21.15.26:0/3985052958 wait complete. 2023-11-28T16:56:24.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe716ffd640 1 -- 172.21.15.26:0/3376730343 <== osd.5 v2:172.21.15.79:6800/1334116605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7280c27c0 con 0x7fe70806ebc0 2023-11-28T16:56:24.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fe70806ebc0 msgr2=0x7fe708070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe72c93e640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fe70806ebc0 0x7fe708070fe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.231+0000 7feeb7fff640 1 -- 172.21.15.26:0/3835780240 <== osd.6 v2:172.21.15.79:6816/179635764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feec8046870 con 0x7feebc06eb00 2023-11-28T16:56:24.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7feebc06eb00 msgr2=0x7feebc070f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7feebc06eb00 0x7feebc070f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feebc066960 msgr2=0x7feebc068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feebc066960 0x7feebc068e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feec00ad000 tx=0x7feec00a6000 comp rx=0 tx=0).stop 2023-11-28T16:56:24.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec8007440 msgr2=0x7feec8177f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 --2- 172.21.15.26:0/3835780240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec8007440 0x7feec8177f30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feec400e890 tx=0x7feec400ed50 comp rx=0 tx=0).stop 2023-11-28T16:56:24.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feecf7fe640 1 -- 172.21.15.26:0/3835780240 reap_dead start 2023-11-28T16:56:24.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 shutdown_connections 2023-11-28T16:56:24.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 >> 172.21.15.26:0/3835780240 conn(0x7feec8048260 msgr2=0x7feec8048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 --> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff024000f50 con 0x7ff01006eb40 2023-11-28T16:56:24.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff017fff640 1 -- 172.21.15.26:0/2193429664 <== osd.4 v2:172.21.15.79:6808/3750285918 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff024000f50 con 0x7ff01006eb40 2023-11-28T16:56:24.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7ff01006eb40 msgr2=0x7ff010070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7ff01006eb40 0x7ff010070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff010066920 msgr2=0x7ff010068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff010066920 0x7ff010068de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff018000f70 tx=0x7ff0180079c0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 msgr2=0x7ff024176a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 --2- 172.21.15.26:0/2193429664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240da130 0x7ff024176a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff02c04fe80 tx=0x7ff02c0690f0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7080669a0 msgr2=0x7fe708068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe72c93e640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7080669a0 0x7fe708068e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7280c4f20 tx=0x7fe71c008040 comp rx=0 tx=0).stop 2023-11-28T16:56:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 msgr2=0x7fe7281ec230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe72c93e640 1 --2- 172.21.15.26:0/3376730343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71000b560 0x7fe7281ec230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7200072c0 tx=0x7fe720007780 comp rx=0 tx=0).stop 2023-11-28T16:56:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff02bfff640 1 -- 172.21.15.26:0/2193429664 reap_dead start 2023-11-28T16:56:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 shutdown_connections 2023-11-28T16:56:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 >> 172.21.15.26:0/2193429664 conn(0x7ff024048230 msgr2=0x7ff024005e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.235+0000 7fe726d9d640 1 -- 172.21.15.26:0/3376730343 reap_dead start 2023-11-28T16:56:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 shutdown_connections 2023-11-28T16:56:24.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 >> 172.21.15.26:0/3376730343 conn(0x7fe7280c2ad0 msgr2=0x7fe728154100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 shutdown_connections 2023-11-28T16:56:24.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7feed5809640 1 -- 172.21.15.26:0/3835780240 wait complete. 2023-11-28T16:56:24.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 shutdown_connections 2023-11-28T16:56:24.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7ff0309d0640 1 -- 172.21.15.26:0/2193429664 wait complete. 2023-11-28T16:56:24.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 shutdown_connections 2023-11-28T16:56:24.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.239+0000 7fe72c93e640 1 -- 172.21.15.26:0/3376730343 wait complete. 2023-11-28T16:56:24.304 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-11-28T16:56:24.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.259+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 --> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6d80c5a80 con 0x7ff6bc06eaf0 2023-11-28T16:56:24.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T16:56:24.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.259+0000 7ff6cdffb640 1 -- 172.21.15.26:0/671397941 <== osd.7 v2:172.21.15.79:6824/3002149091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6d80c5a80 con 0x7ff6bc06eaf0 2023-11-28T16:56:24.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7ff6bc06eaf0 msgr2=0x7ff6bc070f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7ff6bc06eaf0 0x7ff6bc070f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff6bc0668d0 msgr2=0x7ff6bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff6bc0668d0 0x7ff6bc068d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4005890 tx=0x7ff6d4009040 comp rx=0 tx=0).stop 2023-11-28T16:56:24.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d80bd720 msgr2=0x7ff6d814c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 --2- 172.21.15.26:0/671397941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d80bd720 0x7ff6d814c1f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80ab000 tx=0x7ff6c801abc0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6dde9e640 1 -- 172.21.15.26:0/671397941 reap_dead start 2023-11-28T16:56:24.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 shutdown_connections 2023-11-28T16:56:24.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.263+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 >> 172.21.15.26:0/671397941 conn(0x7ff6d8071ea0 msgr2=0x7ff6d8158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.308 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-11-28T16:56:24.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T16:56:24.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.267+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 shutdown_connections 2023-11-28T16:56:24.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.267+0000 7ff6bb7fe640 1 -- 172.21.15.26:0/671397941 wait complete. 2023-11-28T16:56:24.309 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-11-28T16:56:24.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T16:56:24.310 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-11-28T16:56:24.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T16:56:24.311 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:24.312 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T16:56:24.312 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-11-28T16:56:24.313 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T16:56:24.313 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:24.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T16:56:24.315 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:24.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T16:56:24.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.587+0000 7f1e2e6c9640 1 Processor -- start 2023-11-28T16:56:24.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.587+0000 7f1e2e6c9640 1 -- start start 2023-11-28T16:56:24.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2e6c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e2814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2e6c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e2806c400 0x7f1e280c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2e6c9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1e2806bee0 0x7f1e280c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2e6c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e28071440 con 0x7f1e2806c400 2023-11-28T16:56:24.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2e6c9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e28151100 con 0x7f1e2806bee0 2023-11-28T16:56:24.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2e6c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28071f90 con 0x7f1e280c6930 2023-11-28T16:56:24.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e277fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e2806c400 0x7f1e280c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e27fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e2814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1e2806bee0 0x7f1e280c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1e2806bee0 0x7f1e280c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52274/0 (socket says 172.21.15.26:52274) 2023-11-28T16:56:24.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 -- 172.21.15.26:0/389041309 learned_addr learned my addr 172.21.15.26:0/389041309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 -- 172.21.15.26:0/389041309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 msgr2=0x7f1e2814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 --2- 172.21.15.26:0/389041309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e2814dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 -- 172.21.15.26:0/389041309 >> v2:172.21.15.26:3300/0 conn(0x7f1e2806c400 msgr2=0x7f1e280c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 --2- 172.21.15.26:0/389041309 >> v2:172.21.15.26:3300/0 conn(0x7f1e2806c400 0x7f1e280c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.591+0000 7f1e2cc66640 1 -- 172.21.15.26:0/389041309 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2814e100 con 0x7f1e2806bee0 2023-11-28T16:56:24.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.595+0000 7f9ad9d80640 1 Processor -- start 2023-11-28T16:56:24.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.595+0000 7f9ad9d80640 1 -- start start 2023-11-28T16:56:24.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.595+0000 7f1e2cc66640 1 --2- 172.21.15.26:0/389041309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806bee0 0x7f1e280c1270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e28070b60 tx=0x7f1e2001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b86bae3e6950fcb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.595+0000 7f1e26ffd640 1 -- 172.21.15.26:0/389041309 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200a5780 con 0x7f1e2806bee0 2023-11-28T16:56:24.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.595+0000 7f1e26ffd640 1 -- 172.21.15.26:0/389041309 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e200a58e0 con 0x7f1e2806bee0 2023-11-28T16:56:24.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.595+0000 7f1e26ffd640 1 -- 172.21.15.26:0/389041309 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200a5cb0 con 0x7f1e2806bee0 2023-11-28T16:56:24.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9ad414dd10 0x7f9ad40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43958/0 (socket says 172.21.15.26:43958) 2023-11-28T16:56:24.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad9d80640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ad4150840 0x7f9ad4070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad2ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ad406d020 0x7f9ad4070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34032/0 (socket says 172.21.15.26:34032) 2023-11-28T16:56:24.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ad4150840 0x7f9ad4070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ad4150840 0x7f9ad4070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52288/0 (socket says 172.21.15.26:52288) 2023-11-28T16:56:24.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad406c070 con 0x7f9ad414dd10 2023-11-28T16:56:24.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad406c350 con 0x7f9ad406d020 2023-11-28T16:56:24.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40a8b00 con 0x7f9ad4150840 2023-11-28T16:56:24.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad37fe640 1 -- 172.21.15.26:0/1367468736 learned_addr learned my addr 172.21.15.26:0/1367468736 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad3fff640 1 -- 172.21.15.26:0/1367468736 >> v1:172.21.15.79:6789/0 conn(0x7f9ad406d020 legacy=0x7f9ad4070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/389041309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806bee0 msgr2=0x7f1e280c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/389041309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806bee0 0x7f1e280c1270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e28070b60 tx=0x7f1e2001c9f0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/389041309 shutdown_connections 2023-11-28T16:56:24.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/389041309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806bee0 0x7f1e280c1270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/389041309 >> v2:172.21.15.26:3300/0 conn(0x7f1e2806c400 0x7f1e280c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/389041309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e2814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/389041309 >> 172.21.15.26:0/389041309 conn(0x7f1e280c5e10 msgr2=0x7f1e280c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7f9ad3fff640 1 -- 172.21.15.26:0/1367468736 >> v1:172.21.15.26:6789/0 conn(0x7f9ad414dd10 legacy=0x7f9ad40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.599+0000 7fa4ee156640 1 Processor -- start 2023-11-28T16:56:24.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7f9ad3fff640 1 -- 172.21.15.26:0/1367468736 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad406c630 con 0x7f9ad4150840 2023-11-28T16:56:24.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ee156640 1 -- start start 2023-11-28T16:56:24.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/389041309 shutdown_connections 2023-11-28T16:56:24.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/389041309 wait complete. 2023-11-28T16:56:24.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ee156640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e003e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ee156640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4e00074d0 0x7fa4e00e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ee156640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e0048090 con 0x7fa4e004b2e0 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ee156640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e002e130 con 0x7fa4e00074d0 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ee156640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0047510 con 0x7fa4e00dbd20 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ed154640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e003e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ed154640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e003e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44220/0 (socket says 172.21.15.26:44220) 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ed154640 1 -- 172.21.15.26:0/2788749497 learned_addr learned my addr 172.21.15.26:0/2788749497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ed154640 1 -- 172.21.15.26:0/2788749497 >> v2:172.21.15.26:3300/0 conn(0x7fa4e00074d0 msgr2=0x7fa4e00e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ed154640 1 --2- 172.21.15.26:0/2788749497 >> v2:172.21.15.26:3300/0 conn(0x7fa4e00074d0 0x7fa4e00e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ed154640 1 -- 172.21.15.26:0/2788749497 >> v1:172.21.15.26:6789/0 conn(0x7fa4e004b2e0 legacy=0x7fa4e0006dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.603+0000 7fa4ed154640 1 -- 172.21.15.26:0/2788749497 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00477f0 con 0x7fa4e00dbd20 2023-11-28T16:56:24.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 Processor -- start 2023-11-28T16:56:24.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 -- start start 2023-11-28T16:56:24.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f9ad3fff640 1 --2- 172.21.15.26:0/1367468736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad4150840 0x7f9ad4070a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80097c0 tx=0x7f9ac801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3d87fe5060da4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f9ad27fc640 1 -- 172.21.15.26:0/1367468736 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80ab600 con 0x7f9ad4150840 2023-11-28T16:56:24.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2806bee0 0x7f1e28148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f9ad27fc640 1 -- 172.21.15.26:0/1367468736 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac80a7050 con 0x7f9ad4150840 2023-11-28T16:56:24.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f9ad27fc640 1 -- 172.21.15.26:0/1367468736 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80ab600 con 0x7f9ad4150840 2023-11-28T16:56:24.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806c400 0x7f1e28147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e281e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2814aeb0 con 0x7f1e2806bee0 2023-11-28T16:56:24.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e281ec5a0 con 0x7f1e2806c400 2023-11-28T16:56:24.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2e6c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2813ef90 con 0x7f1e280c6930 2023-11-28T16:56:24.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2806bee0 0x7f1e28148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2806bee0 0x7f1e28148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53292/0 (socket says 172.21.15.26:53292) 2023-11-28T16:56:24.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e27fff640 1 -- 172.21.15.26:0/3937786186 learned_addr learned my addr 172.21.15.26:0/3937786186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e277fe640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806c400 0x7f1e28147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f1e2cc66640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e281e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad4150840 msgr2=0x7f9ad4070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.607+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/1367468736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad4150840 0x7f9ad4070a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80097c0 tx=0x7f9ac801c280 comp rx=0 tx=0).stop 2023-11-28T16:56:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 shutdown_connections 2023-11-28T16:56:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/1367468736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad4150840 0x7f9ad4070a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 >> 172.21.15.26:0/1367468736 conn(0x7f9ad40c2ad0 msgr2=0x7f9ad40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e277fe640 1 -- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 msgr2=0x7f1e281e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e277fe640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e281e9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e277fe640 1 -- 172.21.15.26:0/3937786186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2806bee0 msgr2=0x7f1e28148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e277fe640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2806bee0 0x7f1e28148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e277fe640 1 -- 172.21.15.26:0/3937786186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e20009b30 con 0x7f1e2806c400 2023-11-28T16:56:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 shutdown_connections 2023-11-28T16:56:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f9ad9d80640 1 -- 172.21.15.26:0/1367468736 wait complete. 2023-11-28T16:56:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e277fe640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806c400 0x7f1e28147500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e1801e4c0 tx=0x7f1e1801e980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1c2530f640 1 Processor -- start 2023-11-28T16:56:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e24ff9640 1 -- 172.21.15.26:0/3937786186 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18023760 con 0x7f1e2806c400 2023-11-28T16:56:24.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e24ff9640 1 -- 172.21.15.26:0/3937786186 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18020040 con 0x7f1e2806c400 2023-11-28T16:56:24.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1c2530f640 1 -- start start 2023-11-28T16:56:24.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7fa4ed154640 1 --2- 172.21.15.26:0/2788749497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e003e780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009870 tx=0x7fa4e401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b67effbd3d96adaa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e24ff9640 1 -- 172.21.15.26:0/3937786186 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18023ae0 con 0x7f1e2806c400 2023-11-28T16:56:24.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2814b100 con 0x7f1e2806c400 2023-11-28T16:56:24.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e281ec230 con 0x7f1e2806c400 2023-11-28T16:56:24.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f9ad9d80640 1 Processor -- start 2023-11-28T16:56:24.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7fa4dffff640 1 -- 172.21.15.26:0/2788749497 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40aa610 con 0x7fa4e00dbd20 2023-11-28T16:56:24.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7fa4dffff640 1 -- 172.21.15.26:0/2788749497 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e40a6040 con 0x7fa4e00dbd20 2023-11-28T16:56:24.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7fa4dffff640 1 -- 172.21.15.26:0/2788749497 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40aa990 con 0x7fa4e00dbd20 2023-11-28T16:56:24.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7fd92ee79640 1 Processor -- start 2023-11-28T16:56:24.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f9ad9d80640 1 -- start start 2023-11-28T16:56:24.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1c2530f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c20152ce0 0x7f1c2006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1c2530f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c200700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1c2530f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2006bea0 con 0x7f1c200705e0 2023-11-28T16:56:24.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1c2530f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c20159b10 con 0x7f1c20152ce0 2023-11-28T16:56:24.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.611+0000 7f1c2530f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20159550 con 0x7f1c2006db80 2023-11-28T16:56:24.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e281ec710 con 0x7f1e2806c400 2023-11-28T16:56:24.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd92ee79640 1 -- start start 2023-11-28T16:56:24.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1c200705e0 0x7f1c200c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43972/0 (socket says 172.21.15.26:43972) 2023-11-28T16:56:24.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1f7fe640 1 -- 172.21.15.26:0/794498746 learned_addr learned my addr 172.21.15.26:0/794498746 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad9d80640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ad406d020 0x7f9ad4148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad9d80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad414dd10 0x7f9ad415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad9d80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad4150840 0x7f9ad40a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad9d80640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad415f9c0 con 0x7f9ad4150840 2023-11-28T16:56:24.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad9d80640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41f15f0 con 0x7f9ad414dd10 2023-11-28T16:56:24.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad9d80640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41f2130 con 0x7f9ad406d020 2023-11-28T16:56:24.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 -- 172.21.15.26:0/2788749497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 msgr2=0x7fa4e003e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 --2- 172.21.15.26:0/2788749497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e003e780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009870 tx=0x7fa4e401c4f0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1effd640 1 --2- 172.21.15.26:0/794498746 >> v2:172.21.15.79:3300/0 conn(0x7f1c20152ce0 0x7f1c2006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad37fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ad406d020 0x7f9ad4148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad414dd10 0x7f9ad415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad414dd10 0x7f9ad415f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52308/0 (socket says 172.21.15.26:52308) 2023-11-28T16:56:24.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 -- 172.21.15.26:0/597946052 learned_addr learned my addr 172.21.15.26:0/597946052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 -- 172.21.15.26:0/2788749497 shutdown_connections 2023-11-28T16:56:24.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 --2- 172.21.15.26:0/2788749497 >> v2:172.21.15.26:3300/0 conn(0x7fa4e00074d0 0x7fa4e00e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 --2- 172.21.15.26:0/2788749497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e003e780 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 -- 172.21.15.26:0/2788749497 >> 172.21.15.26:0/2788749497 conn(0x7fa4e0005ec0 msgr2=0x7fa4e00062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1e7fc640 1 --2- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c200700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1e24ff9640 1 -- 172.21.15.26:0/3937786186 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1e18023c40 con 0x7f1e2806c400 2023-11-28T16:56:24.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad3fff640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad4150840 0x7f9ad40a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 -- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ad406d020 msgr2=0x7f9ad4148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ad406d020 0x7f9ad4148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 -- 172.21.15.26:0/597946052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad4150840 msgr2=0x7f9ad40a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad4150840 0x7f9ad40a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 -- 172.21.15.26:0/597946052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8009420 con 0x7f9ad414dd10 2023-11-28T16:56:24.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad3fff640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad4150840 0x7f9ad40a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:24.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1effd640 1 -- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 msgr2=0x7f1c200700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd92ee79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd928152ce0 0x7fd92806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1effd640 1 --2- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c200700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd92ee79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd92806d100 0x7fd9280c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd92ee79640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92806bea0 con 0x7fd92806db80 2023-11-28T16:56:24.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd92ee79640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd928159b10 con 0x7fd92806d100 2023-11-28T16:56:24.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd92ee79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd928159550 con 0x7fd928152ce0 2023-11-28T16:56:24.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 -- 172.21.15.26:0/2788749497 shutdown_connections 2023-11-28T16:56:24.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1effd640 1 -- 172.21.15.26:0/794498746 >> v1:172.21.15.26:6789/0 conn(0x7f1c200705e0 legacy=0x7f1c200c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1e24ff9640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e140669a0 0x7f1e14068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fa4ee156640 1 -- 172.21.15.26:0/2788749497 wait complete. 2023-11-28T16:56:24.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd927fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd92806db80 0x7fd9280700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34042/0 (socket says 172.21.15.26:34042) 2023-11-28T16:56:24.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7fd927fff640 1 -- 172.21.15.26:0/567805205 learned_addr learned my addr 172.21.15.26:0/567805205 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f9ad2ffd640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad414dd10 0x7f9ad415f050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c730 tx=0x7f9acc00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1e24ff9640 1 -- 172.21.15.26:0/3937786186 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e18094c80 con 0x7f1e2806c400 2023-11-28T16:56:24.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.615+0000 7f1c1effd640 1 -- 172.21.15.26:0/794498746 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20159830 con 0x7f1c20152ce0 2023-11-28T16:56:24.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7f1e27fff640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e140669a0 0x7f1e14068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fd92d416640 1 --2- 172.21.15.26:0/567805205 >> v2:172.21.15.79:3300/0 conn(0x7fd92806d100 0x7fd9280c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fd92cc15640 1 --2- 172.21.15.26:0/567805205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd928152ce0 0x7fd92806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fd92cc15640 1 -- 172.21.15.26:0/567805205 >> v2:172.21.15.79:3300/0 conn(0x7fd92806d100 msgr2=0x7fd9280c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fd92cc15640 1 --2- 172.21.15.26:0/567805205 >> v2:172.21.15.79:3300/0 conn(0x7fd92806d100 0x7fd9280c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fd92cc15640 1 -- 172.21.15.26:0/567805205 >> v1:172.21.15.79:6789/0 conn(0x7fd92806db80 legacy=0x7fd9280700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fd92cc15640 1 -- 172.21.15.26:0/567805205 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928159830 con 0x7fd928152ce0 2023-11-28T16:56:24.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7f1e27fff640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e140669a0 0x7f1e14068e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ab10 tx=0x7f1e1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fa4ee156640 1 Processor -- start 2023-11-28T16:56:24.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.619+0000 7fa4ee156640 1 -- start start 2023-11-28T16:56:24.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ee156640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00074d0 0x7fa4e00da8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ee156640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e004b2e0 0x7fa4e00cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ee156640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ee156640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00d8780 con 0x7fa4e004b2e0 2023-11-28T16:56:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ee156640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00ce3f0 con 0x7fa4e00074d0 2023-11-28T16:56:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ee156640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00d84a0 con 0x7fa4e00dbd20 2023-11-28T16:56:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00074d0 0x7fa4e00da8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00074d0 0x7fa4e00da8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52324/0 (socket says 172.21.15.26:52324) 2023-11-28T16:56:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 -- 172.21.15.26:0/4107458900 learned_addr learned my addr 172.21.15.26:0/4107458900 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f9abbfff640 1 -- 172.21.15.26:0/597946052 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00ce40 con 0x7f9ad414dd10 2023-11-28T16:56:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f9abbfff640 1 -- 172.21.15.26:0/597946052 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc00a5e0 con 0x7f9ad414dd10 2023-11-28T16:56:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f9abbfff640 1 -- 172.21.15.26:0/597946052 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00a950 con 0x7f9ad414dd10 2023-11-28T16:56:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd92cc15640 1 --2- 172.21.15.26:0/567805205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd928152ce0 0x7fd92806c940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0097c0 tx=0x7fd91c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f848372eb923a39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ec953640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e004b2e0 0x7fa4e00cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed955640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad41f25c0 con 0x7f9ad414dd10 2023-11-28T16:56:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad41f1ae0 con 0x7f9ad414dd10 2023-11-28T16:56:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f1e24ff9640 1 -- 172.21.15.26:0/3937786186 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e1809b080 con 0x7f1e2806c400 2023-11-28T16:56:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 -- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 msgr2=0x7fa4e00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e00cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 -- 172.21.15.26:0/4107458900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e004b2e0 msgr2=0x7fa4e00cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e004b2e0 0x7fa4e00cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 -- 172.21.15.26:0/4107458900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e40094d0 con 0x7fa4e00074d0 2023-11-28T16:56:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ec953640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e004b2e0 0x7fa4e00cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd9277fe640 1 -- 172.21.15.26:0/567805205 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0ab5f0 con 0x7fd928152ce0 2023-11-28T16:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd9277fe640 1 -- 172.21.15.26:0/567805205 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c0ab750 con 0x7fd928152ce0 2023-11-28T16:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd9277fe640 1 -- 172.21.15.26:0/567805205 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0abae0 con 0x7fd928152ce0 2023-11-28T16:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f73555c4640 1 Processor -- start 2023-11-28T16:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f1c1effd640 1 --2- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 0x7f1c2006c940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c100097c0 tx=0x7f1c1001c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbc9cdb3ac9bb1e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ed154640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00074d0 0x7fa4e00da8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40ac040 tx=0x7fa4e4019290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f73555c4640 1 -- start start 2023-11-28T16:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad41f22e0 con 0x7f9ad414dd10 2023-11-28T16:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ddffb640 1 -- 172.21.15.26:0/4107458900 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40bf680 con 0x7fa4e00074d0 2023-11-28T16:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ddffb640 1 -- 172.21.15.26:0/4107458900 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e40b8070 con 0x7fa4e00074d0 2023-11-28T16:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f1c1dffb640 1 -- 172.21.15.26:0/794498746 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100ab600 con 0x7f1c20152ce0 2023-11-28T16:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ddffb640 1 -- 172.21.15.26:0/4107458900 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40bfa60 con 0x7fa4e00074d0 2023-11-28T16:56:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f1c1dffb640 1 -- 172.21.15.26:0/794498746 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c100a7050 con 0x7f1c20152ce0 2023-11-28T16:56:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f1c1dffb640 1 -- 172.21.15.26:0/794498746 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100ab980 con 0x7f1c20152ce0 2023-11-28T16:56:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e00e2750 con 0x7fa4e00074d0 2023-11-28T16:56:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd92ee79640 1 -- 172.21.15.26:0/567805205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd928152ce0 msgr2=0x7fd92806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd92ee79640 1 --2- 172.21.15.26:0/567805205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd928152ce0 0x7fd92806c940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0097c0 tx=0x7fd91c01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e00db1c0 con 0x7fa4e00074d0 2023-11-28T16:56:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd92ee79640 1 -- 172.21.15.26:0/567805205 shutdown_connections 2023-11-28T16:56:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd92ee79640 1 --2- 172.21.15.26:0/567805205 >> v2:172.21.15.79:3300/0 conn(0x7fd92806d100 0x7fd9280c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd92ee79640 1 --2- 172.21.15.26:0/567805205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd928152ce0 0x7fd92806c940 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0097c0 tx=0x7fd91c01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7fd92ee79640 1 -- 172.21.15.26:0/567805205 >> 172.21.15.26:0/567805205 conn(0x7fd9280c2ad0 msgr2=0x7fd9280c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7fd92ee79640 1 -- 172.21.15.26:0/567805205 shutdown_connections 2023-11-28T16:56:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7fd92ee79640 1 -- 172.21.15.26:0/567805205 wait complete. 2023-11-28T16:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f1c2530f640 1 -- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 msgr2=0x7f1c2006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.623+0000 7f1c2530f640 1 --2- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 0x7f1c2006c940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c100097c0 tx=0x7f1c1001c280 comp rx=0 tx=0).stop 2023-11-28T16:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f1c2530f640 1 -- 172.21.15.26:0/794498746 shutdown_connections 2023-11-28T16:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f1c2530f640 1 --2- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c200700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f1c2530f640 1 --2- 172.21.15.26:0/794498746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 0x7f1c2006c940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f1c2530f640 1 -- 172.21.15.26:0/794498746 >> 172.21.15.26:0/794498746 conn(0x7f1c200c2ad0 msgr2=0x7f1c200c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f896785f640 1 Processor -- start 2023-11-28T16:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f896785f640 1 -- start start 2023-11-28T16:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e0042690 con 0x7fa4e00074d0 2023-11-28T16:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f73555c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f735006c0a0 0x7f735006c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f73555c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73500c65e0 0x7f73500c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f1c2530f640 1 -- 172.21.15.26:0/794498746 shutdown_connections 2023-11-28T16:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7fa87ec09640 1 Processor -- start 2023-11-28T16:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f73555c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73500c5b40 con 0x7f73500c77c0 2023-11-28T16:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f73555c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7350158880 con 0x7f73500c65e0 2023-11-28T16:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f73555c4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73500c5de0 con 0x7f735006c0a0 2023-11-28T16:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7fa87ec09640 1 -- start start 2023-11-28T16:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f896785f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89600bd720 0x7f8960158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f896785f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f896006cd90 0x7f8960158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f896785f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8960155790 con 0x7f89600ca610 2023-11-28T16:56:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f896785f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89600c4b00 con 0x7f89600bd720 2023-11-28T16:56:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f896785f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600c4de0 con 0x7f896006cd90 2023-11-28T16:56:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f734effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f735006c0a0 0x7f735006c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f734effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f735006c0a0 0x7f735006c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52330/0 (socket says 172.21.15.26:52330) 2023-11-28T16:56:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f734effd640 1 -- 172.21.15.26:0/3859137481 learned_addr learned my addr 172.21.15.26:0/3859137481 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f89655fb640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89600ca610 0x7f89600c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34058/0 (socket says 172.21.15.26:34058) 2023-11-28T16:56:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f89655fb640 1 -- 172.21.15.26:0/2211138955 learned_addr learned my addr 172.21.15.26:0/2211138955 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f8965dfc640 1 --2- 172.21.15.26:0/2211138955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f896006cd90 0x7f8960158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f8965dfc640 1 -- 172.21.15.26:0/2211138955 >> v2:172.21.15.26:3300/0 conn(0x7f89600bd720 msgr2=0x7f8960158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f8965dfc640 1 --2- 172.21.15.26:0/2211138955 >> v2:172.21.15.26:3300/0 conn(0x7f89600bd720 0x7f8960158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f8965dfc640 1 -- 172.21.15.26:0/2211138955 >> v1:172.21.15.79:6789/0 conn(0x7f89600ca610 legacy=0x7f89600c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f8965dfc640 1 -- 172.21.15.26:0/2211138955 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960157e30 con 0x7f896006cd90 2023-11-28T16:56:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa4ddffb640 1 -- 172.21.15.26:0/4107458900 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa4e40bfbc0 con 0x7fa4e00074d0 2023-11-28T16:56:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa87ec09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8780bd720 0x7fa878158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa87c9a5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa8780ca610 0x7fa8780c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34064/0 (socket says 172.21.15.26:34064) 2023-11-28T16:56:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa87c9a5640 1 -- 172.21.15.26:0/2616923123 learned_addr learned my addr 172.21.15.26:0/2616923123 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa878155790 con 0x7fa87806cd90 2023-11-28T16:56:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa4ddffb640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4cc0668d0 0x7fa4cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f1c2530f640 1 -- 172.21.15.26:0/794498746 wait complete. 2023-11-28T16:56:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f1c2530f640 1 Processor -- start 2023-11-28T16:56:24.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa4ddffb640 1 -- 172.21.15.26:0/4107458900 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4e40ba070 con 0x7fa4e00074d0 2023-11-28T16:56:24.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8780c4b00 con 0x7fa8780ca610 2023-11-28T16:56:24.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8780c4de0 con 0x7fa8780bd720 2023-11-28T16:56:24.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f734effd640 1 -- 172.21.15.26:0/3859137481 >> v2:172.21.15.26:3300/0 conn(0x7f73500c65e0 msgr2=0x7f73500c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f734effd640 1 --2- 172.21.15.26:0/3859137481 >> v2:172.21.15.26:3300/0 conn(0x7f73500c65e0 0x7f73500c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f734effd640 1 -- 172.21.15.26:0/3859137481 >> v1:172.21.15.26:6789/0 conn(0x7f73500c77c0 legacy=0x7f7350151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:24.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.627+0000 7f734effd640 1 -- 172.21.15.26:0/3859137481 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73500c60c0 con 0x7f735006c0a0 2023-11-28T16:56:24.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f9abbfff640 1 -- 172.21.15.26:0/597946052 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9acc00aab0 con 0x7f9ad414dd10 2023-11-28T16:56:24.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa4ec953640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4cc0668d0 0x7fa4cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f1c2530f640 1 -- start start 2023-11-28T16:56:24.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa86ffff640 1 --2- 172.21.15.26:0/2616923123 >> v2:172.21.15.26:3300/0 conn(0x7fa8780bd720 0x7fa878158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f8965dfc640 1 --2- 172.21.15.26:0/2211138955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f896006cd90 0x7f8960158890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8958009d90 tx=0x7f895801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e5755eeb639eded server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 Processor -- start 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 -- start start 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92806d100 0x7fd9280c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd92806db80 0x7fd92814bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd928143d50 0x7fd9281441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280c5e50 con 0x7fd928143d50 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928157f70 con 0x7fd92806d100 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92cc15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92806d100 0x7fd9280c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92cc15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92806d100 0x7fd9280c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52344/0 (socket says 172.21.15.26:52344) 2023-11-28T16:56:24.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92cc15640 1 -- 172.21.15.26:0/145157002 learned_addr learned my addr 172.21.15.26:0/145157002 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd927fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd92806db80 0x7fd92814bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92d416640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd928143d50 0x7fd9281441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9281581a0 con 0x7fd92806db80 2023-11-28T16:56:24.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f9abbfff640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9ac00668d0 0x7f9ac0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7fa4ec953640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4cc0668d0 0x7fa4cc068d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0007200 tx=0x7fa4d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c2530f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c201513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c2530f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c200705e0 0x7f1c2014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c2530f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 0x7f1c2014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c2530f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201ef400 con 0x7f1c200705e0 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c2530f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201ee7f0 con 0x7f1c20152ce0 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c2530f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201eead0 con 0x7f1c2006db80 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c201513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c201513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44300/0 (socket says 172.21.15.26:44300) 2023-11-28T16:56:24.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1effd640 1 -- 172.21.15.26:0/1076072909 learned_addr learned my addr 172.21.15.26:0/1076072909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.631+0000 7f8957fff640 1 -- 172.21.15.26:0/2211138955 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600c52d0 con 0x7f896006cd90 2023-11-28T16:56:24.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f8957fff640 1 -- 172.21.15.26:0/2211138955 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89580a5820 con 0x7f896006cd90 2023-11-28T16:56:24.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f8957fff640 1 -- 172.21.15.26:0/2211138955 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89580a5bb0 con 0x7f896006cd90 2023-11-28T16:56:24.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f9abbfff640 1 -- 172.21.15.26:0/597946052 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9acc083be0 con 0x7f9ad414dd10 2023-11-28T16:56:24.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f9ad37fe640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9ac00668d0 0x7f9ac0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fa4ddffb640 1 -- 172.21.15.26:0/4107458900 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4e40ec000 con 0x7fa4e00074d0 2023-11-28T16:56:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fa877fff640 1 -- 172.21.15.26:0/2616923123 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101135932 0 0) 0x7fa8780c4b00 con 0x7fa8780ca610 2023-11-28T16:56:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fa877fff640 1 -- 172.21.15.26:0/2616923123 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa864003530 con 0x7fa8780ca610 2023-11-28T16:56:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f734effd640 1 --2- 172.21.15.26:0/3859137481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f735006c0a0 0x7f735006c480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7350068a40 tx=0x7f734801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4355199082afa0ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd927fff640 1 -- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92806d100 msgr2=0x7fd9280c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd927fff640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92806d100 0x7fd9280c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd927fff640 1 -- 172.21.15.26:0/145157002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd928143d50 msgr2=0x7fd9281441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd927fff640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd928143d50 0x7fd9281441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd927fff640 1 -- 172.21.15.26:0/145157002 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c009420 con 0x7fd92806db80 2023-11-28T16:56:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd92cc15640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92806d100 0x7fd9280c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f9ad37fe640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9ac00668d0 0x7f9ac0068d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000f70 tx=0x7f9ac4007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd927fff640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd92806db80 0x7fd92814bc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c3c0 tx=0x7fd91400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd9257fa640 1 -- 172.21.15.26:0/145157002 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914005cf0 con 0x7fd92806db80 2023-11-28T16:56:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd9257fa640 1 -- 172.21.15.26:0/145157002 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd914005e50 con 0x7fd92806db80 2023-11-28T16:56:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd9257fa640 1 -- 172.21.15.26:0/145157002 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9140072d0 con 0x7fd92806db80 2023-11-28T16:56:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd928158440 con 0x7fd92806db80 2023-11-28T16:56:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd928158a00 con 0x7fd92806db80 2023-11-28T16:56:24.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 -- 172.21.15.26:0/2211138955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f896006cd90 msgr2=0x7f8960158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 --2- 172.21.15.26:0/2211138955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f896006cd90 0x7f8960158890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8958009d90 tx=0x7f895801c850 comp rx=0 tx=0).stop 2023-11-28T16:56:24.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 -- 172.21.15.26:0/2211138955 shutdown_connections 2023-11-28T16:56:24.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 --2- 172.21.15.26:0/2211138955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f896006cd90 0x7f8960158890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 --2- 172.21.15.26:0/2211138955 >> v2:172.21.15.26:3300/0 conn(0x7f89600bd720 0x7f8960158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 -- 172.21.15.26:0/2211138955 >> 172.21.15.26:0/2211138955 conn(0x7f8960071ea0 msgr2=0x7f89600722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 -- 172.21.15.26:0/2211138955 shutdown_connections 2023-11-28T16:56:24.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f896785f640 1 -- 172.21.15.26:0/2211138955 wait complete. 2023-11-28T16:56:24.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fa86ffff640 1 -- 172.21.15.26:0/2616923123 >> v1:172.21.15.79:6789/0 conn(0x7fa8780ca610 legacy=0x7fa8780c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fa86ffff640 1 -- 172.21.15.26:0/2616923123 >> v1:172.21.15.26:6789/0 conn(0x7fa87806cd90 legacy=0x7fa8780c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7fa86ffff640 1 -- 172.21.15.26:0/2616923123 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878157e30 con 0x7fa8780bd720 2023-11-28T16:56:24.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1e7fc640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c200705e0 0x7f1c2014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1f7fe640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 0x7f1c2014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1e7fc640 1 -- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 msgr2=0x7f1c201513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1e7fc640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c201513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1e7fc640 1 -- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 msgr2=0x7f1c2014c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1e7fc640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 0x7f1c2014c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1e7fc640 1 -- 172.21.15.26:0/1076072909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10009420 con 0x7f1c200705e0 2023-11-28T16:56:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1effd640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c201513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.635+0000 7f1c1e7fc640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c200705e0 0x7f1c2014c190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400d5c0 tx=0x7f1c1400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 Processor -- start 2023-11-28T16:56:24.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd928158c20 con 0x7fd92806db80 2023-11-28T16:56:24.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 -- start start 2023-11-28T16:56:24.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7fd9257fa640 1 -- 172.21.15.26:0/145157002 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd914007430 con 0x7fd92806db80 2023-11-28T16:56:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f734dffb640 1 -- 172.21.15.26:0/3859137481 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73480ab600 con 0x7f735006c0a0 2023-11-28T16:56:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f734dffb640 1 -- 172.21.15.26:0/3859137481 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73480a7050 con 0x7f735006c0a0 2023-11-28T16:56:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f734dffb640 1 -- 172.21.15.26:0/3859137481 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73480ab980 con 0x7f735006c0a0 2023-11-28T16:56:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f896006cd90 0x7f89601585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89600bd720 0x7f89601f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89600ca610 0x7f89601fce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600c1a10 con 0x7f896006cd90 2023-11-28T16:56:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960151d90 con 0x7f89600ca610 2023-11-28T16:56:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f896785f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89601f70e0 con 0x7f89600bd720 2023-11-28T16:56:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7fd9257fa640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd90c0668d0 0x7fd90c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7fd9257fa640 1 -- 172.21.15.26:0/145157002 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9140837b0 con 0x7fd92806db80 2023-11-28T16:56:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8965dfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89600ca610 0x7f89601fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8964dfa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89600bd720 0x7f89601f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8965dfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89600ca610 0x7f89601fce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52352/0 (socket says 172.21.15.26:52352) 2023-11-28T16:56:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8965dfc640 1 -- 172.21.15.26:0/2526910173 learned_addr learned my addr 172.21.15.26:0/2526910173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f9abbfff640 1 -- 172.21.15.26:0/597946052 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ad41f22e0 con 0x7f9ad414dd10 2023-11-28T16:56:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f1c077fe640 1 -- 172.21.15.26:0/1076072909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140125f0 con 0x7f1c200705e0 2023-11-28T16:56:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8964dfa640 1 -- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89600ca610 msgr2=0x7f89601fce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8964dfa640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89600ca610 0x7f89601fce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8964dfa640 1 -- 172.21.15.26:0/2526910173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f896006cd90 msgr2=0x7f89601585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f1c077fe640 1 -- 172.21.15.26:0/1076072909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14012750 con 0x7f1c200705e0 2023-11-28T16:56:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f1c077fe640 1 -- 172.21.15.26:0/1076072909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14012b00 con 0x7f1c200705e0 2023-11-28T16:56:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8964dfa640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f896006cd90 0x7f89601585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8964dfa640 1 -- 172.21.15.26:0/2526910173 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958009a70 con 0x7f89600bd720 2023-11-28T16:56:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.639+0000 7f8964dfa640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89600bd720 0x7f89601f3140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f895000b420 tx=0x7f895000b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c201eedb0 con 0x7f1c200705e0 2023-11-28T16:56:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c201ee4e0 con 0x7f1c200705e0 2023-11-28T16:56:24.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa86ffff640 1 --2- 172.21.15.26:0/2616923123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 0x7fa878158350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa860009d90 tx=0x7fa86001c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152c070da65649c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2004e890 con 0x7f1c200705e0 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa877fff640 1 -- 172.21.15.26:0/2616923123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780c52d0 con 0x7fa8780bd720 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa877fff640 1 -- 172.21.15.26:0/2616923123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8600a4e20 con 0x7fa8780bd720 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa877fff640 1 -- 172.21.15.26:0/2616923123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600ac660 con 0x7fa8780bd720 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 msgr2=0x7fa878158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa87ec09640 1 --2- 172.21.15.26:0/2616923123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 0x7fa878158350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa860009d90 tx=0x7fa86001c550 comp rx=0 tx=0).stop 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 shutdown_connections 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa87ec09640 1 --2- 172.21.15.26:0/2616923123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 0x7fa878158350 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 >> 172.21.15.26:0/2616923123 conn(0x7fa878071ea0 msgr2=0x7fa8780722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7f8955ffb640 1 -- 172.21.15.26:0/2526910173 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011830 con 0x7f89600bd720 2023-11-28T16:56:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7f8955ffb640 1 -- 172.21.15.26:0/2526910173 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950011990 con 0x7f89600bd720 2023-11-28T16:56:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7f8955ffb640 1 -- 172.21.15.26:0/2526910173 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011d40 con 0x7f89600bd720 2023-11-28T16:56:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7fd9257fa640 1 -- 172.21.15.26:0/145157002 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd914050a00 con 0x7fd92806db80 2023-11-28T16:56:24.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 shutdown_connections 2023-11-28T16:56:24.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.643+0000 7f1c077fe640 1 -- 172.21.15.26:0/1076072909 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c14012c60 con 0x7f1c200705e0 2023-11-28T16:56:24.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7fd92cc15640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd90c0668d0 0x7fd90c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 -- 172.21.15.26:0/3859137481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f735006c0a0 msgr2=0x7f735006c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 --2- 172.21.15.26:0/3859137481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f735006c0a0 0x7f735006c480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7350068a40 tx=0x7f734801c430 comp rx=0 tx=0).stop 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 -- 172.21.15.26:0/3859137481 shutdown_connections 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 --2- 172.21.15.26:0/3859137481 >> v2:172.21.15.26:3300/0 conn(0x7f73500c65e0 0x7f73500c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 --2- 172.21.15.26:0/3859137481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f735006c0a0 0x7f735006c480 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7350068a40 tx=0x7f734801c430 comp rx=0 tx=0).stop 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 -- 172.21.15.26:0/3859137481 >> 172.21.15.26:0/3859137481 conn(0x7f73500abcb0 msgr2=0x7f73500ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 -- 172.21.15.26:0/3859137481 shutdown_connections 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f73555c4640 1 -- 172.21.15.26:0/3859137481 wait complete. 2023-11-28T16:56:24.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7fd92cc15640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd90c0668d0 0x7fd90c068d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0097c0 tx=0x7fd91c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f1c077fe640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c0c0669d0 0x7f1c0c068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f1c077fe640 1 -- 172.21.15.26:0/1076072909 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c14085320 con 0x7f1c200705e0 2023-11-28T16:56:24.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7fa87ec09640 1 -- 172.21.15.26:0/2616923123 wait complete. 2023-11-28T16:56:24.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7fa87ec09640 1 Processor -- start 2023-11-28T16:56:24.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89600be4e0 con 0x7f89600bd720 2023-11-28T16:56:24.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89601fa2b0 con 0x7f89600bd720 2023-11-28T16:56:24.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.647+0000 7fa87ec09640 1 -- start start 2023-11-28T16:56:24.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f73555c4640 1 Processor -- start 2023-11-28T16:56:24.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87ec09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa87806cd90 0x7fa8780ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f8955ffb640 1 -- 172.21.15.26:0/2526910173 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f895001b460 con 0x7f89600bd720 2023-11-28T16:56:24.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f1c1effd640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c0c0669d0 0x7f1c0c068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87ec09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 0x7fa8780aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87ec09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8780ca610 0x7fa8780ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f73555c4640 1 -- start start 2023-11-28T16:56:24.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f1c1effd640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c0c0669d0 0x7f1c0c068e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c1001cb20 tx=0x7f1c10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87c9a5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa87806cd90 0x7fa8780ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87c9a5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa87806cd90 0x7fa8780ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44316/0 (socket says 172.21.15.26:44316) 2023-11-28T16:56:24.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87c9a5640 1 -- 172.21.15.26:0/959460694 learned_addr learned my addr 172.21.15.26:0/959460694 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87d1a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8780ca610 0x7fa8780ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780c0f60 con 0x7fa8780bd720 2023-11-28T16:56:24.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa86ffff640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 0x7fa8780aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780add20 con 0x7fa8780ca610 2023-11-28T16:56:24.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780ad110 con 0x7fa87806cd90 2023-11-28T16:56:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896004e890 con 0x7f89600bd720 2023-11-28T16:56:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f8955ffb640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8944066920 0x7f8944068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f8955ffb640 1 -- 172.21.15.26:0/2526910173 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89500840b0 con 0x7f89600bd720 2023-11-28T16:56:24.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.651+0000 7f89655fb640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8944066920 0x7f8944068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f89655fb640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8944066920 0x7f8944068de0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8960158090 tx=0x7f895c007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f73555c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73500c65e0 0x7f735006f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f73555c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73500c77c0 0x7f735014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7fa87c9a5640 1 -- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8780ca610 msgr2=0x7fa8780ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7fa87c9a5640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8780ca610 0x7fa8780ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7fa87c9a5640 1 -- 172.21.15.26:0/959460694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 msgr2=0x7fa8780aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7fa87c9a5640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 0x7fa8780aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7fa87c9a5640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860009a70 con 0x7fa87806cd90 2023-11-28T16:56:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7fa87c9a5640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa87806cd90 0x7fa8780ae5c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c420 tx=0x7fa86800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f734effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73500c65e0 0x7f735006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f734effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73500c65e0 0x7f735006f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44332/0 (socket says 172.21.15.26:44332) 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f734e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73500c77c0 0x7f735014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f734e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73500c77c0 0x7f735014fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53380/0 (socket says 172.21.15.26:53380) 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f734effd640 1 -- 172.21.15.26:0/361157912 learned_addr learned my addr 172.21.15.26:0/361157912 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f73555c4640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7350071660 0x7f735014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f73555c4640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73501f2220 con 0x7f73500c77c0 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f73555c4640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735006f940 con 0x7f7350071660 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f734f7fe640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7350071660 0x7f735014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.655+0000 7f73555c4640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73501461f0 con 0x7f73500c65e0 2023-11-28T16:56:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f1c077fe640 1 -- 172.21.15.26:0/1076072909 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c140525d0 con 0x7f1c200705e0 2023-11-28T16:56:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7fa875ffb640 1 -- 172.21.15.26:0/959460694 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868005cf0 con 0x7fa87806cd90 2023-11-28T16:56:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7fa875ffb640 1 -- 172.21.15.26:0/959460694 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868005e50 con 0x7fa87806cd90 2023-11-28T16:56:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8780ad3f0 con 0x7fa87806cd90 2023-11-28T16:56:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8780ad9b0 con 0x7fa87806cd90 2023-11-28T16:56:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f734effd640 1 -- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7350071660 msgr2=0x7f735014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f734effd640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7350071660 0x7f735014d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f734effd640 1 -- 172.21.15.26:0/361157912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73500c77c0 msgr2=0x7f735014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f734effd640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73500c77c0 0x7f735014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f734effd640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480094d0 con 0x7f73500c65e0 2023-11-28T16:56:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7fa875ffb640 1 -- 172.21.15.26:0/959460694 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680072d0 con 0x7fa87806cd90 2023-11-28T16:56:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f8955ffb640 1 -- 172.21.15.26:0/2526910173 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8950051360 con 0x7f89600bd720 2023-11-28T16:56:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f734effd640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73500c65e0 0x7f735006f400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f734801a060 tx=0x7f734801ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f73477fe640 1 -- 172.21.15.26:0/361157912 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73480b6620 con 0x7f73500c65e0 2023-11-28T16:56:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f73477fe640 1 -- 172.21.15.26:0/361157912 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73480b6780 con 0x7f73500c65e0 2023-11-28T16:56:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.659+0000 7f73477fe640 1 -- 172.21.15.26:0/361157912 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73480b6b10 con 0x7f73500c65e0 2023-11-28T16:56:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.663+0000 7f73555c4640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735006da60 con 0x7f73500c65e0 2023-11-28T16:56:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.663+0000 7f73555c4640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735014f590 con 0x7f73500c65e0 2023-11-28T16:56:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.663+0000 7fa875ffb640 1 -- 172.21.15.26:0/959460694 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa868007430 con 0x7fa87806cd90 2023-11-28T16:56:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.663+0000 7fa875ffb640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa858066920 0x7fa858068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.663+0000 7fa86ffff640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa858066920 0x7fa858068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.663+0000 7fa875ffb640 1 -- 172.21.15.26:0/959460694 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8680548f0 con 0x7fa87806cd90 2023-11-28T16:56:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.667+0000 7fa86ffff640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa858066920 0x7fa858068de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8600ae000 tx=0x7fa8600a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.667+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c005260 con 0x7fa87806cd90 2023-11-28T16:56:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.663+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735004e890 con 0x7f73500c65e0 2023-11-28T16:56:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.667+0000 7f73477fe640 1 -- 172.21.15.26:0/361157912 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f73480b2040 con 0x7f73500c65e0 2023-11-28T16:56:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.667+0000 7f73477fe640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f73300669a0 0x7f7330068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.667+0000 7f73477fe640 1 -- 172.21.15.26:0/361157912 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f734811e200 con 0x7f73500c65e0 2023-11-28T16:56:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.667+0000 7f734e7fc640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f73300669a0 0x7f7330068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.667+0000 7f734e7fc640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f73300669a0 0x7f7330068e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7350071420 tx=0x7f7338009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.671+0000 7f73477fe640 1 -- 172.21.15.26:0/361157912 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73480eb4d0 con 0x7f73500c65e0 2023-11-28T16:56:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.675+0000 7fa875ffb640 1 -- 172.21.15.26:0/959460694 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8680513c0 con 0x7fa87806cd90 2023-11-28T16:56:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.943+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e2804e890 con 0x7f1e2806c400 2023-11-28T16:56:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.943+0000 7f1e24ff9640 1 -- 172.21.15.26:0/3937786186 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e1802b020 con 0x7f1e2806c400 2023-11-28T16:56:24.949 INFO:teuthology.orchestra.run.smithi026.stdout:55834574852 2023-11-28T16:56:24.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.947+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e140669a0 msgr2=0x7f1e14068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.947+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e140669a0 0x7f1e14068e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ab10 tx=0x7f1e1c008040 comp rx=0 tx=0).stop 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.947+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806c400 msgr2=0x7f1e28147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.947+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806c400 0x7f1e28147500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e1801e4c0 tx=0x7f1e1801e980 comp rx=0 tx=0).stop 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 shutdown_connections 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e140669a0 0x7f1e14068e60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e280c6930 0x7f1e281e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e2806c400 0x7f1e28147500 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 --2- 172.21.15.26:0/3937786186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2806bee0 0x7f1e28148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 >> 172.21.15.26:0/3937786186 conn(0x7f1e280c5e10 msgr2=0x7f1e280c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 shutdown_connections 2023-11-28T16:56:24.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.951+0000 7f1e2e6c9640 1 -- 172.21.15.26:0/3937786186 wait complete. 2023-11-28T16:56:24.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.971+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd92804e890 con 0x7fd92806db80 2023-11-28T16:56:24.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.971+0000 7fd9257fa640 1 -- 172.21.15.26:0/145157002 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd914017090 con 0x7fd92806db80 2023-11-28T16:56:24.975 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd90c0668d0 msgr2=0x7fd90c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd90c0668d0 0x7fd90c068d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0097c0 tx=0x7fd91c0a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd92806db80 msgr2=0x7fd92814bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd92806db80 0x7fd92814bc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c3c0 tx=0x7fd91400c880 comp rx=0 tx=0).stop 2023-11-28T16:56:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 shutdown_connections 2023-11-28T16:56:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd928143d50 0x7fd9281441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd90c0668d0 0x7fd90c068d90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd92806db80 0x7fd92814bc40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 --2- 172.21.15.26:0/145157002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92806d100 0x7fd9280c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 >> 172.21.15.26:0/145157002 conn(0x7fd9280c2ad0 msgr2=0x7fd9280c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 shutdown_connections 2023-11-28T16:56:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.975+0000 7fd92ee79640 1 -- 172.21.15.26:0/145157002 wait complete. 2023-11-28T16:56:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.979+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ad41f22e0 con 0x7f9ad414dd10 2023-11-28T16:56:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.979+0000 7f9abbfff640 1 -- 172.21.15.26:0/597946052 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ad41f22e0 con 0x7f9ad414dd10 2023-11-28T16:56:24.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4e00e25b0 con 0x7fa4e00074d0 2023-11-28T16:56:24.986 INFO:teuthology.orchestra.run.smithi026.stdout:55834574852 2023-11-28T16:56:24.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7fa4ddffb640 1 -- 172.21.15.26:0/4107458900 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4e00e25b0 con 0x7fa4e00074d0 2023-11-28T16:56:24.988 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:24.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-11-28T16:56:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9ac00668d0 msgr2=0x7f9ac0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9ac00668d0 0x7f9ac0068d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000f70 tx=0x7f9ac4007e10 comp rx=0 tx=0).stop 2023-11-28T16:56:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad414dd10 msgr2=0x7f9ad415f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad414dd10 0x7f9ad415f050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c730 tx=0x7f9acc00cbf0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 shutdown_connections 2023-11-28T16:56:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad4150840 0x7f9ad40a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ad414dd10 0x7f9ad415f050 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9ac00668d0 0x7f9ac0068d90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 --2- 172.21.15.26:0/597946052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ad406d020 0x7f9ad4148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.983+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 >> 172.21.15.26:0/597946052 conn(0x7f9ad40c2ad0 msgr2=0x7f9ad414cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4cc0668d0 msgr2=0x7fa4cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4cc0668d0 0x7fa4cc068d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0007200 tx=0x7fa4d8009040 comp rx=0 tx=0).stop 2023-11-28T16:56:24.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00074d0 msgr2=0x7fa4e00da8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:24.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00074d0 0x7fa4e00da8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40ac040 tx=0x7fa4e4019290 comp rx=0 tx=0).stop 2023-11-28T16:56:24.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 shutdown_connections 2023-11-28T16:56:24.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7f9ad9d80640 1 -- 172.21.15.26:0/597946052 wait complete. 2023-11-28T16:56:24.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 shutdown_connections 2023-11-28T16:56:24.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4cc0668d0 0x7fa4cc068d90 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0007200 tx=0x7fa4d8009040 comp rx=0 tx=0).stop 2023-11-28T16:56:24.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4e00dbd20 0x7fa4e00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e004b2e0 0x7fa4e00cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 --2- 172.21.15.26:0/4107458900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00074d0 0x7fa4e00da8b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:24.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 >> 172.21.15.26:0/4107458900 conn(0x7fa4e0005ec0 msgr2=0x7fa4e002c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:24.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 shutdown_connections 2023-11-28T16:56:24.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.987+0000 7fa4ee156640 1 -- 172.21.15.26:0/4107458900 wait complete. 2023-11-28T16:56:24.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.995+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f896006cb70 con 0x7f89600bd720 2023-11-28T16:56:24.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.995+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1c20156140 con 0x7f1c200705e0 2023-11-28T16:56:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.995+0000 7f1c077fe640 1 -- 172.21.15.26:0/1076072909 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c14055bf0 con 0x7f1c200705e0 2023-11-28T16:56:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.995+0000 7f8955ffb640 1 -- 172.21.15.26:0/2526910173 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8950054980 con 0x7f89600bd720 2023-11-28T16:56:25.000 INFO:teuthology.orchestra.run.smithi026.stdout:55834574852 2023-11-28T16:56:25.001 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-11-28T16:56:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.995+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa85c0057e0 con 0x7fa87806cd90 2023-11-28T16:56:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.995+0000 7fa875ffb640 1 -- 172.21.15.26:0/959460694 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa868051560 con 0x7fa87806cd90 2023-11-28T16:56:25.002 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-11-28T16:56:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8944066920 msgr2=0x7f8944068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8944066920 0x7f8944068de0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8960158090 tx=0x7f895c007a50 comp rx=0 tx=0).stop 2023-11-28T16:56:25.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89600bd720 msgr2=0x7f89601f3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89600bd720 0x7f89601f3140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f895000b420 tx=0x7f895000b8e0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c0c0669d0 msgr2=0x7f1c0c068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c0c0669d0 0x7f1c0c068e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c1001cb20 tx=0x7f1c10008040 comp rx=0 tx=0).stop 2023-11-28T16:56:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c200705e0 msgr2=0x7f1c2014c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c200705e0 0x7f1c2014c190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400d5c0 tx=0x7f1c1400da80 comp rx=0 tx=0).stop 2023-11-28T16:56:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 shutdown_connections 2023-11-28T16:56:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89600ca610 0x7f89601fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8944066920 0x7f8944068de0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89600bd720 0x7f89601f3140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 --2- 172.21.15.26:0/2526910173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f896006cd90 0x7f89601585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 >> 172.21.15.26:0/2526910173 conn(0x7f8960071ea0 msgr2=0x7f896015f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 shutdown_connections 2023-11-28T16:56:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f896785f640 1 -- 172.21.15.26:0/2526910173 wait complete. 2023-11-28T16:56:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 shutdown_connections 2023-11-28T16:56:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20152ce0 0x7f1c2014c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa858066920 msgr2=0x7fa858068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa858066920 0x7fa858068de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8600ae000 tx=0x7fa8600a6070 comp rx=0 tx=0).stop 2023-11-28T16:56:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa87806cd90 msgr2=0x7fa8780ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa87806cd90 0x7fa8780ae5c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c420 tx=0x7fa86800c8e0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c200705e0 0x7f1c2014c190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c0c0669d0 0x7f1c0c068e90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 --2- 172.21.15.26:0/1076072909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c2006db80 0x7f1c201513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 >> 172.21.15.26:0/1076072909 conn(0x7f1c200c2ad0 msgr2=0x7f1c20156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 shutdown_connections 2023-11-28T16:56:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8780ca610 0x7fa8780ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8780bd720 0x7fa8780aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa858066920 0x7fa858068de0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 --2- 172.21.15.26:0/959460694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa87806cd90 0x7fa8780ae5c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 >> 172.21.15.26:0/959460694 conn(0x7fa878071ea0 msgr2=0x7fa87814e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 shutdown_connections 2023-11-28T16:56:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7fa87ec09640 1 -- 172.21.15.26:0/959460694 wait complete. 2023-11-28T16:56:25.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 shutdown_connections 2023-11-28T16:56:25.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:24.999+0000 7f1c2530f640 1 -- 172.21.15.26:0/1076072909 wait complete. 2023-11-28T16:56:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.003+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7350149750 con 0x7f73500c65e0 2023-11-28T16:56:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.003+0000 7f73477fe640 1 -- 172.21.15.26:0/361157912 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73480eeaf0 con 0x7f73500c65e0 2023-11-28T16:56:25.012 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-11-28T16:56:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f73300669a0 msgr2=0x7f7330068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f73300669a0 0x7f7330068e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7350071420 tx=0x7f7338009060 comp rx=0 tx=0).stop 2023-11-28T16:56:25.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73500c65e0 msgr2=0x7f735006f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73500c65e0 0x7f735006f400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f734801a060 tx=0x7f734801ac70 comp rx=0 tx=0).stop 2023-11-28T16:56:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 shutdown_connections 2023-11-28T16:56:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7350071660 0x7f735014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73500c77c0 0x7f735014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f73300669a0 0x7f7330068e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 --2- 172.21.15.26:0/361157912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73500c65e0 0x7f735006f400 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:25.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.007+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 >> 172.21.15.26:0/361157912 conn(0x7f73500abcb0 msgr2=0x7f7350148880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:25.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-28T16:56:25.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.011+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 shutdown_connections 2023-11-28T16:56:25.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:25.011+0000 7f73457fa640 1 -- 172.21.15.26:0/361157912 wait complete. 2023-11-28T16:56:25.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-11-28T16:56:25.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-11-28T16:56:25.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-28T16:56:25.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-28T16:56:25.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-11-28T16:56:25.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-28T16:56:25.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T16:56:26.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T16:56:26.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T16:56:26.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T16:56:26.044 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T16:56:26.047 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T16:56:26.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T16:56:26.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T16:56:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.187+0000 7f40d929a640 1 Processor -- start 2023-11-28T16:56:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.187+0000 7f40d929a640 1 -- start start 2023-11-28T16:56:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.187+0000 7f40d929a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40d414dc50 0x7f40d40c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.187+0000 7f40d929a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d929a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d4071440 con 0x7f40d406bee0 2023-11-28T16:56:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40d414dc50 0x7f40d40c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d929a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d4151100 con 0x7f40d414dc50 2023-11-28T16:56:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40d414dc50 0x7f40d40c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52386/0 (socket says 172.21.15.26:52386) 2023-11-28T16:56:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d27fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d27fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44336/0 (socket says 172.21.15.26:44336) 2023-11-28T16:56:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d27fc640 1 -- 172.21.15.26:0/2227272037 learned_addr learned my addr 172.21.15.26:0/2227272037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d929a640 1 -- 172.21.15.26:0/2227272037 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d4071f90 con 0x7f40d406c400 2023-11-28T16:56:26.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d27fc640 1 -- 172.21.15.26:0/2227272037 >> v2:172.21.15.79:3300/0 conn(0x7f40d414dc50 msgr2=0x7f40d40c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d27fc640 1 --2- 172.21.15.26:0/2227272037 >> v2:172.21.15.79:3300/0 conn(0x7f40d414dc50 0x7f40d40c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d27fc640 1 -- 172.21.15.26:0/2227272037 >> v1:172.21.15.26:6789/0 conn(0x7f40d406bee0 legacy=0x7f40d406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.191+0000 7f40d27fc640 1 -- 172.21.15.26:0/2227272037 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4151630 con 0x7f40d406c400 2023-11-28T16:56:26.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.195+0000 7f40d27fc640 1 --2- 172.21.15.26:0/2227272037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40c1270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f40c4007360 tx=0x7f40c401e560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=604076c14f68c1c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d1ffb640 1 -- 172.21.15.26:0/2227272037 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4008be0 con 0x7f40d406c400 2023-11-28T16:56:26.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d1ffb640 1 -- 172.21.15.26:0/2227272037 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4008d40 con 0x7f40d406c400 2023-11-28T16:56:26.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d1ffb640 1 -- 172.21.15.26:0/2227272037 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400a2f0 con 0x7f40d406c400 2023-11-28T16:56:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 -- 172.21.15.26:0/2227272037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 msgr2=0x7f40d40c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 --2- 172.21.15.26:0/2227272037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40c1270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f40c4007360 tx=0x7f40c401e560 comp rx=0 tx=0).stop 2023-11-28T16:56:26.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 -- 172.21.15.26:0/2227272037 shutdown_connections 2023-11-28T16:56:26.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 --2- 172.21.15.26:0/2227272037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40c1270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 --2- 172.21.15.26:0/2227272037 >> v2:172.21.15.79:3300/0 conn(0x7f40d414dc50 0x7f40d40c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 -- 172.21.15.26:0/2227272037 >> 172.21.15.26:0/2227272037 conn(0x7f40d40c5e10 msgr2=0x7f40d40c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 -- 172.21.15.26:0/2227272037 shutdown_connections 2023-11-28T16:56:26.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.199+0000 7f40d929a640 1 -- 172.21.15.26:0/2227272037 wait complete. 2023-11-28T16:56:26.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 Processor -- start 2023-11-28T16:56:26.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 -- start start 2023-11-28T16:56:26.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d406bee0 0x7f40d4145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d414dc50 0x7f40d40a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d406bee0 0x7f40d4145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d406bee0 0x7f40d4145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53390/0 (socket says 172.21.15.26:53390) 2023-11-28T16:56:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d2ffd640 1 -- 172.21.15.26:0/1716468938 learned_addr learned my addr 172.21.15.26:0/1716468938 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d40aa240 con 0x7f40d406bee0 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41f1580 con 0x7f40d414dc50 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.203+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d40c4c30 con 0x7f40d406c400 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d37fe640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d414dc50 0x7f40d40a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d27fc640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d37fe640 1 -- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 msgr2=0x7f40d40a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d37fe640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d37fe640 1 -- 172.21.15.26:0/1716468938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d406bee0 msgr2=0x7f40d4145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d37fe640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d406bee0 0x7f40d4145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d37fe640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4007040 con 0x7f40d414dc50 2023-11-28T16:56:26.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d27fc640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:26.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d2ffd640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d406bee0 0x7f40d4145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:26.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d37fe640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d414dc50 0x7f40d40a9ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00be30 tx=0x7f40cc00bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40bb7fe640 1 -- 172.21.15.26:0/1716468938 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00ce90 con 0x7f40d414dc50 2023-11-28T16:56:26.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d41f0970 con 0x7f40d414dc50 2023-11-28T16:56:26.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40bb7fe640 1 -- 172.21.15.26:0/1716468938 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc014440 con 0x7f40d414dc50 2023-11-28T16:56:26.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40bb7fe640 1 -- 172.21.15.26:0/1716468938 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0147f0 con 0x7f40d414dc50 2023-11-28T16:56:26.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.207+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d41f0f30 con 0x7f40d414dc50 2023-11-28T16:56:26.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.211+0000 7f40bb7fe640 1 -- 172.21.15.26:0/1716468938 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f40cc01d3b0 con 0x7f40d414dc50 2023-11-28T16:56:26.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.215+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d41f1730 con 0x7f40d414dc50 2023-11-28T16:56:26.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.215+0000 7f40bb7fe640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40c0066920 0x7f40c0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.215+0000 7f40bb7fe640 1 -- 172.21.15.26:0/1716468938 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40cc084280 con 0x7f40d414dc50 2023-11-28T16:56:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.215+0000 7f40d2ffd640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40c0066920 0x7f40c0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.215+0000 7f40d2ffd640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40c0066920 0x7f40c0068de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007f00 tx=0x7f40c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.219+0000 7f40bb7fe640 1 -- 172.21.15.26:0/1716468938 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40d41f1730 con 0x7f40d414dc50 2023-11-28T16:56:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.255+0000 7f25c0c79640 1 Processor -- start 2023-11-28T16:56:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.255+0000 7f1ed5d7d640 1 Processor -- start 2023-11-28T16:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.255+0000 7f25c0c79640 1 -- start start 2023-11-28T16:56:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.255+0000 7f1ed5d7d640 1 -- start start 2023-11-28T16:56:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed5d7d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ed00bd5e0 0x7f1ed00c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed5d7d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ed006b4e0 0x7f1ed015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25c0c79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25bc155660 0x7f25bc06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed5d7d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed01559f0 con 0x7f1ed006b100 2023-11-28T16:56:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed5d7d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed0157930 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed5d7d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed0151f20 con 0x7f1ed006b4e0 2023-11-28T16:56:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed557c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ed006b4e0 0x7f1ed015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed557c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ed006b4e0 0x7f1ed015ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52416/0 (socket says 172.21.15.26:52416) 2023-11-28T16:56:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f1ed557c640 1 -- 172.21.15.26:0/1208866943 learned_addr learned my addr 172.21.15.26:0/1208866943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25bad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f25bc06b650 0x7f25bc0c7f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34070/0 (socket says 172.21.15.26:34070) 2023-11-28T16:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25b9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25bc155660 0x7f25bc06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25b9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25bc155660 0x7f25bc06b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52432/0 (socket says 172.21.15.26:52432) 2023-11-28T16:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25bad9d640 1 -- 172.21.15.26:0/4022276454 learned_addr learned my addr 172.21.15.26:0/4022276454 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc0c5520 con 0x7f25bc1520f0 2023-11-28T16:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc0c9a80 con 0x7f25bc06b650 2023-11-28T16:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.259+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc06c020 con 0x7f25bc155660 2023-11-28T16:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.263+0000 7f1ed557c640 1 -- 172.21.15.26:0/1208866943 >> v2:172.21.15.26:3300/0 conn(0x7f1ed00bd5e0 msgr2=0x7f1ed00c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.263+0000 7f1ed557c640 1 --2- 172.21.15.26:0/1208866943 >> v2:172.21.15.26:3300/0 conn(0x7f1ed00bd5e0 0x7f1ed00c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.263+0000 7f1ed557c640 1 -- 172.21.15.26:0/1208866943 >> v1:172.21.15.26:6789/0 conn(0x7f1ed006b100 legacy=0x7f1ed00c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.263+0000 7f1ed557c640 1 -- 172.21.15.26:0/1208866943 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00aff20 con 0x7f1ed006b4e0 2023-11-28T16:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.263+0000 7f25b9d9b640 1 -- 172.21.15.26:0/4022276454 >> v1:172.21.15.79:6789/0 conn(0x7f25bc06b650 legacy=0x7f25bc0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.263+0000 7f25b9d9b640 1 -- 172.21.15.26:0/4022276454 >> v1:172.21.15.26:6789/0 conn(0x7f25bc1520f0 legacy=0x7f25bc0c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.263+0000 7f25b9d9b640 1 -- 172.21.15.26:0/4022276454 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0c5240 con 0x7f25bc155660 2023-11-28T16:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25b9d9b640 1 --2- 172.21.15.26:0/4022276454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc155660 0x7f25bc06b110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009740 tx=0x7f25ac01c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76371a185e7da32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed557c640 1 --2- 172.21.15.26:0/1208866943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b4e0 0x7f1ed015ee80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00c0fb0 tx=0x7f1ec001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22825f323066c126 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ecf7fe640 1 -- 172.21.15.26:0/1208866943 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00ab600 con 0x7f1ed006b4e0 2023-11-28T16:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ecf7fe640 1 -- 172.21.15.26:0/1208866943 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00a7050 con 0x7f1ed006b4e0 2023-11-28T16:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ecf7fe640 1 -- 172.21.15.26:0/1208866943 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00ab980 con 0x7f1ed006b4e0 2023-11-28T16:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25b959a640 1 -- 172.21.15.26:0/4022276454 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0ab600 con 0x7f25bc155660 2023-11-28T16:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25b959a640 1 -- 172.21.15.26:0/4022276454 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0a7050 con 0x7f25bc155660 2023-11-28T16:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25b959a640 1 -- 172.21.15.26:0/4022276454 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0ab980 con 0x7f25bc155660 2023-11-28T16:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1208866943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b4e0 msgr2=0x7f1ed015ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1208866943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b4e0 0x7f1ed015ee80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00c0fb0 tx=0x7f1ec001c500 comp rx=0 tx=0).stop 2023-11-28T16:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc155660 msgr2=0x7f25bc06b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25c0c79640 1 --2- 172.21.15.26:0/4022276454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc155660 0x7f25bc06b110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009740 tx=0x7f25ac01c1c0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1208866943 shutdown_connections 2023-11-28T16:56:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1208866943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b4e0 0x7f1ed015ee80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1208866943 >> v2:172.21.15.26:3300/0 conn(0x7f1ed00bd5e0 0x7f1ed00c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1208866943 >> 172.21.15.26:0/1208866943 conn(0x7f1ed00ca550 msgr2=0x7f1ed00abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1208866943 shutdown_connections 2023-11-28T16:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1208866943 wait complete. 2023-11-28T16:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 shutdown_connections 2023-11-28T16:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25c0c79640 1 --2- 172.21.15.26:0/4022276454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc155660 0x7f25bc06b110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 >> 172.21.15.26:0/4022276454 conn(0x7f25bc0ca070 msgr2=0x7f25bc0ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f2d96548640 1 Processor -- start 2023-11-28T16:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.267+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 shutdown_connections 2023-11-28T16:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f25c0c79640 1 -- 172.21.15.26:0/4022276454 wait complete. 2023-11-28T16:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f25c0c79640 1 Processor -- start 2023-11-28T16:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f25c0c79640 1 -- start start 2023-11-28T16:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d96548640 1 -- start start 2023-11-28T16:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d96548640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d9006d420 0x7f2d9006be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d96548640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d900c8800 con 0x7f2d900a7330 2023-11-28T16:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d96548640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d900c5e90 con 0x7f2d900c6310 2023-11-28T16:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d96548640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900c7bf0 con 0x7f2d9006d420 2023-11-28T16:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d94d45640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d9006d420 0x7f2d9006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f1ed5d7d640 1 Processor -- start 2023-11-28T16:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f1ed5d7d640 1 -- start start 2023-11-28T16:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d94d45640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d9006d420 0x7f2d9006be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44348/0 (socket says 172.21.15.26:44348) 2023-11-28T16:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.271+0000 7f2d94d45640 1 -- 172.21.15.26:0/2972171265 learned_addr learned my addr 172.21.15.26:0/2972171265 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f2d94d45640 1 -- 172.21.15.26:0/2972171265 >> v1:172.21.15.79:6789/0 conn(0x7f2d900c6310 legacy=0x7f2d9006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f2d94d45640 1 -- 172.21.15.26:0/2972171265 >> v1:172.21.15.26:6789/0 conn(0x7f2d900a7330 legacy=0x7f2d900baf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed5d7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b100 0x7f1ed0148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed5d7d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed006b4e0 0x7f1ed00ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed5d7d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ed00bd5e0 0x7f1ed00ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed5d7d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed01500f0 con 0x7f1ed006b4e0 2023-11-28T16:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed5d7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00ae710 con 0x7f1ed006b100 2023-11-28T16:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed5d7d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00ae430 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25c0c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25bc06b650 0x7f25bc14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25c0c79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc1520f0 0x7f25bc14e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ed00bd5e0 0x7f1ed00ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ed00bd5e0 0x7f1ed00ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44354/0 (socket says 172.21.15.26:44354) 2023-11-28T16:56:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 -- 172.21.15.26:0/1336507999 learned_addr learned my addr 172.21.15.26:0/1336507999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ecffff640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed006b4e0 0x7f1ed00ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed4d7b640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b100 0x7f1ed0148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25c0c79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25bc155660 0x7f25bc14c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25c0c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc14f440 con 0x7f25bc06b650 2023-11-28T16:56:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25c0c79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc14db40 con 0x7f25bc1520f0 2023-11-28T16:56:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25c0c79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc14ee80 con 0x7f25bc155660 2023-11-28T16:56:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 -- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b100 msgr2=0x7f1ed0148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b100 0x7f1ed0148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 -- 172.21.15.26:0/1336507999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed006b4e0 msgr2=0x7f1ed00ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25bc155660 0x7f25bc14c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25b9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc1520f0 0x7f25bc14e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25bc155660 0x7f25bc14c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44366/0 (socket says 172.21.15.26:44366) 2023-11-28T16:56:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 -- 172.21.15.26:0/1391753913 learned_addr learned my addr 172.21.15.26:0/1391753913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25b9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc1520f0 0x7f25bc14e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52452/0 (socket says 172.21.15.26:52452) 2023-11-28T16:56:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed006b4e0 0x7f1ed00ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed557c640 1 -- 172.21.15.26:0/1336507999 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00094d0 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 -- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc1520f0 msgr2=0x7f25bc14e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc1520f0 0x7f25bc14e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 -- 172.21.15.26:0/1391753913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25bc06b650 msgr2=0x7f25bc14b350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T16:56:26.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25bc06b650 0x7f25bc14b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 -- 172.21.15.26:0/1391753913 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac009420 con 0x7f25bc155660 2023-11-28T16:56:26.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ed4d7b640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b100 0x7f1ed0148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:26.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f25bad9d640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25bc155660 0x7f25bc14c3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25b400cb20 tx=0x7f25b40020e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f2d94d45640 1 -- 172.21.15.26:0/2972171265 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d900c7ed0 con 0x7f2d9006d420 2023-11-28T16:56:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.275+0000 7f1ecffff640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed006b4e0 0x7f1ed00ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f25aaffd640 1 -- 172.21.15.26:0/1391753913 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400a700 con 0x7f25bc155660 2023-11-28T16:56:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f25aaffd640 1 -- 172.21.15.26:0/1391753913 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b400a860 con 0x7f25bc155660 2023-11-28T16:56:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f25aaffd640 1 -- 172.21.15.26:0/1391753913 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400abd0 con 0x7f25bc155660 2023-11-28T16:56:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc0c8800 con 0x7f25bc155660 2023-11-28T16:56:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc14d7d0 con 0x7f25bc155660 2023-11-28T16:56:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f1ed557c640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ed00bd5e0 0x7f1ed00ad880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00ae040 tx=0x7f1ec001ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f1ecd7fa640 1 -- 172.21.15.26:0/1336507999 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00b6620 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f1ecd7fa640 1 -- 172.21.15.26:0/1336507999 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00b6780 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f1ecd7fa640 1 -- 172.21.15.26:0/1336507999 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00b6b30 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed01ed6f0 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed00c0d20 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f2d94d45640 1 --2- 172.21.15.26:0/2972171265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d9006d420 0x7f2d9006be20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d800098a0 tx=0x7f2d8001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78756b5ce7e363b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f2d87fff640 1 -- 172.21.15.26:0/2972171265 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800aa680 con 0x7f2d9006d420 2023-11-28T16:56:26.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f2d87fff640 1 -- 172.21.15.26:0/2972171265 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800aa7e0 con 0x7f2d9006d420 2023-11-28T16:56:26.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f2d87fff640 1 -- 172.21.15.26:0/2972171265 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800aab70 con 0x7f2d9006d420 2023-11-28T16:56:26.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc14d630 con 0x7f25bc155660 2023-11-28T16:56:26.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed01502a0 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.279+0000 7f25aaffd640 1 -- 172.21.15.26:0/1391753913 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25b400ad30 con 0x7f25bc155660 2023-11-28T16:56:26.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f2d96548640 1 -- 172.21.15.26:0/2972171265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d9006d420 msgr2=0x7f2d9006be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f2d96548640 1 --2- 172.21.15.26:0/2972171265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d9006d420 0x7f2d9006be20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d800098a0 tx=0x7f2d8001c520 comp rx=0 tx=0).stop 2023-11-28T16:56:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f25aaffd640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f259c066920 0x7f259c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f25aaffd640 1 -- 172.21.15.26:0/1391753913 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b4083d80 con 0x7f25bc155660 2023-11-28T16:56:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f1ecd7fa640 1 -- 172.21.15.26:0/1336507999 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1ec00b2040 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f25ba59c640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f259c066920 0x7f259c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f25ba59c640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f259c066920 0x7f259c068de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f25b0007fd0 tx=0x7f25b00079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.283+0000 7f1ecd7fa640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1ebc0668d0 0x7f1ebc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f1ecd7fa640 1 -- 172.21.15.26:0/1336507999 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ec011e7b0 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f1ed4d7b640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1ebc0668d0 0x7f1ebc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f2d96548640 1 -- 172.21.15.26:0/2972171265 shutdown_connections 2023-11-28T16:56:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f2d96548640 1 --2- 172.21.15.26:0/2972171265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d9006d420 0x7f2d9006be20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f2d96548640 1 -- 172.21.15.26:0/2972171265 >> 172.21.15.26:0/2972171265 conn(0x7f2d9006aba0 msgr2=0x7f2d900a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f2d96548640 1 -- 172.21.15.26:0/2972171265 shutdown_connections 2023-11-28T16:56:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f2d96548640 1 -- 172.21.15.26:0/2972171265 wait complete. 2023-11-28T16:56:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f1ed4d7b640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1ebc0668d0 0x7f1ebc068d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8007fd0 tx=0x7f1ec8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f25aaffd640 1 -- 172.21.15.26:0/1391753913 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25bc14d630 con 0x7f25bc155660 2023-11-28T16:56:26.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.287+0000 7f2d96548640 1 Processor -- start 2023-11-28T16:56:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.291+0000 7f2d96548640 1 -- start start 2023-11-28T16:56:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.291+0000 7f1ecd7fa640 1 -- 172.21.15.26:0/1336507999 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ec00ebb30 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.295+0000 7f2d96548640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9006d420 0x7f2d900ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.295+0000 7f2d96548640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d900a7330 0x7f2d900be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d96548640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d900c6310 0x7f2d90157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d96548640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9015f030 con 0x7f2d900a7330 2023-11-28T16:56:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d96548640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9015f5b0 con 0x7f2d9006d420 2023-11-28T16:56:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d96548640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9015f2d0 con 0x7f2d900c6310 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d95546640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9006d420 0x7f2d900ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d94d45640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d900a7330 0x7f2d900be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d95546640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9006d420 0x7f2d900ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52458/0 (socket says 172.21.15.26:52458) 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d95546640 1 -- 172.21.15.26:0/471285320 learned_addr learned my addr 172.21.15.26:0/471285320 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d95d47640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d900c6310 0x7f2d90157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d94d45640 1 -- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d900c6310 msgr2=0x7f2d90157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d94d45640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d900c6310 0x7f2d90157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d94d45640 1 -- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9006d420 msgr2=0x7f2d900ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d94d45640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9006d420 0x7f2d900ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d94d45640 1 -- 172.21.15.26:0/471285320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800094d0 con 0x7f2d900a7330 2023-11-28T16:56:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d94d45640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d900a7330 0x7f2d900be2e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2d800ab000 tx=0x7f2d8001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d85ffb640 1 -- 172.21.15.26:0/471285320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800b38c0 con 0x7f2d900a7330 2023-11-28T16:56:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d85ffb640 1 -- 172.21.15.26:0/471285320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800b3a60 con 0x7f2d900a7330 2023-11-28T16:56:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d85ffb640 1 -- 172.21.15.26:0/471285320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800b3e10 con 0x7f2d900a7330 2023-11-28T16:56:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d900ab350 con 0x7f2d900a7330 2023-11-28T16:56:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.299+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d900bca00 con 0x7f2d900a7330 2023-11-28T16:56:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.303+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9004e890 con 0x7f2d900a7330 2023-11-28T16:56:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.315+0000 7f2d85ffb640 1 -- 172.21.15.26:0/471285320 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2d800c7420 con 0x7f2d900a7330 2023-11-28T16:56:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.315+0000 7f2d85ffb640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d74066920 0x7f2d74068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.315+0000 7f2d85ffb640 1 -- 172.21.15.26:0/471285320 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d800f01e0 con 0x7f2d900a7330 2023-11-28T16:56:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.315+0000 7f2d95546640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d74066920 0x7f2d74068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.315+0000 7f2d95546640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d74066920 0x7f2d74068de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0099a0 tx=0x7f2d8c0090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.319+0000 7f2d85ffb640 1 -- 172.21.15.26:0/471285320 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d800ec520 con 0x7f2d900a7330 2023-11-28T16:56:26.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.347+0000 7f264a996640 1 Processor -- start 2023-11-28T16:56:26.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.347+0000 7f264a996640 1 -- start start 2023-11-28T16:56:26.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f264a996640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f263c00bd30 0x7f263c00a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f264a996640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f263c0da300 0x7f263c0e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f264a996640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c046920 con 0x7f263c0d3a80 2023-11-28T16:56:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f264a996640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0473c0 con 0x7f263c0da300 2023-11-28T16:56:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f264a996640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c04b5b0 con 0x7f263c00bd30 2023-11-28T16:56:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2649193640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f263c0d3a80 0x7f263c0d9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34090/0 (socket says 172.21.15.26:34090) 2023-11-28T16:56:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2649193640 1 -- 172.21.15.26:0/2681692435 learned_addr learned my addr 172.21.15.26:0/2681692435 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2649994640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f263c00bd30 0x7f263c00a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2648992640 1 -- 172.21.15.26:0/2681692435 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088862479 0 0) 0x7f263c046920 con 0x7f263c0d3a80 2023-11-28T16:56:26.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2648992640 1 -- 172.21.15.26:0/2681692435 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2630003530 con 0x7f263c0d3a80 2023-11-28T16:56:26.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2649994640 1 -- 172.21.15.26:0/2681692435 >> v2:172.21.15.26:3300/0 conn(0x7f263c0da300 msgr2=0x7f263c0e0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2649994640 1 --2- 172.21.15.26:0/2681692435 >> v2:172.21.15.26:3300/0 conn(0x7f263c0da300 0x7f263c0e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2649994640 1 -- 172.21.15.26:0/2681692435 >> v1:172.21.15.79:6789/0 conn(0x7f263c0d3a80 legacy=0x7f263c0d9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.351+0000 7f2649994640 1 -- 172.21.15.26:0/2681692435 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c04b2d0 con 0x7f263c00bd30 2023-11-28T16:56:26.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.355+0000 7fedf1c74640 1 Processor -- start 2023-11-28T16:56:26.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.355+0000 7fedf1c74640 1 -- start start 2023-11-28T16:56:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.355+0000 7f2649994640 1 --2- 172.21.15.26:0/2681692435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c00bd30 0x7f263c00a960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2644064410 tx=0x7f264409f490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc29fc3960372352 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.355+0000 7f8ad131d640 1 Processor -- start 2023-11-28T16:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.355+0000 7fedf1c74640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fedec14dbc0 0x7fedec071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f2648992640 1 -- 172.21.15.26:0/2681692435 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264412e440 con 0x7f263c00bd30 2023-11-28T16:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f2648992640 1 -- 172.21.15.26:0/2681692435 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264412a050 con 0x7f263c00bd30 2023-11-28T16:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f2648992640 1 -- 172.21.15.26:0/2681692435 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264412e860 con 0x7f263c00bd30 2023-11-28T16:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.355+0000 7fedf1c74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedec0c09d0 0x7fedec153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf1c74640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf1c74640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec071c60 con 0x7fedec0c09d0 2023-11-28T16:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf1c74640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec06da40 con 0x7fedec14dbc0 2023-11-28T16:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf1c74640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec070a20 con 0x7fedec06e3b0 2023-11-28T16:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fa3b6038640 1 Processor -- start 2023-11-28T16:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fedec14dbc0 0x7fedec071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf1473640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fedec14dbc0 0x7fedec071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52474/0 (socket says 172.21.15.26:52474) 2023-11-28T16:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 -- 172.21.15.26:0/487074513 learned_addr learned my addr 172.21.15.26:0/487074513 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f264a996640 1 -- 172.21.15.26:0/2681692435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c00bd30 msgr2=0x7f263c00a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f264a996640 1 --2- 172.21.15.26:0/2681692435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c00bd30 0x7f263c00a960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2644064410 tx=0x7f264409f490 comp rx=0 tx=0).stop 2023-11-28T16:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedebfff640 1 --2- 172.21.15.26:0/487074513 >> v2:172.21.15.26:3300/0 conn(0x7fedec0c09d0 0x7fedec153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fa3b6038640 1 -- start start 2023-11-28T16:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f264a996640 1 -- 172.21.15.26:0/2681692435 shutdown_connections 2023-11-28T16:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f264a996640 1 --2- 172.21.15.26:0/2681692435 >> v2:172.21.15.26:3300/0 conn(0x7f263c0da300 0x7f263c0e0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.355+0000 7f8ad131d640 1 -- start start 2023-11-28T16:56:26.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8ad131d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 0x7f8acc06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8ad131d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8acc06ec40 0x7f8acc0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8ad131d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc151580 con 0x7f8acc14daa0 2023-11-28T16:56:26.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8ad131d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc1542d0 con 0x7f8acc06ec40 2023-11-28T16:56:26.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8ad131d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc06f180 con 0x7f8acc151120 2023-11-28T16:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f264a996640 1 --2- 172.21.15.26:0/2681692435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c00bd30 0x7f263c00a960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f264a996640 1 -- 172.21.15.26:0/2681692435 >> 172.21.15.26:0/2681692435 conn(0x7f263c048230 msgr2=0x7f263c048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8acbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8acc06ec40 0x7f8acc0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8acaffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8acc14daa0 0x7f8acc153bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34094/0 (socket says 172.21.15.26:34094) 2023-11-28T16:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8acaffd640 1 -- 172.21.15.26:0/1202916047 learned_addr learned my addr 172.21.15.26:0/1202916047 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8aca7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 0x7f8acc06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fa3b6038640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3a80d7a50 0x7fa3a804a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623313888 0 0) 0x7f8acc151580 con 0x7f8acc14daa0 2023-11-28T16:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fa3b6038640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80071e0 0x7fa3a8007620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fa3b6038640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80db1d0 con 0x7fa3a800e190 2023-11-28T16:56:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab4003530 con 0x7f8acc14daa0 2023-11-28T16:56:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fa3b6038640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a800fca0 con 0x7fa3a80d7a50 2023-11-28T16:56:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fa3b6038640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a804ad10 con 0x7fa3a80071e0 2023-11-28T16:56:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b5837640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa3a800e190 0x7fa3a800e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44058/0 (socket says 172.21.15.26:44058) 2023-11-28T16:56:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b5837640 1 -- 172.21.15.26:0/3300535560 learned_addr learned my addr 172.21.15.26:0/3300535560 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b4835640 1 --2- 172.21.15.26:0/3300535560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80071e0 0x7fa3a8007620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b5036640 1 --2- 172.21.15.26:0/3300535560 >> v2:172.21.15.26:3300/0 conn(0x7fa3a80d7a50 0x7fa3a804a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 319639425 0 0) 0x7f8ab4003530 con 0x7f8acc14daa0 2023-11-28T16:56:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 msgr2=0x7f8acc06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 0x7f8acc06e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 >> v2:172.21.15.79:3300/0 conn(0x7f8acc06ec40 msgr2=0x7f8acc0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 --2- 172.21.15.26:0/1202916047 >> v2:172.21.15.79:3300/0 conn(0x7f8acc06ec40 0x7f8acc0c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3a7fff640 1 -- 172.21.15.26:0/3300535560 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434495970 0 0) 0x7fa3a80db1d0 con 0x7fa3a800e190 2023-11-28T16:56:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3a7fff640 1 -- 172.21.15.26:0/3300535560 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa39c003530 con 0x7fa3a800e190 2023-11-28T16:56:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b5036640 1 -- 172.21.15.26:0/3300535560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80071e0 msgr2=0x7fa3a8007620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b5036640 1 --2- 172.21.15.26:0/3300535560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80071e0 0x7fa3a8007620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b5036640 1 -- 172.21.15.26:0/3300535560 >> v1:172.21.15.26:6789/0 conn(0x7fa3a800e190 legacy=0x7fa3a800e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fa3b5036640 1 -- 172.21.15.26:0/3300535560 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80da410 con 0x7fa3a80d7a50 2023-11-28T16:56:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc06f460 con 0x7f8acc14daa0 2023-11-28T16:56:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f8abc001680 con 0x7f8acc14daa0 2023-11-28T16:56:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 >> v1:172.21.15.79:6789/0 conn(0x7f8acc14daa0 legacy=0x7f8acc153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 0x7f8acc06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 0x7f8ab4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab4003f10 0x7f8ab40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4004d10 0x7f8ab4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc1542d0 con 0x7f8ab4003f10 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc06f180 con 0x7f8ab4004d10 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 -- 172.21.15.26:0/487074513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 msgr2=0x7fedec1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 --2- 172.21.15.26:0/487074513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec1505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 -- 172.21.15.26:0/487074513 >> v2:172.21.15.26:3300/0 conn(0x7fedec0c09d0 msgr2=0x7fedec153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 --2- 172.21.15.26:0/487074513 >> v2:172.21.15.26:3300/0 conn(0x7fedec0c09d0 0x7fedec153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.359+0000 7fedf0c72640 1 -- 172.21.15.26:0/487074513 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec06dc90 con 0x7fedec14dbc0 2023-11-28T16:56:26.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab4007b00 con 0x7f8acc151120 2023-11-28T16:56:26.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8acbfff640 1 --2- 172.21.15.26:0/1202916047 >> v2:172.21.15.79:3300/0 conn(0x7f8acc06ec40 0x7f8acc0c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:26.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab4003f10 0x7f8ab40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8acbfff640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4004d10 0x7f8ab4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f264a996640 1 -- 172.21.15.26:0/2681692435 shutdown_connections 2023-11-28T16:56:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7fedf0c72640 1 --2- 172.21.15.26:0/487074513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec14dbc0 0x7fedec071470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedec06c8f0 tx=0x7fede001c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a624be9f542d2e92 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8acaffd640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 0x7f8ab4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f264a996640 1 -- 172.21.15.26:0/2681692435 wait complete. 2023-11-28T16:56:26.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8aca7fc640 1 -- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 msgr2=0x7f8ab4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc151120 0x7f8ab4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8aca7fc640 1 -- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4004d10 msgr2=0x7f8ab4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4004d10 0x7f8ab4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.363+0000 7f8aca7fc640 1 -- 172.21.15.26:0/1202916047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4003530 con 0x7f8ab4003f10 2023-11-28T16:56:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fedeb7fe640 1 -- 172.21.15.26:0/487074513 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede00ab600 con 0x7fedec14dbc0 2023-11-28T16:56:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fedeb7fe640 1 -- 172.21.15.26:0/487074513 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede00a7050 con 0x7fedec14dbc0 2023-11-28T16:56:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fedeb7fe640 1 -- 172.21.15.26:0/487074513 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede00ab980 con 0x7fedec14dbc0 2023-11-28T16:56:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7f264a996640 1 Processor -- start 2023-11-28T16:56:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7f264a996640 1 -- start start 2023-11-28T16:56:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fedf1c74640 1 -- 172.21.15.26:0/487074513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec14dbc0 msgr2=0x7fedec071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fedf1c74640 1 --2- 172.21.15.26:0/487074513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec14dbc0 0x7fedec071470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedec06c8f0 tx=0x7fede001c3b0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fa3b5036640 1 --2- 172.21.15.26:0/3300535560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a80d7a50 0x7fa3a804a4c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0097c0 tx=0x7fa3ac01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f83b79f830c636b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fa3a7fff640 1 -- 172.21.15.26:0/3300535560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0ac620 con 0x7fa3a80d7a50 2023-11-28T16:56:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f264a996640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f263c00bd30 0x7f263c0d8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f264a996640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f263c0d3a80 0x7f263c16e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f264a996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c0da300 0x7f263c16ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f264a996640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c041e10 con 0x7f263c00bd30 2023-11-28T16:56:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f264a996640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0418e0 con 0x7f263c0da300 2023-11-28T16:56:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f264a996640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c02c270 con 0x7f263c0d3a80 2023-11-28T16:56:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fa3a7fff640 1 -- 172.21.15.26:0/3300535560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac0ac780 con 0x7fa3a80d7a50 2023-11-28T16:56:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.367+0000 7fa3a7fff640 1 -- 172.21.15.26:0/3300535560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0acb10 con 0x7fa3a80d7a50 2023-11-28T16:56:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fedf1c74640 1 -- 172.21.15.26:0/487074513 shutdown_connections 2023-11-28T16:56:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fedf1c74640 1 --2- 172.21.15.26:0/487074513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fedf1c74640 1 --2- 172.21.15.26:0/487074513 >> v2:172.21.15.26:3300/0 conn(0x7fedec0c09d0 0x7fedec153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fedf1c74640 1 --2- 172.21.15.26:0/487074513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec14dbc0 0x7fedec071470 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fedf1c74640 1 -- 172.21.15.26:0/487074513 >> 172.21.15.26:0/487074513 conn(0x7fedec0c5fd0 msgr2=0x7fedec0c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 -- 172.21.15.26:0/3300535560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a80d7a50 msgr2=0x7fa3a804a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 --2- 172.21.15.26:0/3300535560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a80d7a50 0x7fa3a804a4c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0097c0 tx=0x7fa3ac01c3c0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f263c0d3a80 0x7f263c16e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f263c0d3a80 0x7f263c16e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44398/0 (socket says 172.21.15.26:44398) 2023-11-28T16:56:26.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 -- 172.21.15.26:0/2237846262 learned_addr learned my addr 172.21.15.26:0/2237846262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f264a195640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c0da300 0x7f263c16ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 -- 172.21.15.26:0/3300535560 shutdown_connections 2023-11-28T16:56:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 --2- 172.21.15.26:0/3300535560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80071e0 0x7fa3a8007620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 --2- 172.21.15.26:0/3300535560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a80d7a50 0x7fa3a804a4c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 -- 172.21.15.26:0/3300535560 >> 172.21.15.26:0/3300535560 conn(0x7fa3a804c5c0 msgr2=0x7fa3a804c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fedf1c74640 1 -- 172.21.15.26:0/487074513 shutdown_connections 2023-11-28T16:56:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fedf1c74640 1 -- 172.21.15.26:0/487074513 wait complete. 2023-11-28T16:56:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab4003f10 0x7f8ab40047d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009a00 tx=0x7f8ac001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9c4c5d2a43628f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 -- 172.21.15.26:0/3300535560 shutdown_connections 2023-11-28T16:56:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649994640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f263c00bd30 0x7f263c0d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 -- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c0da300 msgr2=0x7f263c16ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c0da300 0x7f263c16ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 -- 172.21.15.26:0/2237846262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f263c00bd30 msgr2=0x7f263c0d8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f263c00bd30 0x7f263c0d8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 -- 172.21.15.26:0/2237846262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26440687b0 con 0x7f263c0d3a80 2023-11-28T16:56:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649994640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f263c00bd30 0x7f263c0d8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7fa3b6038640 1 -- 172.21.15.26:0/3300535560 wait complete. 2023-11-28T16:56:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00a6690 con 0x7f8ab4003f10 2023-11-28T16:56:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac00a67f0 con 0x7f8ab4003f10 2023-11-28T16:56:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f8ac9ffb640 1 -- 172.21.15.26:0/1202916047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00a6bc0 con 0x7f8ab4003f10 2023-11-28T16:56:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f8ad131d640 1 -- 172.21.15.26:0/1202916047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab4003f10 msgr2=0x7f8ab40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1202916047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab4003f10 0x7f8ab40047d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009a00 tx=0x7f8ac001c6a0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f8acbfff640 1 -- 172.21.15.26:0/1202916047 reap_dead start 2023-11-28T16:56:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.371+0000 7f2649193640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f263c0d3a80 0x7f263c16e750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f264000c3f0 tx=0x7f264000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f263a7fc640 1 -- 172.21.15.26:0/2237846262 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640005db0 con 0x7f263c0d3a80 2023-11-28T16:56:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 Processor -- start 2023-11-28T16:56:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 Processor -- start 2023-11-28T16:56:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c041b30 con 0x7f263c0d3a80 2023-11-28T16:56:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c172140 con 0x7f263c0d3a80 2023-11-28T16:56:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f263a7fc640 1 -- 172.21.15.26:0/2237846262 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26400070d0 con 0x7f263c0d3a80 2023-11-28T16:56:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f263a7fc640 1 -- 172.21.15.26:0/2237846262 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640005db0 con 0x7f263c0d3a80 2023-11-28T16:56:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 -- start start 2023-11-28T16:56:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f8ad131d640 1 -- 172.21.15.26:0/1202916047 shutdown_connections 2023-11-28T16:56:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f8ad131d640 1 -- 172.21.15.26:0/1202916047 >> 172.21.15.26:0/1202916047 conn(0x7f8acc0a8640 msgr2=0x7f8acc0a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a80071e0 0x7fa3a8047670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a800e190 0x7fa3a8048c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80d7a50 0x7fa3a80491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80487f0 con 0x7fa3a800e190 2023-11-28T16:56:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80dbbd0 con 0x7fa3a80071e0 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b6038640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80484c0 con 0x7fa3a80d7a50 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a800e190 0x7fa3a8048c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a800e190 0x7fa3a8048c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53474/0 (socket says 172.21.15.26:53474) 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 -- 172.21.15.26:0/2448731081 learned_addr learned my addr 172.21.15.26:0/2448731081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 -- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80d7a50 msgr2=0x7fa3a80491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80d7a50 0x7fa3a80491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 -- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a80071e0 msgr2=0x7fa3a8047670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a80071e0 0x7fa3a8047670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fa3b4835640 1 -- 172.21.15.26:0/2448731081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac009420 con 0x7fa3a800e190 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 -- start start 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec0c09d0 0x7fedec13b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedec14dbc0 0x7fedec13be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec1f5760 con 0x7fedec14dbc0 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec1f51e0 con 0x7fedec0c09d0 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1c74640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec1f13d0 con 0x7fedec06e3b0 2023-11-28T16:56:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c005260 con 0x7f263c0d3a80 2023-11-28T16:56:26.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f8ad131d640 1 -- 172.21.15.26:0/1202916047 shutdown_connections 2023-11-28T16:56:26.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec0c09d0 0x7fedec13b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1473640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedec14dbc0 0x7fedec13be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1473640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedec14dbc0 0x7fedec13be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53482/0 (socket says 172.21.15.26:53482) 2023-11-28T16:56:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf1473640 1 -- 172.21.15.26:0/1610353729 learned_addr learned my addr 172.21.15.26:0/1610353729 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fa3b4835640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a800e190 0x7fa3a8048c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000e870 tx=0x7fa3a000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7fedf0c72640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fa3a5ffb640 1 -- 172.21.15.26:0/2448731081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0009510 con 0x7fa3a800e190 2023-11-28T16:56:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fa3a5ffb640 1 -- 172.21.15.26:0/2448731081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a000eec0 con 0x7fa3a800e190 2023-11-28T16:56:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fa3a5ffb640 1 -- 172.21.15.26:0/2448731081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000cb40 con 0x7fa3a800e190 2023-11-28T16:56:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a8173560 con 0x7fa3a800e190 2023-11-28T16:56:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedebfff640 1 -- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 msgr2=0x7fedec152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedebfff640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedebfff640 1 -- 172.21.15.26:0/1610353729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedec14dbc0 msgr2=0x7fedec13be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedebfff640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedec14dbc0 0x7fedec13be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedebfff640 1 -- 172.21.15.26:0/1610353729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00094d0 con 0x7fedec0c09d0 2023-11-28T16:56:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedebfff640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec0c09d0 0x7fedec13b900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fede4007d80 tx=0x7fede400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fede97fa640 1 -- 172.21.15.26:0/1610353729 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4014420 con 0x7fedec0c09d0 2023-11-28T16:56:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fede97fa640 1 -- 172.21.15.26:0/1610353729 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4014580 con 0x7fedec0c09d0 2023-11-28T16:56:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fede97fa640 1 -- 172.21.15.26:0/1610353729 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4014930 con 0x7fedec0c09d0 2023-11-28T16:56:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7f263a7fc640 1 -- 172.21.15.26:0/2237846262 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2640007240 con 0x7f263c0d3a80 2023-11-28T16:56:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a8173840 con 0x7fa3a800e190 2023-11-28T16:56:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.375+0000 7f8ad131d640 1 -- 172.21.15.26:0/1202916047 wait complete. 2023-11-28T16:56:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7f8ad131d640 1 Processor -- start 2023-11-28T16:56:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0a8e30 con 0x7fedec0c09d0 2023-11-28T16:56:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec153300 con 0x7fedec0c09d0 2023-11-28T16:56:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.379+0000 7f8ad131d640 1 -- start start 2023-11-28T16:56:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7fedf1473640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedec14dbc0 0x7fedec13be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f263a7fc640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2628066990 0x7f2628068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f263a7fc640 1 -- 172.21.15.26:0/2237846262 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2640083450 con 0x7f263c0d3a80 2023-11-28T16:56:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8ad131d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4003f10 0x7f8acc14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a80056f0 con 0x7fa3a800e190 2023-11-28T16:56:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec1f1230 con 0x7fedec0c09d0 2023-11-28T16:56:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f2649994640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2628066990 0x7f2628068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8ad131d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc0c62e0 0x7f8acc1fcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8acaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4003f10 0x7f8acc14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8aca7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc0c62e0 0x7f8acc1fcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8aca7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc0c62e0 0x7f8acc1fcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44428/0 (socket says 172.21.15.26:44428) 2023-11-28T16:56:26.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8acaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4003f10 0x7f8acc14f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:52520/0 (socket says 172.21.15.26:52520) 2023-11-28T16:56:26.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8aca7fc640 1 -- 172.21.15.26:0/1050085408 learned_addr learned my addr 172.21.15.26:0/1050085408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7fa3a5ffb640 1 -- 172.21.15.26:0/2448731081 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3a000ccc0 con 0x7fa3a800e190 2023-11-28T16:56:26.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f2649994640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2628066990 0x7f2628068e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f263c048eb0 tx=0x7f2644067370 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc0ab9a0 0x7f8acc1fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0ab510 con 0x7f8acc0ab9a0 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc150380 con 0x7f8ab4003f10 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0c7080 con 0x7f8acc0c62e0 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7f8acbfff640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc0ab9a0 0x7f8acc1fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8aca7fc640 1 -- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4003f10 msgr2=0x7f8acc14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4003f10 0x7f8acc14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8aca7fc640 1 -- 172.21.15.26:0/1050085408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc0ab9a0 msgr2=0x7f8acc1fd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc0ab9a0 0x7f8acc1fd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8aca7fc640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0c7360 con 0x7f8acc0c62e0 2023-11-28T16:56:26.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8aca7fc640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc0c62e0 0x7f8acc1fcea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009a00 tx=0x7f8ac0009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.383+0000 7fede97fa640 1 -- 172.21.15.26:0/1610353729 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fede4014a90 con 0x7fedec0c09d0 2023-11-28T16:56:26.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7fede97fa640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedd8066920 0x7fedd8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7fede97fa640 1 -- 172.21.15.26:0/1610353729 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fede4084b10 con 0x7fedec0c09d0 2023-11-28T16:56:26.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8ab37fe640 1 -- 172.21.15.26:0/1050085408 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00b5070 con 0x7f8acc0c62e0 2023-11-28T16:56:26.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8ab37fe640 1 -- 172.21.15.26:0/1050085408 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac0004020 con 0x7f8acc0c62e0 2023-11-28T16:56:26.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8ab37fe640 1 -- 172.21.15.26:0/1050085408 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00b5070 con 0x7f8acc0c62e0 2023-11-28T16:56:26.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7fedf0c72640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedd8066920 0x7fedd8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc0c5cf0 con 0x7f8acc0c62e0 2023-11-28T16:56:26.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7fa3a5ffb640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa394066920 0x7fa394068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc14fc30 con 0x7f8acc0c62e0 2023-11-28T16:56:26.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7fa3b5036640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa394066920 0x7fa394068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7fedf0c72640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedd8066920 0x7fedd8068de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fede00ad000 tx=0x7fede00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f263a7fc640 1 -- 172.21.15.26:0/2237846262 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26400506b0 con 0x7f263c0d3a80 2023-11-28T16:56:26.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7fa3a5ffb640 1 -- 172.21.15.26:0/2448731081 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3a00845a0 con 0x7fa3a800e190 2023-11-28T16:56:26.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.387+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc04e890 con 0x7f8acc0c62e0 2023-11-28T16:56:26.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.391+0000 7fa3b5036640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa394066920 0x7fa394068de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0ae000 tx=0x7fa3ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.391+0000 7f8ab37fe640 1 -- 172.21.15.26:0/1050085408 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8ac0004190 con 0x7f8acc0c62e0 2023-11-28T16:56:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.391+0000 7fa3a5ffb640 1 -- 172.21.15.26:0/2448731081 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3a00517c0 con 0x7fa3a800e190 2023-11-28T16:56:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.391+0000 7f8ab37fe640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ab8066990 0x7f8ab8068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.391+0000 7f8ab37fe640 1 -- 172.21.15.26:0/1050085408 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ac011dd50 con 0x7f8acc0c62e0 2023-11-28T16:56:26.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.391+0000 7fede97fa640 1 -- 172.21.15.26:0/1610353729 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fedec1f1230 con 0x7fedec0c09d0 2023-11-28T16:56:26.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.395+0000 7f8acaffd640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ab8066990 0x7f8ab8068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.399+0000 7f8acaffd640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ab8066990 0x7f8ab8068e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8abc001870 tx=0x7f8abc007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.399+0000 7f8ab37fe640 1 -- 172.21.15.26:0/1050085408 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ac00eaf20 con 0x7f8acc0c62e0 2023-11-28T16:56:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.567+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f40d41f1730 con 0x7f40d414dc50 2023-11-28T16:56:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.571+0000 7f40bb7fe640 1 -- 172.21.15.26:0/1716468938 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40d41f1730 con 0x7f40d414dc50 2023-11-28T16:56:26.574 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.571+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40c0066920 msgr2=0x7f40c0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.571+0000 7f40d929a640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40c0066920 0x7f40c0068de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007f00 tx=0x7f40c8008040 comp rx=0 tx=0).stop 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d414dc50 msgr2=0x7f40d40a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d414dc50 0x7f40d40a9ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00be30 tx=0x7f40cc00bf20 comp rx=0 tx=0).stop 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 shutdown_connections 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d414dc50 0x7f40d40a9ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40c0066920 0x7f40c0068de0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40d406c400 0x7f40d40a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 --2- 172.21.15.26:0/1716468938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d406bee0 0x7f40d4145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 >> 172.21.15.26:0/1716468938 conn(0x7f40d40c5e10 msgr2=0x7f40d40c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 shutdown_connections 2023-11-28T16:56:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.575+0000 7f40d929a640 1 -- 172.21.15.26:0/1716468938 wait complete. 2023-11-28T16:56:26.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2023-11-28T16:56:26.610 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.615+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25bc14d630 con 0x7f25bc155660 2023-11-28T16:56:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.615+0000 7f25aaffd640 1 -- 172.21.15.26:0/1391753913 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25bc14d630 con 0x7f25bc155660 2023-11-28T16:56:26.622 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-11-28T16:56:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f259c066920 msgr2=0x7f259c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f259c066920 0x7f259c068de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f25b0007fd0 tx=0x7f25b00079a0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25bc155660 msgr2=0x7f25bc14c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25bc155660 0x7f25bc14c3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25b400cb20 tx=0x7f25b40020e0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 shutdown_connections 2023-11-28T16:56:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f259c066920 0x7f259c068de0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25bc155660 0x7f25bc14c3a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25bc1520f0 0x7f25bc14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 --2- 172.21.15.26:0/1391753913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25bc06b650 0x7f25bc14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 >> 172.21.15.26:0/1391753913 conn(0x7f25bc0ca070 msgr2=0x7f25bc0c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 shutdown_connections 2023-11-28T16:56:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.619+0000 7f25c0c79640 1 -- 172.21.15.26:0/1391753913 wait complete. 2023-11-28T16:56:26.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.639+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ed004e890 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.639+0000 7f1ecd7fa640 1 -- 172.21.15.26:0/1336507999 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ec00ba020 con 0x7f1ed00bd5e0 2023-11-28T16:56:26.645 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-11-28T16:56:26.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.643+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1ebc0668d0 msgr2=0x7f1ebc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.643+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1ebc0668d0 0x7f1ebc068d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8007fd0 tx=0x7f1ec8009040 comp rx=0 tx=0).stop 2023-11-28T16:56:26.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.643+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ed00bd5e0 msgr2=0x7f1ed00ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.643+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ed00bd5e0 0x7f1ed00ad880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00ae040 tx=0x7f1ec001ad40 comp rx=0 tx=0).stop 2023-11-28T16:56:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 shutdown_connections 2023-11-28T16:56:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1ebc0668d0 0x7f1ebc068d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ed00bd5e0 0x7f1ed00ad880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed006b4e0 0x7f1ed00ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 --2- 172.21.15.26:0/1336507999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ed006b100 0x7f1ed0148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 >> 172.21.15.26:0/1336507999 conn(0x7f1ed00ca550 msgr2=0x7f1ed0153330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 shutdown_connections 2023-11-28T16:56:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f1ed5d7d640 1 -- 172.21.15.26:0/1336507999 wait complete. 2023-11-28T16:56:26.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.647+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d9015f410 con 0x7f2d900a7330 2023-11-28T16:56:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.651+0000 7f2d85ffb640 1 -- 172.21.15.26:0/471285320 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d9015f410 con 0x7f2d900a7330 2023-11-28T16:56:26.656 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.651+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d74066920 msgr2=0x7f2d74068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.651+0000 7f2d96548640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d74066920 0x7f2d74068de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0099a0 tx=0x7f2d8c0090e0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.651+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d900a7330 msgr2=0x7f2d900be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.651+0000 7f2d96548640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d900a7330 0x7f2d900be2e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2d800ab000 tx=0x7f2d8001ad60 comp rx=0 tx=0).stop 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 shutdown_connections 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d74066920 0x7f2d74068de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d900c6310 0x7f2d90157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d900a7330 0x7f2d900be2e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 --2- 172.21.15.26:0/471285320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9006d420 0x7f2d900ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 >> 172.21.15.26:0/471285320 conn(0x7f2d9006aba0 msgr2=0x7f2d9006f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 shutdown_connections 2023-11-28T16:56:26.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.655+0000 7f2d96548640 1 -- 172.21.15.26:0/471285320 wait complete. 2023-11-28T16:56:26.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.3 2023-11-28T16:56:26.660 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.671+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fedec1f1230 con 0x7fedec0c09d0 2023-11-28T16:56:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.671+0000 7fede97fa640 1 -- 172.21.15.26:0/1610353729 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedec1f1230 con 0x7fedec0c09d0 2023-11-28T16:56:26.675 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.671+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedd8066920 msgr2=0x7fedd8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.671+0000 7fedf1c74640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedd8066920 0x7fedd8068de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fede00ad000 tx=0x7fede00a6000 comp rx=0 tx=0).stop 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.671+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec0c09d0 msgr2=0x7fedec13b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.671+0000 7fedf1c74640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec0c09d0 0x7fedec13b900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fede4007d80 tx=0x7fede400e4b0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 shutdown_connections 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedec14dbc0 0x7fedec13be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedec0c09d0 0x7fedec13b900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedd8066920 0x7fedd8068de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 --2- 172.21.15.26:0/1610353729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedec06e3b0 0x7fedec152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 >> 172.21.15.26:0/1610353729 conn(0x7fedec0c5fd0 msgr2=0x7fedec13f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 shutdown_connections 2023-11-28T16:56:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.675+0000 7fedf1c74640 1 -- 172.21.15.26:0/1610353729 wait complete. 2023-11-28T16:56:26.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2023-11-28T16:56:26.685 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2023-11-28T16:56:26.689 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.687+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f262c005510 con 0x7f263c0d3a80 2023-11-28T16:56:26.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.687+0000 7f263a7fc640 1 -- 172.21.15.26:0/2237846262 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2640053cd0 con 0x7f263c0d3a80 2023-11-28T16:56:26.693 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-11-28T16:56:26.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2628066990 msgr2=0x7f2628068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2628066990 0x7f2628068e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f263c048eb0 tx=0x7f2644067370 comp rx=0 tx=0).stop 2023-11-28T16:56:26.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f263c0d3a80 msgr2=0x7f263c16e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f263c0d3a80 0x7f263c16e750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f264000c3f0 tx=0x7f264000c8b0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 shutdown_connections 2023-11-28T16:56:26.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f263c0da300 0x7f263c16ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2628066990 0x7f2628068e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f263c0d3a80 0x7f263c16e750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 --2- 172.21.15.26:0/2237846262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f263c00bd30 0x7f263c0d8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 >> 172.21.15.26:0/2237846262 conn(0x7f263c048230 msgr2=0x7f263c00a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 shutdown_connections 2023-11-28T16:56:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.691+0000 7f264a996640 1 -- 172.21.15.26:0/2237846262 wait complete. 2023-11-28T16:56:26.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-11-28T16:56:26.700 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa3a804e3f0 con 0x7fa3a800e190 2023-11-28T16:56:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3a5ffb640 1 -- 172.21.15.26:0/2448731081 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3a0054de0 con 0x7fa3a800e190 2023-11-28T16:56:26.714 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-11-28T16:56:26.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-11-28T16:56:26.717 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa394066920 msgr2=0x7fa394068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa394066920 0x7fa394068de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0ae000 tx=0x7fa3ac008040 comp rx=0 tx=0).stop 2023-11-28T16:56:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a800e190 msgr2=0x7fa3a8048c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a800e190 0x7fa3a8048c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000e870 tx=0x7fa3a000ec70 comp rx=0 tx=0).stop 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 shutdown_connections 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa394066920 0x7fa394068de0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a80d7a50 0x7fa3a80491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a800e190 0x7fa3a8048c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 --2- 172.21.15.26:0/2448731081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a80071e0 0x7fa3a8047670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 >> 172.21.15.26:0/2448731081 conn(0x7fa3a804c5c0 msgr2=0x7fa3a80d5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 shutdown_connections 2023-11-28T16:56:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.711+0000 7fa3b6038640 1 -- 172.21.15.26:0/2448731081 wait complete. 2023-11-28T16:56:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.723+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8acc071810 con 0x7f8acc0c62e0 2023-11-28T16:56:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.723+0000 7f8ab37fe640 1 -- 172.21.15.26:0/1050085408 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ac000f040 con 0x7f8acc0c62e0 2023-11-28T16:56:26.729 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ab8066990 msgr2=0x7f8ab8068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ab8066990 0x7f8ab8068e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8abc001870 tx=0x7f8abc007040 comp rx=0 tx=0).stop 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc0c62e0 msgr2=0x7f8acc1fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc0c62e0 0x7f8acc1fcea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009a00 tx=0x7f8ac0009190 comp rx=0 tx=0).stop 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 shutdown_connections 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8acc0ab9a0 0x7f8acc1fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ab8066990 0x7f8ab8068e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8acc0c62e0 0x7f8acc1fcea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 --2- 172.21.15.26:0/1050085408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab4003f10 0x7f8acc14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 >> 172.21.15.26:0/1050085408 conn(0x7f8acc0a8640 msgr2=0x7f8acc15a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 shutdown_connections 2023-11-28T16:56:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.727+0000 7f8ad131d640 1 -- 172.21.15.26:0/1050085408 wait complete. 2023-11-28T16:56:26.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-11-28T16:56:26.738 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-11-28T16:56:26.751 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:26.751 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T16:56:26.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:56:26.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117ff96640 1 Processor -- start 2023-11-28T16:56:26.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117ff96640 1 -- start start 2023-11-28T16:56:26.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117ff96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11780c7ec0 0x7f117806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117ff96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117ff96640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1178155680 con 0x7f11780c48d0 2023-11-28T16:56:26.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117ff96640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1178158710 con 0x7f11780c7ec0 2023-11-28T16:56:26.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117ff96640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1178158ba0 con 0x7f1178155150 2023-11-28T16:56:26.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117dd32640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f11780c48d0 0x7f117806b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44068/0 (socket says 172.21.15.26:44068) 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117dd32640 1 -- 172.21.15.26:0/3764559066 learned_addr learned my addr 172.21.15.26:0/3764559066 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117e533640 1 --2- 172.21.15.26:0/3764559066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117d531640 1 --2- 172.21.15.26:0/3764559066 >> v2:172.21.15.79:3300/0 conn(0x7f11780c7ec0 0x7f117806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117cd30640 1 -- 172.21.15.26:0/3764559066 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317934564 0 0) 0x7f1178155680 con 0x7f11780c48d0 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117cd30640 1 -- 172.21.15.26:0/3764559066 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1164003530 con 0x7f11780c48d0 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117e533640 1 -- 172.21.15.26:0/3764559066 >> v2:172.21.15.79:3300/0 conn(0x7f11780c7ec0 msgr2=0x7f117806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117e533640 1 --2- 172.21.15.26:0/3764559066 >> v2:172.21.15.79:3300/0 conn(0x7f11780c7ec0 0x7f117806b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117e533640 1 -- 172.21.15.26:0/3764559066 >> v1:172.21.15.26:6789/0 conn(0x7f11780c48d0 legacy=0x7f117806b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.935+0000 7f117e533640 1 -- 172.21.15.26:0/3764559066 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178157de0 con 0x7f1178155150 2023-11-28T16:56:26.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117e533640 1 --2- 172.21.15.26:0/3764559066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780c4cb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d90 tx=0x7f117001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ab381ed93780be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117cd30640 1 -- 172.21.15.26:0/3764559066 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700a5870 con 0x7f1178155150 2023-11-28T16:56:26.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117cd30640 1 -- 172.21.15.26:0/3764559066 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700a59d0 con 0x7f1178155150 2023-11-28T16:56:26.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117cd30640 1 -- 172.21.15.26:0/3764559066 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700a5d60 con 0x7f1178155150 2023-11-28T16:56:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 -- 172.21.15.26:0/3764559066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 msgr2=0x7f11780c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 --2- 172.21.15.26:0/3764559066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780c4cb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d90 tx=0x7f117001c8c0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 -- 172.21.15.26:0/3764559066 shutdown_connections 2023-11-28T16:56:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 --2- 172.21.15.26:0/3764559066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780c4cb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 --2- 172.21.15.26:0/3764559066 >> v2:172.21.15.79:3300/0 conn(0x7f11780c7ec0 0x7f117806b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 -- 172.21.15.26:0/3764559066 >> 172.21.15.26:0/3764559066 conn(0x7f11780abb00 msgr2=0x7f11780abee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 -- 172.21.15.26:0/3764559066 shutdown_connections 2023-11-28T16:56:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.939+0000 7f117ff96640 1 -- 172.21.15.26:0/3764559066 wait complete. 2023-11-28T16:56:26.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 Processor -- start 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 -- start start 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11780c48d0 0x7f11780c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117814c090 0x7f11780add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117814ee00 con 0x7f11780c48d0 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117814dd80 con 0x7f117814c090 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117814e060 con 0x7f1178155150 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11780c48d0 0x7f11780c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11780c48d0 0x7f11780c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53498/0 (socket says 172.21.15.26:53498) 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 -- 172.21.15.26:0/3646268541 learned_addr learned my addr 172.21.15.26:0/3646268541 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117e533640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117814c090 0x7f11780add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117d531640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 -- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 msgr2=0x7f11780ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 -- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117814c090 msgr2=0x7f11780add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117814c090 0x7f11780add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 -- 172.21.15.26:0/3646268541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170009a70 con 0x7f11780c48d0 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117dd32640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11780c48d0 0x7f11780c3f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f117400c420 tx=0x7f117400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f116e7fc640 1 -- 172.21.15.26:0/3646268541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174005cf0 con 0x7f11780c48d0 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f116e7fc640 1 -- 172.21.15.26:0/3646268541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1174005e50 con 0x7f11780c48d0 2023-11-28T16:56:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117814e340 con 0x7f11780c48d0 2023-11-28T16:56:26.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f116e7fc640 1 -- 172.21.15.26:0/3646268541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740072d0 con 0x7f11780c48d0 2023-11-28T16:56:26.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.943+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11780af2c0 con 0x7f11780c48d0 2023-11-28T16:56:26.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.947+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11780af4b0 con 0x7f11780c48d0 2023-11-28T16:56:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.947+0000 7f116e7fc640 1 -- 172.21.15.26:0/3646268541 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1174007430 con 0x7f11780c48d0 2023-11-28T16:56:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.947+0000 7f116e7fc640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f115c0668d0 0x7f115c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.947+0000 7f116e7fc640 1 -- 172.21.15.26:0/3646268541 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1174083960 con 0x7f11780c48d0 2023-11-28T16:56:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.947+0000 7f117d531640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f115c0668d0 0x7f115c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.947+0000 7f117d531640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f115c0668d0 0x7f115c068d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f117806d060 tx=0x7f1168008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:26.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:26.951+0000 7f116e7fc640 1 -- 172.21.15.26:0/3646268541 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1174050c40 con 0x7f11780c48d0 2023-11-28T16:56:27.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.111+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11780afec0 con 0x7f115c0668d0 2023-11-28T16:56:27.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.115+0000 7f116e7fc640 1 -- 172.21.15.26:0/3646268541 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264561 (secure 0 0 0) 0x7f11780afec0 con 0x7f115c0668d0 2023-11-28T16:56:27.124 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:27.126 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:56:27.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f115c0668d0 msgr2=0x7f115c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f115c0668d0 0x7f115c068d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f117806d060 tx=0x7f1168008040 comp rx=0 tx=0).stop 2023-11-28T16:56:27.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11780c48d0 msgr2=0x7f11780c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11780c48d0 0x7f11780c3f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f117400c420 tx=0x7f117400c8e0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 shutdown_connections 2023-11-28T16:56:27.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117814c090 0x7f11780add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f115c0668d0 0x7f115c068d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1178155150 0x7f11780ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 --2- 172.21.15.26:0/3646268541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11780c48d0 0x7f11780c3f30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 >> 172.21.15.26:0/3646268541 conn(0x7f11780abb00 msgr2=0x7f117806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 shutdown_connections 2023-11-28T16:56:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.119+0000 7f117ff96640 1 -- 172.21.15.26:0/3646268541 wait complete. 2023-11-28T16:56:27.145 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T16:56:25.574584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231508,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743212,"statfs":{"total":773094113280,"available":772857049088,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001949"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335727+0000","last_change":"2023-11-28T16:56:18.296651+0000","last_active":"2023-11-28T16:56:19.335727+0000","last_peered":"2023-11-28T16:56:19.335727+0000","last_clean":"2023-11-28T16:56:19.335727+0000","last_became_active":"2023-11-28T16:56:18.296364+0000","last_became_peered":"2023-11-28T16:56:18.296364+0000","last_unstale":"2023-11-28T16:56:19.335727+0000","last_undegraded":"2023-11-28T16:56:19.335727+0000","last_fullsized":"2023-11-28T16:56:19.335727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:01.071568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289822+0000","last_change":"2023-11-28T16:56:18.292206+0000","last_active":"2023-11-28T16:56:19.289822+0000","last_peered":"2023-11-28T16:56:19.289822+0000","last_clean":"2023-11-28T16:56:19.289822+0000","last_became_active":"2023-11-28T16:56:18.291849+0000","last_became_peered":"2023-11-28T16:56:18.291849+0000","last_unstale":"2023-11-28T16:56:19.289822+0000","last_undegraded":"2023-11-28T16:56:19.289822+0000","last_fullsized":"2023-11-28T16:56:19.289822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290500+0000","last_change":"2023-11-28T16:56:18.288339+0000","last_active":"2023-11-28T16:56:19.290500+0000","last_peered":"2023-11-28T16:56:19.290500+0000","last_clean":"2023-11-28T16:56:19.290500+0000","last_became_active":"2023-11-28T16:56:18.287985+0000","last_became_peered":"2023-11-28T16:56:18.287985+0000","last_unstale":"2023-11-28T16:56:19.290500+0000","last_undegraded":"2023-11-28T16:56:19.290500+0000","last_fullsized":"2023-11-28T16:56:19.290500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380850+0000","last_change":"2023-11-28T16:56:18.305269+0000","last_active":"2023-11-28T16:56:19.380850+0000","last_peered":"2023-11-28T16:56:19.380850+0000","last_clean":"2023-11-28T16:56:19.380850+0000","last_became_active":"2023-11-28T16:56:18.304177+0000","last_became_peered":"2023-11-28T16:56:18.304177+0000","last_unstale":"2023-11-28T16:56:19.380850+0000","last_undegraded":"2023-11-28T16:56:19.380850+0000","last_fullsized":"2023-11-28T16:56:19.380850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335226+0000","last_change":"2023-11-28T16:56:18.286848+0000","last_active":"2023-11-28T16:56:19.335226+0000","last_peered":"2023-11-28T16:56:19.335226+0000","last_clean":"2023-11-28T16:56:19.335226+0000","last_became_active":"2023-11-28T16:56:18.286539+0000","last_became_peered":"2023-11-28T16:56:18.286539+0000","last_unstale":"2023-11-28T16:56:19.335226+0000","last_undegraded":"2023-11-28T16:56:19.335226+0000","last_fullsized":"2023-11-28T16:56:19.335226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381105+0000","last_change":"2023-11-28T16:56:18.293363+0000","last_active":"2023-11-28T16:56:19.381105+0000","last_peered":"2023-11-28T16:56:19.381105+0000","last_clean":"2023-11-28T16:56:19.381105+0000","last_became_active":"2023-11-28T16:56:18.293105+0000","last_became_peered":"2023-11-28T16:56:18.293105+0000","last_unstale":"2023-11-28T16:56:19.381105+0000","last_undegraded":"2023-11-28T16:56:19.381105+0000","last_fullsized":"2023-11-28T16:56:19.381105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335025+0000","last_change":"2023-11-28T16:56:18.294379+0000","last_active":"2023-11-28T16:56:19.335025+0000","last_peered":"2023-11-28T16:56:19.335025+0000","last_clean":"2023-11-28T16:56:19.335025+0000","last_became_active":"2023-11-28T16:56:18.288865+0000","last_became_peered":"2023-11-28T16:56:18.288865+0000","last_unstale":"2023-11-28T16:56:19.335025+0000","last_undegraded":"2023-11-28T16:56:19.335025+0000","last_fullsized":"2023-11-28T16:56:19.335025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379632+0000","last_change":"2023-11-28T16:56:18.292313+0000","last_active":"2023-11-28T16:56:19.379632+0000","last_peered":"2023-11-28T16:56:19.379632+0000","last_clean":"2023-11-28T16:56:19.379632+0000","last_became_active":"2023-11-28T16:56:18.292008+0000","last_became_peered":"2023-11-28T16:56:18.292008+0000","last_unstale":"2023-11-28T16:56:19.379632+0000","last_undegraded":"2023-11-28T16:56:19.379632+0000","last_fullsized":"2023-11-28T16:56:19.379632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335730+0000","last_change":"2023-11-28T16:56:18.287530+0000","last_active":"2023-11-28T16:56:19.335730+0000","last_peered":"2023-11-28T16:56:19.335730+0000","last_clean":"2023-11-28T16:56:19.335730+0000","last_became_active":"2023-11-28T16:56:18.287193+0000","last_became_peered":"2023-11-28T16:56:18.287193+0000","last_unstale":"2023-11-28T16:56:19.335730+0000","last_undegraded":"2023-11-28T16:56:19.335730+0000","last_fullsized":"2023-11-28T16:56:19.335730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:48.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380554+0000","last_change":"2023-11-28T16:56:18.301134+0000","last_active":"2023-11-28T16:56:19.380554+0000","last_peered":"2023-11-28T16:56:19.380554+0000","last_clean":"2023-11-28T16:56:19.380554+0000","last_became_active":"2023-11-28T16:56:18.300869+0000","last_became_peered":"2023-11-28T16:56:18.300869+0000","last_unstale":"2023-11-28T16:56:19.380554+0000","last_undegraded":"2023-11-28T16:56:19.380554+0000","last_fullsized":"2023-11-28T16:56:19.380554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380564+0000","last_change":"2023-11-28T16:56:18.297402+0000","last_active":"2023-11-28T16:56:19.380564+0000","last_peered":"2023-11-28T16:56:19.380564+0000","last_clean":"2023-11-28T16:56:19.380564+0000","last_became_active":"2023-11-28T16:56:18.297065+0000","last_became_peered":"2023-11-28T16:56:18.297065+0000","last_unstale":"2023-11-28T16:56:19.380564+0000","last_undegraded":"2023-11-28T16:56:19.380564+0000","last_fullsized":"2023-11-28T16:56:19.380564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292538+0000","last_change":"2023-11-28T16:56:18.295149+0000","last_active":"2023-11-28T16:56:19.292538+0000","last_peered":"2023-11-28T16:56:19.292538+0000","last_clean":"2023-11-28T16:56:19.292538+0000","last_became_active":"2023-11-28T16:56:18.294748+0000","last_became_peered":"2023-11-28T16:56:18.294748+0000","last_unstale":"2023-11-28T16:56:19.292538+0000","last_undegraded":"2023-11-28T16:56:19.292538+0000","last_fullsized":"2023-11-28T16:56:19.292538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379738+0000","last_change":"2023-11-28T16:56:18.299824+0000","last_active":"2023-11-28T16:56:19.379738+0000","last_peered":"2023-11-28T16:56:19.379738+0000","last_clean":"2023-11-28T16:56:19.379738+0000","last_became_active":"2023-11-28T16:56:18.299530+0000","last_became_peered":"2023-11-28T16:56:18.299530+0000","last_unstale":"2023-11-28T16:56:19.379738+0000","last_undegraded":"2023-11-28T16:56:19.379738+0000","last_fullsized":"2023-11-28T16:56:19.379738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290067+0000","last_change":"2023-11-28T16:56:18.294327+0000","last_active":"2023-11-28T16:56:19.290067+0000","last_peered":"2023-11-28T16:56:19.290067+0000","last_clean":"2023-11-28T16:56:19.290067+0000","last_became_active":"2023-11-28T16:56:18.291271+0000","last_became_peered":"2023-11-28T16:56:18.291271+0000","last_unstale":"2023-11-28T16:56:19.290067+0000","last_undegraded":"2023-11-28T16:56:19.290067+0000","last_fullsized":"2023-11-28T16:56:19.290067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:57.105359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289240+0000","last_change":"2023-11-28T16:56:18.317151+0000","last_active":"2023-11-28T16:56:19.289240+0000","last_peered":"2023-11-28T16:56:19.289240+0000","last_clean":"2023-11-28T16:56:19.289240+0000","last_became_active":"2023-11-28T16:56:18.314732+0000","last_became_peered":"2023-11-28T16:56:18.314732+0000","last_unstale":"2023-11-28T16:56:19.289240+0000","last_undegraded":"2023-11-28T16:56:19.289240+0000","last_fullsized":"2023-11-28T16:56:19.289240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380376+0000","last_change":"2023-11-28T16:56:18.292779+0000","last_active":"2023-11-28T16:56:19.380376+0000","last_peered":"2023-11-28T16:56:19.380376+0000","last_clean":"2023-11-28T16:56:19.380376+0000","last_became_active":"2023-11-28T16:56:18.292415+0000","last_became_peered":"2023-11-28T16:56:18.292415+0000","last_unstale":"2023-11-28T16:56:19.380376+0000","last_undegraded":"2023-11-28T16:56:19.380376+0000","last_fullsized":"2023-11-28T16:56:19.380376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381358+0000","last_change":"2023-11-28T16:56:18.301370+0000","last_active":"2023-11-28T16:56:19.381358+0000","last_peered":"2023-11-28T16:56:19.381358+0000","last_clean":"2023-11-28T16:56:19.381358+0000","last_became_active":"2023-11-28T16:56:18.301075+0000","last_became_peered":"2023-11-28T16:56:18.301075+0000","last_unstale":"2023-11-28T16:56:19.381358+0000","last_undegraded":"2023-11-28T16:56:19.381358+0000","last_fullsized":"2023-11-28T16:56:19.381358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379398+0000","last_change":"2023-11-28T16:56:18.295704+0000","last_active":"2023-11-28T16:56:19.379398+0000","last_peered":"2023-11-28T16:56:19.379398+0000","last_clean":"2023-11-28T16:56:19.379398+0000","last_became_active":"2023-11-28T16:56:18.294762+0000","last_became_peered":"2023-11-28T16:56:18.294762+0000","last_unstale":"2023-11-28T16:56:19.379398+0000","last_undegraded":"2023-11-28T16:56:19.379398+0000","last_fullsized":"2023-11-28T16:56:19.379398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335491+0000","last_change":"2023-11-28T16:56:18.290479+0000","last_active":"2023-11-28T16:56:19.335491+0000","last_peered":"2023-11-28T16:56:19.335491+0000","last_clean":"2023-11-28T16:56:19.335491+0000","last_became_active":"2023-11-28T16:56:18.289982+0000","last_became_peered":"2023-11-28T16:56:18.289982+0000","last_unstale":"2023-11-28T16:56:19.335491+0000","last_undegraded":"2023-11-28T16:56:19.335491+0000","last_fullsized":"2023-11-28T16:56:19.335491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:11.202868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380969+0000","last_change":"2023-11-28T16:56:18.305161+0000","last_active":"2023-11-28T16:56:19.380969+0000","last_peered":"2023-11-28T16:56:19.380969+0000","last_clean":"2023-11-28T16:56:19.380969+0000","last_became_active":"2023-11-28T16:56:18.304931+0000","last_became_peered":"2023-11-28T16:56:18.304931+0000","last_unstale":"2023-11-28T16:56:19.380969+0000","last_undegraded":"2023-11-28T16:56:19.380969+0000","last_fullsized":"2023-11-28T16:56:19.380969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290248+0000","last_change":"2023-11-28T16:56:18.295103+0000","last_active":"2023-11-28T16:56:19.290248+0000","last_peered":"2023-11-28T16:56:19.290248+0000","last_clean":"2023-11-28T16:56:19.290248+0000","last_became_active":"2023-11-28T16:56:18.294121+0000","last_became_peered":"2023-11-28T16:56:18.294121+0000","last_unstale":"2023-11-28T16:56:19.290248+0000","last_undegraded":"2023-11-28T16:56:19.290248+0000","last_fullsized":"2023-11-28T16:56:19.290248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:01.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380774+0000","last_change":"2023-11-28T16:56:18.300601+0000","last_active":"2023-11-28T16:56:19.380774+0000","last_peered":"2023-11-28T16:56:19.380774+0000","last_clean":"2023-11-28T16:56:19.380774+0000","last_became_active":"2023-11-28T16:56:18.300316+0000","last_became_peered":"2023-11-28T16:56:18.300316+0000","last_unstale":"2023-11-28T16:56:19.380774+0000","last_undegraded":"2023-11-28T16:56:19.380774+0000","last_fullsized":"2023-11-28T16:56:19.380774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379383+0000","last_change":"2023-11-28T16:56:18.298840+0000","last_active":"2023-11-28T16:56:19.379383+0000","last_peered":"2023-11-28T16:56:19.379383+0000","last_clean":"2023-11-28T16:56:19.379383+0000","last_became_active":"2023-11-28T16:56:18.297520+0000","last_became_peered":"2023-11-28T16:56:18.297520+0000","last_unstale":"2023-11-28T16:56:19.379383+0000","last_undegraded":"2023-11-28T16:56:19.379383+0000","last_fullsized":"2023-11-28T16:56:19.379383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380406+0000","last_change":"2023-11-28T16:56:18.298922+0000","last_active":"2023-11-28T16:56:19.380406+0000","last_peered":"2023-11-28T16:56:19.380406+0000","last_clean":"2023-11-28T16:56:19.380406+0000","last_became_active":"2023-11-28T16:56:18.298405+0000","last_became_peered":"2023-11-28T16:56:18.298405+0000","last_unstale":"2023-11-28T16:56:19.380406+0000","last_undegraded":"2023-11-28T16:56:19.380406+0000","last_fullsized":"2023-11-28T16:56:19.380406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380028+0000","last_change":"2023-11-28T16:56:18.299370+0000","last_active":"2023-11-28T16:56:19.380028+0000","last_peered":"2023-11-28T16:56:19.380028+0000","last_clean":"2023-11-28T16:56:19.380028+0000","last_became_active":"2023-11-28T16:56:18.298398+0000","last_became_peered":"2023-11-28T16:56:18.298398+0000","last_unstale":"2023-11-28T16:56:19.380028+0000","last_undegraded":"2023-11-28T16:56:19.380028+0000","last_fullsized":"2023-11-28T16:56:19.380028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380776+0000","last_change":"2023-11-28T16:56:18.308925+0000","last_active":"2023-11-28T16:56:19.380776+0000","last_peered":"2023-11-28T16:56:19.380776+0000","last_clean":"2023-11-28T16:56:19.380776+0000","last_became_active":"2023-11-28T16:56:18.303301+0000","last_became_peered":"2023-11-28T16:56:18.303301+0000","last_unstale":"2023-11-28T16:56:19.380776+0000","last_undegraded":"2023-11-28T16:56:19.380776+0000","last_fullsized":"2023-11-28T16:56:19.380776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289808+0000","last_change":"2023-11-28T16:56:18.290403+0000","last_active":"2023-11-28T16:56:19.289808+0000","last_peered":"2023-11-28T16:56:19.289808+0000","last_clean":"2023-11-28T16:56:19.289808+0000","last_became_active":"2023-11-28T16:56:18.290049+0000","last_became_peered":"2023-11-28T16:56:18.290049+0000","last_unstale":"2023-11-28T16:56:19.289808+0000","last_undegraded":"2023-11-28T16:56:19.289808+0000","last_fullsized":"2023-11-28T16:56:19.289808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379926+0000","last_change":"2023-11-28T16:56:18.296771+0000","last_active":"2023-11-28T16:56:19.379926+0000","last_peered":"2023-11-28T16:56:19.379926+0000","last_clean":"2023-11-28T16:56:19.379926+0000","last_became_active":"2023-11-28T16:56:18.296481+0000","last_became_peered":"2023-11-28T16:56:18.296481+0000","last_unstale":"2023-11-28T16:56:19.379926+0000","last_undegraded":"2023-11-28T16:56:19.379926+0000","last_fullsized":"2023-11-28T16:56:19.379926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290303+0000","last_change":"2023-11-28T16:56:18.295300+0000","last_active":"2023-11-28T16:56:19.290303+0000","last_peered":"2023-11-28T16:56:19.290303+0000","last_clean":"2023-11-28T16:56:19.290303+0000","last_became_active":"2023-11-28T16:56:18.295029+0000","last_became_peered":"2023-11-28T16:56:18.295029+0000","last_unstale":"2023-11-28T16:56:19.290303+0000","last_undegraded":"2023-11-28T16:56:19.290303+0000","last_fullsized":"2023-11-28T16:56:19.290303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381291+0000","last_change":"2023-11-28T16:56:18.300254+0000","last_active":"2023-11-28T16:56:19.381291+0000","last_peered":"2023-11-28T16:56:19.381291+0000","last_clean":"2023-11-28T16:56:19.381291+0000","last_became_active":"2023-11-28T16:56:18.299932+0000","last_became_peered":"2023-11-28T16:56:18.299932+0000","last_unstale":"2023-11-28T16:56:19.381291+0000","last_undegraded":"2023-11-28T16:56:19.381291+0000","last_fullsized":"2023-11-28T16:56:19.381291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379533+0000","last_change":"2023-11-28T16:56:18.286733+0000","last_active":"2023-11-28T16:56:19.379533+0000","last_peered":"2023-11-28T16:56:19.379533+0000","last_clean":"2023-11-28T16:56:19.379533+0000","last_became_active":"2023-11-28T16:56:18.286290+0000","last_became_peered":"2023-11-28T16:56:18.286290+0000","last_unstale":"2023-11-28T16:56:19.379533+0000","last_undegraded":"2023-11-28T16:56:19.379533+0000","last_fullsized":"2023-11-28T16:56:19.379533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380201+0000","last_change":"2023-11-28T16:56:18.303664+0000","last_active":"2023-11-28T16:56:19.380201+0000","last_peered":"2023-11-28T16:56:19.380201+0000","last_clean":"2023-11-28T16:56:19.380201+0000","last_became_active":"2023-11-28T16:56:18.303227+0000","last_became_peered":"2023-11-28T16:56:18.303227+0000","last_unstale":"2023-11-28T16:56:19.380201+0000","last_undegraded":"2023-11-28T16:56:19.380201+0000","last_fullsized":"2023-11-28T16:56:19.380201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292149+0000","last_change":"2023-11-28T16:56:18.296578+0000","last_active":"2023-11-28T16:56:19.292149+0000","last_peered":"2023-11-28T16:56:19.292149+0000","last_clean":"2023-11-28T16:56:19.292149+0000","last_became_active":"2023-11-28T16:56:18.296120+0000","last_became_peered":"2023-11-28T16:56:18.296120+0000","last_unstale":"2023-11-28T16:56:19.292149+0000","last_undegraded":"2023-11-28T16:56:19.292149+0000","last_fullsized":"2023-11-28T16:56:19.292149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:58.898204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379894+0000","last_change":"2023-11-28T16:56:17.277061+0000","last_active":"2023-11-28T16:56:19.379894+0000","last_peered":"2023-11-28T16:56:19.379894+0000","last_clean":"2023-11-28T16:56:19.379894+0000","last_became_active":"2023-11-28T16:56:17.276729+0000","last_became_peered":"2023-11-28T16:56:17.276729+0000","last_unstale":"2023-11-28T16:56:19.379894+0000","last_undegraded":"2023-11-28T16:56:19.379894+0000","last_fullsized":"2023-11-28T16:56:19.379894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290375+0000","last_change":"2023-11-28T16:56:18.296888+0000","last_active":"2023-11-28T16:56:19.290375+0000","last_peered":"2023-11-28T16:56:19.290375+0000","last_clean":"2023-11-28T16:56:19.290375+0000","last_became_active":"2023-11-28T16:56:18.296583+0000","last_became_peered":"2023-11-28T16:56:18.296583+0000","last_unstale":"2023-11-28T16:56:19.290375+0000","last_undegraded":"2023-11-28T16:56:19.290375+0000","last_fullsized":"2023-11-28T16:56:19.290375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380694+0000","last_change":"2023-11-28T16:56:17.274703+0000","last_active":"2023-11-28T16:56:19.380694+0000","last_peered":"2023-11-28T16:56:19.380694+0000","last_clean":"2023-11-28T16:56:19.380694+0000","last_became_active":"2023-11-28T16:56:17.273982+0000","last_became_peered":"2023-11-28T16:56:17.273982+0000","last_unstale":"2023-11-28T16:56:19.380694+0000","last_undegraded":"2023-11-28T16:56:19.380694+0000","last_fullsized":"2023-11-28T16:56:19.380694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379497+0000","last_change":"2023-11-28T16:56:17.270991+0000","last_active":"2023-11-28T16:56:19.379497+0000","last_peered":"2023-11-28T16:56:19.379497+0000","last_clean":"2023-11-28T16:56:19.379497+0000","last_became_active":"2023-11-28T16:56:17.270655+0000","last_became_peered":"2023-11-28T16:56:17.270655+0000","last_unstale":"2023-11-28T16:56:19.379497+0000","last_undegraded":"2023-11-28T16:56:19.379497+0000","last_fullsized":"2023-11-28T16:56:19.379497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379300+0000","last_change":"2023-11-28T16:56:18.300151+0000","last_active":"2023-11-28T16:56:19.379300+0000","last_peered":"2023-11-28T16:56:19.379300+0000","last_clean":"2023-11-28T16:56:19.379300+0000","last_became_active":"2023-11-28T16:56:18.299856+0000","last_became_peered":"2023-11-28T16:56:18.299856+0000","last_unstale":"2023-11-28T16:56:19.379300+0000","last_undegraded":"2023-11-28T16:56:19.379300+0000","last_fullsized":"2023-11-28T16:56:19.379300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380514+0000","last_change":"2023-11-28T16:56:17.276089+0000","last_active":"2023-11-28T16:56:19.380514+0000","last_peered":"2023-11-28T16:56:19.380514+0000","last_clean":"2023-11-28T16:56:19.380514+0000","last_became_active":"2023-11-28T16:56:17.275737+0000","last_became_peered":"2023-11-28T16:56:17.275737+0000","last_unstale":"2023-11-28T16:56:19.380514+0000","last_undegraded":"2023-11-28T16:56:19.380514+0000","last_fullsized":"2023-11-28T16:56:19.380514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:35.781472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289119+0000","last_change":"2023-11-28T16:56:18.290460+0000","last_active":"2023-11-28T16:56:19.289119+0000","last_peered":"2023-11-28T16:56:19.289119+0000","last_clean":"2023-11-28T16:56:19.289119+0000","last_became_active":"2023-11-28T16:56:18.289279+0000","last_became_peered":"2023-11-28T16:56:18.289279+0000","last_unstale":"2023-11-28T16:56:19.289119+0000","last_undegraded":"2023-11-28T16:56:19.289119+0000","last_fullsized":"2023-11-28T16:56:19.289119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380625+0000","last_change":"2023-11-28T16:56:17.285460+0000","last_active":"2023-11-28T16:56:19.380625+0000","last_peered":"2023-11-28T16:56:19.380625+0000","last_clean":"2023-11-28T16:56:19.380625+0000","last_became_active":"2023-11-28T16:56:17.285086+0000","last_became_peered":"2023-11-28T16:56:17.285086+0000","last_unstale":"2023-11-28T16:56:19.380625+0000","last_undegraded":"2023-11-28T16:56:19.380625+0000","last_fullsized":"2023-11-28T16:56:19.380625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381297+0000","last_change":"2023-11-28T16:56:18.305936+0000","last_active":"2023-11-28T16:56:19.381297+0000","last_peered":"2023-11-28T16:56:19.381297+0000","last_clean":"2023-11-28T16:56:19.381297+0000","last_became_active":"2023-11-28T16:56:18.305605+0000","last_became_peered":"2023-11-28T16:56:18.305605+0000","last_unstale":"2023-11-28T16:56:19.381297+0000","last_undegraded":"2023-11-28T16:56:19.381297+0000","last_fullsized":"2023-11-28T16:56:19.381297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381093+0000","last_change":"2023-11-28T16:56:17.281889+0000","last_active":"2023-11-28T16:56:19.381093+0000","last_peered":"2023-11-28T16:56:19.381093+0000","last_clean":"2023-11-28T16:56:19.381093+0000","last_became_active":"2023-11-28T16:56:17.279528+0000","last_became_peered":"2023-11-28T16:56:17.279528+0000","last_unstale":"2023-11-28T16:56:19.381093+0000","last_undegraded":"2023-11-28T16:56:19.381093+0000","last_fullsized":"2023-11-28T16:56:19.381093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290576+0000","last_change":"2023-11-28T16:56:18.293159+0000","last_active":"2023-11-28T16:56:19.290576+0000","last_peered":"2023-11-28T16:56:19.290576+0000","last_clean":"2023-11-28T16:56:19.290576+0000","last_became_active":"2023-11-28T16:56:18.292829+0000","last_became_peered":"2023-11-28T16:56:18.292829+0000","last_unstale":"2023-11-28T16:56:19.290576+0000","last_undegraded":"2023-11-28T16:56:19.290576+0000","last_fullsized":"2023-11-28T16:56:19.290576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289906+0000","last_change":"2023-11-28T16:56:17.284348+0000","last_active":"2023-11-28T16:56:19.289906+0000","last_peered":"2023-11-28T16:56:19.289906+0000","last_clean":"2023-11-28T16:56:19.289906+0000","last_became_active":"2023-11-28T16:56:17.283980+0000","last_became_peered":"2023-11-28T16:56:17.283980+0000","last_unstale":"2023-11-28T16:56:19.289906+0000","last_undegraded":"2023-11-28T16:56:19.289906+0000","last_fullsized":"2023-11-28T16:56:19.289906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292612+0000","last_change":"2023-11-28T16:56:18.303791+0000","last_active":"2023-11-28T16:56:19.292612+0000","last_peered":"2023-11-28T16:56:19.292612+0000","last_clean":"2023-11-28T16:56:19.292612+0000","last_became_active":"2023-11-28T16:56:18.303124+0000","last_became_peered":"2023-11-28T16:56:18.303124+0000","last_unstale":"2023-11-28T16:56:19.292612+0000","last_undegraded":"2023-11-28T16:56:19.292612+0000","last_fullsized":"2023-11-28T16:56:19.292612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380840+0000","last_change":"2023-11-28T16:56:17.278950+0000","last_active":"2023-11-28T16:56:19.380840+0000","last_peered":"2023-11-28T16:56:19.380840+0000","last_clean":"2023-11-28T16:56:19.380840+0000","last_became_active":"2023-11-28T16:56:17.274910+0000","last_became_peered":"2023-11-28T16:56:17.274910+0000","last_unstale":"2023-11-28T16:56:19.380840+0000","last_undegraded":"2023-11-28T16:56:19.380840+0000","last_fullsized":"2023-11-28T16:56:19.380840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335299+0000","last_change":"2023-11-28T16:56:18.290296+0000","last_active":"2023-11-28T16:56:19.335299+0000","last_peered":"2023-11-28T16:56:19.335299+0000","last_clean":"2023-11-28T16:56:19.335299+0000","last_became_active":"2023-11-28T16:56:18.289615+0000","last_became_peered":"2023-11-28T16:56:18.289615+0000","last_unstale":"2023-11-28T16:56:19.335299+0000","last_undegraded":"2023-11-28T16:56:19.335299+0000","last_fullsized":"2023-11-28T16:56:19.335299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290385+0000","last_change":"2023-11-28T16:56:17.274214+0000","last_active":"2023-11-28T16:56:19.290385+0000","last_peered":"2023-11-28T16:56:19.290385+0000","last_clean":"2023-11-28T16:56:19.290385+0000","last_became_active":"2023-11-28T16:56:17.273502+0000","last_became_peered":"2023-11-28T16:56:17.273502+0000","last_unstale":"2023-11-28T16:56:19.290385+0000","last_undegraded":"2023-11-28T16:56:19.290385+0000","last_fullsized":"2023-11-28T16:56:19.290385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290196+0000","last_change":"2023-11-28T16:56:18.286223+0000","last_active":"2023-11-28T16:56:19.290196+0000","last_peered":"2023-11-28T16:56:19.290196+0000","last_clean":"2023-11-28T16:56:19.290196+0000","last_became_active":"2023-11-28T16:56:18.285913+0000","last_became_peered":"2023-11-28T16:56:18.285913+0000","last_unstale":"2023-11-28T16:56:19.290196+0000","last_undegraded":"2023-11-28T16:56:19.290196+0000","last_fullsized":"2023-11-28T16:56:19.290196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:58.506137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381200+0000","last_change":"2023-11-28T16:56:17.281382+0000","last_active":"2023-11-28T16:56:19.381200+0000","last_peered":"2023-11-28T16:56:19.381200+0000","last_clean":"2023-11-28T16:56:19.381200+0000","last_became_active":"2023-11-28T16:56:17.280978+0000","last_became_peered":"2023-11-28T16:56:17.280978+0000","last_unstale":"2023-11-28T16:56:19.381200+0000","last_undegraded":"2023-11-28T16:56:19.381200+0000","last_fullsized":"2023-11-28T16:56:19.381200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335329+0000","last_change":"2023-11-28T16:56:18.297433+0000","last_active":"2023-11-28T16:56:19.335329+0000","last_peered":"2023-11-28T16:56:19.335329+0000","last_clean":"2023-11-28T16:56:19.335329+0000","last_became_active":"2023-11-28T16:56:18.297151+0000","last_became_peered":"2023-11-28T16:56:18.297151+0000","last_unstale":"2023-11-28T16:56:19.335329+0000","last_undegraded":"2023-11-28T16:56:19.335329+0000","last_fullsized":"2023-11-28T16:56:19.335329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380199+0000","last_change":"2023-11-28T16:56:17.274113+0000","last_active":"2023-11-28T16:56:19.380199+0000","last_peered":"2023-11-28T16:56:19.380199+0000","last_clean":"2023-11-28T16:56:19.380199+0000","last_became_active":"2023-11-28T16:56:17.273829+0000","last_became_peered":"2023-11-28T16:56:17.273829+0000","last_unstale":"2023-11-28T16:56:19.380199+0000","last_undegraded":"2023-11-28T16:56:19.380199+0000","last_fullsized":"2023-11-28T16:56:19.380199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380389+0000","last_change":"2023-11-28T16:56:18.298961+0000","last_active":"2023-11-28T16:56:19.380389+0000","last_peered":"2023-11-28T16:56:19.380389+0000","last_clean":"2023-11-28T16:56:19.380389+0000","last_became_active":"2023-11-28T16:56:18.297627+0000","last_became_peered":"2023-11-28T16:56:18.297627+0000","last_unstale":"2023-11-28T16:56:19.380389+0000","last_undegraded":"2023-11-28T16:56:19.380389+0000","last_fullsized":"2023-11-28T16:56:19.380389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379011+0000","last_change":"2023-11-28T16:56:17.269852+0000","last_active":"2023-11-28T16:56:19.379011+0000","last_peered":"2023-11-28T16:56:19.379011+0000","last_clean":"2023-11-28T16:56:19.379011+0000","last_became_active":"2023-11-28T16:56:17.269433+0000","last_became_peered":"2023-11-28T16:56:17.269433+0000","last_unstale":"2023-11-28T16:56:19.379011+0000","last_undegraded":"2023-11-28T16:56:19.379011+0000","last_fullsized":"2023-11-28T16:56:19.379011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:53.668556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335123+0000","last_change":"2023-11-28T16:56:18.289171+0000","last_active":"2023-11-28T16:56:19.335123+0000","last_peered":"2023-11-28T16:56:19.335123+0000","last_clean":"2023-11-28T16:56:19.335123+0000","last_became_active":"2023-11-28T16:56:18.288412+0000","last_became_peered":"2023-11-28T16:56:18.288412+0000","last_unstale":"2023-11-28T16:56:19.335123+0000","last_undegraded":"2023-11-28T16:56:19.335123+0000","last_fullsized":"2023-11-28T16:56:19.335123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292552+0000","last_change":"2023-11-28T16:56:17.271860+0000","last_active":"2023-11-28T16:56:19.292552+0000","last_peered":"2023-11-28T16:56:19.292552+0000","last_clean":"2023-11-28T16:56:19.292552+0000","last_became_active":"2023-11-28T16:56:17.271327+0000","last_became_peered":"2023-11-28T16:56:17.271327+0000","last_unstale":"2023-11-28T16:56:19.292552+0000","last_undegraded":"2023-11-28T16:56:19.292552+0000","last_fullsized":"2023-11-28T16:56:19.292552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:37.653000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335599+0000","last_change":"2023-11-28T16:56:18.296341+0000","last_active":"2023-11-28T16:56:19.335599+0000","last_peered":"2023-11-28T16:56:19.335599+0000","last_clean":"2023-11-28T16:56:19.335599+0000","last_became_active":"2023-11-28T16:56:18.296000+0000","last_became_peered":"2023-11-28T16:56:18.296000+0000","last_unstale":"2023-11-28T16:56:19.335599+0000","last_undegraded":"2023-11-28T16:56:19.335599+0000","last_fullsized":"2023-11-28T16:56:19.335599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:12.212104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379483+0000","last_change":"2023-11-28T16:56:17.262861+0000","last_active":"2023-11-28T16:56:19.379483+0000","last_peered":"2023-11-28T16:56:19.379483+0000","last_clean":"2023-11-28T16:56:19.379483+0000","last_became_active":"2023-11-28T16:56:17.262560+0000","last_became_peered":"2023-11-28T16:56:17.262560+0000","last_unstale":"2023-11-28T16:56:19.379483+0000","last_undegraded":"2023-11-28T16:56:19.379483+0000","last_fullsized":"2023-11-28T16:56:19.379483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:30.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335816+0000","last_change":"2023-11-28T16:56:18.303867+0000","last_active":"2023-11-28T16:56:19.335816+0000","last_peered":"2023-11-28T16:56:19.335816+0000","last_clean":"2023-11-28T16:56:19.335816+0000","last_became_active":"2023-11-28T16:56:18.303566+0000","last_became_peered":"2023-11-28T16:56:18.303566+0000","last_unstale":"2023-11-28T16:56:19.335816+0000","last_undegraded":"2023-11-28T16:56:19.335816+0000","last_fullsized":"2023-11-28T16:56:19.335816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:28:53.866031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289997+0000","last_change":"2023-11-28T16:56:17.270718+0000","last_active":"2023-11-28T16:56:19.289997+0000","last_peered":"2023-11-28T16:56:19.289997+0000","last_clean":"2023-11-28T16:56:19.289997+0000","last_became_active":"2023-11-28T16:56:17.269258+0000","last_became_peered":"2023-11-28T16:56:17.269258+0000","last_unstale":"2023-11-28T16:56:19.289997+0000","last_undegraded":"2023-11-28T16:56:19.289997+0000","last_fullsized":"2023-11-28T16:56:19.289997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381133+0000","last_change":"2023-11-28T16:56:18.306623+0000","last_active":"2023-11-28T16:56:19.381133+0000","last_peered":"2023-11-28T16:56:19.381133+0000","last_clean":"2023-11-28T16:56:19.381133+0000","last_became_active":"2023-11-28T16:56:18.304538+0000","last_became_peered":"2023-11-28T16:56:18.304538+0000","last_unstale":"2023-11-28T16:56:19.381133+0000","last_undegraded":"2023-11-28T16:56:19.381133+0000","last_fullsized":"2023-11-28T16:56:19.381133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379166+0000","last_change":"2023-11-28T16:56:17.284653+0000","last_active":"2023-11-28T16:56:19.379166+0000","last_peered":"2023-11-28T16:56:19.379166+0000","last_clean":"2023-11-28T16:56:19.379166+0000","last_became_active":"2023-11-28T16:56:17.284128+0000","last_became_peered":"2023-11-28T16:56:17.284128+0000","last_unstale":"2023-11-28T16:56:19.379166+0000","last_undegraded":"2023-11-28T16:56:19.379166+0000","last_fullsized":"2023-11-28T16:56:19.379166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:57.892183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335328+0000","last_change":"2023-11-28T16:56:18.285248+0000","last_active":"2023-11-28T16:56:19.335328+0000","last_peered":"2023-11-28T16:56:19.335328+0000","last_clean":"2023-11-28T16:56:19.335328+0000","last_became_active":"2023-11-28T16:56:18.284940+0000","last_became_peered":"2023-11-28T16:56:18.284940+0000","last_unstale":"2023-11-28T16:56:19.335328+0000","last_undegraded":"2023-11-28T16:56:19.335328+0000","last_fullsized":"2023-11-28T16:56:19.335328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T16:56:18.271205+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:56:18.271205+0000","last_peered":"2023-11-28T16:56:18.271205+0000","last_clean":"2023-11-28T16:56:18.271205+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:56:18.271205+0000","last_undegraded":"2023-11-28T16:56:18.271205+0000","last_fullsized":"2023-11-28T16:56:18.271205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380719+0000","last_change":"2023-11-28T16:56:17.282961+0000","last_active":"2023-11-28T16:56:19.380719+0000","last_peered":"2023-11-28T16:56:19.380719+0000","last_clean":"2023-11-28T16:56:19.380719+0000","last_became_active":"2023-11-28T16:56:17.282701+0000","last_became_peered":"2023-11-28T16:56:17.282701+0000","last_unstale":"2023-11-28T16:56:19.380719+0000","last_undegraded":"2023-11-28T16:56:19.380719+0000","last_fullsized":"2023-11-28T16:56:19.380719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379683+0000","last_change":"2023-11-28T16:56:18.303548+0000","last_active":"2023-11-28T16:56:19.379683+0000","last_peered":"2023-11-28T16:56:19.379683+0000","last_clean":"2023-11-28T16:56:19.379683+0000","last_became_active":"2023-11-28T16:56:18.303179+0000","last_became_peered":"2023-11-28T16:56:18.303179+0000","last_unstale":"2023-11-28T16:56:19.379683+0000","last_undegraded":"2023-11-28T16:56:19.379683+0000","last_fullsized":"2023-11-28T16:56:19.379683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334952+0000","last_change":"2023-11-28T16:56:17.277497+0000","last_active":"2023-11-28T16:56:19.334952+0000","last_peered":"2023-11-28T16:56:19.334952+0000","last_clean":"2023-11-28T16:56:19.334952+0000","last_became_active":"2023-11-28T16:56:17.277234+0000","last_became_peered":"2023-11-28T16:56:17.277234+0000","last_unstale":"2023-11-28T16:56:19.334952+0000","last_undegraded":"2023-11-28T16:56:19.334952+0000","last_fullsized":"2023-11-28T16:56:19.334952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290216+0000","last_change":"2023-11-28T16:56:18.296396+0000","last_active":"2023-11-28T16:56:19.290216+0000","last_peered":"2023-11-28T16:56:19.290216+0000","last_clean":"2023-11-28T16:56:19.290216+0000","last_became_active":"2023-11-28T16:56:18.296084+0000","last_became_peered":"2023-11-28T16:56:18.296084+0000","last_unstale":"2023-11-28T16:56:19.290216+0000","last_undegraded":"2023-11-28T16:56:19.290216+0000","last_fullsized":"2023-11-28T16:56:19.290216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:59.283743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379147+0000","last_change":"2023-11-28T16:56:17.262892+0000","last_active":"2023-11-28T16:56:19.379147+0000","last_peered":"2023-11-28T16:56:19.379147+0000","last_clean":"2023-11-28T16:56:19.379147+0000","last_became_active":"2023-11-28T16:56:17.262566+0000","last_became_peered":"2023-11-28T16:56:17.262566+0000","last_unstale":"2023-11-28T16:56:19.379147+0000","last_undegraded":"2023-11-28T16:56:19.379147+0000","last_fullsized":"2023-11-28T16:56:19.379147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:47.727755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.288999+0000","last_change":"2023-11-28T16:56:18.286050+0000","last_active":"2023-11-28T16:56:19.288999+0000","last_peered":"2023-11-28T16:56:19.288999+0000","last_clean":"2023-11-28T16:56:19.288999+0000","last_became_active":"2023-11-28T16:56:18.284464+0000","last_became_peered":"2023-11-28T16:56:18.284464+0000","last_unstale":"2023-11-28T16:56:19.288999+0000","last_undegraded":"2023-11-28T16:56:19.288999+0000","last_fullsized":"2023-11-28T16:56:19.288999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381383+0000","last_change":"2023-11-28T16:56:17.281222+0000","last_active":"2023-11-28T16:56:19.381383+0000","last_peered":"2023-11-28T16:56:19.381383+0000","last_clean":"2023-11-28T16:56:19.381383+0000","last_became_active":"2023-11-28T16:56:17.280742+0000","last_became_peered":"2023-11-28T16:56:17.280742+0000","last_unstale":"2023-11-28T16:56:19.381383+0000","last_undegraded":"2023-11-28T16:56:19.381383+0000","last_fullsized":"2023-11-28T16:56:19.381383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292282+0000","last_change":"2023-11-28T16:56:18.296316+0000","last_active":"2023-11-28T16:56:19.292282+0000","last_peered":"2023-11-28T16:56:19.292282+0000","last_clean":"2023-11-28T16:56:19.292282+0000","last_became_active":"2023-11-28T16:56:18.296015+0000","last_became_peered":"2023-11-28T16:56:18.296015+0000","last_unstale":"2023-11-28T16:56:19.292282+0000","last_undegraded":"2023-11-28T16:56:19.292282+0000","last_fullsized":"2023-11-28T16:56:19.292282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:45.933550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289567+0000","last_change":"2023-11-28T16:56:17.266947+0000","last_active":"2023-11-28T16:56:19.289567+0000","last_peered":"2023-11-28T16:56:19.289567+0000","last_clean":"2023-11-28T16:56:19.289567+0000","last_became_active":"2023-11-28T16:56:17.266373+0000","last_became_peered":"2023-11-28T16:56:17.266373+0000","last_unstale":"2023-11-28T16:56:19.289567+0000","last_undegraded":"2023-11-28T16:56:19.289567+0000","last_fullsized":"2023-11-28T16:56:19.289567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381224+0000","last_change":"2023-11-28T16:56:18.293931+0000","last_active":"2023-11-28T16:56:19.381224+0000","last_peered":"2023-11-28T16:56:19.381224+0000","last_clean":"2023-11-28T16:56:19.381224+0000","last_became_active":"2023-11-28T16:56:18.293631+0000","last_became_peered":"2023-11-28T16:56:18.293631+0000","last_unstale":"2023-11-28T16:56:19.381224+0000","last_undegraded":"2023-11-28T16:56:19.381224+0000","last_fullsized":"2023-11-28T16:56:19.381224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335433+0000","last_change":"2023-11-28T16:56:17.275260+0000","last_active":"2023-11-28T16:56:19.335433+0000","last_peered":"2023-11-28T16:56:19.335433+0000","last_clean":"2023-11-28T16:56:19.335433+0000","last_became_active":"2023-11-28T16:56:17.273841+0000","last_became_peered":"2023-11-28T16:56:17.273841+0000","last_unstale":"2023-11-28T16:56:19.335433+0000","last_undegraded":"2023-11-28T16:56:19.335433+0000","last_fullsized":"2023-11-28T16:56:19.335433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:05.898052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289618+0000","last_change":"2023-11-28T16:56:18.287854+0000","last_active":"2023-11-28T16:56:19.289618+0000","last_peered":"2023-11-28T16:56:19.289618+0000","last_clean":"2023-11-28T16:56:19.289618+0000","last_became_active":"2023-11-28T16:56:18.287506+0000","last_became_peered":"2023-11-28T16:56:18.287506+0000","last_unstale":"2023-11-28T16:56:19.289618+0000","last_undegraded":"2023-11-28T16:56:19.289618+0000","last_fullsized":"2023-11-28T16:56:19.289618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.592237+0000","last_change":"2023-11-28T16:56:17.274658+0000","last_active":"2023-11-28T16:56:19.592237+0000","last_peered":"2023-11-28T16:56:19.592237+0000","last_clean":"2023-11-28T16:56:19.592237+0000","last_became_active":"2023-11-28T16:56:17.274438+0000","last_became_peered":"2023-11-28T16:56:17.274438+0000","last_unstale":"2023-11-28T16:56:19.592237+0000","last_undegraded":"2023-11-28T16:56:19.592237+0000","last_fullsized":"2023-11-28T16:56:19.592237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:00.220647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380057+0000","last_change":"2023-11-28T16:56:18.281874+0000","last_active":"2023-11-28T16:56:19.380057+0000","last_peered":"2023-11-28T16:56:19.380057+0000","last_clean":"2023-11-28T16:56:19.380057+0000","last_became_active":"2023-11-28T16:56:18.281487+0000","last_became_peered":"2023-11-28T16:56:18.281487+0000","last_unstale":"2023-11-28T16:56:19.380057+0000","last_undegraded":"2023-11-28T16:56:19.380057+0000","last_fullsized":"2023-11-28T16:56:19.380057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380726+0000","last_change":"2023-11-28T16:56:17.283262+0000","last_active":"2023-11-28T16:56:19.380726+0000","last_peered":"2023-11-28T16:56:19.380726+0000","last_clean":"2023-11-28T16:56:19.380726+0000","last_became_active":"2023-11-28T16:56:17.282998+0000","last_became_peered":"2023-11-28T16:56:17.282998+0000","last_unstale":"2023-11-28T16:56:19.380726+0000","last_undegraded":"2023-11-28T16:56:19.380726+0000","last_fullsized":"2023-11-28T16:56:19.380726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290549+0000","last_change":"2023-11-28T16:56:18.287449+0000","last_active":"2023-11-28T16:56:19.290549+0000","last_peered":"2023-11-28T16:56:19.290549+0000","last_clean":"2023-11-28T16:56:19.290549+0000","last_became_active":"2023-11-28T16:56:18.287148+0000","last_became_peered":"2023-11-28T16:56:18.287148+0000","last_unstale":"2023-11-28T16:56:19.290549+0000","last_undegraded":"2023-11-28T16:56:19.290549+0000","last_fullsized":"2023-11-28T16:56:19.290549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334912+0000","last_change":"2023-11-28T16:56:17.273292+0000","last_active":"2023-11-28T16:56:19.334912+0000","last_peered":"2023-11-28T16:56:19.334912+0000","last_clean":"2023-11-28T16:56:19.334912+0000","last_became_active":"2023-11-28T16:56:17.272927+0000","last_became_peered":"2023-11-28T16:56:17.272927+0000","last_unstale":"2023-11-28T16:56:19.334912+0000","last_undegraded":"2023-11-28T16:56:19.334912+0000","last_fullsized":"2023-11-28T16:56:19.334912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292330+0000","last_change":"2023-11-28T16:56:18.293307+0000","last_active":"2023-11-28T16:56:19.292330+0000","last_peered":"2023-11-28T16:56:19.292330+0000","last_clean":"2023-11-28T16:56:19.292330+0000","last_became_active":"2023-11-28T16:56:18.290847+0000","last_became_peered":"2023-11-28T16:56:18.290847+0000","last_unstale":"2023-11-28T16:56:19.292330+0000","last_undegraded":"2023-11-28T16:56:19.292330+0000","last_fullsized":"2023-11-28T16:56:19.292330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:48.733777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289324+0000","last_change":"2023-11-28T16:56:17.274311+0000","last_active":"2023-11-28T16:56:19.289324+0000","last_peered":"2023-11-28T16:56:19.289324+0000","last_clean":"2023-11-28T16:56:19.289324+0000","last_became_active":"2023-11-28T16:56:17.273978+0000","last_became_peered":"2023-11-28T16:56:17.273978+0000","last_unstale":"2023-11-28T16:56:19.289324+0000","last_undegraded":"2023-11-28T16:56:19.289324+0000","last_fullsized":"2023-11-28T16:56:19.289324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379411+0000","last_change":"2023-11-28T16:56:18.291693+0000","last_active":"2023-11-28T16:56:19.379411+0000","last_peered":"2023-11-28T16:56:19.379411+0000","last_clean":"2023-11-28T16:56:19.379411+0000","last_became_active":"2023-11-28T16:56:18.287795+0000","last_became_peered":"2023-11-28T16:56:18.287795+0000","last_unstale":"2023-11-28T16:56:19.379411+0000","last_undegraded":"2023-11-28T16:56:19.379411+0000","last_fullsized":"2023-11-28T16:56:19.379411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289531+0000","last_change":"2023-11-28T16:56:17.273717+0000","last_active":"2023-11-28T16:56:19.289531+0000","last_peered":"2023-11-28T16:56:19.289531+0000","last_clean":"2023-11-28T16:56:19.289531+0000","last_became_active":"2023-11-28T16:56:17.271544+0000","last_became_peered":"2023-11-28T16:56:17.271544+0000","last_unstale":"2023-11-28T16:56:19.289531+0000","last_undegraded":"2023-11-28T16:56:19.289531+0000","last_fullsized":"2023-11-28T16:56:19.289531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379795+0000","last_change":"2023-11-28T16:56:18.299018+0000","last_active":"2023-11-28T16:56:19.379795+0000","last_peered":"2023-11-28T16:56:19.379795+0000","last_clean":"2023-11-28T16:56:19.379795+0000","last_became_active":"2023-11-28T16:56:18.297543+0000","last_became_peered":"2023-11-28T16:56:18.297543+0000","last_unstale":"2023-11-28T16:56:19.379795+0000","last_undegraded":"2023-11-28T16:56:19.379795+0000","last_fullsized":"2023-11-28T16:56:19.379795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335355+0000","last_change":"2023-11-28T16:56:17.277794+0000","last_active":"2023-11-28T16:56:19.335355+0000","last_peered":"2023-11-28T16:56:19.335355+0000","last_clean":"2023-11-28T16:56:19.335355+0000","last_became_active":"2023-11-28T16:56:17.277482+0000","last_became_peered":"2023-11-28T16:56:17.277482+0000","last_unstale":"2023-11-28T16:56:19.335355+0000","last_undegraded":"2023-11-28T16:56:19.335355+0000","last_fullsized":"2023-11-28T16:56:19.335355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380283+0000","last_change":"2023-11-28T16:56:18.304716+0000","last_active":"2023-11-28T16:56:19.380283+0000","last_peered":"2023-11-28T16:56:19.380283+0000","last_clean":"2023-11-28T16:56:19.380283+0000","last_became_active":"2023-11-28T16:56:18.304418+0000","last_became_peered":"2023-11-28T16:56:18.304418+0000","last_unstale":"2023-11-28T16:56:19.380283+0000","last_undegraded":"2023-11-28T16:56:19.380283+0000","last_fullsized":"2023-11-28T16:56:19.380283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381366+0000","last_change":"2023-11-28T16:56:18.311948+0000","last_active":"2023-11-28T16:56:19.381366+0000","last_peered":"2023-11-28T16:56:19.381366+0000","last_clean":"2023-11-28T16:56:19.381366+0000","last_became_active":"2023-11-28T16:56:18.311642+0000","last_became_peered":"2023-11-28T16:56:18.311642+0000","last_unstale":"2023-11-28T16:56:19.381366+0000","last_undegraded":"2023-11-28T16:56:19.381366+0000","last_fullsized":"2023-11-28T16:56:19.381366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335228+0000","last_change":"2023-11-28T16:56:17.286515+0000","last_active":"2023-11-28T16:56:19.335228+0000","last_peered":"2023-11-28T16:56:19.335228+0000","last_clean":"2023-11-28T16:56:19.335228+0000","last_became_active":"2023-11-28T16:56:17.286203+0000","last_became_peered":"2023-11-28T16:56:17.286203+0000","last_unstale":"2023-11-28T16:56:19.335228+0000","last_undegraded":"2023-11-28T16:56:19.335228+0000","last_fullsized":"2023-11-28T16:56:19.335228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381073+0000","last_change":"2023-11-28T16:56:18.311709+0000","last_active":"2023-11-28T16:56:19.381073+0000","last_peered":"2023-11-28T16:56:19.381073+0000","last_clean":"2023-11-28T16:56:19.381073+0000","last_became_active":"2023-11-28T16:56:18.307023+0000","last_became_peered":"2023-11-28T16:56:18.307023+0000","last_unstale":"2023-11-28T16:56:19.381073+0000","last_undegraded":"2023-11-28T16:56:19.381073+0000","last_fullsized":"2023-11-28T16:56:19.381073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335370+0000","last_change":"2023-11-28T16:56:17.275000+0000","last_active":"2023-11-28T16:56:19.335370+0000","last_peered":"2023-11-28T16:56:19.335370+0000","last_clean":"2023-11-28T16:56:19.335370+0000","last_became_active":"2023-11-28T16:56:17.273306+0000","last_became_peered":"2023-11-28T16:56:17.273306+0000","last_unstale":"2023-11-28T16:56:19.335370+0000","last_undegraded":"2023-11-28T16:56:19.335370+0000","last_fullsized":"2023-11-28T16:56:19.335370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:23.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290507+0000","last_change":"2023-11-28T16:56:18.293608+0000","last_active":"2023-11-28T16:56:19.290507+0000","last_peered":"2023-11-28T16:56:19.290507+0000","last_clean":"2023-11-28T16:56:19.290507+0000","last_became_active":"2023-11-28T16:56:18.293219+0000","last_became_peered":"2023-11-28T16:56:18.293219+0000","last_unstale":"2023-11-28T16:56:19.290507+0000","last_undegraded":"2023-11-28T16:56:19.290507+0000","last_fullsized":"2023-11-28T16:56:19.290507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379965+0000","last_change":"2023-11-28T16:56:17.269059+0000","last_active":"2023-11-28T16:56:19.379965+0000","last_peered":"2023-11-28T16:56:19.379965+0000","last_clean":"2023-11-28T16:56:19.379965+0000","last_became_active":"2023-11-28T16:56:17.268756+0000","last_became_peered":"2023-11-28T16:56:17.268756+0000","last_unstale":"2023-11-28T16:56:19.379965+0000","last_undegraded":"2023-11-28T16:56:19.379965+0000","last_fullsized":"2023-11-28T16:56:19.379965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379889+0000","last_change":"2023-11-28T16:56:18.297186+0000","last_active":"2023-11-28T16:56:19.379889+0000","last_peered":"2023-11-28T16:56:19.379889+0000","last_clean":"2023-11-28T16:56:19.379889+0000","last_became_active":"2023-11-28T16:56:18.295432+0000","last_became_peered":"2023-11-28T16:56:18.295432+0000","last_unstale":"2023-11-28T16:56:19.379889+0000","last_undegraded":"2023-11-28T16:56:19.379889+0000","last_fullsized":"2023-11-28T16:56:19.379889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290693+0000","last_change":"2023-11-28T16:56:17.279529+0000","last_active":"2023-11-28T16:56:19.290693+0000","last_peered":"2023-11-28T16:56:19.290693+0000","last_clean":"2023-11-28T16:56:19.290693+0000","last_became_active":"2023-11-28T16:56:17.279217+0000","last_became_peered":"2023-11-28T16:56:17.279217+0000","last_unstale":"2023-11-28T16:56:19.290693+0000","last_undegraded":"2023-11-28T16:56:19.290693+0000","last_fullsized":"2023-11-28T16:56:19.290693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:56:27.152 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:56:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 Processor -- start 2023-11-28T16:56:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 -- start start 2023-11-28T16:56:27.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5dc0ca610 0x7ff5dc0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5dc0bd720 0x7ff5dc0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc06cd90 0x7ff5dc158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc155790 con 0x7ff5dc0ca610 2023-11-28T16:56:27.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c4b00 con 0x7ff5dc0bd720 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e3fb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c4de0 con 0x7ff5dc06cd90 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5dc0ca610 0x7ff5dc0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5dc0ca610 0x7ff5dc0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53514/0 (socket says 172.21.15.26:53514) 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 -- 172.21.15.26:0/3881203902 learned_addr learned my addr 172.21.15.26:0/3881203902 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e2555640 1 --2- 172.21.15.26:0/3881203902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc06cd90 0x7ff5dc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1553640 1 --2- 172.21.15.26:0/3881203902 >> v2:172.21.15.79:3300/0 conn(0x7ff5dc0bd720 0x7ff5dc0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 -- 172.21.15.26:0/3881203902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc06cd90 msgr2=0x7ff5dc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 --2- 172.21.15.26:0/3881203902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc06cd90 0x7ff5dc158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 -- 172.21.15.26:0/3881203902 >> v2:172.21.15.79:3300/0 conn(0x7ff5dc0bd720 msgr2=0x7ff5dc0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 --2- 172.21.15.26:0/3881203902 >> v2:172.21.15.79:3300/0 conn(0x7ff5dc0bd720 0x7ff5dc0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1d54640 1 -- 172.21.15.26:0/3881203902 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc157e30 con 0x7ff5dc0ca610 2023-11-28T16:56:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.331+0000 7ff5e1553640 1 --2- 172.21.15.26:0/3881203902 >> v2:172.21.15.79:3300/0 conn(0x7ff5dc0bd720 0x7ff5dc0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e1d54640 1 --2- 172.21.15.26:0/3881203902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc0c94c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0ca380 tx=0x7ff5d801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141c668fd8b1abe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e0d52640 1 -- 172.21.15.26:0/3881203902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0c52d0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e0d52640 1 -- 172.21.15.26:0/3881203902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d80a4880 con 0x7ff5dc0ca610 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e0d52640 1 -- 172.21.15.26:0/3881203902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80a4c10 con 0x7ff5dc0ca610 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3881203902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 msgr2=0x7ff5dc0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3881203902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc0c94c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0ca380 tx=0x7ff5d801c0c0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3881203902 shutdown_connections 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3881203902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc06cd90 0x7ff5dc158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3881203902 >> v2:172.21.15.79:3300/0 conn(0x7ff5dc0bd720 0x7ff5dc0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3881203902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc0c94c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3881203902 >> 172.21.15.26:0/3881203902 conn(0x7ff5dc071ea0 msgr2=0x7ff5dc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3881203902 shutdown_connections 2023-11-28T16:56:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.335+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3881203902 wait complete. 2023-11-28T16:56:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 Processor -- start 2023-11-28T16:56:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 -- start start 2023-11-28T16:56:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5dc06cd90 0x7ff5dc14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc0bd720 0x7ff5dc14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc1f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c14e0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc151380 con 0x7ff5dc06cd90 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc14daf0 con 0x7ff5dc0bd720 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc1f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc1f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53528/0 (socket says 172.21.15.26:53528) 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 -- 172.21.15.26:0/3979091529 learned_addr learned my addr 172.21.15.26:0/3979091529 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e1d54640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5dc06cd90 0x7ff5dc14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e1553640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc0bd720 0x7ff5dc14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 -- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc0bd720 msgr2=0x7ff5dc14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc0bd720 0x7ff5dc14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 -- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5dc06cd90 msgr2=0x7ff5dc14d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5dc06cd90 0x7ff5dc14d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 -- 172.21.15.26:0/3979091529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80094d0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e1553640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc0bd720 0x7ff5dc14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e2555640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc1f1700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400eed0 tx=0x7ff5d400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3979091529 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4010040 con 0x7ff5dc0ca610 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3979091529 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4014400 con 0x7ff5dc0ca610 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3979091529 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4009ea0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc151620 con 0x7ff5dc0ca610 2023-11-28T16:56:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.339+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc0c16f0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.343+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc0c18e0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.343+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3979091529 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff5d40147b0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.343+0000 7ff5d27fc640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5c0066900 0x7ff5c0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.343+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3979091529 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5d40849f0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.343+0000 7ff5e1d54640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5c0066900 0x7ff5c0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.343+0000 7ff5e1d54640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5c0066900 0x7ff5c0068dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80ae000 tx=0x7ff5d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:27.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.347+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3979091529 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5d4051cc0 con 0x7ff5dc0ca610 2023-11-28T16:56:27.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.503+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5dc0c5920 con 0x7ff5c0066900 2023-11-28T16:56:27.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.511+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3979091529 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264561 (secure 0 0 0) 0x7ff5dc0c5920 con 0x7ff5c0066900 2023-11-28T16:56:27.519 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:27.521 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:56:27.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.511+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5c0066900 msgr2=0x7ff5c0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.511+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5c0066900 0x7ff5c0068dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80ae000 tx=0x7ff5d8008040 comp rx=0 tx=0).stop 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.511+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 msgr2=0x7ff5dc1f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.511+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc1f1700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400eed0 tx=0x7ff5d400b480 comp rx=0 tx=0).stop 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 shutdown_connections 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0ca610 0x7ff5dc1f1700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5c0066900 0x7ff5c0068dc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5dc0bd720 0x7ff5dc14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 --2- 172.21.15.26:0/3979091529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5dc06cd90 0x7ff5dc14d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 >> 172.21.15.26:0/3979091529 conn(0x7ff5dc071ea0 msgr2=0x7ff5dc0c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 shutdown_connections 2023-11-28T16:56:27.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.515+0000 7ff5e3fb8640 1 -- 172.21.15.26:0/3979091529 wait complete. 2023-11-28T16:56:27.538 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T16:56:25.574584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231508,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743212,"statfs":{"total":773094113280,"available":772857049088,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001949"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335727+0000","last_change":"2023-11-28T16:56:18.296651+0000","last_active":"2023-11-28T16:56:19.335727+0000","last_peered":"2023-11-28T16:56:19.335727+0000","last_clean":"2023-11-28T16:56:19.335727+0000","last_became_active":"2023-11-28T16:56:18.296364+0000","last_became_peered":"2023-11-28T16:56:18.296364+0000","last_unstale":"2023-11-28T16:56:19.335727+0000","last_undegraded":"2023-11-28T16:56:19.335727+0000","last_fullsized":"2023-11-28T16:56:19.335727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:01.071568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289822+0000","last_change":"2023-11-28T16:56:18.292206+0000","last_active":"2023-11-28T16:56:19.289822+0000","last_peered":"2023-11-28T16:56:19.289822+0000","last_clean":"2023-11-28T16:56:19.289822+0000","last_became_active":"2023-11-28T16:56:18.291849+0000","last_became_peered":"2023-11-28T16:56:18.291849+0000","last_unstale":"2023-11-28T16:56:19.289822+0000","last_undegraded":"2023-11-28T16:56:19.289822+0000","last_fullsized":"2023-11-28T16:56:19.289822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290500+0000","last_change":"2023-11-28T16:56:18.288339+0000","last_active":"2023-11-28T16:56:19.290500+0000","last_peered":"2023-11-28T16:56:19.290500+0000","last_clean":"2023-11-28T16:56:19.290500+0000","last_became_active":"2023-11-28T16:56:18.287985+0000","last_became_peered":"2023-11-28T16:56:18.287985+0000","last_unstale":"2023-11-28T16:56:19.290500+0000","last_undegraded":"2023-11-28T16:56:19.290500+0000","last_fullsized":"2023-11-28T16:56:19.290500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380850+0000","last_change":"2023-11-28T16:56:18.305269+0000","last_active":"2023-11-28T16:56:19.380850+0000","last_peered":"2023-11-28T16:56:19.380850+0000","last_clean":"2023-11-28T16:56:19.380850+0000","last_became_active":"2023-11-28T16:56:18.304177+0000","last_became_peered":"2023-11-28T16:56:18.304177+0000","last_unstale":"2023-11-28T16:56:19.380850+0000","last_undegraded":"2023-11-28T16:56:19.380850+0000","last_fullsized":"2023-11-28T16:56:19.380850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335226+0000","last_change":"2023-11-28T16:56:18.286848+0000","last_active":"2023-11-28T16:56:19.335226+0000","last_peered":"2023-11-28T16:56:19.335226+0000","last_clean":"2023-11-28T16:56:19.335226+0000","last_became_active":"2023-11-28T16:56:18.286539+0000","last_became_peered":"2023-11-28T16:56:18.286539+0000","last_unstale":"2023-11-28T16:56:19.335226+0000","last_undegraded":"2023-11-28T16:56:19.335226+0000","last_fullsized":"2023-11-28T16:56:19.335226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381105+0000","last_change":"2023-11-28T16:56:18.293363+0000","last_active":"2023-11-28T16:56:19.381105+0000","last_peered":"2023-11-28T16:56:19.381105+0000","last_clean":"2023-11-28T16:56:19.381105+0000","last_became_active":"2023-11-28T16:56:18.293105+0000","last_became_peered":"2023-11-28T16:56:18.293105+0000","last_unstale":"2023-11-28T16:56:19.381105+0000","last_undegraded":"2023-11-28T16:56:19.381105+0000","last_fullsized":"2023-11-28T16:56:19.381105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335025+0000","last_change":"2023-11-28T16:56:18.294379+0000","last_active":"2023-11-28T16:56:19.335025+0000","last_peered":"2023-11-28T16:56:19.335025+0000","last_clean":"2023-11-28T16:56:19.335025+0000","last_became_active":"2023-11-28T16:56:18.288865+0000","last_became_peered":"2023-11-28T16:56:18.288865+0000","last_unstale":"2023-11-28T16:56:19.335025+0000","last_undegraded":"2023-11-28T16:56:19.335025+0000","last_fullsized":"2023-11-28T16:56:19.335025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379632+0000","last_change":"2023-11-28T16:56:18.292313+0000","last_active":"2023-11-28T16:56:19.379632+0000","last_peered":"2023-11-28T16:56:19.379632+0000","last_clean":"2023-11-28T16:56:19.379632+0000","last_became_active":"2023-11-28T16:56:18.292008+0000","last_became_peered":"2023-11-28T16:56:18.292008+0000","last_unstale":"2023-11-28T16:56:19.379632+0000","last_undegraded":"2023-11-28T16:56:19.379632+0000","last_fullsized":"2023-11-28T16:56:19.379632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335730+0000","last_change":"2023-11-28T16:56:18.287530+0000","last_active":"2023-11-28T16:56:19.335730+0000","last_peered":"2023-11-28T16:56:19.335730+0000","last_clean":"2023-11-28T16:56:19.335730+0000","last_became_active":"2023-11-28T16:56:18.287193+0000","last_became_peered":"2023-11-28T16:56:18.287193+0000","last_unstale":"2023-11-28T16:56:19.335730+0000","last_undegraded":"2023-11-28T16:56:19.335730+0000","last_fullsized":"2023-11-28T16:56:19.335730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:48.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380554+0000","last_change":"2023-11-28T16:56:18.301134+0000","last_active":"2023-11-28T16:56:19.380554+0000","last_peered":"2023-11-28T16:56:19.380554+0000","last_clean":"2023-11-28T16:56:19.380554+0000","last_became_active":"2023-11-28T16:56:18.300869+0000","last_became_peered":"2023-11-28T16:56:18.300869+0000","last_unstale":"2023-11-28T16:56:19.380554+0000","last_undegraded":"2023-11-28T16:56:19.380554+0000","last_fullsized":"2023-11-28T16:56:19.380554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380564+0000","last_change":"2023-11-28T16:56:18.297402+0000","last_active":"2023-11-28T16:56:19.380564+0000","last_peered":"2023-11-28T16:56:19.380564+0000","last_clean":"2023-11-28T16:56:19.380564+0000","last_became_active":"2023-11-28T16:56:18.297065+0000","last_became_peered":"2023-11-28T16:56:18.297065+0000","last_unstale":"2023-11-28T16:56:19.380564+0000","last_undegraded":"2023-11-28T16:56:19.380564+0000","last_fullsized":"2023-11-28T16:56:19.380564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292538+0000","last_change":"2023-11-28T16:56:18.295149+0000","last_active":"2023-11-28T16:56:19.292538+0000","last_peered":"2023-11-28T16:56:19.292538+0000","last_clean":"2023-11-28T16:56:19.292538+0000","last_became_active":"2023-11-28T16:56:18.294748+0000","last_became_peered":"2023-11-28T16:56:18.294748+0000","last_unstale":"2023-11-28T16:56:19.292538+0000","last_undegraded":"2023-11-28T16:56:19.292538+0000","last_fullsized":"2023-11-28T16:56:19.292538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379738+0000","last_change":"2023-11-28T16:56:18.299824+0000","last_active":"2023-11-28T16:56:19.379738+0000","last_peered":"2023-11-28T16:56:19.379738+0000","last_clean":"2023-11-28T16:56:19.379738+0000","last_became_active":"2023-11-28T16:56:18.299530+0000","last_became_peered":"2023-11-28T16:56:18.299530+0000","last_unstale":"2023-11-28T16:56:19.379738+0000","last_undegraded":"2023-11-28T16:56:19.379738+0000","last_fullsized":"2023-11-28T16:56:19.379738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290067+0000","last_change":"2023-11-28T16:56:18.294327+0000","last_active":"2023-11-28T16:56:19.290067+0000","last_peered":"2023-11-28T16:56:19.290067+0000","last_clean":"2023-11-28T16:56:19.290067+0000","last_became_active":"2023-11-28T16:56:18.291271+0000","last_became_peered":"2023-11-28T16:56:18.291271+0000","last_unstale":"2023-11-28T16:56:19.290067+0000","last_undegraded":"2023-11-28T16:56:19.290067+0000","last_fullsized":"2023-11-28T16:56:19.290067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:57.105359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289240+0000","last_change":"2023-11-28T16:56:18.317151+0000","last_active":"2023-11-28T16:56:19.289240+0000","last_peered":"2023-11-28T16:56:19.289240+0000","last_clean":"2023-11-28T16:56:19.289240+0000","last_became_active":"2023-11-28T16:56:18.314732+0000","last_became_peered":"2023-11-28T16:56:18.314732+0000","last_unstale":"2023-11-28T16:56:19.289240+0000","last_undegraded":"2023-11-28T16:56:19.289240+0000","last_fullsized":"2023-11-28T16:56:19.289240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380376+0000","last_change":"2023-11-28T16:56:18.292779+0000","last_active":"2023-11-28T16:56:19.380376+0000","last_peered":"2023-11-28T16:56:19.380376+0000","last_clean":"2023-11-28T16:56:19.380376+0000","last_became_active":"2023-11-28T16:56:18.292415+0000","last_became_peered":"2023-11-28T16:56:18.292415+0000","last_unstale":"2023-11-28T16:56:19.380376+0000","last_undegraded":"2023-11-28T16:56:19.380376+0000","last_fullsized":"2023-11-28T16:56:19.380376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381358+0000","last_change":"2023-11-28T16:56:18.301370+0000","last_active":"2023-11-28T16:56:19.381358+0000","last_peered":"2023-11-28T16:56:19.381358+0000","last_clean":"2023-11-28T16:56:19.381358+0000","last_became_active":"2023-11-28T16:56:18.301075+0000","last_became_peered":"2023-11-28T16:56:18.301075+0000","last_unstale":"2023-11-28T16:56:19.381358+0000","last_undegraded":"2023-11-28T16:56:19.381358+0000","last_fullsized":"2023-11-28T16:56:19.381358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379398+0000","last_change":"2023-11-28T16:56:18.295704+0000","last_active":"2023-11-28T16:56:19.379398+0000","last_peered":"2023-11-28T16:56:19.379398+0000","last_clean":"2023-11-28T16:56:19.379398+0000","last_became_active":"2023-11-28T16:56:18.294762+0000","last_became_peered":"2023-11-28T16:56:18.294762+0000","last_unstale":"2023-11-28T16:56:19.379398+0000","last_undegraded":"2023-11-28T16:56:19.379398+0000","last_fullsized":"2023-11-28T16:56:19.379398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:01.618378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335491+0000","last_change":"2023-11-28T16:56:18.290479+0000","last_active":"2023-11-28T16:56:19.335491+0000","last_peered":"2023-11-28T16:56:19.335491+0000","last_clean":"2023-11-28T16:56:19.335491+0000","last_became_active":"2023-11-28T16:56:18.289982+0000","last_became_peered":"2023-11-28T16:56:18.289982+0000","last_unstale":"2023-11-28T16:56:19.335491+0000","last_undegraded":"2023-11-28T16:56:19.335491+0000","last_fullsized":"2023-11-28T16:56:19.335491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:11.202868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380969+0000","last_change":"2023-11-28T16:56:18.305161+0000","last_active":"2023-11-28T16:56:19.380969+0000","last_peered":"2023-11-28T16:56:19.380969+0000","last_clean":"2023-11-28T16:56:19.380969+0000","last_became_active":"2023-11-28T16:56:18.304931+0000","last_became_peered":"2023-11-28T16:56:18.304931+0000","last_unstale":"2023-11-28T16:56:19.380969+0000","last_undegraded":"2023-11-28T16:56:19.380969+0000","last_fullsized":"2023-11-28T16:56:19.380969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290248+0000","last_change":"2023-11-28T16:56:18.295103+0000","last_active":"2023-11-28T16:56:19.290248+0000","last_peered":"2023-11-28T16:56:19.290248+0000","last_clean":"2023-11-28T16:56:19.290248+0000","last_became_active":"2023-11-28T16:56:18.294121+0000","last_became_peered":"2023-11-28T16:56:18.294121+0000","last_unstale":"2023-11-28T16:56:19.290248+0000","last_undegraded":"2023-11-28T16:56:19.290248+0000","last_fullsized":"2023-11-28T16:56:19.290248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:01.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380774+0000","last_change":"2023-11-28T16:56:18.300601+0000","last_active":"2023-11-28T16:56:19.380774+0000","last_peered":"2023-11-28T16:56:19.380774+0000","last_clean":"2023-11-28T16:56:19.380774+0000","last_became_active":"2023-11-28T16:56:18.300316+0000","last_became_peered":"2023-11-28T16:56:18.300316+0000","last_unstale":"2023-11-28T16:56:19.380774+0000","last_undegraded":"2023-11-28T16:56:19.380774+0000","last_fullsized":"2023-11-28T16:56:19.380774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379383+0000","last_change":"2023-11-28T16:56:18.298840+0000","last_active":"2023-11-28T16:56:19.379383+0000","last_peered":"2023-11-28T16:56:19.379383+0000","last_clean":"2023-11-28T16:56:19.379383+0000","last_became_active":"2023-11-28T16:56:18.297520+0000","last_became_peered":"2023-11-28T16:56:18.297520+0000","last_unstale":"2023-11-28T16:56:19.379383+0000","last_undegraded":"2023-11-28T16:56:19.379383+0000","last_fullsized":"2023-11-28T16:56:19.379383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380406+0000","last_change":"2023-11-28T16:56:18.298922+0000","last_active":"2023-11-28T16:56:19.380406+0000","last_peered":"2023-11-28T16:56:19.380406+0000","last_clean":"2023-11-28T16:56:19.380406+0000","last_became_active":"2023-11-28T16:56:18.298405+0000","last_became_peered":"2023-11-28T16:56:18.298405+0000","last_unstale":"2023-11-28T16:56:19.380406+0000","last_undegraded":"2023-11-28T16:56:19.380406+0000","last_fullsized":"2023-11-28T16:56:19.380406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380028+0000","last_change":"2023-11-28T16:56:18.299370+0000","last_active":"2023-11-28T16:56:19.380028+0000","last_peered":"2023-11-28T16:56:19.380028+0000","last_clean":"2023-11-28T16:56:19.380028+0000","last_became_active":"2023-11-28T16:56:18.298398+0000","last_became_peered":"2023-11-28T16:56:18.298398+0000","last_unstale":"2023-11-28T16:56:19.380028+0000","last_undegraded":"2023-11-28T16:56:19.380028+0000","last_fullsized":"2023-11-28T16:56:19.380028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:03.217172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380776+0000","last_change":"2023-11-28T16:56:18.308925+0000","last_active":"2023-11-28T16:56:19.380776+0000","last_peered":"2023-11-28T16:56:19.380776+0000","last_clean":"2023-11-28T16:56:19.380776+0000","last_became_active":"2023-11-28T16:56:18.303301+0000","last_became_peered":"2023-11-28T16:56:18.303301+0000","last_unstale":"2023-11-28T16:56:19.380776+0000","last_undegraded":"2023-11-28T16:56:19.380776+0000","last_fullsized":"2023-11-28T16:56:19.380776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289808+0000","last_change":"2023-11-28T16:56:18.290403+0000","last_active":"2023-11-28T16:56:19.289808+0000","last_peered":"2023-11-28T16:56:19.289808+0000","last_clean":"2023-11-28T16:56:19.289808+0000","last_became_active":"2023-11-28T16:56:18.290049+0000","last_became_peered":"2023-11-28T16:56:18.290049+0000","last_unstale":"2023-11-28T16:56:19.289808+0000","last_undegraded":"2023-11-28T16:56:19.289808+0000","last_fullsized":"2023-11-28T16:56:19.289808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379926+0000","last_change":"2023-11-28T16:56:18.296771+0000","last_active":"2023-11-28T16:56:19.379926+0000","last_peered":"2023-11-28T16:56:19.379926+0000","last_clean":"2023-11-28T16:56:19.379926+0000","last_became_active":"2023-11-28T16:56:18.296481+0000","last_became_peered":"2023-11-28T16:56:18.296481+0000","last_unstale":"2023-11-28T16:56:19.379926+0000","last_undegraded":"2023-11-28T16:56:19.379926+0000","last_fullsized":"2023-11-28T16:56:19.379926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290303+0000","last_change":"2023-11-28T16:56:18.295300+0000","last_active":"2023-11-28T16:56:19.290303+0000","last_peered":"2023-11-28T16:56:19.290303+0000","last_clean":"2023-11-28T16:56:19.290303+0000","last_became_active":"2023-11-28T16:56:18.295029+0000","last_became_peered":"2023-11-28T16:56:18.295029+0000","last_unstale":"2023-11-28T16:56:19.290303+0000","last_undegraded":"2023-11-28T16:56:19.290303+0000","last_fullsized":"2023-11-28T16:56:19.290303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381291+0000","last_change":"2023-11-28T16:56:18.300254+0000","last_active":"2023-11-28T16:56:19.381291+0000","last_peered":"2023-11-28T16:56:19.381291+0000","last_clean":"2023-11-28T16:56:19.381291+0000","last_became_active":"2023-11-28T16:56:18.299932+0000","last_became_peered":"2023-11-28T16:56:18.299932+0000","last_unstale":"2023-11-28T16:56:19.381291+0000","last_undegraded":"2023-11-28T16:56:19.381291+0000","last_fullsized":"2023-11-28T16:56:19.381291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:33.069881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379533+0000","last_change":"2023-11-28T16:56:18.286733+0000","last_active":"2023-11-28T16:56:19.379533+0000","last_peered":"2023-11-28T16:56:19.379533+0000","last_clean":"2023-11-28T16:56:19.379533+0000","last_became_active":"2023-11-28T16:56:18.286290+0000","last_became_peered":"2023-11-28T16:56:18.286290+0000","last_unstale":"2023-11-28T16:56:19.379533+0000","last_undegraded":"2023-11-28T16:56:19.379533+0000","last_fullsized":"2023-11-28T16:56:19.379533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380201+0000","last_change":"2023-11-28T16:56:18.303664+0000","last_active":"2023-11-28T16:56:19.380201+0000","last_peered":"2023-11-28T16:56:19.380201+0000","last_clean":"2023-11-28T16:56:19.380201+0000","last_became_active":"2023-11-28T16:56:18.303227+0000","last_became_peered":"2023-11-28T16:56:18.303227+0000","last_unstale":"2023-11-28T16:56:19.380201+0000","last_undegraded":"2023-11-28T16:56:19.380201+0000","last_fullsized":"2023-11-28T16:56:19.380201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292149+0000","last_change":"2023-11-28T16:56:18.296578+0000","last_active":"2023-11-28T16:56:19.292149+0000","last_peered":"2023-11-28T16:56:19.292149+0000","last_clean":"2023-11-28T16:56:19.292149+0000","last_became_active":"2023-11-28T16:56:18.296120+0000","last_became_peered":"2023-11-28T16:56:18.296120+0000","last_unstale":"2023-11-28T16:56:19.292149+0000","last_undegraded":"2023-11-28T16:56:19.292149+0000","last_fullsized":"2023-11-28T16:56:19.292149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:58.898204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379894+0000","last_change":"2023-11-28T16:56:17.277061+0000","last_active":"2023-11-28T16:56:19.379894+0000","last_peered":"2023-11-28T16:56:19.379894+0000","last_clean":"2023-11-28T16:56:19.379894+0000","last_became_active":"2023-11-28T16:56:17.276729+0000","last_became_peered":"2023-11-28T16:56:17.276729+0000","last_unstale":"2023-11-28T16:56:19.379894+0000","last_undegraded":"2023-11-28T16:56:19.379894+0000","last_fullsized":"2023-11-28T16:56:19.379894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290375+0000","last_change":"2023-11-28T16:56:18.296888+0000","last_active":"2023-11-28T16:56:19.290375+0000","last_peered":"2023-11-28T16:56:19.290375+0000","last_clean":"2023-11-28T16:56:19.290375+0000","last_became_active":"2023-11-28T16:56:18.296583+0000","last_became_peered":"2023-11-28T16:56:18.296583+0000","last_unstale":"2023-11-28T16:56:19.290375+0000","last_undegraded":"2023-11-28T16:56:19.290375+0000","last_fullsized":"2023-11-28T16:56:19.290375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380694+0000","last_change":"2023-11-28T16:56:17.274703+0000","last_active":"2023-11-28T16:56:19.380694+0000","last_peered":"2023-11-28T16:56:19.380694+0000","last_clean":"2023-11-28T16:56:19.380694+0000","last_became_active":"2023-11-28T16:56:17.273982+0000","last_became_peered":"2023-11-28T16:56:17.273982+0000","last_unstale":"2023-11-28T16:56:19.380694+0000","last_undegraded":"2023-11-28T16:56:19.380694+0000","last_fullsized":"2023-11-28T16:56:19.380694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379497+0000","last_change":"2023-11-28T16:56:17.270991+0000","last_active":"2023-11-28T16:56:19.379497+0000","last_peered":"2023-11-28T16:56:19.379497+0000","last_clean":"2023-11-28T16:56:19.379497+0000","last_became_active":"2023-11-28T16:56:17.270655+0000","last_became_peered":"2023-11-28T16:56:17.270655+0000","last_unstale":"2023-11-28T16:56:19.379497+0000","last_undegraded":"2023-11-28T16:56:19.379497+0000","last_fullsized":"2023-11-28T16:56:19.379497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379300+0000","last_change":"2023-11-28T16:56:18.300151+0000","last_active":"2023-11-28T16:56:19.379300+0000","last_peered":"2023-11-28T16:56:19.379300+0000","last_clean":"2023-11-28T16:56:19.379300+0000","last_became_active":"2023-11-28T16:56:18.299856+0000","last_became_peered":"2023-11-28T16:56:18.299856+0000","last_unstale":"2023-11-28T16:56:19.379300+0000","last_undegraded":"2023-11-28T16:56:19.379300+0000","last_fullsized":"2023-11-28T16:56:19.379300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:15.306567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380514+0000","last_change":"2023-11-28T16:56:17.276089+0000","last_active":"2023-11-28T16:56:19.380514+0000","last_peered":"2023-11-28T16:56:19.380514+0000","last_clean":"2023-11-28T16:56:19.380514+0000","last_became_active":"2023-11-28T16:56:17.275737+0000","last_became_peered":"2023-11-28T16:56:17.275737+0000","last_unstale":"2023-11-28T16:56:19.380514+0000","last_undegraded":"2023-11-28T16:56:19.380514+0000","last_fullsized":"2023-11-28T16:56:19.380514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:35.781472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289119+0000","last_change":"2023-11-28T16:56:18.290460+0000","last_active":"2023-11-28T16:56:19.289119+0000","last_peered":"2023-11-28T16:56:19.289119+0000","last_clean":"2023-11-28T16:56:19.289119+0000","last_became_active":"2023-11-28T16:56:18.289279+0000","last_became_peered":"2023-11-28T16:56:18.289279+0000","last_unstale":"2023-11-28T16:56:19.289119+0000","last_undegraded":"2023-11-28T16:56:19.289119+0000","last_fullsized":"2023-11-28T16:56:19.289119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380625+0000","last_change":"2023-11-28T16:56:17.285460+0000","last_active":"2023-11-28T16:56:19.380625+0000","last_peered":"2023-11-28T16:56:19.380625+0000","last_clean":"2023-11-28T16:56:19.380625+0000","last_became_active":"2023-11-28T16:56:17.285086+0000","last_became_peered":"2023-11-28T16:56:17.285086+0000","last_unstale":"2023-11-28T16:56:19.380625+0000","last_undegraded":"2023-11-28T16:56:19.380625+0000","last_fullsized":"2023-11-28T16:56:19.380625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381297+0000","last_change":"2023-11-28T16:56:18.305936+0000","last_active":"2023-11-28T16:56:19.381297+0000","last_peered":"2023-11-28T16:56:19.381297+0000","last_clean":"2023-11-28T16:56:19.381297+0000","last_became_active":"2023-11-28T16:56:18.305605+0000","last_became_peered":"2023-11-28T16:56:18.305605+0000","last_unstale":"2023-11-28T16:56:19.381297+0000","last_undegraded":"2023-11-28T16:56:19.381297+0000","last_fullsized":"2023-11-28T16:56:19.381297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381093+0000","last_change":"2023-11-28T16:56:17.281889+0000","last_active":"2023-11-28T16:56:19.381093+0000","last_peered":"2023-11-28T16:56:19.381093+0000","last_clean":"2023-11-28T16:56:19.381093+0000","last_became_active":"2023-11-28T16:56:17.279528+0000","last_became_peered":"2023-11-28T16:56:17.279528+0000","last_unstale":"2023-11-28T16:56:19.381093+0000","last_undegraded":"2023-11-28T16:56:19.381093+0000","last_fullsized":"2023-11-28T16:56:19.381093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:01.074842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290576+0000","last_change":"2023-11-28T16:56:18.293159+0000","last_active":"2023-11-28T16:56:19.290576+0000","last_peered":"2023-11-28T16:56:19.290576+0000","last_clean":"2023-11-28T16:56:19.290576+0000","last_became_active":"2023-11-28T16:56:18.292829+0000","last_became_peered":"2023-11-28T16:56:18.292829+0000","last_unstale":"2023-11-28T16:56:19.290576+0000","last_undegraded":"2023-11-28T16:56:19.290576+0000","last_fullsized":"2023-11-28T16:56:19.290576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:57.812305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289906+0000","last_change":"2023-11-28T16:56:17.284348+0000","last_active":"2023-11-28T16:56:19.289906+0000","last_peered":"2023-11-28T16:56:19.289906+0000","last_clean":"2023-11-28T16:56:19.289906+0000","last_became_active":"2023-11-28T16:56:17.283980+0000","last_became_peered":"2023-11-28T16:56:17.283980+0000","last_unstale":"2023-11-28T16:56:19.289906+0000","last_undegraded":"2023-11-28T16:56:19.289906+0000","last_fullsized":"2023-11-28T16:56:19.289906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292612+0000","last_change":"2023-11-28T16:56:18.303791+0000","last_active":"2023-11-28T16:56:19.292612+0000","last_peered":"2023-11-28T16:56:19.292612+0000","last_clean":"2023-11-28T16:56:19.292612+0000","last_became_active":"2023-11-28T16:56:18.303124+0000","last_became_peered":"2023-11-28T16:56:18.303124+0000","last_unstale":"2023-11-28T16:56:19.292612+0000","last_undegraded":"2023-11-28T16:56:19.292612+0000","last_fullsized":"2023-11-28T16:56:19.292612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:02.080864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380840+0000","last_change":"2023-11-28T16:56:17.278950+0000","last_active":"2023-11-28T16:56:19.380840+0000","last_peered":"2023-11-28T16:56:19.380840+0000","last_clean":"2023-11-28T16:56:19.380840+0000","last_became_active":"2023-11-28T16:56:17.274910+0000","last_became_peered":"2023-11-28T16:56:17.274910+0000","last_unstale":"2023-11-28T16:56:19.380840+0000","last_undegraded":"2023-11-28T16:56:19.380840+0000","last_fullsized":"2023-11-28T16:56:19.380840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335299+0000","last_change":"2023-11-28T16:56:18.290296+0000","last_active":"2023-11-28T16:56:19.335299+0000","last_peered":"2023-11-28T16:56:19.335299+0000","last_clean":"2023-11-28T16:56:19.335299+0000","last_became_active":"2023-11-28T16:56:18.289615+0000","last_became_peered":"2023-11-28T16:56:18.289615+0000","last_unstale":"2023-11-28T16:56:19.335299+0000","last_undegraded":"2023-11-28T16:56:19.335299+0000","last_fullsized":"2023-11-28T16:56:19.335299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:15.855533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290385+0000","last_change":"2023-11-28T16:56:17.274214+0000","last_active":"2023-11-28T16:56:19.290385+0000","last_peered":"2023-11-28T16:56:19.290385+0000","last_clean":"2023-11-28T16:56:19.290385+0000","last_became_active":"2023-11-28T16:56:17.273502+0000","last_became_peered":"2023-11-28T16:56:17.273502+0000","last_unstale":"2023-11-28T16:56:19.290385+0000","last_undegraded":"2023-11-28T16:56:19.290385+0000","last_fullsized":"2023-11-28T16:56:19.290385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290196+0000","last_change":"2023-11-28T16:56:18.286223+0000","last_active":"2023-11-28T16:56:19.290196+0000","last_peered":"2023-11-28T16:56:19.290196+0000","last_clean":"2023-11-28T16:56:19.290196+0000","last_became_active":"2023-11-28T16:56:18.285913+0000","last_became_peered":"2023-11-28T16:56:18.285913+0000","last_unstale":"2023-11-28T16:56:19.290196+0000","last_undegraded":"2023-11-28T16:56:19.290196+0000","last_fullsized":"2023-11-28T16:56:19.290196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:58.506137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381200+0000","last_change":"2023-11-28T16:56:17.281382+0000","last_active":"2023-11-28T16:56:19.381200+0000","last_peered":"2023-11-28T16:56:19.381200+0000","last_clean":"2023-11-28T16:56:19.381200+0000","last_became_active":"2023-11-28T16:56:17.280978+0000","last_became_peered":"2023-11-28T16:56:17.280978+0000","last_unstale":"2023-11-28T16:56:19.381200+0000","last_undegraded":"2023-11-28T16:56:19.381200+0000","last_fullsized":"2023-11-28T16:56:19.381200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335329+0000","last_change":"2023-11-28T16:56:18.297433+0000","last_active":"2023-11-28T16:56:19.335329+0000","last_peered":"2023-11-28T16:56:19.335329+0000","last_clean":"2023-11-28T16:56:19.335329+0000","last_became_active":"2023-11-28T16:56:18.297151+0000","last_became_peered":"2023-11-28T16:56:18.297151+0000","last_unstale":"2023-11-28T16:56:19.335329+0000","last_undegraded":"2023-11-28T16:56:19.335329+0000","last_fullsized":"2023-11-28T16:56:19.335329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380199+0000","last_change":"2023-11-28T16:56:17.274113+0000","last_active":"2023-11-28T16:56:19.380199+0000","last_peered":"2023-11-28T16:56:19.380199+0000","last_clean":"2023-11-28T16:56:19.380199+0000","last_became_active":"2023-11-28T16:56:17.273829+0000","last_became_peered":"2023-11-28T16:56:17.273829+0000","last_unstale":"2023-11-28T16:56:19.380199+0000","last_undegraded":"2023-11-28T16:56:19.380199+0000","last_fullsized":"2023-11-28T16:56:19.380199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380389+0000","last_change":"2023-11-28T16:56:18.298961+0000","last_active":"2023-11-28T16:56:19.380389+0000","last_peered":"2023-11-28T16:56:19.380389+0000","last_clean":"2023-11-28T16:56:19.380389+0000","last_became_active":"2023-11-28T16:56:18.297627+0000","last_became_peered":"2023-11-28T16:56:18.297627+0000","last_unstale":"2023-11-28T16:56:19.380389+0000","last_undegraded":"2023-11-28T16:56:19.380389+0000","last_fullsized":"2023-11-28T16:56:19.380389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379011+0000","last_change":"2023-11-28T16:56:17.269852+0000","last_active":"2023-11-28T16:56:19.379011+0000","last_peered":"2023-11-28T16:56:19.379011+0000","last_clean":"2023-11-28T16:56:19.379011+0000","last_became_active":"2023-11-28T16:56:17.269433+0000","last_became_peered":"2023-11-28T16:56:17.269433+0000","last_unstale":"2023-11-28T16:56:19.379011+0000","last_undegraded":"2023-11-28T16:56:19.379011+0000","last_fullsized":"2023-11-28T16:56:19.379011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:53.668556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335123+0000","last_change":"2023-11-28T16:56:18.289171+0000","last_active":"2023-11-28T16:56:19.335123+0000","last_peered":"2023-11-28T16:56:19.335123+0000","last_clean":"2023-11-28T16:56:19.335123+0000","last_became_active":"2023-11-28T16:56:18.288412+0000","last_became_peered":"2023-11-28T16:56:18.288412+0000","last_unstale":"2023-11-28T16:56:19.335123+0000","last_undegraded":"2023-11-28T16:56:19.335123+0000","last_fullsized":"2023-11-28T16:56:19.335123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292552+0000","last_change":"2023-11-28T16:56:17.271860+0000","last_active":"2023-11-28T16:56:19.292552+0000","last_peered":"2023-11-28T16:56:19.292552+0000","last_clean":"2023-11-28T16:56:19.292552+0000","last_became_active":"2023-11-28T16:56:17.271327+0000","last_became_peered":"2023-11-28T16:56:17.271327+0000","last_unstale":"2023-11-28T16:56:19.292552+0000","last_undegraded":"2023-11-28T16:56:19.292552+0000","last_fullsized":"2023-11-28T16:56:19.292552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:37.653000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335599+0000","last_change":"2023-11-28T16:56:18.296341+0000","last_active":"2023-11-28T16:56:19.335599+0000","last_peered":"2023-11-28T16:56:19.335599+0000","last_clean":"2023-11-28T16:56:19.335599+0000","last_became_active":"2023-11-28T16:56:18.296000+0000","last_became_peered":"2023-11-28T16:56:18.296000+0000","last_unstale":"2023-11-28T16:56:19.335599+0000","last_undegraded":"2023-11-28T16:56:19.335599+0000","last_fullsized":"2023-11-28T16:56:19.335599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:12.212104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379483+0000","last_change":"2023-11-28T16:56:17.262861+0000","last_active":"2023-11-28T16:56:19.379483+0000","last_peered":"2023-11-28T16:56:19.379483+0000","last_clean":"2023-11-28T16:56:19.379483+0000","last_became_active":"2023-11-28T16:56:17.262560+0000","last_became_peered":"2023-11-28T16:56:17.262560+0000","last_unstale":"2023-11-28T16:56:19.379483+0000","last_undegraded":"2023-11-28T16:56:19.379483+0000","last_fullsized":"2023-11-28T16:56:19.379483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:30.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335816+0000","last_change":"2023-11-28T16:56:18.303867+0000","last_active":"2023-11-28T16:56:19.335816+0000","last_peered":"2023-11-28T16:56:19.335816+0000","last_clean":"2023-11-28T16:56:19.335816+0000","last_became_active":"2023-11-28T16:56:18.303566+0000","last_became_peered":"2023-11-28T16:56:18.303566+0000","last_unstale":"2023-11-28T16:56:19.335816+0000","last_undegraded":"2023-11-28T16:56:19.335816+0000","last_fullsized":"2023-11-28T16:56:19.335816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:28:53.866031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289997+0000","last_change":"2023-11-28T16:56:17.270718+0000","last_active":"2023-11-28T16:56:19.289997+0000","last_peered":"2023-11-28T16:56:19.289997+0000","last_clean":"2023-11-28T16:56:19.289997+0000","last_became_active":"2023-11-28T16:56:17.269258+0000","last_became_peered":"2023-11-28T16:56:17.269258+0000","last_unstale":"2023-11-28T16:56:19.289997+0000","last_undegraded":"2023-11-28T16:56:19.289997+0000","last_fullsized":"2023-11-28T16:56:19.289997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381133+0000","last_change":"2023-11-28T16:56:18.306623+0000","last_active":"2023-11-28T16:56:19.381133+0000","last_peered":"2023-11-28T16:56:19.381133+0000","last_clean":"2023-11-28T16:56:19.381133+0000","last_became_active":"2023-11-28T16:56:18.304538+0000","last_became_peered":"2023-11-28T16:56:18.304538+0000","last_unstale":"2023-11-28T16:56:19.381133+0000","last_undegraded":"2023-11-28T16:56:19.381133+0000","last_fullsized":"2023-11-28T16:56:19.381133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379166+0000","last_change":"2023-11-28T16:56:17.284653+0000","last_active":"2023-11-28T16:56:19.379166+0000","last_peered":"2023-11-28T16:56:19.379166+0000","last_clean":"2023-11-28T16:56:19.379166+0000","last_became_active":"2023-11-28T16:56:17.284128+0000","last_became_peered":"2023-11-28T16:56:17.284128+0000","last_unstale":"2023-11-28T16:56:19.379166+0000","last_undegraded":"2023-11-28T16:56:19.379166+0000","last_fullsized":"2023-11-28T16:56:19.379166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:57.892183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335328+0000","last_change":"2023-11-28T16:56:18.285248+0000","last_active":"2023-11-28T16:56:19.335328+0000","last_peered":"2023-11-28T16:56:19.335328+0000","last_clean":"2023-11-28T16:56:19.335328+0000","last_became_active":"2023-11-28T16:56:18.284940+0000","last_became_peered":"2023-11-28T16:56:18.284940+0000","last_unstale":"2023-11-28T16:56:19.335328+0000","last_undegraded":"2023-11-28T16:56:19.335328+0000","last_fullsized":"2023-11-28T16:56:19.335328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:50.797361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T16:56:18.271205+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:56:18.271205+0000","last_peered":"2023-11-28T16:56:18.271205+0000","last_clean":"2023-11-28T16:56:18.271205+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:56:18.271205+0000","last_undegraded":"2023-11-28T16:56:18.271205+0000","last_fullsized":"2023-11-28T16:56:18.271205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380719+0000","last_change":"2023-11-28T16:56:17.282961+0000","last_active":"2023-11-28T16:56:19.380719+0000","last_peered":"2023-11-28T16:56:19.380719+0000","last_clean":"2023-11-28T16:56:19.380719+0000","last_became_active":"2023-11-28T16:56:17.282701+0000","last_became_peered":"2023-11-28T16:56:17.282701+0000","last_unstale":"2023-11-28T16:56:19.380719+0000","last_undegraded":"2023-11-28T16:56:19.380719+0000","last_fullsized":"2023-11-28T16:56:19.380719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379683+0000","last_change":"2023-11-28T16:56:18.303548+0000","last_active":"2023-11-28T16:56:19.379683+0000","last_peered":"2023-11-28T16:56:19.379683+0000","last_clean":"2023-11-28T16:56:19.379683+0000","last_became_active":"2023-11-28T16:56:18.303179+0000","last_became_peered":"2023-11-28T16:56:18.303179+0000","last_unstale":"2023-11-28T16:56:19.379683+0000","last_undegraded":"2023-11-28T16:56:19.379683+0000","last_fullsized":"2023-11-28T16:56:19.379683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334952+0000","last_change":"2023-11-28T16:56:17.277497+0000","last_active":"2023-11-28T16:56:19.334952+0000","last_peered":"2023-11-28T16:56:19.334952+0000","last_clean":"2023-11-28T16:56:19.334952+0000","last_became_active":"2023-11-28T16:56:17.277234+0000","last_became_peered":"2023-11-28T16:56:17.277234+0000","last_unstale":"2023-11-28T16:56:19.334952+0000","last_undegraded":"2023-11-28T16:56:19.334952+0000","last_fullsized":"2023-11-28T16:56:19.334952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:14.300545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290216+0000","last_change":"2023-11-28T16:56:18.296396+0000","last_active":"2023-11-28T16:56:19.290216+0000","last_peered":"2023-11-28T16:56:19.290216+0000","last_clean":"2023-11-28T16:56:19.290216+0000","last_became_active":"2023-11-28T16:56:18.296084+0000","last_became_peered":"2023-11-28T16:56:18.296084+0000","last_unstale":"2023-11-28T16:56:19.290216+0000","last_undegraded":"2023-11-28T16:56:19.290216+0000","last_fullsized":"2023-11-28T16:56:19.290216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:59.283743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379147+0000","last_change":"2023-11-28T16:56:17.262892+0000","last_active":"2023-11-28T16:56:19.379147+0000","last_peered":"2023-11-28T16:56:19.379147+0000","last_clean":"2023-11-28T16:56:19.379147+0000","last_became_active":"2023-11-28T16:56:17.262566+0000","last_became_peered":"2023-11-28T16:56:17.262566+0000","last_unstale":"2023-11-28T16:56:19.379147+0000","last_undegraded":"2023-11-28T16:56:19.379147+0000","last_fullsized":"2023-11-28T16:56:19.379147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:47.727755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.288999+0000","last_change":"2023-11-28T16:56:18.286050+0000","last_active":"2023-11-28T16:56:19.288999+0000","last_peered":"2023-11-28T16:56:19.288999+0000","last_clean":"2023-11-28T16:56:19.288999+0000","last_became_active":"2023-11-28T16:56:18.284464+0000","last_became_peered":"2023-11-28T16:56:18.284464+0000","last_unstale":"2023-11-28T16:56:19.288999+0000","last_undegraded":"2023-11-28T16:56:19.288999+0000","last_fullsized":"2023-11-28T16:56:19.288999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381383+0000","last_change":"2023-11-28T16:56:17.281222+0000","last_active":"2023-11-28T16:56:19.381383+0000","last_peered":"2023-11-28T16:56:19.381383+0000","last_clean":"2023-11-28T16:56:19.381383+0000","last_became_active":"2023-11-28T16:56:17.280742+0000","last_became_peered":"2023-11-28T16:56:17.280742+0000","last_unstale":"2023-11-28T16:56:19.381383+0000","last_undegraded":"2023-11-28T16:56:19.381383+0000","last_fullsized":"2023-11-28T16:56:19.381383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292282+0000","last_change":"2023-11-28T16:56:18.296316+0000","last_active":"2023-11-28T16:56:19.292282+0000","last_peered":"2023-11-28T16:56:19.292282+0000","last_clean":"2023-11-28T16:56:19.292282+0000","last_became_active":"2023-11-28T16:56:18.296015+0000","last_became_peered":"2023-11-28T16:56:18.296015+0000","last_unstale":"2023-11-28T16:56:19.292282+0000","last_undegraded":"2023-11-28T16:56:19.292282+0000","last_fullsized":"2023-11-28T16:56:19.292282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:45.933550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289567+0000","last_change":"2023-11-28T16:56:17.266947+0000","last_active":"2023-11-28T16:56:19.289567+0000","last_peered":"2023-11-28T16:56:19.289567+0000","last_clean":"2023-11-28T16:56:19.289567+0000","last_became_active":"2023-11-28T16:56:17.266373+0000","last_became_peered":"2023-11-28T16:56:17.266373+0000","last_unstale":"2023-11-28T16:56:19.289567+0000","last_undegraded":"2023-11-28T16:56:19.289567+0000","last_fullsized":"2023-11-28T16:56:19.289567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:56.099337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381224+0000","last_change":"2023-11-28T16:56:18.293931+0000","last_active":"2023-11-28T16:56:19.381224+0000","last_peered":"2023-11-28T16:56:19.381224+0000","last_clean":"2023-11-28T16:56:19.381224+0000","last_became_active":"2023-11-28T16:56:18.293631+0000","last_became_peered":"2023-11-28T16:56:18.293631+0000","last_unstale":"2023-11-28T16:56:19.381224+0000","last_undegraded":"2023-11-28T16:56:19.381224+0000","last_fullsized":"2023-11-28T16:56:19.381224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:36.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335433+0000","last_change":"2023-11-28T16:56:17.275260+0000","last_active":"2023-11-28T16:56:19.335433+0000","last_peered":"2023-11-28T16:56:19.335433+0000","last_clean":"2023-11-28T16:56:19.335433+0000","last_became_active":"2023-11-28T16:56:17.273841+0000","last_became_peered":"2023-11-28T16:56:17.273841+0000","last_unstale":"2023-11-28T16:56:19.335433+0000","last_undegraded":"2023-11-28T16:56:19.335433+0000","last_fullsized":"2023-11-28T16:56:19.335433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:05.898052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289618+0000","last_change":"2023-11-28T16:56:18.287854+0000","last_active":"2023-11-28T16:56:19.289618+0000","last_peered":"2023-11-28T16:56:19.289618+0000","last_clean":"2023-11-28T16:56:19.289618+0000","last_became_active":"2023-11-28T16:56:18.287506+0000","last_became_peered":"2023-11-28T16:56:18.287506+0000","last_unstale":"2023-11-28T16:56:19.289618+0000","last_undegraded":"2023-11-28T16:56:19.289618+0000","last_fullsized":"2023-11-28T16:56:19.289618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.592237+0000","last_change":"2023-11-28T16:56:17.274658+0000","last_active":"2023-11-28T16:56:19.592237+0000","last_peered":"2023-11-28T16:56:19.592237+0000","last_clean":"2023-11-28T16:56:19.592237+0000","last_became_active":"2023-11-28T16:56:17.274438+0000","last_became_peered":"2023-11-28T16:56:17.274438+0000","last_unstale":"2023-11-28T16:56:19.592237+0000","last_undegraded":"2023-11-28T16:56:19.592237+0000","last_fullsized":"2023-11-28T16:56:19.592237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:08:00.220647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380057+0000","last_change":"2023-11-28T16:56:18.281874+0000","last_active":"2023-11-28T16:56:19.380057+0000","last_peered":"2023-11-28T16:56:19.380057+0000","last_clean":"2023-11-28T16:56:19.380057+0000","last_became_active":"2023-11-28T16:56:18.281487+0000","last_became_peered":"2023-11-28T16:56:18.281487+0000","last_unstale":"2023-11-28T16:56:19.380057+0000","last_undegraded":"2023-11-28T16:56:19.380057+0000","last_fullsized":"2023-11-28T16:56:19.380057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:38.707445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380726+0000","last_change":"2023-11-28T16:56:17.283262+0000","last_active":"2023-11-28T16:56:19.380726+0000","last_peered":"2023-11-28T16:56:19.380726+0000","last_clean":"2023-11-28T16:56:19.380726+0000","last_became_active":"2023-11-28T16:56:17.282998+0000","last_became_peered":"2023-11-28T16:56:17.282998+0000","last_unstale":"2023-11-28T16:56:19.380726+0000","last_undegraded":"2023-11-28T16:56:19.380726+0000","last_fullsized":"2023-11-28T16:56:19.380726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:57.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290549+0000","last_change":"2023-11-28T16:56:18.287449+0000","last_active":"2023-11-28T16:56:19.290549+0000","last_peered":"2023-11-28T16:56:19.290549+0000","last_clean":"2023-11-28T16:56:19.290549+0000","last_became_active":"2023-11-28T16:56:18.287148+0000","last_became_peered":"2023-11-28T16:56:18.287148+0000","last_unstale":"2023-11-28T16:56:19.290549+0000","last_undegraded":"2023-11-28T16:56:19.290549+0000","last_fullsized":"2023-11-28T16:56:19.290549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:34.713814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.334912+0000","last_change":"2023-11-28T16:56:17.273292+0000","last_active":"2023-11-28T16:56:19.334912+0000","last_peered":"2023-11-28T16:56:19.334912+0000","last_clean":"2023-11-28T16:56:19.334912+0000","last_became_active":"2023-11-28T16:56:17.272927+0000","last_became_peered":"2023-11-28T16:56:17.272927+0000","last_unstale":"2023-11-28T16:56:19.334912+0000","last_undegraded":"2023-11-28T16:56:19.334912+0000","last_fullsized":"2023-11-28T16:56:19.334912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:00.612356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.292330+0000","last_change":"2023-11-28T16:56:18.293307+0000","last_active":"2023-11-28T16:56:19.292330+0000","last_peered":"2023-11-28T16:56:19.292330+0000","last_clean":"2023-11-28T16:56:19.292330+0000","last_became_active":"2023-11-28T16:56:18.290847+0000","last_became_peered":"2023-11-28T16:56:18.290847+0000","last_unstale":"2023-11-28T16:56:19.292330+0000","last_undegraded":"2023-11-28T16:56:19.292330+0000","last_fullsized":"2023-11-28T16:56:19.292330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:48.733777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289324+0000","last_change":"2023-11-28T16:56:17.274311+0000","last_active":"2023-11-28T16:56:19.289324+0000","last_peered":"2023-11-28T16:56:19.289324+0000","last_clean":"2023-11-28T16:56:19.289324+0000","last_became_active":"2023-11-28T16:56:17.273978+0000","last_became_peered":"2023-11-28T16:56:17.273978+0000","last_unstale":"2023-11-28T16:56:19.289324+0000","last_undegraded":"2023-11-28T16:56:19.289324+0000","last_fullsized":"2023-11-28T16:56:19.289324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379411+0000","last_change":"2023-11-28T16:56:18.291693+0000","last_active":"2023-11-28T16:56:19.379411+0000","last_peered":"2023-11-28T16:56:19.379411+0000","last_clean":"2023-11-28T16:56:19.379411+0000","last_became_active":"2023-11-28T16:56:18.287795+0000","last_became_peered":"2023-11-28T16:56:18.287795+0000","last_unstale":"2023-11-28T16:56:19.379411+0000","last_undegraded":"2023-11-28T16:56:19.379411+0000","last_fullsized":"2023-11-28T16:56:19.379411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:03:36.787494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.289531+0000","last_change":"2023-11-28T16:56:17.273717+0000","last_active":"2023-11-28T16:56:19.289531+0000","last_peered":"2023-11-28T16:56:19.289531+0000","last_clean":"2023-11-28T16:56:19.289531+0000","last_became_active":"2023-11-28T16:56:17.271544+0000","last_became_peered":"2023-11-28T16:56:17.271544+0000","last_unstale":"2023-11-28T16:56:19.289531+0000","last_undegraded":"2023-11-28T16:56:19.289531+0000","last_fullsized":"2023-11-28T16:56:19.289531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379795+0000","last_change":"2023-11-28T16:56:18.299018+0000","last_active":"2023-11-28T16:56:19.379795+0000","last_peered":"2023-11-28T16:56:19.379795+0000","last_clean":"2023-11-28T16:56:19.379795+0000","last_became_active":"2023-11-28T16:56:18.297543+0000","last_became_peered":"2023-11-28T16:56:18.297543+0000","last_unstale":"2023-11-28T16:56:19.379795+0000","last_undegraded":"2023-11-28T16:56:19.379795+0000","last_fullsized":"2023-11-28T16:56:19.379795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:06.904073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335355+0000","last_change":"2023-11-28T16:56:17.277794+0000","last_active":"2023-11-28T16:56:19.335355+0000","last_peered":"2023-11-28T16:56:19.335355+0000","last_clean":"2023-11-28T16:56:19.335355+0000","last_became_active":"2023-11-28T16:56:17.277482+0000","last_became_peered":"2023-11-28T16:56:17.277482+0000","last_unstale":"2023-11-28T16:56:19.335355+0000","last_undegraded":"2023-11-28T16:56:19.335355+0000","last_fullsized":"2023-11-28T16:56:19.335355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:28.619562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.380283+0000","last_change":"2023-11-28T16:56:18.304716+0000","last_active":"2023-11-28T16:56:19.380283+0000","last_peered":"2023-11-28T16:56:19.380283+0000","last_clean":"2023-11-28T16:56:19.380283+0000","last_became_active":"2023-11-28T16:56:18.304418+0000","last_became_peered":"2023-11-28T16:56:18.304418+0000","last_unstale":"2023-11-28T16:56:19.380283+0000","last_undegraded":"2023-11-28T16:56:19.380283+0000","last_fullsized":"2023-11-28T16:56:19.380283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:29.625584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381366+0000","last_change":"2023-11-28T16:56:18.311948+0000","last_active":"2023-11-28T16:56:19.381366+0000","last_peered":"2023-11-28T16:56:19.381366+0000","last_clean":"2023-11-28T16:56:19.381366+0000","last_became_active":"2023-11-28T16:56:18.311642+0000","last_became_peered":"2023-11-28T16:56:18.311642+0000","last_unstale":"2023-11-28T16:56:19.381366+0000","last_undegraded":"2023-11-28T16:56:19.381366+0000","last_fullsized":"2023-11-28T16:56:19.381366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:06:47.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335228+0000","last_change":"2023-11-28T16:56:17.286515+0000","last_active":"2023-11-28T16:56:19.335228+0000","last_peered":"2023-11-28T16:56:19.335228+0000","last_clean":"2023-11-28T16:56:19.335228+0000","last_became_active":"2023-11-28T16:56:17.286203+0000","last_became_peered":"2023-11-28T16:56:17.286203+0000","last_unstale":"2023-11-28T16:56:19.335228+0000","last_undegraded":"2023-11-28T16:56:19.335228+0000","last_fullsized":"2023-11-28T16:56:19.335228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:07:13.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.381073+0000","last_change":"2023-11-28T16:56:18.311709+0000","last_active":"2023-11-28T16:56:19.381073+0000","last_peered":"2023-11-28T16:56:19.381073+0000","last_clean":"2023-11-28T16:56:19.381073+0000","last_became_active":"2023-11-28T16:56:18.307023+0000","last_became_peered":"2023-11-28T16:56:18.307023+0000","last_unstale":"2023-11-28T16:56:19.381073+0000","last_undegraded":"2023-11-28T16:56:19.381073+0000","last_fullsized":"2023-11-28T16:56:19.381073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:51.159251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.335370+0000","last_change":"2023-11-28T16:56:17.275000+0000","last_active":"2023-11-28T16:56:19.335370+0000","last_peered":"2023-11-28T16:56:19.335370+0000","last_clean":"2023-11-28T16:56:19.335370+0000","last_became_active":"2023-11-28T16:56:17.273306+0000","last_became_peered":"2023-11-28T16:56:17.273306+0000","last_unstale":"2023-11-28T16:56:19.335370+0000","last_undegraded":"2023-11-28T16:56:19.335370+0000","last_fullsized":"2023-11-28T16:56:19.335370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:23.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290507+0000","last_change":"2023-11-28T16:56:18.293608+0000","last_active":"2023-11-28T16:56:19.290507+0000","last_peered":"2023-11-28T16:56:19.290507+0000","last_clean":"2023-11-28T16:56:19.290507+0000","last_became_active":"2023-11-28T16:56:18.293219+0000","last_became_peered":"2023-11-28T16:56:18.293219+0000","last_unstale":"2023-11-28T16:56:19.290507+0000","last_undegraded":"2023-11-28T16:56:19.290507+0000","last_fullsized":"2023-11-28T16:56:19.290507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:24.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379965+0000","last_change":"2023-11-28T16:56:17.269059+0000","last_active":"2023-11-28T16:56:19.379965+0000","last_peered":"2023-11-28T16:56:19.379965+0000","last_clean":"2023-11-28T16:56:19.379965+0000","last_became_active":"2023-11-28T16:56:17.268756+0000","last_became_peered":"2023-11-28T16:56:17.268756+0000","last_unstale":"2023-11-28T16:56:19.379965+0000","last_undegraded":"2023-11-28T16:56:19.379965+0000","last_fullsized":"2023-11-28T16:56:19.379965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:58.277722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.379889+0000","last_change":"2023-11-28T16:56:18.297186+0000","last_active":"2023-11-28T16:56:19.379889+0000","last_peered":"2023-11-28T16:56:19.379889+0000","last_clean":"2023-11-28T16:56:19.379889+0000","last_became_active":"2023-11-28T16:56:18.295432+0000","last_became_peered":"2023-11-28T16:56:18.295432+0000","last_unstale":"2023-11-28T16:56:19.379889+0000","last_undegraded":"2023-11-28T16:56:19.379889+0000","last_fullsized":"2023-11-28T16:56:19.379889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:17.244278+0000","last_clean_scrub_stamp":"2023-11-28T16:56:17.244278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:10.360246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T16:56:19.290693+0000","last_change":"2023-11-28T16:56:17.279529+0000","last_active":"2023-11-28T16:56:19.290693+0000","last_peered":"2023-11-28T16:56:19.290693+0000","last_clean":"2023-11-28T16:56:19.290693+0000","last_became_active":"2023-11-28T16:56:17.279217+0000","last_became_peered":"2023-11-28T16:56:17.279217+0000","last_unstale":"2023-11-28T16:56:19.290693+0000","last_undegraded":"2023-11-28T16:56:19.290693+0000","last_fullsized":"2023-11-28T16:56:19.290693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:16.238257+0000","last_clean_scrub_stamp":"2023-11-28T16:56:16.238257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:11.830802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:56:27.543 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T16:56:27.543 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T16:56:27.543 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T16:56:27.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T16:56:27.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e58e79640 1 Processor -- start 2023-11-28T16:56:27.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e58e79640 1 -- start start 2023-11-28T16:56:27.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e58e79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e5406bd00 0x7f8e54155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e58e79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 0x7f8e540c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e58e79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5406c440 con 0x7f8e5414ea60 2023-11-28T16:56:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e58e79640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e54154790 con 0x7f8e5406bd00 2023-11-28T16:56:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e58e79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5406c6e0 con 0x7f8e540bf400 2023-11-28T16:56:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e5259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8e5414ea60 0x7f8e540700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44080/0 (socket says 172.21.15.26:44080) 2023-11-28T16:56:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e5259c640 1 -- 172.21.15.26:0/3728563979 learned_addr learned my addr 172.21.15.26:0/3728563979 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e52d9d640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 0x7f8e540c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3728563979 >> v2:172.21.15.79:3300/0 conn(0x7f8e5406bd00 0x7f8e54155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834257510 0 0) 0x7f8e5406c440 con 0x7f8e5414ea60 2023-11-28T16:56:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e40003530 con 0x7f8e5414ea60 2023-11-28T16:56:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056379332 0 0) 0x7f8e40003530 con 0x7f8e5414ea60 2023-11-28T16:56:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 msgr2=0x7f8e540c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 0x7f8e540c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 >> v2:172.21.15.79:3300/0 conn(0x7f8e5406bd00 msgr2=0x7f8e54155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 --2- 172.21.15.26:0/3728563979 >> v2:172.21.15.79:3300/0 conn(0x7f8e5406bd00 0x7f8e54155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54154a50 con 0x7f8e5414ea60 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f8e44001680 con 0x7f8e5414ea60 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.723+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3728563979 >> v2:172.21.15.79:3300/0 conn(0x7f8e5406bd00 0x7f8e54155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 >> v1:172.21.15.26:6789/0 conn(0x7f8e5414ea60 legacy=0x7f8e540700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 0x7f8e40003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40003f00 0x7f8e400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40004d10 0x7f8e40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e54154790 con 0x7f8e40003f00 2023-11-28T16:56:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5406c6e0 con 0x7f8e40004d10 2023-11-28T16:56:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4000ba70 con 0x7f8e540bf400 2023-11-28T16:56:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40003f00 0x7f8e400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e5259c640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 0x7f8e40003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e52d9d640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40004d10 0x7f8e40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e4bfff640 1 -- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 msgr2=0x7f8e40003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e540bf400 0x7f8e40003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e4bfff640 1 -- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40004d10 msgr2=0x7f8e40005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:27.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40004d10 0x7f8e40005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e4bfff640 1 -- 172.21.15.26:0/3728563979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40003530 con 0x7f8e40003f00 2023-11-28T16:56:27.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40003f00 0x7f8e400047d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009cb0 tx=0x7f8e3c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d2514c4665f98c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0a5900 con 0x7f8e40003f00 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0a5a60 con 0x7f8e40003f00 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.727+0000 7f8e51d9b640 1 -- 172.21.15.26:0/3728563979 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0a5c50 con 0x7f8e40003f00 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- 172.21.15.26:0/3728563979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40003f00 msgr2=0x7f8e400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 --2- 172.21.15.26:0/3728563979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40003f00 0x7f8e400047d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009cb0 tx=0x7f8e3c01cc40 comp rx=0 tx=0).stop 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e52d9d640 1 -- 172.21.15.26:0/3728563979 reap_dead start 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- 172.21.15.26:0/3728563979 shutdown_connections 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- 172.21.15.26:0/3728563979 >> 172.21.15.26:0/3728563979 conn(0x7f8e540c2ad0 msgr2=0x7f8e540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- 172.21.15.26:0/3728563979 shutdown_connections 2023-11-28T16:56:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- 172.21.15.26:0/3728563979 wait complete. 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 Processor -- start 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- start start 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40003f00 0x7f8e54158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e54158880 0x7f8e541483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e54148920 0x7f8e54155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540a88d0 con 0x7f8e54158880 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e541ecc30 con 0x7f8e40003f00 2023-11-28T16:56:27.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e58e79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e541eda10 con 0x7f8e54148920 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e54158880 0x7f8e541483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e54158880 0x7f8e541483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53552/0 (socket says 172.21.15.26:53552) 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 -- 172.21.15.26:0/3457075530 learned_addr learned my addr 172.21.15.26:0/3457075530 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e5259c640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40003f00 0x7f8e54158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e52d9d640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e54148920 0x7f8e54155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 -- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e54148920 msgr2=0x7f8e54155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e54148920 0x7f8e54155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 -- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40003f00 msgr2=0x7f8e54158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40003f00 0x7f8e54158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.731+0000 7f8e4bfff640 1 -- 172.21.15.26:0/3457075530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e541ece40 con 0x7f8e54158880 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e4bfff640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e54158880 0x7f8e541483e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c01ca70 tx=0x7f8e40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e4affd640 1 -- 172.21.15.26:0/3457075530 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c004020 con 0x7f8e54158880 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e4affd640 1 -- 172.21.15.26:0/3457075530 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0041a0 con 0x7f8e54158880 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e541ed0e0 con 0x7f8e54158880 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e4affd640 1 -- 172.21.15.26:0/3457075530 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c003620 con 0x7f8e54158880 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e541ed6a0 con 0x7f8e54158880 2023-11-28T16:56:27.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e541edba0 con 0x7f8e54158880 2023-11-28T16:56:27.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e4affd640 1 -- 172.21.15.26:0/3457075530 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8e3c0b4040 con 0x7f8e54158880 2023-11-28T16:56:27.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.735+0000 7f8e4affd640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e34066900 0x7f8e34068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:27.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.739+0000 7f8e4affd640 1 -- 172.21.15.26:0/3457075530 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e3c11dd20 con 0x7f8e54158880 2023-11-28T16:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.739+0000 7f8e5259c640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e34066900 0x7f8e34068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.739+0000 7f8e5259c640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e34066900 0x7f8e34068dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e44001cd0 tx=0x7f8e44007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.739+0000 7f8e4affd640 1 -- 172.21.15.26:0/3457075530 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e3c0eaf70 con 0x7f8e54158880 2023-11-28T16:56:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8e5404e890 con 0x7f8e54158880 2023-11-28T16:56:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e4affd640 1 -- 172.21.15.26:0/3457075530 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8e3c0b2040 con 0x7f8e54158880 2023-11-28T16:56:27.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:27.936 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T16:56:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e34066900 msgr2=0x7f8e34068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e34066900 0x7f8e34068dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e44001cd0 tx=0x7f8e44007900 comp rx=0 tx=0).stop 2023-11-28T16:56:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e54158880 msgr2=0x7f8e541483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e54158880 0x7f8e541483e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c01ca70 tx=0x7f8e40005800 comp rx=0 tx=0).stop 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 shutdown_connections 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e34066900 0x7f8e34068dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e54148920 0x7f8e54155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e54158880 0x7f8e541483e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 --2- 172.21.15.26:0/3457075530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e40003f00 0x7f8e54158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 >> 172.21.15.26:0/3457075530 conn(0x7f8e540c2ad0 msgr2=0x7f8e541530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 shutdown_connections 2023-11-28T16:56:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:27.931+0000 7f8e58e79640 1 -- 172.21.15.26:0/3457075530 wait complete. 2023-11-28T16:56:27.958 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T16:56:27.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:28.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.095+0000 7f59d0fe6640 1 Processor -- start 2023-11-28T16:56:28.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.095+0000 7f59d0fe6640 1 -- start start 2023-11-28T16:56:28.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59d0fe6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59d0fe6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59cc0bf400 0x7f59cc0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59d0fe6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59cc06c440 con 0x7f59cc14ea60 2023-11-28T16:56:28.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59d0fe6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc154790 con 0x7f59cc0bf400 2023-11-28T16:56:28.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59d0fe6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc06c6e0 con 0x7f59cc06bd00 2023-11-28T16:56:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59cad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59cc0bf400 0x7f59cc0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44498/0 (socket says 172.21.15.26:44498) 2023-11-28T16:56:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 -- 172.21.15.26:0/2678024099 learned_addr learned my addr 172.21.15.26:0/2678024099 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59ca59c640 1 --1- 172.21.15.26:0/2678024099 >> v1:172.21.15.79:6789/0 conn(0x7f59cc14ea60 0x7f59cc0700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34110/0 (socket says 172.21.15.26:34110) 2023-11-28T16:56:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 -- 172.21.15.26:0/2678024099 >> v2:172.21.15.79:3300/0 conn(0x7f59cc0bf400 msgr2=0x7f59cc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:28.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 --2- 172.21.15.26:0/2678024099 >> v2:172.21.15.79:3300/0 conn(0x7f59cc0bf400 0x7f59cc0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 -- 172.21.15.26:0/2678024099 >> v1:172.21.15.79:6789/0 conn(0x7f59cc14ea60 legacy=0x7f59cc0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 -- 172.21.15.26:0/2678024099 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc154a50 con 0x7f59cc06bd00 2023-11-28T16:56:28.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.099+0000 7f59c3fff640 1 --2- 172.21.15.26:0/2678024099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc155250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009870 tx=0x7f59b401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c46fc859ffb8b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59c9d9b640 1 -- 172.21.15.26:0/2678024099 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ab610 con 0x7f59cc06bd00 2023-11-28T16:56:28.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59c9d9b640 1 -- 172.21.15.26:0/2678024099 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40ab770 con 0x7f59cc06bd00 2023-11-28T16:56:28.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59c9d9b640 1 -- 172.21.15.26:0/2678024099 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40abb00 con 0x7f59cc06bd00 2023-11-28T16:56:28.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- 172.21.15.26:0/2678024099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 msgr2=0x7f59cc155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/2678024099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc155250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009870 tx=0x7f59b401c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- 172.21.15.26:0/2678024099 shutdown_connections 2023-11-28T16:56:28.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/2678024099 >> v2:172.21.15.79:3300/0 conn(0x7f59cc0bf400 0x7f59cc0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/2678024099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc155250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- 172.21.15.26:0/2678024099 >> 172.21.15.26:0/2678024099 conn(0x7f59cc0c2ad0 msgr2=0x7f59cc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:28.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- 172.21.15.26:0/2678024099 shutdown_connections 2023-11-28T16:56:28.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- 172.21.15.26:0/2678024099 wait complete. 2023-11-28T16:56:28.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 Processor -- start 2023-11-28T16:56:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- start start 2023-11-28T16:56:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc1edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc0bf400 0x7f59cc155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59cc14ea60 0x7f59cc157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc14de30 con 0x7f59cc0bf400 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc1449c0 con 0x7f59cc14ea60 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.103+0000 7f59d0fe6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc14e2c0 con 0x7f59cc06bd00 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc0bf400 0x7f59cc155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc0bf400 0x7f59cc155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53560/0 (socket says 172.21.15.26:53560) 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 -- 172.21.15.26:0/1368648511 learned_addr learned my addr 172.21.15.26:0/1368648511 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59ca59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc1edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59cad9d640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59cc14ea60 0x7f59cc157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 -- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 msgr2=0x7f59cc1edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc1edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 -- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59cc14ea60 msgr2=0x7f59cc157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59cc14ea60 0x7f59cc157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 -- 172.21.15.26:0/1368648511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40094d0 con 0x7f59cc0bf400 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c3fff640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc0bf400 0x7f59cc155fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59b40ad040 tx=0x7f59b401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c2ffd640 1 -- 172.21.15.26:0/1368648511 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40be5f0 con 0x7f59cc0bf400 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c2ffd640 1 -- 172.21.15.26:0/1368648511 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40be750 con 0x7f59cc0bf400 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c2ffd640 1 -- 172.21.15.26:0/1368648511 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40beb00 con 0x7f59cc0bf400 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc1f1240 con 0x7f59cc0bf400 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc157540 con 0x7f59cc0bf400 2023-11-28T16:56:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc1f16f0 con 0x7f59cc0bf400 2023-11-28T16:56:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.107+0000 7f59c2ffd640 1 -- 172.21.15.26:0/1368648511 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f59b40b43f0 con 0x7f59cc0bf400 2023-11-28T16:56:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.111+0000 7f59c2ffd640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f59ac0668d0 0x7f59ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.111+0000 7f59c2ffd640 1 -- 172.21.15.26:0/1368648511 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59b411f230 con 0x7f59cc0bf400 2023-11-28T16:56:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.111+0000 7f59ca59c640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f59ac0668d0 0x7f59ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.111+0000 7f59ca59c640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f59ac0668d0 0x7f59ac068d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59bc000f70 tx=0x7f59bc007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.115+0000 7f59c2ffd640 1 -- 172.21.15.26:0/1368648511 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59b40ec480 con 0x7f59cc0bf400 2023-11-28T16:56:28.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59cc14dc00 con 0x7f59cc0bf400 2023-11-28T16:56:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59c2ffd640 1 -- 172.21.15.26:0/1368648511 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f59cc14dc00 con 0x7f59cc0bf400 2023-11-28T16:56:28.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:28.275 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f59ac0668d0 msgr2=0x7f59ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f59ac0668d0 0x7f59ac068d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59bc000f70 tx=0x7f59bc007e90 comp rx=0 tx=0).stop 2023-11-28T16:56:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc0bf400 msgr2=0x7f59cc155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc0bf400 0x7f59cc155fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59b40ad040 tx=0x7f59b401ac30 comp rx=0 tx=0).stop 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 shutdown_connections 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59cc14ea60 0x7f59cc157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc0bf400 0x7f59cc155fb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f59ac0668d0 0x7f59ac068d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 --2- 172.21.15.26:0/1368648511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59cc06bd00 0x7f59cc1edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 >> 172.21.15.26:0/1368648511 conn(0x7f59cc0c2ad0 msgr2=0x7f59cc0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 shutdown_connections 2023-11-28T16:56:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.271+0000 7f59d0fe6640 1 -- 172.21.15.26:0/1368648511 wait complete. 2023-11-28T16:56:28.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:28.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.439+0000 7f1589e9c640 1 Processor -- start 2023-11-28T16:56:28.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.439+0000 7f1589e9c640 1 -- start start 2023-11-28T16:56:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1589e9c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1584151bf0 0x7f1584152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1589e9c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1584158580 con 0x7f15840c6220 2023-11-28T16:56:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1589e9c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1584158e60 con 0x7f1584158a10 2023-11-28T16:56:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1589e9c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840c2fd0 con 0x7f1584151bf0 2023-11-28T16:56:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f15837fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f15840c6220 0x7f15840c13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44096/0 (socket says 172.21.15.26:44096) 2023-11-28T16:56:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f15837fe640 1 -- 172.21.15.26:0/2205575785 learned_addr learned my addr 172.21.15.26:0/2205575785 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1583fff640 1 --2- 172.21.15.26:0/2205575785 >> v2:172.21.15.26:3300/0 conn(0x7f1584151bf0 0x7f1584152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f15827fc640 1 -- 172.21.15.26:0/2205575785 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585654783 0 0) 0x7f1584158580 con 0x7f15840c6220 2023-11-28T16:56:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f15827fc640 1 -- 172.21.15.26:0/2205575785 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f156c003530 con 0x7f15840c6220 2023-11-28T16:56:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1583fff640 1 -- 172.21.15.26:0/2205575785 >> v1:172.21.15.79:6789/0 conn(0x7f1584158a10 legacy=0x7f15840c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1583fff640 1 -- 172.21.15.26:0/2205575785 >> v1:172.21.15.26:6789/0 conn(0x7f15840c6220 legacy=0x7f15840c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.443+0000 7f1583fff640 1 -- 172.21.15.26:0/2205575785 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584157f50 con 0x7f1584151bf0 2023-11-28T16:56:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1583fff640 1 --2- 172.21.15.26:0/2205575785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f1584152020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f157c009d90 tx=0x7f157c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e010b91356441f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f15827fc640 1 -- 172.21.15.26:0/2205575785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0a59e0 con 0x7f1584151bf0 2023-11-28T16:56:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f15827fc640 1 -- 172.21.15.26:0/2205575785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c0a5b40 con 0x7f1584151bf0 2023-11-28T16:56:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f15827fc640 1 -- 172.21.15.26:0/2205575785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0ad440 con 0x7f1584151bf0 2023-11-28T16:56:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 -- 172.21.15.26:0/2205575785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 msgr2=0x7f1584152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 --2- 172.21.15.26:0/2205575785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f1584152020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f157c009d90 tx=0x7f157c01c920 comp rx=0 tx=0).stop 2023-11-28T16:56:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 -- 172.21.15.26:0/2205575785 shutdown_connections 2023-11-28T16:56:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 --2- 172.21.15.26:0/2205575785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f1584152020 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 -- 172.21.15.26:0/2205575785 >> 172.21.15.26:0/2205575785 conn(0x7f158406a5a0 msgr2=0x7f158406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 -- 172.21.15.26:0/2205575785 shutdown_connections 2023-11-28T16:56:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 -- 172.21.15.26:0/2205575785 wait complete. 2023-11-28T16:56:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 Processor -- start 2023-11-28T16:56:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.447+0000 7f1589e9c640 1 -- start start 2023-11-28T16:56:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15840c6220 0x7f1584155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f15841eded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1584158a10 0x7f15840ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840ac350 con 0x7f1584151bf0 2023-11-28T16:56:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584155210 con 0x7f15840c6220 2023-11-28T16:56:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158414e530 con 0x7f1584158a10 2023-11-28T16:56:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f15841eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f15841eded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53566/0 (socket says 172.21.15.26:53566) 2023-11-28T16:56:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 -- 172.21.15.26:0/727631432 learned_addr learned my addr 172.21.15.26:0/727631432 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f15837fe640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15840c6220 0x7f1584155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1583fff640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1584158a10 0x7f15840ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 -- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1584158a10 msgr2=0x7f15840ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1584158a10 0x7f15840ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 -- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15840c6220 msgr2=0x7f1584155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15840c6220 0x7f1584155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 -- 172.21.15.26:0/727631432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c009a70 con 0x7f1584151bf0 2023-11-28T16:56:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1582ffd640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f15841eded0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f157800c400 tx=0x7f157800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f156bfff640 1 -- 172.21.15.26:0/727631432 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15780052d0 con 0x7f1584151bf0 2023-11-28T16:56:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f156bfff640 1 -- 172.21.15.26:0/727631432 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578005430 con 0x7f1584151bf0 2023-11-28T16:56:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15840ab7a0 con 0x7f1584151bf0 2023-11-28T16:56:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f156bfff640 1 -- 172.21.15.26:0/727631432 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578003890 con 0x7f1584151bf0 2023-11-28T16:56:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15841ecdb0 con 0x7f1584151bf0 2023-11-28T16:56:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15840abcc0 con 0x7f1584151bf0 2023-11-28T16:56:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.451+0000 7f156bfff640 1 -- 172.21.15.26:0/727631432 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f15780039f0 con 0x7f1584151bf0 2023-11-28T16:56:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.455+0000 7f156bfff640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1570066900 0x7f1570068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.455+0000 7f156bfff640 1 -- 172.21.15.26:0/727631432 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1578083980 con 0x7f1584151bf0 2023-11-28T16:56:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.455+0000 7f15837fe640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1570066900 0x7f1570068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.455+0000 7f15837fe640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1570066900 0x7f1570068dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15740011f0 tx=0x7f1574007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.459+0000 7f156bfff640 1 -- 172.21.15.26:0/727631432 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15840abcc0 con 0x7f1584151bf0 2023-11-28T16:56:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.615+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15840abcc0 con 0x7f1584151bf0 2023-11-28T16:56:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f156bfff640 1 -- 172.21.15.26:0/727631432 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15840abcc0 con 0x7f1584151bf0 2023-11-28T16:56:28.622 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1570066900 msgr2=0x7f1570068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1570066900 0x7f1570068dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15740011f0 tx=0x7f1574007d40 comp rx=0 tx=0).stop 2023-11-28T16:56:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 msgr2=0x7f15841eded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f15841eded0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f157800c400 tx=0x7f157800c8c0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 shutdown_connections 2023-11-28T16:56:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1570066900 0x7f1570068dc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1584158a10 0x7f15840ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1584151bf0 0x7f15841eded0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 --2- 172.21.15.26:0/727631432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15840c6220 0x7f1584155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 >> 172.21.15.26:0/727631432 conn(0x7f158406a5a0 msgr2=0x7f15840c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:28.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 shutdown_connections 2023-11-28T16:56:28.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.619+0000 7f1589e9c640 1 -- 172.21.15.26:0/727631432 wait complete. 2023-11-28T16:56:28.643 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:28.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 Processor -- start 2023-11-28T16:56:28.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 -- start start 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62440c6220 0x7f6244158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62440c13a0 0x7f62440c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6244151bf0 0x7f6244152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6244158580 con 0x7f62440c13a0 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6244157f50 con 0x7f62440c6220 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6248c09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440c1f60 con 0x7f6244151bf0 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62440c13a0 0x7f62440c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62440c13a0 0x7f62440c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53574/0 (socket says 172.21.15.26:53574) 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 -- 172.21.15.26:0/3787665525 learned_addr learned my addr 172.21.15.26:0/3787665525 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f624259c640 1 --2- 172.21.15.26:0/3787665525 >> v2:172.21.15.79:3300/0 conn(0x7f62440c6220 0x7f6244158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6242d9d640 1 --2- 172.21.15.26:0/3787665525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6244151bf0 0x7f6244152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 -- 172.21.15.26:0/3787665525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6244151bf0 msgr2=0x7f6244152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:28.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 --2- 172.21.15.26:0/3787665525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6244151bf0 0x7f6244152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 -- 172.21.15.26:0/3787665525 >> v2:172.21.15.79:3300/0 conn(0x7f62440c6220 msgr2=0x7f6244158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:28.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 --2- 172.21.15.26:0/3787665525 >> v2:172.21.15.79:3300/0 conn(0x7f62440c6220 0x7f6244158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f623bfff640 1 -- 172.21.15.26:0/3787665525 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440c2240 con 0x7f62440c13a0 2023-11-28T16:56:28.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.787+0000 7f6242d9d640 1 --2- 172.21.15.26:0/3787665525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6244151bf0 0x7f6244152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:28.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f623bfff640 1 --2- 172.21.15.26:0/3787665525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62440c13a0 0x7f62440c28c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f624406b500 tx=0x7f622c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52df534f3c311f16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6241d9b640 1 -- 172.21.15.26:0/3787665525 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0a7070 con 0x7f62440c13a0 2023-11-28T16:56:28.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6241d9b640 1 -- 172.21.15.26:0/3787665525 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c0ab430 con 0x7f62440c13a0 2023-11-28T16:56:28.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6241d9b640 1 -- 172.21.15.26:0/3787665525 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0ab7c0 con 0x7f62440c13a0 2023-11-28T16:56:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 -- 172.21.15.26:0/3787665525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62440c13a0 msgr2=0x7f62440c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 --2- 172.21.15.26:0/3787665525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62440c13a0 0x7f62440c28c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f624406b500 tx=0x7f622c01c4d0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 -- 172.21.15.26:0/3787665525 shutdown_connections 2023-11-28T16:56:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 --2- 172.21.15.26:0/3787665525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6244151bf0 0x7f6244152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 --2- 172.21.15.26:0/3787665525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62440c13a0 0x7f62440c28c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 --2- 172.21.15.26:0/3787665525 >> v2:172.21.15.79:3300/0 conn(0x7f62440c6220 0x7f6244158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 -- 172.21.15.26:0/3787665525 >> 172.21.15.26:0/3787665525 conn(0x7f624406a5a0 msgr2=0x7f624406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 -- 172.21.15.26:0/3787665525 shutdown_connections 2023-11-28T16:56:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 -- 172.21.15.26:0/3787665525 wait complete. 2023-11-28T16:56:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.791+0000 7f6248c09640 1 Processor -- start 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 -- start start 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62440c13a0 0x7f6244157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62440c6220 0x7f62441ed330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6244151bf0 0x7f62440c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6244157370 con 0x7f6244151bf0 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62441ed870 con 0x7f62440c6220 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6244149090 con 0x7f62440c13a0 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6244151bf0 0x7f62440c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f624259c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62440c13a0 0x7f6244157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6244151bf0 0x7f62440c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53580/0 (socket says 172.21.15.26:53580) 2023-11-28T16:56:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 -- 172.21.15.26:0/2352369548 learned_addr learned my addr 172.21.15.26:0/2352369548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f623bfff640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62440c6220 0x7f62441ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 -- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62440c13a0 msgr2=0x7f6244157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62440c13a0 0x7f6244157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 -- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62440c6220 msgr2=0x7f62441ed330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62440c6220 0x7f62441ed330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 -- 172.21.15.26:0/2352369548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c009480 con 0x7f6244151bf0 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6242d9d640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6244151bf0 0x7f62440c3360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f623c007ef0 tx=0x7f623c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f623affd640 1 -- 172.21.15.26:0/2352369548 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c003ba0 con 0x7f6244151bf0 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f623affd640 1 -- 172.21.15.26:0/2352369548 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00f040 con 0x7f6244151bf0 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f623affd640 1 -- 172.21.15.26:0/2352369548 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00de80 con 0x7f6244151bf0 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6244155ec0 con 0x7f6244151bf0 2023-11-28T16:56:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6244156d20 con 0x7f6244151bf0 2023-11-28T16:56:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.795+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624404e890 con 0x7f6244151bf0 2023-11-28T16:56:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.799+0000 7f623affd640 1 -- 172.21.15.26:0/2352369548 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f623c004030 con 0x7f6244151bf0 2023-11-28T16:56:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.799+0000 7f623affd640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f62240668d0 0x7f6224068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.799+0000 7f623affd640 1 -- 172.21.15.26:0/2352369548 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f623c0846c0 con 0x7f6244151bf0 2023-11-28T16:56:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.799+0000 7f624259c640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f62240668d0 0x7f6224068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.799+0000 7f624259c640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f62240668d0 0x7f6224068d90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6244158fd0 tx=0x7f6234009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:28.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.803+0000 7f623affd640 1 -- 172.21.15.26:0/2352369548 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f623c0519a0 con 0x7f6244151bf0 2023-11-28T16:56:28.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.959+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62441574b0 con 0x7f6244151bf0 2023-11-28T16:56:28.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.959+0000 7f623affd640 1 -- 172.21.15.26:0/2352369548 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f623c054fc0 con 0x7f6244151bf0 2023-11-28T16:56:28.965 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f62240668d0 msgr2=0x7f6224068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f62240668d0 0x7f6224068d90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6244158fd0 tx=0x7f6234009190 comp rx=0 tx=0).stop 2023-11-28T16:56:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6244151bf0 msgr2=0x7f62440c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6244151bf0 0x7f62440c3360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f623c007ef0 tx=0x7f623c00d4a0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 shutdown_connections 2023-11-28T16:56:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6244151bf0 0x7f62440c3360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62440c6220 0x7f62441ed330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f62240668d0 0x7f6224068d90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 --2- 172.21.15.26:0/2352369548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62440c13a0 0x7f6244157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 >> 172.21.15.26:0/2352369548 conn(0x7f624406a5a0 msgr2=0x7f62441507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 shutdown_connections 2023-11-28T16:56:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:28.963+0000 7f6248c09640 1 -- 172.21.15.26:0/2352369548 wait complete. 2023-11-28T16:56:28.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379fe09640 1 Processor -- start 2023-11-28T16:56:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379fe09640 1 -- start start 2023-11-28T16:56:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379fe09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f379806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379fe09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379806de00 con 0x7f37980c0370 2023-11-28T16:56:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379fe09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3798070390 con 0x7f379814eaf0 2023-11-28T16:56:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379fe09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379814eed0 con 0x7f37980a8470 2023-11-28T16:56:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379d3a4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37980c0370 0x7f379806d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44104/0 (socket says 172.21.15.26:44104) 2023-11-28T16:56:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379d3a4640 1 -- 172.21.15.26:0/3560218666 learned_addr learned my addr 172.21.15.26:0/3560218666 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379e3a6640 1 --2- 172.21.15.26:0/3560218666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f379806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.131+0000 7f379cba3640 1 -- 172.21.15.26:0/3560218666 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678878698 0 0) 0x7f379806de00 con 0x7f37980c0370 2023-11-28T16:56:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379cba3640 1 -- 172.21.15.26:0/3560218666 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3784003530 con 0x7f37980c0370 2023-11-28T16:56:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379cba3640 1 -- 172.21.15.26:0/3560218666 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004527189 0 0) 0x7f3798070390 con 0x7f379814eaf0 2023-11-28T16:56:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379cba3640 1 -- 172.21.15.26:0/3560218666 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f379806de00 con 0x7f379814eaf0 2023-11-28T16:56:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379e3a6640 1 -- 172.21.15.26:0/3560218666 >> v1:172.21.15.79:6789/0 conn(0x7f379814eaf0 legacy=0x7f3798151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379e3a6640 1 -- 172.21.15.26:0/3560218666 >> v1:172.21.15.26:6789/0 conn(0x7f37980c0370 legacy=0x7f379806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379e3a6640 1 -- 172.21.15.26:0/3560218666 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798151270 con 0x7f37980a8470 2023-11-28T16:56:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379e3a6640 1 --2- 172.21.15.26:0/3560218666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f379806d820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3790009dc0 tx=0x7f379001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a5d538aa0c33b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379cba3640 1 -- 172.21.15.26:0/3560218666 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900a5910 con 0x7f37980a8470 2023-11-28T16:56:29.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379cba3640 1 -- 172.21.15.26:0/3560218666 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37900a5a70 con 0x7f37980a8470 2023-11-28T16:56:29.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.135+0000 7f379cba3640 1 -- 172.21.15.26:0/3560218666 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900a5e00 con 0x7f37980a8470 2023-11-28T16:56:29.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- 172.21.15.26:0/3560218666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 msgr2=0x7f379806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 --2- 172.21.15.26:0/3560218666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f379806d820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3790009dc0 tx=0x7f379001c850 comp rx=0 tx=0).stop 2023-11-28T16:56:29.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- 172.21.15.26:0/3560218666 shutdown_connections 2023-11-28T16:56:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 --2- 172.21.15.26:0/3560218666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f379806d820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- 172.21.15.26:0/3560218666 >> 172.21.15.26:0/3560218666 conn(0x7f37980c2a60 msgr2=0x7f37980c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- 172.21.15.26:0/3560218666 shutdown_connections 2023-11-28T16:56:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- 172.21.15.26:0/3560218666 wait complete. 2023-11-28T16:56:29.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 Processor -- start 2023-11-28T16:56:29.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- start start 2023-11-28T16:56:29.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f37980aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37980c0370 0x7f37981437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379814eaf0 0x7f3798143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37980aa980 con 0x7f379814eaf0 2023-11-28T16:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37980aa080 con 0x7f37980c0370 2023-11-28T16:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379fe09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37980a9d50 con 0x7f37980a8470 2023-11-28T16:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379814eaf0 0x7f3798143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379814eaf0 0x7f3798143d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53588/0 (socket says 172.21.15.26:53588) 2023-11-28T16:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 -- 172.21.15.26:0/4071721009 learned_addr learned my addr 172.21.15.26:0/4071721009 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379d3a4640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37980c0370 0x7f37981437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379dba5640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f37980aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 -- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 msgr2=0x7f37980aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f37980aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 -- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37980c0370 msgr2=0x7f37981437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37980c0370 0x7f37981437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 -- 172.21.15.26:0/4071721009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790009a70 con 0x7f379814eaf0 2023-11-28T16:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379d3a4640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37980c0370 0x7f37981437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.139+0000 7f379e3a6640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379814eaf0 0x7f3798143d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f37900b0040 tx=0x7f37900195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f378e7fc640 1 -- 172.21.15.26:0/4071721009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900ad850 con 0x7f379814eaf0 2023-11-28T16:56:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f378e7fc640 1 -- 172.21.15.26:0/4071721009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37900ad9b0 con 0x7f379814eaf0 2023-11-28T16:56:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f378e7fc640 1 -- 172.21.15.26:0/4071721009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900add40 con 0x7f379814eaf0 2023-11-28T16:56:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37980c2270 con 0x7f379814eaf0 2023-11-28T16:56:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3798144260 con 0x7f379814eaf0 2023-11-28T16:56:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379804e890 con 0x7f379814eaf0 2023-11-28T16:56:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f378e7fc640 1 -- 172.21.15.26:0/4071721009 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f37900b4050 con 0x7f379814eaf0 2023-11-28T16:56:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f378e7fc640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f377c066900 0x7f377c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f378e7fc640 1 -- 172.21.15.26:0/4071721009 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f379011f320 con 0x7f379814eaf0 2023-11-28T16:56:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.143+0000 7f379dba5640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f377c066900 0x7f377c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.147+0000 7f379dba5640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f377c066900 0x7f377c068dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37940011f0 tx=0x7f3794009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.147+0000 7f378e7fc640 1 -- 172.21.15.26:0/4071721009 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37900ec550 con 0x7f379814eaf0 2023-11-28T16:56:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.303+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37980aa1c0 con 0x7f379814eaf0 2023-11-28T16:56:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.303+0000 7f378e7fc640 1 -- 172.21.15.26:0/4071721009 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37900b2020 con 0x7f379814eaf0 2023-11-28T16:56:29.308 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.303+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f377c066900 msgr2=0x7f377c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.303+0000 7f379fe09640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f377c066900 0x7f377c068dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37940011f0 tx=0x7f3794009040 comp rx=0 tx=0).stop 2023-11-28T16:56:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.303+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379814eaf0 msgr2=0x7f3798143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.303+0000 7f379fe09640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379814eaf0 0x7f3798143d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f37900b0040 tx=0x7f37900195f0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 shutdown_connections 2023-11-28T16:56:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379814eaf0 0x7f3798143d20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37980c0370 0x7f37981437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f377c066900 0x7f377c068dc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 --2- 172.21.15.26:0/4071721009 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37980a8470 0x7f37980aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 >> 172.21.15.26:0/4071721009 conn(0x7f37980c2a60 msgr2=0x7f3798144cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 shutdown_connections 2023-11-28T16:56:29.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.307+0000 7f379fe09640 1 -- 172.21.15.26:0/4071721009 wait complete. 2023-11-28T16:56:29.330 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b8870f640 1 Processor -- start 2023-11-28T16:56:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b8870f640 1 -- start start 2023-11-28T16:56:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b8870f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2b800ca610 0x7f2b800c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b8870f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b8006cd90 0x7f2b800c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b8870f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b80155790 con 0x7f2b800bd720 2023-11-28T16:56:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b8870f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b800c4b00 con 0x7f2b8006cd90 2023-11-28T16:56:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b8870f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b800c4de0 con 0x7f2b800ca610 2023-11-28T16:56:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b86cac640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b8006cd90 0x7f2b800c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b86cac640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b8006cd90 0x7f2b800c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53602/0 (socket says 172.21.15.26:53602) 2023-11-28T16:56:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b86cac640 1 -- 172.21.15.26:0/386486025 learned_addr learned my addr 172.21.15.26:0/386486025 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b85caa640 1 --1- 172.21.15.26:0/386486025 >> v1:172.21.15.26:6789/0 conn(0x7f2b800bd720 0x7f2b80158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44114/0 (socket says 172.21.15.26:44114) 2023-11-28T16:56:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b864ab640 1 --2- 172.21.15.26:0/386486025 >> v2:172.21.15.79:3300/0 conn(0x7f2b800ca610 0x7f2b800c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b86cac640 1 -- 172.21.15.26:0/386486025 >> v2:172.21.15.79:3300/0 conn(0x7f2b800ca610 msgr2=0x7f2b800c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b86cac640 1 --2- 172.21.15.26:0/386486025 >> v2:172.21.15.79:3300/0 conn(0x7f2b800ca610 0x7f2b800c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b86cac640 1 -- 172.21.15.26:0/386486025 >> v1:172.21.15.26:6789/0 conn(0x7f2b800bd720 legacy=0x7f2b80158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.471+0000 7f2b86cac640 1 -- 172.21.15.26:0/386486025 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80157e30 con 0x7f2b8006cd90 2023-11-28T16:56:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b86cac640 1 --2- 172.21.15.26:0/386486025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b800c9a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b800acc80 tx=0x7f2b7801c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fcc3ce5d4452f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b854a9640 1 -- 172.21.15.26:0/386486025 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800c52d0 con 0x7f2b8006cd90 2023-11-28T16:56:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b854a9640 1 -- 172.21.15.26:0/386486025 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b780090d0 con 0x7f2b8006cd90 2023-11-28T16:56:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b854a9640 1 -- 172.21.15.26:0/386486025 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780ac610 con 0x7f2b8006cd90 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 -- 172.21.15.26:0/386486025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 msgr2=0x7f2b800c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 --2- 172.21.15.26:0/386486025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b800c9a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b800acc80 tx=0x7f2b7801c590 comp rx=0 tx=0).stop 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 -- 172.21.15.26:0/386486025 shutdown_connections 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 --2- 172.21.15.26:0/386486025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b800c9a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 --2- 172.21.15.26:0/386486025 >> v2:172.21.15.79:3300/0 conn(0x7f2b800ca610 0x7f2b800c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 -- 172.21.15.26:0/386486025 >> 172.21.15.26:0/386486025 conn(0x7f2b80071ea0 msgr2=0x7f2b800722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 -- 172.21.15.26:0/386486025 shutdown_connections 2023-11-28T16:56:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 -- 172.21.15.26:0/386486025 wait complete. 2023-11-28T16:56:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.475+0000 7f2b8870f640 1 Processor -- start 2023-11-28T16:56:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 -- start start 2023-11-28T16:56:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b80157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b800bd720 0x7f2b801520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b800ca610 0x7f2b80149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800aa8d0 con 0x7f2b8006cd90 2023-11-28T16:56:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800aa440 con 0x7f2b800bd720 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80157b50 con 0x7f2b800ca610 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b80157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b80157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53604/0 (socket says 172.21.15.26:53604) 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 -- 172.21.15.26:0/3529506991 learned_addr learned my addr 172.21.15.26:0/3529506991 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b85caa640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b800bd720 0x7f2b801520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b86cac640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b800ca610 0x7f2b80149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 -- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b800ca610 msgr2=0x7f2b80149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b800ca610 0x7f2b80149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 -- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b800bd720 msgr2=0x7f2b801520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b800bd720 0x7f2b801520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 -- 172.21.15.26:0/3529506991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78009b30 con 0x7f2b8006cd90 2023-11-28T16:56:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b864ab640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b80157500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00e870 tx=0x7f2b7c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b76ffd640 1 -- 172.21.15.26:0/3529506991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c009510 con 0x7f2b8006cd90 2023-11-28T16:56:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b76ffd640 1 -- 172.21.15.26:0/3529506991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c00eec0 con 0x7f2b8006cd90 2023-11-28T16:56:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b76ffd640 1 -- 172.21.15.26:0/3529506991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00cb40 con 0x7f2b8006cd90 2023-11-28T16:56:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b800a9b10 con 0x7f2b8006cd90 2023-11-28T16:56:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b800aa0d0 con 0x7f2b8006cd90 2023-11-28T16:56:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.479+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8004e890 con 0x7f2b8006cd90 2023-11-28T16:56:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.483+0000 7f2b76ffd640 1 -- 172.21.15.26:0/3529506991 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2b7c00cca0 con 0x7f2b8006cd90 2023-11-28T16:56:29.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.483+0000 7f2b76ffd640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b640668d0 0x7f2b64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.483+0000 7f2b76ffd640 1 -- 172.21.15.26:0/3529506991 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b7c084580 con 0x7f2b8006cd90 2023-11-28T16:56:29.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.483+0000 7f2b85caa640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b640668d0 0x7f2b64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.483+0000 7f2b85caa640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b640668d0 0x7f2b64068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b80158740 tx=0x7f2b70007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.487+0000 7f2b76ffd640 1 -- 172.21.15.26:0/3529506991 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b7c0517b0 con 0x7f2b8006cd90 2023-11-28T16:56:29.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.675+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b8006cb70 con 0x7f2b8006cd90 2023-11-28T16:56:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b76ffd640 1 -- 172.21.15.26:0/3529506991 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f2b7c054dd0 con 0x7f2b8006cd90 2023-11-28T16:56:29.682 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:29.682 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:29.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b640668d0 msgr2=0x7f2b64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b640668d0 0x7f2b64068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b80158740 tx=0x7f2b70007c90 comp rx=0 tx=0).stop 2023-11-28T16:56:29.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 msgr2=0x7f2b80157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b80157500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00e870 tx=0x7f2b7c00ec70 comp rx=0 tx=0).stop 2023-11-28T16:56:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 shutdown_connections 2023-11-28T16:56:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b640668d0 0x7f2b64068d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b800ca610 0x7f2b80149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b800bd720 0x7f2b801520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 --2- 172.21.15.26:0/3529506991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b8006cd90 0x7f2b80157500 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 >> 172.21.15.26:0/3529506991 conn(0x7f2b80071ea0 msgr2=0x7f2b80072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 shutdown_connections 2023-11-28T16:56:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.679+0000 7f2b8870f640 1 -- 172.21.15.26:0/3529506991 wait complete. 2023-11-28T16:56:29.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:29.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4059db8640 1 Processor -- start 2023-11-28T16:56:29.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4059db8640 1 -- start start 2023-11-28T16:56:29.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4059db8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f405414e9d0 0x7f4054151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4059db8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40540a8470 0x7f405406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4059db8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405406d320 con 0x7f4054070b80 2023-11-28T16:56:29.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4059db8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540721b0 con 0x7f40540a8470 2023-11-28T16:56:29.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4059db8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40540c2830 con 0x7f405414e9d0 2023-11-28T16:56:29.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f4053fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40540a8470 0x7f405406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f40537fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f405414e9d0 0x7f4054151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f40537fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f405414e9d0 0x7f4054151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:44558/0 (socket says 172.21.15.26:44558) 2023-11-28T16:56:29.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.843+0000 7f40537fe640 1 -- 172.21.15.26:0/1527850182 learned_addr learned my addr 172.21.15.26:0/1527850182 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:29.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f40537fe640 1 -- 172.21.15.26:0/1527850182 >> v2:172.21.15.79:3300/0 conn(0x7f40540a8470 msgr2=0x7f405406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:29.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f40537fe640 1 --2- 172.21.15.26:0/1527850182 >> v2:172.21.15.79:3300/0 conn(0x7f40540a8470 0x7f405406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f40537fe640 1 -- 172.21.15.26:0/1527850182 >> v1:172.21.15.79:6789/0 conn(0x7f4054070b80 legacy=0x7f40540c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f40537fe640 1 -- 172.21.15.26:0/1527850182 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054072450 con 0x7f405414e9d0 2023-11-28T16:56:29.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f4053fff640 1 --2- 172.21.15.26:0/1527850182 >> v2:172.21.15.79:3300/0 conn(0x7f40540a8470 0x7f405406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f40537fe640 1 --2- 172.21.15.26:0/1527850182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f405414e9d0 0x7f4054151e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f404400bb10 tx=0x7f404401eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2526657f63405aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f4052ffd640 1 -- 172.21.15.26:0/1527850182 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440a7a60 con 0x7f405414e9d0 2023-11-28T16:56:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f4052ffd640 1 -- 172.21.15.26:0/1527850182 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40440a7bc0 con 0x7f405414e9d0 2023-11-28T16:56:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.847+0000 7f4052ffd640 1 -- 172.21.15.26:0/1527850182 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440af440 con 0x7f405414e9d0 2023-11-28T16:56:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- 172.21.15.26:0/1527850182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f405414e9d0 msgr2=0x7f4054151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 --2- 172.21.15.26:0/1527850182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f405414e9d0 0x7f4054151e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f404400bb10 tx=0x7f404401eb80 comp rx=0 tx=0).stop 2023-11-28T16:56:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- 172.21.15.26:0/1527850182 shutdown_connections 2023-11-28T16:56:29.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 --2- 172.21.15.26:0/1527850182 >> v2:172.21.15.79:3300/0 conn(0x7f40540a8470 0x7f405406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 --2- 172.21.15.26:0/1527850182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f405414e9d0 0x7f4054151e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- 172.21.15.26:0/1527850182 >> 172.21.15.26:0/1527850182 conn(0x7f40540c2ad0 msgr2=0x7f40540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:29.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- 172.21.15.26:0/1527850182 shutdown_connections 2023-11-28T16:56:29.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- 172.21.15.26:0/1527850182 wait complete. 2023-11-28T16:56:29.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 Processor -- start 2023-11-28T16:56:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- start start 2023-11-28T16:56:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4054070b80 0x7f40540c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40540a8470 0x7f4054143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414e9d0 0x7f40541438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054143e10 con 0x7f405414e9d0 2023-11-28T16:56:29.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540a9f00 con 0x7f4054070b80 2023-11-28T16:56:29.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4059db8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4054151de0 con 0x7f40540a8470 2023-11-28T16:56:29.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414e9d0 0x7f40541438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414e9d0 0x7f40541438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53618/0 (socket says 172.21.15.26:53618) 2023-11-28T16:56:29.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 -- 172.21.15.26:0/3274138421 learned_addr learned my addr 172.21.15.26:0/3274138421 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:29.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f40537fe640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4054070b80 0x7f40540c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f404bfff640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40540a8470 0x7f4054143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 -- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40540a8470 msgr2=0x7f4054143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40540a8470 0x7f4054143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 -- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4054070b80 msgr2=0x7f40540c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:29.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4054070b80 0x7f40540c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:29.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f4053fff640 1 -- 172.21.15.26:0/3274138421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c009a70 con 0x7f405414e9d0 2023-11-28T16:56:29.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.851+0000 7f40537fe640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4054070b80 0x7f40540c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:29.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4053fff640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414e9d0 0x7f40541438d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f404c00ef90 tx=0x7f404c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4050ff9640 1 -- 172.21.15.26:0/3274138421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c009d70 con 0x7f405414e9d0 2023-11-28T16:56:29.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4050ff9640 1 -- 172.21.15.26:0/3274138421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c00f040 con 0x7f405414e9d0 2023-11-28T16:56:29.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4050ff9640 1 -- 172.21.15.26:0/3274138421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0146c0 con 0x7f405414e9d0 2023-11-28T16:56:29.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404400b770 con 0x7f405414e9d0 2023-11-28T16:56:29.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40540aa1a0 con 0x7f405414e9d0 2023-11-28T16:56:29.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40540aa390 con 0x7f405414e9d0 2023-11-28T16:56:29.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4050ff9640 1 -- 172.21.15.26:0/3274138421 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f404c014820 con 0x7f405414e9d0 2023-11-28T16:56:29.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4050ff9640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40340668d0 0x7f4034068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:29.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f4050ff9640 1 -- 172.21.15.26:0/3274138421 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f404c085280 con 0x7f405414e9d0 2023-11-28T16:56:29.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.855+0000 7f40537fe640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40340668d0 0x7f4034068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:29.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.859+0000 7f40537fe640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40340668d0 0x7f4034068d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40440b1000 tx=0x7f40440a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:29.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:29.859+0000 7f4050ff9640 1 -- 172.21.15.26:0/3274138421 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f404c052560 con 0x7f405414e9d0 2023-11-28T16:56:30.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.019+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f405404e890 con 0x7f405414e9d0 2023-11-28T16:56:30.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.019+0000 7f4050ff9640 1 -- 172.21.15.26:0/3274138421 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f404c055b80 con 0x7f405414e9d0 2023-11-28T16:56:30.024 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:30.024 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:30.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40340668d0 msgr2=0x7f4034068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40340668d0 0x7f4034068d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40440b1000 tx=0x7f40440a9070 comp rx=0 tx=0).stop 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414e9d0 msgr2=0x7f40541438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414e9d0 0x7f40541438d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f404c00ef90 tx=0x7f404c009f90 comp rx=0 tx=0).stop 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 shutdown_connections 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414e9d0 0x7f40541438d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40340668d0 0x7f4034068d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40540a8470 0x7f4054143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 --2- 172.21.15.26:0/3274138421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4054070b80 0x7f40540c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 >> 172.21.15.26:0/3274138421 conn(0x7f40540c2ad0 msgr2=0x7f40540bfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 shutdown_connections 2023-11-28T16:56:30.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.023+0000 7f4059db8640 1 -- 172.21.15.26:0/3274138421 wait complete. 2023-11-28T16:56:30.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:30.047 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8c6432640 1 Processor -- start 2023-11-28T16:56:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8c6432640 1 -- start start 2023-11-28T16:56:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8c6432640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8c006df30 0x7fe8c0154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8c6432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c0154540 0x7fe8c0070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8c6432640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c0154b90 con 0x7fe8c00700f0 2023-11-28T16:56:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8c6432640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c00a8710 con 0x7fe8c006df30 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8c6432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00c2080 con 0x7fe8c0154540 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.187+0000 7fe8bf7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8c006df30 0x7fe8c0154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8bf7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8c006df30 0x7fe8c0154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53620/0 (socket says 172.21.15.26:53620) 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8bf7fe640 1 -- 172.21.15.26:0/3535768073 learned_addr learned my addr 172.21.15.26:0/3535768073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8c49cf640 1 --2- 172.21.15.26:0/3535768073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c0154540 0x7fe8c0070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8bf7fe640 1 -- 172.21.15.26:0/3535768073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c0154540 msgr2=0x7fe8c0070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8bf7fe640 1 --2- 172.21.15.26:0/3535768073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c0154540 0x7fe8c0070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8bf7fe640 1 -- 172.21.15.26:0/3535768073 >> v1:172.21.15.79:6789/0 conn(0x7fe8c00700f0 legacy=0x7fe8c00c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8bf7fe640 1 -- 172.21.15.26:0/3535768073 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00abd70 con 0x7fe8c006df30 2023-11-28T16:56:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8bf7fe640 1 --2- 172.21.15.26:0/3535768073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c006df30 0x7fe8c0154000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009870 tx=0x7fe8b401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbcab3450282870 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8beffd640 1 -- 172.21.15.26:0/3535768073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40ab600 con 0x7fe8c006df30 2023-11-28T16:56:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8beffd640 1 -- 172.21.15.26:0/3535768073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b40a7050 con 0x7fe8c006df30 2023-11-28T16:56:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.191+0000 7fe8beffd640 1 -- 172.21.15.26:0/3535768073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40ab980 con 0x7fe8c006df30 2023-11-28T16:56:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- 172.21.15.26:0/3535768073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c006df30 msgr2=0x7fe8c0154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 --2- 172.21.15.26:0/3535768073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c006df30 0x7fe8c0154000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009870 tx=0x7fe8b401c420 comp rx=0 tx=0).stop 2023-11-28T16:56:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- 172.21.15.26:0/3535768073 shutdown_connections 2023-11-28T16:56:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 --2- 172.21.15.26:0/3535768073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c0154540 0x7fe8c0070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 --2- 172.21.15.26:0/3535768073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c006df30 0x7fe8c0154000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- 172.21.15.26:0/3535768073 >> 172.21.15.26:0/3535768073 conn(0x7fe8c00c2a60 msgr2=0x7fe8c00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- 172.21.15.26:0/3535768073 shutdown_connections 2023-11-28T16:56:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- 172.21.15.26:0/3535768073 wait complete. 2023-11-28T16:56:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 Processor -- start 2023-11-28T16:56:30.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- start start 2023-11-28T16:56:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c006df30 0x7fe8c0152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8c00700f0 0x7fe8c00c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c0154540 0x7fe8c014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c01edf40 con 0x7fe8c0154540 2023-11-28T16:56:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c01ecf20 con 0x7fe8c00700f0 2023-11-28T16:56:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c6432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c01ed1a0 con 0x7fe8c006df30 2023-11-28T16:56:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c49cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c0154540 0x7fe8c014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c49cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c0154540 0x7fe8c014ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53622/0 (socket says 172.21.15.26:53622) 2023-11-28T16:56:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c49cf640 1 -- 172.21.15.26:0/1587550476 learned_addr learned my addr 172.21.15.26:0/1587550476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8bf7fe640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8c00700f0 0x7fe8c00c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8bffff640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c006df30 0x7fe8c0152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c49cf640 1 -- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c006df30 msgr2=0x7fe8c0152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c49cf640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c006df30 0x7fe8c0152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c49cf640 1 -- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8c00700f0 msgr2=0x7fe8c00c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.195+0000 7fe8c49cf640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8c00700f0 0x7fe8c00c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8c49cf640 1 -- 172.21.15.26:0/1587550476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b40094d0 con 0x7fe8c0154540 2023-11-28T16:56:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8c49cf640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c0154540 0x7fe8c014ff10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800efc0 tx=0x7fe8b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8bcff9640 1 -- 172.21.15.26:0/1587550476 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8014480 con 0x7fe8c0154540 2023-11-28T16:56:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8bcff9640 1 -- 172.21.15.26:0/1587550476 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b800f040 con 0x7fe8c0154540 2023-11-28T16:56:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8bcff9640 1 -- 172.21.15.26:0/1587550476 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8014820 con 0x7fe8c0154540 2023-11-28T16:56:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c01ed480 con 0x7fe8c0154540 2023-11-28T16:56:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c01eda40 con 0x7fe8c0154540 2023-11-28T16:56:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c004e890 con 0x7fe8c0154540 2023-11-28T16:56:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8bcff9640 1 -- 172.21.15.26:0/1587550476 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe8b8014980 con 0x7fe8c0154540 2023-11-28T16:56:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8bcff9640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8ac0668d0 0x7fe8ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8bcff9640 1 -- 172.21.15.26:0/1587550476 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8b8084e80 con 0x7fe8c0154540 2023-11-28T16:56:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.199+0000 7fe8bffff640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8ac0668d0 0x7fe8ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.203+0000 7fe8bffff640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8ac0668d0 0x7fe8ac068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0007fd0 tx=0x7fe8b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.203+0000 7fe8bcff9640 1 -- 172.21.15.26:0/1587550476 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8b8052160 con 0x7fe8c0154540 2023-11-28T16:56:30.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8c00c25f0 con 0x7fe8c0154540 2023-11-28T16:56:30.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8bcff9640 1 -- 172.21.15.26:0/1587550476 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8b8018020 con 0x7fe8c0154540 2023-11-28T16:56:30.374 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8ac0668d0 msgr2=0x7fe8ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8ac0668d0 0x7fe8ac068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0007fd0 tx=0x7fe8b0009040 comp rx=0 tx=0).stop 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c0154540 msgr2=0x7fe8c014ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c0154540 0x7fe8c014ff10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800efc0 tx=0x7fe8b800c490 comp rx=0 tx=0).stop 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 shutdown_connections 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8c0154540 0x7fe8c014ff10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8c00700f0 0x7fe8c00c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8ac0668d0 0x7fe8ac068d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 --2- 172.21.15.26:0/1587550476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8c006df30 0x7fe8c0152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 >> 172.21.15.26:0/1587550476 conn(0x7fe8c00c2a60 msgr2=0x7fe8c00a9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:30.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 shutdown_connections 2023-11-28T16:56:30.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.371+0000 7fe8c6432640 1 -- 172.21.15.26:0/1587550476 wait complete. 2023-11-28T16:56:30.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:30.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1af3e6640 1 Processor -- start 2023-11-28T16:56:30.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1af3e6640 1 -- start start 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1af3e6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1a814fcf0 0x7ff1a81567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1af3e6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1a81500d0 0x7ff1a80c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1af3e6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a806f760 con 0x7ff1a80a7330 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1af3e6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a8156d10 con 0x7ff1a81500d0 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1af3e6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80adf90 con 0x7ff1a814fcf0 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ac981640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1a81500d0 0x7ff1a80c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ad983640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff1a80a7330 0x7ff1a80a9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44116/0 (socket says 172.21.15.26:44116) 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ac981640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1a81500d0 0x7ff1a80c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53624/0 (socket says 172.21.15.26:53624) 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ad983640 1 -- 172.21.15.26:0/656194381 learned_addr learned my addr 172.21.15.26:0/656194381 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ad182640 1 --2- 172.21.15.26:0/656194381 >> v2:172.21.15.79:3300/0 conn(0x7ff1a814fcf0 0x7ff1a81567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ac981640 1 -- 172.21.15.26:0/656194381 >> v2:172.21.15.79:3300/0 conn(0x7ff1a814fcf0 msgr2=0x7ff1a81567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ac981640 1 --2- 172.21.15.26:0/656194381 >> v2:172.21.15.79:3300/0 conn(0x7ff1a814fcf0 0x7ff1a81567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ac981640 1 -- 172.21.15.26:0/656194381 >> v1:172.21.15.26:6789/0 conn(0x7ff1a80a7330 legacy=0x7ff1a80a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.539+0000 7ff1ac981640 1 -- 172.21.15.26:0/656194381 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a806fc90 con 0x7ff1a81500d0 2023-11-28T16:56:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1ac981640 1 --2- 172.21.15.26:0/656194381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a80c3c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80aaca0 tx=0x7ff19801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f002ba34c7a685 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff19ffff640 1 -- 172.21.15.26:0/656194381 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980ad680 con 0x7ff1a81500d0 2023-11-28T16:56:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff19ffff640 1 -- 172.21.15.26:0/656194381 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1980ad7e0 con 0x7ff1a81500d0 2023-11-28T16:56:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff19ffff640 1 -- 172.21.15.26:0/656194381 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980adb70 con 0x7ff1a81500d0 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 -- 172.21.15.26:0/656194381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 msgr2=0x7ff1a80c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/656194381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a80c3c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80aaca0 tx=0x7ff19801c380 comp rx=0 tx=0).stop 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 -- 172.21.15.26:0/656194381 shutdown_connections 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/656194381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a80c3c50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/656194381 >> v2:172.21.15.79:3300/0 conn(0x7ff1a814fcf0 0x7ff1a81567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 -- 172.21.15.26:0/656194381 >> 172.21.15.26:0/656194381 conn(0x7ff1a806a5a0 msgr2=0x7ff1a806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 -- 172.21.15.26:0/656194381 shutdown_connections 2023-11-28T16:56:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 -- 172.21.15.26:0/656194381 wait complete. 2023-11-28T16:56:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.543+0000 7ff1af3e6640 1 Processor -- start 2023-11-28T16:56:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 -- start start 2023-11-28T16:56:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a80a7330 0x7ff1a8146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1a814fcf0 0x7ff1a81ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a81eed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81ef4e0 con 0x7ff1a81500d0 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8149400 con 0x7ff1a80a7330 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81ef240 con 0x7ff1a814fcf0 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a81eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a81eed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53626/0 (socket says 172.21.15.26:53626) 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 -- 172.21.15.26:0/1247739982 learned_addr learned my addr 172.21.15.26:0/1247739982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ac981640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1a814fcf0 0x7ff1a81ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad182640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a80a7330 0x7ff1a8146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 -- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1a814fcf0 msgr2=0x7ff1a81ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1a814fcf0 0x7ff1a81ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 -- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a80a7330 msgr2=0x7ff1a8146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a80a7330 0x7ff1a8146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 -- 172.21.15.26:0/1247739982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980093b0 con 0x7ff1a81500d0 2023-11-28T16:56:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1ad983640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a81eed00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000ca80 tx=0x7ff1a000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff19dffb640 1 -- 172.21.15.26:0/1247739982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a000ac30 con 0x7ff1a81500d0 2023-11-28T16:56:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff19dffb640 1 -- 172.21.15.26:0/1247739982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a000ad90 con 0x7ff1a81500d0 2023-11-28T16:56:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff19dffb640 1 -- 172.21.15.26:0/1247739982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0012600 con 0x7ff1a81500d0 2023-11-28T16:56:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a814fa70 con 0x7ff1a81500d0 2023-11-28T16:56:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a80c2550 con 0x7ff1a81500d0 2023-11-28T16:56:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.547+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a804e890 con 0x7ff1a81500d0 2023-11-28T16:56:30.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.551+0000 7ff19dffb640 1 -- 172.21.15.26:0/1247739982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff1a0007070 con 0x7ff1a81500d0 2023-11-28T16:56:30.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.551+0000 7ff19dffb640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff18c0668d0 0x7ff18c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.551+0000 7ff19dffb640 1 -- 172.21.15.26:0/1247739982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1a0084290 con 0x7ff1a81500d0 2023-11-28T16:56:30.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.551+0000 7ff1ad182640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff18c0668d0 0x7ff18c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.551+0000 7ff1ad182640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff18c0668d0 0x7ff18c068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8156600 tx=0x7ff1a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.555+0000 7ff19dffb640 1 -- 172.21.15.26:0/1247739982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1a00514e0 con 0x7ff1a81500d0 2023-11-28T16:56:30.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.711+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1a80ad070 con 0x7ff1a81500d0 2023-11-28T16:56:30.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.711+0000 7ff19dffb640 1 -- 172.21.15.26:0/1247739982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1a0054b00 con 0x7ff1a81500d0 2023-11-28T16:56:30.717 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:30.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff18c0668d0 msgr2=0x7ff18c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff18c0668d0 0x7ff18c068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8156600 tx=0x7ff1a4009190 comp rx=0 tx=0).stop 2023-11-28T16:56:30.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 msgr2=0x7ff1a81eed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a81eed00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000ca80 tx=0x7ff1a000cf40 comp rx=0 tx=0).stop 2023-11-28T16:56:30.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 shutdown_connections 2023-11-28T16:56:30.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a81500d0 0x7ff1a81eed00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff18c0668d0 0x7ff18c068d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1a814fcf0 0x7ff1a81ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 --2- 172.21.15.26:0/1247739982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a80a7330 0x7ff1a8146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 >> 172.21.15.26:0/1247739982 conn(0x7ff1a806a5a0 msgr2=0x7ff1a80c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:30.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 shutdown_connections 2023-11-28T16:56:30.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.715+0000 7ff1af3e6640 1 -- 172.21.15.26:0/1247739982 wait complete. 2023-11-28T16:56:30.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a2557640 1 Processor -- start 2023-11-28T16:56:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a2557640 1 -- start start 2023-11-28T16:56:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a2557640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa29c154000 0x7fa29c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a2557640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa29c06df30 0x7fa29c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a2557640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c154920 con 0x7fa29c0700f0 2023-11-28T16:56:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a2557640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0a8710 con 0x7fa29c154000 2023-11-28T16:56:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a2557640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c071be0 con 0x7fa29c06df30 2023-11-28T16:56:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa29c154000 0x7fa29c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa29c0700f0 0x7fa29c070f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44130/0 (socket says 172.21.15.26:44130) 2023-11-28T16:56:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29b7fe640 1 -- 172.21.15.26:0/1362553314 learned_addr learned my addr 172.21.15.26:0/1362553314 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa2a0af4640 1 --2- 172.21.15.26:0/1362553314 >> v2:172.21.15.79:3300/0 conn(0x7fa29c06df30 0x7fa29c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29bfff640 1 -- 172.21.15.26:0/1362553314 >> v2:172.21.15.79:3300/0 conn(0x7fa29c06df30 msgr2=0x7fa29c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29bfff640 1 --2- 172.21.15.26:0/1362553314 >> v2:172.21.15.79:3300/0 conn(0x7fa29c06df30 0x7fa29c0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29bfff640 1 -- 172.21.15.26:0/1362553314 >> v1:172.21.15.26:6789/0 conn(0x7fa29c0700f0 legacy=0x7fa29c070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29bfff640 1 -- 172.21.15.26:0/1362553314 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c154b90 con 0x7fa29c154000 2023-11-28T16:56:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.879+0000 7fa29affd640 1 -- 172.21.15.26:0/1362553314 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315382563 0 0) 0x7fa29c154920 con 0x7fa29c0700f0 2023-11-28T16:56:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa29bfff640 1 --2- 172.21.15.26:0/1362553314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c154000 0x7fa29c1543e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0728c0 tx=0x7fa28c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19556c2c090c245b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa29affd640 1 -- 172.21.15.26:0/1362553314 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0ab600 con 0x7fa29c154000 2023-11-28T16:56:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa29affd640 1 -- 172.21.15.26:0/1362553314 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c0a7050 con 0x7fa29c154000 2023-11-28T16:56:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa29affd640 1 -- 172.21.15.26:0/1362553314 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0ab980 con 0x7fa29c154000 2023-11-28T16:56:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 -- 172.21.15.26:0/1362553314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c154000 msgr2=0x7fa29c1543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 --2- 172.21.15.26:0/1362553314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c154000 0x7fa29c1543e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0728c0 tx=0x7fa28c01c340 comp rx=0 tx=0).stop 2023-11-28T16:56:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 -- 172.21.15.26:0/1362553314 shutdown_connections 2023-11-28T16:56:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 --2- 172.21.15.26:0/1362553314 >> v2:172.21.15.79:3300/0 conn(0x7fa29c06df30 0x7fa29c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 --2- 172.21.15.26:0/1362553314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c154000 0x7fa29c1543e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 -- 172.21.15.26:0/1362553314 >> 172.21.15.26:0/1362553314 conn(0x7fa29c0c2a60 msgr2=0x7fa29c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 -- 172.21.15.26:0/1362553314 shutdown_connections 2023-11-28T16:56:30.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.883+0000 7fa2a2557640 1 -- 172.21.15.26:0/1362553314 wait complete. 2023-11-28T16:56:30.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 Processor -- start 2023-11-28T16:56:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 -- start start 2023-11-28T16:56:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa29c06df30 0x7fa29c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0700f0 0x7fa29c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa29c154000 0x7fa29c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0c41f0 con 0x7fa29c0700f0 2023-11-28T16:56:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c147810 con 0x7fa29c06df30 2023-11-28T16:56:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c147af0 con 0x7fa29c154000 2023-11-28T16:56:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0700f0 0x7fa29c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0700f0 0x7fa29c150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53646/0 (socket says 172.21.15.26:53646) 2023-11-28T16:56:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 -- 172.21.15.26:0/423495153 learned_addr learned my addr 172.21.15.26:0/423495153 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29bfff640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa29c06df30 0x7fa29c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a0af4640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa29c154000 0x7fa29c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 -- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa29c154000 msgr2=0x7fa29c1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa29c154000 0x7fa29c1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 -- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa29c06df30 msgr2=0x7fa29c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:30.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa29c06df30 0x7fa29c0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:30.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 -- 172.21.15.26:0/423495153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009420 con 0x7fa29c0700f0 2023-11-28T16:56:30.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa29b7fe640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0700f0 0x7fa29c150480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa29000c450 tx=0x7fa29000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa298ff9640 1 -- 172.21.15.26:0/423495153 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900074e0 con 0x7fa29c0700f0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa298ff9640 1 -- 172.21.15.26:0/423495153 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290007640 con 0x7fa29c0700f0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa298ff9640 1 -- 172.21.15.26:0/423495153 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900049f0 con 0x7fa29c0700f0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c1f4cd0 con 0x7fa29c0700f0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.887+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c153af0 con 0x7fa29c0700f0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.891+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c04e890 con 0x7fa29c0700f0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.891+0000 7fa298ff9640 1 -- 172.21.15.26:0/423495153 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa290004b50 con 0x7fa29c0700f0 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.891+0000 7fa298ff9640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa288066900 0x7fa288068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.891+0000 7fa298ff9640 1 -- 172.21.15.26:0/423495153 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa290083640 con 0x7fa29c0700f0 2023-11-28T16:56:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.891+0000 7fa29bfff640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa288066900 0x7fa288068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.891+0000 7fa29bfff640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa288066900 0x7fa288068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0ad000 tx=0x7fa28c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:30.895+0000 7fa298ff9640 1 -- 172.21.15.26:0/423495153 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa290054300 con 0x7fa29c0700f0 2023-11-28T16:56:31.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.051+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa29c071780 con 0x7fa29c0700f0 2023-11-28T16:56:31.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.051+0000 7fa298ff9640 1 -- 172.21.15.26:0/423495153 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2900180a0 con 0x7fa29c0700f0 2023-11-28T16:56:31.057 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa288066900 msgr2=0x7fa288068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa288066900 0x7fa288068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0ad000 tx=0x7fa28c0a6000 comp rx=0 tx=0).stop 2023-11-28T16:56:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0700f0 msgr2=0x7fa29c150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0700f0 0x7fa29c150480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa29000c450 tx=0x7fa29000c910 comp rx=0 tx=0).stop 2023-11-28T16:56:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 shutdown_connections 2023-11-28T16:56:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa288066900 0x7fa288068dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa29c154000 0x7fa29c1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa29c0700f0 0x7fa29c150480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 --2- 172.21.15.26:0/423495153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa29c06df30 0x7fa29c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 >> 172.21.15.26:0/423495153 conn(0x7fa29c0c2a60 msgr2=0x7fa29c0a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 shutdown_connections 2023-11-28T16:56:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.055+0000 7fa2a2557640 1 -- 172.21.15.26:0/423495153 wait complete. 2023-11-28T16:56:31.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767d19d640 1 Processor -- start 2023-11-28T16:56:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767d19d640 1 -- start start 2023-11-28T16:56:31.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767d19d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76780ca610 0x7f76780c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767d19d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76780c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767d19d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7678155790 con 0x7f76780bd720 2023-11-28T16:56:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767d19d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76780c4b00 con 0x7f76780ca610 2023-11-28T16:56:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767d19d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780c4de0 con 0x7f767806cd90 2023-11-28T16:56:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f7676d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76780ca610 0x7f76780c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f766ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f76780bd720 0x7f7678158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44144/0 (socket says 172.21.15.26:44144) 2023-11-28T16:56:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f766ffff640 1 -- 172.21.15.26:0/4139852209 learned_addr learned my addr 172.21.15.26:0/4139852209 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f767759e640 1 --2- 172.21.15.26:0/4139852209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76780c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f7676d9d640 1 -- 172.21.15.26:0/4139852209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 msgr2=0x7f76780c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f7676d9d640 1 --2- 172.21.15.26:0/4139852209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76780c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f7676d9d640 1 -- 172.21.15.26:0/4139852209 >> v1:172.21.15.26:6789/0 conn(0x7f76780bd720 legacy=0x7f7678158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.219+0000 7f7676d9d640 1 -- 172.21.15.26:0/4139852209 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678157e30 con 0x7f76780ca610 2023-11-28T16:56:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f7676d9d640 1 --2- 172.21.15.26:0/4139852209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76780c94c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f76680097c0 tx=0x7f766801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333e4a47b2f37 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767659c640 1 -- 172.21.15.26:0/4139852209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780c52d0 con 0x7f76780ca610 2023-11-28T16:56:31.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767659c640 1 -- 172.21.15.26:0/4139852209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76680a4880 con 0x7f76780ca610 2023-11-28T16:56:31.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767659c640 1 -- 172.21.15.26:0/4139852209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680a4c10 con 0x7f76780ca610 2023-11-28T16:56:31.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 -- 172.21.15.26:0/4139852209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 msgr2=0x7f76780c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 --2- 172.21.15.26:0/4139852209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76780c94c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f76680097c0 tx=0x7f766801c040 comp rx=0 tx=0).stop 2023-11-28T16:56:31.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 -- 172.21.15.26:0/4139852209 shutdown_connections 2023-11-28T16:56:31.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 --2- 172.21.15.26:0/4139852209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76780c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 --2- 172.21.15.26:0/4139852209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76780c94c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 -- 172.21.15.26:0/4139852209 >> 172.21.15.26:0/4139852209 conn(0x7f7678071ea0 msgr2=0x7f76780722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:31.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 -- 172.21.15.26:0/4139852209 shutdown_connections 2023-11-28T16:56:31.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.223+0000 7f767d19d640 1 -- 172.21.15.26:0/4139852209 wait complete. 2023-11-28T16:56:31.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 Processor -- start 2023-11-28T16:56:31.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 -- start start 2023-11-28T16:56:31.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76781f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780bd720 0x7f7678152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76781ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781ede00 con 0x7f76780ca610 2023-11-28T16:56:31.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780bdcc0 con 0x7f76780bd720 2023-11-28T16:56:31.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780bdfa0 con 0x7f767806cd90 2023-11-28T16:56:31.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76781ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76781ee5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53670/0 (socket says 172.21.15.26:53670) 2023-11-28T16:56:31.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 -- 172.21.15.26:0/764340591 learned_addr learned my addr 172.21.15.26:0/764340591 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f7676d9d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76781f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f766ffff640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780bd720 0x7f7678152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 -- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 msgr2=0x7f76781f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76781f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 -- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780bd720 msgr2=0x7f7678152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780bd720 0x7f7678152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 -- 172.21.15.26:0/764340591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7668009420 con 0x7f76780ca610 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f766ffff640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780bd720 0x7f7678152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767759e640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76781ee5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7670007e40 tx=0x7f767000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f766f7fe640 1 -- 172.21.15.26:0/764340591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670014620 con 0x7f76780ca610 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f766f7fe640 1 -- 172.21.15.26:0/764340591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767000ee90 con 0x7f76780ca610 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f766f7fe640 1 -- 172.21.15.26:0/764340591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700149e0 con 0x7f76780ca610 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76781ee0c0 con 0x7f76780ca610 2023-11-28T16:56:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76780c0900 con 0x7f76780ca610 2023-11-28T16:56:31.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.227+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76780be1c0 con 0x7f76780ca610 2023-11-28T16:56:31.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.231+0000 7f766f7fe640 1 -- 172.21.15.26:0/764340591 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7670014b40 con 0x7f76780ca610 2023-11-28T16:56:31.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.231+0000 7f766f7fe640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76580668d0 0x7f7658068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.231+0000 7f766f7fe640 1 -- 172.21.15.26:0/764340591 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7670084df0 con 0x7f76780ca610 2023-11-28T16:56:31.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.231+0000 7f7676d9d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76580668d0 0x7f7658068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.231+0000 7f7676d9d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76580668d0 0x7f7658068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f76680ae000 tx=0x7f7668008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.235+0000 7f766f7fe640 1 -- 172.21.15.26:0/764340591 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7670051fa0 con 0x7f76780ca610 2023-11-28T16:56:31.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.423+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76781ee2b0 con 0x7f76780ca610 2023-11-28T16:56:31.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.423+0000 7f766f7fe640 1 -- 172.21.15.26:0/764340591 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f76700555c0 con 0x7f76780ca610 2023-11-28T16:56:31.428 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:31.429 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:31.429 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:31.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76580668d0 msgr2=0x7f7658068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76580668d0 0x7f7658068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f76680ae000 tx=0x7f7668008040 comp rx=0 tx=0).stop 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 msgr2=0x7f76781ee5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76781ee5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7670007e40 tx=0x7f767000e4b0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 shutdown_connections 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76780ca610 0x7f76781ee5e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780bd720 0x7f7678152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76580668d0 0x7f7658068d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 --2- 172.21.15.26:0/764340591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f767806cd90 0x7f76781f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 >> 172.21.15.26:0/764340591 conn(0x7f7678071ea0 msgr2=0x7f7678157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 shutdown_connections 2023-11-28T16:56:31.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.427+0000 7f767d19d640 1 -- 172.21.15.26:0/764340591 wait complete. 2023-11-28T16:56:31.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.587+0000 7f2427ae3640 1 Processor -- start 2023-11-28T16:56:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.587+0000 7f2427ae3640 1 -- start start 2023-11-28T16:56:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f2427ae3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f242014fcc0 0x7f2420156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f2427ae3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f24200aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f2427ae3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2420152fe0 con 0x7f24200ab3b0 2023-11-28T16:56:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f2427ae3640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200aa340 con 0x7f242014fcc0 2023-11-28T16:56:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f2427ae3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24201532c0 con 0x7f242006d980 2023-11-28T16:56:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242587f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f242014fcc0 0x7f2420156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242587f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f242014fcc0 0x7f2420156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51200/0 (socket says 172.21.15.26:51200) 2023-11-28T16:56:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242587f640 1 -- 172.21.15.26:0/283310334 learned_addr learned my addr 172.21.15.26:0/283310334 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242507e640 1 --2- 172.21.15.26:0/283310334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f24200aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242587f640 1 -- 172.21.15.26:0/283310334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 msgr2=0x7f24200aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242587f640 1 --2- 172.21.15.26:0/283310334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f24200aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242587f640 1 -- 172.21.15.26:0/283310334 >> v1:172.21.15.26:6789/0 conn(0x7f24200ab3b0 legacy=0x7f24200c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242587f640 1 -- 172.21.15.26:0/283310334 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420155a20 con 0x7f242014fcc0 2023-11-28T16:56:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.591+0000 7f242487d640 1 -- 172.21.15.26:0/283310334 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080652109 0 0) 0x7f2420152fe0 con 0x7f24200ab3b0 2023-11-28T16:56:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f242587f640 1 --2- 172.21.15.26:0/283310334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242014fcc0 0x7f2420156500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d423b16a161df0bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f242487d640 1 -- 172.21.15.26:0/283310334 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0aa670 con 0x7f242014fcc0 2023-11-28T16:56:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f242487d640 1 -- 172.21.15.26:0/283310334 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c0aa7d0 con 0x7f242014fcc0 2023-11-28T16:56:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f242487d640 1 -- 172.21.15.26:0/283310334 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0aab60 con 0x7f242014fcc0 2023-11-28T16:56:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- 172.21.15.26:0/283310334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242014fcc0 msgr2=0x7f2420156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 --2- 172.21.15.26:0/283310334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242014fcc0 0x7f2420156500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c01c510 comp rx=0 tx=0).stop 2023-11-28T16:56:31.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- 172.21.15.26:0/283310334 shutdown_connections 2023-11-28T16:56:31.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 --2- 172.21.15.26:0/283310334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f24200aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 --2- 172.21.15.26:0/283310334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242014fcc0 0x7f2420156500 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- 172.21.15.26:0/283310334 >> 172.21.15.26:0/283310334 conn(0x7f24200c2ad0 msgr2=0x7f24200c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:31.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- 172.21.15.26:0/283310334 shutdown_connections 2023-11-28T16:56:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- 172.21.15.26:0/283310334 wait complete. 2023-11-28T16:56:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 Processor -- start 2023-11-28T16:56:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- start start 2023-11-28T16:56:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f242015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24200ab3b0 0x7f2420070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f242014ccf0 0x7f2420070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420072170 con 0x7f24200ab3b0 2023-11-28T16:56:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200714d0 con 0x7f242014ccf0 2023-11-28T16:56:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.595+0000 7f2427ae3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242014caa0 con 0x7f242006d980 2023-11-28T16:56:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24200ab3b0 0x7f2420070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24200ab3b0 0x7f2420070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51212/0 (socket says 172.21.15.26:51212) 2023-11-28T16:56:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 -- 172.21.15.26:0/4110316395 learned_addr learned my addr 172.21.15.26:0/4110316395 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242587f640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f242015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f2426080640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f242014ccf0 0x7f2420070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 -- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 msgr2=0x7f242015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f242015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 -- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f242014ccf0 msgr2=0x7f2420070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f242014ccf0 0x7f2420070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 -- 172.21.15.26:0/4110316395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0094d0 con 0x7f24200ab3b0 2023-11-28T16:56:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f242507e640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24200ab3b0 0x7f2420070a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f241000d800 tx=0x7f241000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f24167fc640 1 -- 172.21.15.26:0/4110316395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000b6c0 con 0x7f24200ab3b0 2023-11-28T16:56:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f24167fc640 1 -- 172.21.15.26:0/4110316395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241000b820 con 0x7f24200ab3b0 2023-11-28T16:56:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242014c7c0 con 0x7f24200ab3b0 2023-11-28T16:56:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f24167fc640 1 -- 172.21.15.26:0/4110316395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000bb90 con 0x7f24200ab3b0 2023-11-28T16:56:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24201f07f0 con 0x7f24200ab3b0 2023-11-28T16:56:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242004e890 con 0x7f24200ab3b0 2023-11-28T16:56:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f24167fc640 1 -- 172.21.15.26:0/4110316395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f241000bcf0 con 0x7f24200ab3b0 2023-11-28T16:56:31.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.599+0000 7f24167fc640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24040668d0 0x7f2404068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.603+0000 7f24167fc640 1 -- 172.21.15.26:0/4110316395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2410084900 con 0x7f24200ab3b0 2023-11-28T16:56:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.603+0000 7f242587f640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24040668d0 0x7f2404068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.603+0000 7f242587f640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24040668d0 0x7f2404068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f241c0ae000 tx=0x7f241c0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.603+0000 7f24167fc640 1 -- 172.21.15.26:0/4110316395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2410051b30 con 0x7f24200ab3b0 2023-11-28T16:56:31.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24200c06b0 con 0x7f24200ab3b0 2023-11-28T16:56:31.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f24167fc640 1 -- 172.21.15.26:0/4110316395 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f2410055150 con 0x7f24200ab3b0 2023-11-28T16:56:31.768 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:31.769 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:31.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24040668d0 msgr2=0x7f2404068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24040668d0 0x7f2404068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f241c0ae000 tx=0x7f241c0b5040 comp rx=0 tx=0).stop 2023-11-28T16:56:31.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24200ab3b0 msgr2=0x7f2420070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24200ab3b0 0x7f2420070a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f241000d800 tx=0x7f241000dcc0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 shutdown_connections 2023-11-28T16:56:31.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f242014ccf0 0x7f2420070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24200ab3b0 0x7f2420070a50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24040668d0 0x7f2404068d90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 --2- 172.21.15.26:0/4110316395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f242006d980 0x7f242015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 >> 172.21.15.26:0/4110316395 conn(0x7f24200c2ad0 msgr2=0x7f242006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:31.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.763+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 shutdown_connections 2023-11-28T16:56:31.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.767+0000 7f2427ae3640 1 -- 172.21.15.26:0/4110316395 wait complete. 2023-11-28T16:56:31.789 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c3b96640 1 Processor -- start 2023-11-28T16:56:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c3b96640 1 -- start start 2023-11-28T16:56:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c3b96640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05bc14fcc0 0x7f05bc156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c3b96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05bc0c19e0 0x7f05bc0c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c3b96640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc0ab580 con 0x7f05bc06d980 2023-11-28T16:56:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c3b96640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc0aa340 con 0x7f05bc14fcc0 2023-11-28T16:56:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c3b96640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc152fe0 con 0x7f05bc0c19e0 2023-11-28T16:56:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c1932640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05bc14fcc0 0x7f05bc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c1932640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05bc14fcc0 0x7f05bc156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51218/0 (socket says 172.21.15.26:51218) 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c1932640 1 -- 172.21.15.26:0/2425934132 learned_addr learned my addr 172.21.15.26:0/2425934132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.927+0000 7f05c1131640 1 --1- 172.21.15.26:0/2425934132 >> v1:172.21.15.26:6789/0 conn(0x7f05bc06d980 0x7f05bc0aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60336/0 (socket says 172.21.15.26:60336) 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c2133640 1 --2- 172.21.15.26:0/2425934132 >> v2:172.21.15.79:3300/0 conn(0x7f05bc0c19e0 0x7f05bc0c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c1932640 1 -- 172.21.15.26:0/2425934132 >> v2:172.21.15.79:3300/0 conn(0x7f05bc0c19e0 msgr2=0x7f05bc0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c1932640 1 --2- 172.21.15.26:0/2425934132 >> v2:172.21.15.79:3300/0 conn(0x7f05bc0c19e0 0x7f05bc0c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c1932640 1 -- 172.21.15.26:0/2425934132 >> v1:172.21.15.26:6789/0 conn(0x7f05bc06d980 legacy=0x7f05bc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c1932640 1 -- 172.21.15.26:0/2425934132 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc1532c0 con 0x7f05bc14fcc0 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c2133640 1 --2- 172.21.15.26:0/2425934132 >> v2:172.21.15.79:3300/0 conn(0x7f05bc0c19e0 0x7f05bc0c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c0930640 1 -- 172.21.15.26:0/2425934132 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131225082 0 0) 0x7f05bc0ab580 con 0x7f05bc06d980 2023-11-28T16:56:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c1932640 1 --2- 172.21.15.26:0/2425934132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc14fcc0 0x7f05bc156500 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0c3b30 tx=0x7f05b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2e455c72df12db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c0930640 1 -- 172.21.15.26:0/2425934132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80ac640 con 0x7f05bc14fcc0 2023-11-28T16:56:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c0930640 1 -- 172.21.15.26:0/2425934132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b80ac7a0 con 0x7f05bc14fcc0 2023-11-28T16:56:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c0930640 1 -- 172.21.15.26:0/2425934132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80acb30 con 0x7f05bc14fcc0 2023-11-28T16:56:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c3b96640 1 -- 172.21.15.26:0/2425934132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc14fcc0 msgr2=0x7f05bc156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.931+0000 7f05c3b96640 1 --2- 172.21.15.26:0/2425934132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc14fcc0 0x7f05bc156500 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0c3b30 tx=0x7f05b801c4d0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- 172.21.15.26:0/2425934132 shutdown_connections 2023-11-28T16:56:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 --2- 172.21.15.26:0/2425934132 >> v2:172.21.15.79:3300/0 conn(0x7f05bc0c19e0 0x7f05bc0c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 --2- 172.21.15.26:0/2425934132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc14fcc0 0x7f05bc156500 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- 172.21.15.26:0/2425934132 >> 172.21.15.26:0/2425934132 conn(0x7f05bc0c2ad0 msgr2=0x7f05bc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- 172.21.15.26:0/2425934132 shutdown_connections 2023-11-28T16:56:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- 172.21.15.26:0/2425934132 wait complete. 2023-11-28T16:56:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 Processor -- start 2023-11-28T16:56:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- start start 2023-11-28T16:56:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05bc06d980 0x7f05bc14ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0c19e0 0x7f05bc1ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc1ed250 0x7f05bc1f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc146d50 con 0x7f05bc1ed250 2023-11-28T16:56:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc070b90 con 0x7f05bc0c19e0 2023-11-28T16:56:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c3b96640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc070240 con 0x7f05bc06d980 2023-11-28T16:56:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc1ed250 0x7f05bc1f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc1ed250 0x7f05bc1f0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51230/0 (socket says 172.21.15.26:51230) 2023-11-28T16:56:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 -- 172.21.15.26:0/1981220360 learned_addr learned my addr 172.21.15.26:0/1981220360 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c1131640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0c19e0 0x7f05bc1ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c1932640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05bc06d980 0x7f05bc14ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 -- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05bc06d980 msgr2=0x7f05bc14ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05bc06d980 0x7f05bc14ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 -- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0c19e0 msgr2=0x7f05bc1ecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:31.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0c19e0 0x7f05bc1ecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:31.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.935+0000 7f05c2133640 1 -- 172.21.15.26:0/1981220360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80094d0 con 0x7f05bc1ed250 2023-11-28T16:56:31.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05c2133640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc1ed250 0x7f05bc1f0110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f05b400cef0 tx=0x7f05b400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05b27fc640 1 -- 172.21.15.26:0/1981220360 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400d840 con 0x7f05bc1ed250 2023-11-28T16:56:31.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05b27fc640 1 -- 172.21.15.26:0/1981220360 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400d9c0 con 0x7f05bc1ed250 2023-11-28T16:56:31.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05b27fc640 1 -- 172.21.15.26:0/1981220360 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400dd70 con 0x7f05bc1ed250 2023-11-28T16:56:31.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc070520 con 0x7f05bc1ed250 2023-11-28T16:56:31.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc14bf90 con 0x7f05bc1ed250 2023-11-28T16:56:31.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc06dd80 con 0x7f05bc1ed250 2023-11-28T16:56:31.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05b27fc640 1 -- 172.21.15.26:0/1981220360 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f05b401e3b0 con 0x7f05bc1ed250 2023-11-28T16:56:31.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05b27fc640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05a00668d0 0x7f05a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:31.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05b27fc640 1 -- 172.21.15.26:0/1981220360 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05b4084e10 con 0x7f05bc1ed250 2023-11-28T16:56:31.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.939+0000 7f05c1932640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05a00668d0 0x7f05a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:31.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.943+0000 7f05c1932640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05a00668d0 0x7f05a0068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05b80ae000 tx=0x7f05b80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:31.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:31.943+0000 7f05b27fc640 1 -- 172.21.15.26:0/1981220360 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05b4088030 con 0x7f05bc1ed250 2023-11-28T16:56:32.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.131+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05bc04e890 con 0x7f05bc1ed250 2023-11-28T16:56:32.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.131+0000 7f05b27fc640 1 -- 172.21.15.26:0/1981220360 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f05b401a090 con 0x7f05bc1ed250 2023-11-28T16:56:32.137 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:32.138 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:32.138 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:32.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05a00668d0 msgr2=0x7f05a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05a00668d0 0x7f05a0068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05b80ae000 tx=0x7f05b80a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:32.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc1ed250 msgr2=0x7f05bc1f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc1ed250 0x7f05bc1f0110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f05b400cef0 tx=0x7f05b400a710 comp rx=0 tx=0).stop 2023-11-28T16:56:32.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 shutdown_connections 2023-11-28T16:56:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05bc1ed250 0x7f05bc1f0110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0c19e0 0x7f05bc1ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f05a00668d0 0x7f05a0068d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 --2- 172.21.15.26:0/1981220360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05bc06d980 0x7f05bc14ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 >> 172.21.15.26:0/1981220360 conn(0x7f05bc0c2ad0 msgr2=0x7f05bc151350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 shutdown_connections 2023-11-28T16:56:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.135+0000 7f05c3b96640 1 -- 172.21.15.26:0/1981220360 wait complete. 2023-11-28T16:56:32.561 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T16:56:17.653240+0000', 'modified': '2023-11-28T16:56:20.686573+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/2982577996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 2982577996}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2982577996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T16:56:32.562 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T16:56:32.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T16:56:32.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd444079640 1 Processor -- start 2023-11-28T16:56:32.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd444079640 1 -- start start 2023-11-28T16:56:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd444079640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd444079640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c1580b0 0x7fd43c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd444079640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c06e280 con 0x7fd43c155360 2023-11-28T16:56:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd444079640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0c2150 con 0x7fd43c06e7c0 2023-11-28T16:56:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd444079640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c157c60 con 0x7fd43c1580b0 2023-11-28T16:56:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd441614640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd441614640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51238/0 (socket says 172.21.15.26:51238) 2023-11-28T16:56:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd441614640 1 -- 172.21.15.26:0/1309650825 learned_addr learned my addr 172.21.15.26:0/1309650825 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd442616640 1 --2- 172.21.15.26:0/1309650825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c1580b0 0x7fd43c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd440e13640 1 -- 172.21.15.26:0/1309650825 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288270218 0 0) 0x7fd43c06e280 con 0x7fd43c155360 2023-11-28T16:56:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd441614640 1 -- 172.21.15.26:0/1309650825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c1580b0 msgr2=0x7fd43c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.703+0000 7fd441614640 1 --2- 172.21.15.26:0/1309650825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c1580b0 0x7fd43c158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd441614640 1 -- 172.21.15.26:0/1309650825 >> v1:172.21.15.79:6789/0 conn(0x7fd43c155360 legacy=0x7fd43c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd441614640 1 -- 172.21.15.26:0/1309650825 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0c1bd0 con 0x7fd43c06e7c0 2023-11-28T16:56:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd441614640 1 --2- 172.21.15.26:0/1309650825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c06e7c0 0x7fd43c06ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861467ac32f550cb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd440e13640 1 -- 172.21.15.26:0/1309650825 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0a7070 con 0x7fd43c06e7c0 2023-11-28T16:56:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd440e13640 1 -- 172.21.15.26:0/1309650825 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0ab430 con 0x7fd43c06e7c0 2023-11-28T16:56:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd440e13640 1 -- 172.21.15.26:0/1309650825 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ab7c0 con 0x7fd43c06e7c0 2023-11-28T16:56:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd444079640 1 -- 172.21.15.26:0/1309650825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c06e7c0 msgr2=0x7fd43c06ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd444079640 1 --2- 172.21.15.26:0/1309650825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c06e7c0 0x7fd43c06ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c01c540 comp rx=0 tx=0).stop 2023-11-28T16:56:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd444079640 1 -- 172.21.15.26:0/1309650825 shutdown_connections 2023-11-28T16:56:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd444079640 1 --2- 172.21.15.26:0/1309650825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c1580b0 0x7fd43c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd444079640 1 --2- 172.21.15.26:0/1309650825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.707+0000 7fd444079640 1 -- 172.21.15.26:0/1309650825 >> 172.21.15.26:0/1309650825 conn(0x7fd43c0c3240 msgr2=0x7fd43c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 -- 172.21.15.26:0/1309650825 shutdown_connections 2023-11-28T16:56:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 -- 172.21.15.26:0/1309650825 wait complete. 2023-11-28T16:56:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 Processor -- start 2023-11-28T16:56:32.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 -- start start 2023-11-28T16:56:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c155360 0x7fd43c0abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd43c1580b0 0x7fd43c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0a8290 con 0x7fd43c155360 2023-11-28T16:56:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c070f10 con 0x7fd43c1580b0 2023-11-28T16:56:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd444079640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c070900 con 0x7fd43c06e7c0 2023-11-28T16:56:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c155360 0x7fd43c0abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c155360 0x7fd43c0abdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51254/0 (socket says 172.21.15.26:51254) 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 -- 172.21.15.26:0/1746365628 learned_addr learned my addr 172.21.15.26:0/1746365628 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441e15640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd442616640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd43c1580b0 0x7fd43c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 -- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c06e7c0 msgr2=0x7fd43c06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 -- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd43c1580b0 msgr2=0x7fd43c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd43c1580b0 0x7fd43c156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 -- 172.21.15.26:0/1746365628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0094d0 con 0x7fd43c155360 2023-11-28T16:56:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd441614640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c155360 0x7fd43c0abdc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd42c01abf0 tx=0x7fd42c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.711+0000 7fd4327fc640 1 -- 172.21.15.26:0/1746365628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b4830 con 0x7fd43c155360 2023-11-28T16:56:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd4327fc640 1 -- 172.21.15.26:0/1746365628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0b4990 con 0x7fd43c155360 2023-11-28T16:56:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd4327fc640 1 -- 172.21.15.26:0/1746365628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b4d40 con 0x7fd43c155360 2023-11-28T16:56:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c151c20 con 0x7fd43c155360 2023-11-28T16:56:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c151f00 con 0x7fd43c155360 2023-11-28T16:56:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd4327fc640 1 -- 172.21.15.26:0/1746365628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd42c0bf410 con 0x7fd43c155360 2023-11-28T16:56:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd4327fc640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd420066900 0x7fd420068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd4327fc640 1 -- 172.21.15.26:0/1746365628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd42c11e2f0 con 0x7fd43c155360 2023-11-28T16:56:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd441e15640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd420066900 0x7fd420068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.715+0000 7fd4473f2000 1 Processor -- start 2023-11-28T16:56:32.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- start start 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441e15640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd420066900 0x7fd420068dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd438007fd0 tx=0x7fd438009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff3e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff3ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff88ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afe07110 con 0x55c3aff3e8e0 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd979a0 con 0x55c3aff3f200 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd94ed0 con 0x55c3aff3dfc0 2023-11-28T16:56:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff3ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff3ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51264/0 (socket says 172.21.15.26:51264) 2023-11-28T16:56:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 -- 172.21.15.26:0/62826406 learned_addr learned my addr 172.21.15.26:0/62826406 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd442616640 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff88ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441e15640 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff3e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 -- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 msgr2=0x55c3aff3e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff3e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 -- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 msgr2=0x55c3aff88ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff88ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 -- 172.21.15.26:0/62826406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3afa88890 con 0x55c3aff3e8e0 2023-11-28T16:56:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd441614640 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff3ecc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0eb790 tx=0x7fd42c0eebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520b4d54ffd83453 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:32.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd41f7fe640 1 -- 172.21.15.26:0/62826406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0f3120 con 0x55c3aff3e8e0 2023-11-28T16:56:32.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd41f7fe640 1 -- 172.21.15.26:0/62826406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0f74e0 con 0x55c3aff3e8e0 2023-11-28T16:56:32.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd41f7fe640 1 -- 172.21.15.26:0/62826406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ed630 con 0x55c3aff3e8e0 2023-11-28T16:56:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- 172.21.15.26:0/62826406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 msgr2=0x55c3aff3ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff3ecc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0eb790 tx=0x7fd42c0eebf0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- 172.21.15.26:0/62826406 shutdown_connections 2023-11-28T16:56:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff88ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff3ecc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 --2- 172.21.15.26:0/62826406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff3e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- 172.21.15.26:0/62826406 >> 172.21.15.26:0/62826406 conn(0x55c3aff7c830 msgr2=0x55c3aff7ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- 172.21.15.26:0/62826406 shutdown_connections 2023-11-28T16:56:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- 172.21.15.26:0/62826406 wait complete. 2023-11-28T16:56:32.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 -- start start 2023-11-28T16:56:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.719+0000 7fd4473f2000 1 Processor -- start 2023-11-28T16:56:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff7b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff44860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd907c0 con 0x55c3aff3e8e0 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd48bf0 con 0x55c3aff3f200 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd4ea90 con 0x55c3aff3dfc0 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 10 client.0 _ll_register_callbacks cb 0x55c3aff2be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff7bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51268/0 (socket says 172.21.15.26:51268) 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 -- 172.21.15.26:0/2655954786 learned_addr learned my addr 172.21.15.26:0/2655954786 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441e15640 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff7b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd442616640 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff44860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 -- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 msgr2=0x55c3aff7b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff7b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 -- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 msgr2=0x55c3aff44860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff44860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 -- 172.21.15.26:0/2655954786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c151f00 con 0x55c3aff3e8e0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441614640 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff7bed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0eb740 tx=0x7fd42c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb15fa32337b77e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd41cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd41cff9640 1 -- 172.21.15.26:0/2655954786 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0f3120 con 0x55c3aff3e8e0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd41cff9640 1 -- 172.21.15.26:0/2655954786 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd42c0f74e0 con 0x55c3aff3e8e0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3afd52470 con 0x55c3aff3e8e0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd41cff9640 1 -- 172.21.15.26:0/2655954786 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd42c0ee780 con 0x55c3aff3e8e0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 10 client.4629 fetch_fsmap learned FSMap version 8 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c3afd51190 con 0x55c3aff3e8e0 2023-11-28T16:56:32.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd41cff9640 1 -- 172.21.15.26:0/2655954786 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c3afd52470 con 0x55c3aff3e8e0 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd41cff9640 1 -- 172.21.15.26:0/2655954786 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd42c0f7050 con 0x55c3aff3e8e0 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 10 client.4629 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 20 client.4629 populate_metadata read hostname 'smithi026' 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3aff455a0 0x55c3aff45980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 4 client.4629 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 --> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3afd55b50 con 0x55c3aff455a0 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441e15640 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3aff455a0 0x55c3aff45980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd441e15640 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3aff455a0 0x55c3aff45980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc1b75210d0b219 server_cookie=cc215e5914f0329a in_seq=0 out_seq=0 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.723+0000 7fd41cff9640 10 client.4629 ms_handle_connect on v2:172.21.15.79:6836/2982577996 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd41cff9640 1 -- 172.21.15.26:0/2655954786 <== mds.0 v2:172.21.15.79:6836/2982577996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3afd55b50 con 0x55c3aff455a0 2023-11-28T16:56:32.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd41cff9640 10 client.4629 handle_command_reply: tid=0 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 client.4629 shutdown 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 msgr2=0x55c3aff7bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff7bed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0eb740 tx=0x7fd42c000bd0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 shutdown_connections 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3aff455a0 0x55c3aff45980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3aff44860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3e8e0 0x55c3aff7bed0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd41cff9640 0 client.4629 ms_handle_reset on v2:172.21.15.79:6836/2982577996 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 --2- 172.21.15.26:0/2655954786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3dfc0 0x55c3aff7b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 >> 172.21.15.26:0/2655954786 conn(0x55c3aff7c830 msgr2=0x55c3aff7ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 shutdown_connections 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 1 -- 172.21.15.26:0/2655954786 wait complete. 2023-11-28T16:56:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.727+0000 7fd4473f2000 20 client.4629 trim_cache size 0 max 16384 2023-11-28T16:56:32.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 Processor -- start 2023-11-28T16:56:32.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 -- start start 2023-11-28T16:56:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff44430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3e8e0 0x55c3affd8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3f200 0x55c3affd9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afa49940 con 0x55c3aff3dfc0 2023-11-28T16:56:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd4ea90 con 0x55c3aff3e8e0 2023-11-28T16:56:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3afa891b0 con 0x55c3aff3f200 2023-11-28T16:56:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff44430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff44430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51270/0 (socket says 172.21.15.26:51270) 2023-11-28T16:56:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 -- 172.21.15.26:0/643729445 learned_addr learned my addr 172.21.15.26:0/643729445 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 -- 172.21.15.26:0/643729445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3f200 msgr2=0x55c3affd9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 --2- 172.21.15.26:0/643729445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3f200 0x55c3affd9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 -- 172.21.15.26:0/643729445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3e8e0 msgr2=0x55c3affd8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 --2- 172.21.15.26:0/643729445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3e8e0 0x55c3affd8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 -- 172.21.15.26:0/643729445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3afd37490 con 0x55c3aff3dfc0 2023-11-28T16:56:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd441e15640 1 --2- 172.21.15.26:0/643729445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff44430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0c3010 tx=0x7fd43800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50db348e8b43763a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd41ffff640 1 -- 172.21.15.26:0/643729445 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438028070 con 0x55c3aff3dfc0 2023-11-28T16:56:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd41ffff640 1 -- 172.21.15.26:0/643729445 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd438029d40 con 0x55c3aff3dfc0 2023-11-28T16:56:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.743+0000 7fd41ffff640 1 -- 172.21.15.26:0/643729445 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4380160d0 con 0x55c3aff3dfc0 2023-11-28T16:56:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/643729445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 msgr2=0x55c3aff44430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- 172.21.15.26:0/643729445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff44430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0c3010 tx=0x7fd43800a000 comp rx=0 tx=0).stop 2023-11-28T16:56:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/643729445 shutdown_connections 2023-11-28T16:56:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- 172.21.15.26:0/643729445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3f200 0x55c3affd9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- 172.21.15.26:0/643729445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3e8e0 0x55c3affd8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- 172.21.15.26:0/643729445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff44430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/643729445 >> 172.21.15.26:0/643729445 conn(0x55c3aff7c830 msgr2=0x55c3aff45980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/643729445 shutdown_connections 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/643729445 wait complete. 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- start start 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 Processor -- start 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff96980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3e8e0 0x55c3affe13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3affe1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afe17570 con 0x55c3aff3dfc0 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd59910 con 0x55c3aff3f200 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3afd4f8f0 con 0x55c3aff3e8e0 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 10 client.0 _ll_register_callbacks cb 0x55c3afd9b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff96980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff96980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51272/0 (socket says 172.21.15.26:51272) 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 -- 172.21.15.26:0/3068408300 learned_addr learned my addr 172.21.15.26:0/3068408300 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 -- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3e8e0 msgr2=0x55c3affe13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3e8e0 0x55c3affe13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 -- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 msgr2=0x55c3affe1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3affe1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 -- 172.21.15.26:0/3068408300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd438029b00 con 0x55c3aff3dfc0 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd441e15640 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff96980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd43800ffd0 tx=0x7fd438001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11b65d8b70bfcf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd41cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd41cff9640 1 -- 172.21.15.26:0/3068408300 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438028070 con 0x55c3aff3dfc0 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd41cff9640 1 -- 172.21.15.26:0/3068408300 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd43801c040 con 0x55c3aff3dfc0 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3afd8f110 con 0x55c3aff3dfc0 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd41cff9640 1 -- 172.21.15.26:0/3068408300 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4380162e0 con 0x55c3aff3dfc0 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 10 client.4635 fetch_fsmap learned FSMap version 8 2023-11-28T16:56:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c3afa88cc0 con 0x55c3aff3dfc0 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd41cff9640 1 -- 172.21.15.26:0/3068408300 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c3afd8f110 con 0x55c3aff3dfc0 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd41cff9640 1 -- 172.21.15.26:0/3068408300 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd438031070 con 0x55c3aff3dfc0 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 10 client.4635 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 20 client.4635 populate_metadata read hostname 'smithi026' 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3affdffa0 0x55c3affe0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 4 client.4635 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T16:56:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.747+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 --> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3afdbd650 con 0x55c3affdffa0 2023-11-28T16:56:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd441614640 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3affdffa0 0x55c3affe0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd441614640 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3affdffa0 0x55c3affe0380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e778ae74aa2bcabe server_cookie=432017cf53771a49 in_seq=0 out_seq=0 2023-11-28T16:56:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd41cff9640 10 client.4635 ms_handle_connect on v2:172.21.15.79:6836/2982577996 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd41cff9640 1 -- 172.21.15.26:0/3068408300 <== mds.0 v2:172.21.15.79:6836/2982577996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c3afdbd650 con 0x55c3affdffa0 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd41cff9640 10 client.4635 handle_command_reply: tid=0 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 client.4635 shutdown 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 msgr2=0x55c3aff96980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff96980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd43800ffd0 tx=0x7fd438001090 comp rx=0 tx=0).stop 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 shutdown_connections 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:6836/2982577996,v1:172.21.15.79:6837/2982577996] conn(0x55c3affdffa0 0x55c3affe0380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3aff3f200 0x55c3affe1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c3aff3e8e0 0x55c3affe13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 --2- 172.21.15.26:0/3068408300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3aff3dfc0 0x55c3aff96980 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd41cff9640 0 client.4635 ms_handle_reset on v2:172.21.15.79:6836/2982577996 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 >> 172.21.15.26:0/3068408300 conn(0x55c3aff7c830 msgr2=0x55c3aff976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 shutdown_connections 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 1 -- 172.21.15.26:0/3068408300 wait complete. 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd4473f2000 20 client.4635 trim_cache size 0 max 16384 2023-11-28T16:56:32.761 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee", 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4297, 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 14.470416307000001, 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2023-11-28T16:56:32.762 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 20, 2023-11-28T16:56:32.763 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 20, 2023-11-28T16:56:32.763 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 21.774222808000001 2023-11-28T16:56:32.763 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:56:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd420066900 msgr2=0x7fd420068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd420066900 0x7fd420068dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd438007fd0 tx=0x7fd438009040 comp rx=0 tx=0).stop 2023-11-28T16:56:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c155360 msgr2=0x7fd43c0abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c155360 0x7fd43c0abdc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd42c01abf0 tx=0x7fd42c0192e0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 shutdown_connections 2023-11-28T16:56:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd43c1580b0 0x7fd43c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd43c155360 0x7fd43c0abdc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd420066900 0x7fd420068dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 --2- 172.21.15.26:0/1746365628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd43c06e7c0 0x7fd43c06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 >> 172.21.15.26:0/1746365628 conn(0x7fd43c0c3240 msgr2=0x7fd43c15e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 shutdown_connections 2023-11-28T16:56:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:32.751+0000 7fd444079640 1 -- 172.21.15.26:0/1746365628 wait complete. 2023-11-28T16:56:32.775 INFO:teuthology.run_tasks:Running task kclient... 2023-11-28T16:56:32.798 INFO:tasks.kclient:Mounting kernel clients... 2023-11-28T16:56:32.798 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-11-28T16:56:32.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:32.799 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:56:32.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:32.810 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-11-28T16:56:32.877 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-11-28T16:56:32.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:56:32.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:32.880 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:56:32.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:32.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-11-28T16:56:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2023-11-28T16:56:32.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:56:32.962 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-28T16:56:32.962 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T16:56:32.962 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:56:32.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:56:33.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.099+0000 7f95520fe640 1 Processor -- start 2023-11-28T16:56:33.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.099+0000 7f95520fe640 1 -- start start 2023-11-28T16:56:33.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f95520fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f954c070b80 0x7f954c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:33.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f95520fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c06d320 con 0x7f954c0a8470 2023-11-28T16:56:33.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f95520fe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0721b0 con 0x7f954c14e9d0 2023-11-28T16:56:33.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f95520fe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c0c2830 con 0x7f954c070b80 2023-11-28T16:56:33.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f954c0a8470 0x7f954c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60348/0 (socket says 172.21.15.26:60348) 2023-11-28T16:56:33.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954bfff640 1 -- 172.21.15.26:0/4088908476 learned_addr learned my addr 172.21.15.26:0/4088908476 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:33.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954affd640 1 --2- 172.21.15.26:0/4088908476 >> v2:172.21.15.79:3300/0 conn(0x7f954c070b80 0x7f954c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954a7fc640 1 -- 172.21.15.26:0/4088908476 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858013433 0 0) 0x7f954c06d320 con 0x7f954c0a8470 2023-11-28T16:56:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954a7fc640 1 -- 172.21.15.26:0/4088908476 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9534003530 con 0x7f954c0a8470 2023-11-28T16:56:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954affd640 1 -- 172.21.15.26:0/4088908476 >> v1:172.21.15.79:6789/0 conn(0x7f954c14e9d0 legacy=0x7f954c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954affd640 1 -- 172.21.15.26:0/4088908476 >> v1:172.21.15.26:6789/0 conn(0x7f954c0a8470 legacy=0x7f954c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.103+0000 7f954affd640 1 -- 172.21.15.26:0/4088908476 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c072450 con 0x7f954c070b80 2023-11-28T16:56:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f954affd640 1 --2- 172.21.15.26:0/4088908476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c070b80 0x7f954c151e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95400097c0 tx=0x7f954001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35b9a600079cb668 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f954a7fc640 1 -- 172.21.15.26:0/4088908476 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400ab600 con 0x7f954c070b80 2023-11-28T16:56:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f954a7fc640 1 -- 172.21.15.26:0/4088908476 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95400a7050 con 0x7f954c070b80 2023-11-28T16:56:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f954a7fc640 1 -- 172.21.15.26:0/4088908476 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400ab980 con 0x7f954c070b80 2023-11-28T16:56:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 -- 172.21.15.26:0/4088908476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c070b80 msgr2=0x7f954c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 --2- 172.21.15.26:0/4088908476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c070b80 0x7f954c151e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95400097c0 tx=0x7f954001c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 -- 172.21.15.26:0/4088908476 shutdown_connections 2023-11-28T16:56:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 --2- 172.21.15.26:0/4088908476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c070b80 0x7f954c151e60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 -- 172.21.15.26:0/4088908476 >> 172.21.15.26:0/4088908476 conn(0x7f954c0c2ad0 msgr2=0x7f954c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 -- 172.21.15.26:0/4088908476 shutdown_connections 2023-11-28T16:56:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 -- 172.21.15.26:0/4088908476 wait complete. 2023-11-28T16:56:33.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 Processor -- start 2023-11-28T16:56:33.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 -- start start 2023-11-28T16:56:33.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f954c070b80 0x7f954c1f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:33.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.107+0000 7f95520fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c0a8470 0x7f954c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f95520fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f954c14e9d0 0x7f954c1ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f95520fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c153b60 con 0x7f954c070b80 2023-11-28T16:56:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f95520fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c152df0 con 0x7f954c0a8470 2023-11-28T16:56:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f95520fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c5460 con 0x7f954c14e9d0 2023-11-28T16:56:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f954c070b80 0x7f954c1f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f954c070b80 0x7f954c1f0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51288/0 (socket says 172.21.15.26:51288) 2023-11-28T16:56:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 -- 172.21.15.26:0/835671167 learned_addr learned my addr 172.21.15.26:0/835671167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954affd640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c0a8470 0x7f954c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:33.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954bfff640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f954c14e9d0 0x7f954c1ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:33.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 -- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f954c14e9d0 msgr2=0x7f954c1ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f954c14e9d0 0x7f954c1ecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 -- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c0a8470 msgr2=0x7f954c14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c0a8470 0x7f954c14c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 -- 172.21.15.26:0/835671167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540009420 con 0x7f954c070b80 2023-11-28T16:56:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f954b7fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f954c070b80 0x7f954c1f0a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c3c0 tx=0x7f953c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f9533fff640 1 -- 172.21.15.26:0/835671167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c0052d0 con 0x7f954c070b80 2023-11-28T16:56:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f9533fff640 1 -- 172.21.15.26:0/835671167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c005430 con 0x7f954c070b80 2023-11-28T16:56:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f9533fff640 1 -- 172.21.15.26:0/835671167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c003840 con 0x7f954c070b80 2023-11-28T16:56:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c0c5ce0 con 0x7f954c070b80 2023-11-28T16:56:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c0c5a00 con 0x7f954c070b80 2023-11-28T16:56:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c04e890 con 0x7f954c070b80 2023-11-28T16:56:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.111+0000 7f9533fff640 1 -- 172.21.15.26:0/835671167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f953c0039a0 con 0x7f954c070b80 2023-11-28T16:56:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.115+0000 7f9533fff640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95380668d0 0x7f9538068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.115+0000 7f9533fff640 1 -- 172.21.15.26:0/835671167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f953c0838c0 con 0x7f954c070b80 2023-11-28T16:56:33.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.115+0000 7f954affd640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95380668d0 0x7f9538068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:33.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.115+0000 7f954affd640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95380668d0 0x7f9538068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f95400ad000 tx=0x7f9540008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:33.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.119+0000 7f9533fff640 1 -- 172.21.15.26:0/835671167 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f953c050ba0 con 0x7f954c070b80 2023-11-28T16:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.311+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f954c0700a0 con 0x7f954c070b80 2023-11-28T16:56:33.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.311+0000 7f9533fff640 1 -- 172.21.15.26:0/835671167 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f953c017070 con 0x7f954c070b80 2023-11-28T16:56:33.316 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95380668d0 msgr2=0x7f9538068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95380668d0 0x7f9538068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f95400ad000 tx=0x7f9540008040 comp rx=0 tx=0).stop 2023-11-28T16:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f954c070b80 msgr2=0x7f954c1f0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f954c070b80 0x7f954c1f0a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c3c0 tx=0x7f953c00c880 comp rx=0 tx=0).stop 2023-11-28T16:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 shutdown_connections 2023-11-28T16:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95380668d0 0x7f9538068d90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f954c14e9d0 0x7f954c1ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c0a8470 0x7f954c14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 --2- 172.21.15.26:0/835671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f954c070b80 0x7f954c1f0a50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 >> 172.21.15.26:0/835671167 conn(0x7f954c0c2ad0 msgr2=0x7f954c0c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 shutdown_connections 2023-11-28T16:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:33.315+0000 7f95520fe640 1 -- 172.21.15.26:0/835671167 wait complete. 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:56:33.338 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:56:33.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.339 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-11-28T16:56:33.349 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:56:33.349 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:56:33.349 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42382sec preferred_lft 42382sec 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:1b:cd:da:6f brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:56:33.352 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:33.352 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T16:56:33.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.352 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:56:33.352 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:56:33.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2023-11-28T16:56:33.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2023-11-28T16:56:33.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2023-11-28T16:56:33.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T16:56:33.353 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:56:33.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.466 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:56:33.486 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-11-28T16:56:33.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.488 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-11-28T16:56:33.554 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-11-28T16:56:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:56:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T16:56:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:56:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T16:56:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:56:33.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.555 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:56:33.556 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:56:33.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T16:56:33.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T16:56:33.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T16:56:33.556 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:56:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.651 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:56:33.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.661 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-11-28T16:56:33.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.711 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:56:33.711 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:56:33.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:56:33.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T16:56:33.711 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:56:33.797 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T16:56:33.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.797 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:56:33.797 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:56:33.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T16:56:33.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T16:56:33.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T16:56:33.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T16:56:33.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T16:56:33.798 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:56:33.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:33.961 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:56:33.961 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:56:33.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-11-28T16:56:33.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T16:56:33.961 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:56:34.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:56:34.004 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T16:56:34.054 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:56:34.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:56:34.054 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:56:34.105 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T16:56:34.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:34.106 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:56:34.217 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:56:34.217 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:56:34.330 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:56:34.331 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:56:34.331 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:56:34.331 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:56:34.331 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:56:34.334 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:56:34.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:34.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:56:34.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:34.357 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:56:34.432 INFO:teuthology.orchestra.run.smithi026.stdout:client4520 2023-11-28T16:56:34.432 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:56:34.432 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:34.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:34.482 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:56:34.545 INFO:teuthology.orchestra.run.smithi026.stdout:client4520 2023-11-28T16:56:34.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:34.545 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:56:34.605 INFO:teuthology.orchestra.run.smithi026.stdout:client4520 2023-11-28T16:56:34.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:34.605 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.client4520/status') 2023-11-28T16:56:34.672 INFO:teuthology.orchestra.run.smithi026.stdout:instance: client.4520 (3)172.21.15.26:0/2237615169 2023-11-28T16:56:34.672 INFO:teuthology.orchestra.run.smithi026.stdout:blocklisted: false 2023-11-28T16:56:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+1 records in 2023-11-28T16:56:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+1 records out 2023-11-28T16:56:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:70 bytes copied, 6.69e-05 s, 1.0 MB/s 2023-11-28T16:56:34.674 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-11-28T16:56:34.675 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T16:56:34.675 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:56:34.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:56:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d9da9a640 1 Processor -- start 2023-11-28T16:56:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d9da9a640 1 -- start start 2023-11-28T16:56:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d9da9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d980a8470 0x7f2d98151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d9da9a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9806d320 con 0x7f2d98070b80 2023-11-28T16:56:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d9da9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980721b0 con 0x7f2d9814e9d0 2023-11-28T16:56:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d9da9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980c2830 con 0x7f2d980a8470 2023-11-28T16:56:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d96ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2d98070b80 0x7f2d9806d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60358/0 (socket says 172.21.15.26:60358) 2023-11-28T16:56:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d96ffd640 1 -- 172.21.15.26:0/2586404110 learned_addr learned my addr 172.21.15.26:0/2586404110 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d97fff640 1 --2- 172.21.15.26:0/2586404110 >> v2:172.21.15.26:3300/0 conn(0x7f2d980a8470 0x7f2d98151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d97fff640 1 -- 172.21.15.26:0/2586404110 >> v1:172.21.15.79:6789/0 conn(0x7f2d9814e9d0 legacy=0x7f2d980c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d97fff640 1 -- 172.21.15.26:0/2586404110 >> v1:172.21.15.26:6789/0 conn(0x7f2d98070b80 legacy=0x7f2d9806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.855+0000 7f2d97fff640 1 -- 172.21.15.26:0/2586404110 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98072450 con 0x7f2d980a8470 2023-11-28T16:56:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d97fff640 1 --2- 172.21.15.26:0/2586404110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d98151e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009d90 tx=0x7f2d9001ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226cbf99197b53d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d967fc640 1 -- 172.21.15.26:0/2586404110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d900a79b0 con 0x7f2d980a8470 2023-11-28T16:56:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d967fc640 1 -- 172.21.15.26:0/2586404110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d900a7b10 con 0x7f2d980a8470 2023-11-28T16:56:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d967fc640 1 -- 172.21.15.26:0/2586404110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d900a7ea0 con 0x7f2d980a8470 2023-11-28T16:56:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d9da9a640 1 -- 172.21.15.26:0/2586404110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 msgr2=0x7f2d98151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/2586404110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d98151e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009d90 tx=0x7f2d9001ead0 comp rx=0 tx=0).stop 2023-11-28T16:56:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d9da9a640 1 -- 172.21.15.26:0/2586404110 shutdown_connections 2023-11-28T16:56:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/2586404110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d98151e60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d9da9a640 1 -- 172.21.15.26:0/2586404110 >> 172.21.15.26:0/2586404110 conn(0x7f2d980c2ad0 msgr2=0x7f2d980c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d9da9a640 1 -- 172.21.15.26:0/2586404110 shutdown_connections 2023-11-28T16:56:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.859+0000 7f2d9da9a640 1 -- 172.21.15.26:0/2586404110 wait complete. 2023-11-28T16:56:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 Processor -- start 2023-11-28T16:56:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 -- start start 2023-11-28T16:56:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d98070b80 0x7f2d98148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d981ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9814e9d0 0x7f2d981ec810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98153140 con 0x7f2d980a8470 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981ed1a0 con 0x7f2d9814e9d0 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981ecec0 con 0x7f2d98070b80 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d981ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d981ec2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51308/0 (socket says 172.21.15.26:51308) 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 -- 172.21.15.26:0/611246117 learned_addr learned my addr 172.21.15.26:0/611246117 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d977fe640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d98070b80 0x7f2d98148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:34.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d97fff640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9814e9d0 0x7f2d981ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 -- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d98070b80 msgr2=0x7f2d98148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d98070b80 0x7f2d98148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 -- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9814e9d0 msgr2=0x7f2d981ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9814e9d0 0x7f2d981ec810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 -- 172.21.15.26:0/611246117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009a70 con 0x7f2d980a8470 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d96ffd640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d981ec2d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c4d0 tx=0x7f2d8c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d7ffff640 1 -- 172.21.15.26:0/611246117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c005cf0 con 0x7f2d980a8470 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d7ffff640 1 -- 172.21.15.26:0/611246117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c005e50 con 0x7f2d980a8470 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d98155490 con 0x7f2d980a8470 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.863+0000 7f2d7ffff640 1 -- 172.21.15.26:0/611246117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c007270 con 0x7f2d980a8470 2023-11-28T16:56:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.867+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d981ec010 con 0x7f2d980a8470 2023-11-28T16:56:34.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.867+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98067a40 con 0x7f2d980a8470 2023-11-28T16:56:34.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.867+0000 7f2d7ffff640 1 -- 172.21.15.26:0/611246117 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2d8c0073d0 con 0x7f2d980a8470 2023-11-28T16:56:34.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.867+0000 7f2d7ffff640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d840668d0 0x7f2d84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:34.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.867+0000 7f2d7ffff640 1 -- 172.21.15.26:0/611246117 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d8c083850 con 0x7f2d980a8470 2023-11-28T16:56:34.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.867+0000 7f2d977fe640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d840668d0 0x7f2d84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:34.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.867+0000 7f2d977fe640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d840668d0 0x7f2d84068d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d980c02d0 tx=0x7f2d88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:34.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:34.871+0000 7f2d7ffff640 1 -- 172.21.15.26:0/611246117 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d8c050b30 con 0x7f2d980a8470 2023-11-28T16:56:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d98153280 con 0x7f2d980a8470 2023-11-28T16:56:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d7ffff640 1 -- 172.21.15.26:0/611246117 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d8c017070 con 0x7f2d980a8470 2023-11-28T16:56:35.079 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:56:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d840668d0 msgr2=0x7f2d84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d840668d0 0x7f2d84068d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d980c02d0 tx=0x7f2d88009040 comp rx=0 tx=0).stop 2023-11-28T16:56:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 msgr2=0x7f2d981ec2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:35.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d981ec2d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c4d0 tx=0x7f2d8c00c990 comp rx=0 tx=0).stop 2023-11-28T16:56:35.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 shutdown_connections 2023-11-28T16:56:35.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9814e9d0 0x7f2d981ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d980a8470 0x7f2d981ec2d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2d840668d0 0x7f2d84068d90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 --2- 172.21.15.26:0/611246117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d98070b80 0x7f2d98148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 >> 172.21.15.26:0/611246117 conn(0x7f2d980c2ad0 msgr2=0x7f2d980c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:35.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 shutdown_connections 2023-11-28T16:56:35.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:35.071+0000 7f2d9da9a640 1 -- 172.21.15.26:0/611246117 wait complete. 2023-11-28T16:56:35.098 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T16:56:35.099 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:56:35.099 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:56:35.100 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T16:56:35.100 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:56:35.100 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T16:56:35.100 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T16:56:35.100 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:56:35.100 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:56:35.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.101 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:56:35.112 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:56:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:56:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:56:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:56:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:35.113 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:56:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:56:35.114 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:56:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:56:35.114 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:56:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:35.115 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:56:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:56:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42372sec preferred_lft 42372sec 2023-11-28T16:56:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:56:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:35.115 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:56:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:56:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:56:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:56:35.116 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T16:56:35.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.117 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:56:35.117 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:56:35.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2023-11-28T16:56:35.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2023-11-28T16:56:35.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2023-11-28T16:56:35.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T16:56:35.118 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:56:35.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.230 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:56:35.249 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:56:35.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.252 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:56:35.321 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:56:35.322 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:56:35.322 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:56:35.322 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:56:35.322 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:56:35.323 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:56:35.323 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:56:35.323 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:56:35.323 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:56:35.323 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:56:35.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.324 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:56:35.324 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:56:35.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:56:35.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:56:35.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:56:35.325 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:56:35.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.415 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:56:35.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.425 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2023-11-28T16:56:35.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.475 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:56:35.475 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:56:35.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:56:35.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T16:56:35.475 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:56:35.559 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T16:56:35.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.559 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:56:35.560 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:56:35.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T16:56:35.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T16:56:35.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T16:56:35.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T16:56:35.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T16:56:35.560 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:56:35.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.733 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:56:35.734 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:56:35.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:56:35.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T16:56:35.734 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:56:35.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:56:35.775 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:56:35.830 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:56:35.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:56:35.831 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:56:35.886 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T16:56:35.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:35.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:56:35.987 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:56:35.987 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:56:36.107 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:56:36.108 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:56:36.108 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:56:36.108 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:56:36.108 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:56:36.111 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:56:36.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:36.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:56:36.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:36.132 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:56:36.208 INFO:teuthology.orchestra.run.smithi079.stdout:client4653 2023-11-28T16:56:36.208 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:56:36.208 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:36.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:36.262 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:56:36.317 INFO:teuthology.orchestra.run.smithi079.stdout:client4653 2023-11-28T16:56:36.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:36.317 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:56:36.370 INFO:teuthology.orchestra.run.smithi079.stdout:client4653 2023-11-28T16:56:36.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:36.371 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.client4653/status') 2023-11-28T16:56:36.434 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.4653 (3)172.21.15.79:0/1076420001 2023-11-28T16:56:36.434 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2023-11-28T16:56:36.435 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2023-11-28T16:56:36.435 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2023-11-28T16:56:36.435 INFO:teuthology.orchestra.run.smithi079.stderr:70 bytes copied, 5.0463e-05 s, 1.4 MB/s 2023-11-28T16:56:36.436 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T16:56:36.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:36.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f714d832640 1 Processor -- start 2023-11-28T16:56:36.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f714d832640 1 -- start start 2023-11-28T16:56:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f714d832640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f714806cd90 0x7f7148160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f714d832640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7148155790 con 0x7f71480ca610 2023-11-28T16:56:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f714d832640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71480c4b00 con 0x7f71480bd720 2023-11-28T16:56:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f714d832640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71480c4de0 con 0x7f714806cd90 2023-11-28T16:56:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f7146ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f71480ca610 0x7f71480c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60362/0 (socket says 172.21.15.26:60362) 2023-11-28T16:56:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f7146ffd640 1 -- 172.21.15.26:0/1738675131 learned_addr learned my addr 172.21.15.26:0/1738675131 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71477fe640 1 --2- 172.21.15.26:0/1738675131 >> v2:172.21.15.79:3300/0 conn(0x7f714806cd90 0x7f7148160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71467fc640 1 -- 172.21.15.26:0/1738675131 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081623243 0 0) 0x7f71480c4b00 con 0x7f71480bd720 2023-11-28T16:56:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71467fc640 1 -- 172.21.15.26:0/1738675131 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7134003530 con 0x7f71480bd720 2023-11-28T16:56:36.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71467fc640 1 -- 172.21.15.26:0/1738675131 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731924944 0 0) 0x7f7148155790 con 0x7f71480ca610 2023-11-28T16:56:36.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71467fc640 1 -- 172.21.15.26:0/1738675131 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71480c4b00 con 0x7f71480ca610 2023-11-28T16:56:36.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71477fe640 1 -- 172.21.15.26:0/1738675131 >> v1:172.21.15.79:6789/0 conn(0x7f71480bd720 legacy=0x7f7148158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71477fe640 1 -- 172.21.15.26:0/1738675131 >> v1:172.21.15.26:6789/0 conn(0x7f71480ca610 legacy=0x7f71480c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.607+0000 7f71477fe640 1 -- 172.21.15.26:0/1738675131 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148157e30 con 0x7f714806cd90 2023-11-28T16:56:36.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f71477fe640 1 --2- 172.21.15.26:0/1738675131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 0x7f7148160130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7140009d90 tx=0x7f714001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e843e007df469ab2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f71467fc640 1 -- 172.21.15.26:0/1738675131 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71480c52d0 con 0x7f714806cd90 2023-11-28T16:56:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f71467fc640 1 -- 172.21.15.26:0/1738675131 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400a4e60 con 0x7f714806cd90 2023-11-28T16:56:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f71467fc640 1 -- 172.21.15.26:0/1738675131 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400ac660 con 0x7f714806cd90 2023-11-28T16:56:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f714d832640 1 -- 172.21.15.26:0/1738675131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 msgr2=0x7f7148160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f714d832640 1 --2- 172.21.15.26:0/1738675131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 0x7f7148160130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7140009d90 tx=0x7f714001c510 comp rx=0 tx=0).stop 2023-11-28T16:56:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f714d832640 1 -- 172.21.15.26:0/1738675131 shutdown_connections 2023-11-28T16:56:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f714d832640 1 --2- 172.21.15.26:0/1738675131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 0x7f7148160130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f714d832640 1 -- 172.21.15.26:0/1738675131 >> 172.21.15.26:0/1738675131 conn(0x7f7148071ea0 msgr2=0x7f71480722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f714d832640 1 -- 172.21.15.26:0/1738675131 shutdown_connections 2023-11-28T16:56:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.611+0000 7f714d832640 1 -- 172.21.15.26:0/1738675131 wait complete. 2023-11-28T16:56:36.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 Processor -- start 2023-11-28T16:56:36.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 -- start start 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 0x7f714814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71480bd720 0x7f71480c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71480ca610 0x7f71480c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148147740 con 0x7f71480ca610 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480ab0e0 con 0x7f714806cd90 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480aaaf0 con 0x7f71480bd720 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71480ca610 0x7f71480c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71480ca610 0x7f71480c16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51316/0 (socket says 172.21.15.26:51316) 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 -- 172.21.15.26:0/2810203244 learned_addr learned my addr 172.21.15.26:0/2810203244 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:36.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f7146ffd640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 0x7f714814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f713ffff640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71480bd720 0x7f71480c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 -- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71480bd720 msgr2=0x7f71480c11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71480bd720 0x7f71480c11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 -- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 msgr2=0x7f714814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 0x7f714814d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 -- 172.21.15.26:0/2810203244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140009a70 con 0x7f71480ca610 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f71477fe640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71480ca610 0x7f71480c16f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f714001a350 tx=0x7f71400195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f7144ff9640 1 -- 172.21.15.26:0/2810203244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140009450 con 0x7f71480ca610 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f7144ff9640 1 -- 172.21.15.26:0/2810203244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400a4c60 con 0x7f71480ca610 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f7144ff9640 1 -- 172.21.15.26:0/2810203244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400acd00 con 0x7f71480ca610 2023-11-28T16:56:36.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71481f6850 con 0x7f71480ca610 2023-11-28T16:56:36.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.615+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71480aad70 con 0x7f71480ca610 2023-11-28T16:56:36.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.619+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71481f6d00 con 0x7f71480ca610 2023-11-28T16:56:36.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.619+0000 7f7144ff9640 1 -- 172.21.15.26:0/2810203244 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71400b3040 con 0x7f71480ca610 2023-11-28T16:56:36.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.619+0000 7f7144ff9640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7128066900 0x7f7128068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.619+0000 7f7144ff9640 1 -- 172.21.15.26:0/2810203244 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71480cac00 con 0x7f71480ca610 2023-11-28T16:56:36.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.619+0000 7f7146ffd640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7128066900 0x7f7128068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.619+0000 7f7146ffd640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7128066900 0x7f7128068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7138007fd0 tx=0x7f7138009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:36.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.623+0000 7f7144ff9640 1 -- 172.21.15.26:0/2810203244 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71400eb000 con 0x7f71480ca610 2023-11-28T16:56:36.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.783+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f714804e890 con 0x7f71480ca610 2023-11-28T16:56:36.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f7144ff9640 1 -- 172.21.15.26:0/2810203244 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f71400ace60 con 0x7f71480ca610 2023-11-28T16:56:36.791 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:36.791 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7128066900 msgr2=0x7f7128068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7128066900 0x7f7128068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7138007fd0 tx=0x7f7138009040 comp rx=0 tx=0).stop 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71480ca610 msgr2=0x7f71480c16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71480ca610 0x7f71480c16f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f714001a350 tx=0x7f71400195d0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 shutdown_connections 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71480ca610 0x7f71480c16f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7128066900 0x7f7128068dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71480bd720 0x7f71480c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 --2- 172.21.15.26:0/2810203244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f714806cd90 0x7f714814d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 >> 172.21.15.26:0/2810203244 conn(0x7f7148071ea0 msgr2=0x7f7148149d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:36.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 shutdown_connections 2023-11-28T16:56:36.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.787+0000 7f714d832640 1 -- 172.21.15.26:0/2810203244 wait complete. 2023-11-28T16:56:36.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:36.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 Processor -- start 2023-11-28T16:56:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 -- start start 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe84014eaf0 0x7fe840151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe840151f90 0x7fe84006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8400c0370 0x7fe84006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84006de00 con 0x7fe84014eaf0 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe840070390 con 0x7fe840151f90 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe846e09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84006db90 con 0x7fe8400c0370 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe84014eaf0 0x7fe840151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe84014eaf0 0x7fe840151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51320/0 (socket says 172.21.15.26:51320) 2023-11-28T16:56:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 -- 172.21.15.26:0/2840579134 learned_addr learned my addr 172.21.15.26:0/2840579134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe83ffff640 1 --2- 172.21.15.26:0/2840579134 >> v2:172.21.15.79:3300/0 conn(0x7fe840151f90 0x7fe84006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe8453a6640 1 --2- 172.21.15.26:0/2840579134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8400c0370 0x7fe84006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 -- 172.21.15.26:0/2840579134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8400c0370 msgr2=0x7fe84006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 --2- 172.21.15.26:0/2840579134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8400c0370 0x7fe84006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 -- 172.21.15.26:0/2840579134 >> v2:172.21.15.79:3300/0 conn(0x7fe840151f90 msgr2=0x7fe84006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 --2- 172.21.15.26:0/2840579134 >> v2:172.21.15.79:3300/0 conn(0x7fe840151f90 0x7fe84006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.955+0000 7fe844ba5640 1 -- 172.21.15.26:0/2840579134 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84014eed0 con 0x7fe84014eaf0 2023-11-28T16:56:36.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe844ba5640 1 --2- 172.21.15.26:0/2840579134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840151a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe84006e2d0 tx=0x7fe83401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94b6d7768d53a6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe83f7fe640 1 -- 172.21.15.26:0/2840579134 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340ac600 con 0x7fe84014eaf0 2023-11-28T16:56:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe83f7fe640 1 -- 172.21.15.26:0/2840579134 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8340a8050 con 0x7fe84014eaf0 2023-11-28T16:56:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe83f7fe640 1 -- 172.21.15.26:0/2840579134 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340ac980 con 0x7fe84014eaf0 2023-11-28T16:56:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 -- 172.21.15.26:0/2840579134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 msgr2=0x7fe840151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 --2- 172.21.15.26:0/2840579134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840151a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe84006e2d0 tx=0x7fe83401c3e0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 -- 172.21.15.26:0/2840579134 shutdown_connections 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 --2- 172.21.15.26:0/2840579134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8400c0370 0x7fe84006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 --2- 172.21.15.26:0/2840579134 >> v2:172.21.15.79:3300/0 conn(0x7fe840151f90 0x7fe84006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 --2- 172.21.15.26:0/2840579134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840151a50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 -- 172.21.15.26:0/2840579134 >> 172.21.15.26:0/2840579134 conn(0x7fe8400c2a60 msgr2=0x7fe8400c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 -- 172.21.15.26:0/2840579134 shutdown_connections 2023-11-28T16:56:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.959+0000 7fe846e09640 1 -- 172.21.15.26:0/2840579134 wait complete. 2023-11-28T16:56:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 Processor -- start 2023-11-28T16:56:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 -- start start 2023-11-28T16:56:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8400c0370 0x7fe8400bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe840152cb0 0x7fe840143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401441f0 con 0x7fe84014eaf0 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401ee450 con 0x7fe8400c0370 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401eded0 con 0x7fe840152cb0 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51324/0 (socket says 172.21.15.26:51324) 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 -- 172.21.15.26:0/3076224437 learned_addr learned my addr 172.21.15.26:0/3076224437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe844ba5640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8400c0370 0x7fe8400bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe8453a6640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe840152cb0 0x7fe840143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 -- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe840152cb0 msgr2=0x7fe840143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe840152cb0 0x7fe840143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 -- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8400c0370 msgr2=0x7fe8400bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8400c0370 0x7fe8400bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 -- 172.21.15.26:0/3076224437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340094d0 con 0x7fe84014eaf0 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83ffff640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840143770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e870 tx=0x7fe82c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83d7fa640 1 -- 172.21.15.26:0/3076224437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c009510 con 0x7fe84014eaf0 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83d7fa640 1 -- 172.21.15.26:0/3076224437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00eec0 con 0x7fe84014eaf0 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe83d7fa640 1 -- 172.21.15.26:0/3076224437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00cae0 con 0x7fe84014eaf0 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84006d620 con 0x7fe84014eaf0 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.963+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8400abbd0 con 0x7fe84014eaf0 2023-11-28T16:56:36.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.967+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84004e890 con 0x7fe84014eaf0 2023-11-28T16:56:36.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.967+0000 7fe83d7fa640 1 -- 172.21.15.26:0/3076224437 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe82c00cc40 con 0x7fe84014eaf0 2023-11-28T16:56:36.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.967+0000 7fe83d7fa640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8240668d0 0x7fe824068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:36.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.967+0000 7fe83d7fa640 1 -- 172.21.15.26:0/3076224437 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe82c0847c0 con 0x7fe84014eaf0 2023-11-28T16:56:36.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.967+0000 7fe844ba5640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8240668d0 0x7fe824068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:36.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.967+0000 7fe844ba5640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8240668d0 0x7fe824068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8340ae000 tx=0x7fe8340a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:36.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:36.971+0000 7fe83d7fa640 1 -- 172.21.15.26:0/3076224437 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe82c051ab0 con 0x7fe84014eaf0 2023-11-28T16:56:37.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.127+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8400c4c30 con 0x7fe84014eaf0 2023-11-28T16:56:37.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.127+0000 7fe83d7fa640 1 -- 172.21.15.26:0/3076224437 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe82c021020 con 0x7fe84014eaf0 2023-11-28T16:56:37.133 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:37.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8240668d0 msgr2=0x7fe824068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8240668d0 0x7fe824068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8340ae000 tx=0x7fe8340a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:37.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 msgr2=0x7fe840143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840143770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e870 tx=0x7fe82c00ec70 comp rx=0 tx=0).stop 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 shutdown_connections 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8240668d0 0x7fe824068d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe840152cb0 0x7fe840143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84014eaf0 0x7fe840143770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 --2- 172.21.15.26:0/3076224437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8400c0370 0x7fe8400bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 >> 172.21.15.26:0/3076224437 conn(0x7fe8400c2a60 msgr2=0x7fe84014dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 shutdown_connections 2023-11-28T16:56:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.131+0000 7fe846e09640 1 -- 172.21.15.26:0/3076224437 wait complete. 2023-11-28T16:56:37.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:37.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa397e17640 1 Processor -- start 2023-11-28T16:56:37.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa397e17640 1 -- start start 2023-11-28T16:56:37.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa397e17640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3900c8430 0x7fa39006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa397e17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39006cf70 con 0x7fa3900c7f20 2023-11-28T16:56:37.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa397e17640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa390152160 con 0x7fa390151d80 2023-11-28T16:56:37.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa397e17640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3900c6a30 con 0x7fa3900c8430 2023-11-28T16:56:37.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa3963b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa3900c7f20 0x7fa39006bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60374/0 (socket says 172.21.15.26:60374) 2023-11-28T16:56:37.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.295+0000 7fa3963b4640 1 -- 172.21.15.26:0/2512176187 learned_addr learned my addr 172.21.15.26:0/2512176187 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:37.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3953b2640 1 --2- 172.21.15.26:0/2512176187 >> v2:172.21.15.79:3300/0 conn(0x7fa3900c8430 0x7fa39006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213525998 0 0) 0x7fa39006cf70 con 0x7fa3900c7f20 2023-11-28T16:56:37.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa37c003530 con 0x7fa3900c7f20 2023-11-28T16:56:37.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480070226 0 0) 0x7fa37c003530 con 0x7fa3900c7f20 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 >> v2:172.21.15.79:3300/0 conn(0x7fa3900c8430 msgr2=0x7fa39006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 --2- 172.21.15.26:0/2512176187 >> v2:172.21.15.79:3300/0 conn(0x7fa3900c8430 0x7fa39006b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 >> v1:172.21.15.79:6789/0 conn(0x7fa390151d80 legacy=0x7fa3900c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900c72d0 con 0x7fa3900c7f20 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fa388001a20 con 0x7fa3900c7f20 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 >> v1:172.21.15.26:6789/0 conn(0x7fa3900c7f20 legacy=0x7fa39006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa37c003980 0x7fa37c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c0047d0 0x7fa37c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c005190 0x7fa37c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900c6a30 con 0x7fa37c005190 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c00c130 con 0x7fa37c0047d0 2023-11-28T16:56:37.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c00c2f0 con 0x7fa37c003980 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3953b2640 1 --2- 172.21.15.26:0/2512176187 >> v2:172.21.15.79:3300/0 conn(0x7fa3900c8430 0x7fa39006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3963b4640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c005190 0x7fa37c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa395bb3640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa37c003980 0x7fa37c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3953b2640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c0047d0 0x7fa37c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3963b4640 1 -- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa37c003980 msgr2=0x7fa37c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3963b4640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa37c003980 0x7fa37c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3963b4640 1 -- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c0047d0 msgr2=0x7fa37c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3963b4640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c0047d0 0x7fa37c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3963b4640 1 -- 172.21.15.26:0/2512176187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c003530 con 0x7fa37c005190 2023-11-28T16:56:37.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.299+0000 7fa3953b2640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c0047d0 0x7fa37c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa3963b4640 1 -- 172.21.15.26:0/2512176187 reap_dead start 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa3963b4640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c005190 0x7fa37c00b990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa38800a7f0 tx=0x7fa38801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66183969686345f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880aa670 con 0x7fa37c005190 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3880aa7f0 con 0x7fa37c005190 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa394bb1640 1 -- 172.21.15.26:0/2512176187 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880aaba0 con 0x7fa37c005190 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 -- 172.21.15.26:0/2512176187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c005190 msgr2=0x7fa37c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c005190 0x7fa37c00b990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa38800a7f0 tx=0x7fa38801fa40 comp rx=0 tx=0).stop 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 -- 172.21.15.26:0/2512176187 shutdown_connections 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 --2- 172.21.15.26:0/2512176187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa37c005190 0x7fa37c00b990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 -- 172.21.15.26:0/2512176187 >> 172.21.15.26:0/2512176187 conn(0x7fa3900abd00 msgr2=0x7fa3900ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:37.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 -- 172.21.15.26:0/2512176187 shutdown_connections 2023-11-28T16:56:37.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 -- 172.21.15.26:0/2512176187 wait complete. 2023-11-28T16:56:37.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 Processor -- start 2023-11-28T16:56:37.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.303+0000 7fa397e17640 1 -- start start 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c005190 0x7fa39006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3900c1b00 0x7fa3900c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3900c24c0 0x7fa3900aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900c3e70 con 0x7fa3900c24c0 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900c1390 con 0x7fa37c005190 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900c1670 con 0x7fa3900c1b00 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3900c24c0 0x7fa3900aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3900c24c0 0x7fa3900aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51340/0 (socket says 172.21.15.26:51340) 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 -- 172.21.15.26:0/3554500142 learned_addr learned my addr 172.21.15.26:0/3554500142 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa395bb3640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c005190 0x7fa39006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3953b2640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3900c1b00 0x7fa3900c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 -- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3900c1b00 msgr2=0x7fa3900c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3900c1b00 0x7fa3900c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 -- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c005190 msgr2=0x7fa39006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c005190 0x7fa39006b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 -- 172.21.15.26:0/3554500142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39014e360 con 0x7fa3900c24c0 2023-11-28T16:56:37.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3963b4640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3900c24c0 0x7fa3900aab20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3880202e0 tx=0x7fa37c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:37.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3867fc640 1 -- 172.21.15.26:0/3554500142 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880aa670 con 0x7fa3900c24c0 2023-11-28T16:56:37.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3867fc640 1 -- 172.21.15.26:0/3554500142 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa388001fa0 con 0x7fa3900c24c0 2023-11-28T16:56:37.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3867fc640 1 -- 172.21.15.26:0/3554500142 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388001a20 con 0x7fa3900c24c0 2023-11-28T16:56:37.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39014e080 con 0x7fa3900c24c0 2023-11-28T16:56:37.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3901edf20 con 0x7fa3900c24c0 2023-11-28T16:56:37.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3900c1820 con 0x7fa3900c24c0 2023-11-28T16:56:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.307+0000 7fa3867fc640 1 -- 172.21.15.26:0/3554500142 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3880b6480 con 0x7fa3900c24c0 2023-11-28T16:56:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.311+0000 7fa3867fc640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa374066900 0x7fa374068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.311+0000 7fa3867fc640 1 -- 172.21.15.26:0/3554500142 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa388121640 con 0x7fa3900c24c0 2023-11-28T16:56:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.311+0000 7fa395bb3640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa374066900 0x7fa374068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.311+0000 7fa395bb3640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa374066900 0x7fa374068dc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa38c007fd0 tx=0x7fa38c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.315+0000 7fa3867fc640 1 -- 172.21.15.26:0/3554500142 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3900c1820 con 0x7fa3900c24c0 2023-11-28T16:56:37.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3900c1820 con 0x7fa3900c24c0 2023-11-28T16:56:37.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa3867fc640 1 -- 172.21.15.26:0/3554500142 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3900c1820 con 0x7fa3900c24c0 2023-11-28T16:56:37.479 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:37.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa374066900 msgr2=0x7fa374068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa374066900 0x7fa374068dc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa38c007fd0 tx=0x7fa38c009040 comp rx=0 tx=0).stop 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3900c24c0 msgr2=0x7fa3900aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3900c24c0 0x7fa3900aab20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3880202e0 tx=0x7fa37c005800 comp rx=0 tx=0).stop 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 shutdown_connections 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3900c24c0 0x7fa3900aab20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa374066900 0x7fa374068dc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3900c1b00 0x7fa3900c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 --2- 172.21.15.26:0/3554500142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37c005190 0x7fa39006b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 >> 172.21.15.26:0/3554500142 conn(0x7fa3900abd00 msgr2=0x7fa3900c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 shutdown_connections 2023-11-28T16:56:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.475+0000 7fa397e17640 1 -- 172.21.15.26:0/3554500142 wait complete. 2023-11-28T16:56:37.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:37.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 Processor -- start 2023-11-28T16:56:37.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 -- start start 2023-11-28T16:56:37.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f294c0c6220 0x7f294c158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f294c0c13a0 0x7f294c0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c151bf0 0x7f294c152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c158580 con 0x7f294c0c13a0 2023-11-28T16:56:37.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c157f50 con 0x7f294c0c6220 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2950d80640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0c1f60 con 0x7f294c151bf0 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f294c0c13a0 0x7f294c0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f294c0c13a0 0x7f294c0c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51348/0 (socket says 172.21.15.26:51348) 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 -- 172.21.15.26:0/2914824533 learned_addr learned my addr 172.21.15.26:0/2914824533 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f294ad9d640 1 --2- 172.21.15.26:0/2914824533 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c151bf0 0x7f294c152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f294a59c640 1 --2- 172.21.15.26:0/2914824533 >> v2:172.21.15.79:3300/0 conn(0x7f294c0c6220 0x7f294c158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 -- 172.21.15.26:0/2914824533 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c151bf0 msgr2=0x7f294c152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 --2- 172.21.15.26:0/2914824533 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c151bf0 0x7f294c152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 -- 172.21.15.26:0/2914824533 >> v2:172.21.15.79:3300/0 conn(0x7f294c0c6220 msgr2=0x7f294c158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 --2- 172.21.15.26:0/2914824533 >> v2:172.21.15.79:3300/0 conn(0x7f294c0c6220 0x7f294c158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.642+0000 7f2943fff640 1 -- 172.21.15.26:0/2914824533 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c0c2240 con 0x7f294c0c13a0 2023-11-28T16:56:37.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2943fff640 1 --2- 172.21.15.26:0/2914824533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c0c13a0 0x7f294c0c28c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f294c06b500 tx=0x7f293401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf35ad3e5d42339 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:37.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2949d9b640 1 -- 172.21.15.26:0/2914824533 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29340a7070 con 0x7f294c0c13a0 2023-11-28T16:56:37.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2949d9b640 1 -- 172.21.15.26:0/2914824533 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29340ab430 con 0x7f294c0c13a0 2023-11-28T16:56:37.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2949d9b640 1 -- 172.21.15.26:0/2914824533 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29340ab7c0 con 0x7f294c0c13a0 2023-11-28T16:56:37.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 -- 172.21.15.26:0/2914824533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c0c13a0 msgr2=0x7f294c0c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 --2- 172.21.15.26:0/2914824533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c0c13a0 0x7f294c0c28c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f294c06b500 tx=0x7f293401c4d0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 -- 172.21.15.26:0/2914824533 shutdown_connections 2023-11-28T16:56:37.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 --2- 172.21.15.26:0/2914824533 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c151bf0 0x7f294c152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 --2- 172.21.15.26:0/2914824533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c0c13a0 0x7f294c0c28c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 --2- 172.21.15.26:0/2914824533 >> v2:172.21.15.79:3300/0 conn(0x7f294c0c6220 0x7f294c158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 -- 172.21.15.26:0/2914824533 >> 172.21.15.26:0/2914824533 conn(0x7f294c06a5a0 msgr2=0x7f294c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:37.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 -- 172.21.15.26:0/2914824533 shutdown_connections 2023-11-28T16:56:37.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 -- 172.21.15.26:0/2914824533 wait complete. 2023-11-28T16:56:37.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.646+0000 7f2950d80640 1 Processor -- start 2023-11-28T16:56:37.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f2950d80640 1 -- start start 2023-11-28T16:56:37.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f2950d80640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c0c13a0 0x7f294c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f2950d80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f294c0c6220 0x7f294c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f2950d80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c151bf0 0x7f294c148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f2950d80640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0add30 con 0x7f294c151bf0 2023-11-28T16:56:37.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f2950d80640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c155630 con 0x7f294c0c6220 2023-11-28T16:56:37.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f2950d80640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c154a00 con 0x7f294c0c13a0 2023-11-28T16:56:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c151bf0 0x7f294c148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.650+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c151bf0 0x7f294c148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51352/0 (socket says 172.21.15.26:51352) 2023-11-28T16:56:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294ad9d640 1 -- 172.21.15.26:0/2812703456 learned_addr learned my addr 172.21.15.26:0/2812703456 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294a59c640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c0c13a0 0x7f294c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2943fff640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f294c0c6220 0x7f294c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294ad9d640 1 -- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c0c13a0 msgr2=0x7f294c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294ad9d640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c0c13a0 0x7f294c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294ad9d640 1 -- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f294c0c6220 msgr2=0x7f294c1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294ad9d640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f294c0c6220 0x7f294c1509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294ad9d640 1 -- 172.21.15.26:0/2812703456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934009480 con 0x7f294c151bf0 2023-11-28T16:56:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f294ad9d640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c151bf0 0x7f294c148eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2944007e70 tx=0x7f294400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2942ffd640 1 -- 172.21.15.26:0/2812703456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944014620 con 0x7f294c151bf0 2023-11-28T16:56:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2942ffd640 1 -- 172.21.15.26:0/2812703456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29440147a0 con 0x7f294c151bf0 2023-11-28T16:56:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2942ffd640 1 -- 172.21.15.26:0/2812703456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944014b50 con 0x7f294c151bf0 2023-11-28T16:56:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c155860 con 0x7f294c151bf0 2023-11-28T16:56:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c1543b0 con 0x7f294c151bf0 2023-11-28T16:56:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c154b70 con 0x7f294c151bf0 2023-11-28T16:56:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2942ffd640 1 -- 172.21.15.26:0/2812703456 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2944014cb0 con 0x7f294c151bf0 2023-11-28T16:56:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2942ffd640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f292c0668d0 0x7f292c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.654+0000 7f2942ffd640 1 -- 172.21.15.26:0/2812703456 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2944084ee0 con 0x7f294c151bf0 2023-11-28T16:56:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.658+0000 7f294a59c640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f292c0668d0 0x7f292c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.658+0000 7f294a59c640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f292c0668d0 0x7f292c068d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f293c00ba30 tx=0x7f293c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.662+0000 7f2942ffd640 1 -- 172.21.15.26:0/2812703456 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2944051ff0 con 0x7f294c151bf0 2023-11-28T16:56:37.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.814+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f294c04e890 con 0x7f294c151bf0 2023-11-28T16:56:37.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.814+0000 7f2942ffd640 1 -- 172.21.15.26:0/2812703456 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2944055610 con 0x7f294c151bf0 2023-11-28T16:56:37.821 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:37.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f292c0668d0 msgr2=0x7f292c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f292c0668d0 0x7f292c068d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f293c00ba30 tx=0x7f293c008040 comp rx=0 tx=0).stop 2023-11-28T16:56:37.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c151bf0 msgr2=0x7f294c148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c151bf0 0x7f294c148eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2944007e70 tx=0x7f294400e4b0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 shutdown_connections 2023-11-28T16:56:37.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294c151bf0 0x7f294c148eb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f294c0c6220 0x7f294c1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f292c0668d0 0x7f292c068d90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 --2- 172.21.15.26:0/2812703456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f294c0c13a0 0x7f294c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 >> 172.21.15.26:0/2812703456 conn(0x7f294c06a5a0 msgr2=0x7f294c14fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:37.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 shutdown_connections 2023-11-28T16:56:37.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.818+0000 7f2950d80640 1 -- 172.21.15.26:0/2812703456 wait complete. 2023-11-28T16:56:37.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:37.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c13632640 1 Processor -- start 2023-11-28T16:56:37.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c13632640 1 -- start start 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c13632640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c0c0ca610 0x7f0c0c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c13632640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c13632640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c155790 con 0x7f0c0c06cd90 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c13632640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c0c4b00 con 0x7f0c0c0ca610 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c13632640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0c4de0 con 0x7f0c0c0bd720 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c11bcf640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0c0c06cd90 0x7f0c0c158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60376/0 (socket says 172.21.15.26:60376) 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c11bcf640 1 -- 172.21.15.26:0/3738013855 learned_addr learned my addr 172.21.15.26:0/3738013855 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c113ce640 1 --2- 172.21.15.26:0/3738013855 >> v2:172.21.15.79:3300/0 conn(0x7f0c0c0ca610 0x7f0c0c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c10bcd640 1 --2- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c03fff640 1 -- 172.21.15.26:0/3738013855 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186295099 0 0) 0x7f0c0c155790 con 0x7f0c0c06cd90 2023-11-28T16:56:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c03fff640 1 -- 172.21.15.26:0/3738013855 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf8003530 con 0x7f0c0c06cd90 2023-11-28T16:56:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c113ce640 1 -- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 msgr2=0x7f0c0c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c113ce640 1 --2- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c113ce640 1 -- 172.21.15.26:0/3738013855 >> v1:172.21.15.26:6789/0 conn(0x7f0c0c06cd90 legacy=0x7f0c0c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c113ce640 1 -- 172.21.15.26:0/3738013855 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c157e30 con 0x7f0c0c0ca610 2023-11-28T16:56:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.982+0000 7f0c10bcd640 1 --2- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:37.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c113ce640 1 --2- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0c94c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c080097c0 tx=0x7f0c0801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=185a7aa4d6ea3d54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:37.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c03fff640 1 -- 172.21.15.26:0/3738013855 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0c52d0 con 0x7f0c0c0ca610 2023-11-28T16:56:37.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c03fff640 1 -- 172.21.15.26:0/3738013855 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c080a4880 con 0x7f0c0c0ca610 2023-11-28T16:56:37.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c03fff640 1 -- 172.21.15.26:0/3738013855 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080a4c10 con 0x7f0c0c0ca610 2023-11-28T16:56:37.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 -- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 msgr2=0x7f0c0c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:37.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 --2- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0c94c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c080097c0 tx=0x7f0c0801c040 comp rx=0 tx=0).stop 2023-11-28T16:56:37.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 -- 172.21.15.26:0/3738013855 shutdown_connections 2023-11-28T16:56:37.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 --2- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 --2- 172.21.15.26:0/3738013855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0c94c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:37.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 -- 172.21.15.26:0/3738013855 >> 172.21.15.26:0/3738013855 conn(0x7f0c0c071ea0 msgr2=0x7f0c0c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:37.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 -- 172.21.15.26:0/3738013855 shutdown_connections 2023-11-28T16:56:37.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.986+0000 7f0c13632640 1 -- 172.21.15.26:0/3738013855 wait complete. 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 Processor -- start 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 -- start start 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c0c06cd90 0x7f0c0c14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0bf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c153500 con 0x7f0c0c06cd90 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c1546b0 con 0x7f0c0c0ca610 2023-11-28T16:56:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c1537a0 con 0x7f0c0c0bd720 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c0c06cd90 0x7f0c0c14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c0c06cd90 0x7f0c0c14b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51354/0 (socket says 172.21.15.26:51354) 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 -- 172.21.15.26:0/3741905720 learned_addr learned my addr 172.21.15.26:0/3741905720 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c10bcd640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c11bcf640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 -- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 msgr2=0x7f0c0c0bf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0bf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 -- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 msgr2=0x7f0c0c0bfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0bfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 -- 172.21.15.26:0/3741905720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc009420 con 0x7f0c0c06cd90 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c11bcf640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0bfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c113ce640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c0c06cd90 0x7f0c0c14b8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c08019e80 tx=0x7f0c08019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c01ffb640 1 -- 172.21.15.26:0/3741905720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080ac850 con 0x7f0c0c06cd90 2023-11-28T16:56:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c01ffb640 1 -- 172.21.15.26:0/3741905720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c080ac9d0 con 0x7f0c0c06cd90 2023-11-28T16:56:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c01ffb640 1 -- 172.21.15.26:0/3741905720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080acd80 con 0x7f0c0c06cd90 2023-11-28T16:56:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c08009420 con 0x7f0c0c06cd90 2023-11-28T16:56:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.990+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c0bdf70 con 0x7f0c0c06cd90 2023-11-28T16:56:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.994+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c1532d0 con 0x7f0c0c06cd90 2023-11-28T16:56:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.994+0000 7f0c01ffb640 1 -- 172.21.15.26:0/3741905720 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c080b3040 con 0x7f0c0c06cd90 2023-11-28T16:56:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.994+0000 7f0c01ffb640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bf00668d0 0x7f0bf0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.994+0000 7f0c01ffb640 1 -- 172.21.15.26:0/3741905720 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c0c0cac00 con 0x7f0c0c06cd90 2023-11-28T16:56:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.994+0000 7f0c10bcd640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bf00668d0 0x7f0bf0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.994+0000 7f0c10bcd640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bf00668d0 0x7f0bf0068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c067a90 tx=0x7f0bfc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:37.998+0000 7f0c01ffb640 1 -- 172.21.15.26:0/3741905720 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c080eaf70 con 0x7f0c0c06cd90 2023-11-28T16:56:38.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.158+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c0c04e890 con 0x7f0c0c06cd90 2023-11-28T16:56:38.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.158+0000 7f0c01ffb640 1 -- 172.21.15.26:0/3741905720 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f0c080c3090 con 0x7f0c0c06cd90 2023-11-28T16:56:38.166 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:38.166 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:38.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bf00668d0 msgr2=0x7f0bf0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bf00668d0 0x7f0bf0068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c067a90 tx=0x7f0bfc009190 comp rx=0 tx=0).stop 2023-11-28T16:56:38.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c0c06cd90 msgr2=0x7f0c0c14b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c0c06cd90 0x7f0c0c14b8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c08019e80 tx=0x7f0c08019100 comp rx=0 tx=0).stop 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 shutdown_connections 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c0c0ca610 0x7f0c0c0bfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bf00668d0 0x7f0bf0068d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c0c0bd720 0x7f0c0c0bf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 --2- 172.21.15.26:0/3741905720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c0c06cd90 0x7f0c0c14b8e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 >> 172.21.15.26:0/3741905720 conn(0x7f0c0c071ea0 msgr2=0x7f0c0c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 shutdown_connections 2023-11-28T16:56:38.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.162+0000 7f0c13632640 1 -- 172.21.15.26:0/3741905720 wait complete. 2023-11-28T16:56:38.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:38.187 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:38.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.326+0000 7f8b5df3e640 1 Processor -- start 2023-11-28T16:56:38.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b5df3e640 1 -- start start 2023-11-28T16:56:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b5df3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b580c6220 0x7f8b58158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b5df3e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b580c13a0 0x7f8b580c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b5df3e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b58158580 con 0x7f8b58151bf0 2023-11-28T16:56:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b5df3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b58157f50 con 0x7f8b580c6220 2023-11-28T16:56:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b5df3e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b580c1f60 con 0x7f8b580c13a0 2023-11-28T16:56:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b577fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b580c6220 0x7f8b58158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b577fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b580c6220 0x7f8b58158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51358/0 (socket says 172.21.15.26:51358) 2023-11-28T16:56:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b577fe640 1 -- 172.21.15.26:0/2480267772 learned_addr learned my addr 172.21.15.26:0/2480267772 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b56ffd640 1 --2- 172.21.15.26:0/2480267772 >> v2:172.21.15.79:3300/0 conn(0x7f8b580c13a0 0x7f8b580c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b577fe640 1 -- 172.21.15.26:0/2480267772 >> v2:172.21.15.79:3300/0 conn(0x7f8b580c13a0 msgr2=0x7f8b580c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b577fe640 1 --2- 172.21.15.26:0/2480267772 >> v2:172.21.15.79:3300/0 conn(0x7f8b580c13a0 0x7f8b580c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b577fe640 1 -- 172.21.15.26:0/2480267772 >> v1:172.21.15.79:6789/0 conn(0x7f8b58151bf0 legacy=0x7f8b580a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b577fe640 1 -- 172.21.15.26:0/2480267772 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580c2240 con 0x7f8b580c6220 2023-11-28T16:56:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.330+0000 7f8b56ffd640 1 --2- 172.21.15.26:0/2480267772 >> v2:172.21.15.79:3300/0 conn(0x7f8b580c13a0 0x7f8b580c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b577fe640 1 --2- 172.21.15.26:0/2480267772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58158a10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8b58071980 tx=0x7f8b4801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e2e90bbeda3d82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b567fc640 1 -- 172.21.15.26:0/2480267772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480aa610 con 0x7f8b580c6220 2023-11-28T16:56:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b567fc640 1 -- 172.21.15.26:0/2480267772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b480a6040 con 0x7f8b580c6220 2023-11-28T16:56:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b567fc640 1 -- 172.21.15.26:0/2480267772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480aa990 con 0x7f8b580c6220 2023-11-28T16:56:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 -- 172.21.15.26:0/2480267772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 msgr2=0x7f8b58158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/2480267772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58158a10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8b58071980 tx=0x7f8b4801c490 comp rx=0 tx=0).stop 2023-11-28T16:56:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 -- 172.21.15.26:0/2480267772 shutdown_connections 2023-11-28T16:56:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/2480267772 >> v2:172.21.15.79:3300/0 conn(0x7f8b580c13a0 0x7f8b580c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/2480267772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58158a10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 -- 172.21.15.26:0/2480267772 >> 172.21.15.26:0/2480267772 conn(0x7f8b5806a5a0 msgr2=0x7f8b5806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 -- 172.21.15.26:0/2480267772 shutdown_connections 2023-11-28T16:56:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 -- 172.21.15.26:0/2480267772 wait complete. 2023-11-28T16:56:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 Processor -- start 2023-11-28T16:56:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.334+0000 7f8b5df3e640 1 -- start start 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580c13a0 0x7f8b580ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b58151bf0 0x7f8b581f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580ac440 con 0x7f8b580c6220 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581f08d0 con 0x7f8b580c13a0 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580abba0 con 0x7f8b58151bf0 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580c13a0 0x7f8b580ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51366/0 (socket says 172.21.15.26:51366) 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 -- 172.21.15.26:0/984374896 learned_addr learned my addr 172.21.15.26:0/984374896 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b57fff640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b58151bf0 0x7f8b581f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 -- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b58151bf0 msgr2=0x7f8b581f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b58151bf0 0x7f8b581f0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 -- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580c13a0 msgr2=0x7f8b580ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580c13a0 0x7f8b580ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 -- 172.21.15.26:0/984374896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480094d0 con 0x7f8b580c6220 2023-11-28T16:56:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b577fe640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580c13a0 0x7f8b580ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b56ffd640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58156dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c7f0 tx=0x7f8b4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b3ffff640 1 -- 172.21.15.26:0/984374896 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c005ba0 con 0x7f8b580c6220 2023-11-28T16:56:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b3ffff640 1 -- 172.21.15.26:0/984374896 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c005d00 con 0x7f8b580c6220 2023-11-28T16:56:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b3ffff640 1 -- 172.21.15.26:0/984374896 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c007a50 con 0x7f8b580c6220 2023-11-28T16:56:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b580abe80 con 0x7f8b580c6220 2023-11-28T16:56:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b58157300 con 0x7f8b580c6220 2023-11-28T16:56:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.338+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5804e890 con 0x7f8b580c6220 2023-11-28T16:56:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.342+0000 7f8b3ffff640 1 -- 172.21.15.26:0/984374896 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8b4c007bb0 con 0x7f8b580c6220 2023-11-28T16:56:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.342+0000 7f8b3ffff640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b440668d0 0x7f8b44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.342+0000 7f8b3ffff640 1 -- 172.21.15.26:0/984374896 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b4c084380 con 0x7f8b580c6220 2023-11-28T16:56:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.342+0000 7f8b577fe640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b440668d0 0x7f8b44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.342+0000 7f8b577fe640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b440668d0 0x7f8b44068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b480ae000 tx=0x7f8b480b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.346+0000 7f8b3ffff640 1 -- 172.21.15.26:0/984374896 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b4c051660 con 0x7f8b580c6220 2023-11-28T16:56:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b5814fcb0 con 0x7f8b580c6220 2023-11-28T16:56:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b3ffff640 1 -- 172.21.15.26:0/984374896 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b4c01e020 con 0x7f8b580c6220 2023-11-28T16:56:38.511 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b440668d0 msgr2=0x7f8b44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b440668d0 0x7f8b44068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b480ae000 tx=0x7f8b480b5040 comp rx=0 tx=0).stop 2023-11-28T16:56:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 msgr2=0x7f8b58156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58156dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c7f0 tx=0x7f8b4c00cbf0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 shutdown_connections 2023-11-28T16:56:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b440668d0 0x7f8b44068d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b58151bf0 0x7f8b581f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b580c6220 0x7f8b58156dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 --2- 172.21.15.26:0/984374896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580c13a0 0x7f8b580ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 >> 172.21.15.26:0/984374896 conn(0x7f8b5806a5a0 msgr2=0x7f8b5806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 shutdown_connections 2023-11-28T16:56:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.506+0000 7f8b5df3e640 1 -- 172.21.15.26:0/984374896 wait complete. 2023-11-28T16:56:38.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 Processor -- start 2023-11-28T16:56:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 -- start start 2023-11-28T16:56:38.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c980a86d0 0x7f1c980a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c98156600 0x7f1c9814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c9814fb30 0x7f1c980aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c98152d90 con 0x7f1c980a86d0 2023-11-28T16:56:38.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c98152480 con 0x7f1c98156600 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.674+0000 7f1c9e0ea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980a9760 con 0x7f1c9814fb30 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c980a86d0 0x7f1c980a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c980a86d0 0x7f1c980a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51368/0 (socket says 172.21.15.26:51368) 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 -- 172.21.15.26:0/286572537 learned_addr learned my addr 172.21.15.26:0/286572537 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c97fff640 1 --2- 172.21.15.26:0/286572537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c9814fb30 0x7f1c980aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c8ffff640 1 --2- 172.21.15.26:0/286572537 >> v2:172.21.15.79:3300/0 conn(0x7f1c98156600 0x7f1c9814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 -- 172.21.15.26:0/286572537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c9814fb30 msgr2=0x7f1c980aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 --2- 172.21.15.26:0/286572537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c9814fb30 0x7f1c980aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 -- 172.21.15.26:0/286572537 >> v2:172.21.15.79:3300/0 conn(0x7f1c98156600 msgr2=0x7f1c9814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:38.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 --2- 172.21.15.26:0/286572537 >> v2:172.21.15.79:3300/0 conn(0x7f1c98156600 0x7f1c9814f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 -- 172.21.15.26:0/286572537 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98152740 con 0x7f1c980a86d0 2023-11-28T16:56:38.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c8ffff640 1 --2- 172.21.15.26:0/286572537 >> v2:172.21.15.79:3300/0 conn(0x7f1c98156600 0x7f1c9814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:38.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c977fe640 1 --2- 172.21.15.26:0/286572537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c980a8f30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009870 tx=0x7f1c8801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c72c7f7d5830ab4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c96ffd640 1 -- 172.21.15.26:0/286572537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880ab600 con 0x7f1c980a86d0 2023-11-28T16:56:38.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c96ffd640 1 -- 172.21.15.26:0/286572537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c880a7050 con 0x7f1c980a86d0 2023-11-28T16:56:38.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.678+0000 7f1c96ffd640 1 -- 172.21.15.26:0/286572537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880ab980 con 0x7f1c980a86d0 2023-11-28T16:56:38.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/286572537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 msgr2=0x7f1c980a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/286572537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c980a8f30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009870 tx=0x7f1c8801c500 comp rx=0 tx=0).stop 2023-11-28T16:56:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/286572537 shutdown_connections 2023-11-28T16:56:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/286572537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c9814fb30 0x7f1c980aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/286572537 >> v2:172.21.15.79:3300/0 conn(0x7f1c98156600 0x7f1c9814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/286572537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c980a8f30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/286572537 >> 172.21.15.26:0/286572537 conn(0x7f1c980c2a60 msgr2=0x7f1c980c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/286572537 shutdown_connections 2023-11-28T16:56:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/286572537 wait complete. 2023-11-28T16:56:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 Processor -- start 2023-11-28T16:56:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- start start 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c981f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814fb30 0x7f1c981512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98156600 0x7f1c9814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c98070e20 con 0x7f1c980a86d0 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c981f1260 con 0x7f1c9814fb30 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c9e0ea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c98145b20 con 0x7f1c98156600 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c981f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c981f0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51380/0 (socket says 172.21.15.26:51380) 2023-11-28T16:56:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 -- 172.21.15.26:0/852433606 learned_addr learned my addr 172.21.15.26:0/852433606 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c8ffff640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814fb30 0x7f1c981512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c97fff640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98156600 0x7f1c9814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 -- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98156600 msgr2=0x7f1c9814a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98156600 0x7f1c9814a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 -- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814fb30 msgr2=0x7f1c981512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814fb30 0x7f1c981512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.682+0000 7f1c977fe640 1 -- 172.21.15.26:0/852433606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880094d0 con 0x7f1c980a86d0 2023-11-28T16:56:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c977fe640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c981f0d20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c880ae040 tx=0x7f1c8801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c94ff9640 1 -- 172.21.15.26:0/852433606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880b6420 con 0x7f1c980a86d0 2023-11-28T16:56:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c94ff9640 1 -- 172.21.15.26:0/852433606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c880b6580 con 0x7f1c980a86d0 2023-11-28T16:56:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c94ff9640 1 -- 172.21.15.26:0/852433606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880b6930 con 0x7f1c980a86d0 2023-11-28T16:56:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c981533a0 con 0x7f1c980a86d0 2023-11-28T16:56:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c98145d70 con 0x7f1c980a86d0 2023-11-28T16:56:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c98070fd0 con 0x7f1c980a86d0 2023-11-28T16:56:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c94ff9640 1 -- 172.21.15.26:0/852433606 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c880b2040 con 0x7f1c980a86d0 2023-11-28T16:56:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c94ff9640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c780668d0 0x7f1c78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.686+0000 7f1c94ff9640 1 -- 172.21.15.26:0/852433606 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c8811e6f0 con 0x7f1c980a86d0 2023-11-28T16:56:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.690+0000 7f1c8ffff640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c780668d0 0x7f1c78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.690+0000 7f1c8ffff640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c780668d0 0x7f1c78068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c98070940 tx=0x7f1c80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.690+0000 7f1c94ff9640 1 -- 172.21.15.26:0/852433606 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c98070fd0 con 0x7f1c980a86d0 2023-11-28T16:56:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.850+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c98070fd0 con 0x7f1c980a86d0 2023-11-28T16:56:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.850+0000 7f1c94ff9640 1 -- 172.21.15.26:0/852433606 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c98070fd0 con 0x7f1c980a86d0 2023-11-28T16:56:38.857 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c780668d0 msgr2=0x7f1c78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c780668d0 0x7f1c78068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c98070940 tx=0x7f1c80008040 comp rx=0 tx=0).stop 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 msgr2=0x7f1c981f0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c981f0d20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c880ae040 tx=0x7f1c8801ad40 comp rx=0 tx=0).stop 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 shutdown_connections 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c780668d0 0x7f1c78068d90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98156600 0x7f1c9814a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814fb30 0x7f1c981512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 --2- 172.21.15.26:0/852433606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a86d0 0x7f1c981f0d20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:38.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 >> 172.21.15.26:0/852433606 conn(0x7f1c980c2a60 msgr2=0x7f1c98151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:38.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 shutdown_connections 2023-11-28T16:56:38.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:38.854+0000 7f1c9e0ea640 1 -- 172.21.15.26:0/852433606 wait complete. 2023-11-28T16:56:38.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:39.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.018+0000 7f77e9432640 1 Processor -- start 2023-11-28T16:56:39.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.018+0000 7f77e9432640 1 -- start start 2023-11-28T16:56:39.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.018+0000 7f77e9432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e414eaf0 0x7f77e4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.018+0000 7f77e9432640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e406de00 con 0x7f77e40c0370 2023-11-28T16:56:39.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.018+0000 7f77e9432640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e4070390 con 0x7f77e4151f90 2023-11-28T16:56:39.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.018+0000 7f77e9432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e414eed0 con 0x7f77e414eaf0 2023-11-28T16:56:39.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f77e40c0370 0x7f77e415bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60392/0 (socket says 172.21.15.26:60392) 2023-11-28T16:56:39.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e37fe640 1 -- 172.21.15.26:0/3387474172 learned_addr learned my addr 172.21.15.26:0/3387474172 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:39.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e2ffd640 1 --2- 172.21.15.26:0/3387474172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e414eaf0 0x7f77e4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e27fc640 1 -- 172.21.15.26:0/3387474172 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294183989 0 0) 0x7f77e406de00 con 0x7f77e40c0370 2023-11-28T16:56:39.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e27fc640 1 -- 172.21.15.26:0/3387474172 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d0003530 con 0x7f77e40c0370 2023-11-28T16:56:39.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e27fc640 1 -- 172.21.15.26:0/3387474172 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108268442 0 0) 0x7f77e4070390 con 0x7f77e4151f90 2023-11-28T16:56:39.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e27fc640 1 -- 172.21.15.26:0/3387474172 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e406de00 con 0x7f77e4151f90 2023-11-28T16:56:39.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e2ffd640 1 -- 172.21.15.26:0/3387474172 >> v1:172.21.15.79:6789/0 conn(0x7f77e4151f90 legacy=0x7f77e406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e2ffd640 1 -- 172.21.15.26:0/3387474172 >> v1:172.21.15.26:6789/0 conn(0x7f77e40c0370 legacy=0x7f77e415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e2ffd640 1 -- 172.21.15.26:0/3387474172 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4151270 con 0x7f77e414eaf0 2023-11-28T16:56:39.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e2ffd640 1 --2- 172.21.15.26:0/3387474172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e414eaf0 0x7f77e4151a50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77d40097f0 tx=0x7f77d401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74eba48a61522fb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e27fc640 1 -- 172.21.15.26:0/3387474172 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40ab600 con 0x7f77e414eaf0 2023-11-28T16:56:39.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e27fc640 1 -- 172.21.15.26:0/3387474172 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40a7050 con 0x7f77e414eaf0 2023-11-28T16:56:39.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.022+0000 7f77e27fc640 1 -- 172.21.15.26:0/3387474172 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40ab980 con 0x7f77e414eaf0 2023-11-28T16:56:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- 172.21.15.26:0/3387474172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e414eaf0 msgr2=0x7f77e4151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 --2- 172.21.15.26:0/3387474172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e414eaf0 0x7f77e4151a50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77d40097f0 tx=0x7f77d401c370 comp rx=0 tx=0).stop 2023-11-28T16:56:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- 172.21.15.26:0/3387474172 shutdown_connections 2023-11-28T16:56:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 --2- 172.21.15.26:0/3387474172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e414eaf0 0x7f77e4151a50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- 172.21.15.26:0/3387474172 >> 172.21.15.26:0/3387474172 conn(0x7f77e40c2a60 msgr2=0x7f77e40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- 172.21.15.26:0/3387474172 shutdown_connections 2023-11-28T16:56:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- 172.21.15.26:0/3387474172 wait complete. 2023-11-28T16:56:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 Processor -- start 2023-11-28T16:56:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- start start 2023-11-28T16:56:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e40c0370 0x7f77e41eb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e414eaf0 0x7f77e40ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e4142a80 0x7f77e41438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40ab6d0 con 0x7f77e40c0370 2023-11-28T16:56:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e414f0e0 con 0x7f77e414eaf0 2023-11-28T16:56:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e9432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e41eb7b0 con 0x7f77e4142a80 2023-11-28T16:56:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e40c0370 0x7f77e41eb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e40c0370 0x7f77e41eb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51388/0 (socket says 172.21.15.26:51388) 2023-11-28T16:56:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 -- 172.21.15.26:0/3972318328 learned_addr learned my addr 172.21.15.26:0/3972318328 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77dbfff640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e414eaf0 0x7f77e40ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e37fe640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e4142a80 0x7f77e41438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 -- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e4142a80 msgr2=0x7f77e41438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e4142a80 0x7f77e41438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 -- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e414eaf0 msgr2=0x7f77e40ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e414eaf0 0x7f77e40ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.026+0000 7f77e2ffd640 1 -- 172.21.15.26:0/3972318328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4009420 con 0x7f77e40c0370 2023-11-28T16:56:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77e2ffd640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e40c0370 0x7f77e41eb1d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f77d4018f80 tx=0x7f77d401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77db7fe640 1 -- 172.21.15.26:0/3972318328 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40b7450 con 0x7f77e40c0370 2023-11-28T16:56:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77db7fe640 1 -- 172.21.15.26:0/3972318328 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40b75d0 con 0x7f77e40c0370 2023-11-28T16:56:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e41eba90 con 0x7f77e40c0370 2023-11-28T16:56:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77db7fe640 1 -- 172.21.15.26:0/3972318328 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40b7980 con 0x7f77e40c0370 2023-11-28T16:56:39.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e41ec050 con 0x7f77e40c0370 2023-11-28T16:56:39.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e404e890 con 0x7f77e40c0370 2023-11-28T16:56:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77db7fe640 1 -- 172.21.15.26:0/3972318328 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f77d40b7ae0 con 0x7f77e40c0370 2023-11-28T16:56:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77db7fe640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77c4066900 0x7f77c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77db7fe640 1 -- 172.21.15.26:0/3972318328 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77d411e810 con 0x7f77e40c0370 2023-11-28T16:56:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.030+0000 7f77dbfff640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77c4066900 0x7f77c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.034+0000 7f77dbfff640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77c4066900 0x7f77c4068dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77e40ab910 tx=0x7f77cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.034+0000 7f77db7fe640 1 -- 172.21.15.26:0/3972318328 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77d40eba70 con 0x7f77e40c0370 2023-11-28T16:56:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.190+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77e40a9140 con 0x7f77e40c0370 2023-11-28T16:56:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77db7fe640 1 -- 172.21.15.26:0/3972318328 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77d40ef090 con 0x7f77e40c0370 2023-11-28T16:56:39.199 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77c4066900 msgr2=0x7f77c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77c4066900 0x7f77c4068dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77e40ab910 tx=0x7f77cc009040 comp rx=0 tx=0).stop 2023-11-28T16:56:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e40c0370 msgr2=0x7f77e41eb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e40c0370 0x7f77e41eb1d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f77d4018f80 tx=0x7f77d401abb0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 shutdown_connections 2023-11-28T16:56:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77c4066900 0x7f77c4068dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77e4142a80 0x7f77e41438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e414eaf0 0x7f77e40ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 --2- 172.21.15.26:0/3972318328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e40c0370 0x7f77e41eb1d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 >> 172.21.15.26:0/3972318328 conn(0x7f77e40c2a60 msgr2=0x7f77e414be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 shutdown_connections 2023-11-28T16:56:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.194+0000 7f77e9432640 1 -- 172.21.15.26:0/3972318328 wait complete. 2023-11-28T16:56:39.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:39.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabf5a5a640 1 Processor -- start 2023-11-28T16:56:39.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabf5a5a640 1 -- start start 2023-11-28T16:56:39.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabf5a5a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabf00aacd0 0x7fabf0154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabf5a5a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00700a0 0x7fabf01546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabf5a5a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf0072780 con 0x7fabf00ab7a0 2023-11-28T16:56:39.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabf5a5a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00ac160 con 0x7fabf00aacd0 2023-11-28T16:56:39.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabf5a5a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00abe80 con 0x7fabf00700a0 2023-11-28T16:56:39.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabeeffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabf00aacd0 0x7fabf0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabeeffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabf00aacd0 0x7fabf0154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51400/0 (socket says 172.21.15.26:51400) 2023-11-28T16:56:39.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabeeffd640 1 -- 172.21.15.26:0/963166623 learned_addr learned my addr 172.21.15.26:0/963166623 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:39.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.358+0000 7fabe7fff640 1 --2- 172.21.15.26:0/963166623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00700a0 0x7fabf01546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabeeffd640 1 -- 172.21.15.26:0/963166623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00700a0 msgr2=0x7fabf01546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabeeffd640 1 --2- 172.21.15.26:0/963166623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00700a0 0x7fabf01546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabeeffd640 1 -- 172.21.15.26:0/963166623 >> v1:172.21.15.79:6789/0 conn(0x7fabf00ab7a0 legacy=0x7fabf006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabeeffd640 1 -- 172.21.15.26:0/963166623 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0154cf0 con 0x7fabf00aacd0 2023-11-28T16:56:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabe7fff640 1 --2- 172.21.15.26:0/963166623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00700a0 0x7fabf01546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:39.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabeeffd640 1 --2- 172.21.15.26:0/963166623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00aacd0 0x7fabf0154160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009870 tx=0x7fabe001d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89aec40c3b0aa67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabee7fc640 1 -- 172.21.15.26:0/963166623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00ab660 con 0x7fabf00aacd0 2023-11-28T16:56:39.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabee7fc640 1 -- 172.21.15.26:0/963166623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe00ab7c0 con 0x7fabf00aacd0 2023-11-28T16:56:39.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.362+0000 7fabee7fc640 1 -- 172.21.15.26:0/963166623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00abb50 con 0x7fabf00aacd0 2023-11-28T16:56:39.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- 172.21.15.26:0/963166623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00aacd0 msgr2=0x7fabf0154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/963166623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00aacd0 0x7fabf0154160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009870 tx=0x7fabe001d550 comp rx=0 tx=0).stop 2023-11-28T16:56:39.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- 172.21.15.26:0/963166623 shutdown_connections 2023-11-28T16:56:39.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/963166623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00700a0 0x7fabf01546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/963166623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00aacd0 0x7fabf0154160 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- 172.21.15.26:0/963166623 >> 172.21.15.26:0/963166623 conn(0x7fabf00c2ad0 msgr2=0x7fabf00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:39.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- 172.21.15.26:0/963166623 shutdown_connections 2023-11-28T16:56:39.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- 172.21.15.26:0/963166623 wait complete. 2023-11-28T16:56:39.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 Processor -- start 2023-11-28T16:56:39.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- start start 2023-11-28T16:56:39.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00700a0 0x7fabf014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabf00aacd0 0x7fabf00710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00ab7a0 0x7fabf01ee800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf014fd00 con 0x7fabf00700a0 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0149540 con 0x7fabf00aacd0 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabf5a5a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01497b0 con 0x7fabf00ab7a0 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00700a0 0x7fabf014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00700a0 0x7fabf014a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51414/0 (socket says 172.21.15.26:51414) 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 -- 172.21.15.26:0/3383673847 learned_addr learned my addr 172.21.15.26:0/3383673847 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabe7fff640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabf00aacd0 0x7fabf00710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabef7fe640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00ab7a0 0x7fabf01ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 -- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00ab7a0 msgr2=0x7fabf01ee800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00ab7a0 0x7fabf01ee800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 -- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabf00aacd0 msgr2=0x7fabf00710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabf00aacd0 0x7fabf00710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.366+0000 7fabeeffd640 1 -- 172.21.15.26:0/3383673847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00094d0 con 0x7fabf00700a0 2023-11-28T16:56:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.370+0000 7fabeeffd640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00700a0 0x7fabf014a940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fabe001ddf0 tx=0x7fabe001a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.370+0000 7fabecff9640 1 -- 172.21.15.26:0/3383673847 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00b4830 con 0x7fabf00700a0 2023-11-28T16:56:39.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.370+0000 7fabecff9640 1 -- 172.21.15.26:0/3383673847 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe00b49b0 con 0x7fabf00700a0 2023-11-28T16:56:39.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.370+0000 7fabecff9640 1 -- 172.21.15.26:0/3383673847 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00b4d60 con 0x7fabf00700a0 2023-11-28T16:56:39.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.370+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0149a90 con 0x7fabf00700a0 2023-11-28T16:56:39.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.370+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf00715e0 con 0x7fabf00700a0 2023-11-28T16:56:39.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.370+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf004e890 con 0x7fabf00700a0 2023-11-28T16:56:39.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.374+0000 7fabecff9640 1 -- 172.21.15.26:0/3383673847 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fabe00bd3b0 con 0x7fabf00700a0 2023-11-28T16:56:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.374+0000 7fabecff9640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fabd0066900 0x7fabd0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.374+0000 7fabecff9640 1 -- 172.21.15.26:0/3383673847 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabe00a7040 con 0x7fabf00700a0 2023-11-28T16:56:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.374+0000 7fabe7fff640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fabd0066900 0x7fabd0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.374+0000 7fabe7fff640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fabd0066900 0x7fabd0068dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fabf0072420 tx=0x7fabd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.378+0000 7fabecff9640 1 -- 172.21.15.26:0/3383673847 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabe00ebee0 con 0x7fabf00700a0 2023-11-28T16:56:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.534+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabf014a0e0 con 0x7fabf00700a0 2023-11-28T16:56:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.534+0000 7fabecff9640 1 -- 172.21.15.26:0/3383673847 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fabe00ab620 con 0x7fabf00700a0 2023-11-28T16:56:39.542 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:39.542 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fabd0066900 msgr2=0x7fabd0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fabd0066900 0x7fabd0068dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fabf0072420 tx=0x7fabd8008040 comp rx=0 tx=0).stop 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00700a0 msgr2=0x7fabf014a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00700a0 0x7fabf014a940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fabe001ddf0 tx=0x7fabe001a2f0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 shutdown_connections 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fabd0066900 0x7fabd0068dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabf00ab7a0 0x7fabf01ee800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabf00aacd0 0x7fabf00710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 --2- 172.21.15.26:0/3383673847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf00700a0 0x7fabf014a940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 >> 172.21.15.26:0/3383673847 conn(0x7fabf00c2ad0 msgr2=0x7fabf013d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 shutdown_connections 2023-11-28T16:56:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.538+0000 7fabf5a5a640 1 -- 172.21.15.26:0/3383673847 wait complete. 2023-11-28T16:56:39.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:39.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867cefe640 1 Processor -- start 2023-11-28T16:56:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867cefe640 1 -- start start 2023-11-28T16:56:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867cefe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86780c6220 0x7f8678158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867cefe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8678158580 con 0x7f8678151bf0 2023-11-28T16:56:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867cefe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8678157f50 con 0x7f86780c13a0 2023-11-28T16:56:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867cefe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86780c2fd0 con 0x7f86780c6220 2023-11-28T16:56:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f8676d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8678151bf0 0x7f867815f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60396/0 (socket says 172.21.15.26:60396) 2023-11-28T16:56:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f8676d9d640 1 -- 172.21.15.26:0/2937179219 learned_addr learned my addr 172.21.15.26:0/2937179219 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867659c640 1 --2- 172.21.15.26:0/2937179219 >> v2:172.21.15.79:3300/0 conn(0x7f86780c6220 0x7f8678158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867559a640 1 -- 172.21.15.26:0/2937179219 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643573990 0 0) 0x7f8678158580 con 0x7f8678151bf0 2023-11-28T16:56:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867559a640 1 -- 172.21.15.26:0/2937179219 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8660003530 con 0x7f8678151bf0 2023-11-28T16:56:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867559a640 1 -- 172.21.15.26:0/2937179219 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727242497 0 0) 0x7f8678157f50 con 0x7f86780c13a0 2023-11-28T16:56:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867559a640 1 -- 172.21.15.26:0/2937179219 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8678158580 con 0x7f86780c13a0 2023-11-28T16:56:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867659c640 1 -- 172.21.15.26:0/2937179219 >> v1:172.21.15.79:6789/0 conn(0x7f86780c13a0 legacy=0x7f86780c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867659c640 1 -- 172.21.15.26:0/2937179219 >> v1:172.21.15.26:6789/0 conn(0x7f8678151bf0 legacy=0x7f867815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.706+0000 7f867659c640 1 -- 172.21.15.26:0/2937179219 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780c1f60 con 0x7f86780c6220 2023-11-28T16:56:39.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867659c640 1 --2- 172.21.15.26:0/2937179219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678158a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86680097c0 tx=0x7f866801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e9084f5c9d1b8b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867559a640 1 -- 172.21.15.26:0/2937179219 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680ab650 con 0x7f86780c6220 2023-11-28T16:56:39.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867559a640 1 -- 172.21.15.26:0/2937179219 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86680ab7b0 con 0x7f86780c6220 2023-11-28T16:56:39.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867559a640 1 -- 172.21.15.26:0/2937179219 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680abb40 con 0x7f86780c6220 2023-11-28T16:56:39.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867cefe640 1 -- 172.21.15.26:0/2937179219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 msgr2=0x7f8678158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867cefe640 1 --2- 172.21.15.26:0/2937179219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678158a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86680097c0 tx=0x7f866801c450 comp rx=0 tx=0).stop 2023-11-28T16:56:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867cefe640 1 -- 172.21.15.26:0/2937179219 shutdown_connections 2023-11-28T16:56:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867cefe640 1 --2- 172.21.15.26:0/2937179219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678158a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867cefe640 1 -- 172.21.15.26:0/2937179219 >> 172.21.15.26:0/2937179219 conn(0x7f867806a5a0 msgr2=0x7f867806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867cefe640 1 -- 172.21.15.26:0/2937179219 shutdown_connections 2023-11-28T16:56:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.710+0000 7f867cefe640 1 -- 172.21.15.26:0/2937179219 wait complete. 2023-11-28T16:56:39.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 Processor -- start 2023-11-28T16:56:39.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 -- start start 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86780c13a0 0x7f86781f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8678151bf0 0x7f86780aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780ac7d0 con 0x7f8678151bf0 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86781f0580 con 0x7f86780c6220 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780ad570 con 0x7f86780c13a0 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8678151bf0 0x7f86780aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8678151bf0 0x7f86780aac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51426/0 (socket says 172.21.15.26:51426) 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 -- 172.21.15.26:0/1156584343 learned_addr learned my addr 172.21.15.26:0/1156584343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867659c640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86780c13a0 0x7f86781f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 -- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86780c13a0 msgr2=0x7f86781f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86780c13a0 0x7f86781f0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 -- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 msgr2=0x7f8678145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8675d9b640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 -- 172.21.15.26:0/1156584343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668009420 con 0x7f8678151bf0 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8675d9b640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8676d9d640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8678151bf0 0x7f86780aac70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f867000cb40 tx=0x7f867000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8666ffd640 1 -- 172.21.15.26:0/1156584343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867000aca0 con 0x7f8678151bf0 2023-11-28T16:56:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8666ffd640 1 -- 172.21.15.26:0/1156584343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867000ae00 con 0x7f8678151bf0 2023-11-28T16:56:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f8666ffd640 1 -- 172.21.15.26:0/1156584343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670012600 con 0x7f8678151bf0 2023-11-28T16:56:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86781f14d0 con 0x7f8678151bf0 2023-11-28T16:56:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.714+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86781f0b00 con 0x7f8678151bf0 2023-11-28T16:56:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.718+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86781f0c90 con 0x7f8678151bf0 2023-11-28T16:56:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.718+0000 7f8666ffd640 1 -- 172.21.15.26:0/1156584343 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8670007070 con 0x7f8678151bf0 2023-11-28T16:56:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.718+0000 7f8666ffd640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f86580668d0 0x7f8658068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.718+0000 7f8666ffd640 1 -- 172.21.15.26:0/1156584343 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8670084160 con 0x7f8678151bf0 2023-11-28T16:56:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.718+0000 7f867659c640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f86580668d0 0x7f8658068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.718+0000 7f867659c640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f86580668d0 0x7f8658068d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f86680af000 tx=0x7f86680a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.722+0000 7f8666ffd640 1 -- 172.21.15.26:0/1156584343 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86700513c0 con 0x7f8678151bf0 2023-11-28T16:56:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.878+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86781f14d0 con 0x7f8678151bf0 2023-11-28T16:56:39.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.878+0000 7f8666ffd640 1 -- 172.21.15.26:0/1156584343 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86781f14d0 con 0x7f8678151bf0 2023-11-28T16:56:39.885 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:39.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f86580668d0 msgr2=0x7f8658068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f86580668d0 0x7f8658068d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f86680af000 tx=0x7f86680a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:39.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8678151bf0 msgr2=0x7f86780aac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8678151bf0 0x7f86780aac70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f867000cb40 tx=0x7f867000a060 comp rx=0 tx=0).stop 2023-11-28T16:56:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 shutdown_connections 2023-11-28T16:56:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8678151bf0 0x7f86780aac70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780c6220 0x7f8678145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f86580668d0 0x7f8658068d90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 --2- 172.21.15.26:0/1156584343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86780c13a0 0x7f86781f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 >> 172.21.15.26:0/1156584343 conn(0x7f867806a5a0 msgr2=0x7f8678142fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 shutdown_connections 2023-11-28T16:56:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:39.882+0000 7f867cefe640 1 -- 172.21.15.26:0/1156584343 wait complete. 2023-11-28T16:56:39.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:40.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.046+0000 7f7a3946b640 1 Processor -- start 2023-11-28T16:56:40.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.046+0000 7f7a3946b640 1 -- start start 2023-11-28T16:56:40.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.046+0000 7f7a3946b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a340a86d0 0x7f7a340a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a3946b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a34152d90 con 0x7f7a3414fd00 2023-11-28T16:56:40.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a3946b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a34152480 con 0x7f7a34156600 2023-11-28T16:56:40.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a3946b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340a9760 con 0x7f7a340a86d0 2023-11-28T16:56:40.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a337fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7a3414fd00 0x7f7a340aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60404/0 (socket says 172.21.15.26:60404) 2023-11-28T16:56:40.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a337fe640 1 -- 172.21.15.26:0/4201680104 learned_addr learned my addr 172.21.15.26:0/4201680104 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:40.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a32ffd640 1 --2- 172.21.15.26:0/4201680104 >> v2:172.21.15.79:3300/0 conn(0x7f7a340a86d0 0x7f7a340a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a327fc640 1 -- 172.21.15.26:0/4201680104 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123623504 0 0) 0x7f7a34152d90 con 0x7f7a3414fd00 2023-11-28T16:56:40.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a327fc640 1 -- 172.21.15.26:0/4201680104 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a20003530 con 0x7f7a3414fd00 2023-11-28T16:56:40.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a32ffd640 1 -- 172.21.15.26:0/4201680104 >> v1:172.21.15.79:6789/0 conn(0x7f7a34156600 legacy=0x7f7a3414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a32ffd640 1 -- 172.21.15.26:0/4201680104 >> v1:172.21.15.26:6789/0 conn(0x7f7a3414fd00 legacy=0x7f7a340aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a32ffd640 1 -- 172.21.15.26:0/4201680104 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34152740 con 0x7f7a340a86d0 2023-11-28T16:56:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.050+0000 7f7a32ffd640 1 --2- 172.21.15.26:0/4201680104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a340a8f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097f0 tx=0x7f7a2401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a495f29c4fcaf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a327fc640 1 -- 172.21.15.26:0/4201680104 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24004230 con 0x7f7a340a86d0 2023-11-28T16:56:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a327fc640 1 -- 172.21.15.26:0/4201680104 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a240a7050 con 0x7f7a340a86d0 2023-11-28T16:56:40.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a327fc640 1 -- 172.21.15.26:0/4201680104 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24003620 con 0x7f7a340a86d0 2023-11-28T16:56:40.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- 172.21.15.26:0/4201680104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 msgr2=0x7f7a340a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 --2- 172.21.15.26:0/4201680104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a340a8f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097f0 tx=0x7f7a2401c480 comp rx=0 tx=0).stop 2023-11-28T16:56:40.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- 172.21.15.26:0/4201680104 shutdown_connections 2023-11-28T16:56:40.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 --2- 172.21.15.26:0/4201680104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a340a8f30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- 172.21.15.26:0/4201680104 >> 172.21.15.26:0/4201680104 conn(0x7f7a340c2a60 msgr2=0x7f7a340c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:40.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- 172.21.15.26:0/4201680104 shutdown_connections 2023-11-28T16:56:40.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- 172.21.15.26:0/4201680104 wait complete. 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 Processor -- start 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- start start 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a341424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a3414fd00 0x7f7a34146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a34156600 0x7f7a3414a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414e410 con 0x7f7a34156600 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414b190 con 0x7f7a340a86d0 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a3946b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414f4f0 con 0x7f7a3414fd00 2023-11-28T16:56:40.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a337fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a34156600 0x7f7a3414a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a337fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a34156600 0x7f7a3414a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51436/0 (socket says 172.21.15.26:51436) 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a337fe640 1 -- 172.21.15.26:0/1023415020 learned_addr learned my addr 172.21.15.26:0/1023415020 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a32ffd640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a341424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a337fe640 1 -- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a3414fd00 msgr2=0x7f7a34146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a337fe640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a3414fd00 0x7f7a34146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a337fe640 1 -- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 msgr2=0x7f7a341424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.054+0000 7f7a337fe640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a341424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a337fe640 1 -- 172.21.15.26:0/1023415020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24009420 con 0x7f7a34156600 2023-11-28T16:56:40.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a32ffd640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a341424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:40.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a337fe640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a34156600 0x7f7a3414a560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00cad0 tx=0x7f7a2c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a2b7fe640 1 -- 172.21.15.26:0/1023415020 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00ac30 con 0x7f7a34156600 2023-11-28T16:56:40.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a2b7fe640 1 -- 172.21.15.26:0/1023415020 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c00ad90 con 0x7f7a34156600 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3414bd00 con 0x7f7a34156600 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a2b7fe640 1 -- 172.21.15.26:0/1023415020 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c012620 con 0x7f7a34156600 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3414aeb0 con 0x7f7a34156600 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3404e890 con 0x7f7a34156600 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a2b7fe640 1 -- 172.21.15.26:0/1023415020 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7a2c007070 con 0x7f7a34156600 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a2b7fe640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7a14066900 0x7f7a14068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a2b7fe640 1 -- 172.21.15.26:0/1023415020 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2c084300 con 0x7f7a34156600 2023-11-28T16:56:40.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.058+0000 7f7a32ffd640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7a14066900 0x7f7a14068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.062+0000 7f7a32ffd640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7a14066900 0x7f7a14068dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ad000 tx=0x7f7a24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.062+0000 7f7a2b7fe640 1 -- 172.21.15.26:0/1023415020 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a2c0515d0 con 0x7f7a34156600 2023-11-28T16:56:40.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.222+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a340c1730 con 0x7f7a34156600 2023-11-28T16:56:40.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.222+0000 7f7a2b7fe640 1 -- 172.21.15.26:0/1023415020 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a2c054bf0 con 0x7f7a34156600 2023-11-28T16:56:40.229 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7a14066900 msgr2=0x7f7a14068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7a14066900 0x7f7a14068dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ad000 tx=0x7f7a24008040 comp rx=0 tx=0).stop 2023-11-28T16:56:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a34156600 msgr2=0x7f7a3414a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a34156600 0x7f7a3414a560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00cad0 tx=0x7f7a2c00cf90 comp rx=0 tx=0).stop 2023-11-28T16:56:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 shutdown_connections 2023-11-28T16:56:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a34156600 0x7f7a3414a560 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7a14066900 0x7f7a14068dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a3414fd00 0x7f7a34146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 --2- 172.21.15.26:0/1023415020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a340a86d0 0x7f7a341424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 >> 172.21.15.26:0/1023415020 conn(0x7f7a340c2a60 msgr2=0x7f7a340c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 shutdown_connections 2023-11-28T16:56:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.226+0000 7f7a3946b640 1 -- 172.21.15.26:0/1023415020 wait complete. 2023-11-28T16:56:40.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:40.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.390+0000 7f290d65a640 1 Processor -- start 2023-11-28T16:56:40.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.390+0000 7f290d65a640 1 -- start start 2023-11-28T16:56:40.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f290d65a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2908151d80 0x7f29080c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f290d65a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29080c8430 0x7f290806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f290d65a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290806cf70 con 0x7f29080c7f20 2023-11-28T16:56:40.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f290d65a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2908152160 con 0x7f29080c8430 2023-11-28T16:56:40.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f290d65a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080c6a30 con 0x7f2908151d80 2023-11-28T16:56:40.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f29077fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f29080c7f20 0x7f290806bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60420/0 (socket says 172.21.15.26:60420) 2023-11-28T16:56:40.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f29077fe640 1 -- 172.21.15.26:0/1464762398 learned_addr learned my addr 172.21.15.26:0/1464762398 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:40.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f2906ffd640 1 --2- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2908151d80 0x7f29080c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f28fe7fc640 1 --2- 172.21.15.26:0/1464762398 >> v2:172.21.15.79:3300/0 conn(0x7f29080c8430 0x7f290806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f29067fc640 1 -- 172.21.15.26:0/1464762398 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788572490 0 0) 0x7f290806cf70 con 0x7f29080c7f20 2023-11-28T16:56:40.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f29067fc640 1 -- 172.21.15.26:0/1464762398 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f4003530 con 0x7f29080c7f20 2023-11-28T16:56:40.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f28fe7fc640 1 -- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2908151d80 msgr2=0x7f29080c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:40.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f28fe7fc640 1 --2- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2908151d80 0x7f29080c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f28fe7fc640 1 -- 172.21.15.26:0/1464762398 >> v1:172.21.15.26:6789/0 conn(0x7f29080c7f20 legacy=0x7f290806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f28fe7fc640 1 -- 172.21.15.26:0/1464762398 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080c72d0 con 0x7f29080c8430 2023-11-28T16:56:40.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.394+0000 7f2906ffd640 1 --2- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2908151d80 0x7f29080c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:40.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f28fe7fc640 1 --2- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080c8430 0x7f290806b720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28f00097c0 tx=0x7f28f001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6385f8c256a7f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f29067fc640 1 -- 172.21.15.26:0/1464762398 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00ac620 con 0x7f29080c8430 2023-11-28T16:56:40.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f29067fc640 1 -- 172.21.15.26:0/1464762398 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f00ac780 con 0x7f29080c8430 2023-11-28T16:56:40.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f29067fc640 1 -- 172.21.15.26:0/1464762398 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00acb10 con 0x7f29080c8430 2023-11-28T16:56:40.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 -- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080c8430 msgr2=0x7f290806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 --2- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080c8430 0x7f290806b720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28f00097c0 tx=0x7f28f001c3c0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 -- 172.21.15.26:0/1464762398 shutdown_connections 2023-11-28T16:56:40.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 --2- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080c8430 0x7f290806b720 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 --2- 172.21.15.26:0/1464762398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2908151d80 0x7f29080c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 -- 172.21.15.26:0/1464762398 >> 172.21.15.26:0/1464762398 conn(0x7f29080abd00 msgr2=0x7f29080ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:40.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 -- 172.21.15.26:0/1464762398 shutdown_connections 2023-11-28T16:56:40.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 -- 172.21.15.26:0/1464762398 wait complete. 2023-11-28T16:56:40.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 Processor -- start 2023-11-28T16:56:40.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 -- start start 2023-11-28T16:56:40.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.398+0000 7f290d65a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29080c7f20 0x7f29081f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29080c8430 0x7f29081572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2908151d80 0x7f29081ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2908157dd0 con 0x7f29080c8430 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29081f0740 con 0x7f2908151d80 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29081f0110 con 0x7f29080c7f20 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29080c8430 0x7f29081572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29080c8430 0x7f29081572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51446/0 (socket says 172.21.15.26:51446) 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 -- 172.21.15.26:0/1888736771 learned_addr learned my addr 172.21.15.26:0/1888736771 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:40.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f2906ffd640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29080c7f20 0x7f29081f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f29077fe640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2908151d80 0x7f29081ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 -- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29080c7f20 msgr2=0x7f29081f0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29080c7f20 0x7f29081f0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 -- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2908151d80 msgr2=0x7f29081ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2908151d80 0x7f29081ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 -- 172.21.15.26:0/1888736771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009420 con 0x7f29080c8430 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fe7fc640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29080c8430 0x7f29081572e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28f00af040 tx=0x7f28f0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fffff640 1 -- 172.21.15.26:0/1888736771 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00ac620 con 0x7f29080c8430 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fffff640 1 -- 172.21.15.26:0/1888736771 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f00b5410 con 0x7f29080c8430 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f0009420 con 0x7f29080c8430 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fffff640 1 -- 172.21.15.26:0/1888736771 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00b57e0 con 0x7f29080c8430 2023-11-28T16:56:40.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29080c3500 con 0x7f29080c8430 2023-11-28T16:56:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29081f0880 con 0x7f29080c8430 2023-11-28T16:56:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.402+0000 7f28fffff640 1 -- 172.21.15.26:0/1888736771 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f28f00b3040 con 0x7f29080c8430 2023-11-28T16:56:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.406+0000 7f28fffff640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28e80668d0 0x7f28e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.406+0000 7f28fffff640 1 -- 172.21.15.26:0/1888736771 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28f011e400 con 0x7f29080c8430 2023-11-28T16:56:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.406+0000 7f2906ffd640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28e80668d0 0x7f28e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.406+0000 7f2906ffd640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28e80668d0 0x7f28e8068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009cf0 tx=0x7f28f8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.406+0000 7f28fffff640 1 -- 172.21.15.26:0/1888736771 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28f00eb6e0 con 0x7f29080c8430 2023-11-28T16:56:40.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f290804e890 con 0x7f29080c8430 2023-11-28T16:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f28fffff640 1 -- 172.21.15.26:0/1888736771 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28f00eed00 con 0x7f29080c8430 2023-11-28T16:56:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:40.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28e80668d0 msgr2=0x7f28e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28e80668d0 0x7f28e8068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009cf0 tx=0x7f28f8009190 comp rx=0 tx=0).stop 2023-11-28T16:56:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29080c8430 msgr2=0x7f29081572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29080c8430 0x7f29081572e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28f00af040 tx=0x7f28f0019160 comp rx=0 tx=0).stop 2023-11-28T16:56:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 shutdown_connections 2023-11-28T16:56:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2908151d80 0x7f29081ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29080c8430 0x7f29081572e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28e80668d0 0x7f28e8068d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 --2- 172.21.15.26:0/1888736771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29080c7f20 0x7f29081f0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 >> 172.21.15.26:0/1888736771 conn(0x7f29080abd00 msgr2=0x7f290815e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 shutdown_connections 2023-11-28T16:56:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.566+0000 7f290d65a640 1 -- 172.21.15.26:0/1888736771 wait complete. 2023-11-28T16:56:40.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.730+0000 7f2b7ca32640 1 Processor -- start 2023-11-28T16:56:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.730+0000 7f2b7ca32640 1 -- start start 2023-11-28T16:56:40.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b7ca32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b7806d980 0x7f2b780c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b7ca32640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b78156980 con 0x7f2b78156500 2023-11-28T16:56:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b7ca32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b780ab580 con 0x7f2b7814fcc0 2023-11-28T16:56:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b7ca32640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b780aa340 con 0x7f2b7806d980 2023-11-28T16:56:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b76d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b7806d980 0x7f2b780c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b6ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2b78156500 0x7f2b780c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60426/0 (socket says 172.21.15.26:60426) 2023-11-28T16:56:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b6ffff640 1 -- 172.21.15.26:0/1929808255 learned_addr learned my addr 172.21.15.26:0/1929808255 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b76d9d640 1 -- 172.21.15.26:0/1929808255 >> v1:172.21.15.79:6789/0 conn(0x7f2b7814fcc0 legacy=0x7f2b780aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b76d9d640 1 -- 172.21.15.26:0/1929808255 >> v1:172.21.15.26:6789/0 conn(0x7f2b78156500 legacy=0x7f2b780c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b76d9d640 1 -- 172.21.15.26:0/1929808255 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78152fe0 con 0x7f2b7806d980 2023-11-28T16:56:40.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.734+0000 7f2b75d9b640 1 -- 172.21.15.26:0/1929808255 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773753014 0 0) 0x7f2b60001120 con 0x7f2b78156500 2023-11-28T16:56:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b76d9d640 1 --2- 172.21.15.26:0/1929808255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c20f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009d90 tx=0x7f2b7001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39b3280f5b7f56c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b75d9b640 1 -- 172.21.15.26:0/1929808255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700a59e0 con 0x7f2b7806d980 2023-11-28T16:56:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b75d9b640 1 -- 172.21.15.26:0/1929808255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700a5b40 con 0x7f2b7806d980 2023-11-28T16:56:40.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b75d9b640 1 -- 172.21.15.26:0/1929808255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700ad440 con 0x7f2b7806d980 2023-11-28T16:56:40.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- 172.21.15.26:0/1929808255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 msgr2=0x7f2b780c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/1929808255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c20f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009d90 tx=0x7f2b7001c920 comp rx=0 tx=0).stop 2023-11-28T16:56:40.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- 172.21.15.26:0/1929808255 shutdown_connections 2023-11-28T16:56:40.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/1929808255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c20f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- 172.21.15.26:0/1929808255 >> 172.21.15.26:0/1929808255 conn(0x7f2b780c2ad0 msgr2=0x7f2b780c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:40.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- 172.21.15.26:0/1929808255 shutdown_connections 2023-11-28T16:56:40.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- 172.21.15.26:0/1929808255 wait complete. 2023-11-28T16:56:40.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 Processor -- start 2023-11-28T16:56:40.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- start start 2023-11-28T16:56:40.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b78156500 0x7f2b78141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b781459e0 0x7f2b78141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7814f350 con 0x7f2b7806d980 2023-11-28T16:56:40.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780c1620 con 0x7f2b781459e0 2023-11-28T16:56:40.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.738+0000 7f2b7ca32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780c1010 con 0x7f2b78156500 2023-11-28T16:56:40.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51458/0 (socket says 172.21.15.26:51458) 2023-11-28T16:56:40.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 -- 172.21.15.26:0/58183655 learned_addr learned my addr 172.21.15.26:0/58183655 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:40.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b76d9d640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b781459e0 0x7f2b78141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b6ffff640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b78156500 0x7f2b78141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 -- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b78156500 msgr2=0x7f2b78141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b78156500 0x7f2b78141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 -- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b781459e0 msgr2=0x7f2b78141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b781459e0 0x7f2b78141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 -- 172.21.15.26:0/58183655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009a70 con 0x7f2b7806d980 2023-11-28T16:56:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7659c640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c1d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800c500 tx=0x7f2b6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b6effd640 1 -- 172.21.15.26:0/58183655 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68005220 con 0x7f2b7806d980 2023-11-28T16:56:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b6effd640 1 -- 172.21.15.26:0/58183655 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68005380 con 0x7f2b7806d980 2023-11-28T16:56:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b781eb060 con 0x7f2b7806d980 2023-11-28T16:56:40.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b6effd640 1 -- 172.21.15.26:0/58183655 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68007270 con 0x7f2b7806d980 2023-11-28T16:56:40.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b781eb340 con 0x7f2b7806d980 2023-11-28T16:56:40.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7804e890 con 0x7f2b7806d980 2023-11-28T16:56:40.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.742+0000 7f2b6effd640 1 -- 172.21.15.26:0/58183655 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2b680073d0 con 0x7f2b7806d980 2023-11-28T16:56:40.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.746+0000 7f2b6effd640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b58066900 0x7f2b58068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:40.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.746+0000 7f2b6effd640 1 -- 172.21.15.26:0/58183655 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b68083ba0 con 0x7f2b7806d980 2023-11-28T16:56:40.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.746+0000 7f2b6ffff640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b58066900 0x7f2b58068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:40.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.746+0000 7f2b6ffff640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b58066900 0x7f2b58068dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b780a97d0 tx=0x7f2b60007240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:40.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.746+0000 7f2b6effd640 1 -- 172.21.15.26:0/58183655 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b68050ea0 con 0x7f2b7806d980 2023-11-28T16:56:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.906+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b7806ce10 con 0x7f2b7806d980 2023-11-28T16:56:40.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.906+0000 7f2b6effd640 1 -- 172.21.15.26:0/58183655 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f2b680544c0 con 0x7f2b7806d980 2023-11-28T16:56:40.914 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:40.914 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b58066900 msgr2=0x7f2b58068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b58066900 0x7f2b58068dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b780a97d0 tx=0x7f2b60007240 comp rx=0 tx=0).stop 2023-11-28T16:56:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 msgr2=0x7f2b780c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c1d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800c500 tx=0x7f2b6800c9c0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 shutdown_connections 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b781459e0 0x7f2b78141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b58066900 0x7f2b58068dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b78156500 0x7f2b78141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 --2- 172.21.15.26:0/58183655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b7806d980 0x7f2b780c1d90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 >> 172.21.15.26:0/58183655 conn(0x7f2b780c2ad0 msgr2=0x7f2b78153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 shutdown_connections 2023-11-28T16:56:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:40.910+0000 7f2b7ca32640 1 -- 172.21.15.26:0/58183655 wait complete. 2023-11-28T16:56:40.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:40.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1c91d640 1 Processor -- start 2023-11-28T16:56:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1c91d640 1 -- start start 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1c91d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a18151d80 0x7f3a180c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1c91d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a180c7f20 0x7f3a1806be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1c91d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1806cf70 con 0x7f3a180c8430 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1c91d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a18152160 con 0x7f3a18151d80 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1c91d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180c6a30 con 0x7f3a180c7f20 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.078+0000 7f3a1659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a18151d80 0x7f3a180c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a1659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a18151d80 0x7f3a180c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51462/0 (socket says 172.21.15.26:51462) 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a1659c640 1 -- 172.21.15.26:0/4084100182 learned_addr learned my addr 172.21.15.26:0/4084100182 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a16d9d640 1 --2- 172.21.15.26:0/4084100182 >> v2:172.21.15.79:3300/0 conn(0x7f3a180c7f20 0x7f3a1806be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a1659c640 1 -- 172.21.15.26:0/4084100182 >> v2:172.21.15.79:3300/0 conn(0x7f3a180c7f20 msgr2=0x7f3a1806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a1659c640 1 --2- 172.21.15.26:0/4084100182 >> v2:172.21.15.79:3300/0 conn(0x7f3a180c7f20 0x7f3a1806be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a1659c640 1 -- 172.21.15.26:0/4084100182 >> v1:172.21.15.79:6789/0 conn(0x7f3a180c8430 legacy=0x7f3a1806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a1659c640 1 -- 172.21.15.26:0/4084100182 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180c72d0 con 0x7f3a18151d80 2023-11-28T16:56:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a1659c640 1 --2- 172.21.15.26:0/4084100182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a18151d80 0x7f3a180c49a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a180c4220 tx=0x7f3a0801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1efa8639274de5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a15d9b640 1 -- 172.21.15.26:0/4084100182 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080ab640 con 0x7f3a18151d80 2023-11-28T16:56:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a15d9b640 1 -- 172.21.15.26:0/4084100182 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a080a7070 con 0x7f3a18151d80 2023-11-28T16:56:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.082+0000 7f3a15d9b640 1 -- 172.21.15.26:0/4084100182 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080ab9c0 con 0x7f3a18151d80 2023-11-28T16:56:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- 172.21.15.26:0/4084100182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a18151d80 msgr2=0x7f3a180c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/4084100182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a18151d80 0x7f3a180c49a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a180c4220 tx=0x7f3a0801c440 comp rx=0 tx=0).stop 2023-11-28T16:56:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- 172.21.15.26:0/4084100182 shutdown_connections 2023-11-28T16:56:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/4084100182 >> v2:172.21.15.79:3300/0 conn(0x7f3a180c7f20 0x7f3a1806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/4084100182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a18151d80 0x7f3a180c49a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- 172.21.15.26:0/4084100182 >> 172.21.15.26:0/4084100182 conn(0x7f3a180abd00 msgr2=0x7f3a180ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- 172.21.15.26:0/4084100182 shutdown_connections 2023-11-28T16:56:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- 172.21.15.26:0/4084100182 wait complete. 2023-11-28T16:56:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 Processor -- start 2023-11-28T16:56:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- start start 2023-11-28T16:56:41.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a180c7f20 0x7f3a181f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a180c8430 0x7f3a180a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a18151d80 0x7f3a18152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181f0010 con 0x7f3a180c8430 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180aa720 con 0x7f3a18151d80 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1c91d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181f0f30 con 0x7f3a180c7f20 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a180c8430 0x7f3a180a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a180c8430 0x7f3a180a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51474/0 (socket says 172.21.15.26:51474) 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 -- 172.21.15.26:0/3929121932 learned_addr learned my addr 172.21.15.26:0/3929121932 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a1659c640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a180c7f20 0x7f3a181f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a16d9d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a18151d80 0x7f3a18152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 -- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a180c7f20 msgr2=0x7f3a181f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a180c7f20 0x7f3a181f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 -- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a18151d80 msgr2=0x7f3a18152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a18151d80 0x7f3a18152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 -- 172.21.15.26:0/3929121932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080094d0 con 0x7f3a180c8430 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a16d9d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a18151d80 0x7f3a18152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.086+0000 7f3a0ffff640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a180c8430 0x7f3a180a9c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c3d0 tx=0x7f3a0000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a0effd640 1 -- 172.21.15.26:0/3929121932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000052d0 con 0x7f3a180c8430 2023-11-28T16:56:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a0effd640 1 -- 172.21.15.26:0/3929121932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00005450 con 0x7f3a180c8430 2023-11-28T16:56:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1814f2c0 con 0x7f3a180c8430 2023-11-28T16:56:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a0effd640 1 -- 172.21.15.26:0/3929121932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00003860 con 0x7f3a180c8430 2023-11-28T16:56:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a181f01f0 con 0x7f3a180c8430 2023-11-28T16:56:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1814f770 con 0x7f3a180c8430 2023-11-28T16:56:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a0effd640 1 -- 172.21.15.26:0/3929121932 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a000039c0 con 0x7f3a180c8430 2023-11-28T16:56:41.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a0effd640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f39f8066900 0x7f39f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a0effd640 1 -- 172.21.15.26:0/3929121932 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a000839a0 con 0x7f3a180c8430 2023-11-28T16:56:41.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.090+0000 7f3a1659c640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f39f8066900 0x7f39f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.094+0000 7f3a1659c640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f39f8066900 0x7f39f8068dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3a080af000 tx=0x7f3a080a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.094+0000 7f3a0effd640 1 -- 172.21.15.26:0/3929121932 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a00050bd0 con 0x7f3a180c8430 2023-11-28T16:56:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.254+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a1804e890 con 0x7f3a180c8430 2023-11-28T16:56:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.254+0000 7f3a0effd640 1 -- 172.21.15.26:0/3929121932 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a000170a0 con 0x7f3a180c8430 2023-11-28T16:56:41.260 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f39f8066900 msgr2=0x7f39f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f39f8066900 0x7f39f8068dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3a080af000 tx=0x7f3a080a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a180c8430 msgr2=0x7f3a180a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a180c8430 0x7f3a180a9c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c3d0 tx=0x7f3a0000c890 comp rx=0 tx=0).stop 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 shutdown_connections 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a18151d80 0x7f3a18152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a180c8430 0x7f3a180a9c00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f39f8066900 0x7f39f8068dc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 --2- 172.21.15.26:0/3929121932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a180c7f20 0x7f3a181f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 >> 172.21.15.26:0/3929121932 conn(0x7f3a180abd00 msgr2=0x7f3a180ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 shutdown_connections 2023-11-28T16:56:41.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.258+0000 7f3a1c91d640 1 -- 172.21.15.26:0/3929121932 wait complete. 2023-11-28T16:56:41.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:41.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.422+0000 7f79472e3640 1 Processor -- start 2023-11-28T16:56:41.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.422+0000 7f79472e3640 1 -- start start 2023-11-28T16:56:41.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f79472e3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f7940158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f79472e3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7940158580 con 0x7f79400c13a0 2023-11-28T16:56:41.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f79472e3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7940157f50 con 0x7f7940151bf0 2023-11-28T16:56:41.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f79472e3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79400c2fd0 con 0x7f79400c6220 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f794487e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f79400c13a0 0x7f79400c28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51816/0 (socket says 172.21.15.26:51816) 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f794487e640 1 -- 172.21.15.26:0/971736630 learned_addr learned my addr 172.21.15.26:0/971736630 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f794507f640 1 --2- 172.21.15.26:0/971736630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f7940158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f7937fff640 1 -- 172.21.15.26:0/971736630 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993593839 0 0) 0x7f7940158580 con 0x7f79400c13a0 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f7937fff640 1 -- 172.21.15.26:0/971736630 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792c003530 con 0x7f79400c13a0 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f7937fff640 1 -- 172.21.15.26:0/971736630 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113701069 0 0) 0x7f7940157f50 con 0x7f7940151bf0 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f7937fff640 1 -- 172.21.15.26:0/971736630 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7940158580 con 0x7f7940151bf0 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f794507f640 1 -- 172.21.15.26:0/971736630 >> v1:172.21.15.79:6789/0 conn(0x7f7940151bf0 legacy=0x7f794015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f794507f640 1 -- 172.21.15.26:0/971736630 >> v1:172.21.15.26:6789/0 conn(0x7f79400c13a0 legacy=0x7f79400c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.426+0000 7f794507f640 1 -- 172.21.15.26:0/971736630 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79400c1f60 con 0x7f79400c6220 2023-11-28T16:56:41.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f794507f640 1 --2- 172.21.15.26:0/971736630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f7940158a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f793c0097f0 tx=0x7f793c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c3d7e7e8182a0de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f7937fff640 1 -- 172.21.15.26:0/971736630 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0aa5f0 con 0x7f79400c6220 2023-11-28T16:56:41.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f7937fff640 1 -- 172.21.15.26:0/971736630 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c0aa750 con 0x7f79400c6220 2023-11-28T16:56:41.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f7937fff640 1 -- 172.21.15.26:0/971736630 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0aaae0 con 0x7f79400c6220 2023-11-28T16:56:41.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 -- 172.21.15.26:0/971736630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 msgr2=0x7f7940158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 --2- 172.21.15.26:0/971736630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f7940158a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f793c0097f0 tx=0x7f793c01c490 comp rx=0 tx=0).stop 2023-11-28T16:56:41.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 -- 172.21.15.26:0/971736630 shutdown_connections 2023-11-28T16:56:41.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 --2- 172.21.15.26:0/971736630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f7940158a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 -- 172.21.15.26:0/971736630 >> 172.21.15.26:0/971736630 conn(0x7f794006a5a0 msgr2=0x7f794006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:41.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 -- 172.21.15.26:0/971736630 shutdown_connections 2023-11-28T16:56:41.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 -- 172.21.15.26:0/971736630 wait complete. 2023-11-28T16:56:41.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 Processor -- start 2023-11-28T16:56:41.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.430+0000 7f79472e3640 1 -- start start 2023-11-28T16:56:41.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79400c13a0 0x7f7940140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f79401f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7940151bf0 0x7f7940157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79401f19a0 con 0x7f7940151bf0 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79401ed5f0 con 0x7f79400c13a0 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79401ed8d0 con 0x7f79400c6220 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7940151bf0 0x7f7940157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7940151bf0 0x7f7940157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49208/0 (socket says 172.21.15.26:49208) 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 -- 172.21.15.26:0/1908372410 learned_addr learned my addr 172.21.15.26:0/1908372410 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f794507f640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79400c13a0 0x7f7940140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f794487e640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f79401f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 -- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 msgr2=0x7f79401f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f79401f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 -- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79400c13a0 msgr2=0x7f7940140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79400c13a0 0x7f7940140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 -- 172.21.15.26:0/1908372410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c009420 con 0x7f7940151bf0 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7945880640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7940151bf0 0x7f7940157420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f793800c730 tx=0x7f793800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7935ffb640 1 -- 172.21.15.26:0/1908372410 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938003b80 con 0x7f7940151bf0 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7935ffb640 1 -- 172.21.15.26:0/1908372410 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7938003ce0 con 0x7f7940151bf0 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79401edbb0 con 0x7f7940151bf0 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7935ffb640 1 -- 172.21.15.26:0/1908372410 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800aa90 con 0x7f7940151bf0 2023-11-28T16:56:41.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79401ee170 con 0x7f7940151bf0 2023-11-28T16:56:41.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79401ee360 con 0x7f7940151bf0 2023-11-28T16:56:41.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.434+0000 7f7935ffb640 1 -- 172.21.15.26:0/1908372410 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f793800abf0 con 0x7f7940151bf0 2023-11-28T16:56:41.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.438+0000 7f7935ffb640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79240668d0 0x7f7924068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.438+0000 7f7935ffb640 1 -- 172.21.15.26:0/1908372410 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7938084120 con 0x7f7940151bf0 2023-11-28T16:56:41.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.438+0000 7f794507f640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79240668d0 0x7f7924068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.438+0000 7f794507f640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79240668d0 0x7f7924068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f793c0ae000 tx=0x7f793c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.442+0000 7f7935ffb640 1 -- 172.21.15.26:0/1908372410 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7938051400 con 0x7f7940151bf0 2023-11-28T16:56:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.598+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f794004e890 con 0x7f7940151bf0 2023-11-28T16:56:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.598+0000 7f7935ffb640 1 -- 172.21.15.26:0/1908372410 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7938054a20 con 0x7f7940151bf0 2023-11-28T16:56:41.605 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79240668d0 msgr2=0x7f7924068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79240668d0 0x7f7924068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f793c0ae000 tx=0x7f793c0a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7940151bf0 msgr2=0x7f7940157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7940151bf0 0x7f7940157420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f793800c730 tx=0x7f793800cbf0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 shutdown_connections 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7940151bf0 0x7f7940157420 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79240668d0 0x7f7924068d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79400c6220 0x7f79401f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 --2- 172.21.15.26:0/1908372410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79400c13a0 0x7f7940140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 >> 172.21.15.26:0/1908372410 conn(0x7f794006a5a0 msgr2=0x7f79400c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 shutdown_connections 2023-11-28T16:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.602+0000 7f79472e3640 1 -- 172.21.15.26:0/1908372410 wait complete. 2023-11-28T16:56:41.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46b89f8640 1 Processor -- start 2023-11-28T16:56:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46b89f8640 1 -- start start 2023-11-28T16:56:41.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46b89f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46b4156600 0x7f46b414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46b89f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46b414fb30 0x7f46b40aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46b89f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4152d90 con 0x7f46b40a86d0 2023-11-28T16:56:41.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46b89f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b414ffa0 con 0x7f46b4156600 2023-11-28T16:56:41.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46b89f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b4152480 con 0x7f46b414fb30 2023-11-28T16:56:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46abfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46b4156600 0x7f46b414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46abfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46b4156600 0x7f46b414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49214/0 (socket says 172.21.15.26:49214) 2023-11-28T16:56:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.766+0000 7f46abfff640 1 -- 172.21.15.26:0/1434476102 learned_addr learned my addr 172.21.15.26:0/1434476102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46b2d9d640 1 --2- 172.21.15.26:0/1434476102 >> v2:172.21.15.79:3300/0 conn(0x7f46b414fb30 0x7f46b40aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46abfff640 1 -- 172.21.15.26:0/1434476102 >> v2:172.21.15.79:3300/0 conn(0x7f46b414fb30 msgr2=0x7f46b40aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46abfff640 1 --2- 172.21.15.26:0/1434476102 >> v2:172.21.15.79:3300/0 conn(0x7f46b414fb30 0x7f46b40aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46abfff640 1 -- 172.21.15.26:0/1434476102 >> v1:172.21.15.79:6789/0 conn(0x7f46b40a86d0 legacy=0x7f46b40a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46abfff640 1 -- 172.21.15.26:0/1434476102 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40a9760 con 0x7f46b4156600 2023-11-28T16:56:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46b2d9d640 1 --2- 172.21.15.26:0/1434476102 >> v2:172.21.15.79:3300/0 conn(0x7f46b414fb30 0x7f46b40aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46abfff640 1 --2- 172.21.15.26:0/1434476102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4156600 0x7f46b414f5f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f469c009870 tx=0x7f469c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bb8b1e6c6a9e76 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46b1d9b640 1 -- 172.21.15.26:0/1434476102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0ac410 con 0x7f46b4156600 2023-11-28T16:56:41.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46b1d9b640 1 -- 172.21.15.26:0/1434476102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c0ac570 con 0x7f46b4156600 2023-11-28T16:56:41.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46b1d9b640 1 -- 172.21.15.26:0/1434476102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0ac900 con 0x7f46b4156600 2023-11-28T16:56:41.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46b89f8640 1 -- 172.21.15.26:0/1434476102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4156600 msgr2=0x7f46b414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.770+0000 7f46b89f8640 1 --2- 172.21.15.26:0/1434476102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4156600 0x7f46b414f5f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f469c009870 tx=0x7f469c01c4c0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- 172.21.15.26:0/1434476102 shutdown_connections 2023-11-28T16:56:41.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 --2- 172.21.15.26:0/1434476102 >> v2:172.21.15.79:3300/0 conn(0x7f46b414fb30 0x7f46b40aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 --2- 172.21.15.26:0/1434476102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4156600 0x7f46b414f5f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- 172.21.15.26:0/1434476102 >> 172.21.15.26:0/1434476102 conn(0x7f46b40c2a60 msgr2=0x7f46b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:41.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- 172.21.15.26:0/1434476102 shutdown_connections 2023-11-28T16:56:41.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- 172.21.15.26:0/1434476102 wait complete. 2023-11-28T16:56:41.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 Processor -- start 2023-11-28T16:56:41.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- start start 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40a86d0 0x7f46b41555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b414fb30 0x7f46b415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46b4156600 0x7f46b41f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40c0810 con 0x7f46b414fb30 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4072160 con 0x7f46b40a86d0 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b89f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41ea9c0 con 0x7f46b4156600 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b414fb30 0x7f46b415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b414fb30 0x7f46b415b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49216/0 (socket says 172.21.15.26:49216) 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 -- 172.21.15.26:0/3027771906 learned_addr learned my addr 172.21.15.26:0/3027771906 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b259c640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40a86d0 0x7f46b41555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b2d9d640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46b4156600 0x7f46b41f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 -- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46b4156600 msgr2=0x7f46b41f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46b4156600 0x7f46b41f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 -- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40a86d0 msgr2=0x7f46b41555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40a86d0 0x7f46b41555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 -- 172.21.15.26:0/3027771906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0094d0 con 0x7f46b414fb30 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46b259c640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40a86d0 0x7f46b41555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.774+0000 7f46abfff640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b414fb30 0x7f46b415b360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f469c0af040 tx=0x7f469c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46aaffd640 1 -- 172.21.15.26:0/3027771906 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0ac410 con 0x7f46b414fb30 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46aaffd640 1 -- 172.21.15.26:0/3027771906 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c0b7660 con 0x7f46b414fb30 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46aaffd640 1 -- 172.21.15.26:0/3027771906 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0b7a30 con 0x7f46b414fb30 2023-11-28T16:56:41.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b41533a0 con 0x7f46b414fb30 2023-11-28T16:56:41.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b4071c50 con 0x7f46b414fb30 2023-11-28T16:56:41.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4153200 con 0x7f46b414fb30 2023-11-28T16:56:41.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46aaffd640 1 -- 172.21.15.26:0/3027771906 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f469c0b3070 con 0x7f46b414fb30 2023-11-28T16:56:41.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46aaffd640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f46940668d0 0x7f4694068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:41.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46aaffd640 1 -- 172.21.15.26:0/3027771906 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f469c11eb20 con 0x7f46b414fb30 2023-11-28T16:56:41.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.778+0000 7f46b259c640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f46940668d0 0x7f4694068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:41.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.782+0000 7f46b259c640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f46940668d0 0x7f4694068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46a4003ec0 tx=0x7f46a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:41.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.782+0000 7f46aaffd640 1 -- 172.21.15.26:0/3027771906 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f46b4153200 con 0x7f46b414fb30 2023-11-28T16:56:41.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46b4153200 con 0x7f46b414fb30 2023-11-28T16:56:41.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46aaffd640 1 -- 172.21.15.26:0/3027771906 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46b4153200 con 0x7f46b414fb30 2023-11-28T16:56:41.948 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f46940668d0 msgr2=0x7f4694068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f46940668d0 0x7f4694068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46a4003ec0 tx=0x7f46a4009040 comp rx=0 tx=0).stop 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b414fb30 msgr2=0x7f46b415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b414fb30 0x7f46b415b360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f469c0af040 tx=0x7f469c019260 comp rx=0 tx=0).stop 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 shutdown_connections 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f46940668d0 0x7f4694068d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46b4156600 0x7f46b41f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b414fb30 0x7f46b415b360 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 --2- 172.21.15.26:0/3027771906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40a86d0 0x7f46b41555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 >> 172.21.15.26:0/3027771906 conn(0x7f46b40c2a60 msgr2=0x7f46b40c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:41.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 shutdown_connections 2023-11-28T16:56:41.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:41.942+0000 7f46b89f8640 1 -- 172.21.15.26:0/3027771906 wait complete. 2023-11-28T16:56:41.979 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-28T16:56:41.979 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:42.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdbbe9c640 1 Processor -- start 2023-11-28T16:56:42.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdbbe9c640 1 -- start start 2023-11-28T16:56:42.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdbbe9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb4156500 0x7fcdb406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdbbe9c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdb40c19e0 0x7fcdb40c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdbbe9c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb406dec0 con 0x7fcdb414fcc0 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdbbe9c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb40aa340 con 0x7fcdb40c19e0 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdbbe9c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4156980 con 0x7fcdb4156500 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdba439640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdb40c19e0 0x7fcdb40c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdba439640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdb40c19e0 0x7fcdb40c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49232/0 (socket says 172.21.15.26:49232) 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdba439640 1 -- 172.21.15.26:0/2332412469 learned_addr learned my addr 172.21.15.26:0/2332412469 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdb9437640 1 --2- 172.21.15.26:0/2332412469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb4156500 0x7fcdb406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdba439640 1 -- 172.21.15.26:0/2332412469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb4156500 msgr2=0x7fcdb406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdba439640 1 --2- 172.21.15.26:0/2332412469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb4156500 0x7fcdb406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdba439640 1 -- 172.21.15.26:0/2332412469 >> v1:172.21.15.79:6789/0 conn(0x7fcdb414fcc0 legacy=0x7fcdb40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.118+0000 7fcdba439640 1 -- 172.21.15.26:0/2332412469 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40ab580 con 0x7fcdb40c19e0 2023-11-28T16:56:42.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdba439640 1 --2- 172.21.15.26:0/2332412469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb40c19e0 0x7fcdb40c1e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009e50 tx=0x7fcdac01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44406c78b2565fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdb8c36640 1 -- 172.21.15.26:0/2332412469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0a57c0 con 0x7fcdb40c19e0 2023-11-28T16:56:42.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdb8c36640 1 -- 172.21.15.26:0/2332412469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac0a5920 con 0x7fcdb40c19e0 2023-11-28T16:56:42.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdb8c36640 1 -- 172.21.15.26:0/2332412469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0a5cb0 con 0x7fcdb40c19e0 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/2332412469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb40c19e0 msgr2=0x7fcdb40c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/2332412469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb40c19e0 0x7fcdb40c1e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009e50 tx=0x7fcdac01c9e0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/2332412469 shutdown_connections 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/2332412469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb40c19e0 0x7fcdb40c1e70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/2332412469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb4156500 0x7fcdb406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/2332412469 >> 172.21.15.26:0/2332412469 conn(0x7fcdb40c2ad0 msgr2=0x7fcdb40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/2332412469 shutdown_connections 2023-11-28T16:56:42.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.122+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/2332412469 wait complete. 2023-11-28T16:56:42.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 Processor -- start 2023-11-28T16:56:42.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 -- start start 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb40c19e0 0x7fcdb40c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb4156500 0x7fcdb4145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdb4145db0 0x7fcdb40c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4151e40 con 0x7fcdb4156500 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4151130 con 0x7fcdb4145db0 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4151710 con 0x7fcdb40c19e0 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb4156500 0x7fcdb4145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb4156500 0x7fcdb4145870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49240/0 (socket says 172.21.15.26:49240) 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 -- 172.21.15.26:0/1179596254 learned_addr learned my addr 172.21.15.26:0/1179596254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9c38640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb40c19e0 0x7fcdb40c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdba439640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdb4145db0 0x7fcdb40c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 -- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb40c19e0 msgr2=0x7fcdb40c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb40c19e0 0x7fcdb40c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 -- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdb4145db0 msgr2=0x7fcdb40c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdb4145db0 0x7fcdb40c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 -- 172.21.15.26:0/1179596254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac009b30 con 0x7fcdb4156500 2023-11-28T16:56:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdb9437640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb4156500 0x7fcdb4145870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e930 tx=0x7fcda400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdaa7fc640 1 -- 172.21.15.26:0/1179596254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4009690 con 0x7fcdb4156500 2023-11-28T16:56:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdaa7fc640 1 -- 172.21.15.26:0/1179596254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda400ca00 con 0x7fcdb4156500 2023-11-28T16:56:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdaa7fc640 1 -- 172.21.15.26:0/1179596254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400cd70 con 0x7fcdb4156500 2023-11-28T16:56:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb4146260 con 0x7fcdb4156500 2023-11-28T16:56:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb414dfc0 con 0x7fcdb4156500 2023-11-28T16:56:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.126+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb404e890 con 0x7fcdb4156500 2023-11-28T16:56:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.130+0000 7fcdaa7fc640 1 -- 172.21.15.26:0/1179596254 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcda4013470 con 0x7fcdb4156500 2023-11-28T16:56:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.130+0000 7fcdaa7fc640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcd980668d0 0x7fcd98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.130+0000 7fcdaa7fc640 1 -- 172.21.15.26:0/1179596254 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcda4084670 con 0x7fcdb4156500 2023-11-28T16:56:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.130+0000 7fcdb9c38640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcd980668d0 0x7fcd98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.130+0000 7fcdb9c38640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcd980668d0 0x7fcd98068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0000f70 tx=0x7fcdb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.134+0000 7fcdaa7fc640 1 -- 172.21.15.26:0/1179596254 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcda4051970 con 0x7fcdb4156500 2023-11-28T16:56:42.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.294+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdb4152200 con 0x7fcdb4156500 2023-11-28T16:56:42.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdaa7fc640 1 -- 172.21.15.26:0/1179596254 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fcda4054f90 con 0x7fcdb4156500 2023-11-28T16:56:42.303 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:42.303 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcd980668d0 msgr2=0x7fcd98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcd980668d0 0x7fcd98068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0000f70 tx=0x7fcdb0009040 comp rx=0 tx=0).stop 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb4156500 msgr2=0x7fcdb4145870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb4156500 0x7fcdb4145870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e930 tx=0x7fcda400edf0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 shutdown_connections 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdb4145db0 0x7fcdb40c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdb4156500 0x7fcdb4145870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcd980668d0 0x7fcd98068d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 --2- 172.21.15.26:0/1179596254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcdb40c19e0 0x7fcdb40c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 >> 172.21.15.26:0/1179596254 conn(0x7fcdb40c2ad0 msgr2=0x7fcdb4149ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 shutdown_connections 2023-11-28T16:56:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.298+0000 7fcdbbe9c640 1 -- 172.21.15.26:0/1179596254 wait complete. 2023-11-28T16:56:42.325 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:42.325 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a192b640 1 Processor -- start 2023-11-28T16:56:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a192b640 1 -- start start 2023-11-28T16:56:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a192b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f899c151ab0 0x7f899c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a192b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c0c7ce0 0x7f899c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a192b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c151e90 con 0x7f899c0c4ca0 2023-11-28T16:56:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a192b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0c71a0 con 0x7f899c151ab0 2023-11-28T16:56:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a192b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0c6900 con 0x7f899c0c7ce0 2023-11-28T16:56:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a0929640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f899c151ab0 0x7f899c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a0929640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f899c151ab0 0x7f899c154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49246/0 (socket says 172.21.15.26:49246) 2023-11-28T16:56:42.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a0929640 1 -- 172.21.15.26:0/2313351678 learned_addr learned my addr 172.21.15.26:0/2313351678 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:42.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f899bfff640 1 --2- 172.21.15.26:0/2313351678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c0c7ce0 0x7f899c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a0929640 1 -- 172.21.15.26:0/2313351678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c0c7ce0 msgr2=0x7f899c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:42.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a0929640 1 --2- 172.21.15.26:0/2313351678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c0c7ce0 0x7f899c0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a0929640 1 -- 172.21.15.26:0/2313351678 >> v1:172.21.15.26:6789/0 conn(0x7f899c0c4ca0 legacy=0x7f899c06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f89a0929640 1 -- 172.21.15.26:0/2313351678 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0c6be0 con 0x7f899c151ab0 2023-11-28T16:56:42.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.466+0000 7f899b7fe640 1 -- 172.21.15.26:0/2313351678 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146189501 0 0) 0x7f899c151e90 con 0x7f899c0c4ca0 2023-11-28T16:56:42.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a0929640 1 --2- 172.21.15.26:0/2313351678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c151ab0 0x7f899c154e80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8990009870 tx=0x7f899001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf96958f703ccbb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f899b7fe640 1 -- 172.21.15.26:0/2313351678 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900ac600 con 0x7f899c151ab0 2023-11-28T16:56:42.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f899b7fe640 1 -- 172.21.15.26:0/2313351678 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89900a8050 con 0x7f899c151ab0 2023-11-28T16:56:42.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f899b7fe640 1 -- 172.21.15.26:0/2313351678 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900ac980 con 0x7f899c151ab0 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 -- 172.21.15.26:0/2313351678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c151ab0 msgr2=0x7f899c154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 --2- 172.21.15.26:0/2313351678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c151ab0 0x7f899c154e80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8990009870 tx=0x7f899001c4b0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 -- 172.21.15.26:0/2313351678 shutdown_connections 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 --2- 172.21.15.26:0/2313351678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c0c7ce0 0x7f899c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 --2- 172.21.15.26:0/2313351678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c151ab0 0x7f899c154e80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 -- 172.21.15.26:0/2313351678 >> 172.21.15.26:0/2313351678 conn(0x7f899c0abba0 msgr2=0x7f899c0abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 -- 172.21.15.26:0/2313351678 shutdown_connections 2023-11-28T16:56:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.470+0000 7f89a192b640 1 -- 172.21.15.26:0/2313351678 wait complete. 2023-11-28T16:56:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 Processor -- start 2023-11-28T16:56:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 -- start start 2023-11-28T16:56:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899c0c4ca0 0x7f899c0c0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c0c7ce0 0x7f899c1efee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c151ab0 0x7f899c0be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0ae8d0 con 0x7f899c0c7ce0 2023-11-28T16:56:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0ae0b0 con 0x7f899c0c4ca0 2023-11-28T16:56:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0af100 con 0x7f899c151ab0 2023-11-28T16:56:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c0c7ce0 0x7f899c1efee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c0c7ce0 0x7f899c1efee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49262/0 (socket says 172.21.15.26:49262) 2023-11-28T16:56:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 -- 172.21.15.26:0/3112901123 learned_addr learned my addr 172.21.15.26:0/3112901123 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a0929640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899c0c4ca0 0x7f899c0c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a112a640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c151ab0 0x7f899c0be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 -- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c151ab0 msgr2=0x7f899c0be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c151ab0 0x7f899c0be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 -- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899c0c4ca0 msgr2=0x7f899c0c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899c0c4ca0 0x7f899c0c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 -- 172.21.15.26:0/3112901123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900094d0 con 0x7f899c0c7ce0 2023-11-28T16:56:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a0929640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899c0c4ca0 0x7f899c0c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a112a640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c151ab0 0x7f899c0be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f899bfff640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c0c7ce0 0x7f899c1efee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f898800d7d0 tx=0x7f898800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89997fa640 1 -- 172.21.15.26:0/3112901123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800b6c0 con 0x7f899c0c7ce0 2023-11-28T16:56:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89997fa640 1 -- 172.21.15.26:0/3112901123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898800b820 con 0x7f899c0c7ce0 2023-11-28T16:56:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c0ae310 con 0x7f899c0c7ce0 2023-11-28T16:56:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89997fa640 1 -- 172.21.15.26:0/3112901123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800bbd0 con 0x7f899c0c7ce0 2023-11-28T16:56:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c0bed10 con 0x7f899c0c7ce0 2023-11-28T16:56:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.474+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c067a10 con 0x7f899c0c7ce0 2023-11-28T16:56:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.478+0000 7f89997fa640 1 -- 172.21.15.26:0/3112901123 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f898800bd30 con 0x7f899c0c7ce0 2023-11-28T16:56:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.478+0000 7f89997fa640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8980066920 0x7f8980068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.478+0000 7f89997fa640 1 -- 172.21.15.26:0/3112901123 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8988084900 con 0x7f899c0c7ce0 2023-11-28T16:56:42.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.478+0000 7f89a0929640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8980066920 0x7f8980068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.478+0000 7f89a0929640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8980066920 0x7f8980068de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f89900ae000 tx=0x7f8990008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.482+0000 7f89997fa640 1 -- 172.21.15.26:0/3112901123 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8988051bb0 con 0x7f899c0c7ce0 2023-11-28T16:56:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f899c074970 con 0x7f899c0c7ce0 2023-11-28T16:56:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89997fa640 1 -- 172.21.15.26:0/3112901123 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89880551d0 con 0x7f899c0c7ce0 2023-11-28T16:56:42.647 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8980066920 msgr2=0x7f8980068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8980066920 0x7f8980068de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f89900ae000 tx=0x7f8990008040 comp rx=0 tx=0).stop 2023-11-28T16:56:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c0c7ce0 msgr2=0x7f899c1efee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c0c7ce0 0x7f899c1efee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f898800d7d0 tx=0x7f898800dc90 comp rx=0 tx=0).stop 2023-11-28T16:56:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 shutdown_connections 2023-11-28T16:56:42.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8980066920 0x7f8980068de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899c151ab0 0x7f899c0be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899c0c7ce0 0x7f899c1efee0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 --2- 172.21.15.26:0/3112901123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899c0c4ca0 0x7f899c0c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 >> 172.21.15.26:0/3112901123 conn(0x7f899c0abba0 msgr2=0x7f899c14f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:42.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 shutdown_connections 2023-11-28T16:56:42.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.642+0000 7f89a192b640 1 -- 172.21.15.26:0/3112901123 wait complete. 2023-11-28T16:56:42.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:42.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f928d6640 1 Processor -- start 2023-11-28T16:56:42.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f928d6640 1 -- start start 2023-11-28T16:56:42.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f928d6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f8c0c1bd0 0x7f4f8c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f928d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f928d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c157d20 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f928d6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c06deb0 con 0x7f4f8c0c1bd0 2023-11-28T16:56:42.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f928d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c06e100 con 0x7f4f8c152150 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f90e73640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f8bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f8c0c1bd0 0x7f4f8c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f90e73640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:56838/0 (socket says 172.21.15.26:56838) 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f90e73640 1 -- 172.21.15.26:0/2347218785 learned_addr learned my addr 172.21.15.26:0/2347218785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f8bfff640 1 --2- 172.21.15.26:0/2347218785 >> v2:172.21.15.79:3300/0 conn(0x7f4f8c0c1bd0 0x7f4f8c151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:39800/0 (socket says 172.21.15.26:39800) 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f90e73640 1 -- 172.21.15.26:0/2347218785 >> v2:172.21.15.79:3300/0 conn(0x7f4f8c0c1bd0 msgr2=0x7f4f8c151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f90e73640 1 --2- 172.21.15.26:0/2347218785 >> v2:172.21.15.79:3300/0 conn(0x7f4f8c0c1bd0 0x7f4f8c151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f90e73640 1 -- 172.21.15.26:0/2347218785 >> v1:172.21.15.79:6789/0 conn(0x7f4f8c06c5c0 legacy=0x7f4f8c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f90e73640 1 -- 172.21.15.26:0/2347218785 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0700f0 con 0x7f4f8c152150 2023-11-28T16:56:42.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.810+0000 7f4f8bfff640 1 --2- 172.21.15.26:0/2347218785 >> v2:172.21.15.79:3300/0 conn(0x7f4f8c0c1bd0 0x7f4f8c151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:42.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f90e73640 1 --2- 172.21.15.26:0/2347218785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1588c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f84009e50 tx=0x7f4f8401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b6a9364163b76bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f8affd640 1 -- 172.21.15.26:0/2347218785 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840a57d0 con 0x7f4f8c152150 2023-11-28T16:56:42.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f8affd640 1 -- 172.21.15.26:0/2347218785 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f840a5930 con 0x7f4f8c152150 2023-11-28T16:56:42.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f8affd640 1 -- 172.21.15.26:0/2347218785 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840a5cc0 con 0x7f4f8c152150 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 -- 172.21.15.26:0/2347218785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 msgr2=0x7f4f8c1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 --2- 172.21.15.26:0/2347218785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1588c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f84009e50 tx=0x7f4f8401c8f0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 -- 172.21.15.26:0/2347218785 shutdown_connections 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 --2- 172.21.15.26:0/2347218785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1588c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 --2- 172.21.15.26:0/2347218785 >> v2:172.21.15.79:3300/0 conn(0x7f4f8c0c1bd0 0x7f4f8c151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 -- 172.21.15.26:0/2347218785 >> 172.21.15.26:0/2347218785 conn(0x7f4f8c0c2a60 msgr2=0x7f4f8c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 -- 172.21.15.26:0/2347218785 shutdown_connections 2023-11-28T16:56:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.814+0000 7f4f928d6640 1 -- 172.21.15.26:0/2347218785 wait complete. 2023-11-28T16:56:42.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 Processor -- start 2023-11-28T16:56:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 -- start start 2023-11-28T16:56:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f8c06c5c0 0x7f4f8c150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f8c0c1bd0 0x7f4f8c151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0c4cc0 con 0x7f4f8c0c1bd0 2023-11-28T16:56:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0c4500 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1515c0 con 0x7f4f8c152150 2023-11-28T16:56:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f8c0c1bd0 0x7f4f8c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f8c06c5c0 0x7f4f8c150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f8c06c5c0 0x7f4f8c150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:39814/0 (socket says 172.21.15.26:39814) 2023-11-28T16:56:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 -- 172.21.15.26:0/4274568102 learned_addr learned my addr 172.21.15.26:0/4274568102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f8c0c1bd0 0x7f4f8c151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49272/0 (socket says 172.21.15.26:49272) 2023-11-28T16:56:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f90e73640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 -- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 msgr2=0x7f4f8c1ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 -- 172.21.15.26:0/4274568102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f8c0c1bd0 msgr2=0x7f4f8c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f8c0c1bd0 0x7f4f8c151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 -- 172.21.15.26:0/4274568102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c009420 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8b7fe640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f8c0c1bd0 0x7f4f8c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f8bfff640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f8c06c5c0 0x7f4f8c150b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00ec10 tx=0x7f4f7c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f88ff9640 1 -- 172.21.15.26:0/4274568102 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00cc30 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f88ff9640 1 -- 172.21.15.26:0/4274568102 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c00cd90 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f88ff9640 1 -- 172.21.15.26:0/4274568102 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c013690 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f84009b30 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.818+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c0c47a0 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.822+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c155370 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.822+0000 7f4f88ff9640 1 -- 172.21.15.26:0/4274568102 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4f7c0137f0 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.822+0000 7f4f88ff9640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f780668d0 0x7f4f78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:42.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.822+0000 7f4f88ff9640 1 -- 172.21.15.26:0/4274568102 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f7c084730 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.822+0000 7f4f8b7fe640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f780668d0 0x7f4f78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:42.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.822+0000 7f4f8b7fe640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f780668d0 0x7f4f78068d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c157bb0 tx=0x7f4f80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:42.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.830+0000 7f4f88ff9640 1 -- 172.21.15.26:0/4274568102 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f7c051980 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.986+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f8c0c49c0 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f88ff9640 1 -- 172.21.15.26:0/4274568102 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f7c054fa0 con 0x7f4f8c06c5c0 2023-11-28T16:56:42.994 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:42.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f780668d0 msgr2=0x7f4f78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f780668d0 0x7f4f78068d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c157bb0 tx=0x7f4f80009040 comp rx=0 tx=0).stop 2023-11-28T16:56:42.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f8c06c5c0 msgr2=0x7f4f8c150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:42.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f8c06c5c0 0x7f4f8c150b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00ec10 tx=0x7f4f7c00c520 comp rx=0 tx=0).stop 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 shutdown_connections 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f780668d0 0x7f4f78068d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f8c152150 0x7f4f8c1ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f8c0c1bd0 0x7f4f8c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 --2- 172.21.15.26:0/4274568102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f8c06c5c0 0x7f4f8c150b40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 >> 172.21.15.26:0/4274568102 conn(0x7f4f8c0c2a60 msgr2=0x7f4f8c0c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 shutdown_connections 2023-11-28T16:56:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:42.990+0000 7f4f928d6640 1 -- 172.21.15.26:0/4274568102 wait complete. 2023-11-28T16:56:43.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:43.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.154+0000 7fc1f099d640 1 Processor -- start 2023-11-28T16:56:43.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.154+0000 7fc1f099d640 1 -- start start 2023-11-28T16:56:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1f099d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1ec156600 0x7fc1ec14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1f099d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 0x7fc1ec0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1f099d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec152d90 con 0x7fc1ec0a86d0 2023-11-28T16:56:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1f099d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec152480 con 0x7fc1ec156600 2023-11-28T16:56:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1f099d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0a9760 con 0x7fc1ec14fb30 2023-11-28T16:56:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc1ec0a86d0 0x7fc1ec0a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51840/0 (socket says 172.21.15.26:51840) 2023-11-28T16:56:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 -- 172.21.15.26:0/4115916826 learned_addr learned my addr 172.21.15.26:0/4115916826 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e9d9b640 1 --2- 172.21.15.26:0/4115916826 >> v2:172.21.15.79:3300/0 conn(0x7fc1ec156600 0x7fc1ec14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ead9d640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 0x7fc1ec0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692061645 0 0) 0x7fc1ec152d90 con 0x7fc1ec0a86d0 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d4003530 con 0x7fc1ec0a86d0 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184708488 0 0) 0x7fc1d4003530 con 0x7fc1ec0a86d0 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 msgr2=0x7fc1ec0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 0x7fc1ec0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 >> v2:172.21.15.79:3300/0 conn(0x7fc1ec156600 msgr2=0x7fc1ec14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 --2- 172.21.15.26:0/4115916826 >> v2:172.21.15.79:3300/0 conn(0x7fc1ec156600 0x7fc1ec14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec152740 con 0x7fc1ec0a86d0 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fc1dc001680 con 0x7fc1ec0a86d0 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 >> v1:172.21.15.26:6789/0 conn(0x7fc1ec0a86d0 legacy=0x7fc1ec0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1d4003980 0x7fc1d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 0x7fc1d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1d4004d10 0x7fc1d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec152480 con 0x7fc1d4003980 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0a9760 con 0x7fc1d4004d10 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d400b990 con 0x7fc1ec14fb30 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1d4003980 0x7fc1d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1e9d9b640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 0x7fc1d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ead9d640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1d4004d10 0x7fc1d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 -- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 msgr2=0x7fc1d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1ec14fb30 0x7fc1d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 -- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1d4004d10 msgr2=0x7fc1d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1d4004d10 0x7fc1d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.158+0000 7fc1ea59c640 1 -- 172.21.15.26:0/4115916826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec152740 con 0x7fc1d4003980 2023-11-28T16:56:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1ea59c640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1d4003980 0x7fc1d4003da0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c2c0 tx=0x7fc1dc01cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17053ad2d49d5342 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0058e0 con 0x7fc1d4003980 2023-11-28T16:56:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc005a40 con 0x7fc1d4003980 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1e959a640 1 -- 172.21.15.26:0/4115916826 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc005df0 con 0x7fc1d4003980 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1f099d640 1 -- 172.21.15.26:0/4115916826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1d4003980 msgr2=0x7fc1d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1f099d640 1 --2- 172.21.15.26:0/4115916826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1d4003980 0x7fc1d4003da0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c2c0 tx=0x7fc1dc01cd40 comp rx=0 tx=0).stop 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1ead9d640 1 -- 172.21.15.26:0/4115916826 reap_dead start 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1f099d640 1 -- 172.21.15.26:0/4115916826 shutdown_connections 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1f099d640 1 -- 172.21.15.26:0/4115916826 >> 172.21.15.26:0/4115916826 conn(0x7fc1ec0c2a60 msgr2=0x7fc1ec0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1f099d640 1 -- 172.21.15.26:0/4115916826 shutdown_connections 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1f099d640 1 -- 172.21.15.26:0/4115916826 wait complete. 2023-11-28T16:56:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.162+0000 7fc1f099d640 1 Processor -- start 2023-11-28T16:56:43.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 -- start start 2023-11-28T16:56:43.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1d4003980 0x7fc1ec14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ec0bcb80 0x7fc1ec1e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec1e95f0 0x7fc1ec1ee640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1e9a70 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1598d0 con 0x7fc1ec1e95f0 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec159b70 con 0x7fc1d4003980 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ec0bcb80 0x7fc1ec1e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ec0bcb80 0x7fc1ec1e90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49284/0 (socket says 172.21.15.26:49284) 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 -- 172.21.15.26:0/270647312 learned_addr learned my addr 172.21.15.26:0/270647312 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1ea59c640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1d4003980 0x7fc1ec14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1ead9d640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec1e95f0 0x7fc1ec1ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 -- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1d4003980 msgr2=0x7fc1ec14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1d4003980 0x7fc1ec14d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 -- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec1e95f0 msgr2=0x7fc1ec1ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec1e95f0 0x7fc1ec1ee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 -- 172.21.15.26:0/270647312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec1eb3e0 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1e9d9b640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ec0bcb80 0x7fc1ec1e90b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0006d50 tx=0x7fc1e0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1daffd640 1 -- 172.21.15.26:0/270647312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000faf0 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1daffd640 1 -- 172.21.15.26:0/270647312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e000fc50 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1daffd640 1 -- 172.21.15.26:0/270647312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0004030 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec1eb6c0 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec0bbc30 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.166+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec072b30 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.170+0000 7fc1daffd640 1 -- 172.21.15.26:0/270647312 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc1e0004190 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.170+0000 7fc1daffd640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc1cc066900 0x7fc1cc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.170+0000 7fc1daffd640 1 -- 172.21.15.26:0/270647312 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e00849a0 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.170+0000 7fc1ea59c640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc1cc066900 0x7fc1cc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.170+0000 7fc1ea59c640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc1cc066900 0x7fc1cc068dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0aa000 tx=0x7fc1dc001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:43.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.174+0000 7fc1daffd640 1 -- 172.21.15.26:0/270647312 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1e0051c80 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1ec04e890 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1daffd640 1 -- 172.21.15.26:0/270647312 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1e0022020 con 0x7fc1ec0bcb80 2023-11-28T16:56:43.335 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:43.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc1cc066900 msgr2=0x7fc1cc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc1cc066900 0x7fc1cc068dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0aa000 tx=0x7fc1dc001a10 comp rx=0 tx=0).stop 2023-11-28T16:56:43.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ec0bcb80 msgr2=0x7fc1ec1e90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ec0bcb80 0x7fc1ec1e90b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0006d50 tx=0x7fc1e0011de0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 shutdown_connections 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec1e95f0 0x7fc1ec1ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ec0bcb80 0x7fc1ec1e90b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc1cc066900 0x7fc1cc068dc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 --2- 172.21.15.26:0/270647312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1d4003980 0x7fc1ec14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 >> 172.21.15.26:0/270647312 conn(0x7fc1ec0c2a60 msgr2=0x7fc1ec14ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 shutdown_connections 2023-11-28T16:56:43.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.330+0000 7fc1f099d640 1 -- 172.21.15.26:0/270647312 wait complete. 2023-11-28T16:56:43.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-28T16:56:43.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3099b8640 1 Processor -- start 2023-11-28T16:56:43.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3099b8640 1 -- start start 2023-11-28T16:56:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3099b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff3040c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3099b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3040c1ae0 0x7ff30406a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3099b8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3041551d0 con 0x7ff3040c0510 2023-11-28T16:56:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3099b8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30406e9c0 con 0x7ff3040c1ae0 2023-11-28T16:56:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3099b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040a86e0 con 0x7ff30406a5a0 2023-11-28T16:56:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff302ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff3040c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3027fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3040c1ae0 0x7ff30406a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3027fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3040c1ae0 0x7ff30406a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:39832/0 (socket says 172.21.15.26:39832) 2023-11-28T16:56:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3027fc640 1 -- 172.21.15.26:0/387550650 learned_addr learned my addr 172.21.15.26:0/387550650 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff302ffd640 1 --2- 172.21.15.26:0/387550650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff3040c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:56862/0 (socket says 172.21.15.26:56862) 2023-11-28T16:56:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff302ffd640 1 -- 172.21.15.26:0/387550650 >> v2:172.21.15.79:3300/0 conn(0x7ff3040c1ae0 msgr2=0x7ff30406a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff302ffd640 1 --2- 172.21.15.26:0/387550650 >> v2:172.21.15.79:3300/0 conn(0x7ff3040c1ae0 0x7ff30406a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff302ffd640 1 -- 172.21.15.26:0/387550650 >> v1:172.21.15.79:6789/0 conn(0x7ff3040c0510 legacy=0x7ff3040c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff302ffd640 1 -- 172.21.15.26:0/387550650 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304072840 con 0x7ff30406a5a0 2023-11-28T16:56:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.494+0000 7ff3027fc640 1 --2- 172.21.15.26:0/387550650 >> v2:172.21.15.79:3300/0 conn(0x7ff3040c1ae0 0x7ff30406a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:43.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff302ffd640 1 --2- 172.21.15.26:0/387550650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff3040c3490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097c0 tx=0x7ff2f401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb11ce360fb14fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff301ffb640 1 -- 172.21.15.26:0/387550650 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40ab600 con 0x7ff30406a5a0 2023-11-28T16:56:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff301ffb640 1 -- 172.21.15.26:0/387550650 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f40a7050 con 0x7ff30406a5a0 2023-11-28T16:56:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff301ffb640 1 -- 172.21.15.26:0/387550650 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40ab980 con 0x7ff30406a5a0 2023-11-28T16:56:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 -- 172.21.15.26:0/387550650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 msgr2=0x7ff3040c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 --2- 172.21.15.26:0/387550650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff3040c3490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097c0 tx=0x7ff2f401c480 comp rx=0 tx=0).stop 2023-11-28T16:56:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 -- 172.21.15.26:0/387550650 shutdown_connections 2023-11-28T16:56:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 --2- 172.21.15.26:0/387550650 >> v2:172.21.15.79:3300/0 conn(0x7ff3040c1ae0 0x7ff30406a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 --2- 172.21.15.26:0/387550650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff3040c3490 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 -- 172.21.15.26:0/387550650 >> 172.21.15.26:0/387550650 conn(0x7ff3040c3be0 msgr2=0x7ff3040c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 -- 172.21.15.26:0/387550650 shutdown_connections 2023-11-28T16:56:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.498+0000 7ff3099b8640 1 -- 172.21.15.26:0/387550650 wait complete. 2023-11-28T16:56:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 Processor -- start 2023-11-28T16:56:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 -- start start 2023-11-28T16:56:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff304145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3040c0510 0x7ff304148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3040c1ae0 0x7ff304148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304148080 con 0x7ff3040c0510 2023-11-28T16:56:43.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304149fb0 con 0x7ff3040c1ae0 2023-11-28T16:56:43.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3041ed5e0 con 0x7ff30406a5a0 2023-11-28T16:56:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3040c0510 0x7ff304148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3040c0510 0x7ff304148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49286/0 (socket says 172.21.15.26:49286) 2023-11-28T16:56:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 -- 172.21.15.26:0/2585766457 learned_addr learned my addr 172.21.15.26:0/2585766457 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3037fe640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3040c1ae0 0x7ff304148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff302ffd640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff304145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 -- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 msgr2=0x7ff304145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff304145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 -- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3040c1ae0 msgr2=0x7ff304148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3040c1ae0 0x7ff304148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 -- 172.21.15.26:0/2585766457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80094d0 con 0x7ff3040c0510 2023-11-28T16:56:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3027fc640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3040c0510 0x7ff304148550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e9d0 tx=0x7ff2f800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff2ebfff640 1 -- 172.21.15.26:0/2585766457 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f800ca60 con 0x7ff3040c0510 2023-11-28T16:56:43.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff2ebfff640 1 -- 172.21.15.26:0/2585766457 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f800cbc0 con 0x7ff3040c0510 2023-11-28T16:56:43.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff2ebfff640 1 -- 172.21.15.26:0/2585766457 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8013470 con 0x7ff3040c0510 2023-11-28T16:56:43.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f4009420 con 0x7ff3040c0510 2023-11-28T16:56:43.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.502+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3041ed8c0 con 0x7ff3040c0510 2023-11-28T16:56:43.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.506+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff304155640 con 0x7ff3040c0510 2023-11-28T16:56:43.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.506+0000 7ff2ebfff640 1 -- 172.21.15.26:0/2585766457 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff2f80135d0 con 0x7ff3040c0510 2023-11-28T16:56:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.506+0000 7ff2ebfff640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2f00668d0 0x7ff2f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.506+0000 7ff2ebfff640 1 -- 172.21.15.26:0/2585766457 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2f8084610 con 0x7ff3040c0510 2023-11-28T16:56:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.506+0000 7ff302ffd640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2f00668d0 0x7ff2f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.506+0000 7ff302ffd640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2f00668d0 0x7ff2f0068d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40ad000 tx=0x7ff2f40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.510+0000 7ff2ebfff640 1 -- 172.21.15.26:0/2585766457 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff304155640 con 0x7ff3040c0510 2023-11-28T16:56:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:43.722+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7ff304155640 con 0x7ff3040c0510 2023-11-28T16:56:44.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.390+0000 7ff2ebfff640 1 -- 172.21.15.26:0/2585766457 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v47) v1 ==== 162+0+0 (secure 0 0 0) 0x7ff304155640 con 0x7ff3040c0510 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2f00668d0 msgr2=0x7ff2f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2f00668d0 0x7ff2f0068d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40ad000 tx=0x7ff2f40a6000 comp rx=0 tx=0).stop 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3040c0510 msgr2=0x7ff304148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3040c0510 0x7ff304148550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e9d0 tx=0x7ff2f800ee90 comp rx=0 tx=0).stop 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 shutdown_connections 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3040c1ae0 0x7ff304148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3040c0510 0x7ff304148550 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2f00668d0 0x7ff2f0068d90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 --2- 172.21.15.26:0/2585766457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff30406a5a0 0x7ff304145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 >> 172.21.15.26:0/2585766457 conn(0x7ff3040c3be0 msgr2=0x7ff3040a9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:44.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 shutdown_connections 2023-11-28T16:56:44.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.394+0000 7ff3099b8640 1 -- 172.21.15.26:0/2585766457 wait complete. 2023-11-28T16:56:44.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T16:56:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.566+0000 7fc9edeea640 1 Processor -- start 2023-11-28T16:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.566+0000 7fc9edeea640 1 -- start start 2023-11-28T16:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9edeea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9e80c0370 0x7fc9e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9edeea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9e80a8470 0x7fc9e806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9edeea640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e806de00 con 0x7fc9e814eaf0 2023-11-28T16:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9edeea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e8070390 con 0x7fc9e80c0370 2023-11-28T16:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9edeea640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e806db90 con 0x7fc9e80a8470 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9e80c0370 0x7fc9e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9e80c0370 0x7fc9e806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49298/0 (socket says 172.21.15.26:49298) 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9dffff640 1 -- 172.21.15.26:0/2386929804 learned_addr learned my addr 172.21.15.26:0/2386929804 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9e7fff640 1 --2- 172.21.15.26:0/2386929804 >> v2:172.21.15.79:3300/0 conn(0x7fc9e80a8470 0x7fc9e806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9dffff640 1 -- 172.21.15.26:0/2386929804 >> v2:172.21.15.79:3300/0 conn(0x7fc9e80a8470 msgr2=0x7fc9e806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9dffff640 1 --2- 172.21.15.26:0/2386929804 >> v2:172.21.15.79:3300/0 conn(0x7fc9e80a8470 0x7fc9e806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9dffff640 1 -- 172.21.15.26:0/2386929804 >> v1:172.21.15.79:6789/0 conn(0x7fc9e814eaf0 legacy=0x7fc9e8151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.570+0000 7fc9dffff640 1 -- 172.21.15.26:0/2386929804 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e814eed0 con 0x7fc9e80c0370 2023-11-28T16:56:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9dffff640 1 --2- 172.21.15.26:0/2386929804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e806d110 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80c3910 tx=0x7fc9d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe76c9c457d42f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9e6ffd640 1 -- 172.21.15.26:0/2386929804 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00ab600 con 0x7fc9e80c0370 2023-11-28T16:56:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9e6ffd640 1 -- 172.21.15.26:0/2386929804 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d00ab760 con 0x7fc9e80c0370 2023-11-28T16:56:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9e6ffd640 1 -- 172.21.15.26:0/2386929804 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00abaf0 con 0x7fc9e80c0370 2023-11-28T16:56:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 -- 172.21.15.26:0/2386929804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 msgr2=0x7fc9e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 --2- 172.21.15.26:0/2386929804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e806d110 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80c3910 tx=0x7fc9d001c3e0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 -- 172.21.15.26:0/2386929804 shutdown_connections 2023-11-28T16:56:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 --2- 172.21.15.26:0/2386929804 >> v2:172.21.15.79:3300/0 conn(0x7fc9e80a8470 0x7fc9e806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 --2- 172.21.15.26:0/2386929804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e806d110 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 -- 172.21.15.26:0/2386929804 >> 172.21.15.26:0/2386929804 conn(0x7fc9e80c2a60 msgr2=0x7fc9e80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 -- 172.21.15.26:0/2386929804 shutdown_connections 2023-11-28T16:56:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 -- 172.21.15.26:0/2386929804 wait complete. 2023-11-28T16:56:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 Processor -- start 2023-11-28T16:56:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.574+0000 7fc9edeea640 1 -- start start 2023-11-28T16:56:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9e80a8470 0x7fc9e81ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e80aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9e814eaf0 0x7fc9e80bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8152e20 con 0x7fc9e80c0370 2023-11-28T16:56:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8153350 con 0x7fc9e814eaf0 2023-11-28T16:56:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8153070 con 0x7fc9e80a8470 2023-11-28T16:56:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e80aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e80aa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49304/0 (socket says 172.21.15.26:49304) 2023-11-28T16:56:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 -- 172.21.15.26:0/112301144 learned_addr learned my addr 172.21.15.26:0/112301144 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9e77fe640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9e80a8470 0x7fc9e81ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9e7fff640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9e814eaf0 0x7fc9e80bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 -- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9e80a8470 msgr2=0x7fc9e81ed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9e80a8470 0x7fc9e81ed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 -- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9e814eaf0 msgr2=0x7fc9e80bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9e814eaf0 0x7fc9e80bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 -- 172.21.15.26:0/112301144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00094d0 con 0x7fc9e80c0370 2023-11-28T16:56:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9e77fe640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9e80a8470 0x7fc9e81ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9dffff640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e80aa1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0018ff0 tx=0x7fc9d001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9e4ff9640 1 -- 172.21.15.26:0/112301144 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00b2b50 con 0x7fc9e80c0370 2023-11-28T16:56:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9e4ff9640 1 -- 172.21.15.26:0/112301144 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d00b2cb0 con 0x7fc9e80c0370 2023-11-28T16:56:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e81f0440 con 0x7fc9e80c0370 2023-11-28T16:56:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9e4ff9640 1 -- 172.21.15.26:0/112301144 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00abe20 con 0x7fc9e80c0370 2023-11-28T16:56:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e8149f10 con 0x7fc9e80c0370 2023-11-28T16:56:44.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e81f0960 con 0x7fc9e80c0370 2023-11-28T16:56:44.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.578+0000 7fc9e4ff9640 1 -- 172.21.15.26:0/112301144 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc9d00c7440 con 0x7fc9e80c0370 2023-11-28T16:56:44.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.582+0000 7fc9e4ff9640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9c80668d0 0x7fc9c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:44.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.582+0000 7fc9e4ff9640 1 -- 172.21.15.26:0/112301144 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9d011f280 con 0x7fc9e80c0370 2023-11-28T16:56:44.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.582+0000 7fc9e77fe640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9c80668d0 0x7fc9c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:44.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.582+0000 7fc9e77fe640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9c80668d0 0x7fc9c8068d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f70 tx=0x7fc9d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.586+0000 7fc9e4ff9640 1 -- 172.21.15.26:0/112301144 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9e81f0960 con 0x7fc9e80c0370 2023-11-28T16:56:44.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.746+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc9e81f0960 con 0x7fc9e80c0370 2023-11-28T16:56:44.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.750+0000 7fc9e4ff9640 1 -- 172.21.15.26:0/112301144 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9e81f0960 con 0x7fc9e80c0370 2023-11-28T16:56:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.750+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9c80668d0 msgr2=0x7fc9c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.750+0000 7fc9edeea640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9c80668d0 0x7fc9c8068d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f70 tx=0x7fc9d8009040 comp rx=0 tx=0).stop 2023-11-28T16:56:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.750+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 msgr2=0x7fc9e80aa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.750+0000 7fc9edeea640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e80aa1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0018ff0 tx=0x7fc9d001ac20 comp rx=0 tx=0).stop 2023-11-28T16:56:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 shutdown_connections 2023-11-28T16:56:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9e814eaf0 0x7fc9e80bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e80c0370 0x7fc9e80aa1f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9c80668d0 0x7fc9c8068d90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 --2- 172.21.15.26:0/112301144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9e80a8470 0x7fc9e81ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:44.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 >> 172.21.15.26:0/112301144 conn(0x7fc9e80c2a60 msgr2=0x7fc9e814a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:44.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 shutdown_connections 2023-11-28T16:56:44.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:44.754+0000 7fc9edeea640 1 -- 172.21.15.26:0/112301144 wait complete. 2023-11-28T16:56:44.778 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T16:56:44.778 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:56:44.872 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:56:44.949 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T16:56:44.949 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:56:44.949 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:44.959 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:56:44.959 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:45.010 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:56:45.010 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:45.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:45.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 Processor -- start 2023-11-28T16:56:45.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 -- start start 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f159414fcc0 0x7f1594156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f159406d980 0x7f15940aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15940ab3b0 0x7f15940c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15940aa340 con 0x7f159414fcc0 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1594152fe0 con 0x7f15940ab3b0 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.242+0000 7f1598d72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15941532c0 con 0x7f159406d980 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f159414fcc0 0x7f1594156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f159414fcc0 0x7f1594156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49318/0 (socket says 172.21.15.26:49318) 2023-11-28T16:56:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 -- 172.21.15.26:0/4241972017 learned_addr learned my addr 172.21.15.26:0/4241972017 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f1592d9d640 1 --2- 172.21.15.26:0/4241972017 >> v2:172.21.15.79:3300/0 conn(0x7f15940ab3b0 0x7f15940c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f158bfff640 1 --2- 172.21.15.26:0/4241972017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f159406d980 0x7f15940aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 -- 172.21.15.26:0/4241972017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f159406d980 msgr2=0x7f15940aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 --2- 172.21.15.26:0/4241972017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f159406d980 0x7f15940aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 -- 172.21.15.26:0/4241972017 >> v2:172.21.15.79:3300/0 conn(0x7f15940ab3b0 msgr2=0x7f15940c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 --2- 172.21.15.26:0/4241972017 >> v2:172.21.15.79:3300/0 conn(0x7f15940ab3b0 0x7f15940c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 -- 172.21.15.26:0/4241972017 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594155a20 con 0x7f159414fcc0 2023-11-28T16:56:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f1592d9d640 1 --2- 172.21.15.26:0/4241972017 >> v2:172.21.15.79:3300/0 conn(0x7f15940ab3b0 0x7f15940c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f158bfff640 1 --2- 172.21.15.26:0/4241972017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f159406d980 0x7f15940aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:45.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f159259c640 1 --2- 172.21.15.26:0/4241972017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159414fcc0 0x7f1594156500 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f159406e300 tx=0x7f158401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3e32d8de021920 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f1591d9b640 1 -- 172.21.15.26:0/4241972017 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840aa5f0 con 0x7f159414fcc0 2023-11-28T16:56:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f1591d9b640 1 -- 172.21.15.26:0/4241972017 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15840aa750 con 0x7f159414fcc0 2023-11-28T16:56:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.246+0000 7f1591d9b640 1 -- 172.21.15.26:0/4241972017 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840aaae0 con 0x7f159414fcc0 2023-11-28T16:56:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- 172.21.15.26:0/4241972017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159414fcc0 msgr2=0x7f1594156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 --2- 172.21.15.26:0/4241972017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159414fcc0 0x7f1594156500 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f159406e300 tx=0x7f158401c4d0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- 172.21.15.26:0/4241972017 shutdown_connections 2023-11-28T16:56:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 --2- 172.21.15.26:0/4241972017 >> v2:172.21.15.79:3300/0 conn(0x7f15940ab3b0 0x7f15940c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 --2- 172.21.15.26:0/4241972017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f159406d980 0x7f15940aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 --2- 172.21.15.26:0/4241972017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159414fcc0 0x7f1594156500 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- 172.21.15.26:0/4241972017 >> 172.21.15.26:0/4241972017 conn(0x7f15940c2ad0 msgr2=0x7f15940c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- 172.21.15.26:0/4241972017 shutdown_connections 2023-11-28T16:56:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- 172.21.15.26:0/4241972017 wait complete. 2023-11-28T16:56:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 Processor -- start 2023-11-28T16:56:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- start start 2023-11-28T16:56:45.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f159406d980 0x7f159414abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15940ab3b0 0x7f1594148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15941efce0 0x7f1594149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159414b830 con 0x7f15941efce0 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594149670 con 0x7f159406d980 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1598d72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15941ed6b0 con 0x7f15940ab3b0 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15941efce0 0x7f1594149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f158bfff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15940ab3b0 0x7f1594148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15941efce0 0x7f1594149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49334/0 (socket says 172.21.15.26:49334) 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f1592d9d640 1 -- 172.21.15.26:0/1246262290 learned_addr learned my addr 172.21.15.26:0/1246262290 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.250+0000 7f159259c640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f159406d980 0x7f159414abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1592d9d640 1 -- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15940ab3b0 msgr2=0x7f1594148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1592d9d640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15940ab3b0 0x7f1594148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1592d9d640 1 -- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f159406d980 msgr2=0x7f159414abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1592d9d640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f159406d980 0x7f159414abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1592d9d640 1 -- 172.21.15.26:0/1246262290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840094d0 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1592d9d640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15941efce0 0x7f1594149130 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f158c00ceb0 tx=0x7f158c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f158affd640 1 -- 172.21.15.26:0/1246262290 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00d840 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f158affd640 1 -- 172.21.15.26:0/1246262290 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00d9a0 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15941ecb30 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f158affd640 1 -- 172.21.15.26:0/1246262290 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00dd50 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15941ed0f0 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15940c3bc0 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f158affd640 1 -- 172.21.15.26:0/1246262290 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f158c01f440 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.254+0000 7f158affd640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f15740668d0 0x7f1574068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.258+0000 7f158affd640 1 -- 172.21.15.26:0/1246262290 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f158c084e30 con 0x7f15941efce0 2023-11-28T16:56:45.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.258+0000 7f159259c640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f15740668d0 0x7f1574068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.258+0000 7f159259c640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f15740668d0 0x7f1574068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f15840ae000 tx=0x7f15840b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.262+0000 7f158affd640 1 -- 172.21.15.26:0/1246262290 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15940c3bc0 con 0x7f15941efce0 2023-11-28T16:56:45.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.418+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15940c3bc0 con 0x7f15941efce0 2023-11-28T16:56:45.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.418+0000 7f158affd640 1 -- 172.21.15.26:0/1246262290 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f15940c3bc0 con 0x7f15941efce0 2023-11-28T16:56:45.425 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:45.425 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f15740668d0 msgr2=0x7f1574068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f15740668d0 0x7f1574068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f15840ae000 tx=0x7f15840b5040 comp rx=0 tx=0).stop 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15941efce0 msgr2=0x7f1594149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15941efce0 0x7f1594149130 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f158c00ceb0 tx=0x7f158c00a710 comp rx=0 tx=0).stop 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 shutdown_connections 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15941efce0 0x7f1594149130 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f15740668d0 0x7f1574068d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15940ab3b0 0x7f1594148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 --2- 172.21.15.26:0/1246262290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f159406d980 0x7f159414abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 >> 172.21.15.26:0/1246262290 conn(0x7f15940c2ad0 msgr2=0x7f15941538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:45.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 shutdown_connections 2023-11-28T16:56:45.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.422+0000 7f1598d72640 1 -- 172.21.15.26:0/1246262290 wait complete. 2023-11-28T16:56:45.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:45.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:45.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.586+0000 7f8d515df640 1 Processor -- start 2023-11-28T16:56:45.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d515df640 1 -- start start 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d515df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c0c2750 0x7f8d4c151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d515df640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d4c0c4350 0x7f8d4c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d515df640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c0c22c0 con 0x7f8d4c152300 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d515df640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c06d880 con 0x7f8d4c0c4350 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d515df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c152740 con 0x7f8d4c0c2750 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d4c0c4350 0x7f8d4c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d4c0c4350 0x7f8d4c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49344/0 (socket says 172.21.15.26:49344) 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4b7fe640 1 -- 172.21.15.26:0/1353452442 learned_addr learned my addr 172.21.15.26:0/1353452442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4affd640 1 --2- 172.21.15.26:0/1353452442 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c0c2750 0x7f8d4c151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4b7fe640 1 -- 172.21.15.26:0/1353452442 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c0c2750 msgr2=0x7f8d4c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:45.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4b7fe640 1 --2- 172.21.15.26:0/1353452442 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c0c2750 0x7f8d4c151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4b7fe640 1 -- 172.21.15.26:0/1353452442 >> v1:172.21.15.79:6789/0 conn(0x7f8d4c152300 legacy=0x7f8d4c0c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4b7fe640 1 -- 172.21.15.26:0/1353452442 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c0c11d0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.590+0000 7f8d4a7fc640 1 -- 172.21.15.26:0/1353452442 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368356268 0 0) 0x7f8d4c0c22c0 con 0x7f8d4c152300 2023-11-28T16:56:45.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d4b7fe640 1 --2- 172.21.15.26:0/1353452442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c15bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009870 tx=0x7f8d4401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2978e812dbb57c55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d4a7fc640 1 -- 172.21.15.26:0/1353452442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440ab5f0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d4a7fc640 1 -- 172.21.15.26:0/1353452442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d440ab750 con 0x7f8d4c0c4350 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d4a7fc640 1 -- 172.21.15.26:0/1353452442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440abae0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 -- 172.21.15.26:0/1353452442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 msgr2=0x7f8d4c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 --2- 172.21.15.26:0/1353452442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c15bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009870 tx=0x7f8d4401c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 -- 172.21.15.26:0/1353452442 shutdown_connections 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 --2- 172.21.15.26:0/1353452442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c15bf30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 --2- 172.21.15.26:0/1353452442 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c0c2750 0x7f8d4c151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 -- 172.21.15.26:0/1353452442 >> 172.21.15.26:0/1353452442 conn(0x7f8d4c06a5a0 msgr2=0x7f8d4c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:45.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 -- 172.21.15.26:0/1353452442 shutdown_connections 2023-11-28T16:56:45.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 -- 172.21.15.26:0/1353452442 wait complete. 2023-11-28T16:56:45.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 Processor -- start 2023-11-28T16:56:45.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.594+0000 7f8d515df640 1 -- start start 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d4c0c2750 0x7f8d4c13ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c13f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c152300 0x7f8d4c1f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c143140 con 0x7f8d4c0c4350 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0aa920 con 0x7f8d4c0c2750 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0a9380 con 0x7f8d4c152300 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c13f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c13f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49356/0 (socket says 172.21.15.26:49356) 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 -- 172.21.15.26:0/3646833233 learned_addr learned my addr 172.21.15.26:0/3646833233 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:45.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d4affd640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d4c0c2750 0x7f8d4c13ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d4b7fe640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c152300 0x7f8d4c1f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 -- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c152300 msgr2=0x7f8d4c1f00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c152300 0x7f8d4c1f00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 -- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d4c0c2750 msgr2=0x7f8d4c13ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d4c0c2750 0x7f8d4c13ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 -- 172.21.15.26:0/3646833233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440094d0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d427fc640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c13f1b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400c7a0 tx=0x7f8d3400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d43fff640 1 -- 172.21.15.26:0/3646833233 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34003db0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d43fff640 1 -- 172.21.15.26:0/3646833233 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34005070 con 0x7f8d4c0c4350 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c0a9660 con 0x7f8d4c0c4350 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d43fff640 1 -- 172.21.15.26:0/3646833233 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34005420 con 0x7f8d4c0c4350 2023-11-28T16:56:45.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c142dd0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.598+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c0680c0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.602+0000 7f8d43fff640 1 -- 172.21.15.26:0/3646833233 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8d34005580 con 0x7f8d4c0c4350 2023-11-28T16:56:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.602+0000 7f8d43fff640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8d2c066900 0x7f8d2c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.602+0000 7f8d43fff640 1 -- 172.21.15.26:0/3646833233 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d34083b70 con 0x7f8d4c0c4350 2023-11-28T16:56:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.602+0000 7f8d4affd640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8d2c066900 0x7f8d2c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.602+0000 7f8d4affd640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8d2c066900 0x7f8d2c068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009b60 tx=0x7f8d3c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.606+0000 7f8d43fff640 1 -- 172.21.15.26:0/3646833233 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d34050e50 con 0x7f8d4c0c4350 2023-11-28T16:56:45.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.762+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d4c0c0df0 con 0x7f8d4c0c4350 2023-11-28T16:56:45.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.762+0000 7f8d43fff640 1 -- 172.21.15.26:0/3646833233 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d34017070 con 0x7f8d4c0c4350 2023-11-28T16:56:45.769 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:45.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8d2c066900 msgr2=0x7f8d2c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8d2c066900 0x7f8d2c068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009b60 tx=0x7f8d3c009190 comp rx=0 tx=0).stop 2023-11-28T16:56:45.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 msgr2=0x7f8d4c13f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c13f1b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400c7a0 tx=0x7f8d3400cc60 comp rx=0 tx=0).stop 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 shutdown_connections 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8d2c066900 0x7f8d2c068dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d4c152300 0x7f8d4c1f00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c0c4350 0x7f8d4c13f1b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 --2- 172.21.15.26:0/3646833233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d4c0c2750 0x7f8d4c13ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 >> 172.21.15.26:0/3646833233 conn(0x7f8d4c06a5a0 msgr2=0x7f8d4c0c47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 shutdown_connections 2023-11-28T16:56:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.766+0000 7f8d515df640 1 -- 172.21.15.26:0/3646833233 wait complete. 2023-11-28T16:56:45.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:45.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff571a6b640 1 Processor -- start 2023-11-28T16:56:45.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff571a6b640 1 -- start start 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff571a6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff571a6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff56c0c0370 0x7ff56c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff571a6b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c06de00 con 0x7ff56c151f90 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff571a6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c070390 con 0x7ff56c0c0370 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff571a6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c14eed0 con 0x7ff56c14eaf0 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff56c0c0370 0x7ff56c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff56c0c0370 0x7ff56c06d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49362/0 (socket says 172.21.15.26:49362) 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56bfff640 1 -- 172.21.15.26:0/2582383 learned_addr learned my addr 172.21.15.26:0/2582383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56b7fe640 1 --2- 172.21.15.26:0/2582383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56bfff640 1 -- 172.21.15.26:0/2582383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 msgr2=0x7ff56c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:45.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56bfff640 1 --2- 172.21.15.26:0/2582383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56bfff640 1 -- 172.21.15.26:0/2582383 >> v1:172.21.15.79:6789/0 conn(0x7ff56c151f90 legacy=0x7ff56c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.930+0000 7ff56bfff640 1 -- 172.21.15.26:0/2582383 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c151270 con 0x7ff56c0c0370 2023-11-28T16:56:45.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff56bfff640 1 --2- 172.21.15.26:0/2582383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c06d820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff564009e50 tx=0x7ff56401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93189a071bf07d73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff56a7fc640 1 -- 172.21.15.26:0/2582383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640a5780 con 0x7ff56c0c0370 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff56a7fc640 1 -- 172.21.15.26:0/2582383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5640a58e0 con 0x7ff56c0c0370 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff56a7fc640 1 -- 172.21.15.26:0/2582383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640a5c70 con 0x7ff56c0c0370 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 -- 172.21.15.26:0/2582383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 msgr2=0x7ff56c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 --2- 172.21.15.26:0/2582383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c06d820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff564009e50 tx=0x7ff56401c8c0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 -- 172.21.15.26:0/2582383 shutdown_connections 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 --2- 172.21.15.26:0/2582383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c06d820 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 --2- 172.21.15.26:0/2582383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 -- 172.21.15.26:0/2582383 >> 172.21.15.26:0/2582383 conn(0x7ff56c0c2a60 msgr2=0x7ff56c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:45.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 -- 172.21.15.26:0/2582383 shutdown_connections 2023-11-28T16:56:45.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.934+0000 7ff571a6b640 1 -- 172.21.15.26:0/2582383 wait complete. 2023-11-28T16:56:45.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 Processor -- start 2023-11-28T16:56:45.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 -- start start 2023-11-28T16:56:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c0bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff56c15d560 0x7ff56c0c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c15ddc0 con 0x7ff56c0c0370 2023-11-28T16:56:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c15e930 con 0x7ff56c15d560 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0c3dd0 con 0x7ff56c14eaf0 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c0bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c0bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49378/0 (socket says 172.21.15.26:49378) 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 -- 172.21.15.26:0/1252285030 learned_addr learned my addr 172.21.15.26:0/1252285030 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56affd640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56bfff640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff56c15d560 0x7ff56c0c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 -- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 msgr2=0x7ff56c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 -- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff56c15d560 msgr2=0x7ff56c0c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff56c15d560 0x7ff56c0c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 -- 172.21.15.26:0/1252285030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009b30 con 0x7ff56c0c0370 2023-11-28T16:56:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff56b7fe640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c0bf5f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00d800 tx=0x7ff55c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff553fff640 1 -- 172.21.15.26:0/1252285030 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00b6c0 con 0x7ff56c0c0370 2023-11-28T16:56:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff553fff640 1 -- 172.21.15.26:0/1252285030 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00b820 con 0x7ff56c0c0370 2023-11-28T16:56:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff553fff640 1 -- 172.21.15.26:0/1252285030 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00bb90 con 0x7ff56c0c0370 2023-11-28T16:56:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c15dae0 con 0x7ff56c0c0370 2023-11-28T16:56:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.938+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c15e5c0 con 0x7ff56c0c0370 2023-11-28T16:56:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.942+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c15e140 con 0x7ff56c0c0370 2023-11-28T16:56:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.942+0000 7ff553fff640 1 -- 172.21.15.26:0/1252285030 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff55c00bcf0 con 0x7ff56c0c0370 2023-11-28T16:56:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.942+0000 7ff553fff640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5580668d0 0x7ff558068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.942+0000 7ff553fff640 1 -- 172.21.15.26:0/1252285030 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff55c084820 con 0x7ff56c0c0370 2023-11-28T16:56:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.942+0000 7ff56affd640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5580668d0 0x7ff558068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.942+0000 7ff56affd640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5580668d0 0x7ff558068d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff56c148e70 tx=0x7ff560009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:45.946+0000 7ff553fff640 1 -- 172.21.15.26:0/1252285030 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff56c15e140 con 0x7ff56c0c0370 2023-11-28T16:56:46.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.102+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff56c15e140 con 0x7ff56c0c0370 2023-11-28T16:56:46.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff553fff640 1 -- 172.21.15.26:0/1252285030 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff56c15e140 con 0x7ff56c0c0370 2023-11-28T16:56:46.110 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:46.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5580668d0 msgr2=0x7ff558068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5580668d0 0x7ff558068d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff56c148e70 tx=0x7ff560009040 comp rx=0 tx=0).stop 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 msgr2=0x7ff56c0bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c0bf5f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00d800 tx=0x7ff55c00dcc0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 shutdown_connections 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff56c15d560 0x7ff56c0c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff5580668d0 0x7ff558068d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff56c14eaf0 0x7ff56c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 --2- 172.21.15.26:0/1252285030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff56c0c0370 0x7ff56c0bf5f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 >> 172.21.15.26:0/1252285030 conn(0x7ff56c0c2a60 msgr2=0x7ff56c0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 shutdown_connections 2023-11-28T16:56:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.106+0000 7ff571a6b640 1 -- 172.21.15.26:0/1252285030 wait complete. 2023-11-28T16:56:46.131 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:46.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.270+0000 7f7f3289c640 1 Processor -- start 2023-11-28T16:56:46.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.270+0000 7f7f3289c640 1 -- start start 2023-11-28T16:56:46.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f3289c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f2c154000 0x7f7f2c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f3289c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c06df30 0x7f7f2c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f3289c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c154920 con 0x7f7f2c0700f0 2023-11-28T16:56:46.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f3289c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0a8710 con 0x7f7f2c154000 2023-11-28T16:56:46.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f3289c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c071be0 con 0x7f7f2c06df30 2023-11-28T16:56:46.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f2bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f2c154000 0x7f7f2c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f2bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f2c154000 0x7f7f2c1543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49384/0 (socket says 172.21.15.26:49384) 2023-11-28T16:56:46.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2835374807 learned_addr learned my addr 172.21.15.26:0/2835374807 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:46.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f30e39640 1 --2- 172.21.15.26:0/2835374807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c06df30 0x7f7f2c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2835374807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c06df30 msgr2=0x7f7f2c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:46.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f2bfff640 1 --2- 172.21.15.26:0/2835374807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c06df30 0x7f7f2c0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2835374807 >> v1:172.21.15.79:6789/0 conn(0x7f7f2c0700f0 legacy=0x7f7f2c070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2835374807 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c154b90 con 0x7f7f2c154000 2023-11-28T16:56:46.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.274+0000 7f7f30e39640 1 --2- 172.21.15.26:0/2835374807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c06df30 0x7f7f2c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:46.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f2bfff640 1 --2- 172.21.15.26:0/2835374807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c154000 0x7f7f2c1543e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009870 tx=0x7f7f1c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3661111463cd2881 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:46.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f2affd640 1 -- 172.21.15.26:0/2835374807 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0ac600 con 0x7f7f2c154000 2023-11-28T16:56:46.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f2affd640 1 -- 172.21.15.26:0/2835374807 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c0a8050 con 0x7f7f2c154000 2023-11-28T16:56:46.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f2affd640 1 -- 172.21.15.26:0/2835374807 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0ac980 con 0x7f7f2c154000 2023-11-28T16:56:46.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- 172.21.15.26:0/2835374807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c154000 msgr2=0x7f7f2c1543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2835374807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c154000 0x7f7f2c1543e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009870 tx=0x7f7f1c01c420 comp rx=0 tx=0).stop 2023-11-28T16:56:46.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- 172.21.15.26:0/2835374807 shutdown_connections 2023-11-28T16:56:46.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2835374807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c06df30 0x7f7f2c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2835374807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c154000 0x7f7f2c1543e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- 172.21.15.26:0/2835374807 >> 172.21.15.26:0/2835374807 conn(0x7f7f2c0c2a60 msgr2=0x7f7f2c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- 172.21.15.26:0/2835374807 shutdown_connections 2023-11-28T16:56:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- 172.21.15.26:0/2835374807 wait complete. 2023-11-28T16:56:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 Processor -- start 2023-11-28T16:56:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- start start 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c06df30 0x7f7f2c0bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c0700f0 0x7f7f2c146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f2c154000 0x7f7f2c143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1ed040 con 0x7f7f2c06df30 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1ed320 con 0x7f7f2c154000 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.278+0000 7f7f3289c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1ed600 con 0x7f7f2c0700f0 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c06df30 0x7f7f2c0bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c06df30 0x7f7f2c0bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49392/0 (socket says 172.21.15.26:49392) 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2738592716 learned_addr learned my addr 172.21.15.26:0/2738592716 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f30e39640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f2c154000 0x7f7f2c143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2b7fe640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c0700f0 0x7f7f2c146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c0700f0 msgr2=0x7f7f2c146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c0700f0 0x7f7f2c146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f2c154000 msgr2=0x7f7f2c143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f2c154000 0x7f7f2c143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 -- 172.21.15.26:0/2738592716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0094d0 con 0x7f7f2c06df30 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f2bfff640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c06df30 0x7f7f2c0bf5f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c01aad0 tx=0x7f7f1c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f28ff9640 1 -- 172.21.15.26:0/2738592716 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0b7620 con 0x7f7f2c06df30 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f28ff9640 1 -- 172.21.15.26:0/2738592716 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c0ace90 con 0x7f7f2c06df30 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f28ff9640 1 -- 172.21.15.26:0/2738592716 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0b79e0 con 0x7f7f2c06df30 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c1ed8e0 con 0x7f7f2c06df30 2023-11-28T16:56:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c1472e0 con 0x7f7f2c06df30 2023-11-28T16:56:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c04e890 con 0x7f7f2c06df30 2023-11-28T16:56:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.282+0000 7f7f28ff9640 1 -- 172.21.15.26:0/2738592716 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7f1c0b3040 con 0x7f7f2c06df30 2023-11-28T16:56:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.286+0000 7f7f28ff9640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f180668d0 0x7f7f18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.286+0000 7f7f28ff9640 1 -- 172.21.15.26:0/2738592716 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f1c11e6c0 con 0x7f7f2c06df30 2023-11-28T16:56:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.286+0000 7f7f2b7fe640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f180668d0 0x7f7f18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.286+0000 7f7f2b7fe640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f180668d0 0x7f7f18068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0c5800 tx=0x7f7f20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.286+0000 7f7f28ff9640 1 -- 172.21.15.26:0/2738592716 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f1c0ebac0 con 0x7f7f2c06df30 2023-11-28T16:56:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.446+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f2c1ed180 con 0x7f7f2c06df30 2023-11-28T16:56:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.446+0000 7f7f28ff9640 1 -- 172.21.15.26:0/2738592716 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f2c1ed180 con 0x7f7f2c06df30 2023-11-28T16:56:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f180668d0 msgr2=0x7f7f18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f180668d0 0x7f7f18068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0c5800 tx=0x7f7f20009040 comp rx=0 tx=0).stop 2023-11-28T16:56:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c06df30 msgr2=0x7f7f2c0bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c06df30 0x7f7f2c0bf5f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c01aad0 tx=0x7f7f1c01ac60 comp rx=0 tx=0).stop 2023-11-28T16:56:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 shutdown_connections 2023-11-28T16:56:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f2c154000 0x7f7f2c143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7f180668d0 0x7f7f18068d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f2c0700f0 0x7f7f2c146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 --2- 172.21.15.26:0/2738592716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f2c06df30 0x7f7f2c0bf5f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 >> 172.21.15.26:0/2738592716 conn(0x7f7f2c0c2a60 msgr2=0x7f7f2c0aa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 shutdown_connections 2023-11-28T16:56:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.450+0000 7f7f3289c640 1 -- 172.21.15.26:0/2738592716 wait complete. 2023-11-28T16:56:46.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:56:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e64fb5640 1 Processor -- start 2023-11-28T16:56:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e64fb5640 1 -- start start 2023-11-28T16:56:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e64fb5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600c4890 0x7f1e600caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e64fb5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e600bd5a0 0x7f1e600c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e64fb5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6006b7d0 con 0x7f1e600ca620 2023-11-28T16:56:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e64fb5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e60155160 con 0x7f1e600bd5a0 2023-11-28T16:56:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e64fb5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6006b180 con 0x7f1e600c4890 2023-11-28T16:56:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e600bd5a0 0x7f1e600c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e600bd5a0 0x7f1e600c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49408/0 (socket says 172.21.15.26:49408) 2023-11-28T16:56:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5ffff640 1 -- 172.21.15.26:0/1893096943 learned_addr learned my addr 172.21.15.26:0/1893096943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5effd640 1 --2- 172.21.15.26:0/1893096943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600c4890 0x7f1e600caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5ffff640 1 -- 172.21.15.26:0/1893096943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600c4890 msgr2=0x7f1e600caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:46.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5ffff640 1 --2- 172.21.15.26:0/1893096943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600c4890 0x7f1e600caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5ffff640 1 -- 172.21.15.26:0/1893096943 >> v1:172.21.15.79:6789/0 conn(0x7f1e600ca620 legacy=0x7f1e600c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.614+0000 7f1e5ffff640 1 -- 172.21.15.26:0/1893096943 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6006b460 con 0x7f1e600bd5a0 2023-11-28T16:56:46.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e5ffff640 1 --2- 172.21.15.26:0/1893096943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600bd5a0 0x7f1e600c8620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009e50 tx=0x7f1e5801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f31cd9c20bf53c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:46.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e5e7fc640 1 -- 172.21.15.26:0/1893096943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580a5790 con 0x7f1e600bd5a0 2023-11-28T16:56:46.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e5e7fc640 1 -- 172.21.15.26:0/1893096943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e580a58f0 con 0x7f1e600bd5a0 2023-11-28T16:56:46.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e5e7fc640 1 -- 172.21.15.26:0/1893096943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580a5c80 con 0x7f1e600bd5a0 2023-11-28T16:56:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 -- 172.21.15.26:0/1893096943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600bd5a0 msgr2=0x7f1e600c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/1893096943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600bd5a0 0x7f1e600c8620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009e50 tx=0x7f1e5801c980 comp rx=0 tx=0).stop 2023-11-28T16:56:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 -- 172.21.15.26:0/1893096943 shutdown_connections 2023-11-28T16:56:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/1893096943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600bd5a0 0x7f1e600c8620 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/1893096943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600c4890 0x7f1e600caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 -- 172.21.15.26:0/1893096943 >> 172.21.15.26:0/1893096943 conn(0x7f1e600ac0a0 msgr2=0x7f1e600c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:46.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 -- 172.21.15.26:0/1893096943 shutdown_connections 2023-11-28T16:56:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.618+0000 7f1e64fb5640 1 -- 172.21.15.26:0/1893096943 wait complete. 2023-11-28T16:56:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 Processor -- start 2023-11-28T16:56:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 -- start start 2023-11-28T16:56:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600bd5a0 0x7f1e6014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e600c4890 0x7f1e600c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600ca620 0x7f1e600c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60158050 con 0x7f1e600ca620 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6014fbb0 con 0x7f1e600c4890 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e601ecca0 con 0x7f1e600bd5a0 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600ca620 0x7f1e600c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600ca620 0x7f1e600c02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49424/0 (socket says 172.21.15.26:49424) 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 -- 172.21.15.26:0/633790045 learned_addr learned my addr 172.21.15.26:0/633790045 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5f7fe640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600bd5a0 0x7f1e6014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5effd640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e600c4890 0x7f1e600c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 -- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600bd5a0 msgr2=0x7f1e6014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600bd5a0 0x7f1e6014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 -- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e600c4890 msgr2=0x7f1e600c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e600c4890 0x7f1e600c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 -- 172.21.15.26:0/633790045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58009b30 con 0x7f1e600ca620 2023-11-28T16:56:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5effd640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e600c4890 0x7f1e600c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e5ffff640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600ca620 0x7f1e600c02b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e580af040 tx=0x7f1e58019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e47fff640 1 -- 172.21.15.26:0/633790045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580b8670 con 0x7f1e600ca620 2023-11-28T16:56:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e47fff640 1 -- 172.21.15.26:0/633790045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e580b87d0 con 0x7f1e600ca620 2023-11-28T16:56:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e601ecf80 con 0x7f1e600ca620 2023-11-28T16:56:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e47fff640 1 -- 172.21.15.26:0/633790045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580b8b60 con 0x7f1e600ca620 2023-11-28T16:56:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.622+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e601ed540 con 0x7f1e600ca620 2023-11-28T16:56:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.626+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e601ed730 con 0x7f1e600ca620 2023-11-28T16:56:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.626+0000 7f1e47fff640 1 -- 172.21.15.26:0/633790045 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1e580b8cc0 con 0x7f1e600ca620 2023-11-28T16:56:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.626+0000 7f1e47fff640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e4c0668d0 0x7f1e4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.626+0000 7f1e47fff640 1 -- 172.21.15.26:0/633790045 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e5811fa00 con 0x7f1e600ca620 2023-11-28T16:56:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.626+0000 7f1e5f7fe640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e4c0668d0 0x7f1e4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.626+0000 7f1e5f7fe640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e4c0668d0 0x7f1e4c068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1e50007fd0 tx=0x7f1e50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:46.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.630+0000 7f1e47fff640 1 -- 172.21.15.26:0/633790045 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e580ecc30 con 0x7f1e600ca620 2023-11-28T16:56:46.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e601ecde0 con 0x7f1e600ca620 2023-11-28T16:56:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e47fff640 1 -- 172.21.15.26:0/633790045 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1e601ecde0 con 0x7f1e600ca620 2023-11-28T16:56:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:56:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e4c0668d0 msgr2=0x7f1e4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e4c0668d0 0x7f1e4c068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1e50007fd0 tx=0x7f1e50009040 comp rx=0 tx=0).stop 2023-11-28T16:56:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600ca620 msgr2=0x7f1e600c02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600ca620 0x7f1e600c02b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e580af040 tx=0x7f1e58019720 comp rx=0 tx=0).stop 2023-11-28T16:56:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 shutdown_connections 2023-11-28T16:56:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600ca620 0x7f1e600c02b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e600c4890 0x7f1e600c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1e4c0668d0 0x7f1e4c068d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 --2- 172.21.15.26:0/633790045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e600bd5a0 0x7f1e6014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.798+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 >> 172.21.15.26:0/633790045 conn(0x7f1e600ac0a0 msgr2=0x7f1e600a9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.802+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 shutdown_connections 2023-11-28T16:56:46.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:46.802+0000 7f1e64fb5640 1 -- 172.21.15.26:0/633790045 wait complete. 2023-11-28T16:56:46.825 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T16:56:46.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:46.826 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-28T16:56:46.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:56:46.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:46.863 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T16:56:46.930 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:56:46.930 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:46.940 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:56:46.940 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:46.991 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:56:46.991 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:56:47.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:47.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefeeb57640 1 Processor -- start 2023-11-28T16:56:47.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefeeb57640 1 -- start start 2023-11-28T16:56:47.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefeeb57640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fefe80ca610 0x7fefe80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefeeb57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80bd720 0x7fefe80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefeeb57640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe8155790 con 0x7fefe806cd90 2023-11-28T16:56:47.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefeeb57640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe80c4b00 con 0x7fefe80ca610 2023-11-28T16:56:47.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefeeb57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80c4de0 con 0x7fefe80bd720 2023-11-28T16:56:47.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefe7fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80bd720 0x7fefe80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefec8f3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fefe80ca610 0x7fefe80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefe7fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80bd720 0x7fefe80c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:56988/0 (socket says 172.21.15.26:56988) 2023-11-28T16:56:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefe7fff640 1 -- 172.21.15.26:0/2260527549 learned_addr learned my addr 172.21.15.26:0/2260527549 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefe7fff640 1 -- 172.21.15.26:0/2260527549 >> v2:172.21.15.79:3300/0 conn(0x7fefe80ca610 msgr2=0x7fefe80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefe7fff640 1 --2- 172.21.15.26:0/2260527549 >> v2:172.21.15.79:3300/0 conn(0x7fefe80ca610 0x7fefe80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefe7fff640 1 -- 172.21.15.26:0/2260527549 >> v1:172.21.15.79:6789/0 conn(0x7fefe806cd90 legacy=0x7fefe8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.182+0000 7fefe7fff640 1 -- 172.21.15.26:0/2260527549 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe8157e30 con 0x7fefe80bd720 2023-11-28T16:56:47.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefe7fff640 1 --2- 172.21.15.26:0/2260527549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80bd720 0x7fefe80c9a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009870 tx=0x7fefd401c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e8507f765b4b23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefe77fe640 1 -- 172.21.15.26:0/2260527549 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80c52d0 con 0x7fefe80bd720 2023-11-28T16:56:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefe77fe640 1 -- 172.21.15.26:0/2260527549 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40a4940 con 0x7fefe80bd720 2023-11-28T16:56:47.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefe77fe640 1 -- 172.21.15.26:0/2260527549 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40a4cd0 con 0x7fefe80bd720 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefeeb57640 1 -- 172.21.15.26:0/2260527549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80bd720 msgr2=0x7fefe80c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefeeb57640 1 --2- 172.21.15.26:0/2260527549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80bd720 0x7fefe80c9a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009870 tx=0x7fefd401c100 comp rx=0 tx=0).stop 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefeeb57640 1 -- 172.21.15.26:0/2260527549 shutdown_connections 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefeeb57640 1 --2- 172.21.15.26:0/2260527549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80bd720 0x7fefe80c9a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefeeb57640 1 --2- 172.21.15.26:0/2260527549 >> v2:172.21.15.79:3300/0 conn(0x7fefe80ca610 0x7fefe80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefeeb57640 1 -- 172.21.15.26:0/2260527549 >> 172.21.15.26:0/2260527549 conn(0x7fefe8071ea0 msgr2=0x7fefe80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.186+0000 7fefeeb57640 1 -- 172.21.15.26:0/2260527549 shutdown_connections 2023-11-28T16:56:47.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 -- 172.21.15.26:0/2260527549 wait complete. 2023-11-28T16:56:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 Processor -- start 2023-11-28T16:56:47.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 -- start start 2023-11-28T16:56:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806cd90 0x7fefe81f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe80bd720 0x7fefe81f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80ca610 0x7fefe80c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8151680 con 0x7fefe80bd720 2023-11-28T16:56:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80be000 con 0x7fefe806cd90 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8151e20 con 0x7fefe80ca610 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe80bd720 0x7fefe81f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe80bd720 0x7fefe81f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49428/0 (socket says 172.21.15.26:49428) 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 -- 172.21.15.26:0/3181890274 learned_addr learned my addr 172.21.15.26:0/3181890274 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefec8f3640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806cd90 0x7fefe81f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefed0f4640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80ca610 0x7fefe80c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 -- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80ca610 msgr2=0x7fefe80c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80ca610 0x7fefe80c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 -- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806cd90 msgr2=0x7fefe81f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806cd90 0x7fefe81f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 -- 172.21.15.26:0/3181890274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd40094d0 con 0x7fefe80bd720 2023-11-28T16:56:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefec8f3640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806cd90 0x7fefe81f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:47.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe7fff640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe80bd720 0x7fefe81f20a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fefd40af040 tx=0x7fefd40191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe57fa640 1 -- 172.21.15.26:0/3181890274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40ac8d0 con 0x7fefe80bd720 2023-11-28T16:56:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe57fa640 1 -- 172.21.15.26:0/3181890274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40aca50 con 0x7fefe80bd720 2023-11-28T16:56:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefe57fa640 1 -- 172.21.15.26:0/3181890274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40ace00 con 0x7fefe80bd720 2023-11-28T16:56:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.190+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe8151860 con 0x7fefe80bd720 2023-11-28T16:56:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.194+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe80bdc90 con 0x7fefe80bd720 2023-11-28T16:56:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.194+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe804e890 con 0x7fefe80bd720 2023-11-28T16:56:47.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.194+0000 7fefe57fa640 1 -- 172.21.15.26:0/3181890274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fefd40b43f0 con 0x7fefe80bd720 2023-11-28T16:56:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.194+0000 7fefe57fa640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefcc0668d0 0x7fefcc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.194+0000 7fefe57fa640 1 -- 172.21.15.26:0/3181890274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefe80cac00 con 0x7fefe80bd720 2023-11-28T16:56:47.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.194+0000 7fefec8f3640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefcc0668d0 0x7fefcc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.198+0000 7fefec8f3640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefcc0668d0 0x7fefcc068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009b10 tx=0x7fefdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.198+0000 7fefe57fa640 1 -- 172.21.15.26:0/3181890274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefd40eab80 con 0x7fefe80bd720 2023-11-28T16:56:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.358+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefe8157910 con 0x7fefe80bd720 2023-11-28T16:56:47.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.358+0000 7fefe57fa640 1 -- 172.21.15.26:0/3181890274 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fefd40bc090 con 0x7fefe80bd720 2023-11-28T16:56:47.364 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:47.364 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.358+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefcc0668d0 msgr2=0x7fefcc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.358+0000 7fefeeb57640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefcc0668d0 0x7fefcc068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009b10 tx=0x7fefdc008040 comp rx=0 tx=0).stop 2023-11-28T16:56:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.358+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe80bd720 msgr2=0x7fefe81f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.358+0000 7fefeeb57640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe80bd720 0x7fefe81f20a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fefd40af040 tx=0x7fefd40191c0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 shutdown_connections 2023-11-28T16:56:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefcc0668d0 0x7fefcc068d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe80ca610 0x7fefe80c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefe80bd720 0x7fefe81f20a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 --2- 172.21.15.26:0/3181890274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806cd90 0x7fefe81f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 >> 172.21.15.26:0/3181890274 conn(0x7fefe8071ea0 msgr2=0x7fefe815f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:47.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 shutdown_connections 2023-11-28T16:56:47.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.362+0000 7fefeeb57640 1 -- 172.21.15.26:0/3181890274 wait complete. 2023-11-28T16:56:47.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:47.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.526+0000 7f8e4ed10640 1 Processor -- start 2023-11-28T16:56:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.526+0000 7f8e4ed10640 1 -- start start 2023-11-28T16:56:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4ed10640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e480c7ce0 0x7f8e480c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4ed10640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e480c4ca0 0x7f8e4806b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4ed10640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e48151e90 con 0x7f8e48151ab0 2023-11-28T16:56:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4ed10640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e480c71a0 con 0x7f8e480c7ce0 2023-11-28T16:56:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4ed10640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480c6900 con 0x7f8e480c4ca0 2023-11-28T16:56:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e480c7ce0 0x7f8e480c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e480c7ce0 0x7f8e480c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49436/0 (socket says 172.21.15.26:49436) 2023-11-28T16:56:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 -- 172.21.15.26:0/828192714 learned_addr learned my addr 172.21.15.26:0/828192714 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 -- 172.21.15.26:0/828192714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e480c4ca0 msgr2=0x7f8e4806b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4e50f640 1 --2- 172.21.15.26:0/828192714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e480c4ca0 0x7f8e4806b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 --2- 172.21.15.26:0/828192714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e480c4ca0 0x7f8e4806b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 -- 172.21.15.26:0/828192714 >> v1:172.21.15.26:6789/0 conn(0x7f8e48151ab0 legacy=0x7f8e48154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 -- 172.21.15.26:0/828192714 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480c6be0 con 0x7f8e480c7ce0 2023-11-28T16:56:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4e50f640 1 --2- 172.21.15.26:0/828192714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e480c4ca0 0x7f8e4806b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:47.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.530+0000 7f8e4d50d640 1 --2- 172.21.15.26:0/828192714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c7ce0 0x7f8e480c4760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009870 tx=0x7f8e3801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde007f546d8618b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4cd0c640 1 -- 172.21.15.26:0/828192714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e380ad660 con 0x7f8e480c7ce0 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4cd0c640 1 -- 172.21.15.26:0/828192714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e380ad7c0 con 0x7f8e480c7ce0 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4cd0c640 1 -- 172.21.15.26:0/828192714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e380adb50 con 0x7f8e480c7ce0 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- 172.21.15.26:0/828192714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c7ce0 msgr2=0x7f8e480c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/828192714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c7ce0 0x7f8e480c4760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009870 tx=0x7f8e3801c470 comp rx=0 tx=0).stop 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- 172.21.15.26:0/828192714 shutdown_connections 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/828192714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e480c4ca0 0x7f8e4806b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/828192714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c7ce0 0x7f8e480c4760 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- 172.21.15.26:0/828192714 >> 172.21.15.26:0/828192714 conn(0x7f8e480abba0 msgr2=0x7f8e480abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- 172.21.15.26:0/828192714 shutdown_connections 2023-11-28T16:56:47.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- 172.21.15.26:0/828192714 wait complete. 2023-11-28T16:56:47.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 Processor -- start 2023-11-28T16:56:47.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- start start 2023-11-28T16:56:47.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c4ca0 0x7f8e48153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e480c7ce0 0x7f8e48157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e48151ab0 0x7f8e48157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480be500 con 0x7f8e480c4ca0 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480bd8f0 con 0x7f8e480c7ce0 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4ed10640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480bdbd0 con 0x7f8e48151ab0 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4dd0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c4ca0 0x7f8e48153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4dd0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c4ca0 0x7f8e48153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49438/0 (socket says 172.21.15.26:49438) 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.534+0000 7f8e4dd0e640 1 -- 172.21.15.26:0/4129771045 learned_addr learned my addr 172.21.15.26:0/4129771045 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4dd0e640 1 -- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e48151ab0 msgr2=0x7f8e48157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4dd0e640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e48151ab0 0x7f8e48157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4dd0e640 1 -- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e480c7ce0 msgr2=0x7f8e48157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4dd0e640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e480c7ce0 0x7f8e48157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4dd0e640 1 -- 172.21.15.26:0/4129771045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380094d0 con 0x7f8e480c4ca0 2023-11-28T16:56:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4dd0e640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c4ca0 0x7f8e48153770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c500 tx=0x7f8e4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e3e7fc640 1 -- 172.21.15.26:0/4129771045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44005220 con 0x7f8e480c4ca0 2023-11-28T16:56:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e3e7fc640 1 -- 172.21.15.26:0/4129771045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44005380 con 0x7f8e480c4ca0 2023-11-28T16:56:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e3e7fc640 1 -- 172.21.15.26:0/4129771045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44007270 con 0x7f8e480c4ca0 2023-11-28T16:56:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e480bdeb0 con 0x7f8e480c4ca0 2023-11-28T16:56:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e480c74b0 con 0x7f8e480c4ca0 2023-11-28T16:56:47.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e48067a10 con 0x7f8e480c4ca0 2023-11-28T16:56:47.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.538+0000 7f8e3e7fc640 1 -- 172.21.15.26:0/4129771045 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8e440073d0 con 0x7f8e480c4ca0 2023-11-28T16:56:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.542+0000 7f8e3e7fc640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e2c0668d0 0x7f8e2c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.542+0000 7f8e3e7fc640 1 -- 172.21.15.26:0/4129771045 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e44083830 con 0x7f8e480c4ca0 2023-11-28T16:56:47.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.542+0000 7f8e4d50d640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e2c0668d0 0x7f8e2c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.542+0000 7f8e4d50d640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e2c0668d0 0x7f8e2c068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e380af000 tx=0x7f8e38004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.546+0000 7f8e3e7fc640 1 -- 172.21.15.26:0/4129771045 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e440509e0 con 0x7f8e480c4ca0 2023-11-28T16:56:47.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:56:47.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:56:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e48074970 con 0x7f8e480c4ca0 2023-11-28T16:56:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e3e7fc640 1 -- 172.21.15.26:0/4129771045 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e44072020 con 0x7f8e480c4ca0 2023-11-28T16:56:47.712 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e2c0668d0 msgr2=0x7f8e2c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e2c0668d0 0x7f8e2c068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e380af000 tx=0x7f8e38004740 comp rx=0 tx=0).stop 2023-11-28T16:56:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c4ca0 msgr2=0x7f8e48153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c4ca0 0x7f8e48153770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c500 tx=0x7f8e4400c9c0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 shutdown_connections 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8e2c0668d0 0x7f8e2c068d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e48151ab0 0x7f8e48157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e480c7ce0 0x7f8e48157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 --2- 172.21.15.26:0/4129771045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e480c4ca0 0x7f8e48153770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 >> 172.21.15.26:0/4129771045 conn(0x7f8e480abba0 msgr2=0x7f8e4815e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 shutdown_connections 2023-11-28T16:56:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.706+0000 7f8e4ed10640 1 -- 172.21.15.26:0/4129771045 wait complete. 2023-11-28T16:56:47.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71b03e6640 1 Processor -- start 2023-11-28T16:56:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71b03e6640 1 -- start start 2023-11-28T16:56:47.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71b03e6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71a80a86d0 0x7f71a80a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71b03e6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a8152d90 con 0x7f71a814fd00 2023-11-28T16:56:47.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71b03e6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a8152480 con 0x7f71a8156600 2023-11-28T16:56:47.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71b03e6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a80a9760 con 0x7f71a80a86d0 2023-11-28T16:56:47.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ae983640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f71a814fd00 0x7f71a80aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51856/0 (socket says 172.21.15.26:51856) 2023-11-28T16:56:47.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ae983640 1 -- 172.21.15.26:0/3746355335 learned_addr learned my addr 172.21.15.26:0/3746355335 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ae182640 1 --2- 172.21.15.26:0/3746355335 >> v2:172.21.15.79:3300/0 conn(0x7f71a80a86d0 0x7f71a80a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280460242 0 0) 0x7f71a8152d90 con 0x7f71a814fd00 2023-11-28T16:56:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7194003530 con 0x7f71a814fd00 2023-11-28T16:56:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674899286 0 0) 0x7f71a8152480 con 0x7f71a8156600 2023-11-28T16:56:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a8152d90 con 0x7f71a8156600 2023-11-28T16:56:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2199403196 0 0) 0x7f7194003530 con 0x7f71a814fd00 2023-11-28T16:56:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ae182640 1 -- 172.21.15.26:0/3746355335 >> v1:172.21.15.79:6789/0 conn(0x7f71a8156600 legacy=0x7f71a814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ae182640 1 -- 172.21.15.26:0/3746355335 >> v1:172.21.15.26:6789/0 conn(0x7f71a814fd00 legacy=0x7f71a80aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.914+0000 7f71ae182640 1 -- 172.21.15.26:0/3746355335 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8152740 con 0x7f71a80a86d0 2023-11-28T16:56:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71ae182640 1 --2- 172.21.15.26:0/3746355335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a80a86d0 0x7f71a80a8f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71a40097f0 tx=0x7f71a401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=124af11ca30b9c27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0001a00 con 0x7f71a80a86d0 2023-11-28T16:56:47.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a40a7050 con 0x7f71a80a86d0 2023-11-28T16:56:47.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71ad180640 1 -- 172.21.15.26:0/3746355335 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40ab600 con 0x7f71a80a86d0 2023-11-28T16:56:47.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71b03e6640 1 -- 172.21.15.26:0/3746355335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a80a86d0 msgr2=0x7f71a80a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71b03e6640 1 --2- 172.21.15.26:0/3746355335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a80a86d0 0x7f71a80a8f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71a40097f0 tx=0x7f71a401c3a0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71b03e6640 1 -- 172.21.15.26:0/3746355335 shutdown_connections 2023-11-28T16:56:47.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71b03e6640 1 --2- 172.21.15.26:0/3746355335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a80a86d0 0x7f71a80a8f30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71b03e6640 1 -- 172.21.15.26:0/3746355335 >> 172.21.15.26:0/3746355335 conn(0x7f71a80c2a60 msgr2=0x7f71a80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:47.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71b03e6640 1 -- 172.21.15.26:0/3746355335 shutdown_connections 2023-11-28T16:56:47.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.918+0000 7f71b03e6640 1 -- 172.21.15.26:0/3746355335 wait complete. 2023-11-28T16:56:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 Processor -- start 2023-11-28T16:56:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 -- start start 2023-11-28T16:56:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71a80a86d0 0x7f71a806c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a814fd00 0x7f71a814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71a8156600 0x7f71a814a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a814e420 con 0x7f71a8156600 2023-11-28T16:56:47.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a814f380 con 0x7f71a814fd00 2023-11-28T16:56:47.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a814b420 con 0x7f71a80a86d0 2023-11-28T16:56:47.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71a8156600 0x7f71a814a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71a8156600 0x7f71a814a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49440/0 (socket says 172.21.15.26:49440) 2023-11-28T16:56:47.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 -- 172.21.15.26:0/866946493 learned_addr learned my addr 172.21.15.26:0/866946493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:47.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae182640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71a80a86d0 0x7f71a806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ad981640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a814fd00 0x7f71a814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 -- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71a80a86d0 msgr2=0x7f71a806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71a80a86d0 0x7f71a806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 -- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a814fd00 msgr2=0x7f71a814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a814fd00 0x7f71a814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 -- 172.21.15.26:0/866946493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009420 con 0x7f71a8156600 2023-11-28T16:56:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ad981640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a814fd00 0x7f71a814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71ae983640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71a8156600 0x7f71a814a970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71a000cc20 tx=0x7f71a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f719effd640 1 -- 172.21.15.26:0/866946493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000ce30 con 0x7f71a8156600 2023-11-28T16:56:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f719effd640 1 -- 172.21.15.26:0/866946493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a0012400 con 0x7f71a8156600 2023-11-28T16:56:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a814f620 con 0x7f71a8156600 2023-11-28T16:56:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f719effd640 1 -- 172.21.15.26:0/866946493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0012790 con 0x7f71a8156600 2023-11-28T16:56:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.922+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a814b700 con 0x7f71a8156600 2023-11-28T16:56:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.926+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a814a150 con 0x7f71a8156600 2023-11-28T16:56:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.926+0000 7f719effd640 1 -- 172.21.15.26:0/866946493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71a00128f0 con 0x7f71a8156600 2023-11-28T16:56:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.926+0000 7f719effd640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f718c0668d0 0x7f718c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.926+0000 7f719effd640 1 -- 172.21.15.26:0/866946493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71a0084ab0 con 0x7f71a8156600 2023-11-28T16:56:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.926+0000 7f71ae182640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f718c0668d0 0x7f718c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.926+0000 7f71ae182640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f718c0668d0 0x7f718c068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71a40ad000 tx=0x7f71a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:47.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:47.930+0000 7f719effd640 1 -- 172.21.15.26:0/866946493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71a814a150 con 0x7f71a8156600 2023-11-28T16:56:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.086+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71a814a150 con 0x7f71a8156600 2023-11-28T16:56:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.086+0000 7f719effd640 1 -- 172.21.15.26:0/866946493 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71a814a150 con 0x7f71a8156600 2023-11-28T16:56:48.093 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f718c0668d0 msgr2=0x7f718c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f718c0668d0 0x7f718c068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71a40ad000 tx=0x7f71a4008040 comp rx=0 tx=0).stop 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71a8156600 msgr2=0x7f71a814a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71a8156600 0x7f71a814a970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71a000cc20 tx=0x7f71a000a430 comp rx=0 tx=0).stop 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 shutdown_connections 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71a8156600 0x7f71a814a970 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a814fd00 0x7f71a814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f718c0668d0 0x7f718c068d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 --2- 172.21.15.26:0/866946493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71a80a86d0 0x7f71a806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 >> 172.21.15.26:0/866946493 conn(0x7f71a80c2a60 msgr2=0x7f71a81502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 shutdown_connections 2023-11-28T16:56:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.090+0000 7f71b03e6640 1 -- 172.21.15.26:0/866946493 wait complete. 2023-11-28T16:56:48.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:48.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b8cad640 1 Processor -- start 2023-11-28T16:56:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b8cad640 1 -- start start 2023-11-28T16:56:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b8cad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b40a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b8cad640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71b414fd00 0x7f71b40aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b8cad640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b4152d90 con 0x7f71b4156600 2023-11-28T16:56:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b8cad640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b4152480 con 0x7f71b414fd00 2023-11-28T16:56:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b8cad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40a9760 con 0x7f71b40a86d0 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71b414fd00 0x7f71b40aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b259c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b40a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b259c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b40a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:57038/0 (socket says 172.21.15.26:57038) 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71b414fd00 0x7f71b40aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:39948/0 (socket says 172.21.15.26:39948) 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b259c640 1 -- 172.21.15.26:0/2329532360 learned_addr learned my addr 172.21.15.26:0/2329532360 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b259c640 1 -- 172.21.15.26:0/2329532360 >> v2:172.21.15.79:3300/0 conn(0x7f71b414fd00 msgr2=0x7f71b40aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b259c640 1 --2- 172.21.15.26:0/2329532360 >> v2:172.21.15.79:3300/0 conn(0x7f71b414fd00 0x7f71b40aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.254+0000 7f71b259c640 1 -- 172.21.15.26:0/2329532360 >> v1:172.21.15.79:6789/0 conn(0x7f71b4156600 legacy=0x7f71b414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.258+0000 7f71b259c640 1 -- 172.21.15.26:0/2329532360 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4152740 con 0x7f71b40a86d0 2023-11-28T16:56:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.258+0000 7f71b259c640 1 --2- 172.21.15.26:0/2329532360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b40a8f30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009870 tx=0x7f71a401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c8b74d9bd1bc45c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.258+0000 7f71b159a640 1 -- 172.21.15.26:0/2329532360 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40a7070 con 0x7f71b40a86d0 2023-11-28T16:56:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.258+0000 7f71b159a640 1 -- 172.21.15.26:0/2329532360 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a40ab430 con 0x7f71b40a86d0 2023-11-28T16:56:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.258+0000 7f71b159a640 1 -- 172.21.15.26:0/2329532360 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40ab7c0 con 0x7f71b40a86d0 2023-11-28T16:56:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.258+0000 7f71b8cad640 1 -- 172.21.15.26:0/2329532360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 msgr2=0x7f71b40a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.258+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2329532360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b40a8f30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009870 tx=0x7f71a401c540 comp rx=0 tx=0).stop 2023-11-28T16:56:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- 172.21.15.26:0/2329532360 shutdown_connections 2023-11-28T16:56:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2329532360 >> v2:172.21.15.79:3300/0 conn(0x7f71b414fd00 0x7f71b40aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2329532360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b40a8f30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- 172.21.15.26:0/2329532360 >> 172.21.15.26:0/2329532360 conn(0x7f71b40c2a60 msgr2=0x7f71b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- 172.21.15.26:0/2329532360 shutdown_connections 2023-11-28T16:56:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- 172.21.15.26:0/2329532360 wait complete. 2023-11-28T16:56:48.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 Processor -- start 2023-11-28T16:56:48.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- start start 2023-11-28T16:56:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b406c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b414fd00 0x7f71b4142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4156600 0x7f71b4143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4148de0 con 0x7f71b414fd00 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41ec7a0 con 0x7f71b4156600 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b8cad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4143960 con 0x7f71b40a86d0 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b414fd00 0x7f71b4142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b414fd00 0x7f71b4142ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49446/0 (socket says 172.21.15.26:49446) 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 -- 172.21.15.26:0/2426436603 learned_addr learned my addr 172.21.15.26:0/2426436603 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b259c640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b406c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b2d9d640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4156600 0x7f71b4143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 -- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 msgr2=0x7f71b406c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b406c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 -- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4156600 msgr2=0x7f71b4143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4156600 0x7f71b4143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b1d9b640 1 -- 172.21.15.26:0/2426436603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40094d0 con 0x7f71b414fd00 2023-11-28T16:56:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.262+0000 7f71b2d9d640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4156600 0x7f71b4143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71b1d9b640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b414fd00 0x7f71b4142ee0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c480 tx=0x7f71a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71a2ffd640 1 -- 172.21.15.26:0/2426436603 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80052d0 con 0x7f71b414fd00 2023-11-28T16:56:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71a2ffd640 1 -- 172.21.15.26:0/2426436603 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8005430 con 0x7f71b414fd00 2023-11-28T16:56:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71a2ffd640 1 -- 172.21.15.26:0/2426436603 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8007260 con 0x7f71b414fd00 2023-11-28T16:56:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b41533a0 con 0x7f71b414fd00 2023-11-28T16:56:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4148820 con 0x7f71b414fd00 2023-11-28T16:56:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b4153200 con 0x7f71b414fd00 2023-11-28T16:56:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71a2ffd640 1 -- 172.21.15.26:0/2426436603 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71a80073c0 con 0x7f71b414fd00 2023-11-28T16:56:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71a2ffd640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71940668d0 0x7f7194068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71a2ffd640 1 -- 172.21.15.26:0/2426436603 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71a8083c90 con 0x7f71b414fd00 2023-11-28T16:56:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.266+0000 7f71b259c640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71940668d0 0x7f7194068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.270+0000 7f71b259c640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71940668d0 0x7f7194068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71a40af000 tx=0x7f71a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.270+0000 7f71a2ffd640 1 -- 172.21.15.26:0/2426436603 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71b4153200 con 0x7f71b414fd00 2023-11-28T16:56:48.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71b4153200 con 0x7f71b414fd00 2023-11-28T16:56:48.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71a2ffd640 1 -- 172.21.15.26:0/2426436603 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71b4153200 con 0x7f71b414fd00 2023-11-28T16:56:48.435 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71940668d0 msgr2=0x7f7194068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71940668d0 0x7f7194068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71a40af000 tx=0x7f71a4008040 comp rx=0 tx=0).stop 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b414fd00 msgr2=0x7f71b4142ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b414fd00 0x7f71b4142ee0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c480 tx=0x7f71a800c940 comp rx=0 tx=0).stop 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 shutdown_connections 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4156600 0x7f71b4143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71b414fd00 0x7f71b4142ee0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71940668d0 0x7f7194068d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 --2- 172.21.15.26:0/2426436603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71b40a86d0 0x7f71b406c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 >> 172.21.15.26:0/2426436603 conn(0x7f71b40c2a60 msgr2=0x7f71b40c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 shutdown_connections 2023-11-28T16:56:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.430+0000 7f71b8cad640 1 -- 172.21.15.26:0/2426436603 wait complete. 2023-11-28T16:56:48.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:56:48.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.594+0000 7f82fdd72640 1 Processor -- start 2023-11-28T16:56:48.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.594+0000 7f82fdd72640 1 -- start start 2023-11-28T16:56:48.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82fdd72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82f814fcc0 0x7f82f8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82fdd72640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82f80c19e0 0x7f82f80c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82fdd72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f80ab580 con 0x7f82f806d980 2023-11-28T16:56:48.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82fdd72640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80aa340 con 0x7f82f80c19e0 2023-11-28T16:56:48.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82fdd72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f8152fe0 con 0x7f82f814fcc0 2023-11-28T16:56:48.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82f80c19e0 0x7f82f80c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82f80c19e0 0x7f82f80c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49452/0 (socket says 172.21.15.26:49452) 2023-11-28T16:56:48.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f7fff640 1 -- 172.21.15.26:0/3110643563 learned_addr learned my addr 172.21.15.26:0/3110643563 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:48.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f77fe640 1 --2- 172.21.15.26:0/3110643563 >> v2:172.21.15.79:3300/0 conn(0x7f82f814fcc0 0x7f82f8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f7fff640 1 -- 172.21.15.26:0/3110643563 >> v2:172.21.15.79:3300/0 conn(0x7f82f814fcc0 msgr2=0x7f82f8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f7fff640 1 --2- 172.21.15.26:0/3110643563 >> v2:172.21.15.79:3300/0 conn(0x7f82f814fcc0 0x7f82f8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f7fff640 1 -- 172.21.15.26:0/3110643563 >> v1:172.21.15.79:6789/0 conn(0x7f82f806d980 legacy=0x7f82f80aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f7fff640 1 -- 172.21.15.26:0/3110643563 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f81532c0 con 0x7f82f80c19e0 2023-11-28T16:56:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.598+0000 7f82f77fe640 1 --2- 172.21.15.26:0/3110643563 >> v2:172.21.15.79:3300/0 conn(0x7f82f814fcc0 0x7f82f8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82f7fff640 1 --2- 172.21.15.26:0/3110643563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f80c19e0 0x7f82f80c1e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f82f806e350 tx=0x7f82f001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cdb5b37b745a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82f67fc640 1 -- 172.21.15.26:0/3110643563 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00a5730 con 0x7f82f80c19e0 2023-11-28T16:56:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82f67fc640 1 -- 172.21.15.26:0/3110643563 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f00a5890 con 0x7f82f80c19e0 2023-11-28T16:56:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82f67fc640 1 -- 172.21.15.26:0/3110643563 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00a5c20 con 0x7f82f80c19e0 2023-11-28T16:56:48.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 -- 172.21.15.26:0/3110643563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f80c19e0 msgr2=0x7f82f80c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 --2- 172.21.15.26:0/3110643563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f80c19e0 0x7f82f80c1e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f82f806e350 tx=0x7f82f001c960 comp rx=0 tx=0).stop 2023-11-28T16:56:48.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 -- 172.21.15.26:0/3110643563 shutdown_connections 2023-11-28T16:56:48.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 --2- 172.21.15.26:0/3110643563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f80c19e0 0x7f82f80c1e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 --2- 172.21.15.26:0/3110643563 >> v2:172.21.15.79:3300/0 conn(0x7f82f814fcc0 0x7f82f8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 -- 172.21.15.26:0/3110643563 >> 172.21.15.26:0/3110643563 conn(0x7f82f80c2ad0 msgr2=0x7f82f80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:48.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 -- 172.21.15.26:0/3110643563 shutdown_connections 2023-11-28T16:56:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 -- 172.21.15.26:0/3110643563 wait complete. 2023-11-28T16:56:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 Processor -- start 2023-11-28T16:56:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.602+0000 7f82fdd72640 1 -- start start 2023-11-28T16:56:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82f806d980 0x7f82f80c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82f80c19e0 0x7f82f813c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f814ac90 0x7f82f813cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81f11b0 con 0x7f82f814ac90 2023-11-28T16:56:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81f0250 con 0x7f82f80c19e0 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81f0530 con 0x7f82f806d980 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f814ac90 0x7f82f813cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f814ac90 0x7f82f813cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49468/0 (socket says 172.21.15.26:49468) 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 -- 172.21.15.26:0/234464768 learned_addr learned my addr 172.21.15.26:0/234464768 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f77fe640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82f806d980 0x7f82f80c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f6ffd640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82f80c19e0 0x7f82f813c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 -- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82f806d980 msgr2=0x7f82f80c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82f806d980 0x7f82f80c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 -- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82f80c19e0 msgr2=0x7f82f813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82f80c19e0 0x7f82f813c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 -- 172.21.15.26:0/234464768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0009b30 con 0x7f82f814ac90 2023-11-28T16:56:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f6ffd640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82f80c19e0 0x7f82f813c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:48.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82f7fff640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f814ac90 0x7f82f813cbb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f82f00af040 tx=0x7f82f0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:48.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82dffff640 1 -- 172.21.15.26:0/234464768 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00b8670 con 0x7f82f814ac90 2023-11-28T16:56:48.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82dffff640 1 -- 172.21.15.26:0/234464768 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f00b87d0 con 0x7f82f814ac90 2023-11-28T16:56:48.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f81f0810 con 0x7f82f814ac90 2023-11-28T16:56:48.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82dffff640 1 -- 172.21.15.26:0/234464768 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00b8b80 con 0x7f82f814ac90 2023-11-28T16:56:48.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f81f0dd0 con 0x7f82f814ac90 2023-11-28T16:56:48.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f806dde0 con 0x7f82f814ac90 2023-11-28T16:56:48.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.606+0000 7f82dffff640 1 -- 172.21.15.26:0/234464768 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f82f00b8ce0 con 0x7f82f814ac90 2023-11-28T16:56:48.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.610+0000 7f82dffff640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82e40668d0 0x7f82e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:48.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.610+0000 7f82dffff640 1 -- 172.21.15.26:0/234464768 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82f011fa00 con 0x7f82f814ac90 2023-11-28T16:56:48.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.610+0000 7f82f77fe640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82e40668d0 0x7f82e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:48.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.610+0000 7f82f77fe640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82e40668d0 0x7f82e4068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82e80045f0 tx=0x7f82e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:48.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.614+0000 7f82dffff640 1 -- 172.21.15.26:0/234464768 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82f806dde0 con 0x7f82f814ac90 2023-11-28T16:56:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.782+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82f814b640 con 0x7f82f814ac90 2023-11-28T16:56:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82dffff640 1 -- 172.21.15.26:0/234464768 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82f814b640 con 0x7f82f814ac90 2023-11-28T16:56:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:56:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82e40668d0 msgr2=0x7f82e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82e40668d0 0x7f82e4068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82e80045f0 tx=0x7f82e8008040 comp rx=0 tx=0).stop 2023-11-28T16:56:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f814ac90 msgr2=0x7f82f813cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f814ac90 0x7f82f813cbb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f82f00af040 tx=0x7f82f0019700 comp rx=0 tx=0).stop 2023-11-28T16:56:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 shutdown_connections 2023-11-28T16:56:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82f814ac90 0x7f82f813cbb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82f80c19e0 0x7f82f813c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82e40668d0 0x7f82e4068d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 --2- 172.21.15.26:0/234464768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82f806d980 0x7f82f80c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 >> 172.21.15.26:0/234464768 conn(0x7f82f80c2ad0 msgr2=0x7f82f8156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 shutdown_connections 2023-11-28T16:56:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:48.786+0000 7f82fdd72640 1 -- 172.21.15.26:0/234464768 wait complete. 2023-11-28T16:56:48.811 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T16:56:48.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:48.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-28T16:56:48.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:56:48.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:56:48.851 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:56:48.909 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-28T16:56:48.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:49.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0bdd1640 1 Processor -- start 2023-11-28T16:56:49.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0bdd1640 1 -- start start 2023-11-28T16:56:49.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0bdd1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e040a8470 0x7f0e04151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0bdd1640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0406d320 con 0x7f0e04070b80 2023-11-28T16:56:49.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0bdd1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e040721b0 con 0x7f0e0414e9d0 2023-11-28T16:56:49.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0bdd1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e040c2830 con 0x7f0e040a8470 2023-11-28T16:56:49.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0936c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0e04070b80 0x7f0e0406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51860/0 (socket says 172.21.15.26:51860) 2023-11-28T16:56:49.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0936c640 1 -- 172.21.15.26:0/3704753310 learned_addr learned my addr 172.21.15.26:0/3704753310 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:49.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.046+0000 7f0e0a36e640 1 --2- 172.21.15.26:0/3704753310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e040a8470 0x7f0e04151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e08b6b640 1 -- 172.21.15.26:0/3704753310 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294833502 0 0) 0x7f0e0406d320 con 0x7f0e04070b80 2023-11-28T16:56:49.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e08b6b640 1 -- 172.21.15.26:0/3704753310 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df0003530 con 0x7f0e04070b80 2023-11-28T16:56:49.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e08b6b640 1 -- 172.21.15.26:0/3704753310 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131675002 0 0) 0x7f0e040721b0 con 0x7f0e0414e9d0 2023-11-28T16:56:49.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e08b6b640 1 -- 172.21.15.26:0/3704753310 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e0406d320 con 0x7f0e0414e9d0 2023-11-28T16:56:49.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e0a36e640 1 -- 172.21.15.26:0/3704753310 >> v1:172.21.15.79:6789/0 conn(0x7f0e0414e9d0 legacy=0x7f0e040c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e0a36e640 1 -- 172.21.15.26:0/3704753310 >> v1:172.21.15.26:6789/0 conn(0x7f0e04070b80 legacy=0x7f0e0406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e0a36e640 1 -- 172.21.15.26:0/3704753310 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04072450 con 0x7f0e040a8470 2023-11-28T16:56:49.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e0a36e640 1 --2- 172.21.15.26:0/3704753310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e040a8470 0x7f0e04151e60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009dc0 tx=0x7f0dfc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c41f5ec0bea9182 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e08b6b640 1 -- 172.21.15.26:0/3704753310 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0a58b0 con 0x7f0e040a8470 2023-11-28T16:56:49.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e08b6b640 1 -- 172.21.15.26:0/3704753310 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0a5a10 con 0x7f0e040a8470 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.050+0000 7f0e08b6b640 1 -- 172.21.15.26:0/3704753310 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0a5d80 con 0x7f0e040a8470 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/3704753310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e040a8470 msgr2=0x7f0e04151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/3704753310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e040a8470 0x7f0e04151e60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009dc0 tx=0x7f0dfc01c8e0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/3704753310 shutdown_connections 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/3704753310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e040a8470 0x7f0e04151e60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/3704753310 >> 172.21.15.26:0/3704753310 conn(0x7f0e040c2ad0 msgr2=0x7f0e040c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/3704753310 shutdown_connections 2023-11-28T16:56:49.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/3704753310 wait complete. 2023-11-28T16:56:49.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 Processor -- start 2023-11-28T16:56:49.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- start start 2023-11-28T16:56:49.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e04070b80 0x7f0e040c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e040a8470 0x7f0e04150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e0414e9d0 0x7f0e04150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04152660 con 0x7f0e0414e9d0 2023-11-28T16:56:49.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04149c80 con 0x7f0e040a8470 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0bdd1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0414fb90 con 0x7f0e04070b80 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e0414e9d0 0x7f0e04150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e0414e9d0 0x7f0e04150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49474/0 (socket says 172.21.15.26:49474) 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 -- 172.21.15.26:0/882236196 learned_addr learned my addr 172.21.15.26:0/882236196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e09b6d640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e04070b80 0x7f0e040c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0936c640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e040a8470 0x7f0e04150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 -- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e04070b80 msgr2=0x7f0e040c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e04070b80 0x7f0e040c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 -- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e040a8470 msgr2=0x7f0e04150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e040a8470 0x7f0e04150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0a36e640 1 -- 172.21.15.26:0/882236196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc009a70 con 0x7f0e0414e9d0 2023-11-28T16:56:49.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e09b6d640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e04070b80 0x7f0e040c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:49.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.054+0000 7f0e0936c640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e040a8470 0x7f0e04150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:49.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0e0a36e640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e0414e9d0 0x7f0e04150b70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0194f0 tx=0x7f0dfc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0dfa7fc640 1 -- 172.21.15.26:0/882236196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0ad640 con 0x7f0e0414e9d0 2023-11-28T16:56:49.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0dfa7fc640 1 -- 172.21.15.26:0/882236196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0ad7a0 con 0x7f0e0414e9d0 2023-11-28T16:56:49.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e041499a0 con 0x7f0e0414e9d0 2023-11-28T16:56:49.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0dfa7fc640 1 -- 172.21.15.26:0/882236196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0adb50 con 0x7f0e0414e9d0 2023-11-28T16:56:49.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e040c53b0 con 0x7f0e0414e9d0 2023-11-28T16:56:49.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e04150350 con 0x7f0e0414e9d0 2023-11-28T16:56:49.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0dfa7fc640 1 -- 172.21.15.26:0/882236196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0dfc0b4070 con 0x7f0e0414e9d0 2023-11-28T16:56:49.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0dfa7fc640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0de80668d0 0x7f0de8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0dfa7fc640 1 -- 172.21.15.26:0/882236196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dfc11ea80 con 0x7f0e0414e9d0 2023-11-28T16:56:49.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.058+0000 7f0e09b6d640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0de80668d0 0x7f0de8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.062+0000 7f0e09b6d640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0de80668d0 0x7f0de8068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e00001640 tx=0x7f0e00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.062+0000 7f0dfa7fc640 1 -- 172.21.15.26:0/882236196 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e04150350 con 0x7f0e0414e9d0 2023-11-28T16:56:49.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.254+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e04150350 con 0x7f0e0414e9d0 2023-11-28T16:56:49.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.254+0000 7f0dfa7fc640 1 -- 172.21.15.26:0/882236196 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f0e04150350 con 0x7f0e0414e9d0 2023-11-28T16:56:49.260 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:49.260 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:49.261 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0de80668d0 msgr2=0x7f0de8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0de80668d0 0x7f0de8068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e00001640 tx=0x7f0e00009040 comp rx=0 tx=0).stop 2023-11-28T16:56:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e0414e9d0 msgr2=0x7f0e04150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e0414e9d0 0x7f0e04150b70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0194f0 tx=0x7f0dfc019680 comp rx=0 tx=0).stop 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 shutdown_connections 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e0414e9d0 0x7f0e04150b70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e040a8470 0x7f0e04150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0de80668d0 0x7f0de8068d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 --2- 172.21.15.26:0/882236196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e04070b80 0x7f0e040c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 >> 172.21.15.26:0/882236196 conn(0x7f0e040c2ad0 msgr2=0x7f0e040c12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 shutdown_connections 2023-11-28T16:56:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.258+0000 7f0e0bdd1640 1 -- 172.21.15.26:0/882236196 wait complete. 2023-11-28T16:56:49.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:49.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24e17c4640 1 Processor -- start 2023-11-28T16:56:49.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24e17c4640 1 -- start start 2023-11-28T16:56:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24e17c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24dc0bd720 0x7f24dc158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24e17c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc155790 con 0x7f24dc06cd90 2023-11-28T16:56:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24e17c4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc0c4b00 con 0x7f24dc0ca610 2023-11-28T16:56:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24e17c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc0c4de0 con 0x7f24dc0bd720 2023-11-28T16:56:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24db7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f24dc06cd90 0x7f24dc0c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51864/0 (socket says 172.21.15.26:51864) 2023-11-28T16:56:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24db7fe640 1 -- 172.21.15.26:0/2380593469 learned_addr learned my addr 172.21.15.26:0/2380593469 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:49.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24d3fff640 1 --2- 172.21.15.26:0/2380593469 >> v2:172.21.15.26:3300/0 conn(0x7f24dc0bd720 0x7f24dc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24da7fc640 1 -- 172.21.15.26:0/2380593469 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945983207 0 0) 0x7f24dc155790 con 0x7f24dc06cd90 2023-11-28T16:56:49.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24da7fc640 1 -- 172.21.15.26:0/2380593469 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c8003530 con 0x7f24dc06cd90 2023-11-28T16:56:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24da7fc640 1 -- 172.21.15.26:0/2380593469 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135049127 0 0) 0x7f24dc0c4b00 con 0x7f24dc0ca610 2023-11-28T16:56:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24d3fff640 1 -- 172.21.15.26:0/2380593469 >> v1:172.21.15.79:6789/0 conn(0x7f24dc0ca610 legacy=0x7f24dc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24d3fff640 1 -- 172.21.15.26:0/2380593469 >> v1:172.21.15.26:6789/0 conn(0x7f24dc06cd90 legacy=0x7f24dc0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.422+0000 7f24d3fff640 1 -- 172.21.15.26:0/2380593469 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc157e30 con 0x7f24dc0bd720 2023-11-28T16:56:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24d3fff640 1 --2- 172.21.15.26:0/2380593469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0bd720 0x7f24dc158350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f24c40097c0 tx=0x7f24c401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6791166b2ed1c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24da7fc640 1 -- 172.21.15.26:0/2380593469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc0c52d0 con 0x7f24dc0bd720 2023-11-28T16:56:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24da7fc640 1 -- 172.21.15.26:0/2380593469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c40a4840 con 0x7f24dc0bd720 2023-11-28T16:56:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24da7fc640 1 -- 172.21.15.26:0/2380593469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40a4bd0 con 0x7f24dc0bd720 2023-11-28T16:56:49.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24e17c4640 1 -- 172.21.15.26:0/2380593469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0bd720 msgr2=0x7f24dc158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24e17c4640 1 --2- 172.21.15.26:0/2380593469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0bd720 0x7f24dc158350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f24c40097c0 tx=0x7f24c401c040 comp rx=0 tx=0).stop 2023-11-28T16:56:49.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24e17c4640 1 -- 172.21.15.26:0/2380593469 shutdown_connections 2023-11-28T16:56:49.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24e17c4640 1 --2- 172.21.15.26:0/2380593469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0bd720 0x7f24dc158350 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24e17c4640 1 -- 172.21.15.26:0/2380593469 >> 172.21.15.26:0/2380593469 conn(0x7f24dc071ea0 msgr2=0x7f24dc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:49.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24e17c4640 1 -- 172.21.15.26:0/2380593469 shutdown_connections 2023-11-28T16:56:49.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.426+0000 7f24e17c4640 1 -- 172.21.15.26:0/2380593469 wait complete. 2023-11-28T16:56:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 Processor -- start 2023-11-28T16:56:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 -- start start 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24dc06cd90 0x7f24dc0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc0bd720 0x7f24dc0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0ca610 0x7f24dc1ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0a9a70 con 0x7f24dc0ca610 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0aa380 con 0x7f24dc0bd720 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0a9c50 con 0x7f24dc06cd90 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0ca610 0x7f24dc1ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0ca610 0x7f24dc1ee490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49488/0 (socket says 172.21.15.26:49488) 2023-11-28T16:56:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 -- 172.21.15.26:0/3967429450 learned_addr learned my addr 172.21.15.26:0/3967429450 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24daffd640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24dc06cd90 0x7f24dc0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24d3fff640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc0bd720 0x7f24dc0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 -- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24dc06cd90 msgr2=0x7f24dc0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24dc06cd90 0x7f24dc0ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 -- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc0bd720 msgr2=0x7f24dc0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc0bd720 0x7f24dc0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 -- 172.21.15.26:0/3967429450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4009420 con 0x7f24dc0ca610 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24d3fff640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc0bd720 0x7f24dc0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24db7fe640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0ca610 0x7f24dc1ee490 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24d400cb40 tx=0x7f24d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24d37fe640 1 -- 172.21.15.26:0/3967429450 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400aca0 con 0x7f24dc0ca610 2023-11-28T16:56:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24d37fe640 1 -- 172.21.15.26:0/3967429450 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400ae00 con 0x7f24dc0ca610 2023-11-28T16:56:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24d37fe640 1 -- 172.21.15.26:0/3967429450 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4012620 con 0x7f24dc0ca610 2023-11-28T16:56:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc0a9f30 con 0x7f24dc0ca610 2023-11-28T16:56:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc1edf20 con 0x7f24dc0ca610 2023-11-28T16:56:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.430+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc1ee170 con 0x7f24dc0ca610 2023-11-28T16:56:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.434+0000 7f24d37fe640 1 -- 172.21.15.26:0/3967429450 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f24d4007070 con 0x7f24dc0ca610 2023-11-28T16:56:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.434+0000 7f24d37fe640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24bc0668d0 0x7f24bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.434+0000 7f24d37fe640 1 -- 172.21.15.26:0/3967429450 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24d4084420 con 0x7f24dc0ca610 2023-11-28T16:56:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.434+0000 7f24daffd640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24bc0668d0 0x7f24bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.434+0000 7f24daffd640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24bc0668d0 0x7f24bc068d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24cc007fd0 tx=0x7f24cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.438+0000 7f24d37fe640 1 -- 172.21.15.26:0/3967429450 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24d4051700 con 0x7f24dc0ca610 2023-11-28T16:56:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.598+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24dc04e890 con 0x7f24dc0ca610 2023-11-28T16:56:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.598+0000 7f24d37fe640 1 -- 172.21.15.26:0/3967429450 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f24d4054d20 con 0x7f24dc0ca610 2023-11-28T16:56:49.604 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:49.604 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:49.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24bc0668d0 msgr2=0x7f24bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24bc0668d0 0x7f24bc068d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24cc007fd0 tx=0x7f24cc009040 comp rx=0 tx=0).stop 2023-11-28T16:56:49.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0ca610 msgr2=0x7f24dc1ee490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0ca610 0x7f24dc1ee490 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24d400cb40 tx=0x7f24d400a060 comp rx=0 tx=0).stop 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 shutdown_connections 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0ca610 0x7f24dc1ee490 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc0bd720 0x7f24dc0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24bc0668d0 0x7f24bc068d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 --2- 172.21.15.26:0/3967429450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24dc06cd90 0x7f24dc0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 >> 172.21.15.26:0/3967429450 conn(0x7f24dc071ea0 msgr2=0x7f24dc14e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 shutdown_connections 2023-11-28T16:56:49.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.602+0000 7f24e17c4640 1 -- 172.21.15.26:0/3967429450 wait complete. 2023-11-28T16:56:49.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:56:15.704457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:56:16.649414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:56:49.627 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:56:49.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.766+0000 7f3c4dbf5640 1 Processor -- start 2023-11-28T16:56:49.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.766+0000 7f3c4dbf5640 1 -- start start 2023-11-28T16:56:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c4dbf5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c4814eaf0 0x7f3c48151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c4dbf5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c48151f90 0x7f3c4806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c4dbf5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4806de00 con 0x7f3c480c0370 2023-11-28T16:56:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c4dbf5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c48070390 con 0x7f3c4814eaf0 2023-11-28T16:56:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c4dbf5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4814eed0 con 0x7f3c48151f90 2023-11-28T16:56:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c477fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c4814eaf0 0x7f3c48151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c46ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c48151f90 0x7f3c4806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c477fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c4814eaf0 0x7f3c48151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:40004/0 (socket says 172.21.15.26:40004) 2023-11-28T16:56:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c477fe640 1 -- 172.21.15.26:0/1754734970 learned_addr learned my addr 172.21.15.26:0/1754734970 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c477fe640 1 -- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c48151f90 msgr2=0x7f3c4806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c477fe640 1 --2- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c48151f90 0x7f3c4806d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c477fe640 1 -- 172.21.15.26:0/1754734970 >> v1:172.21.15.79:6789/0 conn(0x7f3c480c0370 legacy=0x7f3c4806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c477fe640 1 -- 172.21.15.26:0/1754734970 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48151270 con 0x7f3c4814eaf0 2023-11-28T16:56:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c46ffd640 1 --2- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c48151f90 0x7f3c4806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.770+0000 7f3c467fc640 1 -- 172.21.15.26:0/1754734970 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707397165 0 0) 0x7f3c4806de00 con 0x7f3c480c0370 2023-11-28T16:56:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c477fe640 1 --2- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4814eaf0 0x7f3c48151a50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009870 tx=0x7f3c3801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a6d6a78a11e1555 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c467fc640 1 -- 172.21.15.26:0/1754734970 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c380ab5f0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c467fc640 1 -- 172.21.15.26:0/1754734970 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c380ab750 con 0x7f3c4814eaf0 2023-11-28T16:56:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c467fc640 1 -- 172.21.15.26:0/1754734970 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c380abae0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4814eaf0 msgr2=0x7f3c48151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4814eaf0 0x7f3c48151a50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009870 tx=0x7f3c3801c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1754734970 shutdown_connections 2023-11-28T16:56:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c48151f90 0x7f3c4806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1754734970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4814eaf0 0x7f3c48151a50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1754734970 >> 172.21.15.26:0/1754734970 conn(0x7f3c480c2a60 msgr2=0x7f3c480c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:49.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1754734970 shutdown_connections 2023-11-28T16:56:49.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1754734970 wait complete. 2023-11-28T16:56:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 Processor -- start 2023-11-28T16:56:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.774+0000 7f3c4dbf5640 1 -- start start 2023-11-28T16:56:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c480c0370 0x7f3c480c0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c4814eaf0 0x7f3c480718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480c58c0 0x7f3c48154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481497b0 con 0x7f3c480c58c0 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480c3bf0 con 0x7f3c480c0370 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4814ac40 con 0x7f3c4814eaf0 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c47fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480c58c0 0x7f3c48154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c480c0370 0x7f3c480c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c46ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c4814eaf0 0x7f3c480718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c480c0370 0x7f3c480c0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:40018/0 (socket says 172.21.15.26:40018) 2023-11-28T16:56:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c477fe640 1 -- 172.21.15.26:0/1327438333 learned_addr learned my addr 172.21.15.26:0/1327438333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c46ffd640 1 -- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c480c0370 msgr2=0x7f3c480c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c46ffd640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c480c0370 0x7f3c480c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c46ffd640 1 -- 172.21.15.26:0/1327438333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480c58c0 msgr2=0x7f3c48154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c46ffd640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480c58c0 0x7f3c48154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c46ffd640 1 -- 172.21.15.26:0/1327438333 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009420 con 0x7f3c4814eaf0 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c47fff640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480c58c0 0x7f3c48154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c477fe640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c480c0370 0x7f3c480c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c46ffd640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c4814eaf0 0x7f3c480718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00e8e0 tx=0x7f3c3c00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c2ffff640 1 -- 172.21.15.26:0/1327438333 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00c8e0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c2ffff640 1 -- 172.21.15.26:0/1327438333 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00ca40 con 0x7f3c4814eaf0 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c2ffff640 1 -- 172.21.15.26:0/1327438333 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00cdf0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c380094d0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c48149ce0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.778+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4804e890 con 0x7f3c4814eaf0 2023-11-28T16:56:49.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.782+0000 7f3c2ffff640 1 -- 172.21.15.26:0/1327438333 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3c3c013470 con 0x7f3c4814eaf0 2023-11-28T16:56:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.782+0000 7f3c2ffff640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c34066900 0x7f3c34068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.782+0000 7f3c2ffff640 1 -- 172.21.15.26:0/1327438333 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c3c0847a0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.782+0000 7f3c477fe640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c34066900 0x7f3c34068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.782+0000 7f3c477fe640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c34066900 0x7f3c34068dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c3801c430 tx=0x7f3c380b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:49.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.786+0000 7f3c2ffff640 1 -- 172.21.15.26:0/1327438333 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c3c0518e0 con 0x7f3c4814eaf0 2023-11-28T16:56:49.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c48150070 con 0x7f3c4814eaf0 2023-11-28T16:56:49.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c2ffff640 1 -- 172.21.15.26:0/1327438333 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c3c054f00 con 0x7f3c4814eaf0 2023-11-28T16:56:49.951 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:56:49.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c34066900 msgr2=0x7f3c34068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c34066900 0x7f3c34068dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c3801c430 tx=0x7f3c380b6040 comp rx=0 tx=0).stop 2023-11-28T16:56:49.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c4814eaf0 msgr2=0x7f3c480718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:49.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c4814eaf0 0x7f3c480718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00e8e0 tx=0x7f3c3c00eda0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 shutdown_connections 2023-11-28T16:56:49.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480c58c0 0x7f3c48154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c34066900 0x7f3c34068dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c4814eaf0 0x7f3c480718c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 --2- 172.21.15.26:0/1327438333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c480c0370 0x7f3c480c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:49.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 >> 172.21.15.26:0/1327438333 conn(0x7f3c480c2a60 msgr2=0x7f3c48144e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:49.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 shutdown_connections 2023-11-28T16:56:49.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:49.946+0000 7f3c4dbf5640 1 -- 172.21.15.26:0/1327438333 wait complete. 2023-11-28T16:56:49.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:56:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96b51f5640 1 Processor -- start 2023-11-28T16:56:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96b51f5640 1 -- start start 2023-11-28T16:56:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96b51f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00c0370 0x7f96b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96b51f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96b00a8470 0x7f96b006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96b51f5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b006de00 con 0x7f96b014eaf0 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96b51f5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b0070390 con 0x7f96b00a8470 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96b51f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b006db90 con 0x7f96b00c0370 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96aed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f96b014eaf0 0x7f96b0151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51872/0 (socket says 172.21.15.26:51872) 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96aed9d640 1 -- 172.21.15.26:0/4071557284 learned_addr learned my addr 172.21.15.26:0/4071557284 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96af59e640 1 --2- 172.21.15.26:0/4071557284 >> v2:172.21.15.79:3300/0 conn(0x7f96b00a8470 0x7f96b006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96a7fff640 1 --2- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00c0370 0x7f96b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96ae59c640 1 -- 172.21.15.26:0/4071557284 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399481109 0 0) 0x7f96b006de00 con 0x7f96b014eaf0 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96ae59c640 1 -- 172.21.15.26:0/4071557284 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f969c003530 con 0x7f96b014eaf0 2023-11-28T16:56:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96af59e640 1 -- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00c0370 msgr2=0x7f96b006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:50.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96af59e640 1 --2- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00c0370 0x7f96b006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96af59e640 1 -- 172.21.15.26:0/4071557284 >> v1:172.21.15.26:6789/0 conn(0x7f96b014eaf0 legacy=0x7f96b0151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96af59e640 1 -- 172.21.15.26:0/4071557284 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b014eed0 con 0x7f96b00a8470 2023-11-28T16:56:50.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.114+0000 7f96a7fff640 1 --2- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00c0370 0x7f96b006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96af59e640 1 --2- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00a8470 0x7f96b006d650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009d90 tx=0x7f96a801c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c596d9954f08fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96ae59c640 1 -- 172.21.15.26:0/4071557284 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a80a5910 con 0x7f96b00a8470 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96ae59c640 1 -- 172.21.15.26:0/4071557284 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a80a5a70 con 0x7f96b00a8470 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96ae59c640 1 -- 172.21.15.26:0/4071557284 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a80a5e00 con 0x7f96b00a8470 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 -- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00a8470 msgr2=0x7f96b006d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 --2- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00a8470 0x7f96b006d650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009d90 tx=0x7f96a801c830 comp rx=0 tx=0).stop 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 -- 172.21.15.26:0/4071557284 shutdown_connections 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 --2- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00a8470 0x7f96b006d650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 --2- 172.21.15.26:0/4071557284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00c0370 0x7f96b006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 -- 172.21.15.26:0/4071557284 >> 172.21.15.26:0/4071557284 conn(0x7f96b00c2a60 msgr2=0x7f96b00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 -- 172.21.15.26:0/4071557284 shutdown_connections 2023-11-28T16:56:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.118+0000 7f96b51f5640 1 -- 172.21.15.26:0/4071557284 wait complete. 2023-11-28T16:56:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 Processor -- start 2023-11-28T16:56:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 -- start start 2023-11-28T16:56:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00a8470 0x7f96b00bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00c0370 0x7f96b0140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96b014eaf0 0x7f96b01efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01448e0 con 0x7f96b014eaf0 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00c5d20 con 0x7f96b00c0370 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0152800 con 0x7f96b00a8470 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96b014eaf0 0x7f96b01efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96b014eaf0 0x7f96b01efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49514/0 (socket says 172.21.15.26:49514) 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 -- 172.21.15.26:0/2363726368 learned_addr learned my addr 172.21.15.26:0/2363726368 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96aed9d640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00a8470 0x7f96b00bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96a7fff640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00c0370 0x7f96b0140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 -- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00a8470 msgr2=0x7f96b00bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00a8470 0x7f96b00bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 -- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00c0370 msgr2=0x7f96b0140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00c0370 0x7f96b0140840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 -- 172.21.15.26:0/2363726368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698009420 con 0x7f96b014eaf0 2023-11-28T16:56:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96af59e640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96b014eaf0 0x7f96b01efde0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96a801aee0 tx=0x7f96a80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96a77fe640 1 -- 172.21.15.26:0/2363726368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a80adc00 con 0x7f96b014eaf0 2023-11-28T16:56:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96a77fe640 1 -- 172.21.15.26:0/2363726368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a80add60 con 0x7f96b014eaf0 2023-11-28T16:56:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a8009a70 con 0x7f96b014eaf0 2023-11-28T16:56:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96a77fe640 1 -- 172.21.15.26:0/2363726368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a80b9650 con 0x7f96b014eaf0 2023-11-28T16:56:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.122+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b0144e10 con 0x7f96b014eaf0 2023-11-28T16:56:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.126+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b0145000 con 0x7f96b014eaf0 2023-11-28T16:56:50.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.126+0000 7f96a77fe640 1 -- 172.21.15.26:0/2363726368 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f96a80b97b0 con 0x7f96b014eaf0 2023-11-28T16:56:50.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.126+0000 7f96a77fe640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f96900668d0 0x7f9690068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.126+0000 7f96a77fe640 1 -- 172.21.15.26:0/2363726368 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96a811fb80 con 0x7f96b014eaf0 2023-11-28T16:56:50.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.126+0000 7f96aed9d640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f96900668d0 0x7f9690068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.126+0000 7f96aed9d640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f96900668d0 0x7f9690068d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96a00011f0 tx=0x7f96a0007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.130+0000 7f96a77fe640 1 -- 172.21.15.26:0/2363726368 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96a80ecf80 con 0x7f96b014eaf0 2023-11-28T16:56:50.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.290+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96b004e890 con 0x7f96b014eaf0 2023-11-28T16:56:50.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.290+0000 7f96a77fe640 1 -- 172.21.15.26:0/2363726368 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96a80f05a0 con 0x7f96b014eaf0 2023-11-28T16:56:50.297 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:56:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f96900668d0 msgr2=0x7f9690068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f96900668d0 0x7f9690068d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96a00011f0 tx=0x7f96a0007d40 comp rx=0 tx=0).stop 2023-11-28T16:56:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96b014eaf0 msgr2=0x7f96b01efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96b014eaf0 0x7f96b01efde0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96a801aee0 tx=0x7f96a80195d0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 shutdown_connections 2023-11-28T16:56:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96b014eaf0 0x7f96b01efde0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b00c0370 0x7f96b0140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f96900668d0 0x7f9690068d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 --2- 172.21.15.26:0/2363726368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00a8470 0x7f96b00bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 >> 172.21.15.26:0/2363726368 conn(0x7f96b00c2a60 msgr2=0x7f96b006cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:50.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 shutdown_connections 2023-11-28T16:56:50.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.294+0000 7f96b51f5640 1 -- 172.21.15.26:0/2363726368 wait complete. 2023-11-28T16:56:50.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:56:50.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f246aa9a640 1 Processor -- start 2023-11-28T16:56:50.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f246aa9a640 1 -- start start 2023-11-28T16:56:50.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f246aa9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2464151d80 0x7f24640c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f246aa9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f246406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f246aa9a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246406cf70 con 0x7f24640c7f20 2023-11-28T16:56:50.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f246aa9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2464152160 con 0x7f2464151d80 2023-11-28T16:56:50.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f246aa9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640c6a30 con 0x7f24640c8430 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2468836640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2464151d80 0x7f24640c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2469037640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f24640c7f20 0x7f246406bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51886/0 (socket says 172.21.15.26:51886) 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2469037640 1 -- 172.21.15.26:0/2211215668 learned_addr learned my addr 172.21.15.26:0/2211215668 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2463fff640 1 --2- 172.21.15.26:0/2211215668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f246406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2468836640 1 -- 172.21.15.26:0/2211215668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 msgr2=0x7f246406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2468836640 1 --2- 172.21.15.26:0/2211215668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f246406b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2468836640 1 -- 172.21.15.26:0/2211215668 >> v1:172.21.15.26:6789/0 conn(0x7f24640c7f20 legacy=0x7f246406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.462+0000 7f2468836640 1 -- 172.21.15.26:0/2211215668 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640c72d0 con 0x7f2464151d80 2023-11-28T16:56:50.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f2468836640 1 --2- 172.21.15.26:0/2211215668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c49a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24580097c0 tx=0x7f245801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c1141b8b1b32a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f24637fe640 1 -- 172.21.15.26:0/2211215668 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24580ac620 con 0x7f2464151d80 2023-11-28T16:56:50.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f24637fe640 1 -- 172.21.15.26:0/2211215668 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24580ac780 con 0x7f2464151d80 2023-11-28T16:56:50.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f24637fe640 1 -- 172.21.15.26:0/2211215668 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24580acb10 con 0x7f2464151d80 2023-11-28T16:56:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 -- 172.21.15.26:0/2211215668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 msgr2=0x7f24640c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 --2- 172.21.15.26:0/2211215668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c49a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24580097c0 tx=0x7f245801c3c0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 -- 172.21.15.26:0/2211215668 shutdown_connections 2023-11-28T16:56:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 --2- 172.21.15.26:0/2211215668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f246406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 --2- 172.21.15.26:0/2211215668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c49a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 -- 172.21.15.26:0/2211215668 >> 172.21.15.26:0/2211215668 conn(0x7f24640abd00 msgr2=0x7f24640ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:50.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 -- 172.21.15.26:0/2211215668 shutdown_connections 2023-11-28T16:56:50.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 -- 172.21.15.26:0/2211215668 wait complete. 2023-11-28T16:56:50.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 Processor -- start 2023-11-28T16:56:50.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.466+0000 7f246aa9a640 1 -- start start 2023-11-28T16:56:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24640c7f20 0x7f24641f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f24641ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24641eccb0 con 0x7f2464151d80 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24641f1140 con 0x7f24640c7f20 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24641edc00 con 0x7f24640c8430 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49542/0 (socket says 172.21.15.26:49542) 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 -- 172.21.15.26:0/3759460005 learned_addr learned my addr 172.21.15.26:0/3759460005 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2468836640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24640c7f20 0x7f24641f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2463fff640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f24641ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 -- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 msgr2=0x7f24641ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f24641ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 -- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24640c7f20 msgr2=0x7f24641f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24640c7f20 0x7f24641f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 -- 172.21.15.26:0/3759460005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458009420 con 0x7f2464151d80 2023-11-28T16:56:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f2469037640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c10f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f245c00caa0 tx=0x7f245c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f24617fa640 1 -- 172.21.15.26:0/3759460005 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00ac00 con 0x7f2464151d80 2023-11-28T16:56:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f24617fa640 1 -- 172.21.15.26:0/3759460005 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c00ad60 con 0x7f2464151d80 2023-11-28T16:56:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f24617fa640 1 -- 172.21.15.26:0/3759460005 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c012600 con 0x7f2464151d80 2023-11-28T16:56:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640c1630 con 0x7f2464151d80 2023-11-28T16:56:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24640c2c50 con 0x7f2464151d80 2023-11-28T16:56:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24640c2e40 con 0x7f2464151d80 2023-11-28T16:56:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.470+0000 7f24617fa640 1 -- 172.21.15.26:0/3759460005 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f245c007070 con 0x7f2464151d80 2023-11-28T16:56:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.474+0000 7f24617fa640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24480668d0 0x7f2448068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.474+0000 7f24617fa640 1 -- 172.21.15.26:0/3759460005 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f245c084250 con 0x7f2464151d80 2023-11-28T16:56:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.474+0000 7f2468836640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24480668d0 0x7f2448068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.474+0000 7f2468836640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24480668d0 0x7f2448068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24580ae000 tx=0x7f2458008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.478+0000 7f24617fa640 1 -- 172.21.15.26:0/3759460005 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f245c0514a0 con 0x7f2464151d80 2023-11-28T16:56:50.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.634+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f246404e890 con 0x7f2464151d80 2023-11-28T16:56:50.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.634+0000 7f24617fa640 1 -- 172.21.15.26:0/3759460005 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f245c054ac0 con 0x7f2464151d80 2023-11-28T16:56:50.641 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:56:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24480668d0 msgr2=0x7f2448068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24480668d0 0x7f2448068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24580ae000 tx=0x7f2458008040 comp rx=0 tx=0).stop 2023-11-28T16:56:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 msgr2=0x7f24640c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c10f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f245c00caa0 tx=0x7f245c00cf60 comp rx=0 tx=0).stop 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 shutdown_connections 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464151d80 0x7f24640c10f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24480668d0 0x7f2448068d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c8430 0x7f24641ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 --2- 172.21.15.26:0/3759460005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24640c7f20 0x7f24641f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 >> 172.21.15.26:0/3759460005 conn(0x7f24640abd00 msgr2=0x7f246414e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 shutdown_connections 2023-11-28T16:56:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.638+0000 7f246aa9a640 1 -- 172.21.15.26:0/3759460005 wait complete. 2023-11-28T16:56:50.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09d4879640 1 Processor -- start 2023-11-28T16:56:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09d4879640 1 -- start start 2023-11-28T16:56:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09d4879640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09d0155360 0x7f09d006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09d4879640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09d006baf0 0x7f09d006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09d4879640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d006e280 con 0x7f09d006ed00 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09d4879640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00c2150 con 0x7f09d006baf0 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09d4879640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d0157c60 con 0x7f09d0155360 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09c7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09d006baf0 0x7f09d006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09c7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09d006baf0 0x7f09d006e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49558/0 (socket says 172.21.15.26:49558) 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09c7fff640 1 -- 172.21.15.26:0/455037594 learned_addr learned my addr 172.21.15.26:0/455037594 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09ce59c640 1 --2- 172.21.15.26:0/455037594 >> v2:172.21.15.79:3300/0 conn(0x7f09d0155360 0x7f09d006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09c7fff640 1 -- 172.21.15.26:0/455037594 >> v2:172.21.15.79:3300/0 conn(0x7f09d0155360 msgr2=0x7f09d006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09c7fff640 1 --2- 172.21.15.26:0/455037594 >> v2:172.21.15.79:3300/0 conn(0x7f09d0155360 0x7f09d006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09c7fff640 1 -- 172.21.15.26:0/455037594 >> v1:172.21.15.79:6789/0 conn(0x7f09d006ed00 legacy=0x7f09d01580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.802+0000 7f09c7fff640 1 -- 172.21.15.26:0/455037594 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00c1bd0 con 0x7f09d006baf0 2023-11-28T16:56:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09c7fff640 1 --2- 172.21.15.26:0/455037594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006baf0 0x7f09d006e7c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f09d00c0c10 tx=0x7f09b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244bffa8e1cbc8bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09cdd9b640 1 -- 172.21.15.26:0/455037594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80ab600 con 0x7f09d006baf0 2023-11-28T16:56:50.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09cdd9b640 1 -- 172.21.15.26:0/455037594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b80a7050 con 0x7f09d006baf0 2023-11-28T16:56:50.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09cdd9b640 1 -- 172.21.15.26:0/455037594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80ab980 con 0x7f09d006baf0 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 -- 172.21.15.26:0/455037594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006baf0 msgr2=0x7f09d006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 --2- 172.21.15.26:0/455037594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006baf0 0x7f09d006e7c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f09d00c0c10 tx=0x7f09b801c500 comp rx=0 tx=0).stop 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 -- 172.21.15.26:0/455037594 shutdown_connections 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 --2- 172.21.15.26:0/455037594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006baf0 0x7f09d006e7c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 --2- 172.21.15.26:0/455037594 >> v2:172.21.15.79:3300/0 conn(0x7f09d0155360 0x7f09d006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 -- 172.21.15.26:0/455037594 >> 172.21.15.26:0/455037594 conn(0x7f09d00c3240 msgr2=0x7f09d00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 -- 172.21.15.26:0/455037594 shutdown_connections 2023-11-28T16:56:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.806+0000 7f09d4879640 1 -- 172.21.15.26:0/455037594 wait complete. 2023-11-28T16:56:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 Processor -- start 2023-11-28T16:56:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 -- start start 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006baf0 0x7f09d0146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006ed00 0x7f09d014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d0155360 0x7f09d01f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d01ed790 con 0x7f09d006ed00 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014cd00 con 0x7f09d006baf0 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014f380 con 0x7f09d0155360 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006ed00 0x7f09d014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006ed00 0x7f09d014c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49560/0 (socket says 172.21.15.26:49560) 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 -- 172.21.15.26:0/2677371402 learned_addr learned my addr 172.21.15.26:0/2677371402 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09ce59c640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006baf0 0x7f09d0146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09ced9d640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d0155360 0x7f09d01f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 -- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d0155360 msgr2=0x7f09d01f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d0155360 0x7f09d01f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 -- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006baf0 msgr2=0x7f09d0146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006baf0 0x7f09d0146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 -- 172.21.15.26:0/2677371402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80094d0 con 0x7f09d006ed00 2023-11-28T16:56:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c7fff640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006ed00 0x7f09d014c010 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f09b8019110 tx=0x7f09b80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c6ffd640 1 -- 172.21.15.26:0/2677371402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80b4420 con 0x7f09d006ed00 2023-11-28T16:56:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c6ffd640 1 -- 172.21.15.26:0/2677371402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b80b4580 con 0x7f09d006ed00 2023-11-28T16:56:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09c6ffd640 1 -- 172.21.15.26:0/2677371402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80b48f0 con 0x7f09d006ed00 2023-11-28T16:56:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d01ecb30 con 0x7f09d006ed00 2023-11-28T16:56:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d01ed0d0 con 0x7f09d006ed00 2023-11-28T16:56:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.810+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d01ed8d0 con 0x7f09d006ed00 2023-11-28T16:56:50.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.814+0000 7f09c6ffd640 1 -- 172.21.15.26:0/2677371402 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f09b80b2070 con 0x7f09d006ed00 2023-11-28T16:56:50.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.814+0000 7f09c6ffd640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f09b00668d0 0x7f09b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:50.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.814+0000 7f09c6ffd640 1 -- 172.21.15.26:0/2677371402 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09b811d570 con 0x7f09d006ed00 2023-11-28T16:56:50.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.814+0000 7f09ce59c640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f09b00668d0 0x7f09b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:50.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.814+0000 7f09ce59c640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f09b00668d0 0x7f09b0068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009ac0 tx=0x7f09c0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:50.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:50.818+0000 7f09c6ffd640 1 -- 172.21.15.26:0/2677371402 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09b80ea7c0 con 0x7f09d006ed00 2023-11-28T16:56:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.006+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09d004e890 con 0x7f09d006ed00 2023-11-28T16:56:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.006+0000 7f09c6ffd640 1 -- 172.21.15.26:0/2677371402 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f09b80edde0 con 0x7f09d006ed00 2023-11-28T16:56:51.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:51.014 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f09b00668d0 msgr2=0x7f09b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f09b00668d0 0x7f09b0068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009ac0 tx=0x7f09c0009190 comp rx=0 tx=0).stop 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006ed00 msgr2=0x7f09d014c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006ed00 0x7f09d014c010 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f09b8019110 tx=0x7f09b80192a0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 shutdown_connections 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f09b00668d0 0x7f09b0068d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d0155360 0x7f09d01f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09d006ed00 0x7f09d014c010 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 --2- 172.21.15.26:0/2677371402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006baf0 0x7f09d0146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 >> 172.21.15.26:0/2677371402 conn(0x7f09d00c3240 msgr2=0x7f09d00c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 shutdown_connections 2023-11-28T16:56:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.010+0000 7f09d4879640 1 -- 172.21.15.26:0/2677371402 wait complete. 2023-11-28T16:56:51.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f324d479640 1 Processor -- start 2023-11-28T16:56:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f324d479640 1 -- start start 2023-11-28T16:56:51.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f324d479640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f324814e9d0 0x7f3248151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f324d479640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324806d320 con 0x7f3248070b80 2023-11-28T16:56:51.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f324d479640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480721b0 con 0x7f32480a8470 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f324d479640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480c2830 con 0x7f324814e9d0 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f323ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3248070b80 0x7f32480c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51890/0 (socket says 172.21.15.26:51890) 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f323ffff640 1 -- 172.21.15.26:0/4205804195 learned_addr learned my addr 172.21.15.26:0/4205804195 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f3246ffd640 1 --2- 172.21.15.26:0/4205804195 >> v2:172.21.15.79:3300/0 conn(0x7f324814e9d0 0x7f3248151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f32467fc640 1 -- 172.21.15.26:0/4205804195 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080196357 0 0) 0x7f324806d320 con 0x7f3248070b80 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f32467fc640 1 -- 172.21.15.26:0/4205804195 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234003530 con 0x7f3248070b80 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f3246ffd640 1 -- 172.21.15.26:0/4205804195 >> v1:172.21.15.79:6789/0 conn(0x7f32480a8470 legacy=0x7f324806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f32467fc640 1 -- 172.21.15.26:0/4205804195 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154222144 0 0) 0x7f32480721b0 con 0x7f32480a8470 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f3246ffd640 1 -- 172.21.15.26:0/4205804195 >> v1:172.21.15.26:6789/0 conn(0x7f3248070b80 legacy=0x7f32480c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.174+0000 7f3246ffd640 1 -- 172.21.15.26:0/4205804195 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248072450 con 0x7f324814e9d0 2023-11-28T16:56:51.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f3246ffd640 1 --2- 172.21.15.26:0/4205804195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324814e9d0 0x7f3248151e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f32380097c0 tx=0x7f323801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a050916391b2a2e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f32467fc640 1 -- 172.21.15.26:0/4205804195 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380ab600 con 0x7f324814e9d0 2023-11-28T16:56:51.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f32467fc640 1 -- 172.21.15.26:0/4205804195 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32380a7050 con 0x7f324814e9d0 2023-11-28T16:56:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f32467fc640 1 -- 172.21.15.26:0/4205804195 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380ab980 con 0x7f324814e9d0 2023-11-28T16:56:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f324d479640 1 -- 172.21.15.26:0/4205804195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324814e9d0 msgr2=0x7f3248151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f324d479640 1 --2- 172.21.15.26:0/4205804195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324814e9d0 0x7f3248151e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f32380097c0 tx=0x7f323801c3f0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f324d479640 1 -- 172.21.15.26:0/4205804195 shutdown_connections 2023-11-28T16:56:51.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f324d479640 1 --2- 172.21.15.26:0/4205804195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324814e9d0 0x7f3248151e60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f324d479640 1 -- 172.21.15.26:0/4205804195 >> 172.21.15.26:0/4205804195 conn(0x7f32480c2ad0 msgr2=0x7f32480c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:51.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f324d479640 1 -- 172.21.15.26:0/4205804195 shutdown_connections 2023-11-28T16:56:51.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.178+0000 7f324d479640 1 -- 172.21.15.26:0/4205804195 wait complete. 2023-11-28T16:56:51.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 Processor -- start 2023-11-28T16:56:51.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 -- start start 2023-11-28T16:56:51.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248070b80 0x7f3248148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32480a8470 0x7f32481498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f324814e9d0 0x7f32481f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32481f0690 con 0x7f324814e9d0 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32481ecbe0 con 0x7f3248070b80 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32481f0930 con 0x7f32480a8470 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f324814e9d0 0x7f32481f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f324814e9d0 0x7f32481f0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49570/0 (socket says 172.21.15.26:49570) 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 -- 172.21.15.26:0/1208947610 learned_addr learned my addr 172.21.15.26:0/1208947610 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f3246ffd640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248070b80 0x7f3248148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f323ffff640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32480a8470 0x7f32481498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 -- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32480a8470 msgr2=0x7f32481498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32480a8470 0x7f32481498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 -- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248070b80 msgr2=0x7f3248148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248070b80 0x7f3248148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 -- 172.21.15.26:0/1208947610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3238009420 con 0x7f324814e9d0 2023-11-28T16:56:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f32477fe640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f324814e9d0 0x7f32481f0150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3240002240 tx=0x7f324000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f323f7fe640 1 -- 172.21.15.26:0/1208947610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000cea0 con 0x7f324814e9d0 2023-11-28T16:56:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f323f7fe640 1 -- 172.21.15.26:0/1208947610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240003db0 con 0x7f324814e9d0 2023-11-28T16:56:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32481f0c10 con 0x7f324814e9d0 2023-11-28T16:56:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f323f7fe640 1 -- 172.21.15.26:0/1208947610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400052b0 con 0x7f324814e9d0 2023-11-28T16:56:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.182+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32481ecea0 con 0x7f324814e9d0 2023-11-28T16:56:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.186+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3248067a40 con 0x7f324814e9d0 2023-11-28T16:56:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.186+0000 7f323f7fe640 1 -- 172.21.15.26:0/1208947610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3240005410 con 0x7f324814e9d0 2023-11-28T16:56:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.186+0000 7f323f7fe640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3228066900 0x7f3228068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.186+0000 7f323f7fe640 1 -- 172.21.15.26:0/1208947610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3240083b80 con 0x7f324814e9d0 2023-11-28T16:56:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.186+0000 7f3246ffd640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3228066900 0x7f3228068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.186+0000 7f3246ffd640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3228066900 0x7f3228068dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32380ad000 tx=0x7f32380a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.190+0000 7f323f7fe640 1 -- 172.21.15.26:0/1208947610 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3240050f00 con 0x7f324814e9d0 2023-11-28T16:56:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.350+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32481ed0c0 con 0x7f324814e9d0 2023-11-28T16:56:51.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f323f7fe640 1 -- 172.21.15.26:0/1208947610 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f3240017070 con 0x7f324814e9d0 2023-11-28T16:56:51.359 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:51.359 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3228066900 msgr2=0x7f3228068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3228066900 0x7f3228068dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32380ad000 tx=0x7f32380a4f90 comp rx=0 tx=0).stop 2023-11-28T16:56:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f324814e9d0 msgr2=0x7f32481f0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f324814e9d0 0x7f32481f0150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3240002240 tx=0x7f324000cc50 comp rx=0 tx=0).stop 2023-11-28T16:56:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 shutdown_connections 2023-11-28T16:56:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f324814e9d0 0x7f32481f0150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3228066900 0x7f3228068dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32480a8470 0x7f32481498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 --2- 172.21.15.26:0/1208947610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248070b80 0x7f3248148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 >> 172.21.15.26:0/1208947610 conn(0x7f32480c2ad0 msgr2=0x7f32480c0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 shutdown_connections 2023-11-28T16:56:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.354+0000 7f324d479640 1 -- 172.21.15.26:0/1208947610 wait complete. 2023-11-28T16:56:51.380 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T16:56:51.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc18965640 1 Processor -- start 2023-11-28T16:56:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc18965640 1 -- start start 2023-11-28T16:56:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc18965640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc1414fcc0 0x7fdc14156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc18965640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc140c19e0 0x7fdc140c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc18965640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140ab580 con 0x7fdc1406d980 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc18965640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc140aa340 con 0x7fdc1414fcc0 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc18965640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc14152fe0 con 0x7fdc140c19e0 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc1259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc1414fcc0 0x7fdc14156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc1259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc1414fcc0 0x7fdc14156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51660/0 (socket says 172.21.15.26:51660) 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc1259c640 1 -- 172.21.15.26:0/1662523890 learned_addr learned my addr 172.21.15.26:0/1662523890 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.518+0000 7fdc12d9d640 1 --2- 172.21.15.26:0/1662523890 >> v2:172.21.15.79:3300/0 conn(0x7fdc140c19e0 0x7fdc140c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc1259c640 1 -- 172.21.15.26:0/1662523890 >> v2:172.21.15.79:3300/0 conn(0x7fdc140c19e0 msgr2=0x7fdc140c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc1259c640 1 --2- 172.21.15.26:0/1662523890 >> v2:172.21.15.79:3300/0 conn(0x7fdc140c19e0 0x7fdc140c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc1259c640 1 -- 172.21.15.26:0/1662523890 >> v1:172.21.15.79:6789/0 conn(0x7fdc1406d980 legacy=0x7fdc140aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc1259c640 1 -- 172.21.15.26:0/1662523890 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc141532c0 con 0x7fdc1414fcc0 2023-11-28T16:56:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc12d9d640 1 --2- 172.21.15.26:0/1662523890 >> v2:172.21.15.79:3300/0 conn(0x7fdc140c19e0 0x7fdc140c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc1259c640 1 --2- 172.21.15.26:0/1662523890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc1414fcc0 0x7fdc14156500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc140c3b30 tx=0x7fdc0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28f991ef8dfd3e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc11d9b640 1 -- 172.21.15.26:0/1662523890 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040ac640 con 0x7fdc1414fcc0 2023-11-28T16:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc11d9b640 1 -- 172.21.15.26:0/1662523890 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040ac7a0 con 0x7fdc1414fcc0 2023-11-28T16:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc11d9b640 1 -- 172.21.15.26:0/1662523890 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040acb30 con 0x7fdc1414fcc0 2023-11-28T16:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc18965640 1 -- 172.21.15.26:0/1662523890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc1414fcc0 msgr2=0x7fdc14156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.522+0000 7fdc18965640 1 --2- 172.21.15.26:0/1662523890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc1414fcc0 0x7fdc14156500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc140c3b30 tx=0x7fdc0401c4d0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- 172.21.15.26:0/1662523890 shutdown_connections 2023-11-28T16:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 --2- 172.21.15.26:0/1662523890 >> v2:172.21.15.79:3300/0 conn(0x7fdc140c19e0 0x7fdc140c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 --2- 172.21.15.26:0/1662523890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc1414fcc0 0x7fdc14156500 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- 172.21.15.26:0/1662523890 >> 172.21.15.26:0/1662523890 conn(0x7fdc140c2ad0 msgr2=0x7fdc140c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:51.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- 172.21.15.26:0/1662523890 shutdown_connections 2023-11-28T16:56:51.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- 172.21.15.26:0/1662523890 wait complete. 2023-11-28T16:56:51.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 Processor -- start 2023-11-28T16:56:51.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- start start 2023-11-28T16:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc1406d980 0x7fdc1406bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc140c19e0 0x7fdc1415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc141ece40 0x7fdc1415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14155450 con 0x7fdc141ece40 2023-11-28T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141535a0 con 0x7fdc140c19e0 2023-11-28T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc18965640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1415bf90 con 0x7fdc1406d980 2023-11-28T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc141ece40 0x7fdc1415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc141ece40 0x7fdc1415ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51662/0 (socket says 172.21.15.26:51662) 2023-11-28T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 -- 172.21.15.26:0/2253095472 learned_addr learned my addr 172.21.15.26:0/2253095472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc1259c640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc1406d980 0x7fdc1406bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc0bfff640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc140c19e0 0x7fdc1415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 -- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc1406d980 msgr2=0x7fdc1406bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc1406d980 0x7fdc1406bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 -- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc140c19e0 msgr2=0x7fdc1415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc140c19e0 0x7fdc1415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 -- 172.21.15.26:0/2253095472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040094d0 con 0x7fdc141ece40 2023-11-28T16:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc12d9d640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc141ece40 0x7fdc1415ba50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007ef0 tx=0x7fdc0c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.526+0000 7fdc0affd640 1 -- 172.21.15.26:0/2253095472 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c003ba0 con 0x7fdc141ece40 2023-11-28T16:56:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc0affd640 1 -- 172.21.15.26:0/2253095472 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c00f040 con 0x7fdc141ece40 2023-11-28T16:56:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc0affd640 1 -- 172.21.15.26:0/2253095472 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c00de80 con 0x7fdc141ece40 2023-11-28T16:56:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc141ed3b0 con 0x7fdc141ece40 2023-11-28T16:56:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc141ed970 con 0x7fdc141ece40 2023-11-28T16:56:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1406dd60 con 0x7fdc141ece40 2023-11-28T16:56:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc0affd640 1 -- 172.21.15.26:0/2253095472 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc0c004030 con 0x7fdc141ece40 2023-11-28T16:56:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc0affd640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdbf40668d0 0x7fdbf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc0affd640 1 -- 172.21.15.26:0/2253095472 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc0c0846c0 con 0x7fdc141ece40 2023-11-28T16:56:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc1259c640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdbf40668d0 0x7fdbf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.530+0000 7fdc1259c640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdbf40668d0 0x7fdbf4068d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc040ae000 tx=0x7fdc040a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.534+0000 7fdc0affd640 1 -- 172.21.15.26:0/2253095472 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc1406dd60 con 0x7fdc141ece40 2023-11-28T16:56:51.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc1406dd60 con 0x7fdc141ece40 2023-11-28T16:56:51.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc0affd640 1 -- 172.21.15.26:0/2253095472 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fdc1406dd60 con 0x7fdc141ece40 2023-11-28T16:56:51.732 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:51.732 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:51.732 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdbf40668d0 msgr2=0x7fdbf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdbf40668d0 0x7fdbf4068d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc040ae000 tx=0x7fdc040a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc141ece40 msgr2=0x7fdc1415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc141ece40 0x7fdc1415ba50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007ef0 tx=0x7fdc0c00d4a0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 shutdown_connections 2023-11-28T16:56:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc141ece40 0x7fdc1415ba50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc140c19e0 0x7fdc1415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdbf40668d0 0x7fdbf4068d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 --2- 172.21.15.26:0/2253095472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc1406d980 0x7fdc1406bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.726+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 >> 172.21.15.26:0/2253095472 conn(0x7fdc140c2ad0 msgr2=0x7fdc140c01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.730+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 shutdown_connections 2023-11-28T16:56:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.730+0000 7fdc18965640 1 -- 172.21.15.26:0/2253095472 wait complete. 2023-11-28T16:56:51.754 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:56:51.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 Processor -- start 2023-11-28T16:56:51.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 -- start start 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd80c14e9d0 0x7fd80c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c070b80 0x7fd80c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd80c0c1f20 0x7fd80c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c06d320 con 0x7fd80c14e9d0 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0721b0 con 0x7fd80c0c1f20 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd812e32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0c2830 con 0x7fd80c070b80 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd810bce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd80c14e9d0 0x7fd80c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd810bce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd80c14e9d0 0x7fd80c151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51672/0 (socket says 172.21.15.26:51672) 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd810bce640 1 -- 172.21.15.26:0/3676519082 learned_addr learned my addr 172.21.15.26:0/3676519082 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.890+0000 7fd80bfff640 1 --2- 172.21.15.26:0/3676519082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c070b80 0x7fd80c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd8113cf640 1 --2- 172.21.15.26:0/3676519082 >> v2:172.21.15.79:3300/0 conn(0x7fd80c0c1f20 0x7fd80c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd810bce640 1 -- 172.21.15.26:0/3676519082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c070b80 msgr2=0x7fd80c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd810bce640 1 --2- 172.21.15.26:0/3676519082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c070b80 0x7fd80c0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd810bce640 1 -- 172.21.15.26:0/3676519082 >> v2:172.21.15.79:3300/0 conn(0x7fd80c0c1f20 msgr2=0x7fd80c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd810bce640 1 --2- 172.21.15.26:0/3676519082 >> v2:172.21.15.79:3300/0 conn(0x7fd80c0c1f20 0x7fd80c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd810bce640 1 -- 172.21.15.26:0/3676519082 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c072450 con 0x7fd80c14e9d0 2023-11-28T16:56:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd810bce640 1 --2- 172.21.15.26:0/3676519082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c151e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0704f0 tx=0x7fd80001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58b337435954b2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd80b7fe640 1 -- 172.21.15.26:0/3676519082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000ab600 con 0x7fd80c14e9d0 2023-11-28T16:56:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd80b7fe640 1 -- 172.21.15.26:0/3676519082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8000a7050 con 0x7fd80c14e9d0 2023-11-28T16:56:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd80b7fe640 1 -- 172.21.15.26:0/3676519082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000ab980 con 0x7fd80c14e9d0 2023-11-28T16:56:51.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd812e32640 1 -- 172.21.15.26:0/3676519082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 msgr2=0x7fd80c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.894+0000 7fd812e32640 1 --2- 172.21.15.26:0/3676519082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c151e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0704f0 tx=0x7fd80001c470 comp rx=0 tx=0).stop 2023-11-28T16:56:51.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- 172.21.15.26:0/3676519082 shutdown_connections 2023-11-28T16:56:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 --2- 172.21.15.26:0/3676519082 >> v2:172.21.15.79:3300/0 conn(0x7fd80c0c1f20 0x7fd80c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 --2- 172.21.15.26:0/3676519082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c070b80 0x7fd80c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 --2- 172.21.15.26:0/3676519082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c151e60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- 172.21.15.26:0/3676519082 >> 172.21.15.26:0/3676519082 conn(0x7fd80c0c2ad0 msgr2=0x7fd80c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- 172.21.15.26:0/3676519082 shutdown_connections 2023-11-28T16:56:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- 172.21.15.26:0/3676519082 wait complete. 2023-11-28T16:56:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 Processor -- start 2023-11-28T16:56:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- start start 2023-11-28T16:56:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c070b80 0x7fd80c0c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c0c1f20 0x7fd80c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c1f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0abc90 con 0x7fd80c14e9d0 2023-11-28T16:56:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0c5230 con 0x7fd80c070b80 2023-11-28T16:56:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd812e32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0ab6d0 con 0x7fd80c0c1f20 2023-11-28T16:56:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c1f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c1f0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51684/0 (socket says 172.21.15.26:51684) 2023-11-28T16:56:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 -- 172.21.15.26:0/3051816136 learned_addr learned my addr 172.21.15.26:0/3051816136 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd80bfff640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c0c1f20 0x7fd80c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd810bce640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c070b80 0x7fd80c0c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 -- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c0c1f20 msgr2=0x7fd80c154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c0c1f20 0x7fd80c154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 -- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c070b80 msgr2=0x7fd80c0c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c070b80 0x7fd80c0c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:51.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.898+0000 7fd8113cf640 1 -- 172.21.15.26:0/3051816136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8000094d0 con 0x7fd80c14e9d0 2023-11-28T16:56:51.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd8113cf640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c1f0c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd804007e40 tx=0x7fd80400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd8097fa640 1 -- 172.21.15.26:0/3051816136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804014620 con 0x7fd80c14e9d0 2023-11-28T16:56:51.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd8097fa640 1 -- 172.21.15.26:0/3051816136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80400ee90 con 0x7fd80c14e9d0 2023-11-28T16:56:51.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd8097fa640 1 -- 172.21.15.26:0/3051816136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040149e0 con 0x7fd80c14e9d0 2023-11-28T16:56:51.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c0ab9b0 con 0x7fd80c14e9d0 2023-11-28T16:56:51.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c154570 con 0x7fd80c14e9d0 2023-11-28T16:56:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c0c4d00 con 0x7fd80c14e9d0 2023-11-28T16:56:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd8097fa640 1 -- 172.21.15.26:0/3051816136 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd804014b40 con 0x7fd80c14e9d0 2023-11-28T16:56:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd8097fa640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f00668d0 0x7fd7f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd8097fa640 1 -- 172.21.15.26:0/3051816136 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd804084cf0 con 0x7fd80c14e9d0 2023-11-28T16:56:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.902+0000 7fd810bce640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f00668d0 0x7fd7f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.906+0000 7fd810bce640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f00668d0 0x7fd7f0068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0c3980 tx=0x7fd800009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:51.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:51.906+0000 7fd8097fa640 1 -- 172.21.15.26:0/3051816136 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd804051fd0 con 0x7fd80c14e9d0 2023-11-28T16:56:52.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.098+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd80c0c53a0 con 0x7fd80c14e9d0 2023-11-28T16:56:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.098+0000 7fd8097fa640 1 -- 172.21.15.26:0/3051816136 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fd8040555f0 con 0x7fd80c14e9d0 2023-11-28T16:56:52.105 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:52.105 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2914447133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2914447133},{"type":"v1","addr":"172.21.15.79:6835","nonce":2914447133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/625353763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":625353763},{"type":"v1","addr":"172.21.15.26:6834","nonce":625353763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2894599517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2894599517},{"type":"v1","addr":"172.21.15.26:6835","nonce":2894599517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:56:17.653240+0000","modified":"2023-11-28T16:56:20.686573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2982577996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2982577996},{"type":"v1","addr":"172.21.15.79:6837","nonce":2982577996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T16:56:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-11-28T16:56:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f00668d0 msgr2=0x7fd7f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f00668d0 0x7fd7f0068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0c3980 tx=0x7fd800009040 comp rx=0 tx=0).stop 2023-11-28T16:56:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 msgr2=0x7fd80c1f0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c1f0c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd804007e40 tx=0x7fd80400e4b0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 shutdown_connections 2023-11-28T16:56:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd80c14e9d0 0x7fd80c1f0c30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f00668d0 0x7fd7f0068d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd80c0c1f20 0x7fd80c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 --2- 172.21.15.26:0/3051816136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c070b80 0x7fd80c0c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 >> 172.21.15.26:0/3051816136 conn(0x7fd80c0c2ad0 msgr2=0x7fd80c0bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 shutdown_connections 2023-11-28T16:56:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.102+0000 7fd812e32640 1 -- 172.21.15.26:0/3051816136 wait complete. 2023-11-28T16:56:52.126 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:56:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.262+0000 7f7023a9a640 1 Processor -- start 2023-11-28T16:56:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.262+0000 7f7023a9a640 1 -- start start 2023-11-28T16:56:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7023a9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7023a9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f701c070b80 0x7f701c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7023a9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f701c0c1f20 0x7f701c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7023a9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c06d320 con 0x7f701c070b80 2023-11-28T16:56:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7023a9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c0721b0 con 0x7f701c0c1f20 2023-11-28T16:56:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7023a9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0c2830 con 0x7f701c14e9d0 2023-11-28T16:56:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f701c070b80 0x7f701c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f701c070b80 0x7f701c0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51692/0 (socket says 172.21.15.26:51692) 2023-11-28T16:56:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 -- 172.21.15.26:0/646865857 learned_addr learned my addr 172.21.15.26:0/646865857 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021836640 1 --2- 172.21.15.26:0/646865857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7022037640 1 --2- 172.21.15.26:0/646865857 >> v2:172.21.15.79:3300/0 conn(0x7f701c0c1f20 0x7f701c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 -- 172.21.15.26:0/646865857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 msgr2=0x7f701c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 --2- 172.21.15.26:0/646865857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 -- 172.21.15.26:0/646865857 >> v2:172.21.15.79:3300/0 conn(0x7f701c0c1f20 msgr2=0x7f701c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 --2- 172.21.15.26:0/646865857 >> v2:172.21.15.79:3300/0 conn(0x7f701c0c1f20 0x7f701c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021035640 1 -- 172.21.15.26:0/646865857 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c072450 con 0x7f701c070b80 2023-11-28T16:56:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7021836640 1 --2- 172.21.15.26:0/646865857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.266+0000 7f7022037640 1 --2- 172.21.15.26:0/646865857 >> v2:172.21.15.79:3300/0 conn(0x7f701c0c1f20 0x7f701c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7021035640 1 --2- 172.21.15.26:0/646865857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c0c19e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f701c0704f0 tx=0x7f700c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9d88b78c81c859 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7020834640 1 -- 172.21.15.26:0/646865857 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c0a7ae0 con 0x7f701c070b80 2023-11-28T16:56:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7020834640 1 -- 172.21.15.26:0/646865857 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c0a7c40 con 0x7f701c070b80 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7020834640 1 -- 172.21.15.26:0/646865857 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c0af440 con 0x7f701c070b80 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- 172.21.15.26:0/646865857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 msgr2=0x7f701c0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 --2- 172.21.15.26:0/646865857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c0c19e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f701c0704f0 tx=0x7f700c01eb40 comp rx=0 tx=0).stop 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- 172.21.15.26:0/646865857 shutdown_connections 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 --2- 172.21.15.26:0/646865857 >> v2:172.21.15.79:3300/0 conn(0x7f701c0c1f20 0x7f701c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 --2- 172.21.15.26:0/646865857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c0c19e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 --2- 172.21.15.26:0/646865857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- 172.21.15.26:0/646865857 >> 172.21.15.26:0/646865857 conn(0x7f701c0c2ad0 msgr2=0x7f701c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- 172.21.15.26:0/646865857 shutdown_connections 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- 172.21.15.26:0/646865857 wait complete. 2023-11-28T16:56:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 Processor -- start 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- start start 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f701c0c1f20 0x7f701c1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c1470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c153240 con 0x7f701c070b80 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c1e9930 con 0x7f701c0c1f20 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.270+0000 7f7023a9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c1527d0 con 0x7f701c14e9d0 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c1482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51706/0 (socket says 172.21.15.26:51706) 2023-11-28T16:56:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 -- 172.21.15.26:0/1159310393 learned_addr learned my addr 172.21.15.26:0/1159310393 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021035640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f701c0c1f20 0x7f701c1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 -- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 msgr2=0x7f701c1470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c1470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 -- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f701c0c1f20 msgr2=0x7f701c1487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f701c0c1f20 0x7f701c1487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 -- 172.21.15.26:0/1159310393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c00b770 con 0x7f701c070b80 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021035640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f701c0c1f20 0x7f701c1487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7021836640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c1482b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f701800d800 tx=0x7f701800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f70127fc640 1 -- 172.21.15.26:0/1159310393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180096c0 con 0x7f701c070b80 2023-11-28T16:56:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f70127fc640 1 -- 172.21.15.26:0/1159310393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7018009820 con 0x7f701c070b80 2023-11-28T16:56:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f70127fc640 1 -- 172.21.15.26:0/1159310393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018009bd0 con 0x7f701c070b80 2023-11-28T16:56:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c154460 con 0x7f701c070b80 2023-11-28T16:56:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c1e9b40 con 0x7f701c070b80 2023-11-28T16:56:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c071fc0 con 0x7f701c070b80 2023-11-28T16:56:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.274+0000 7f70127fc640 1 -- 172.21.15.26:0/1159310393 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7018009d30 con 0x7f701c070b80 2023-11-28T16:56:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.278+0000 7f70127fc640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70000668d0 0x7f7000068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.278+0000 7f70127fc640 1 -- 172.21.15.26:0/1159310393 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7018084be0 con 0x7f701c070b80 2023-11-28T16:56:52.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.278+0000 7f7021035640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70000668d0 0x7f7000068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.278+0000 7f7021035640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70000668d0 0x7f7000068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f700c0b1000 tx=0x7f700c0a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:52.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.282+0000 7f70127fc640 1 -- 172.21.15.26:0/1159310393 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7018051d80 con 0x7f701c070b80 2023-11-28T16:56:52.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.438+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f701c04e890 con 0x7f701c070b80 2023-11-28T16:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.438+0000 7f70127fc640 1 -- 172.21.15.26:0/1159310393 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f70180553a0 con 0x7f701c070b80 2023-11-28T16:56:52.446 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:52.446 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:19.279204+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:56:15.704457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T16:56:16.649414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70000668d0 msgr2=0x7f7000068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70000668d0 0x7f7000068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f700c0b1000 tx=0x7f700c0a9070 comp rx=0 tx=0).stop 2023-11-28T16:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 msgr2=0x7f701c1482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c1482b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f701800d800 tx=0x7f701800dcc0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 shutdown_connections 2023-11-28T16:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70000668d0 0x7f7000068d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f701c14e9d0 0x7f701c1470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f701c0c1f20 0x7f701c1487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 --2- 172.21.15.26:0/1159310393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f701c070b80 0x7f701c1482b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 >> 172.21.15.26:0/1159310393 conn(0x7f701c0c2ad0 msgr2=0x7f701c0c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 shutdown_connections 2023-11-28T16:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.442+0000 7f7023a9a640 1 -- 172.21.15.26:0/1159310393 wait complete. 2023-11-28T16:56:52.467 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T16:56:52.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe293bf8640 1 Processor -- start 2023-11-28T16:56:52.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe293bf8640 1 -- start start 2023-11-28T16:56:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe293bf8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe28c06db80 0x7fe28c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe293bf8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c06bea0 con 0x7fe28c152ce0 2023-11-28T16:56:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe293bf8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c159550 con 0x7fe28c06d100 2023-11-28T16:56:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe293bf8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c159b10 con 0x7fe28c06db80 2023-11-28T16:56:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe291994640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe28c152ce0 0x7fe28c0700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46198/0 (socket says 172.21.15.26:46198) 2023-11-28T16:56:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe291994640 1 -- 172.21.15.26:0/1769396752 learned_addr learned my addr 172.21.15.26:0/1769396752 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305470841 0 0) 0x7fe28c06bea0 con 0x7fe28c152ce0 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe291193640 1 --2- 172.21.15.26:0/1769396752 >> v2:172.21.15.79:3300/0 conn(0x7fe28c06db80 0x7fe28c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe278003530 con 0x7fe28c152ce0 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180607805 0 0) 0x7fe278003530 con 0x7fe28c152ce0 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 >> v2:172.21.15.79:3300/0 conn(0x7fe28c06db80 msgr2=0x7fe28c06c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 --2- 172.21.15.26:0/1769396752 >> v2:172.21.15.79:3300/0 conn(0x7fe28c06db80 0x7fe28c06c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 >> v1:172.21.15.79:6789/0 conn(0x7fe28c06d100 legacy=0x7fe28c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c159830 con 0x7fe28c152ce0 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fe288001680 con 0x7fe28c152ce0 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 >> v1:172.21.15.26:6789/0 conn(0x7fe28c152ce0 legacy=0x7fe28c0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.606+0000 7fe290992640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278003980 0x7fe278003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2780047d0 0x7fe278004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe278005190 0x7fe27800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c159b10 con 0x7fe278005190 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27800c130 con 0x7fe2780047d0 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27800c2f0 con 0x7fe278003980 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe278005190 0x7fe27800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe291994640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278003980 0x7fe278003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe291193640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2780047d0 0x7fe278004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 -- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278003980 msgr2=0x7fe278003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:52.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278003980 0x7fe278003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 -- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2780047d0 msgr2=0x7fe278004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:52.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2780047d0 0x7fe278004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 -- 172.21.15.26:0/1769396752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278003530 con 0x7fe278005190 2023-11-28T16:56:52.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 -- 172.21.15.26:0/1769396752 reap_dead start 2023-11-28T16:56:52.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe292195640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe278005190 0x7fe27800b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe284001e70 tx=0x7fe28401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de4f8facf99d077 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:52.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284003b80 con 0x7fe278005190 2023-11-28T16:56:52.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284003d20 con 0x7fe278005190 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.610+0000 7fe290992640 1 -- 172.21.15.26:0/1769396752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284005310 con 0x7fe278005190 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- 172.21.15.26:0/1769396752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe278005190 msgr2=0x7fe27800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe278005190 0x7fe27800b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe284001e70 tx=0x7fe28401c760 comp rx=0 tx=0).stop 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- 172.21.15.26:0/1769396752 shutdown_connections 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 --2- 172.21.15.26:0/1769396752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe278005190 0x7fe27800b990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- 172.21.15.26:0/1769396752 >> 172.21.15.26:0/1769396752 conn(0x7fe28c0c2ad0 msgr2=0x7fe28c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- 172.21.15.26:0/1769396752 shutdown_connections 2023-11-28T16:56:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- 172.21.15.26:0/1769396752 wait complete. 2023-11-28T16:56:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 Processor -- start 2023-11-28T16:56:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- start start 2023-11-28T16:56:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278005190 0x7fe28c0aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe28c148fc0 0x7fe28c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe28c14b510 0x7fe28c14b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0aaff0 con 0x7fe28c148fc0 2023-11-28T16:56:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c14bf00 con 0x7fe28c14b510 2023-11-28T16:56:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe293bf8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0aa3c0 con 0x7fe278005190 2023-11-28T16:56:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe28c148fc0 0x7fe28c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe28c148fc0 0x7fe28c0c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51724/0 (socket says 172.21.15.26:51724) 2023-11-28T16:56:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 -- 172.21.15.26:0/3974570026 learned_addr learned my addr 172.21.15.26:0/3974570026 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291994640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278005190 0x7fe28c0aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe292195640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe28c14b510 0x7fe28c14b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 -- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278005190 msgr2=0x7fe28c0aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278005190 0x7fe28c0aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 -- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe28c14b510 msgr2=0x7fe28c14b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe28c14b510 0x7fe28c14b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe291193640 1 -- 172.21.15.26:0/3974570026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c0ab220 con 0x7fe28c148fc0 2023-11-28T16:56:52.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.614+0000 7fe292195640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe28c14b510 0x7fe28c14b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:52.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe291193640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe28c148fc0 0x7fe28c0c4e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe27c011960 tx=0x7fe27c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:52.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe2827fc640 1 -- 172.21.15.26:0/3974570026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c004240 con 0x7fe28c148fc0 2023-11-28T16:56:52.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe2827fc640 1 -- 172.21.15.26:0/3974570026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c0043a0 con 0x7fe28c148fc0 2023-11-28T16:56:52.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe2827fc640 1 -- 172.21.15.26:0/3974570026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00fa40 con 0x7fe28c148fc0 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c0ab500 con 0x7fe28c148fc0 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c0c53b0 con 0x7fe28c148fc0 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c04e890 con 0x7fe28c148fc0 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe2827fc640 1 -- 172.21.15.26:0/3974570026 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe27c00fba0 con 0x7fe28c148fc0 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe2827fc640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe270066900 0x7fe270068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe2827fc640 1 -- 172.21.15.26:0/3974570026 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe27c084a70 con 0x7fe28c148fc0 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.618+0000 7fe291994640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe270066900 0x7fe270068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.622+0000 7fe291994640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe270066900 0x7fe270068dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0c3b10 tx=0x7fe288000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:52.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.622+0000 7fe2827fc640 1 -- 172.21.15.26:0/3974570026 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe27c051c10 con 0x7fe28c148fc0 2023-11-28T16:56:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.814+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe28c06cee0 con 0x7fe28c148fc0 2023-11-28T16:56:52.822 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-11-28T16:56:52.818+0000 7fcd77275640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T16:56:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.818+0000 7fe2827fc640 1 -- 172.21.15.26:0/3974570026 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe27c023090 con 0x7fe28c148fc0 2023-11-28T16:56:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe270066900 msgr2=0x7fe270068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe270066900 0x7fe270068dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0c3b10 tx=0x7fe288000ee0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe28c148fc0 msgr2=0x7fe28c0c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe28c148fc0 0x7fe28c0c4e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe27c011960 tx=0x7fe27c011d60 comp rx=0 tx=0).stop 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 shutdown_connections 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe28c14b510 0x7fe28c14b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe28c148fc0 0x7fe28c0c4e70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe270066900 0x7fe270068dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 --2- 172.21.15.26:0/3974570026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe278005190 0x7fe28c0aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 >> 172.21.15.26:0/3974570026 conn(0x7fe28c0c2ad0 msgr2=0x7fe28c0c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 shutdown_connections 2023-11-28T16:56:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.822+0000 7fe293bf8640 1 -- 172.21.15.26:0/3974570026 wait complete. 2023-11-28T16:56:52.840 INFO:tasks.ceph.mds.b.smithi079.stderr: -5348> 2023-11-28T16:56:21.985+0000 7ff07850c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:56:52.847 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T16:56:52.890 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-11-28T16:56:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6b59e640 1 Processor -- start 2023-11-28T16:56:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6b59e640 1 -- start start 2023-11-28T16:56:52.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6b59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c6c0c24f0 0x7f9c6c0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6b59e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c6c0c3960 0x7f9c6c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:52.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6b59e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0c4420 con 0x7f9c6c0c0460 2023-11-28T16:56:52.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6b59e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0c1ac0 con 0x7f9c6c0c3960 2023-11-28T16:56:52.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6b59e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0a4ef0 con 0x7f9c6c0c24f0 2023-11-28T16:56:52.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c63fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c6c0c3960 0x7f9c6c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c63fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c6c0c3960 0x7f9c6c0c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51728/0 (socket says 172.21.15.26:51728) 2023-11-28T16:56:52.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c63fff640 1 -- 172.21.15.26:0/1936546424 learned_addr learned my addr 172.21.15.26:0/1936546424 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:52.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.986+0000 7f9c6a59c640 1 --2- 172.21.15.26:0/1936546424 >> v2:172.21.15.79:3300/0 conn(0x7f9c6c0c24f0 0x7f9c6c0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:52.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c63fff640 1 -- 172.21.15.26:0/1936546424 >> v2:172.21.15.79:3300/0 conn(0x7f9c6c0c24f0 msgr2=0x7f9c6c0c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:52.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c63fff640 1 --2- 172.21.15.26:0/1936546424 >> v2:172.21.15.79:3300/0 conn(0x7f9c6c0c24f0 0x7f9c6c0c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c63fff640 1 -- 172.21.15.26:0/1936546424 >> v1:172.21.15.79:6789/0 conn(0x7f9c6c0c0460 legacy=0x7f9c6c0c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c63fff640 1 -- 172.21.15.26:0/1936546424 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c1531a0 con 0x7f9c6c0c3960 2023-11-28T16:56:52.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c6a59c640 1 --2- 172.21.15.26:0/1936546424 >> v2:172.21.15.79:3300/0 conn(0x7f9c6c0c24f0 0x7f9c6c0c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:52.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c63fff640 1 --2- 172.21.15.26:0/1936546424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 0x7f9c6c0c48d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0c3330 tx=0x7f9c5401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb974b0aa56e78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:52.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c69d9b640 1 -- 172.21.15.26:0/1936546424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540ab5f0 con 0x7f9c6c0c3960 2023-11-28T16:56:52.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c69d9b640 1 -- 172.21.15.26:0/1936546424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540ab750 con 0x7f9c6c0c3960 2023-11-28T16:56:52.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c69d9b640 1 -- 172.21.15.26:0/1936546424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540abae0 con 0x7f9c6c0c3960 2023-11-28T16:56:52.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c6b59e640 1 -- 172.21.15.26:0/1936546424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 msgr2=0x7f9c6c0c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:52.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.990+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/1936546424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 0x7f9c6c0c48d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0c3330 tx=0x7f9c5401c500 comp rx=0 tx=0).stop 2023-11-28T16:56:52.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- 172.21.15.26:0/1936546424 shutdown_connections 2023-11-28T16:56:52.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/1936546424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 0x7f9c6c0c48d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/1936546424 >> v2:172.21.15.79:3300/0 conn(0x7f9c6c0c24f0 0x7f9c6c0c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:52.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- 172.21.15.26:0/1936546424 >> 172.21.15.26:0/1936546424 conn(0x7f9c6c06a5a0 msgr2=0x7f9c6c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:52.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- 172.21.15.26:0/1936546424 shutdown_connections 2023-11-28T16:56:52.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- 172.21.15.26:0/1936546424 wait complete. 2023-11-28T16:56:53.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 Processor -- start 2023-11-28T16:56:53.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- start start 2023-11-28T16:56:53.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c6c0c0460 0x7f9c6c0ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:53.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c0c24f0 0x7f9c6c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:53.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 0x7f9c6c154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:53.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0bc500 con 0x7f9c6c0c3960 2023-11-28T16:56:53.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0bc7e0 con 0x7f9c6c0c0460 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6b59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c15bca0 con 0x7f9c6c0c24f0 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c6c0c0460 0x7f9c6c0ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c6c0c0460 0x7f9c6c0ab710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:38542/0 (socket says 172.21.15.26:38542) 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 -- 172.21.15.26:0/2926853091 learned_addr learned my addr 172.21.15.26:0/2926853091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c63fff640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c0c24f0 0x7f9c6c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 0x7f9c6c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 -- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c0c24f0 msgr2=0x7f9c6c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c0c24f0 0x7f9c6c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 -- 172.21.15.26:0/2926853091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 msgr2=0x7f9c6c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:53.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 0x7f9c6c154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:53.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 -- 172.21.15.26:0/2926853091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540094d0 con 0x7f9c6c0c0460 2023-11-28T16:56:53.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.994+0000 7f9c6a59c640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c6c0c0460 0x7f9c6c0ab710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e810 tx=0x7f9c5c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:53.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c62ffd640 1 -- 172.21.15.26:0/2926853091 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00c8d0 con 0x7f9c6c0c0460 2023-11-28T16:56:53.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c62ffd640 1 -- 172.21.15.26:0/2926853091 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00ca30 con 0x7f9c6c0c0460 2023-11-28T16:56:53.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c62ffd640 1 -- 172.21.15.26:0/2926853091 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00cde0 con 0x7f9c6c0c0460 2023-11-28T16:56:53.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c15bf80 con 0x7f9c6c0c0460 2023-11-28T16:56:53.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c0c5270 con 0x7f9c6c0c0460 2023-11-28T16:56:53.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c0680c0 con 0x7f9c6c0c0460 2023-11-28T16:56:53.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c62ffd640 1 -- 172.21.15.26:0/2926853091 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c5c03a490 con 0x7f9c6c0c0460 2023-11-28T16:56:53.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c62ffd640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9c4c0668d0 0x7f9c4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:53.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c62ffd640 1 -- 172.21.15.26:0/2926853091 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9c5c0843d0 con 0x7f9c6c0c0460 2023-11-28T16:56:53.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:52.998+0000 7f9c63fff640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9c4c0668d0 0x7f9c4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:53.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.002+0000 7f9c63fff640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9c4c0668d0 0x7f9c4c068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af000 tx=0x7f9c540a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:53.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.002+0000 7f9c62ffd640 1 -- 172.21.15.26:0/2926853091 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c5c0516d0 con 0x7f9c6c0c0460 2023-11-28T16:56:53.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.194+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9c6c074970 con 0x7f9c6c0c0460 2023-11-28T16:56:53.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c62ffd640 1 -- 172.21.15.26:0/2926853091 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9c5c05b020 con 0x7f9c6c0c0460 2023-11-28T16:56:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9c4c0668d0 msgr2=0x7f9c4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9c4c0668d0 0x7f9c4c068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af000 tx=0x7f9c540a7000 comp rx=0 tx=0).stop 2023-11-28T16:56:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c6c0c0460 msgr2=0x7f9c6c0ab710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c6c0c0460 0x7f9c6c0ab710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e810 tx=0x7f9c5c00ecd0 comp rx=0 tx=0).stop 2023-11-28T16:56:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 shutdown_connections 2023-11-28T16:56:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c6c0c3960 0x7f9c6c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9c4c0668d0 0x7f9c4c068d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c0c24f0 0x7f9c6c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:53.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 --2- 172.21.15.26:0/2926853091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c6c0c0460 0x7f9c6c0ab710 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:53.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 >> 172.21.15.26:0/2926853091 conn(0x7f9c6c06a5a0 msgr2=0x7f9c6c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:53.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 shutdown_connections 2023-11-28T16:56:53.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.826+0000 7f9c6b59e640 1 -- 172.21.15.26:0/2926853091 wait complete. 2023-11-28T16:56:53.855 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T16:56:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30fb79d640 1 Processor -- start 2023-11-28T16:56:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30fb79d640 1 -- start start 2023-11-28T16:56:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30fb79d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30fb79d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30f41562e0 0x7f30f406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30fb79d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f40abb60 con 0x7f30f4156740 2023-11-28T16:56:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30fb79d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f406c7a0 con 0x7f30f41562e0 2023-11-28T16:56:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30fb79d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40abdb0 con 0x7f30f4155f00 2023-11-28T16:56:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f8d38640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30f41562e0 0x7f30f406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f8d38640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30f41562e0 0x7f30f406cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51752/0 (socket says 172.21.15.26:51752) 2023-11-28T16:56:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f9d3a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f30f4156740 0x7f30f40c2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46202/0 (socket says 172.21.15.26:46202) 2023-11-28T16:56:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f8d38640 1 -- 172.21.15.26:0/2751419398 learned_addr learned my addr 172.21.15.26:0/2751419398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f9539640 1 --2- 172.21.15.26:0/2751419398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f8d38640 1 -- 172.21.15.26:0/2751419398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 msgr2=0x7f30f40a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f8d38640 1 --2- 172.21.15.26:0/2751419398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f8d38640 1 -- 172.21.15.26:0/2751419398 >> v1:172.21.15.26:6789/0 conn(0x7f30f4156740 legacy=0x7f30f40c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30ebfff640 1 -- 172.21.15.26:0/2751419398 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056801377 0 0) 0x7f30f40abb60 con 0x7f30f4156740 2023-11-28T16:56:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:53.998+0000 7f30f8d38640 1 -- 172.21.15.26:0/2751419398 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40ac090 con 0x7f30f41562e0 2023-11-28T16:56:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30f8d38640 1 --2- 172.21.15.26:0/2751419398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f41562e0 0x7f30f406cf10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009870 tx=0x7f30e401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a271b3d9a3e8fd30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30ebfff640 1 -- 172.21.15.26:0/2751419398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40ab600 con 0x7f30f41562e0 2023-11-28T16:56:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30ebfff640 1 -- 172.21.15.26:0/2751419398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e40a7050 con 0x7f30f41562e0 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30ebfff640 1 -- 172.21.15.26:0/2751419398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40ab980 con 0x7f30f41562e0 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 -- 172.21.15.26:0/2751419398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f41562e0 msgr2=0x7f30f406cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 --2- 172.21.15.26:0/2751419398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f41562e0 0x7f30f406cf10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009870 tx=0x7f30e401c4b0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 -- 172.21.15.26:0/2751419398 shutdown_connections 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 --2- 172.21.15.26:0/2751419398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f41562e0 0x7f30f406cf10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 --2- 172.21.15.26:0/2751419398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 -- 172.21.15.26:0/2751419398 >> 172.21.15.26:0/2751419398 conn(0x7f30f406a5a0 msgr2=0x7f30f406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 -- 172.21.15.26:0/2751419398 shutdown_connections 2023-11-28T16:56:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.002+0000 7f30fb79d640 1 -- 172.21.15.26:0/2751419398 wait complete. 2023-11-28T16:56:54.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 Processor -- start 2023-11-28T16:56:54.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 -- start start 2023-11-28T16:56:54.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40bba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f41562e0 0x7f30f40bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f4156740 0x7f30f4148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4151f30 con 0x7f30f4156740 2023-11-28T16:56:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40bc810 con 0x7f30f41562e0 2023-11-28T16:56:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40bb730 con 0x7f30f4155f00 2023-11-28T16:56:54.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f4156740 0x7f30f4148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f4156740 0x7f30f4148440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51762/0 (socket says 172.21.15.26:51762) 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 -- 172.21.15.26:0/827585497 learned_addr learned my addr 172.21.15.26:0/827585497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9539640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f8d38640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f41562e0 0x7f30f40bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 -- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 msgr2=0x7f30f40bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 -- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f41562e0 msgr2=0x7f30f40bc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f41562e0 0x7f30f40bc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 -- 172.21.15.26:0/827585497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40094d0 con 0x7f30f4156740 2023-11-28T16:56:54.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30f9d3a640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f4156740 0x7f30f4148440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c7a0 tx=0x7f30ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:54.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30e9ffb640 1 -- 172.21.15.26:0/827585497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00a640 con 0x7f30f4156740 2023-11-28T16:56:54.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30e9ffb640 1 -- 172.21.15.26:0/827585497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec00a7a0 con 0x7f30f4156740 2023-11-28T16:56:54.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30e9ffb640 1 -- 172.21.15.26:0/827585497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00abd0 con 0x7f30f4156740 2023-11-28T16:56:54.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.006+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f4152180 con 0x7f30f4156740 2023-11-28T16:56:54.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.010+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f4149170 con 0x7f30f4156740 2023-11-28T16:56:54.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.010+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f404e890 con 0x7f30f4156740 2023-11-28T16:56:54.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.010+0000 7f30e9ffb640 1 -- 172.21.15.26:0/827585497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f30ec00ad30 con 0x7f30f4156740 2023-11-28T16:56:54.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.010+0000 7f30e9ffb640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f30d80668d0 0x7f30d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:54.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.010+0000 7f30e9ffb640 1 -- 172.21.15.26:0/827585497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f30ec0839a0 con 0x7f30f4156740 2023-11-28T16:56:54.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.010+0000 7f30f9539640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f30d80668d0 0x7f30d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:54.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.014+0000 7f30f9539640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f30d80668d0 0x7f30d8068d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009ac0 tx=0x7f30f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:54.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.014+0000 7f30e9ffb640 1 -- 172.21.15.26:0/827585497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30ec050c20 con 0x7f30f4156740 2023-11-28T16:56:54.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.174+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f30f40bbf80 con 0x7f30f4156740 2023-11-28T16:56:54.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.822+0000 7f30e9ffb640 1 -- 172.21.15.26:0/827585497 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f30ec018070 con 0x7f30f4156740 2023-11-28T16:56:54.829 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-11-28T16:56:54.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f30d80668d0 msgr2=0x7f30d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:54.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f30d80668d0 0x7f30d8068d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009ac0 tx=0x7f30f0009190 comp rx=0 tx=0).stop 2023-11-28T16:56:54.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f4156740 msgr2=0x7f30f4148440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:54.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f4156740 0x7f30f4148440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c7a0 tx=0x7f30ec00cc60 comp rx=0 tx=0).stop 2023-11-28T16:56:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 shutdown_connections 2023-11-28T16:56:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f4156740 0x7f30f4148440 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f41562e0 0x7f30f40bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f30d80668d0 0x7f30d8068d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 --2- 172.21.15.26:0/827585497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30f4155f00 0x7f30f40bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 >> 172.21.15.26:0/827585497 conn(0x7f30f406a5a0 msgr2=0x7f30f40ab030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 shutdown_connections 2023-11-28T16:56:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:54.826+0000 7f30fb79d640 1 -- 172.21.15.26:0/827585497 wait complete. 2023-11-28T16:56:54.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T16:56:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.014+0000 7f56036fe640 1 Processor -- start 2023-11-28T16:56:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.014+0000 7f56036fe640 1 -- start start 2023-11-28T16:56:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.014+0000 7f56036fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55fc0c2000 0x7f55fc070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.014+0000 7f56036fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c0330 0x7f55fc154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.014+0000 7f56036fe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc071510 con 0x7f55fc1588c0 2023-11-28T16:56:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.014+0000 7f56036fe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc06b3e0 con 0x7f55fc0c2000 2023-11-28T16:56:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.014+0000 7f56036fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc071d70 con 0x7f55fc0c0330 2023-11-28T16:56:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f5600c99640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c0330 0x7f55fc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f560149a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55fc0c2000 0x7f55fc070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f560149a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55fc0c2000 0x7f55fc070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:38562/0 (socket says 172.21.15.26:38562) 2023-11-28T16:56:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f5601c9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f55fc1588c0 0x7f55fc151b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39784/0 (socket says 172.21.15.26:39784) 2023-11-28T16:56:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f560149a640 1 -- 172.21.15.26:0/3872823850 learned_addr learned my addr 172.21.15.26:0/3872823850 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f5600c99640 1 -- 172.21.15.26:0/3872823850 >> v2:172.21.15.79:3300/0 conn(0x7f55fc0c2000 msgr2=0x7f55fc070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f5600c99640 1 --2- 172.21.15.26:0/3872823850 >> v2:172.21.15.79:3300/0 conn(0x7f55fc0c2000 0x7f55fc070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f5600c99640 1 -- 172.21.15.26:0/3872823850 >> v1:172.21.15.79:6789/0 conn(0x7f55fc1588c0 legacy=0x7f55fc151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f55f3fff640 1 -- 172.21.15.26:0/3872823850 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663593139 0 0) 0x7f55fc071510 con 0x7f55fc1588c0 2023-11-28T16:56:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f5600c99640 1 -- 172.21.15.26:0/3872823850 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0717b0 con 0x7f55fc0c0330 2023-11-28T16:56:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.018+0000 7f560149a640 1 --2- 172.21.15.26:0/3872823850 >> v2:172.21.15.79:3300/0 conn(0x7f55fc0c2000 0x7f55fc070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f5600c99640 1 --2- 172.21.15.26:0/3872823850 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c0330 0x7f55fc154930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0097c0 tx=0x7f55ec01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca59ddecfa8dcd8f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f55f3fff640 1 -- 172.21.15.26:0/3872823850 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0ab650 con 0x7f55fc0c0330 2023-11-28T16:56:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f55f3fff640 1 -- 172.21.15.26:0/3872823850 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0ab7b0 con 0x7f55fc0c0330 2023-11-28T16:56:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f55f3fff640 1 -- 172.21.15.26:0/3872823850 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0abb40 con 0x7f55fc0c0330 2023-11-28T16:56:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- 172.21.15.26:0/3872823850 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c0330 msgr2=0x7f55fc154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 --2- 172.21.15.26:0/3872823850 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c0330 0x7f55fc154930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0097c0 tx=0x7f55ec01c450 comp rx=0 tx=0).stop 2023-11-28T16:56:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- 172.21.15.26:0/3872823850 shutdown_connections 2023-11-28T16:56:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 --2- 172.21.15.26:0/3872823850 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c0330 0x7f55fc154930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 --2- 172.21.15.26:0/3872823850 >> v2:172.21.15.79:3300/0 conn(0x7f55fc0c2000 0x7f55fc070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- 172.21.15.26:0/3872823850 >> 172.21.15.26:0/3872823850 conn(0x7f55fc06a5a0 msgr2=0x7f55fc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- 172.21.15.26:0/3872823850 shutdown_connections 2023-11-28T16:56:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- 172.21.15.26:0/3872823850 wait complete. 2023-11-28T16:56:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 Processor -- start 2023-11-28T16:56:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- start start 2023-11-28T16:56:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0c0330 0x7f55fc1f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c2000 0x7f55fc155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55fc1588c0 0x7f55fc156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1567a0 con 0x7f55fc1588c0 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1f1410 con 0x7f55fc0c0330 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f56036fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1f16f0 con 0x7f55fc0c2000 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f5601c9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55fc1588c0 0x7f55fc156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f560149a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0c0330 0x7f55fc1f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f5601c9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55fc1588c0 0x7f55fc156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51764/0 (socket says 172.21.15.26:51764) 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f5601c9b640 1 -- 172.21.15.26:0/4067707432 learned_addr learned my addr 172.21.15.26:0/4067707432 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.022+0000 7f5600c99640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c2000 0x7f55fc155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f5600c99640 1 -- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0c0330 msgr2=0x7f55fc1f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f5600c99640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0c0330 0x7f55fc1f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f5600c99640 1 -- 172.21.15.26:0/4067707432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55fc1588c0 msgr2=0x7f55fc156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f5600c99640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55fc1588c0 0x7f55fc156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f5600c99640 1 -- 172.21.15.26:0/4067707432 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80094d0 con 0x7f55fc0c2000 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f5601c9b640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55fc1588c0 0x7f55fc156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f5600c99640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c2000 0x7f55fc155d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0ac000 tx=0x7f55ec01ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f55f1ffb640 1 -- 172.21.15.26:0/4067707432 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0bf610 con 0x7f55fc0c2000 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f55f1ffb640 1 -- 172.21.15.26:0/4067707432 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0bf770 con 0x7f55fc0c2000 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f55f1ffb640 1 -- 172.21.15.26:0/4067707432 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0bfb20 con 0x7f55fc0c2000 2023-11-28T16:56:55.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec009420 con 0x7f55fc0c2000 2023-11-28T16:56:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc154820 con 0x7f55fc0c2000 2023-11-28T16:56:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc152f80 con 0x7f55fc0c2000 2023-11-28T16:56:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.026+0000 7f55f1ffb640 1 -- 172.21.15.26:0/4067707432 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f55ec0b5400 con 0x7f55fc0c2000 2023-11-28T16:56:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.030+0000 7f55f1ffb640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55e0066920 0x7f55e0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.030+0000 7f55f1ffb640 1 -- 172.21.15.26:0/4067707432 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f55ec11f620 con 0x7f55fc0c2000 2023-11-28T16:56:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.030+0000 7f560149a640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55e0066920 0x7f55e0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:55.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.030+0000 7f560149a640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55e0066920 0x7f55e0068de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06dea0 tx=0x7f55f8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:55.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.030+0000 7f55f1ffb640 1 -- 172.21.15.26:0/4067707432 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55ec0ecc00 con 0x7f55fc0c2000 2023-11-28T16:56:55.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.190+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55fc1f1550 con 0x7f55fc0c2000 2023-11-28T16:56:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.830+0000 7f55f1ffb640 1 -- 172.21.15.26:0/4067707432 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55fc1f1550 con 0x7f55fc0c2000 2023-11-28T16:56:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-11-28T16:56:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55e0066920 msgr2=0x7f55e0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55e0066920 0x7f55e0068de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06dea0 tx=0x7f55f8009240 comp rx=0 tx=0).stop 2023-11-28T16:56:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c2000 msgr2=0x7f55fc155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c2000 0x7f55fc155d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0ac000 tx=0x7f55ec01ac90 comp rx=0 tx=0).stop 2023-11-28T16:56:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 shutdown_connections 2023-11-28T16:56:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55fc1588c0 0x7f55fc156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55e0066920 0x7f55e0068de0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55fc0c2000 0x7f55fc155d20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 --2- 172.21.15.26:0/4067707432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0c0330 0x7f55fc1f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:55.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 >> 172.21.15.26:0/4067707432 conn(0x7f55fc06a5a0 msgr2=0x7f55fc0bf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:55.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 shutdown_connections 2023-11-28T16:56:55.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:55.834+0000 7f56036fe640 1 -- 172.21.15.26:0/4067707432 wait complete. 2023-11-28T16:56:55.872 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T16:56:55.873 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T16:56:55.873 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T16:56:55.873 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:56:55.873 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T16:56:55.873 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T16:56:55.874 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T16:56:55.874 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:56:55.874 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T16:56:55.874 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T16:56:55.875 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T16:56:55.875 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:56:55.875 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T16:56:55.875 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T16:56:55.876 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T16:56:55.876 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:56:55.890 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T16:56:55.890 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T16:56:55.892 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T16:56:55.892 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T16:56:55.893 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T16:56:55.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T16:56:55.896 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T16:56:55.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T16:56:55.940 INFO:tasks.ceph.mds.c:Started 2023-11-28T16:56:55.941 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:55.942 INFO:tasks.ceph.mds.d:Started 2023-11-28T16:56:55.942 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:55.943 INFO:tasks.ceph.mds.a:Started 2023-11-28T16:56:55.943 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:55.944 INFO:tasks.ceph.mds.b:Started 2023-11-28T16:56:55.944 DEBUG:teuthology.parallel:result is None 2023-11-28T16:56:55.945 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T16:56:56.029 INFO:tasks.ceph.mds.d.smithi079.stdout:starting mds.d at 2023-11-28T16:56:56.029 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-11-28T16:56:56.031 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-11-28T16:56:56.032 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-11-28T16:56:56.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e7417640 1 Processor -- start 2023-11-28T16:56:56.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e7417640 1 -- start start 2023-11-28T16:56:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e7417640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14e00aacd0 0x7f14e0154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e7417640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f14e00ab7a0 0x7f14e01546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:56.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e7417640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e0072780 con 0x7f14e00700a0 2023-11-28T16:56:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e7417640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00ac160 con 0x7f14e00aacd0 2023-11-28T16:56:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e7417640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00abe80 con 0x7f14e00ab7a0 2023-11-28T16:56:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e51b3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14e00aacd0 0x7f14e0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e49b2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f14e00700a0 0x7f14e006c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46206/0 (socket says 172.21.15.26:46206) 2023-11-28T16:56:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e49b2640 1 -- 172.21.15.26:0/3304758725 learned_addr learned my addr 172.21.15.26:0/3304758725 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:56.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e59b4640 1 --2- 172.21.15.26:0/3304758725 >> v2:172.21.15.79:3300/0 conn(0x7f14e00ab7a0 0x7f14e01546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e51b3640 1 -- 172.21.15.26:0/3304758725 >> v2:172.21.15.79:3300/0 conn(0x7f14e00ab7a0 msgr2=0x7f14e01546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e51b3640 1 --2- 172.21.15.26:0/3304758725 >> v2:172.21.15.79:3300/0 conn(0x7f14e00ab7a0 0x7f14e01546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e51b3640 1 -- 172.21.15.26:0/3304758725 >> v1:172.21.15.26:6789/0 conn(0x7f14e00700a0 legacy=0x7f14e006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:56.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.090+0000 7f14e51b3640 1 -- 172.21.15.26:0/3304758725 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0154cf0 con 0x7f14e00aacd0 2023-11-28T16:56:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e51b3640 1 --2- 172.21.15.26:0/3304758725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00aacd0 0x7f14e0154160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f14e0070030 tx=0x7f14dc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3711aa70f553d373 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14d7fff640 1 -- 172.21.15.26:0/3304758725 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0ac600 con 0x7f14e00aacd0 2023-11-28T16:56:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14d7fff640 1 -- 172.21.15.26:0/3304758725 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0a8050 con 0x7f14e00aacd0 2023-11-28T16:56:56.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14d7fff640 1 -- 172.21.15.26:0/3304758725 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0ac980 con 0x7f14e00aacd0 2023-11-28T16:56:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 -- 172.21.15.26:0/3304758725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00aacd0 msgr2=0x7f14e0154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 --2- 172.21.15.26:0/3304758725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00aacd0 0x7f14e0154160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f14e0070030 tx=0x7f14dc01c3a0 comp rx=0 tx=0).stop 2023-11-28T16:56:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 -- 172.21.15.26:0/3304758725 shutdown_connections 2023-11-28T16:56:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 --2- 172.21.15.26:0/3304758725 >> v2:172.21.15.79:3300/0 conn(0x7f14e00ab7a0 0x7f14e01546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:56.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 --2- 172.21.15.26:0/3304758725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00aacd0 0x7f14e0154160 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:56.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 -- 172.21.15.26:0/3304758725 >> 172.21.15.26:0/3304758725 conn(0x7f14e00c2ad0 msgr2=0x7f14e00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:56.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 -- 172.21.15.26:0/3304758725 shutdown_connections 2023-11-28T16:56:56.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.094+0000 7f14e7417640 1 -- 172.21.15.26:0/3304758725 wait complete. 2023-11-28T16:56:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 Processor -- start 2023-11-28T16:56:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 -- start start 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14e00700a0 0x7f14e014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14e00aacd0 0x7f14e01f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00ab7a0 0x7f14e01f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e01515d0 con 0x7f14e00ab7a0 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e014eb40 con 0x7f14e00700a0 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e014ee20 con 0x7f14e00aacd0 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00ab7a0 0x7f14e01f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00ab7a0 0x7f14e01f0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51824/0 (socket says 172.21.15.26:51824) 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 -- 172.21.15.26:0/2438746070 learned_addr learned my addr 172.21.15.26:0/2438746070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e51b3640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14e00700a0 0x7f14e014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e49b2640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14e00aacd0 0x7f14e01f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 -- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14e00aacd0 msgr2=0x7f14e01f00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14e00aacd0 0x7f14e01f00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 -- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14e00700a0 msgr2=0x7f14e014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14e00700a0 0x7f14e014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 -- 172.21.15.26:0/2438746070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc009420 con 0x7f14e00ab7a0 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e51b3640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14e00700a0 0x7f14e014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e49b2640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14e00aacd0 0x7f14e01f00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e59b4640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00ab7a0 0x7f14e01f0630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f14d800efc0 tx=0x7f14d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14d5ffb640 1 -- 172.21.15.26:0/2438746070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8014480 con 0x7f14e00ab7a0 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14d5ffb640 1 -- 172.21.15.26:0/2438746070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800f040 con 0x7f14e00ab7a0 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e014f100 con 0x7f14e00ab7a0 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14d5ffb640 1 -- 172.21.15.26:0/2438746070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8014820 con 0x7f14e00ab7a0 2023-11-28T16:56:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e014b2f0 con 0x7f14e00ab7a0 2023-11-28T16:56:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.098+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e0152270 con 0x7f14e00ab7a0 2023-11-28T16:56:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.102+0000 7f14d5ffb640 1 -- 172.21.15.26:0/2438746070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f14d8014980 con 0x7f14e00ab7a0 2023-11-28T16:56:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.102+0000 7f14d5ffb640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f14c4066900 0x7f14c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.102+0000 7f14d5ffb640 1 -- 172.21.15.26:0/2438746070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f14d8084c90 con 0x7f14e00ab7a0 2023-11-28T16:56:56.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.102+0000 7f14e51b3640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f14c4066900 0x7f14c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:56.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.102+0000 7f14e51b3640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f14c4066900 0x7f14c4068dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0ae000 tx=0x7f14dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:56.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.106+0000 7f14d5ffb640 1 -- 172.21.15.26:0/2438746070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14e0152270 con 0x7f14e00ab7a0 2023-11-28T16:56:56.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:56.274+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f14e0152270 con 0x7f14e00ab7a0 2023-11-28T16:56:57.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.466+0000 7f14d5ffb640 1 -- 172.21.15.26:0/2438746070 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f14e0152270 con 0x7f14e00ab7a0 2023-11-28T16:56:57.472 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f14c4066900 msgr2=0x7f14c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f14c4066900 0x7f14c4068dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0ae000 tx=0x7f14dc008040 comp rx=0 tx=0).stop 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00ab7a0 msgr2=0x7f14e01f0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00ab7a0 0x7f14e01f0630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f14d800efc0 tx=0x7f14d800c490 comp rx=0 tx=0).stop 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 shutdown_connections 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e00ab7a0 0x7f14e01f0630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f14c4066900 0x7f14c4068dc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14e00aacd0 0x7f14e01f00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 --2- 172.21.15.26:0/2438746070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14e00700a0 0x7f14e014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 >> 172.21.15.26:0/2438746070 conn(0x7f14e00c2ad0 msgr2=0x7f14e00704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:57.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 shutdown_connections 2023-11-28T16:56:57.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.470+0000 7f14e7417640 1 -- 172.21.15.26:0/2438746070 wait complete. 2023-11-28T16:56:57.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T16:56:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.642+0000 7f92a15df640 1 Processor -- start 2023-11-28T16:56:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.642+0000 7f92a15df640 1 -- start start 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f92a15df640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f929c06a5a0 0x7f929c0c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f92a15df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f929c0c0c20 0x7f929c06a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f92a15df640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c1551d0 con 0x7f929c0c1ae0 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f92a15df640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c06e9c0 con 0x7f929c06a5a0 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f92a15df640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0a86e0 con 0x7f929c0c0c20 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f929c06a5a0 0x7f929c0c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f9293fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f929c0c1ae0 0x7f929c0c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46214/0 (socket says 172.21.15.26:46214) 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f9293fff640 1 -- 172.21.15.26:0/3277997051 learned_addr learned my addr 172.21.15.26:0/3277997051 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929b7fe640 1 --2- 172.21.15.26:0/3277997051 >> v2:172.21.15.79:3300/0 conn(0x7f929c0c0c20 0x7f929c06a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929affd640 1 -- 172.21.15.26:0/3277997051 >> v2:172.21.15.79:3300/0 conn(0x7f929c0c0c20 msgr2=0x7f929c06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929affd640 1 --2- 172.21.15.26:0/3277997051 >> v2:172.21.15.79:3300/0 conn(0x7f929c0c0c20 0x7f929c06a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929affd640 1 -- 172.21.15.26:0/3277997051 >> v1:172.21.15.26:6789/0 conn(0x7f929c0c1ae0 legacy=0x7f929c0c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929affd640 1 -- 172.21.15.26:0/3277997051 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c072840 con 0x7f929c06a5a0 2023-11-28T16:56:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929b7fe640 1 --2- 172.21.15.26:0/3277997051 >> v2:172.21.15.79:3300/0 conn(0x7f929c0c0c20 0x7f929c06a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.646+0000 7f929a7fc640 1 -- 172.21.15.26:0/3277997051 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761716143 0 0) 0x7f929c1551d0 con 0x7f929c0c1ae0 2023-11-28T16:56:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f929affd640 1 --2- 172.21.15.26:0/3277997051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c06a5a0 0x7f929c0c3490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f929c0c8140 tx=0x7f928c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a850aba66f2a8b78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f929a7fc640 1 -- 172.21.15.26:0/3277997051 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0ab600 con 0x7f929c06a5a0 2023-11-28T16:56:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f929a7fc640 1 -- 172.21.15.26:0/3277997051 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c0a7050 con 0x7f929c06a5a0 2023-11-28T16:56:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f929a7fc640 1 -- 172.21.15.26:0/3277997051 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0ab980 con 0x7f929c06a5a0 2023-11-28T16:56:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- 172.21.15.26:0/3277997051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c06a5a0 msgr2=0x7f929c0c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 --2- 172.21.15.26:0/3277997051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c06a5a0 0x7f929c0c3490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f929c0c8140 tx=0x7f928c01c460 comp rx=0 tx=0).stop 2023-11-28T16:56:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- 172.21.15.26:0/3277997051 shutdown_connections 2023-11-28T16:56:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 --2- 172.21.15.26:0/3277997051 >> v2:172.21.15.79:3300/0 conn(0x7f929c0c0c20 0x7f929c06a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 --2- 172.21.15.26:0/3277997051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c06a5a0 0x7f929c0c3490 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- 172.21.15.26:0/3277997051 >> 172.21.15.26:0/3277997051 conn(0x7f929c0c3be0 msgr2=0x7f929c0c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- 172.21.15.26:0/3277997051 shutdown_connections 2023-11-28T16:56:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- 172.21.15.26:0/3277997051 wait complete. 2023-11-28T16:56:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 Processor -- start 2023-11-28T16:56:57.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- start start 2023-11-28T16:56:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929c06a5a0 0x7f929c141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c0c0c20 0x7f929c1ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0c1ae0 0x7f929c1f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1f0f60 con 0x7f929c0c0c20 2023-11-28T16:56:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c14dac0 con 0x7f929c0c1ae0 2023-11-28T16:56:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.650+0000 7f92a15df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c14dda0 con 0x7f929c06a5a0 2023-11-28T16:56:57.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c0c0c20 0x7f929c1ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:57.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c0c0c20 0x7f929c1ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51840/0 (socket says 172.21.15.26:51840) 2023-11-28T16:56:57.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 -- 172.21.15.26:0/3834414975 learned_addr learned my addr 172.21.15.26:0/3834414975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f929affd640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929c06a5a0 0x7f929c141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f929b7fe640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0c1ae0 0x7f929c1f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 -- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929c06a5a0 msgr2=0x7f929c141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929c06a5a0 0x7f929c141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 -- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0c1ae0 msgr2=0x7f929c1f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0c1ae0 0x7f929c1f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 -- 172.21.15.26:0/3834414975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009420 con 0x7f929c0c0c20 2023-11-28T16:56:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f9293fff640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c0c0c20 0x7f929c1ed5f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f928400c480 tx=0x7f928400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f92937fe640 1 -- 172.21.15.26:0/3834414975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840074e0 con 0x7f929c0c0c20 2023-11-28T16:56:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f92937fe640 1 -- 172.21.15.26:0/3834414975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284007660 con 0x7f929c0c0c20 2023-11-28T16:56:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f92937fe640 1 -- 172.21.15.26:0/3834414975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284004a30 con 0x7f929c0c0c20 2023-11-28T16:56:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c1ecdf0 con 0x7f929c0c0c20 2023-11-28T16:56:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c1ecaa0 con 0x7f929c0c0c20 2023-11-28T16:56:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c155640 con 0x7f929c0c0c20 2023-11-28T16:56:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.654+0000 7f92937fe640 1 -- 172.21.15.26:0/3834414975 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9284004b90 con 0x7f929c0c0c20 2023-11-28T16:56:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.658+0000 7f92937fe640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f927c0668d0 0x7f927c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.658+0000 7f92937fe640 1 -- 172.21.15.26:0/3834414975 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92840832b0 con 0x7f929c0c0c20 2023-11-28T16:56:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.658+0000 7f929affd640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f927c0668d0 0x7f927c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.658+0000 7f929affd640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f927c0668d0 0x7f927c068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f928c0ad000 tx=0x7f928c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.662+0000 7f92937fe640 1 -- 172.21.15.26:0/3834414975 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f929c155640 con 0x7f929c0c0c20 2023-11-28T16:56:57.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.874+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f929c155640 con 0x7f929c0c0c20 2023-11-28T16:56:57.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.874+0000 7f92937fe640 1 -- 172.21.15.26:0/3834414975 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f929c155640 con 0x7f929c0c0c20 2023-11-28T16:56:57.881 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:56:57.881 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:56:57.881 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlAikwBRAAQ6/impgMsMbDuSaqtxHLAg==", 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.882 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.886 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-11-28T16:56:57.886 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlGkK2ERAAvgQCl4mK38H2G8IG10WC8g==", 2023-11-28T16:56:57.886 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.886 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:56:57.886 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:56:57.886 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:56:57.887 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.887 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.887 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.887 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.887 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-11-28T16:56:57.887 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlN8GNDBAA3+w1QxhoXQo54UQV/ogQ5Q==", 2023-11-28T16:56:57.887 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.888 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:56:57.888 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:56:57.888 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:56:57.888 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.888 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.889 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.889 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.889 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-11-28T16:56:57.889 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlCZg+GRAADDsRVkfdQ4/R/d3auYuQLQ==", 2023-11-28T16:56:57.889 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.889 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:56:57.889 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:56:57.890 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:56:57.890 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.890 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.891 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.891 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.891 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-11-28T16:56:57.891 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB5G2Zlm75jMhAAfBhoHD0wXNlVoDshO3cpeg==", 2023-11-28T16:56:57.891 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.892 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.892 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.892 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.892 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.892 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.893 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.893 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-11-28T16:56:57.893 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB8G2ZlFdNYORAAN6gs23w6ngpwiGxRH9wdqA==", 2023-11-28T16:56:57.893 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.894 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.894 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.894 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.894 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.895 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.895 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.895 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-11-28T16:56:57.895 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCAG2ZlPWo/BBAAhIuajQHDwNtFJhJECKL0HA==", 2023-11-28T16:56:57.896 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.896 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.896 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.897 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.897 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.897 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.898 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.898 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-11-28T16:56:57.898 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCDG2ZltllfCxAAqpT3R2HyGu+P4MKWVo9haA==", 2023-11-28T16:56:57.899 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.899 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.899 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.899 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.899 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.900 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.900 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.900 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-11-28T16:56:57.900 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCJG2Zl86hXEhAAVn3jysp8SF3VujHFQXdJZA==", 2023-11-28T16:56:57.901 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.901 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.901 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.901 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.902 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.902 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.902 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.903 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-11-28T16:56:57.903 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCMG2Zldu2MGBAAK/nOy8WbKhJ/e91PhwY4Jg==", 2023-11-28T16:56:57.903 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.904 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.904 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.905 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.905 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.905 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.905 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.905 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-11-28T16:56:57.905 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCPG2ZlMzrZHxAAgwVfHNVLyId5CNs6/llC2w==", 2023-11-28T16:56:57.905 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.906 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.906 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.906 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.906 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.906 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.906 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.906 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCSG2ZlzlL/JRAAXY00dUMMj9nNXUjTVsMBQQ==", 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.907 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.908 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-11-28T16:56:57.908 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw==", 2023-11-28T16:56:57.908 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.908 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:56:57.908 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg==", 2023-11-28T16:56:57.909 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.910 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-11-28T16:56:57.911 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB3G2ZlBP0bIRAA91R862EjTamLWS36tcdt9g==", 2023-11-28T16:56:57.911 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.911 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:56:57.911 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:56:57.911 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:56:57.911 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mds", 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCYG2ZlBeIlGxAAb9bqw9eEURzIBUeTGXMJyQ==", 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T16:56:57.912 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCYG2ZlcPMlGxAA9QYRLk0AKqTci1CYw/D+cQ==", 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-osd", 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCYG2Zl/wAmGxAA8AqA+AKQOJtK0v1ESB+bHQ==", 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.913 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCYG2ZlrQkmGxAAqQQsJwQSxXay4bSQts432A==", 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCYG2ZlTRImGxAAPBCeg8pc98G8C9ji3gJYCA==", 2023-11-28T16:56:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCYG2ZlLRsmGxAAEyP3EqLR7qz8vxs/Q8Zcrw==", 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.915 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZldwN4ABAAk2OXnh0lwdB6ER6KsTUp+w==", 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB3G2ZlahcsOBAA/pu4L5dOusqC3KpdoJVbiQ==", 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:56:57.916 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:56:57.917 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-11-28T16:56:57.917 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:56:57.917 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.917 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:56:57.917 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-11-28T16:56:57.917 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:56:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f927c0668d0 msgr2=0x7f927c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f927c0668d0 0x7f927c068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f928c0ad000 tx=0x7f928c008040 comp rx=0 tx=0).stop 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c0c0c20 msgr2=0x7f929c1ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c0c0c20 0x7f929c1ed5f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f928400c480 tx=0x7f928400c940 comp rx=0 tx=0).stop 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 shutdown_connections 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0c1ae0 0x7f929c1f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f929c0c0c20 0x7f929c1ed5f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f927c0668d0 0x7f927c068d90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 --2- 172.21.15.26:0/3834414975 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929c06a5a0 0x7f929c141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 >> 172.21.15.26:0/3834414975 conn(0x7f929c0c3be0 msgr2=0x7f929c1529d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 shutdown_connections 2023-11-28T16:56:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:57.878+0000 7f92a15df640 1 -- 172.21.15.26:0/3834414975 wait complete. 2023-11-28T16:56:57.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T16:56:58.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.058+0000 7fcc86832640 1 Processor -- start 2023-11-28T16:56:58.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.058+0000 7fcc86832640 1 -- start start 2023-11-28T16:56:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.058+0000 7fcc86832640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc80156500 0x7fcc8006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.058+0000 7fcc86832640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8006dec0 con 0x7fcc8014fcc0 2023-11-28T16:56:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.058+0000 7fcc86832640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc80156980 con 0x7fcc800c19e0 2023-11-28T16:56:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.058+0000 7fcc86832640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800aa340 con 0x7fcc80156500 2023-11-28T16:56:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcc8014fcc0 0x7fcc800aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46230/0 (socket says 172.21.15.26:46230) 2023-11-28T16:56:58.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7ffff640 1 -- 172.21.15.26:0/4041675149 learned_addr learned my addr 172.21.15.26:0/4041675149 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:58.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7f7fe640 1 --2- 172.21.15.26:0/4041675149 >> v2:172.21.15.26:3300/0 conn(0x7fcc80156500 0x7fcc8006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7effd640 1 -- 172.21.15.26:0/4041675149 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045386271 0 0) 0x7fcc8006dec0 con 0x7fcc8014fcc0 2023-11-28T16:56:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7effd640 1 -- 172.21.15.26:0/4041675149 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc68003530 con 0x7fcc8014fcc0 2023-11-28T16:56:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7f7fe640 1 -- 172.21.15.26:0/4041675149 >> v1:172.21.15.79:6789/0 conn(0x7fcc800c19e0 legacy=0x7fcc800c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7f7fe640 1 -- 172.21.15.26:0/4041675149 >> v1:172.21.15.26:6789/0 conn(0x7fcc8014fcc0 legacy=0x7fcc800aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7f7fe640 1 -- 172.21.15.26:0/4041675149 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800ab580 con 0x7fcc80156500 2023-11-28T16:56:58.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7f7fe640 1 --2- 172.21.15.26:0/4041675149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc80156500 0x7fcc8006d980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcc740097c0 tx=0x7fcc7401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab91f58e48db6239 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7effd640 1 -- 172.21.15.26:0/4041675149 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740ab650 con 0x7fcc80156500 2023-11-28T16:56:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7effd640 1 -- 172.21.15.26:0/4041675149 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc740ab7b0 con 0x7fcc80156500 2023-11-28T16:56:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.062+0000 7fcc7effd640 1 -- 172.21.15.26:0/4041675149 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740abb40 con 0x7fcc80156500 2023-11-28T16:56:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- 172.21.15.26:0/4041675149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc80156500 msgr2=0x7fcc8006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 --2- 172.21.15.26:0/4041675149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc80156500 0x7fcc8006d980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcc740097c0 tx=0x7fcc7401c450 comp rx=0 tx=0).stop 2023-11-28T16:56:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- 172.21.15.26:0/4041675149 shutdown_connections 2023-11-28T16:56:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 --2- 172.21.15.26:0/4041675149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc80156500 0x7fcc8006d980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- 172.21.15.26:0/4041675149 >> 172.21.15.26:0/4041675149 conn(0x7fcc800c2ad0 msgr2=0x7fcc800c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- 172.21.15.26:0/4041675149 shutdown_connections 2023-11-28T16:56:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- 172.21.15.26:0/4041675149 wait complete. 2023-11-28T16:56:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 Processor -- start 2023-11-28T16:56:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- start start 2023-11-28T16:56:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc800c19e0 0x7fcc800c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc80156500 0x7fcc801470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc800c3bc0 0x7fcc801475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80071830 con 0x7fcc800c3bc0 2023-11-28T16:56:58.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80071b10 con 0x7fcc800c19e0 2023-11-28T16:56:58.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc86832640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80147de0 con 0x7fcc80156500 2023-11-28T16:56:58.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc800c3bc0 0x7fcc801475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc800c3bc0 0x7fcc801475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51866/0 (socket says 172.21.15.26:51866) 2023-11-28T16:56:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 -- 172.21.15.26:0/1886707568 learned_addr learned my addr 172.21.15.26:0/1886707568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc7ffff640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc800c19e0 0x7fcc800c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc7f7fe640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc80156500 0x7fcc801470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 -- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc80156500 msgr2=0x7fcc801470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc80156500 0x7fcc801470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 -- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc800c19e0 msgr2=0x7fcc800c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc800c19e0 0x7fcc800c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.066+0000 7fcc84dcf640 1 -- 172.21.15.26:0/1886707568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74009420 con 0x7fcc800c3bc0 2023-11-28T16:56:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc84dcf640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc800c3bc0 0x7fcc801475e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c770 tx=0x7fcc7800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc7cff9640 1 -- 172.21.15.26:0/1886707568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78003b80 con 0x7fcc800c3bc0 2023-11-28T16:56:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc7cff9640 1 -- 172.21.15.26:0/1886707568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78003ce0 con 0x7fcc800c3bc0 2023-11-28T16:56:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc7cff9640 1 -- 172.21.15.26:0/1886707568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800aa90 con 0x7fcc800c3bc0 2023-11-28T16:56:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc801480c0 con 0x7fcc800c3bc0 2023-11-28T16:56:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8014d040 con 0x7fcc800c3bc0 2023-11-28T16:56:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc801f0f00 con 0x7fcc800c3bc0 2023-11-28T16:56:58.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc7cff9640 1 -- 172.21.15.26:0/1886707568 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc7800abf0 con 0x7fcc800c3bc0 2023-11-28T16:56:58.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc7cff9640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c066900 0x7fcc6c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc7cff9640 1 -- 172.21.15.26:0/1886707568 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcc78083c10 con 0x7fcc800c3bc0 2023-11-28T16:56:58.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.070+0000 7fcc7ffff640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c066900 0x7fcc6c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.074+0000 7fcc7ffff640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c066900 0x7fcc6c068dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc700011f0 tx=0x7fcc70007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.074+0000 7fcc7cff9640 1 -- 172.21.15.26:0/1886707568 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc78051240 con 0x7fcc800c3bc0 2023-11-28T16:56:58.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.290+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fcc80156980 con 0x7fcc800c3bc0 2023-11-28T16:56:58.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc7cff9640 1 -- 172.21.15.26:0/1886707568 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcc80156980 con 0x7fcc800c3bc0 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c066900 msgr2=0x7fcc6c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c066900 0x7fcc6c068dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc700011f0 tx=0x7fcc70007d40 comp rx=0 tx=0).stop 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc800c3bc0 msgr2=0x7fcc801475e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc800c3bc0 0x7fcc801475e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c770 tx=0x7fcc7800cc30 comp rx=0 tx=0).stop 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 shutdown_connections 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc800c3bc0 0x7fcc801475e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c066900 0x7fcc6c068dc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc80156500 0x7fcc801470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 --2- 172.21.15.26:0/1886707568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc800c19e0 0x7fcc800c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 >> 172.21.15.26:0/1886707568 conn(0x7fcc800c2ad0 msgr2=0x7fcc8006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 shutdown_connections 2023-11-28T16:56:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.294+0000 7fcc86832640 1 -- 172.21.15.26:0/1886707568 wait complete. 2023-11-28T16:56:58.320 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T16:56:58.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.458+0000 7fc48c1df640 1 Processor -- start 2023-11-28T16:56:58.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.458+0000 7fc48c1df640 1 -- start start 2023-11-28T16:56:58.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48c1df640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc484153380 0x7fc4840adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48c1df640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48406e5d0 con 0x7fc4840c3560 2023-11-28T16:56:58.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48c1df640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48406e870 con 0x7fc4840a6e60 2023-11-28T16:56:58.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48c1df640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc484152850 con 0x7fc484153380 2023-11-28T16:56:58.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48977a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc4840c3560 0x7fc48415afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46234/0 (socket says 172.21.15.26:46234) 2023-11-28T16:56:58.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48977a640 1 -- 172.21.15.26:0/2957037608 learned_addr learned my addr 172.21.15.26:0/2957037608 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:58.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48a77c640 1 --2- 172.21.15.26:0/2957037608 >> v2:172.21.15.26:3300/0 conn(0x7fc484153380 0x7fc4840adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc488f79640 1 -- 172.21.15.26:0/2957037608 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462329002 0 0) 0x7fc48406e5d0 con 0x7fc4840c3560 2023-11-28T16:56:58.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc488f79640 1 -- 172.21.15.26:0/2957037608 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc470003530 con 0x7fc4840c3560 2023-11-28T16:56:58.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48a77c640 1 -- 172.21.15.26:0/2957037608 >> v1:172.21.15.79:6789/0 conn(0x7fc4840a6e60 legacy=0x7fc484152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48a77c640 1 -- 172.21.15.26:0/2957037608 >> v1:172.21.15.26:6789/0 conn(0x7fc4840c3560 legacy=0x7fc48415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc488f79640 1 -- 172.21.15.26:0/2957037608 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276725670 0 0) 0x7fc48406e870 con 0x7fc4840a6e60 2023-11-28T16:56:58.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.462+0000 7fc48a77c640 1 -- 172.21.15.26:0/2957037608 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840c54f0 con 0x7fc484153380 2023-11-28T16:56:58.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48a77c640 1 --2- 172.21.15.26:0/2957037608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc484153380 0x7fc4840adc80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009d90 tx=0x7fc47c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892ee00a24343926 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc488f79640 1 -- 172.21.15.26:0/2957037608 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0a5810 con 0x7fc484153380 2023-11-28T16:56:58.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc488f79640 1 -- 172.21.15.26:0/2957037608 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c0a5970 con 0x7fc484153380 2023-11-28T16:56:58.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc488f79640 1 -- 172.21.15.26:0/2957037608 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0a5d00 con 0x7fc484153380 2023-11-28T16:56:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 -- 172.21.15.26:0/2957037608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc484153380 msgr2=0x7fc4840adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 --2- 172.21.15.26:0/2957037608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc484153380 0x7fc4840adc80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009d90 tx=0x7fc47c01c950 comp rx=0 tx=0).stop 2023-11-28T16:56:58.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 -- 172.21.15.26:0/2957037608 shutdown_connections 2023-11-28T16:56:58.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 --2- 172.21.15.26:0/2957037608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc484153380 0x7fc4840adc80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 -- 172.21.15.26:0/2957037608 >> 172.21.15.26:0/2957037608 conn(0x7fc4840c4960 msgr2=0x7fc4840c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:58.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 -- 172.21.15.26:0/2957037608 shutdown_connections 2023-11-28T16:56:58.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 -- 172.21.15.26:0/2957037608 wait complete. 2023-11-28T16:56:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 Processor -- start 2023-11-28T16:56:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.466+0000 7fc48c1df640 1 -- start start 2023-11-28T16:56:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4840a6e60 0x7fc48406c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4840c3560 0x7fc48413ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc48414e8a0 0x7fc48413f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841537d0 con 0x7fc48414e8a0 2023-11-28T16:56:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc484153ab0 con 0x7fc4840c3560 2023-11-28T16:56:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48413f8d0 con 0x7fc4840a6e60 2023-11-28T16:56:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc48414e8a0 0x7fc48413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc48414e8a0 0x7fc48413f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51886/0 (socket says 172.21.15.26:51886) 2023-11-28T16:56:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 -- 172.21.15.26:0/3249677654 learned_addr learned my addr 172.21.15.26:0/3249677654 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc489f7b640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4840a6e60 0x7fc48406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48977a640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4840c3560 0x7fc48413ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 -- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4840a6e60 msgr2=0x7fc48406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4840a6e60 0x7fc48406c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 -- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4840c3560 msgr2=0x7fc48413ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4840c3560 0x7fc48413ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 -- 172.21.15.26:0/3249677654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009a70 con 0x7fc48414e8a0 2023-11-28T16:56:58.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc489f7b640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4840a6e60 0x7fc48406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:58.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48977a640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4840c3560 0x7fc48413ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:58.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48a77c640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc48414e8a0 0x7fc48413f390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc47c01ce30 tx=0x7fc47c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc47a7fc640 1 -- 172.21.15.26:0/3249677654 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c003ba0 con 0x7fc48414e8a0 2023-11-28T16:56:58.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc47a7fc640 1 -- 172.21.15.26:0/3249677654 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c003d00 con 0x7fc48414e8a0 2023-11-28T16:56:58.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc47a7fc640 1 -- 172.21.15.26:0/3249677654 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c004250 con 0x7fc48414e8a0 2023-11-28T16:56:58.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48414f440 con 0x7fc48414e8a0 2023-11-28T16:56:58.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4841edf70 con 0x7fc48414e8a0 2023-11-28T16:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.470+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc484153c60 con 0x7fc48414e8a0 2023-11-28T16:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.474+0000 7fc47a7fc640 1 -- 172.21.15.26:0/3249677654 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc47c0043b0 con 0x7fc48414e8a0 2023-11-28T16:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.474+0000 7fc47a7fc640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc4680668d0 0x7fc468068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.474+0000 7fc47a7fc640 1 -- 172.21.15.26:0/3249677654 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc47c11f600 con 0x7fc48414e8a0 2023-11-28T16:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.474+0000 7fc489f7b640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc4680668d0 0x7fc468068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.474+0000 7fc489f7b640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc4680668d0 0x7fc468068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f70 tx=0x7fc480009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.478+0000 7fc47a7fc640 1 -- 172.21.15.26:0/3249677654 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc484153c60 con 0x7fc48414e8a0 2023-11-28T16:56:58.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.690+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc484153c60 con 0x7fc48414e8a0 2023-11-28T16:56:58.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc47a7fc640 1 -- 172.21.15.26:0/3249677654 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc484153c60 con 0x7fc48414e8a0 2023-11-28T16:56:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc4680668d0 msgr2=0x7fc468068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc4680668d0 0x7fc468068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f70 tx=0x7fc480009040 comp rx=0 tx=0).stop 2023-11-28T16:56:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc48414e8a0 msgr2=0x7fc48413f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc48414e8a0 0x7fc48413f390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc47c01ce30 tx=0x7fc47c0196f0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 shutdown_connections 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc48414e8a0 0x7fc48413f390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4840c3560 0x7fc48413ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc4680668d0 0x7fc468068d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 --2- 172.21.15.26:0/3249677654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4840a6e60 0x7fc48406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 >> 172.21.15.26:0/3249677654 conn(0x7fc4840c4960 msgr2=0x7fc484151680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 shutdown_connections 2023-11-28T16:56:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.694+0000 7fc48c1df640 1 -- 172.21.15.26:0/3249677654 wait complete. 2023-11-28T16:56:58.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T16:56:58.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafb2609640 1 Processor -- start 2023-11-28T16:56:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafb2609640 1 -- start start 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafb2609640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafac0aacd0 0x7fafac154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafb2609640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fafac0700a0 0x7fafac1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafb2609640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac072780 con 0x7fafac0ab7a0 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafb2609640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac0ac160 con 0x7fafac0aacd0 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafb2609640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac0abe80 con 0x7fafac0700a0 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafabfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafac0aacd0 0x7fafac154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafabfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafac0aacd0 0x7fafac154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51892/0 (socket says 172.21.15.26:51892) 2023-11-28T16:56:58.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.858+0000 7fafabfff640 1 -- 172.21.15.26:0/3162357498 learned_addr learned my addr 172.21.15.26:0/3162357498 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:58.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafab7fe640 1 --2- 172.21.15.26:0/3162357498 >> v2:172.21.15.79:3300/0 conn(0x7fafac0700a0 0x7fafac1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafabfff640 1 -- 172.21.15.26:0/3162357498 >> v2:172.21.15.79:3300/0 conn(0x7fafac0700a0 msgr2=0x7fafac1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:58.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafabfff640 1 --2- 172.21.15.26:0/3162357498 >> v2:172.21.15.79:3300/0 conn(0x7fafac0700a0 0x7fafac1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafabfff640 1 -- 172.21.15.26:0/3162357498 >> v1:172.21.15.79:6789/0 conn(0x7fafac0ab7a0 legacy=0x7fafac06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:58.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafabfff640 1 -- 172.21.15.26:0/3162357498 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac154cf0 con 0x7fafac0aacd0 2023-11-28T16:56:58.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafab7fe640 1 --2- 172.21.15.26:0/3162357498 >> v2:172.21.15.79:3300/0 conn(0x7fafac0700a0 0x7fafac1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:56:58.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafabfff640 1 --2- 172.21.15.26:0/3162357498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0aacd0 0x7fafac154160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fafac0c08a0 tx=0x7faf9c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd90e94d93497c40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafaaffd640 1 -- 172.21.15.26:0/3162357498 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0ab600 con 0x7fafac0aacd0 2023-11-28T16:56:58.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafaaffd640 1 -- 172.21.15.26:0/3162357498 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0a7050 con 0x7fafac0aacd0 2023-11-28T16:56:58.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafaaffd640 1 -- 172.21.15.26:0/3162357498 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0ab980 con 0x7fafac0aacd0 2023-11-28T16:56:58.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafb2609640 1 -- 172.21.15.26:0/3162357498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0aacd0 msgr2=0x7fafac154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafb2609640 1 --2- 172.21.15.26:0/3162357498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0aacd0 0x7fafac154160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fafac0c08a0 tx=0x7faf9c01c400 comp rx=0 tx=0).stop 2023-11-28T16:56:58.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafb2609640 1 -- 172.21.15.26:0/3162357498 shutdown_connections 2023-11-28T16:56:58.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafb2609640 1 --2- 172.21.15.26:0/3162357498 >> v2:172.21.15.79:3300/0 conn(0x7fafac0700a0 0x7fafac1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafb2609640 1 --2- 172.21.15.26:0/3162357498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0aacd0 0x7fafac154160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.862+0000 7fafb2609640 1 -- 172.21.15.26:0/3162357498 >> 172.21.15.26:0/3162357498 conn(0x7fafac0c2ad0 msgr2=0x7fafac0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:58.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 -- 172.21.15.26:0/3162357498 shutdown_connections 2023-11-28T16:56:58.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 -- 172.21.15.26:0/3162357498 wait complete. 2023-11-28T16:56:58.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 Processor -- start 2023-11-28T16:56:58.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 -- start start 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0700a0 0x7fafac1ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0aacd0 0x7fafac153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0ab7a0 0x7fafac149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1eec80 con 0x7fafac0700a0 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1eef60 con 0x7fafac0aacd0 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1ef240 con 0x7fafac0ab7a0 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0700a0 0x7fafac1ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0700a0 0x7fafac1ee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51894/0 (socket says 172.21.15.26:51894) 2023-11-28T16:56:58.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 -- 172.21.15.26:0/1847932444 learned_addr learned my addr 172.21.15.26:0/1847932444 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:58.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafab7fe640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0aacd0 0x7fafac153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb0ba6640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0ab7a0 0x7fafac149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 -- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0ab7a0 msgr2=0x7fafac149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0ab7a0 0x7fafac149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 -- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0aacd0 msgr2=0x7fafac153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0aacd0 0x7fafac153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 -- 172.21.15.26:0/1847932444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0094d0 con 0x7fafac0700a0 2023-11-28T16:56:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafab7fe640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0aacd0 0x7fafac153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafabfff640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0700a0 0x7fafac1ee6a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf9c01a030 tx=0x7faf9c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafa8ff9640 1 -- 172.21.15.26:0/1847932444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0b3890 con 0x7fafac0700a0 2023-11-28T16:56:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafa8ff9640 1 -- 172.21.15.26:0/1847932444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0b39f0 con 0x7fafac0700a0 2023-11-28T16:56:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafa8ff9640 1 -- 172.21.15.26:0/1847932444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0b3da0 con 0x7fafac0700a0 2023-11-28T16:56:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.866+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac1ef520 con 0x7fafac0700a0 2023-11-28T16:56:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.870+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac153cc0 con 0x7fafac0700a0 2023-11-28T16:56:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.870+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac04e890 con 0x7fafac0700a0 2023-11-28T16:56:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.870+0000 7fafa8ff9640 1 -- 172.21.15.26:0/1847932444 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faf9c0b2070 con 0x7fafac0700a0 2023-11-28T16:56:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.870+0000 7fafa8ff9640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf98066920 0x7faf98068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.870+0000 7fafa8ff9640 1 -- 172.21.15.26:0/1847932444 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faf9c11e2c0 con 0x7fafac0700a0 2023-11-28T16:56:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.870+0000 7fafab7fe640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf98066920 0x7faf98068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.874+0000 7fafab7fe640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf98066920 0x7faf98068de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fafac070ef0 tx=0x7fafa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:58.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:58.874+0000 7fafa8ff9640 1 -- 172.21.15.26:0/1847932444 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf9c0eb9c0 con 0x7fafac0700a0 2023-11-28T16:56:59.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.086+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fafac0c0410 con 0x7fafac0700a0 2023-11-28T16:56:59.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafa8ff9640 1 -- 172.21.15.26:0/1847932444 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7faf9c0eefe0 con 0x7fafac0700a0 2023-11-28T16:56:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf98066920 msgr2=0x7faf98068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf98066920 0x7faf98068de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fafac070ef0 tx=0x7fafa0008040 comp rx=0 tx=0).stop 2023-11-28T16:56:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0700a0 msgr2=0x7fafac1ee6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0700a0 0x7fafac1ee6a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf9c01a030 tx=0x7faf9c0191a0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 shutdown_connections 2023-11-28T16:56:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf98066920 0x7faf98068de0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0ab7a0 0x7fafac149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0aacd0 0x7fafac153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 --2- 172.21.15.26:0/1847932444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0700a0 0x7fafac1ee6a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 >> 172.21.15.26:0/1847932444 conn(0x7fafac0c2ad0 msgr2=0x7fafac0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 shutdown_connections 2023-11-28T16:56:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.090+0000 7fafb2609640 1 -- 172.21.15.26:0/1847932444 wait complete. 2023-11-28T16:56:59.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T16:56:59.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582f017640 1 Processor -- start 2023-11-28T16:56:59.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582f017640 1 -- start start 2023-11-28T16:56:59.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582f017640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5828156500 0x7f582806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582f017640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582806dec0 con 0x7f58280c19e0 2023-11-28T16:56:59.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582f017640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5828156980 con 0x7f582814fcc0 2023-11-28T16:56:59.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582f017640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280aa340 con 0x7f5828156500 2023-11-28T16:56:59.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582d5b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f58280c19e0 0x7f58280c1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46240/0 (socket says 172.21.15.26:46240) 2023-11-28T16:56:59.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.254+0000 7f582d5b4640 1 -- 172.21.15.26:0/1078052013 learned_addr learned my addr 172.21.15.26:0/1078052013 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f5827fff640 1 --2- 172.21.15.26:0/1078052013 >> v2:172.21.15.79:3300/0 conn(0x7f5828156500 0x7f582806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620871443 0 0) 0x7f582806dec0 con 0x7f58280c19e0 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5818003530 con 0x7f58280c19e0 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317955308 0 0) 0x7f5818003530 con 0x7f58280c19e0 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 >> v2:172.21.15.79:3300/0 conn(0x7f5828156500 msgr2=0x7f582806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 --2- 172.21.15.26:0/1078052013 >> v2:172.21.15.79:3300/0 conn(0x7f5828156500 0x7f582806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 >> v1:172.21.15.79:6789/0 conn(0x7f582814fcc0 legacy=0x7f58280aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280ab580 con 0x7f58280c19e0 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f5820001a00 con 0x7f58280c19e0 2023-11-28T16:56:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 >> v1:172.21.15.26:6789/0 conn(0x7f58280c19e0 legacy=0x7f58280c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f5818003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58180047d0 0x7f5818004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5818005190 0x7f581800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581800c000 con 0x7f5818003980 2023-11-28T16:56:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581800c170 con 0x7f5818005190 2023-11-28T16:56:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581800c330 con 0x7f58180047d0 2023-11-28T16:56:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582cdb3640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f5818003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f5827fff640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58180047d0 0x7f5818004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582d5b4640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5818005190 0x7f581800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582cdb3640 1 -- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58180047d0 msgr2=0x7f5818004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582cdb3640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58180047d0 0x7f5818004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582cdb3640 1 -- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5818005190 msgr2=0x7f581800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582cdb3640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5818005190 0x7f581800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582cdb3640 1 -- 172.21.15.26:0/1078052013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818003530 con 0x7f5818003980 2023-11-28T16:56:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f5827fff640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58180047d0 0x7f5818004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582d5b4640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5818005190 0x7f581800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.258+0000 7f582d5b4640 1 -- 172.21.15.26:0/1078052013 reap_dead start 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582cdb3640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f5818003da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f581c0015e0 tx=0x7f581c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc00f6a616a61a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0052d0 con 0x7f5818003980 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0a7050 con 0x7f5818003980 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f58277fe640 1 -- 172.21.15.26:0/1078052013 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c003600 con 0x7f5818003980 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 -- 172.21.15.26:0/1078052013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 msgr2=0x7f5818003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f5818003da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f581c0015e0 tx=0x7f581c01c210 comp rx=0 tx=0).stop 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 -- 172.21.15.26:0/1078052013 shutdown_connections 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 --2- 172.21.15.26:0/1078052013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f5818003da0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 -- 172.21.15.26:0/1078052013 >> 172.21.15.26:0/1078052013 conn(0x7f58280c2ad0 msgr2=0x7f58280c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 -- 172.21.15.26:0/1078052013 shutdown_connections 2023-11-28T16:56:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 -- 172.21.15.26:0/1078052013 wait complete. 2023-11-28T16:56:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 Processor -- start 2023-11-28T16:56:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.262+0000 7f582f017640 1 -- start start 2023-11-28T16:56:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f58281511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5828071db0 0x7f58281516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5828144ee0 0x7f5828145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828151c20 con 0x7f5818003980 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280711f0 con 0x7f5828144ee0 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5828070f30 con 0x7f5828071db0 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f58281511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f58281511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51912/0 (socket says 172.21.15.26:51912) 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 -- 172.21.15.26:0/3920062293 learned_addr learned my addr 172.21.15.26:0/3920062293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f5827fff640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5828071db0 0x7f58281516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582d5b4640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5828144ee0 0x7f5828145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 -- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5828071db0 msgr2=0x7f58281516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5828071db0 0x7f58281516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 -- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5828144ee0 msgr2=0x7f5828145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5828144ee0 0x7f5828145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 -- 172.21.15.26:0/3920062293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828146020 con 0x7f5818003980 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f5827fff640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5828071db0 0x7f58281516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582d5b4640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5828144ee0 0x7f5828145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582cdb3640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f58281511a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f581c005040 tx=0x7f5818005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f58257fa640 1 -- 172.21.15.26:0/3920062293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c007140 con 0x7f5818003980 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f58257fa640 1 -- 172.21.15.26:0/3920062293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0072a0 con 0x7f5818003980 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f58257fa640 1 -- 172.21.15.26:0/3920062293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c007650 con 0x7f5818003980 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5828146300 con 0x7f5818003980 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58280700a0 con 0x7f5818003980 2023-11-28T16:56:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582804e890 con 0x7f5818003980 2023-11-28T16:56:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.266+0000 7f58257fa640 1 -- 172.21.15.26:0/3920062293 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f581c0067e0 con 0x7f5818003980 2023-11-28T16:56:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.270+0000 7f58257fa640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f580c0668d0 0x7f580c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.270+0000 7f58257fa640 1 -- 172.21.15.26:0/3920062293 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f581c11e480 con 0x7f5818003980 2023-11-28T16:56:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.270+0000 7f5827fff640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f580c0668d0 0x7f580c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.270+0000 7f5827fff640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f580c0668d0 0x7f580c068d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5828152850 tx=0x7f5814008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.274+0000 7f58257fa640 1 -- 172.21.15.26:0/3920062293 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f581c0eba00 con 0x7f5818003980 2023-11-28T16:56:59.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.486+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5828156980 con 0x7f5818003980 2023-11-28T16:56:59.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.486+0000 7f58257fa640 1 -- 172.21.15.26:0/3920062293 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5828156980 con 0x7f5818003980 2023-11-28T16:56:59.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f580c0668d0 msgr2=0x7f580c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f580c0668d0 0x7f580c068d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5828152850 tx=0x7f5814008040 comp rx=0 tx=0).stop 2023-11-28T16:56:59.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 msgr2=0x7f58281511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f58281511a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f581c005040 tx=0x7f5818005800 comp rx=0 tx=0).stop 2023-11-28T16:56:59.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 shutdown_connections 2023-11-28T16:56:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5828144ee0 0x7f5828145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f580c0668d0 0x7f580c068d90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5828071db0 0x7f58281516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 --2- 172.21.15.26:0/3920062293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5818003980 0x7f58281511a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 >> 172.21.15.26:0/3920062293 conn(0x7f58280c2ad0 msgr2=0x7f58280a8470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 shutdown_connections 2023-11-28T16:56:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.490+0000 7f582f017640 1 -- 172.21.15.26:0/3920062293 wait complete. 2023-11-28T16:56:59.515 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T16:56:59.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3251b5640 1 Processor -- start 2023-11-28T16:56:59.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3251b5640 1 -- start start 2023-11-28T16:56:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3251b5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3200af140 0x7fe3200af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3251b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3200c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3251b5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3200c9970 con 0x7fe3200c94e0 2023-11-28T16:56:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3251b5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3201556e0 con 0x7fe3200af140 2023-11-28T16:56:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3251b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c4ee0 con 0x7fe320155170 2023-11-28T16:56:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe31ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3200af140 0x7fe3200af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3249b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3200c94e0 0x7fe32006acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46252/0 (socket says 172.21.15.26:46252) 2023-11-28T16:56:59.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe3249b4640 1 -- 172.21.15.26:0/1966452144 learned_addr learned my addr 172.21.15.26:0/1966452144 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:56:59.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe31f7fe640 1 --2- 172.21.15.26:0/1966452144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3200c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe31ffff640 1 -- 172.21.15.26:0/1966452144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 msgr2=0x7fe3200c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:56:59.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe31ffff640 1 --2- 172.21.15.26:0/1966452144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3200c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe31ffff640 1 -- 172.21.15.26:0/1966452144 >> v1:172.21.15.26:6789/0 conn(0x7fe3200c94e0 legacy=0x7fe32006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe31effd640 1 -- 172.21.15.26:0/1966452144 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410131559 0 0) 0x7fe3180014a0 con 0x7fe3200c94e0 2023-11-28T16:56:59.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.654+0000 7fe31ffff640 1 -- 172.21.15.26:0/1966452144 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200c81e0 con 0x7fe3200af140 2023-11-28T16:56:59.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe31ffff640 1 --2- 172.21.15.26:0/1966452144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3200af520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097c0 tx=0x7fe31001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bd498c995c7ee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:59.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe31effd640 1 -- 172.21.15.26:0/1966452144 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100ac620 con 0x7fe3200af140 2023-11-28T16:56:59.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe31effd640 1 -- 172.21.15.26:0/1966452144 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100ac780 con 0x7fe3200af140 2023-11-28T16:56:59.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe31effd640 1 -- 172.21.15.26:0/1966452144 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100acb10 con 0x7fe3200af140 2023-11-28T16:56:59.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 -- 172.21.15.26:0/1966452144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 msgr2=0x7fe3200af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 --2- 172.21.15.26:0/1966452144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3200af520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097c0 tx=0x7fe31001c3c0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 -- 172.21.15.26:0/1966452144 shutdown_connections 2023-11-28T16:56:59.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 --2- 172.21.15.26:0/1966452144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3200c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 --2- 172.21.15.26:0/1966452144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3200af520 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 -- 172.21.15.26:0/1966452144 >> 172.21.15.26:0/1966452144 conn(0x7fe3200ca140 msgr2=0x7fe3200ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:59.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 -- 172.21.15.26:0/1966452144 shutdown_connections 2023-11-28T16:56:59.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.658+0000 7fe3251b5640 1 -- 172.21.15.26:0/1966452144 wait complete. 2023-11-28T16:56:59.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 Processor -- start 2023-11-28T16:56:59.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 -- start start 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3201f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3200c94e0 0x7fe320152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3201534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c1210 con 0x7fe3200af140 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c14f0 con 0x7fe3200c94e0 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32014c120 con 0x7fe320155170 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3201f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3201f0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51918/0 (socket says 172.21.15.26:51918) 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 -- 172.21.15.26:0/2726787478 learned_addr learned my addr 172.21.15.26:0/2726787478 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31f7fe640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3200c94e0 0x7fe320152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3249b4640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3201534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 -- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 msgr2=0x7fe3201534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3201534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 -- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3200c94e0 msgr2=0x7fe320152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3200c94e0 0x7fe320152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 -- 172.21.15.26:0/2726787478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009420 con 0x7fe3200af140 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31f7fe640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3200c94e0 0x7fe320152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3249b4640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3201534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:56:59.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31ffff640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3201f0a40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe310019ff0 tx=0x7fe310019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:59.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31cff9640 1 -- 172.21.15.26:0/2726787478 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b5410 con 0x7fe3200af140 2023-11-28T16:56:59.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31cff9640 1 -- 172.21.15.26:0/2726787478 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100b5570 con 0x7fe3200af140 2023-11-28T16:56:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe31cff9640 1 -- 172.21.15.26:0/2726787478 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b5920 con 0x7fe3200af140 2023-11-28T16:56:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.662+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32014c630 con 0x7fe3200af140 2023-11-28T16:56:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.666+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3201f1290 con 0x7fe3200af140 2023-11-28T16:56:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.666+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32004e890 con 0x7fe3200af140 2023-11-28T16:56:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.666+0000 7fe31cff9640 1 -- 172.21.15.26:0/2726787478 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe3100b3040 con 0x7fe3200af140 2023-11-28T16:56:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.666+0000 7fe31cff9640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe30c0668d0 0x7fe30c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:56:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.666+0000 7fe31cff9640 1 -- 172.21.15.26:0/2726787478 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe31011e3a0 con 0x7fe3200af140 2023-11-28T16:56:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.666+0000 7fe31f7fe640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe30c0668d0 0x7fe30c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:56:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.670+0000 7fe31f7fe640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe30c0668d0 0x7fe30c068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe320156770 tx=0x7fe314008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:56:59.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.670+0000 7fe31cff9640 1 -- 172.21.15.26:0/2726787478 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3100eb920 con 0x7fe3200af140 2023-11-28T16:56:59.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.886+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe3200afde0 con 0x7fe3200af140 2023-11-28T16:56:59.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.886+0000 7fe31cff9640 1 -- 172.21.15.26:0/2726787478 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe3100eef40 con 0x7fe3200af140 2023-11-28T16:56:59.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe30c0668d0 msgr2=0x7fe30c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe30c0668d0 0x7fe30c068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe320156770 tx=0x7fe314008040 comp rx=0 tx=0).stop 2023-11-28T16:56:59.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 msgr2=0x7fe3201f0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:56:59.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3201f0a40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe310019ff0 tx=0x7fe310019160 comp rx=0 tx=0).stop 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 shutdown_connections 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe30c0668d0 0x7fe30c068d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe320155170 0x7fe3201534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3200c94e0 0x7fe320152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 --2- 172.21.15.26:0/2726787478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3200af140 0x7fe3201f0a40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 >> 172.21.15.26:0/2726787478 conn(0x7fe3200ca140 msgr2=0x7fe3200ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 shutdown_connections 2023-11-28T16:56:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:56:59.890+0000 7fe3251b5640 1 -- 172.21.15.26:0/2726787478 wait complete. 2023-11-28T16:56:59.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T16:57:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.054+0000 7f9dacdd8640 1 Processor -- start 2023-11-28T16:57:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.054+0000 7f9dacdd8640 1 -- start start 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.054+0000 7f9dacdd8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9da80ca610 0x7f9da80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.054+0000 7f9dacdd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da80bd720 0x7f9da80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.054+0000 7f9dacdd8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da8155790 con 0x7f9da806cd90 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.054+0000 7f9dacdd8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da80c4b00 con 0x7f9da80ca610 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.054+0000 7f9dacdd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c4de0 con 0x7f9da80bd720 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9da80ca610 0x7f9da80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9d9ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da80bd720 0x7f9da80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da6d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9da806cd90 0x7f9da8158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39830/0 (socket says 172.21.15.26:39830) 2023-11-28T16:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9da80ca610 0x7f9da80c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:38732/0 (socket says 172.21.15.26:38732) 2023-11-28T16:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da6d9d640 1 -- 172.21.15.26:0/2787908766 learned_addr learned my addr 172.21.15.26:0/2787908766 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da5d9b640 1 -- 172.21.15.26:0/2787908766 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864273036 0 0) 0x7f9da8155790 con 0x7f9da806cd90 2023-11-28T16:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da5d9b640 1 -- 172.21.15.26:0/2787908766 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d94003530 con 0x7f9da806cd90 2023-11-28T16:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da659c640 1 -- 172.21.15.26:0/2787908766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da80bd720 msgr2=0x7f9da80c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da659c640 1 --2- 172.21.15.26:0/2787908766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da80bd720 0x7f9da80c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da659c640 1 -- 172.21.15.26:0/2787908766 >> v1:172.21.15.79:6789/0 conn(0x7f9da806cd90 legacy=0x7f9da8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da659c640 1 -- 172.21.15.26:0/2787908766 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8157e30 con 0x7f9da80ca610 2023-11-28T16:57:00.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da659c640 1 --2- 172.21.15.26:0/2787908766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 0x7f9da80c94c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d980097c0 tx=0x7f9d9801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8235b9dd2476fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da5d9b640 1 -- 172.21.15.26:0/2787908766 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80c52d0 con 0x7f9da80ca610 2023-11-28T16:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da5d9b640 1 -- 172.21.15.26:0/2787908766 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980a4880 con 0x7f9da80ca610 2023-11-28T16:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.058+0000 7f9da5d9b640 1 -- 172.21.15.26:0/2787908766 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980a4c10 con 0x7f9da80ca610 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2787908766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 msgr2=0x7f9da80c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2787908766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 0x7f9da80c94c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d980097c0 tx=0x7f9d9801c040 comp rx=0 tx=0).stop 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2787908766 shutdown_connections 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2787908766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da80bd720 0x7f9da80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2787908766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 0x7f9da80c94c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2787908766 >> 172.21.15.26:0/2787908766 conn(0x7f9da8071ea0 msgr2=0x7f9da80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2787908766 shutdown_connections 2023-11-28T16:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2787908766 wait complete. 2023-11-28T16:57:00.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 Processor -- start 2023-11-28T16:57:00.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- start start 2023-11-28T16:57:00.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da806cd90 0x7f9da814b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da80bd720 0x7f9da80bf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 0x7f9da80bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8153500 con 0x7f9da80bd720 2023-11-28T16:57:00.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81546b0 con 0x7f9da80ca610 2023-11-28T16:57:00.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9dacdd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81537a0 con 0x7f9da806cd90 2023-11-28T16:57:00.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9d9ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da80bd720 0x7f9da80bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9da659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da806cd90 0x7f9da814b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9d9ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da80bd720 0x7f9da80bf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51928/0 (socket says 172.21.15.26:51928) 2023-11-28T16:57:00.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9d9ffff640 1 -- 172.21.15.26:0/2827212979 learned_addr learned my addr 172.21.15.26:0/2827212979 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:00.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.062+0000 7f9da6d9d640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 0x7f9da80bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9da659c640 1 -- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 msgr2=0x7f9da80bfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9da659c640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 0x7f9da80bfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9da659c640 1 -- 172.21.15.26:0/2827212979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da80bd720 msgr2=0x7f9da80bf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9da659c640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da80bd720 0x7f9da80bf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9da659c640 1 -- 172.21.15.26:0/2827212979 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98009420 con 0x7f9da806cd90 2023-11-28T16:57:00.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9d9ffff640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da80bd720 0x7f9da80bf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:00.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9da659c640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da806cd90 0x7f9da814b8e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d980ab000 tx=0x7f9d98019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9d9effd640 1 -- 172.21.15.26:0/2827212979 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980ac850 con 0x7f9da806cd90 2023-11-28T16:57:00.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9d9effd640 1 -- 172.21.15.26:0/2827212979 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980ac9d0 con 0x7f9da806cd90 2023-11-28T16:57:00.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9d9effd640 1 -- 172.21.15.26:0/2827212979 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980acd80 con 0x7f9da806cd90 2023-11-28T16:57:00.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da80bdf70 con 0x7f9da806cd90 2023-11-28T16:57:00.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da814be20 con 0x7f9da806cd90 2023-11-28T16:57:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da81532d0 con 0x7f9da806cd90 2023-11-28T16:57:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.066+0000 7f9d9effd640 1 -- 172.21.15.26:0/2827212979 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9d980b3040 con 0x7f9da806cd90 2023-11-28T16:57:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.070+0000 7f9d9effd640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9d880668d0 0x7f9d88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.070+0000 7f9d9effd640 1 -- 172.21.15.26:0/2827212979 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9da80cac00 con 0x7f9da806cd90 2023-11-28T16:57:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.070+0000 7f9d9ffff640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9d880668d0 0x7f9d88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.070+0000 7f9d9ffff640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9d880668d0 0x7f9d88068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9da8067a90 tx=0x7f9d90009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.074+0000 7f9d9effd640 1 -- 172.21.15.26:0/2827212979 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d980eafb0 con 0x7f9da806cd90 2023-11-28T16:57:00.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.286+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f9da804e890 con 0x7f9da806cd90 2023-11-28T16:57:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9d9effd640 1 -- 172.21.15.26:0/2827212979 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9d980ee5d0 con 0x7f9da806cd90 2023-11-28T16:57:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9d880668d0 msgr2=0x7f9d88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9d880668d0 0x7f9d88068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9da8067a90 tx=0x7f9d90009190 comp rx=0 tx=0).stop 2023-11-28T16:57:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da806cd90 msgr2=0x7f9da814b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da806cd90 0x7f9da814b8e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d980ab000 tx=0x7f9d98019100 comp rx=0 tx=0).stop 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 shutdown_connections 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da80ca610 0x7f9da80bfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da80bd720 0x7f9da80bf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9d880668d0 0x7f9d88068d90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 --2- 172.21.15.26:0/2827212979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9da806cd90 0x7f9da814b8e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 >> 172.21.15.26:0/2827212979 conn(0x7f9da8071ea0 msgr2=0x7f9da80ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 shutdown_connections 2023-11-28T16:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.294+0000 7f9dacdd8640 1 -- 172.21.15.26:0/2827212979 wait complete. 2023-11-28T16:57:00.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:00.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a70009640 1 Processor -- start 2023-11-28T16:57:00.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a70009640 1 -- start start 2023-11-28T16:57:00.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a70009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a68152ce0 0x7f3a6806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a70009640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a6806db80 0x7f3a680700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a70009640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6806bea0 con 0x7f3a680705e0 2023-11-28T16:57:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a70009640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a68159b10 con 0x7f3a6806db80 2023-11-28T16:57:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a70009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68159550 con 0x7f3a68152ce0 2023-11-28T16:57:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6d5a4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a6806db80 0x7f3a680700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6d5a4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a6806db80 0x7f3a680700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51942/0 (socket says 172.21.15.26:51942) 2023-11-28T16:57:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/1069309736 learned_addr learned my addr 172.21.15.26:0/1069309736 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6dda5640 1 --2- 172.21.15.26:0/1069309736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a68152ce0 0x7f3a6806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/1069309736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a68152ce0 msgr2=0x7f3a6806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6d5a4640 1 --2- 172.21.15.26:0/1069309736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a68152ce0 0x7f3a6806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/1069309736 >> v1:172.21.15.79:6789/0 conn(0x7f3a680705e0 legacy=0x7f3a680c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.458+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/1069309736 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68159830 con 0x7f3a6806db80 2023-11-28T16:57:00.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a6d5a4640 1 --2- 172.21.15.26:0/1069309736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6806db80 0x7f3a680700a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009870 tx=0x7f3a5801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaffbbff6b5dde8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a6cda3640 1 -- 172.21.15.26:0/1069309736 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a7070 con 0x7f3a6806db80 2023-11-28T16:57:00.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a6cda3640 1 -- 172.21.15.26:0/1069309736 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580ab430 con 0x7f3a6806db80 2023-11-28T16:57:00.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a6cda3640 1 -- 172.21.15.26:0/1069309736 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580ab7c0 con 0x7f3a6806db80 2023-11-28T16:57:00.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 -- 172.21.15.26:0/1069309736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6806db80 msgr2=0x7f3a680700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 --2- 172.21.15.26:0/1069309736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6806db80 0x7f3a680700a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009870 tx=0x7f3a5801c470 comp rx=0 tx=0).stop 2023-11-28T16:57:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 -- 172.21.15.26:0/1069309736 shutdown_connections 2023-11-28T16:57:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 --2- 172.21.15.26:0/1069309736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6806db80 0x7f3a680700a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 --2- 172.21.15.26:0/1069309736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a68152ce0 0x7f3a6806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 -- 172.21.15.26:0/1069309736 >> 172.21.15.26:0/1069309736 conn(0x7f3a680c2ad0 msgr2=0x7f3a680c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 -- 172.21.15.26:0/1069309736 shutdown_connections 2023-11-28T16:57:00.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.462+0000 7f3a70009640 1 -- 172.21.15.26:0/1069309736 wait complete. 2023-11-28T16:57:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 Processor -- start 2023-11-28T16:57:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 -- start start 2023-11-28T16:57:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a6806db80 0x7f3a6814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a680705e0 0x7f3a68148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a68152ce0 0x7f3a681492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6815c7d0 con 0x7f3a680705e0 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a681f1db0 con 0x7f3a68152ce0 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a681f22e0 con 0x7f3a6806db80 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a680705e0 0x7f3a68148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a680705e0 0x7f3a68148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51954/0 (socket says 172.21.15.26:51954) 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/2330782714 learned_addr learned my addr 172.21.15.26:0/2330782714 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6dda5640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a6806db80 0x7f3a6814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6e5a6640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a68152ce0 0x7f3a681492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a6806db80 msgr2=0x7f3a6814e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a6806db80 0x7f3a6814e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a68152ce0 msgr2=0x7f3a681492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a68152ce0 0x7f3a681492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 -- 172.21.15.26:0/2330782714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580094d0 con 0x7f3a680705e0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a6d5a4640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a680705e0 0x7f3a68148da0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a580ad040 tx=0x7f3a58019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a5e7fc640 1 -- 172.21.15.26:0/2330782714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580b4830 con 0x7f3a680705e0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a5e7fc640 1 -- 172.21.15.26:0/2330782714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580b4990 con 0x7f3a680705e0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a681f2000 con 0x7f3a680705e0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a5e7fc640 1 -- 172.21.15.26:0/2330782714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580b4d40 con 0x7f3a680705e0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a680c5c70 con 0x7f3a680705e0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.466+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6804e890 con 0x7f3a680705e0 2023-11-28T16:57:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.470+0000 7f3a5e7fc640 1 -- 172.21.15.26:0/2330782714 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a580b3380 con 0x7f3a680705e0 2023-11-28T16:57:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.470+0000 7f3a5e7fc640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a4c066900 0x7f3a4c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.470+0000 7f3a5e7fc640 1 -- 172.21.15.26:0/2330782714 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3a5811e440 con 0x7f3a680705e0 2023-11-28T16:57:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.470+0000 7f3a6dda5640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a4c066900 0x7f3a4c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.470+0000 7f3a6dda5640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a4c066900 0x7f3a4c068dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3a640079c0 tx=0x7f3a64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.474+0000 7f3a5e7fc640 1 -- 172.21.15.26:0/2330782714 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a580ebc10 con 0x7f3a680705e0 2023-11-28T16:57:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a6806cee0 con 0x7f3a680705e0 2023-11-28T16:57:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a5e7fc640 1 -- 172.21.15.26:0/2330782714 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12785 (secure 0 0 0) 0x7f3a580c4090 con 0x7f3a680705e0 2023-11-28T16:57:00.639 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:00.639 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":28,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:56:57.468540+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:00.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a4c066900 msgr2=0x7f3a4c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a4c066900 0x7f3a4c068dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3a640079c0 tx=0x7f3a64008040 comp rx=0 tx=0).stop 2023-11-28T16:57:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a680705e0 msgr2=0x7f3a68148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a680705e0 0x7f3a68148da0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a580ad040 tx=0x7f3a58019210 comp rx=0 tx=0).stop 2023-11-28T16:57:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 shutdown_connections 2023-11-28T16:57:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a68152ce0 0x7f3a681492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a680705e0 0x7f3a68148da0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a4c066900 0x7f3a4c068dc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 --2- 172.21.15.26:0/2330782714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a6806db80 0x7f3a6814e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 >> 172.21.15.26:0/2330782714 conn(0x7f3a680c2ad0 msgr2=0x7f3a6814c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 shutdown_connections 2023-11-28T16:57:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.634+0000 7f3a70009640 1 -- 172.21.15.26:0/2330782714 wait complete. 2023-11-28T16:57:00.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:00.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:00.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d2fc4640 1 Processor -- start 2023-11-28T16:57:00.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d2fc4640 1 -- start start 2023-11-28T16:57:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d2fc4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89cc0a8470 0x7f89cc06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d2fc4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc06de00 con 0x7f89cc14eaf0 2023-11-28T16:57:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d2fc4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc070390 con 0x7f89cc0c0370 2023-11-28T16:57:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d2fc4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc14eed0 con 0x7f89cc0a8470 2023-11-28T16:57:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f89cc14eaf0 0x7f89cc151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46268/0 (socket says 172.21.15.26:46268) 2023-11-28T16:57:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 -- 172.21.15.26:0/2037202523 learned_addr learned my addr 172.21.15.26:0/2037202523 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d1561640 1 --2- 172.21.15.26:0/2037202523 >> v2:172.21.15.79:3300/0 conn(0x7f89cc0a8470 0x7f89cc06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060535179 0 0) 0x7f89cc06de00 con 0x7f89cc14eaf0 2023-11-28T16:57:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89bc003530 con 0x7f89cc14eaf0 2023-11-28T16:57:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50746377 0 0) 0x7f89bc003530 con 0x7f89cc14eaf0 2023-11-28T16:57:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 >> v2:172.21.15.79:3300/0 conn(0x7f89cc0a8470 msgr2=0x7f89cc06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 --2- 172.21.15.26:0/2037202523 >> v2:172.21.15.79:3300/0 conn(0x7f89cc0a8470 0x7f89cc06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 >> v1:172.21.15.79:6789/0 conn(0x7f89cc0c0370 legacy=0x7f89cc06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc151270 con 0x7f89cc14eaf0 2023-11-28T16:57:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f89c0001680 con 0x7f89cc14eaf0 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d1561640 1 --2- 172.21.15.26:0/2037202523 >> v2:172.21.15.79:3300/0 conn(0x7f89cc0a8470 0x7f89cc06d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 >> v1:172.21.15.26:6789/0 conn(0x7f89cc14eaf0 legacy=0x7f89cc151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc003980 0x7f89bc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc0047d0 0x7f89bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89bc005190 0x7f89bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc14eed0 con 0x7f89bc003980 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc00c0e0 con 0x7f89bc0047d0 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc00e4b0 con 0x7f89bc005190 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc003980 0x7f89bc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89cbfff640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc0047d0 0x7f89bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d1561640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89bc005190 0x7f89bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 -- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89bc005190 msgr2=0x7f89bc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:00.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89bc005190 0x7f89bc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 -- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc0047d0 msgr2=0x7f89bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc0047d0 0x7f89bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d0d60640 1 -- 172.21.15.26:0/2037202523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc003530 con 0x7f89bc003980 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.802+0000 7f89d1561640 1 -- 172.21.15.26:0/2037202523 reap_dead start 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d0d60640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc003980 0x7f89bc003d60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f89c000c210 tx=0x7f89c001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a6ad03e2b9420 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0005ae0 con 0x7f89bc003980 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0005c60 con 0x7f89bc003980 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89cb7fe640 1 -- 172.21.15.26:0/2037202523 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00a5ad0 con 0x7f89bc003980 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2037202523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc003980 msgr2=0x7f89bc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc003980 0x7f89bc003d60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f89c000c210 tx=0x7f89c001cbb0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2037202523 shutdown_connections 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2037202523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc003980 0x7f89bc003d60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2037202523 >> 172.21.15.26:0/2037202523 conn(0x7f89cc0c2a60 msgr2=0x7f89cc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:00.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2037202523 shutdown_connections 2023-11-28T16:57:00.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.806+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2037202523 wait complete. 2023-11-28T16:57:00.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 Processor -- start 2023-11-28T16:57:00.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 -- start start 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc003980 0x7f89cc0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89cc0ab980 0x7f89cc0bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89cc144a90 0x7f89cc144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c4080 con 0x7f89cc0ab980 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c5610 con 0x7f89bc003980 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d2fc4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0a9eb0 con 0x7f89cc144a90 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89cc0ab980 0x7f89cc0bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89cc0ab980 0x7f89cc0bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51970/0 (socket says 172.21.15.26:51970) 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 -- 172.21.15.26:0/2650676982 learned_addr learned my addr 172.21.15.26:0/2650676982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d0d60640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc003980 0x7f89cc0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89d1561640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89cc144a90 0x7f89cc144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 -- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89cc144a90 msgr2=0x7f89cc144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89cc144a90 0x7f89cc144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 -- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc003980 msgr2=0x7f89cc0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc003980 0x7f89cc0c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 -- 172.21.15.26:0/2650676982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc1ecbc0 con 0x7f89cc0ab980 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89cbfff640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89cc0ab980 0x7f89cc0bf5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f89b800f7f0 tx=0x7f89b800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.810+0000 7f89c97fa640 1 -- 172.21.15.26:0/2650676982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80050d0 con 0x7f89cc0ab980 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89c97fa640 1 -- 172.21.15.26:0/2650676982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b8005250 con 0x7f89cc0ab980 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89c97fa640 1 -- 172.21.15.26:0/2650676982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b800d730 con 0x7f89cc0ab980 2023-11-28T16:57:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc1f0f30 con 0x7f89cc0ab980 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc0c4570 con 0x7f89cc0ab980 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc04e890 con 0x7f89cc0ab980 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89c97fa640 1 -- 172.21.15.26:0/2650676982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f89b800d890 con 0x7f89cc0ab980 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89c97fa640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89b00668d0 0x7f89b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89c97fa640 1 -- 172.21.15.26:0/2650676982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89b8083f70 con 0x7f89cc0ab980 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.814+0000 7f89d0d60640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89b00668d0 0x7f89b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.818+0000 7f89d0d60640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89b00668d0 0x7f89b0068d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89c00ab000 tx=0x7f89c00b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:00.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.818+0000 7f89c97fa640 1 -- 172.21.15.26:0/2650676982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89b80514f0 con 0x7f89cc0ab980 2023-11-28T16:57:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89cc14f840 con 0x7f89cc0ab980 2023-11-28T16:57:00.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89c97fa640 1 -- 172.21.15.26:0/2650676982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89b8054b10 con 0x7f89cc0ab980 2023-11-28T16:57:00.984 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89b00668d0 msgr2=0x7f89b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89b00668d0 0x7f89b0068d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89c00ab000 tx=0x7f89c00b1040 comp rx=0 tx=0).stop 2023-11-28T16:57:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89cc0ab980 msgr2=0x7f89cc0bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89cc0ab980 0x7f89cc0bf5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f89b800f7f0 tx=0x7f89b800fbf0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 shutdown_connections 2023-11-28T16:57:00.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89b00668d0 0x7f89b0068d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89cc144a90 0x7f89cc144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89cc0ab980 0x7f89cc0bf5f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 --2- 172.21.15.26:0/2650676982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89bc003980 0x7f89cc0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:00.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.978+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 >> 172.21.15.26:0/2650676982 conn(0x7f89cc0c2a60 msgr2=0x7f89cc0c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:00.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.982+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 shutdown_connections 2023-11-28T16:57:00.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:00.982+0000 7f89d2fc4640 1 -- 172.21.15.26:0/2650676982 wait complete. 2023-11-28T16:57:01.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T16:57:01.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.142+0000 7fb0a7c09640 1 Processor -- start 2023-11-28T16:57:01.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.142+0000 7fb0a7c09640 1 -- start start 2023-11-28T16:57:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a7c09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0a014fcc0 0x7fb0a0156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a7c09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0a006d980 0x7fb0a00aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a7c09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a0152fe0 con 0x7fb0a00ab3b0 2023-11-28T16:57:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a7c09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a00aa340 con 0x7fb0a014fcc0 2023-11-28T16:57:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a7c09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a01532c0 con 0x7fb0a006d980 2023-11-28T16:57:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0a014fcc0 0x7fb0a0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0a014fcc0 0x7fb0a0156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51986/0 (socket says 172.21.15.26:51986) 2023-11-28T16:57:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 -- 172.21.15.26:0/993690646 learned_addr learned my addr 172.21.15.26:0/993690646 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a51a4640 1 --2- 172.21.15.26:0/993690646 >> v2:172.21.15.79:3300/0 conn(0x7fb0a006d980 0x7fb0a00aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 -- 172.21.15.26:0/993690646 >> v2:172.21.15.79:3300/0 conn(0x7fb0a006d980 msgr2=0x7fb0a00aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 --2- 172.21.15.26:0/993690646 >> v2:172.21.15.79:3300/0 conn(0x7fb0a006d980 0x7fb0a00aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 -- 172.21.15.26:0/993690646 >> v1:172.21.15.79:6789/0 conn(0x7fb0a00ab3b0 legacy=0x7fb0a00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 -- 172.21.15.26:0/993690646 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a0155a20 con 0x7fb0a014fcc0 2023-11-28T16:57:01.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.146+0000 7fb0a59a5640 1 --2- 172.21.15.26:0/993690646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a014fcc0 0x7fb0a0156500 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb0a006b4e0 tx=0x7fb09c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5b6643a1c2768d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a49a3640 1 -- 172.21.15.26:0/993690646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0aa5f0 con 0x7fb0a014fcc0 2023-11-28T16:57:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a49a3640 1 -- 172.21.15.26:0/993690646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c0aa750 con 0x7fb0a014fcc0 2023-11-28T16:57:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a49a3640 1 -- 172.21.15.26:0/993690646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0aaae0 con 0x7fb0a014fcc0 2023-11-28T16:57:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- 172.21.15.26:0/993690646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a014fcc0 msgr2=0x7fb0a0156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/993690646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a014fcc0 0x7fb0a0156500 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb0a006b4e0 tx=0x7fb09c01c490 comp rx=0 tx=0).stop 2023-11-28T16:57:01.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- 172.21.15.26:0/993690646 shutdown_connections 2023-11-28T16:57:01.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/993690646 >> v2:172.21.15.79:3300/0 conn(0x7fb0a006d980 0x7fb0a00aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/993690646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a014fcc0 0x7fb0a0156500 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- 172.21.15.26:0/993690646 >> 172.21.15.26:0/993690646 conn(0x7fb0a00c2ad0 msgr2=0x7fb0a00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:01.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- 172.21.15.26:0/993690646 shutdown_connections 2023-11-28T16:57:01.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- 172.21.15.26:0/993690646 wait complete. 2023-11-28T16:57:01.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 Processor -- start 2023-11-28T16:57:01.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- start start 2023-11-28T16:57:01.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006d980 0x7fb0a00c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a00ab3b0 0x7fb0a01ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a00c3bc0 0x7fb0a015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00c4ad0 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a01ed7b0 con 0x7fb0a00ab3b0 2023-11-28T16:57:01.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.150+0000 7fb0a7c09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00701d0 con 0x7fb0a006d980 2023-11-28T16:57:01.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a00c3bc0 0x7fb0a015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a51a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a00ab3b0 0x7fb0a01ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a00c3bc0 0x7fb0a015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51996/0 (socket says 172.21.15.26:51996) 2023-11-28T16:57:01.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 -- 172.21.15.26:0/4102019149 learned_addr learned my addr 172.21.15.26:0/4102019149 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a59a5640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006d980 0x7fb0a00c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 -- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006d980 msgr2=0x7fb0a00c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006d980 0x7fb0a00c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 -- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a00ab3b0 msgr2=0x7fb0a01ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a00ab3b0 0x7fb0a01ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 -- 172.21.15.26:0/4102019149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0094d0 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a61a6640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a00c3bc0 0x7fb0a015b3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb09800c780 tx=0x7fb09800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0967fc640 1 -- 172.21.15.26:0/4102019149 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800a9f0 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0967fc640 1 -- 172.21.15.26:0/4102019149 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800ab50 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a00704b0 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0967fc640 1 -- 172.21.15.26:0/4102019149 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800ce30 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a0151d80 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a004e890 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.154+0000 7fb0967fc640 1 -- 172.21.15.26:0/4102019149 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb098012420 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.158+0000 7fb0967fc640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0840668d0 0x7fb084068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.158+0000 7fb0967fc640 1 -- 172.21.15.26:0/4102019149 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0980840d0 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.158+0000 7fb0a59a5640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0840668d0 0x7fb084068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.158+0000 7fb0a59a5640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0840668d0 0x7fb084068d90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0ae000 tx=0x7fb09c0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.158+0000 7fb0967fc640 1 -- 172.21.15.26:0/4102019149 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0980517a0 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb0a006ce10 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0967fc640 1 -- 172.21.15.26:0/4102019149 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb098054dc0 con 0x7fb0a00c3bc0 2023-11-28T16:57:01.328 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:01.328 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-11-28T16:57:01.328 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:01.328 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-11-28T16:57:01.329 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-11-28T16:57:01.329 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:01.329 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-11-28T16:57:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0840668d0 msgr2=0x7fb084068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0840668d0 0x7fb084068d90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0ae000 tx=0x7fb09c0b5040 comp rx=0 tx=0).stop 2023-11-28T16:57:01.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a00c3bc0 msgr2=0x7fb0a015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a00c3bc0 0x7fb0a015b3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb09800c780 tx=0x7fb09800cc40 comp rx=0 tx=0).stop 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 shutdown_connections 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a00c3bc0 0x7fb0a015b3f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a00ab3b0 0x7fb0a01ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0840668d0 0x7fb084068d90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 --2- 172.21.15.26:0/4102019149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006d980 0x7fb0a00c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 >> 172.21.15.26:0/4102019149 conn(0x7fb0a00c2ad0 msgr2=0x7fb0a0153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 shutdown_connections 2023-11-28T16:57:01.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.322+0000 7fb0a7c09640 1 -- 172.21.15.26:0/4102019149 wait complete. 2023-11-28T16:57:01.349 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T16:57:01.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T16:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f15955f8640 1 Processor -- start 2023-11-28T16:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f15955f8640 1 -- start start 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f15955f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15900abde0 0x7f15900c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f15955f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15901545a0 0x7f15901549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f15955f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159014e770 con 0x7f159014e390 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f15955f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159006b2e0 con 0x7f15901545a0 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f15955f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15901518d0 con 0x7f15900abde0 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15901545a0 0x7f15901549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f159014e390 0x7f15900c1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49372/0 (socket says 172.21.15.26:49372) 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158effd640 1 -- 172.21.15.26:0/1469964674 learned_addr learned my addr 172.21.15.26:0/1469964674 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:01.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158e7fc640 1 --2- 172.21.15.26:0/1469964674 >> v2:172.21.15.79:3300/0 conn(0x7f15900abde0 0x7f15900c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158f7fe640 1 -- 172.21.15.26:0/1469964674 >> v2:172.21.15.79:3300/0 conn(0x7f15900abde0 msgr2=0x7f15900c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:01.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158dffb640 1 -- 172.21.15.26:0/1469964674 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725181192 0 0) 0x7f159014e770 con 0x7f159014e390 2023-11-28T16:57:01.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158f7fe640 1 --2- 172.21.15.26:0/1469964674 >> v2:172.21.15.79:3300/0 conn(0x7f15900abde0 0x7f15900c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158f7fe640 1 -- 172.21.15.26:0/1469964674 >> v1:172.21.15.26:6789/0 conn(0x7f159014e390 legacy=0x7f15900c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158f7fe640 1 -- 172.21.15.26:0/1469964674 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590151bb0 con 0x7f15901545a0 2023-11-28T16:57:01.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.494+0000 7f158e7fc640 1 --2- 172.21.15.26:0/1469964674 >> v2:172.21.15.79:3300/0 conn(0x7f15900abde0 0x7f15900c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f158f7fe640 1 --2- 172.21.15.26:0/1469964674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15901545a0 0x7f15901549d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1590071fc0 tx=0x7f158801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cb6404aafbdeab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f158dffb640 1 -- 172.21.15.26:0/1469964674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15880a66d0 con 0x7f15901545a0 2023-11-28T16:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f158dffb640 1 -- 172.21.15.26:0/1469964674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15880a6830 con 0x7f15901545a0 2023-11-28T16:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f158dffb640 1 -- 172.21.15.26:0/1469964674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15880a6bc0 con 0x7f15901545a0 2023-11-28T16:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 -- 172.21.15.26:0/1469964674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15901545a0 msgr2=0x7f15901549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 --2- 172.21.15.26:0/1469964674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15901545a0 0x7f15901549d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1590071fc0 tx=0x7f158801c880 comp rx=0 tx=0).stop 2023-11-28T16:57:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 -- 172.21.15.26:0/1469964674 shutdown_connections 2023-11-28T16:57:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 --2- 172.21.15.26:0/1469964674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15901545a0 0x7f15901549d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 --2- 172.21.15.26:0/1469964674 >> v2:172.21.15.79:3300/0 conn(0x7f15900abde0 0x7f15900c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 -- 172.21.15.26:0/1469964674 >> 172.21.15.26:0/1469964674 conn(0x7f159006a5a0 msgr2=0x7f159006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 -- 172.21.15.26:0/1469964674 shutdown_connections 2023-11-28T16:57:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 -- 172.21.15.26:0/1469964674 wait complete. 2023-11-28T16:57:01.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.498+0000 7f15955f8640 1 Processor -- start 2023-11-28T16:57:01.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 -- start start 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15900abde0 0x7f15901eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159014e390 0x7f159014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15901545a0 0x7f15900aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900a9c10 con 0x7f159014e390 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159014ec20 con 0x7f15901545a0 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1590150450 con 0x7f15900abde0 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159014e390 0x7f159014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159014e390 0x7f159014ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51788/0 (socket says 172.21.15.26:51788) 2023-11-28T16:57:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 -- 172.21.15.26:0/566627546 learned_addr learned my addr 172.21.15.26:0/566627546 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:01.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 -- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15900abde0 msgr2=0x7f15901eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15900abde0 0x7f15901eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 -- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15901545a0 msgr2=0x7f15900aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15901545a0 0x7f15900aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 -- 172.21.15.26:0/566627546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1588009a70 con 0x7f159014e390 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f158e7fc640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159014e390 0x7f159014ff10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f158400e840 tx=0x7f158400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15777fe640 1 -- 172.21.15.26:0/566627546 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400c8d0 con 0x7f159014e390 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15777fe640 1 -- 172.21.15.26:0/566627546 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158400ca30 con 0x7f159014e390 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159014eed0 con 0x7f159014e390 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15777fe640 1 -- 172.21.15.26:0/566627546 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400cdc0 con 0x7f159014e390 2023-11-28T16:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159014f710 con 0x7f159014e390 2023-11-28T16:57:01.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.502+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159004e890 con 0x7f159014e390 2023-11-28T16:57:01.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.506+0000 7f15777fe640 1 -- 172.21.15.26:0/566627546 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1584013410 con 0x7f159014e390 2023-11-28T16:57:01.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.506+0000 7f15777fe640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f157c0668d0 0x7f157c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.506+0000 7f15777fe640 1 -- 172.21.15.26:0/566627546 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1584083ff0 con 0x7f159014e390 2023-11-28T16:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.506+0000 7f158effd640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f157c0668d0 0x7f157c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.506+0000 7f158effd640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f157c0668d0 0x7f157c068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f15800011f0 tx=0x7f1580007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.510+0000 7f15777fe640 1 -- 172.21.15.26:0/566627546 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15840514e0 con 0x7f159014e390 2023-11-28T16:57:01.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.666+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f15900c23f0 con 0x7f159014e390 2023-11-28T16:57:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.846+0000 7f15777fe640 1 -- 172.21.15.26:0/566627546 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1584009480 con 0x7f159014e390 2023-11-28T16:57:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-11-28T16:57:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f157c0668d0 msgr2=0x7f157c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f157c0668d0 0x7f157c068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f15800011f0 tx=0x7f1580007930 comp rx=0 tx=0).stop 2023-11-28T16:57:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159014e390 msgr2=0x7f159014ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159014e390 0x7f159014ff10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f158400e840 tx=0x7f158400ed00 comp rx=0 tx=0).stop 2023-11-28T16:57:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 shutdown_connections 2023-11-28T16:57:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15901545a0 0x7f15900aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f159014e390 0x7f159014ff10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f157c0668d0 0x7f157c068d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 --2- 172.21.15.26:0/566627546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15900abde0 0x7f15901eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 >> 172.21.15.26:0/566627546 conn(0x7f159006a5a0 msgr2=0x7f1590070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 shutdown_connections 2023-11-28T16:57:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:01.850+0000 7f15955f8640 1 -- 172.21.15.26:0/566627546 wait complete. 2023-11-28T16:57:01.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T16:57:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff151eea640 1 Processor -- start 2023-11-28T16:57:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff151eea640 1 -- start start 2023-11-28T16:57:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff151eea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 0x7ff14c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff151eea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c06de00 con 0x7ff14c0c0370 2023-11-28T16:57:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff151eea640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c070390 con 0x7ff14c14eaf0 2023-11-28T16:57:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff151eea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c14eed0 con 0x7ff14c0a8470 2023-11-28T16:57:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff14c0c0370 0x7ff14c06d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49376/0 (socket says 172.21.15.26:49376) 2023-11-28T16:57:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14affd640 1 -- 172.21.15.26:0/2605984171 learned_addr learned my addr 172.21.15.26:0/2605984171 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:02.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14bfff640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 0x7ff14c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108150472 0 0) 0x7ff14c06de00 con 0x7ff14c0c0370 2023-11-28T16:57:02.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff134005740 con 0x7ff14c0c0370 2023-11-28T16:57:02.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016262900 0 0) 0x7ff14c070390 con 0x7ff14c14eaf0 2023-11-28T16:57:02.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff14c06de00 con 0x7ff14c14eaf0 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 41150307 0 0) 0x7ff134005740 con 0x7ff14c0c0370 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 msgr2=0x7ff14c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 0x7ff14c06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 >> v1:172.21.15.79:6789/0 conn(0x7ff14c14eaf0 legacy=0x7ff14c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c151270 con 0x7ff14c0c0370 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7ff140001680 con 0x7ff14c0c0370 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 >> v1:172.21.15.26:6789/0 conn(0x7ff14c0c0370 legacy=0x7ff14c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff134005d50 0x7ff134006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 0x7ff1340069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff1340073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c14eed0 con 0x7ff134006f20 2023-11-28T16:57:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13400dde0 con 0x7ff134005d50 2023-11-28T16:57:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.026+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13400dfa0 con 0x7ff14c0a8470 2023-11-28T16:57:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14affd640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 0x7ff1340069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14b7fe640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff134005d50 0x7ff134006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14bfff640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff1340073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14bfff640 1 -- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 msgr2=0x7ff1340069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:02.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14bfff640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0a8470 0x7ff1340069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14bfff640 1 -- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff134005d50 msgr2=0x7ff134006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:02.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14bfff640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff134005d50 0x7ff134006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14bfff640 1 -- 172.21.15.26:0/2605984171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134005740 con 0x7ff134006f20 2023-11-28T16:57:02.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14bfff640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff1340073a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff144009fc0 tx=0x7ff14401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d7372e89747bf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:02.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440a5c50 con 0x7ff134006f20 2023-11-28T16:57:02.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400f040 con 0x7ff134006f20 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.030+0000 7ff14a7fc640 1 -- 172.21.15.26:0/2605984171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440ad440 con 0x7ff134006f20 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- 172.21.15.26:0/2605984171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 msgr2=0x7ff1340073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 --2- 172.21.15.26:0/2605984171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff1340073a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff144009fc0 tx=0x7ff14401cc60 comp rx=0 tx=0).stop 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff14bfff640 1 -- 172.21.15.26:0/2605984171 reap_dead start 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- 172.21.15.26:0/2605984171 shutdown_connections 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- 172.21.15.26:0/2605984171 >> 172.21.15.26:0/2605984171 conn(0x7ff14c0c2a60 msgr2=0x7ff14c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- 172.21.15.26:0/2605984171 shutdown_connections 2023-11-28T16:57:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- 172.21.15.26:0/2605984171 wait complete. 2023-11-28T16:57:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 Processor -- start 2023-11-28T16:57:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- start start 2023-11-28T16:57:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff14c0c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff14c0c2580 0x7ff14c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0abd70 0x7ff14c0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c54d0 con 0x7ff134006f20 2023-11-28T16:57:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0ab920 con 0x7ff14c0c2580 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff151eea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1525b0 con 0x7ff14c0abd70 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff14c0c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff14c0c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51814/0 (socket says 172.21.15.26:51814) 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff14b7fe640 1 -- 172.21.15.26:0/702030813 learned_addr learned my addr 172.21.15.26:0/702030813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff14bfff640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0abd70 0x7ff14c0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.034+0000 7ff14affd640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff14c0c2580 0x7ff14c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff14b7fe640 1 -- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0abd70 msgr2=0x7ff14c0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff14b7fe640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0abd70 0x7ff14c0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff14b7fe640 1 -- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff14c0c2580 msgr2=0x7ff14c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff14b7fe640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff14c0c2580 0x7ff14c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff14b7fe640 1 -- 172.21.15.26:0/702030813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c1f16c0 con 0x7ff134006f20 2023-11-28T16:57:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff14b7fe640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff14c0c5880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00f770 tx=0x7ff13c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff133fff640 1 -- 172.21.15.26:0/702030813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00fe80 con 0x7ff134006f20 2023-11-28T16:57:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff133fff640 1 -- 172.21.15.26:0/702030813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c0052e0 con 0x7ff134006f20 2023-11-28T16:57:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff133fff640 1 -- 172.21.15.26:0/702030813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00d970 con 0x7ff134006f20 2023-11-28T16:57:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c152870 con 0x7ff134006f20 2023-11-28T16:57:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c15a510 con 0x7ff134006f20 2023-11-28T16:57:02.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c152a60 con 0x7ff134006f20 2023-11-28T16:57:02.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.038+0000 7ff133fff640 1 -- 172.21.15.26:0/702030813 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff13c00dad0 con 0x7ff134006f20 2023-11-28T16:57:02.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.042+0000 7ff133fff640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff138066900 0x7ff138068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:02.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.042+0000 7ff133fff640 1 -- 172.21.15.26:0/702030813 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff13c084a80 con 0x7ff134006f20 2023-11-28T16:57:02.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.042+0000 7ff14affd640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff138066900 0x7ff138068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:02.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.042+0000 7ff14affd640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff138066900 0x7ff138068dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0ab6e0 tx=0x7ff140001050 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:02.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.042+0000 7ff133fff640 1 -- 172.21.15.26:0/702030813 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff13c051fc0 con 0x7ff134006f20 2023-11-28T16:57:02.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.202+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff14c152a60 con 0x7ff134006f20 2023-11-28T16:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff133fff640 1 -- 172.21.15.26:0/702030813 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff14c152a60 con 0x7ff134006f20 2023-11-28T16:57:02.863 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-11-28T16:57:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff138066900 msgr2=0x7ff138068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff138066900 0x7ff138068dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0ab6e0 tx=0x7ff140001050 comp rx=0 tx=0).stop 2023-11-28T16:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 msgr2=0x7ff14c0c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff14c0c5880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00f770 tx=0x7ff13c00fc30 comp rx=0 tx=0).stop 2023-11-28T16:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 shutdown_connections 2023-11-28T16:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff138066900 0x7ff138068dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff14c0abd70 0x7ff14c0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff14c0c2580 0x7ff14c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 --2- 172.21.15.26:0/702030813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134006f20 0x7ff14c0c5880 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 >> 172.21.15.26:0/702030813 conn(0x7ff14c0c2a60 msgr2=0x7ff14c142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 shutdown_connections 2023-11-28T16:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:02.858+0000 7ff151eea640 1 -- 172.21.15.26:0/702030813 wait complete. 2023-11-28T16:57:02.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T16:57:03.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.042+0000 7effa0879640 1 Processor -- start 2023-11-28T16:57:03.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.042+0000 7effa0879640 1 -- start start 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.042+0000 7effa0879640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff9c0700f0 0x7eff9c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7effa0879640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff9c06df30 0x7eff9c0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7effa0879640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c154b90 con 0x7eff9c154000 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7effa0879640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0a8710 con 0x7eff9c0700f0 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7effa0879640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0abd70 con 0x7eff9c06df30 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff9a59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7eff9c154000 0x7eff9c1543e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49392/0 (socket says 172.21.15.26:49392) 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff9a59c640 1 -- 172.21.15.26:0/2160350611 learned_addr learned my addr 172.21.15.26:0/2160350611 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff93fff640 1 --2- 172.21.15.26:0/2160350611 >> v2:172.21.15.26:3300/0 conn(0x7eff9c0700f0 0x7eff9c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff9ad9d640 1 --2- 172.21.15.26:0/2160350611 >> v2:172.21.15.79:3300/0 conn(0x7eff9c06df30 0x7eff9c0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff99d9b640 1 -- 172.21.15.26:0/2160350611 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961889456 0 0) 0x7eff9c154b90 con 0x7eff9c154000 2023-11-28T16:57:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff99d9b640 1 -- 172.21.15.26:0/2160350611 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff88003530 con 0x7eff9c154000 2023-11-28T16:57:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff93fff640 1 -- 172.21.15.26:0/2160350611 >> v2:172.21.15.79:3300/0 conn(0x7eff9c06df30 msgr2=0x7eff9c0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff93fff640 1 --2- 172.21.15.26:0/2160350611 >> v2:172.21.15.79:3300/0 conn(0x7eff9c06df30 0x7eff9c0714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff93fff640 1 -- 172.21.15.26:0/2160350611 >> v1:172.21.15.26:6789/0 conn(0x7eff9c154000 legacy=0x7eff9c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff93fff640 1 -- 172.21.15.26:0/2160350611 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0ab820 con 0x7eff9c0700f0 2023-11-28T16:57:03.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.046+0000 7eff93fff640 1 --2- 172.21.15.26:0/2160350611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c0700f0 0x7eff9c070f90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0728c0 tx=0x7eff8401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b5f971314246e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff99d9b640 1 -- 172.21.15.26:0/2160350611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840ab600 con 0x7eff9c0700f0 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff99d9b640 1 -- 172.21.15.26:0/2160350611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff840a7050 con 0x7eff9c0700f0 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff99d9b640 1 -- 172.21.15.26:0/2160350611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840ab980 con 0x7eff9c0700f0 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- 172.21.15.26:0/2160350611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c0700f0 msgr2=0x7eff9c070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 --2- 172.21.15.26:0/2160350611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c0700f0 0x7eff9c070f90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0728c0 tx=0x7eff8401c340 comp rx=0 tx=0).stop 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- 172.21.15.26:0/2160350611 shutdown_connections 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 --2- 172.21.15.26:0/2160350611 >> v2:172.21.15.79:3300/0 conn(0x7eff9c06df30 0x7eff9c0714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 --2- 172.21.15.26:0/2160350611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c0700f0 0x7eff9c070f90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- 172.21.15.26:0/2160350611 >> 172.21.15.26:0/2160350611 conn(0x7eff9c0c2a60 msgr2=0x7eff9c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- 172.21.15.26:0/2160350611 shutdown_connections 2023-11-28T16:57:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- 172.21.15.26:0/2160350611 wait complete. 2023-11-28T16:57:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 Processor -- start 2023-11-28T16:57:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- start start 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c06df30 0x7eff9c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff9c0700f0 0x7eff9c1ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff9c154000 0x7eff9c1f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c50d0 con 0x7eff9c06df30 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c1f1250 con 0x7eff9c0700f0 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7effa0879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c1ed3c0 con 0x7eff9c154000 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff9a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c06df30 0x7eff9c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff9a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c06df30 0x7eff9c0c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51844/0 (socket says 172.21.15.26:51844) 2023-11-28T16:57:03.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff9a59c640 1 -- 172.21.15.26:0/407280240 learned_addr learned my addr 172.21.15.26:0/407280240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:03.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff9ad9d640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff9c154000 0x7eff9c1f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:03.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.050+0000 7eff93fff640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff9c0700f0 0x7eff9c1ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:03.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff9a59c640 1 -- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff9c154000 msgr2=0x7eff9c1f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:03.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff9a59c640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff9c154000 0x7eff9c1f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff9a59c640 1 -- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff9c0700f0 msgr2=0x7eff9c1ed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:03.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff9a59c640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff9c0700f0 0x7eff9c1ed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff9a59c640 1 -- 172.21.15.26:0/407280240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84009420 con 0x7eff9c06df30 2023-11-28T16:57:03.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff9a59c640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c06df30 0x7eff9c0c4190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c450 tx=0x7eff8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:03.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff92ffd640 1 -- 172.21.15.26:0/407280240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c005cf0 con 0x7eff9c06df30 2023-11-28T16:57:03.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff92ffd640 1 -- 172.21.15.26:0/407280240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c005e50 con 0x7eff9c06df30 2023-11-28T16:57:03.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff92ffd640 1 -- 172.21.15.26:0/407280240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0072d0 con 0x7eff9c06df30 2023-11-28T16:57:03.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c1ecd90 con 0x7eff9c06df30 2023-11-28T16:57:03.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c0c4ac0 con 0x7eff9c06df30 2023-11-28T16:57:03.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c0c4cb0 con 0x7eff9c06df30 2023-11-28T16:57:03.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.054+0000 7eff92ffd640 1 -- 172.21.15.26:0/407280240 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff8c007430 con 0x7eff9c06df30 2023-11-28T16:57:03.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.058+0000 7eff92ffd640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff7c066900 0x7eff7c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:03.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.058+0000 7eff92ffd640 1 -- 172.21.15.26:0/407280240 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7eff8c083da0 con 0x7eff9c06df30 2023-11-28T16:57:03.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.058+0000 7eff93fff640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff7c066900 0x7eff7c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:03.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.058+0000 7eff93fff640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff7c066900 0x7eff7c068dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff840ad000 tx=0x7eff840a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:03.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.062+0000 7eff92ffd640 1 -- 172.21.15.26:0/407280240 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff8c051160 con 0x7eff9c06df30 2023-11-28T16:57:03.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.250+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7eff9c04e890 con 0x7eff9c06df30 2023-11-28T16:57:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.870+0000 7eff92ffd640 1 -- 172.21.15.26:0/407280240 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7eff8c054780 con 0x7eff9c06df30 2023-11-28T16:57:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 4 and data pool 5 2023-11-28T16:57:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.878+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff7c066900 msgr2=0x7eff7c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.878+0000 7effa0879640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff7c066900 0x7eff7c068dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff840ad000 tx=0x7eff840a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.878+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c06df30 msgr2=0x7eff9c0c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:03.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.878+0000 7effa0879640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c06df30 0x7eff9c0c4190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c450 tx=0x7eff8c00c910 comp rx=0 tx=0).stop 2023-11-28T16:57:03.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.882+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 shutdown_connections 2023-11-28T16:57:03.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.882+0000 7effa0879640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff7c066900 0x7eff7c068dc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.882+0000 7effa0879640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff9c154000 0x7eff9c1f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.882+0000 7effa0879640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff9c0700f0 0x7eff9c1ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.882+0000 7effa0879640 1 --2- 172.21.15.26:0/407280240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9c06df30 0x7eff9c0c4190 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:03.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.882+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 >> 172.21.15.26:0/407280240 conn(0x7eff9c0c2a60 msgr2=0x7eff9c0a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:03.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.886+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 shutdown_connections 2023-11-28T16:57:03.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:03.890+0000 7effa0879640 1 -- 172.21.15.26:0/407280240 wait complete. 2023-11-28T16:57:03.925 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.062+0000 7fd880157640 1 Processor -- start 2023-11-28T16:57:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.062+0000 7fd880157640 1 -- start start 2023-11-28T16:57:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd880157640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8780c5f20 0x7fd878151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd880157640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd878152070 0x7fd8780c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd880157640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878158b20 con 0x7fd8780c2ac0 2023-11-28T16:57:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd880157640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd878157f10 con 0x7fd878152070 2023-11-28T16:57:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd880157640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8781581f0 con 0x7fd8780c5f20 2023-11-28T16:57:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87e6f4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd878152070 0x7fd8780c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87e6f4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd878152070 0x7fd8780c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51858/0 (socket says 172.21.15.26:51858) 2023-11-28T16:57:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87e6f4640 1 -- 172.21.15.26:0/3512144461 learned_addr learned my addr 172.21.15.26:0/3512144461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87d6f2640 1 --2- 172.21.15.26:0/3512144461 >> v2:172.21.15.79:3300/0 conn(0x7fd8780c5f20 0x7fd878151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87e6f4640 1 -- 172.21.15.26:0/3512144461 >> v2:172.21.15.79:3300/0 conn(0x7fd8780c5f20 msgr2=0x7fd878151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87e6f4640 1 --2- 172.21.15.26:0/3512144461 >> v2:172.21.15.79:3300/0 conn(0x7fd8780c5f20 0x7fd878151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87e6f4640 1 -- 172.21.15.26:0/3512144461 >> v1:172.21.15.79:6789/0 conn(0x7fd8780c2ac0 legacy=0x7fd878070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.066+0000 7fd87e6f4640 1 -- 172.21.15.26:0/3512144461 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8781584d0 con 0x7fd878152070 2023-11-28T16:57:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd87e6f4640 1 --2- 172.21.15.26:0/3512144461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd8780c1290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd8780680b0 tx=0x7fd87001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180c9414e369e764 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd87cef1640 1 -- 172.21.15.26:0/3512144461 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780c1fe0 con 0x7fd878152070 2023-11-28T16:57:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd87cef1640 1 -- 172.21.15.26:0/3512144461 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8700a57f0 con 0x7fd878152070 2023-11-28T16:57:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd87cef1640 1 -- 172.21.15.26:0/3512144461 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8700a5b80 con 0x7fd878152070 2023-11-28T16:57:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- 172.21.15.26:0/3512144461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 msgr2=0x7fd8780c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 --2- 172.21.15.26:0/3512144461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd8780c1290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd8780680b0 tx=0x7fd87001c910 comp rx=0 tx=0).stop 2023-11-28T16:57:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- 172.21.15.26:0/3512144461 shutdown_connections 2023-11-28T16:57:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 --2- 172.21.15.26:0/3512144461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd8780c1290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 --2- 172.21.15.26:0/3512144461 >> v2:172.21.15.79:3300/0 conn(0x7fd8780c5f20 0x7fd878151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- 172.21.15.26:0/3512144461 >> 172.21.15.26:0/3512144461 conn(0x7fd8780a9c10 msgr2=0x7fd8780aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- 172.21.15.26:0/3512144461 shutdown_connections 2023-11-28T16:57:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- 172.21.15.26:0/3512144461 wait complete. 2023-11-28T16:57:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 Processor -- start 2023-11-28T16:57:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- start start 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8780c2ac0 0x7fd878145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8780c5f20 0x7fd87806b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd87806fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87806e7b0 con 0x7fd878152070 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878157cc0 con 0x7fd8780c2ac0 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.070+0000 7fd880157640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd878145830 con 0x7fd8780c5f20 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87e6f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd87806fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87d6f2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8780c5f20 0x7fd87806b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87def3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8780c2ac0 0x7fd878145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87d6f2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8780c5f20 0x7fd87806b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:56832/0 (socket says 172.21.15.26:56832) 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87d6f2640 1 -- 172.21.15.26:0/2205433551 learned_addr learned my addr 172.21.15.26:0/2205433551 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87def3640 1 -- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8780c5f20 msgr2=0x7fd87806b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87def3640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8780c5f20 0x7fd87806b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87def3640 1 -- 172.21.15.26:0/2205433551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 msgr2=0x7fd87806fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87def3640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd87806fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87def3640 1 -- 172.21.15.26:0/2205433551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870009b30 con 0x7fd8780c2ac0 2023-11-28T16:57:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87e6f4640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd87806fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd87def3640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8780c2ac0 0x7fd878145cc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c400 tx=0x7fd87400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd86e7fc640 1 -- 172.21.15.26:0/2205433551 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740052d0 con 0x7fd8780c2ac0 2023-11-28T16:57:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd86e7fc640 1 -- 172.21.15.26:0/2205433551 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874005430 con 0x7fd8780c2ac0 2023-11-28T16:57:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd86e7fc640 1 -- 172.21.15.26:0/2205433551 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874003840 con 0x7fd8780c2ac0 2023-11-28T16:57:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd878070700 con 0x7fd8780c2ac0 2023-11-28T16:57:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8780c7790 con 0x7fd8780c2ac0 2023-11-28T16:57:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87804e890 con 0x7fd8780c2ac0 2023-11-28T16:57:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.074+0000 7fd86e7fc640 1 -- 172.21.15.26:0/2205433551 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd8740039a0 con 0x7fd8780c2ac0 2023-11-28T16:57:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.078+0000 7fd86e7fc640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd85c0668d0 0x7fd85c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.078+0000 7fd86e7fc640 1 -- 172.21.15.26:0/2205433551 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd874083950 con 0x7fd8780c2ac0 2023-11-28T16:57:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.078+0000 7fd87d6f2640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd85c0668d0 0x7fd85c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.078+0000 7fd87d6f2640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd85c0668d0 0x7fd85c068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd87806d3d0 tx=0x7fd868009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.082+0000 7fd86e7fc640 1 -- 172.21.15.26:0/2205433551 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd874050c30 con 0x7fd8780c2ac0 2023-11-28T16:57:04.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.238+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd87814c010 con 0x7fd8780c2ac0 2023-11-28T16:57:04.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd86e7fc640 1 -- 172.21.15.26:0/2205433551 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16510 (secure 0 0 0) 0x7fd87814c010 con 0x7fd8780c2ac0 2023-11-28T16:57:04.248 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:04.248 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:03.254654+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd85c0668d0 msgr2=0x7fd85c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd85c0668d0 0x7fd85c068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd87806d3d0 tx=0x7fd868009190 comp rx=0 tx=0).stop 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8780c2ac0 msgr2=0x7fd878145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8780c2ac0 0x7fd878145cc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c400 tx=0x7fd87400c8c0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 shutdown_connections 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd878152070 0x7fd87806fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd85c0668d0 0x7fd85c068d90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8780c5f20 0x7fd87806b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 --2- 172.21.15.26:0/2205433551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8780c2ac0 0x7fd878145cc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 >> 172.21.15.26:0/2205433551 conn(0x7fd8780a9c10 msgr2=0x7fd8780c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 shutdown_connections 2023-11-28T16:57:04.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.242+0000 7fd880157640 1 -- 172.21.15.26:0/2205433551 wait complete. 2023-11-28T16:57:04.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:04.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb3052d6640 1 Processor -- start 2023-11-28T16:57:04.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb3052d6640 1 -- start start 2023-11-28T16:57:04.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb3052d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb300070b80 0x7fb300151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb3052d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3000a8470 0x7fb30006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb3052d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30006d320 con 0x7fb30014e9d0 2023-11-28T16:57:04.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb3052d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000721b0 con 0x7fb3000a8470 2023-11-28T16:57:04.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb3052d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c2830 con 0x7fb300070b80 2023-11-28T16:57:04.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb2feffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb30014e9d0 0x7fb3000c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49396/0 (socket says 172.21.15.26:49396) 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb2feffd640 1 -- 172.21.15.26:0/1492079537 learned_addr learned my addr 172.21.15.26:0/1492079537 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb2ff7fe640 1 --2- 172.21.15.26:0/1492079537 >> v2:172.21.15.26:3300/0 conn(0x7fb3000a8470 0x7fb30006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.406+0000 7fb2f7fff640 1 --2- 172.21.15.26:0/1492079537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb300070b80 0x7fb300151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2fe7fc640 1 -- 172.21.15.26:0/1492079537 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225256391 0 0) 0x7fb30006d320 con 0x7fb30014e9d0 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2fe7fc640 1 -- 172.21.15.26:0/1492079537 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec003530 con 0x7fb30014e9d0 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2ff7fe640 1 -- 172.21.15.26:0/1492079537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb300070b80 msgr2=0x7fb300151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2ff7fe640 1 --2- 172.21.15.26:0/1492079537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb300070b80 0x7fb300151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2ff7fe640 1 -- 172.21.15.26:0/1492079537 >> v1:172.21.15.26:6789/0 conn(0x7fb30014e9d0 legacy=0x7fb3000c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2ff7fe640 1 -- 172.21.15.26:0/1492079537 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300072450 con 0x7fb3000a8470 2023-11-28T16:57:04.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2ff7fe640 1 --2- 172.21.15.26:0/1492079537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3000a8470 0x7fb30006d7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009d90 tx=0x7fb2f801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7564a5d56ff5f0e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2fe7fc640 1 -- 172.21.15.26:0/1492079537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80a5790 con 0x7fb3000a8470 2023-11-28T16:57:04.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2fe7fc640 1 -- 172.21.15.26:0/1492079537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f80a58f0 con 0x7fb3000a8470 2023-11-28T16:57:04.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb2fe7fc640 1 -- 172.21.15.26:0/1492079537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80a5c60 con 0x7fb3000a8470 2023-11-28T16:57:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb3052d6640 1 -- 172.21.15.26:0/1492079537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3000a8470 msgr2=0x7fb30006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.410+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1492079537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3000a8470 0x7fb30006d7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009d90 tx=0x7fb2f801c8c0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- 172.21.15.26:0/1492079537 shutdown_connections 2023-11-28T16:57:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1492079537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3000a8470 0x7fb30006d7b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1492079537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb300070b80 0x7fb300151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- 172.21.15.26:0/1492079537 >> 172.21.15.26:0/1492079537 conn(0x7fb3000c2ad0 msgr2=0x7fb3000c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- 172.21.15.26:0/1492079537 shutdown_connections 2023-11-28T16:57:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- 172.21.15.26:0/1492079537 wait complete. 2023-11-28T16:57:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 Processor -- start 2023-11-28T16:57:04.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- start start 2023-11-28T16:57:04.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb300070b80 0x7fb300151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3000a8470 0x7fb3000aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb30014e9d0 0x7fb3000ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000aa970 con 0x7fb300070b80 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30014fd90 con 0x7fb30014e9d0 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb3052d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30014f210 con 0x7fb3000a8470 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb300070b80 0x7fb300151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb300070b80 0x7fb300151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51876/0 (socket says 172.21.15.26:51876) 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 -- 172.21.15.26:0/1567910250 learned_addr learned my addr 172.21.15.26:0/1567910250 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2f7fff640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3000a8470 0x7fb3000aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2ff7fe640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb30014e9d0 0x7fb3000ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 -- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3000a8470 msgr2=0x7fb3000aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3000a8470 0x7fb3000aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 -- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb30014e9d0 msgr2=0x7fb3000ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb30014e9d0 0x7fb3000ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 -- 172.21.15.26:0/1567910250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009a70 con 0x7fb300070b80 2023-11-28T16:57:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2ff7fe640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb30014e9d0 0x7fb3000ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.414+0000 7fb2feffd640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb300070b80 0x7fb300151170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c3c0 tx=0x7fb2f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb2f77fe640 1 -- 172.21.15.26:0/1567910250 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0005cf0 con 0x7fb300070b80 2023-11-28T16:57:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb2f77fe640 1 -- 172.21.15.26:0/1567910250 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0005e50 con 0x7fb300070b80 2023-11-28T16:57:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb2f77fe640 1 -- 172.21.15.26:0/1567910250 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00072f0 con 0x7fb300070b80 2023-11-28T16:57:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb300151b30 con 0x7fb300070b80 2023-11-28T16:57:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30014f7b0 con 0x7fb300070b80 2023-11-28T16:57:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3000aabe0 con 0x7fb300070b80 2023-11-28T16:57:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb2f77fe640 1 -- 172.21.15.26:0/1567910250 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb2f0007450 con 0x7fb300070b80 2023-11-28T16:57:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb2f77fe640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2e0066900 0x7fb2e0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb2f77fe640 1 -- 172.21.15.26:0/1567910250 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2f0083990 con 0x7fb300070b80 2023-11-28T16:57:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.418+0000 7fb2f7fff640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2e0066900 0x7fb2e0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.422+0000 7fb2f7fff640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2e0066900 0x7fb2e0068dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800b240 tx=0x7fb2e800b3a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.422+0000 7fb2f77fe640 1 -- 172.21.15.26:0/1567910250 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2f0050c60 con 0x7fb300070b80 2023-11-28T16:57:04.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb30014f9a0 con 0x7fb300070b80 2023-11-28T16:57:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb2f77fe640 1 -- 172.21.15.26:0/1567910250 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16510 (secure 0 0 0) 0x7fb2f0017070 con 0x7fb300070b80 2023-11-28T16:57:04.587 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:04.588 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:03.254654+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2e0066900 msgr2=0x7fb2e0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2e0066900 0x7fb2e0068dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800b240 tx=0x7fb2e800b3a0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb300070b80 msgr2=0x7fb300151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb300070b80 0x7fb300151170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c3c0 tx=0x7fb2f000c880 comp rx=0 tx=0).stop 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 shutdown_connections 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb30014e9d0 0x7fb3000ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2e0066900 0x7fb2e0068dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3000a8470 0x7fb3000aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 --2- 172.21.15.26:0/1567910250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb300070b80 0x7fb300151170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 >> 172.21.15.26:0/1567910250 conn(0x7fb3000c2ad0 msgr2=0x7fb3000c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 shutdown_connections 2023-11-28T16:57:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.582+0000 7fb3052d6640 1 -- 172.21.15.26:0/1567910250 wait complete. 2023-11-28T16:57:04.610 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T16:57:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f33501640 1 Processor -- start 2023-11-28T16:57:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f33501640 1 -- start start 2023-11-28T16:57:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f33501640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c14fd00 0x7f4f2c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f33501640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c152d90 con 0x7f4f2c156600 2023-11-28T16:57:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f33501640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c152480 con 0x7f4f2c0a86d0 2023-11-28T16:57:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f33501640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0a9760 con 0x7f4f2c14fd00 2023-11-28T16:57:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f30a9c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4f2c156600 0x7f4f2c14f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49404/0 (socket says 172.21.15.26:49404) 2023-11-28T16:57:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f30a9c640 1 -- 172.21.15.26:0/2628862616 learned_addr learned my addr 172.21.15.26:0/2628862616 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f31a9e640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c14fd00 0x7f4f2c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837643692 0 0) 0x7f4f2c152d90 con 0x7f4f2c156600 2023-11-28T16:57:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f18003530 con 0x7f4f2c156600 2023-11-28T16:57:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983455180 0 0) 0x7f4f2c152480 con 0x7f4f2c0a86d0 2023-11-28T16:57:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f2c152d90 con 0x7f4f2c0a86d0 2023-11-28T16:57:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.750+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3840977644 0 0) 0x7f4f18003530 con 0x7f4f2c156600 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c14fd00 msgr2=0x7f4f2c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c14fd00 0x7f4f2c0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 >> v1:172.21.15.79:6789/0 conn(0x7f4f2c0a86d0 legacy=0x7f4f2c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c152740 con 0x7f4f2c156600 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f4f1c001680 con 0x7f4f2c156600 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 >> v1:172.21.15.26:6789/0 conn(0x7f4f2c156600 legacy=0x7f4f2c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f18003b40 0x7f4f18003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f180047d0 0x7f4f18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f18005190 0x7f4f1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0a9760 con 0x7f4f18005190 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1800bf80 con 0x7f4f18003b40 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1800c140 con 0x7f4f180047d0 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c14fd00 0x7f4f2c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f18005190 0x7f4f1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f3129d640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f18003b40 0x7f4f18003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f30a9c640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f180047d0 0x7f4f18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 -- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f180047d0 msgr2=0x7f4f18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f180047d0 0x7f4f18004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 -- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f18003b40 msgr2=0x7f4f18003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f18003b40 0x7f4f18003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 -- 172.21.15.26:0/2628862616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18003530 con 0x7f4f18005190 2023-11-28T16:57:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f3129d640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f18003b40 0x7f4f18003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f31a9e640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f18005190 0x7f4f1800b990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c066ce0 tx=0x7f4f2401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce6d5a21a0d5ec7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240a5cf0 con 0x7f4f18005190 2023-11-28T16:57:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2400f040 con 0x7f4f18005190 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.754+0000 7f4f23fff640 1 -- 172.21.15.26:0/2628862616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24003bc0 con 0x7f4f18005190 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- 172.21.15.26:0/2628862616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f18005190 msgr2=0x7f4f1800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 --2- 172.21.15.26:0/2628862616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f18005190 0x7f4f1800b990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c066ce0 tx=0x7f4f2401cca0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f31a9e640 1 -- 172.21.15.26:0/2628862616 reap_dead start 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- 172.21.15.26:0/2628862616 shutdown_connections 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- 172.21.15.26:0/2628862616 >> 172.21.15.26:0/2628862616 conn(0x7f4f2c0c2a60 msgr2=0x7f4f2c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- 172.21.15.26:0/2628862616 shutdown_connections 2023-11-28T16:57:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- 172.21.15.26:0/2628862616 wait complete. 2023-11-28T16:57:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 Processor -- start 2023-11-28T16:57:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- start start 2023-11-28T16:57:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c151c20 0x7f4f2c1edd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f2c1dba00 0x7f4f2c154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2c1dbe60 0x7f4f2c154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c1dd060 con 0x7f4f2c1dba00 2023-11-28T16:57:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c1ed2d0 con 0x7f4f2c1dbe60 2023-11-28T16:57:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f33501640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c1850 con 0x7f4f2c151c20 2023-11-28T16:57:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f30a9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f2c1dba00 0x7f4f2c154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f30a9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f2c1dba00 0x7f4f2c154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51898/0 (socket says 172.21.15.26:51898) 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f30a9c640 1 -- 172.21.15.26:0/1508267857 learned_addr learned my addr 172.21.15.26:0/1508267857 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f3129d640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c151c20 0x7f4f2c1edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.758+0000 7f4f31a9e640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2c1dbe60 0x7f4f2c154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f30a9c640 1 -- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c151c20 msgr2=0x7f4f2c1edd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f30a9c640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c151c20 0x7f4f2c1edd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f30a9c640 1 -- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2c1dbe60 msgr2=0x7f4f2c154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f30a9c640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2c1dbe60 0x7f4f2c154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f30a9c640 1 -- 172.21.15.26:0/1508267857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c1533a0 con 0x7f4f2c1dba00 2023-11-28T16:57:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f30a9c640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f2c1dba00 0x7f4f2c154840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c012540 tx=0x7f4f1c012940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f21ffb640 1 -- 172.21.15.26:0/1508267857 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c014810 con 0x7f4f2c1dba00 2023-11-28T16:57:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f21ffb640 1 -- 172.21.15.26:0/1508267857 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c014970 con 0x7f4f2c1dba00 2023-11-28T16:57:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c150e30 con 0x7f4f2c1dba00 2023-11-28T16:57:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f21ffb640 1 -- 172.21.15.26:0/1508267857 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c014d00 con 0x7f4f2c1dba00 2023-11-28T16:57:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c1ed520 con 0x7f4f2c1dba00 2023-11-28T16:57:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c04e890 con 0x7f4f2c1dba00 2023-11-28T16:57:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f21ffb640 1 -- 172.21.15.26:0/1508267857 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4f1c0153e0 con 0x7f4f2c1dba00 2023-11-28T16:57:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f21ffb640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f10066900 0x7f4f10068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f21ffb640 1 -- 172.21.15.26:0/1508267857 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f1c086c60 con 0x7f4f2c1dba00 2023-11-28T16:57:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.762+0000 7f4f3129d640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f10066900 0x7f4f10068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.766+0000 7f4f3129d640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f10066900 0x7f4f10068dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000c10 tx=0x7f4f28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:04.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.766+0000 7f4f21ffb640 1 -- 172.21.15.26:0/1508267857 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f1c053f40 con 0x7f4f2c1dba00 2023-11-28T16:57:04.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:04.962+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4f2c14eb10 con 0x7f4f2c1dba00 2023-11-28T16:57:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.882+0000 7f4f21ffb640 1 -- 172.21.15.26:0/1508267857 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4f1c01c020 con 0x7f4f2c1dba00 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f10066900 msgr2=0x7f4f10068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f10066900 0x7f4f10068dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000c10 tx=0x7f4f28009040 comp rx=0 tx=0).stop 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f2c1dba00 msgr2=0x7f4f2c154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f2c1dba00 0x7f4f2c154840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c012540 tx=0x7f4f1c012940 comp rx=0 tx=0).stop 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 shutdown_connections 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2c1dbe60 0x7f4f2c154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f2c1dba00 0x7f4f2c154840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f10066900 0x7f4f10068dc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:05.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 --2- 172.21.15.26:0/1508267857 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f2c151c20 0x7f4f2c1edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:05.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 >> 172.21.15.26:0/1508267857 conn(0x7f4f2c0c2a60 msgr2=0x7f4f2c14ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:05.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 shutdown_connections 2023-11-28T16:57:05.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:05.886+0000 7f4f33501640 1 -- 172.21.15.26:0/1508267857 wait complete. 2023-11-28T16:57:05.915 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T16:57:05.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T16:57:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc3278c9640 1 Processor -- start 2023-11-28T16:57:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc3278c9640 1 -- start start 2023-11-28T16:57:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc3278c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3200a86d0 0x7fc3200a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc3278c9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc320156600 0x7fc32014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc3278c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc320152d90 con 0x7fc32014fb30 2023-11-28T16:57:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc3278c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32014ffa0 con 0x7fc3200a86d0 2023-11-28T16:57:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc3278c9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc320152480 con 0x7fc320156600 2023-11-28T16:57:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc325e66640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc32014fb30 0x7fc3200aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49412/0 (socket says 172.21.15.26:49412) 2023-11-28T16:57:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc325e66640 1 -- 172.21.15.26:0/3800150940 learned_addr learned my addr 172.21.15.26:0/3800150940 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc325665640 1 --2- 172.21.15.26:0/3800150940 >> v2:172.21.15.26:3300/0 conn(0x7fc3200a86d0 0x7fc3200a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc324e64640 1 --2- 172.21.15.26:0/3800150940 >> v2:172.21.15.79:3300/0 conn(0x7fc320156600 0x7fc32014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc317fff640 1 -- 172.21.15.26:0/3800150940 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521044470 0 0) 0x7fc320152d90 con 0x7fc32014fb30 2023-11-28T16:57:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc317fff640 1 -- 172.21.15.26:0/3800150940 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c003530 con 0x7fc32014fb30 2023-11-28T16:57:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc325665640 1 -- 172.21.15.26:0/3800150940 >> v2:172.21.15.79:3300/0 conn(0x7fc320156600 msgr2=0x7fc32014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc325665640 1 --2- 172.21.15.26:0/3800150940 >> v2:172.21.15.79:3300/0 conn(0x7fc320156600 0x7fc32014f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc325665640 1 -- 172.21.15.26:0/3800150940 >> v1:172.21.15.26:6789/0 conn(0x7fc32014fb30 legacy=0x7fc3200aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.062+0000 7fc325665640 1 -- 172.21.15.26:0/3800150940 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200a9760 con 0x7fc3200a86d0 2023-11-28T16:57:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc325665640 1 --2- 172.21.15.26:0/3800150940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3200a86d0 0x7fc3200a8f30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfd1fae286235cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc317fff640 1 -- 172.21.15.26:0/3800150940 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0ab600 con 0x7fc3200a86d0 2023-11-28T16:57:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc317fff640 1 -- 172.21.15.26:0/3800150940 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c0a7050 con 0x7fc3200a86d0 2023-11-28T16:57:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc317fff640 1 -- 172.21.15.26:0/3800150940 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0ab960 con 0x7fc3200a86d0 2023-11-28T16:57:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 -- 172.21.15.26:0/3800150940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3200a86d0 msgr2=0x7fc3200a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 --2- 172.21.15.26:0/3800150940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3200a86d0 0x7fc3200a8f30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c01c440 comp rx=0 tx=0).stop 2023-11-28T16:57:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 -- 172.21.15.26:0/3800150940 shutdown_connections 2023-11-28T16:57:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 --2- 172.21.15.26:0/3800150940 >> v2:172.21.15.79:3300/0 conn(0x7fc320156600 0x7fc32014f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 --2- 172.21.15.26:0/3800150940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3200a86d0 0x7fc3200a8f30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 -- 172.21.15.26:0/3800150940 >> 172.21.15.26:0/3800150940 conn(0x7fc3200c2a60 msgr2=0x7fc3200c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:06.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 -- 172.21.15.26:0/3800150940 shutdown_connections 2023-11-28T16:57:06.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.066+0000 7fc3278c9640 1 -- 172.21.15.26:0/3800150940 wait complete. 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 Processor -- start 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 -- start start 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3200a86d0 0x7fc3200704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc32014fb30 0x7fc3201f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc320156600 0x7fc32015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201f0f40 con 0x7fc32014fb30 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201ecbc0 con 0x7fc320156600 2023-11-28T16:57:06.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32014d850 con 0x7fc3200a86d0 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc32014fb30 0x7fc3201f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc32014fb30 0x7fc3201f0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51920/0 (socket says 172.21.15.26:51920) 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 -- 172.21.15.26:0/256025433 learned_addr learned my addr 172.21.15.26:0/256025433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc325665640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3200a86d0 0x7fc3200704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc325e66640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc320156600 0x7fc32015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 -- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3200a86d0 msgr2=0x7fc3200704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3200a86d0 0x7fc3200704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 -- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc320156600 msgr2=0x7fc32015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc320156600 0x7fc32015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 -- 172.21.15.26:0/256025433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009420 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc324e64640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc32014fb30 0x7fc3201f0a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc31000d7d0 tx=0x7fc31000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc315ffb640 1 -- 172.21.15.26:0/256025433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310018070 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc315ffb640 1 -- 172.21.15.26:0/256025433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310004020 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc315ffb640 1 -- 172.21.15.26:0/256025433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100041d0 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3201533a0 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.070+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3201ece60 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.074+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32014d5a0 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.074+0000 7fc315ffb640 1 -- 172.21.15.26:0/256025433 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc310004330 con 0x7fc32014fb30 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.074+0000 7fc315ffb640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3040668d0 0x7fc304068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:06.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.074+0000 7fc315ffb640 1 -- 172.21.15.26:0/256025433 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc310084190 con 0x7fc32014fb30 2023-11-28T16:57:06.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.074+0000 7fc325665640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3040668d0 0x7fc304068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:06.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.074+0000 7fc325665640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3040668d0 0x7fc304068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ad000 tx=0x7fc31c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:06.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.078+0000 7fc315ffb640 1 -- 172.21.15.26:0/256025433 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc310051480 con 0x7fc32014fb30 2023-11-28T16:57:06.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.270+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc32004e890 con 0x7fc32014fb30 2023-11-28T16:57:06.849 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-11-28T16:57:06.842+0000 7f274f58a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:57:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.890+0000 7fc315ffb640 1 -- 172.21.15.26:0/256025433 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc310054aa0 con 0x7fc32014fb30 2023-11-28T16:57:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3040668d0 msgr2=0x7fc304068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3040668d0 0x7fc304068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ad000 tx=0x7fc31c0a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc32014fb30 msgr2=0x7fc3201f0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc32014fb30 0x7fc3201f0a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc31000d7d0 tx=0x7fc31000dc90 comp rx=0 tx=0).stop 2023-11-28T16:57:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 shutdown_connections 2023-11-28T16:57:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc320156600 0x7fc32015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc32014fb30 0x7fc3201f0a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3040668d0 0x7fc304068d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 --2- 172.21.15.26:0/256025433 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3200a86d0 0x7fc3200704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 >> 172.21.15.26:0/256025433 conn(0x7fc3200c2a60 msgr2=0x7fc3200c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 shutdown_connections 2023-11-28T16:57:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:06.894+0000 7fc3278c9640 1 -- 172.21.15.26:0/256025433 wait complete. 2023-11-28T16:57:06.920 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T16:57:06.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:07.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.058+0000 7f90b92aa640 1 Processor -- start 2023-11-28T16:57:07.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.058+0000 7f90b92aa640 1 -- start start 2023-11-28T16:57:07.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b92aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90b40c2ac0 0x7f90b4070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b92aa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b4158b20 con 0x7f90b40c5f20 2023-11-28T16:57:07.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b92aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b4070ba0 con 0x7f90b40c1290 2023-11-28T16:57:07.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b92aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b4157f10 con 0x7f90b40c2ac0 2023-11-28T16:57:07.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90abfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f90b40c5f20 0x7f90b4151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49414/0 (socket says 172.21.15.26:49414) 2023-11-28T16:57:07.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90abfff640 1 -- 172.21.15.26:0/1215284645 learned_addr learned my addr 172.21.15.26:0/1215284645 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:07.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b2ffd640 1 --2- 172.21.15.26:0/1215284645 >> v2:172.21.15.79:3300/0 conn(0x7f90b40c2ac0 0x7f90b4070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b27fc640 1 -- 172.21.15.26:0/1215284645 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748750702 0 0) 0x7f90b4158b20 con 0x7f90b40c5f20 2023-11-28T16:57:07.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b27fc640 1 -- 172.21.15.26:0/1215284645 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a0003530 con 0x7f90b40c5f20 2023-11-28T16:57:07.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b2ffd640 1 -- 172.21.15.26:0/1215284645 >> v1:172.21.15.79:6789/0 conn(0x7f90b40c1290 legacy=0x7f90b40c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b2ffd640 1 -- 172.21.15.26:0/1215284645 >> v1:172.21.15.26:6789/0 conn(0x7f90b40c5f20 legacy=0x7f90b4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b2ffd640 1 -- 172.21.15.26:0/1215284645 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b41581f0 con 0x7f90b40c2ac0 2023-11-28T16:57:07.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.062+0000 7f90b2ffd640 1 --2- 172.21.15.26:0/1215284645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c2ac0 0x7f90b4070660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90a40097c0 tx=0x7f90a401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d18292c260fc6fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b27fc640 1 -- 172.21.15.26:0/1215284645 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40ac620 con 0x7f90b40c2ac0 2023-11-28T16:57:07.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b27fc640 1 -- 172.21.15.26:0/1215284645 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a40ac780 con 0x7f90b40c2ac0 2023-11-28T16:57:07.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b27fc640 1 -- 172.21.15.26:0/1215284645 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40acb10 con 0x7f90b40c2ac0 2023-11-28T16:57:07.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- 172.21.15.26:0/1215284645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c2ac0 msgr2=0x7f90b4070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 --2- 172.21.15.26:0/1215284645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c2ac0 0x7f90b4070660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90a40097c0 tx=0x7f90a401c3c0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- 172.21.15.26:0/1215284645 shutdown_connections 2023-11-28T16:57:07.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 --2- 172.21.15.26:0/1215284645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c2ac0 0x7f90b4070660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- 172.21.15.26:0/1215284645 >> 172.21.15.26:0/1215284645 conn(0x7f90b40a9c10 msgr2=0x7f90b40aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:07.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- 172.21.15.26:0/1215284645 shutdown_connections 2023-11-28T16:57:07.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- 172.21.15.26:0/1215284645 wait complete. 2023-11-28T16:57:07.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 Processor -- start 2023-11-28T16:57:07.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- start start 2023-11-28T16:57:07.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40c1290 0x7f90b406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90b40c2ac0 0x7f90b4144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c5f20 0x7f90b4145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40ac740 con 0x7f90b40c1290 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b4145670 con 0x7f90b40c5f20 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b92aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41f0be0 con 0x7f90b40c2ac0 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40c1290 0x7f90b406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40c1290 0x7f90b406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51932/0 (socket says 172.21.15.26:51932) 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b2ffd640 1 -- 172.21.15.26:0/3027569147 learned_addr learned my addr 172.21.15.26:0/3027569147 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90b37fe640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c5f20 0x7f90b4145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.066+0000 7f90abfff640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90b40c2ac0 0x7f90b4144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b2ffd640 1 -- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90b40c2ac0 msgr2=0x7f90b4144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b2ffd640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90b40c2ac0 0x7f90b4144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b2ffd640 1 -- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c5f20 msgr2=0x7f90b4145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b2ffd640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c5f20 0x7f90b4145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b2ffd640 1 -- 172.21.15.26:0/3027569147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a4009420 con 0x7f90b40c1290 2023-11-28T16:57:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b2ffd640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40c1290 0x7f90b406c6c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90a40af040 tx=0x7f90a401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90ab7fe640 1 -- 172.21.15.26:0/3027569147 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40b8450 con 0x7f90b40c1290 2023-11-28T16:57:07.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90ab7fe640 1 -- 172.21.15.26:0/3027569147 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a40b85d0 con 0x7f90b40c1290 2023-11-28T16:57:07.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b41f0ec0 con 0x7f90b40c1290 2023-11-28T16:57:07.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90ab7fe640 1 -- 172.21.15.26:0/3027569147 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40b8980 con 0x7f90b40c1290 2023-11-28T16:57:07.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b40ac360 con 0x7f90b40c1290 2023-11-28T16:57:07.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b40ac880 con 0x7f90b40c1290 2023-11-28T16:57:07.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90ab7fe640 1 -- 172.21.15.26:0/3027569147 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f90a40aa070 con 0x7f90b40c1290 2023-11-28T16:57:07.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90ab7fe640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90940668d0 0x7f9094068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.070+0000 7f90ab7fe640 1 -- 172.21.15.26:0/3027569147 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90a411e8f0 con 0x7f90b40c1290 2023-11-28T16:57:07.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.074+0000 7f90abfff640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90940668d0 0x7f9094068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.074+0000 7f90abfff640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90940668d0 0x7f9094068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90b4070560 tx=0x7f909c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.074+0000 7f90ab7fe640 1 -- 172.21.15.26:0/3027569147 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90a40ebcf0 con 0x7f90b40c1290 2023-11-28T16:57:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.262+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90b41ecc60 con 0x7f90b40c1290 2023-11-28T16:57:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.262+0000 7f90ab7fe640 1 -- 172.21.15.26:0/3027569147 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f90a40bc090 con 0x7f90b40c1290 2023-11-28T16:57:07.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:07.270 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:03.255028+0000","modified":"2023-11-28T16:57:06.275664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4984":{"gid":4984,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/756252810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":756252810},{"type":"v1","addr":"172.21.15.26:6835","nonce":756252810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T16:57:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 16 2023-11-28T16:57:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90940668d0 msgr2=0x7f9094068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90940668d0 0x7f9094068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90b4070560 tx=0x7f909c007d40 comp rx=0 tx=0).stop 2023-11-28T16:57:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40c1290 msgr2=0x7f90b406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40c1290 0x7f90b406c6c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90a40af040 tx=0x7f90a401ac00 comp rx=0 tx=0).stop 2023-11-28T16:57:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 shutdown_connections 2023-11-28T16:57:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90b40c5f20 0x7f90b4145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90940668d0 0x7f9094068d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90b40c2ac0 0x7f90b4144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 --2- 172.21.15.26:0/3027569147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40c1290 0x7f90b406c6c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 >> 172.21.15.26:0/3027569147 conn(0x7f90b40a9c10 msgr2=0x7f90b41501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 shutdown_connections 2023-11-28T16:57:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.266+0000 7f90b92aa640 1 -- 172.21.15.26:0/3027569147 wait complete. 2023-11-28T16:57:07.291 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:07.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.426+0000 7f811639d640 1 Processor -- start 2023-11-28T16:57:07.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.426+0000 7f811639d640 1 -- start start 2023-11-28T16:57:07.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811639d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811014fcc0 0x7f8110156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811639d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81100c19e0 0x7f81100c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811639d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100ab580 con 0x7f811006d980 2023-11-28T16:57:07.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811639d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100aa340 con 0x7f81100c19e0 2023-11-28T16:57:07.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811639d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110152fe0 con 0x7f811014fcc0 2023-11-28T16:57:07.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f810f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f811006d980 0x7f81100aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49428/0 (socket says 172.21.15.26:49428) 2023-11-28T16:57:07.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f810f7fe640 1 -- 172.21.15.26:0/2711314372 learned_addr learned my addr 172.21.15.26:0/2711314372 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:07.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811493a640 1 --2- 172.21.15.26:0/2711314372 >> v2:172.21.15.26:3300/0 conn(0x7f81100c19e0 0x7f81100c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f810ffff640 1 --2- 172.21.15.26:0/2711314372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811014fcc0 0x7f8110156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f810effd640 1 -- 172.21.15.26:0/2711314372 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505260662 0 0) 0x7f81100ab580 con 0x7f811006d980 2023-11-28T16:57:07.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f810effd640 1 -- 172.21.15.26:0/2711314372 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f8003530 con 0x7f811006d980 2023-11-28T16:57:07.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811493a640 1 -- 172.21.15.26:0/2711314372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811014fcc0 msgr2=0x7f8110156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:07.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811493a640 1 --2- 172.21.15.26:0/2711314372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811014fcc0 0x7f8110156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811493a640 1 -- 172.21.15.26:0/2711314372 >> v1:172.21.15.26:6789/0 conn(0x7f811006d980 legacy=0x7f81100aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.430+0000 7f811493a640 1 -- 172.21.15.26:0/2711314372 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81101532c0 con 0x7f81100c19e0 2023-11-28T16:57:07.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811493a640 1 --2- 172.21.15.26:0/2711314372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81100c19e0 0x7f81100c1e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8108009d90 tx=0x7f810801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a29f7b66a05a0b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f810effd640 1 -- 172.21.15.26:0/2711314372 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080a58f0 con 0x7f81100c19e0 2023-11-28T16:57:07.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f810effd640 1 -- 172.21.15.26:0/2711314372 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080a5a50 con 0x7f81100c19e0 2023-11-28T16:57:07.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f810effd640 1 -- 172.21.15.26:0/2711314372 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080a5dc0 con 0x7f81100c19e0 2023-11-28T16:57:07.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 -- 172.21.15.26:0/2711314372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81100c19e0 msgr2=0x7f81100c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 --2- 172.21.15.26:0/2711314372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81100c19e0 0x7f81100c1e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8108009d90 tx=0x7f810801c920 comp rx=0 tx=0).stop 2023-11-28T16:57:07.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 -- 172.21.15.26:0/2711314372 shutdown_connections 2023-11-28T16:57:07.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 --2- 172.21.15.26:0/2711314372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81100c19e0 0x7f81100c1e70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 --2- 172.21.15.26:0/2711314372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811014fcc0 0x7f8110156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 -- 172.21.15.26:0/2711314372 >> 172.21.15.26:0/2711314372 conn(0x7f81100c2ad0 msgr2=0x7f81100c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:07.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 -- 172.21.15.26:0/2711314372 shutdown_connections 2023-11-28T16:57:07.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 -- 172.21.15.26:0/2711314372 wait complete. 2023-11-28T16:57:07.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 Processor -- start 2023-11-28T16:57:07.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.434+0000 7f811639d640 1 -- start start 2023-11-28T16:57:07.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006d980 0x7f81100c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c19e0 0x7f8110070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81101f0180 0x7f811014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110071fd0 con 0x7f811006d980 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100c4c70 con 0x7f81100c19e0 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100c59b0 con 0x7f81101f0180 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006d980 0x7f81100c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006d980 0x7f81100c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51956/0 (socket says 172.21.15.26:51956) 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 -- 172.21.15.26:0/104388471 learned_addr learned my addr 172.21.15.26:0/104388471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810f7fe640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c19e0 0x7f8110070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811493a640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81101f0180 0x7f811014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 -- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81101f0180 msgr2=0x7f811014a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81101f0180 0x7f811014a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 -- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c19e0 msgr2=0x7f8110070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c19e0 0x7f8110070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 -- 172.21.15.26:0/104388471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108009a70 con 0x7f811006d980 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810ffff640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006d980 0x7f81100c4730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f810000e8a0 tx=0x7f810000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810cff9640 1 -- 172.21.15.26:0/104388471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100009510 con 0x7f811006d980 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810cff9640 1 -- 172.21.15.26:0/104388471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810000c940 con 0x7f811006d980 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f810cff9640 1 -- 172.21.15.26:0/104388471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810000ccb0 con 0x7f811006d980 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81101f0ad0 con 0x7f811006d980 2023-11-28T16:57:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100c56d0 con 0x7f811006d980 2023-11-28T16:57:07.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.438+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811006dd60 con 0x7f811006d980 2023-11-28T16:57:07.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.442+0000 7f810cff9640 1 -- 172.21.15.26:0/104388471 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8100013470 con 0x7f811006d980 2023-11-28T16:57:07.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.442+0000 7f810cff9640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80fc0668d0 0x7f80fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.442+0000 7f810cff9640 1 -- 172.21.15.26:0/104388471 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81000845b0 con 0x7f811006d980 2023-11-28T16:57:07.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.442+0000 7f810f7fe640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80fc0668d0 0x7f80fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.442+0000 7f810f7fe640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80fc0668d0 0x7f80fc068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f81101edaa0 tx=0x7f8104009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.446+0000 7f810cff9640 1 -- 172.21.15.26:0/104388471 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f811006dd60 con 0x7f811006d980 2023-11-28T16:57:07.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.606+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f811006dd60 con 0x7f811006d980 2023-11-28T16:57:07.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.606+0000 7f810cff9640 1 -- 172.21.15.26:0/104388471 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16497 (secure 0 0 0) 0x7f811006dd60 con 0x7f811006d980 2023-11-28T16:57:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:07.613 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:04.874436+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80fc0668d0 msgr2=0x7f80fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80fc0668d0 0x7f80fc068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f81101edaa0 tx=0x7f8104009040 comp rx=0 tx=0).stop 2023-11-28T16:57:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006d980 msgr2=0x7f81100c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006d980 0x7f81100c4730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f810000e8a0 tx=0x7f810000eca0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 shutdown_connections 2023-11-28T16:57:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80fc0668d0 0x7f80fc068d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81101f0180 0x7f811014a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c19e0 0x7f8110070ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 --2- 172.21.15.26:0/104388471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006d980 0x7f81100c4730 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 >> 172.21.15.26:0/104388471 conn(0x7f81100c2ad0 msgr2=0x7f8110156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 shutdown_connections 2023-11-28T16:57:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.610+0000 7f811639d640 1 -- 172.21.15.26:0/104388471 wait complete. 2023-11-28T16:57:07.635 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T16:57:07.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:57:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91efb8640 1 Processor -- start 2023-11-28T16:57:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91efb8640 1 -- start start 2023-11-28T16:57:07.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91efb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 0x7fb9180c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91efb8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9180bd720 0x7fb9180c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91efb8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb918155790 con 0x7fb91806cd90 2023-11-28T16:57:07.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91efb8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180c4b00 con 0x7fb9180bd720 2023-11-28T16:57:07.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91efb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c4de0 con 0x7fb9180ca610 2023-11-28T16:57:07.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91d555640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb91806cd90 0x7fb918158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49430/0 (socket says 172.21.15.26:49430) 2023-11-28T16:57:07.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91d555640 1 -- 172.21.15.26:0/2551896174 learned_addr learned my addr 172.21.15.26:0/2551896174 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:07.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91cd54640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 0x7fb9180c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259372507 0 0) 0x7fb918155790 con 0x7fb91806cd90 2023-11-28T16:57:07.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90ffff640 1 --2- 172.21.15.26:0/2551896174 >> v2:172.21.15.79:3300/0 conn(0x7fb9180bd720 0x7fb9180c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb900003530 con 0x7fb91806cd90 2023-11-28T16:57:07.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4071432309 0 0) 0x7fb900003530 con 0x7fb91806cd90 2023-11-28T16:57:07.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 msgr2=0x7fb9180c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:07.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 0x7fb9180c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 >> v2:172.21.15.79:3300/0 conn(0x7fb9180bd720 msgr2=0x7fb9180c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:07.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 --2- 172.21.15.26:0/2551896174 >> v2:172.21.15.79:3300/0 conn(0x7fb9180bd720 0x7fb9180c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918157e30 con 0x7fb91806cd90 2023-11-28T16:57:07.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fb910001a00 con 0x7fb91806cd90 2023-11-28T16:57:07.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 >> v1:172.21.15.26:6789/0 conn(0x7fb91806cd90 legacy=0x7fb918158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 0x7fb900003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900003f00 0x7fb9000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb900004d10 0x7fb900005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c4b00 con 0x7fb900003f00 2023-11-28T16:57:07.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c4de0 con 0x7fb900004d10 2023-11-28T16:57:07.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90000ba70 con 0x7fb9180ca610 2023-11-28T16:57:07.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90ffff640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900003f00 0x7fb9000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91cd54640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 0x7fb900003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91d555640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb900004d10 0x7fb900005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90ffff640 1 -- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 msgr2=0x7fb900003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:07.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90ffff640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9180ca610 0x7fb900003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90ffff640 1 -- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb900004d10 msgr2=0x7fb900005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:07.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90ffff640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb900004d10 0x7fb900005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb90ffff640 1 -- 172.21.15.26:0/2551896174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900003530 con 0x7fb900003f00 2023-11-28T16:57:07.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.774+0000 7fb91d555640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb900004d10 0x7fb900005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb90ffff640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900003f00 0x7fb9000047d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb908009ae0 tx=0x7fb90801c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a326220b2c742cb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180c52d0 con 0x7fb900003f00 2023-11-28T16:57:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9080a4ac0 con 0x7fb900003f00 2023-11-28T16:57:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb90f7fe640 1 -- 172.21.15.26:0/2551896174 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080a4e70 con 0x7fb900003f00 2023-11-28T16:57:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb91efb8640 1 -- 172.21.15.26:0/2551896174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900003f00 msgr2=0x7fb9000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb91efb8640 1 --2- 172.21.15.26:0/2551896174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900003f00 0x7fb9000047d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb908009ae0 tx=0x7fb90801c770 comp rx=0 tx=0).stop 2023-11-28T16:57:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb91d555640 1 -- 172.21.15.26:0/2551896174 reap_dead start 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb91efb8640 1 -- 172.21.15.26:0/2551896174 shutdown_connections 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb91efb8640 1 -- 172.21.15.26:0/2551896174 >> 172.21.15.26:0/2551896174 conn(0x7fb918071ea0 msgr2=0x7fb9180722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb91efb8640 1 -- 172.21.15.26:0/2551896174 shutdown_connections 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.778+0000 7fb91efb8640 1 -- 172.21.15.26:0/2551896174 wait complete. 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 Processor -- start 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 -- start start 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb91814e2e0 0x7fb9180ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9181ee610 0x7fb9180aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9180aab30 0x7fb9181e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180abb80 con 0x7fb9180aab30 2023-11-28T16:57:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9181eea90 con 0x7fb9181ee610 2023-11-28T16:57:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180aafb0 con 0x7fb91814e2e0 2023-11-28T16:57:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9180aab30 0x7fb9181e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9180aab30 0x7fb9181e13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51984/0 (socket says 172.21.15.26:51984) 2023-11-28T16:57:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 -- 172.21.15.26:0/3069747864 learned_addr learned my addr 172.21.15.26:0/3069747864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 -- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb91814e2e0 msgr2=0x7fb9180ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb91814e2e0 0x7fb9180ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 -- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9181ee610 msgr2=0x7fb9180aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9181ee610 0x7fb9180aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 -- 172.21.15.26:0/3069747864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91814e6c0 con 0x7fb9180aab30 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91d555640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9180aab30 0x7fb9181e13f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb9180c5d50 tx=0x7fb91000e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb90d7fa640 1 -- 172.21.15.26:0/3069747864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910017070 con 0x7fb9180aab30 2023-11-28T16:57:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb90d7fa640 1 -- 172.21.15.26:0/3069747864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb910013420 con 0x7fb9180aab30 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb90d7fa640 1 -- 172.21.15.26:0/3069747864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100135b0 con 0x7fb9180aab30 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9180a9a70 con 0x7fb9180aab30 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.782+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9180aa030 con 0x7fb9180aab30 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.786+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91804e890 con 0x7fb9180aab30 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.786+0000 7fb90d7fa640 1 -- 172.21.15.26:0/3069747864 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb910013710 con 0x7fb9180aab30 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.786+0000 7fb90d7fa640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb904066900 0x7fb904068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.786+0000 7fb90d7fa640 1 -- 172.21.15.26:0/3069747864 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9100843c0 con 0x7fb9180aab30 2023-11-28T16:57:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.786+0000 7fb91cd54640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb904066900 0x7fb904068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:07.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.786+0000 7fb91cd54640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb904066900 0x7fb904068dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb914006d50 tx=0x7fb914006c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:07.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.790+0000 7fb90d7fa640 1 -- 172.21.15.26:0/3069747864 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9100515f0 con 0x7fb9180aab30 2023-11-28T16:57:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.946+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb91806cb70 con 0x7fb904066900 2023-11-28T16:57:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.954+0000 7fb90d7fa640 1 -- 172.21.15.26:0/3069747864 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7fb91806cb70 con 0x7fb904066900 2023-11-28T16:57:07.963 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:07.965 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:57:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb904066900 msgr2=0x7fb904068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb904066900 0x7fb904068dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb914006d50 tx=0x7fb914006c40 comp rx=0 tx=0).stop 2023-11-28T16:57:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9180aab30 msgr2=0x7fb9181e13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9180aab30 0x7fb9181e13f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb9180c5d50 tx=0x7fb91000e5f0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 shutdown_connections 2023-11-28T16:57:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9180aab30 0x7fb9181e13f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9181ee610 0x7fb9180aa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb904066900 0x7fb904068dc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 --2- 172.21.15.26:0/3069747864 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb91814e2e0 0x7fb9180ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 >> 172.21.15.26:0/3069747864 conn(0x7fb918071ea0 msgr2=0x7fb9181532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 shutdown_connections 2023-11-28T16:57:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:07.958+0000 7fb91efb8640 1 -- 172.21.15.26:0/3069747864 wait complete. 2023-11-28T16:57:07.984 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-28T16:57:07.585308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236732,"kb_used_data":3916,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737988,"statfs":{"total":773094113280,"available":772851699712,"internally_reserved":0,"allocated":4009984,"data_stored":2242083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.729049"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900969+0000","last_change":"2023-11-28T16:57:03.894170+0000","last_active":"2023-11-28T16:57:03.900969+0000","last_peered":"2023-11-28T16:57:03.900969+0000","last_clean":"2023-11-28T16:57:03.900969+0000","last_became_active":"2023-11-28T16:57:03.893856+0000","last_became_peered":"2023-11-28T16:57:03.893856+0000","last_unstale":"2023-11-28T16:57:03.900969+0000","last_undegraded":"2023-11-28T16:57:03.900969+0000","last_fullsized":"2023-11-28T16:57:03.900969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:42.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911089+0000","last_change":"2023-11-28T16:57:03.896151+0000","last_active":"2023-11-28T16:57:03.911089+0000","last_peered":"2023-11-28T16:57:03.911089+0000","last_clean":"2023-11-28T16:57:03.911089+0000","last_became_active":"2023-11-28T16:57:03.891088+0000","last_became_peered":"2023-11-28T16:57:03.891088+0000","last_unstale":"2023-11-28T16:57:03.911089+0000","last_undegraded":"2023-11-28T16:57:03.911089+0000","last_fullsized":"2023-11-28T16:57:03.911089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.907201+0000","last_change":"2023-11-28T16:57:03.905652+0000","last_active":"2023-11-28T16:57:03.907201+0000","last_peered":"2023-11-28T16:57:03.907201+0000","last_clean":"2023-11-28T16:57:03.907201+0000","last_became_active":"2023-11-28T16:57:03.905310+0000","last_became_peered":"2023-11-28T16:57:03.905310+0000","last_unstale":"2023-11-28T16:57:03.907201+0000","last_undegraded":"2023-11-28T16:57:03.907201+0000","last_fullsized":"2023-11-28T16:57:03.907201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.885448+0000","last_change":"2023-11-28T16:57:03.881735+0000","last_active":"2023-11-28T16:57:03.885448+0000","last_peered":"2023-11-28T16:57:03.885448+0000","last_clean":"2023-11-28T16:57:03.885448+0000","last_became_active":"2023-11-28T16:57:03.881212+0000","last_became_peered":"2023-11-28T16:57:03.881212+0000","last_unstale":"2023-11-28T16:57:03.885448+0000","last_undegraded":"2023-11-28T16:57:03.885448+0000","last_fullsized":"2023-11-28T16:57:03.885448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:21.117551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900190+0000","last_change":"2023-11-28T16:57:03.895662+0000","last_active":"2023-11-28T16:57:03.900190+0000","last_peered":"2023-11-28T16:57:03.900190+0000","last_clean":"2023-11-28T16:57:03.900190+0000","last_became_active":"2023-11-28T16:57:03.895366+0000","last_became_peered":"2023-11-28T16:57:03.895366+0000","last_unstale":"2023-11-28T16:57:03.900190+0000","last_undegraded":"2023-11-28T16:57:03.900190+0000","last_fullsized":"2023-11-28T16:57:03.900190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:18:22.025823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894887+0000","last_change":"2023-11-28T16:57:03.884669+0000","last_active":"2023-11-28T16:57:03.894887+0000","last_peered":"2023-11-28T16:57:03.894887+0000","last_clean":"2023-11-28T16:57:03.894887+0000","last_became_active":"2023-11-28T16:57:03.884388+0000","last_became_peered":"2023-11-28T16:57:03.884388+0000","last_unstale":"2023-11-28T16:57:03.894887+0000","last_undegraded":"2023-11-28T16:57:03.894887+0000","last_fullsized":"2023-11-28T16:57:03.894887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903634+0000","last_change":"2023-11-28T16:57:03.896614+0000","last_active":"2023-11-28T16:57:03.903634+0000","last_peered":"2023-11-28T16:57:03.903634+0000","last_clean":"2023-11-28T16:57:03.903634+0000","last_became_active":"2023-11-28T16:57:03.896037+0000","last_became_peered":"2023-11-28T16:57:03.896037+0000","last_unstale":"2023-11-28T16:57:03.903634+0000","last_undegraded":"2023-11-28T16:57:03.903634+0000","last_fullsized":"2023-11-28T16:57:03.903634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.586951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903439+0000","last_change":"2023-11-28T16:57:03.894793+0000","last_active":"2023-11-28T16:57:03.903439+0000","last_peered":"2023-11-28T16:57:03.903439+0000","last_clean":"2023-11-28T16:57:03.903439+0000","last_became_active":"2023-11-28T16:57:03.887901+0000","last_became_peered":"2023-11-28T16:57:03.887901+0000","last_unstale":"2023-11-28T16:57:03.903439+0000","last_undegraded":"2023-11-28T16:57:03.903439+0000","last_fullsized":"2023-11-28T16:57:03.903439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.888467+0000","last_change":"2023-11-28T16:57:03.884223+0000","last_active":"2023-11-28T16:57:03.888467+0000","last_peered":"2023-11-28T16:57:03.888467+0000","last_clean":"2023-11-28T16:57:03.888467+0000","last_became_active":"2023-11-28T16:57:03.883861+0000","last_became_peered":"2023-11-28T16:57:03.883861+0000","last_unstale":"2023-11-28T16:57:03.888467+0000","last_undegraded":"2023-11-28T16:57:03.888467+0000","last_fullsized":"2023-11-28T16:57:03.888467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:07:32.729943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.908671+0000","last_change":"2023-11-28T16:57:03.898138+0000","last_active":"2023-11-28T16:57:03.908671+0000","last_peered":"2023-11-28T16:57:03.908671+0000","last_clean":"2023-11-28T16:57:03.908671+0000","last_became_active":"2023-11-28T16:57:03.897728+0000","last_became_peered":"2023-11-28T16:57:03.897728+0000","last_unstale":"2023-11-28T16:57:03.908671+0000","last_undegraded":"2023-11-28T16:57:03.908671+0000","last_fullsized":"2023-11-28T16:57:03.908671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899409+0000","last_change":"2023-11-28T16:57:03.887859+0000","last_active":"2023-11-28T16:57:03.899409+0000","last_peered":"2023-11-28T16:57:03.899409+0000","last_clean":"2023-11-28T16:57:03.899409+0000","last_became_active":"2023-11-28T16:57:03.887591+0000","last_became_peered":"2023-11-28T16:57:03.887591+0000","last_unstale":"2023-11-28T16:57:03.899409+0000","last_undegraded":"2023-11-28T16:57:03.899409+0000","last_fullsized":"2023-11-28T16:57:03.899409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:46.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901142+0000","last_change":"2023-11-28T16:57:03.896260+0000","last_active":"2023-11-28T16:57:03.901142+0000","last_peered":"2023-11-28T16:57:03.901142+0000","last_clean":"2023-11-28T16:57:03.901142+0000","last_became_active":"2023-11-28T16:57:03.894336+0000","last_became_peered":"2023-11-28T16:57:03.894336+0000","last_unstale":"2023-11-28T16:57:03.901142+0000","last_undegraded":"2023-11-28T16:57:03.901142+0000","last_fullsized":"2023-11-28T16:57:03.901142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894894+0000","last_change":"2023-11-28T16:57:03.890754+0000","last_active":"2023-11-28T16:57:03.894894+0000","last_peered":"2023-11-28T16:57:03.894894+0000","last_clean":"2023-11-28T16:57:03.894894+0000","last_became_active":"2023-11-28T16:57:03.890427+0000","last_became_peered":"2023-11-28T16:57:03.890427+0000","last_unstale":"2023-11-28T16:57:03.894894+0000","last_undegraded":"2023-11-28T16:57:03.894894+0000","last_fullsized":"2023-11-28T16:57:03.894894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:48.826550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.905608+0000","last_change":"2023-11-28T16:57:03.889443+0000","last_active":"2023-11-28T16:57:03.905608+0000","last_peered":"2023-11-28T16:57:03.905608+0000","last_clean":"2023-11-28T16:57:03.905608+0000","last_became_active":"2023-11-28T16:57:03.888958+0000","last_became_peered":"2023-11-28T16:57:03.888958+0000","last_unstale":"2023-11-28T16:57:03.905608+0000","last_undegraded":"2023-11-28T16:57:03.905608+0000","last_fullsized":"2023-11-28T16:57:03.905608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901302+0000","last_change":"2023-11-28T16:57:03.895417+0000","last_active":"2023-11-28T16:57:03.901302+0000","last_peered":"2023-11-28T16:57:03.901302+0000","last_clean":"2023-11-28T16:57:03.901302+0000","last_became_active":"2023-11-28T16:57:03.895139+0000","last_became_peered":"2023-11-28T16:57:03.895139+0000","last_unstale":"2023-11-28T16:57:03.901302+0000","last_undegraded":"2023-11-28T16:57:03.901302+0000","last_fullsized":"2023-11-28T16:57:03.901302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.904588+0000","last_change":"2023-11-28T16:57:03.899703+0000","last_active":"2023-11-28T16:57:03.904588+0000","last_peered":"2023-11-28T16:57:03.904588+0000","last_clean":"2023-11-28T16:57:03.904588+0000","last_became_active":"2023-11-28T16:57:03.899394+0000","last_became_peered":"2023-11-28T16:57:03.899394+0000","last_unstale":"2023-11-28T16:57:03.904588+0000","last_undegraded":"2023-11-28T16:57:03.904588+0000","last_fullsized":"2023-11-28T16:57:03.904588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.904543+0000","last_change":"2023-11-28T16:57:03.899079+0000","last_active":"2023-11-28T16:57:03.904543+0000","last_peered":"2023-11-28T16:57:03.904543+0000","last_clean":"2023-11-28T16:57:03.904543+0000","last_became_active":"2023-11-28T16:57:03.898739+0000","last_became_peered":"2023-11-28T16:57:03.898739+0000","last_unstale":"2023-11-28T16:57:03.904543+0000","last_undegraded":"2023-11-28T16:57:03.904543+0000","last_fullsized":"2023-11-28T16:57:03.904543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911301+0000","last_change":"2023-11-28T16:57:03.891691+0000","last_active":"2023-11-28T16:57:03.911301+0000","last_peered":"2023-11-28T16:57:03.911301+0000","last_clean":"2023-11-28T16:57:03.911301+0000","last_became_active":"2023-11-28T16:57:03.890689+0000","last_became_peered":"2023-11-28T16:57:03.890689+0000","last_unstale":"2023-11-28T16:57:03.911301+0000","last_undegraded":"2023-11-28T16:57:03.911301+0000","last_fullsized":"2023-11-28T16:57:03.911301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.913597+0000","last_change":"2023-11-28T16:57:03.910151+0000","last_active":"2023-11-28T16:57:03.913597+0000","last_peered":"2023-11-28T16:57:03.913597+0000","last_clean":"2023-11-28T16:57:03.913597+0000","last_became_active":"2023-11-28T16:57:03.909840+0000","last_became_peered":"2023-11-28T16:57:03.909840+0000","last_unstale":"2023-11-28T16:57:03.913597+0000","last_undegraded":"2023-11-28T16:57:03.913597+0000","last_fullsized":"2023-11-28T16:57:03.913597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.896731+0000","last_change":"2023-11-28T16:57:03.893588+0000","last_active":"2023-11-28T16:57:03.896731+0000","last_peered":"2023-11-28T16:57:03.896731+0000","last_clean":"2023-11-28T16:57:03.896731+0000","last_became_active":"2023-11-28T16:57:03.891825+0000","last_became_peered":"2023-11-28T16:57:03.891825+0000","last_unstale":"2023-11-28T16:57:03.896731+0000","last_undegraded":"2023-11-28T16:57:03.896731+0000","last_fullsized":"2023-11-28T16:57:03.896731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:18.679259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.890866+0000","last_change":"2023-11-28T16:57:03.885753+0000","last_active":"2023-11-28T16:57:03.890866+0000","last_peered":"2023-11-28T16:57:03.890866+0000","last_clean":"2023-11-28T16:57:03.890866+0000","last_became_active":"2023-11-28T16:57:03.885404+0000","last_became_peered":"2023-11-28T16:57:03.885404+0000","last_unstale":"2023-11-28T16:57:03.890866+0000","last_undegraded":"2023-11-28T16:57:03.890866+0000","last_fullsized":"2023-11-28T16:57:03.890866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:01.464912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892467+0000","last_change":"2023-11-28T16:57:03.888953+0000","last_active":"2023-11-28T16:57:03.892467+0000","last_peered":"2023-11-28T16:57:03.892467+0000","last_clean":"2023-11-28T16:57:03.892467+0000","last_became_active":"2023-11-28T16:57:03.888624+0000","last_became_peered":"2023-11-28T16:57:03.888624+0000","last_unstale":"2023-11-28T16:57:03.892467+0000","last_undegraded":"2023-11-28T16:57:03.892467+0000","last_fullsized":"2023-11-28T16:57:03.892467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:46.680946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897704+0000","last_change":"2023-11-28T16:57:03.888524+0000","last_active":"2023-11-28T16:57:03.897704+0000","last_peered":"2023-11-28T16:57:03.897704+0000","last_clean":"2023-11-28T16:57:03.897704+0000","last_became_active":"2023-11-28T16:57:03.885162+0000","last_became_peered":"2023-11-28T16:57:03.885162+0000","last_unstale":"2023-11-28T16:57:03.897704+0000","last_undegraded":"2023-11-28T16:57:03.897704+0000","last_fullsized":"2023-11-28T16:57:03.897704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900714+0000","last_change":"2023-11-28T16:57:03.889249+0000","last_active":"2023-11-28T16:57:03.900714+0000","last_peered":"2023-11-28T16:57:03.900714+0000","last_clean":"2023-11-28T16:57:03.900714+0000","last_became_active":"2023-11-28T16:57:03.888913+0000","last_became_peered":"2023-11-28T16:57:03.888913+0000","last_unstale":"2023-11-28T16:57:03.900714+0000","last_undegraded":"2023-11-28T16:57:03.900714+0000","last_fullsized":"2023-11-28T16:57:03.900714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894993+0000","last_change":"2023-11-28T16:57:03.885984+0000","last_active":"2023-11-28T16:57:03.894993+0000","last_peered":"2023-11-28T16:57:03.894993+0000","last_clean":"2023-11-28T16:57:03.894993+0000","last_became_active":"2023-11-28T16:57:03.885297+0000","last_became_peered":"2023-11-28T16:57:03.885297+0000","last_unstale":"2023-11-28T16:57:03.894993+0000","last_undegraded":"2023-11-28T16:57:03.894993+0000","last_fullsized":"2023-11-28T16:57:03.894993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.910413+0000","last_change":"2023-11-28T16:57:03.891455+0000","last_active":"2023-11-28T16:57:03.910413+0000","last_peered":"2023-11-28T16:57:03.910413+0000","last_clean":"2023-11-28T16:57:03.910413+0000","last_became_active":"2023-11-28T16:57:03.890363+0000","last_became_peered":"2023-11-28T16:57:03.890363+0000","last_unstale":"2023-11-28T16:57:03.910413+0000","last_undegraded":"2023-11-28T16:57:03.910413+0000","last_fullsized":"2023-11-28T16:57:03.910413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.586951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.908378+0000","last_change":"2023-11-28T16:57:03.899721+0000","last_active":"2023-11-28T16:57:03.908378+0000","last_peered":"2023-11-28T16:57:03.908378+0000","last_clean":"2023-11-28T16:57:03.908378+0000","last_became_active":"2023-11-28T16:57:03.898861+0000","last_became_peered":"2023-11-28T16:57:03.898861+0000","last_unstale":"2023-11-28T16:57:03.908378+0000","last_undegraded":"2023-11-28T16:57:03.908378+0000","last_fullsized":"2023-11-28T16:57:03.908378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901094+0000","last_change":"2023-11-28T16:57:03.894338+0000","last_active":"2023-11-28T16:57:03.901094+0000","last_peered":"2023-11-28T16:57:03.901094+0000","last_clean":"2023-11-28T16:57:03.901094+0000","last_became_active":"2023-11-28T16:57:03.894019+0000","last_became_peered":"2023-11-28T16:57:03.894019+0000","last_unstale":"2023-11-28T16:57:03.901094+0000","last_undegraded":"2023-11-28T16:57:03.901094+0000","last_fullsized":"2023-11-28T16:57:03.901094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.887828+0000","last_change":"2023-11-28T16:57:03.884478+0000","last_active":"2023-11-28T16:57:03.887828+0000","last_peered":"2023-11-28T16:57:03.887828+0000","last_clean":"2023-11-28T16:57:03.887828+0000","last_became_active":"2023-11-28T16:57:03.884199+0000","last_became_peered":"2023-11-28T16:57:03.884199+0000","last_unstale":"2023-11-28T16:57:03.887828+0000","last_undegraded":"2023-11-28T16:57:03.887828+0000","last_fullsized":"2023-11-28T16:57:03.887828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:39:05.732024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.907645+0000","last_change":"2023-11-28T16:57:03.904013+0000","last_active":"2023-11-28T16:57:03.907645+0000","last_peered":"2023-11-28T16:57:03.907645+0000","last_clean":"2023-11-28T16:57:03.907645+0000","last_became_active":"2023-11-28T16:57:03.903753+0000","last_became_peered":"2023-11-28T16:57:03.903753+0000","last_unstale":"2023-11-28T16:57:03.907645+0000","last_undegraded":"2023-11-28T16:57:03.907645+0000","last_fullsized":"2023-11-28T16:57:03.907645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900375+0000","last_change":"2023-11-28T16:57:03.892625+0000","last_active":"2023-11-28T16:57:03.900375+0000","last_peered":"2023-11-28T16:57:03.900375+0000","last_clean":"2023-11-28T16:57:03.900375+0000","last_became_active":"2023-11-28T16:57:03.892360+0000","last_became_peered":"2023-11-28T16:57:03.892360+0000","last_unstale":"2023-11-28T16:57:03.900375+0000","last_undegraded":"2023-11-28T16:57:03.900375+0000","last_fullsized":"2023-11-28T16:57:03.900375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:40.067864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899617+0000","last_change":"2023-11-28T16:57:03.886973+0000","last_active":"2023-11-28T16:57:03.899617+0000","last_peered":"2023-11-28T16:57:03.899617+0000","last_clean":"2023-11-28T16:57:03.899617+0000","last_became_active":"2023-11-28T16:57:03.886340+0000","last_became_peered":"2023-11-28T16:57:03.886340+0000","last_unstale":"2023-11-28T16:57:03.899617+0000","last_undegraded":"2023-11-28T16:57:03.899617+0000","last_fullsized":"2023-11-28T16:57:03.899617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.898094+0000","last_change":"2023-11-28T16:57:03.894765+0000","last_active":"2023-11-28T16:57:03.898094+0000","last_peered":"2023-11-28T16:57:03.898094+0000","last_clean":"2023-11-28T16:57:03.898094+0000","last_became_active":"2023-11-28T16:57:03.894466+0000","last_became_peered":"2023-11-28T16:57:03.894466+0000","last_unstale":"2023-11-28T16:57:03.898094+0000","last_undegraded":"2023-11-28T16:57:03.898094+0000","last_fullsized":"2023-11-28T16:57:03.898094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:40.067864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914077+0000","last_change":"2023-11-28T16:57:02.890520+0000","last_active":"2023-11-28T16:57:03.914077+0000","last_peered":"2023-11-28T16:57:03.914077+0000","last_clean":"2023-11-28T16:57:03.914077+0000","last_became_active":"2023-11-28T16:57:02.890238+0000","last_became_peered":"2023-11-28T16:57:02.890238+0000","last_unstale":"2023-11-28T16:57:03.914077+0000","last_undegraded":"2023-11-28T16:57:03.914077+0000","last_fullsized":"2023-11-28T16:57:03.914077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899494+0000","last_change":"2023-11-28T16:57:03.891242+0000","last_active":"2023-11-28T16:57:03.899494+0000","last_peered":"2023-11-28T16:57:03.899494+0000","last_clean":"2023-11-28T16:57:03.899494+0000","last_became_active":"2023-11-28T16:57:03.890884+0000","last_became_peered":"2023-11-28T16:57:03.890884+0000","last_unstale":"2023-11-28T16:57:03.899494+0000","last_undegraded":"2023-11-28T16:57:03.899494+0000","last_fullsized":"2023-11-28T16:57:03.899494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:01.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906500+0000","last_change":"2023-11-28T16:57:02.878046+0000","last_active":"2023-11-28T16:57:03.906500+0000","last_peered":"2023-11-28T16:57:03.906500+0000","last_clean":"2023-11-28T16:57:03.906500+0000","last_became_active":"2023-11-28T16:57:02.877719+0000","last_became_peered":"2023-11-28T16:57:02.877719+0000","last_unstale":"2023-11-28T16:57:03.906500+0000","last_undegraded":"2023-11-28T16:57:03.906500+0000","last_fullsized":"2023-11-28T16:57:03.906500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.905279+0000","last_change":"2023-11-28T16:57:03.898573+0000","last_active":"2023-11-28T16:57:03.905279+0000","last_peered":"2023-11-28T16:57:03.905279+0000","last_clean":"2023-11-28T16:57:03.905279+0000","last_became_active":"2023-11-28T16:57:03.898275+0000","last_became_peered":"2023-11-28T16:57:03.898275+0000","last_unstale":"2023-11-28T16:57:03.905279+0000","last_undegraded":"2023-11-28T16:57:03.905279+0000","last_fullsized":"2023-11-28T16:57:03.905279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:56.812246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914016+0000","last_change":"2023-11-28T16:57:02.895629+0000","last_active":"2023-11-28T16:57:03.914016+0000","last_peered":"2023-11-28T16:57:03.914016+0000","last_clean":"2023-11-28T16:57:03.914016+0000","last_became_active":"2023-11-28T16:57:02.895339+0000","last_became_peered":"2023-11-28T16:57:02.895339+0000","last_unstale":"2023-11-28T16:57:03.914016+0000","last_undegraded":"2023-11-28T16:57:03.914016+0000","last_fullsized":"2023-11-28T16:57:03.914016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:22.670983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.908397+0000","last_change":"2023-11-28T16:57:03.899996+0000","last_active":"2023-11-28T16:57:03.908397+0000","last_peered":"2023-11-28T16:57:03.908397+0000","last_clean":"2023-11-28T16:57:03.908397+0000","last_became_active":"2023-11-28T16:57:03.899369+0000","last_became_peered":"2023-11-28T16:57:03.899369+0000","last_unstale":"2023-11-28T16:57:03.908397+0000","last_undegraded":"2023-11-28T16:57:03.908397+0000","last_fullsized":"2023-11-28T16:57:03.908397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911976+0000","last_change":"2023-11-28T16:57:02.893416+0000","last_active":"2023-11-28T16:57:03.911976+0000","last_peered":"2023-11-28T16:57:03.911976+0000","last_clean":"2023-11-28T16:57:03.911976+0000","last_became_active":"2023-11-28T16:57:02.892837+0000","last_became_peered":"2023-11-28T16:57:02.892837+0000","last_unstale":"2023-11-28T16:57:03.911976+0000","last_undegraded":"2023-11-28T16:57:03.911976+0000","last_fullsized":"2023-11-28T16:57:03.911976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:35.400319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.905658+0000","last_change":"2023-11-28T16:57:03.897702+0000","last_active":"2023-11-28T16:57:03.905658+0000","last_peered":"2023-11-28T16:57:03.905658+0000","last_clean":"2023-11-28T16:57:03.905658+0000","last_became_active":"2023-11-28T16:57:03.895461+0000","last_became_peered":"2023-11-28T16:57:03.895461+0000","last_unstale":"2023-11-28T16:57:03.905658+0000","last_undegraded":"2023-11-28T16:57:03.905658+0000","last_fullsized":"2023-11-28T16:57:03.905658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914405+0000","last_change":"2023-11-28T16:57:02.883245+0000","last_active":"2023-11-28T16:57:03.914405+0000","last_peered":"2023-11-28T16:57:03.914405+0000","last_clean":"2023-11-28T16:57:03.914405+0000","last_became_active":"2023-11-28T16:57:02.882929+0000","last_became_peered":"2023-11-28T16:57:02.882929+0000","last_unstale":"2023-11-28T16:57:03.914405+0000","last_undegraded":"2023-11-28T16:57:03.914405+0000","last_fullsized":"2023-11-28T16:57:03.914405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:57:59.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892622+0000","last_change":"2023-11-28T16:57:03.889038+0000","last_active":"2023-11-28T16:57:03.892622+0000","last_peered":"2023-11-28T16:57:03.892622+0000","last_clean":"2023-11-28T16:57:03.892622+0000","last_became_active":"2023-11-28T16:57:03.888749+0000","last_became_peered":"2023-11-28T16:57:03.888749+0000","last_unstale":"2023-11-28T16:57:03.892622+0000","last_undegraded":"2023-11-28T16:57:03.892622+0000","last_fullsized":"2023-11-28T16:57:03.892622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914338+0000","last_change":"2023-11-28T16:57:02.884058+0000","last_active":"2023-11-28T16:57:03.914338+0000","last_peered":"2023-11-28T16:57:03.914338+0000","last_clean":"2023-11-28T16:57:03.914338+0000","last_became_active":"2023-11-28T16:57:02.883737+0000","last_became_peered":"2023-11-28T16:57:02.883737+0000","last_unstale":"2023-11-28T16:57:03.914338+0000","last_undegraded":"2023-11-28T16:57:03.914338+0000","last_fullsized":"2023-11-28T16:57:03.914338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:17:33.236125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894363+0000","last_change":"2023-11-28T16:57:03.892365+0000","last_active":"2023-11-28T16:57:03.894363+0000","last_peered":"2023-11-28T16:57:03.894363+0000","last_clean":"2023-11-28T16:57:03.894363+0000","last_became_active":"2023-11-28T16:57:03.892096+0000","last_became_peered":"2023-11-28T16:57:03.892096+0000","last_unstale":"2023-11-28T16:57:03.894363+0000","last_undegraded":"2023-11-28T16:57:03.894363+0000","last_fullsized":"2023-11-28T16:57:03.894363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:23.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872761+0000","last_change":"2023-11-28T16:57:02.887000+0000","last_active":"2023-11-28T16:57:03.872761+0000","last_peered":"2023-11-28T16:57:03.872761+0000","last_clean":"2023-11-28T16:57:03.872761+0000","last_became_active":"2023-11-28T16:57:02.886730+0000","last_became_peered":"2023-11-28T16:57:02.886730+0000","last_unstale":"2023-11-28T16:57:03.872761+0000","last_undegraded":"2023-11-28T16:57:03.872761+0000","last_fullsized":"2023-11-28T16:57:03.872761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.909465+0000","last_change":"2023-11-28T16:57:03.902695+0000","last_active":"2023-11-28T16:57:03.909465+0000","last_peered":"2023-11-28T16:57:03.909465+0000","last_clean":"2023-11-28T16:57:03.909465+0000","last_became_active":"2023-11-28T16:57:03.902147+0000","last_became_peered":"2023-11-28T16:57:03.902147+0000","last_unstale":"2023-11-28T16:57:03.909465+0000","last_undegraded":"2023-11-28T16:57:03.909465+0000","last_fullsized":"2023-11-28T16:57:03.909465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:01.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872260+0000","last_change":"2023-11-28T16:57:02.883963+0000","last_active":"2023-11-28T16:57:03.872260+0000","last_peered":"2023-11-28T16:57:03.872260+0000","last_clean":"2023-11-28T16:57:03.872260+0000","last_became_active":"2023-11-28T16:57:02.883629+0000","last_became_peered":"2023-11-28T16:57:02.883629+0000","last_unstale":"2023-11-28T16:57:03.872260+0000","last_undegraded":"2023-11-28T16:57:03.872260+0000","last_fullsized":"2023-11-28T16:57:03.872260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:00.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.916110+0000","last_change":"2023-11-28T16:57:03.912991+0000","last_active":"2023-11-28T16:57:03.916110+0000","last_peered":"2023-11-28T16:57:03.916110+0000","last_clean":"2023-11-28T16:57:03.916110+0000","last_became_active":"2023-11-28T16:57:03.912733+0000","last_became_peered":"2023-11-28T16:57:03.912733+0000","last_unstale":"2023-11-28T16:57:03.916110+0000","last_undegraded":"2023-11-28T16:57:03.916110+0000","last_fullsized":"2023-11-28T16:57:03.916110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.880216+0000","last_change":"2023-11-28T16:57:02.893953+0000","last_active":"2023-11-28T16:57:03.880216+0000","last_peered":"2023-11-28T16:57:03.880216+0000","last_clean":"2023-11-28T16:57:03.880216+0000","last_became_active":"2023-11-28T16:57:02.892987+0000","last_became_peered":"2023-11-28T16:57:02.892987+0000","last_unstale":"2023-11-28T16:57:03.880216+0000","last_undegraded":"2023-11-28T16:57:03.880216+0000","last_fullsized":"2023-11-28T16:57:03.880216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:08.372872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911533+0000","last_change":"2023-11-28T16:57:03.904109+0000","last_active":"2023-11-28T16:57:03.911533+0000","last_peered":"2023-11-28T16:57:03.911533+0000","last_clean":"2023-11-28T16:57:03.911533+0000","last_became_active":"2023-11-28T16:57:03.903816+0000","last_became_peered":"2023-11-28T16:57:03.903816+0000","last_unstale":"2023-11-28T16:57:03.911533+0000","last_undegraded":"2023-11-28T16:57:03.911533+0000","last_fullsized":"2023-11-28T16:57:03.911533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.869490+0000","last_change":"2023-11-28T16:57:02.881277+0000","last_active":"2023-11-28T16:57:03.869490+0000","last_peered":"2023-11-28T16:57:03.869490+0000","last_clean":"2023-11-28T16:57:03.869490+0000","last_became_active":"2023-11-28T16:57:02.881004+0000","last_became_peered":"2023-11-28T16:57:02.881004+0000","last_unstale":"2023-11-28T16:57:03.869490+0000","last_undegraded":"2023-11-28T16:57:03.869490+0000","last_fullsized":"2023-11-28T16:57:03.869490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906583+0000","last_change":"2023-11-28T16:57:03.889206+0000","last_active":"2023-11-28T16:57:03.906583+0000","last_peered":"2023-11-28T16:57:03.906583+0000","last_clean":"2023-11-28T16:57:03.906583+0000","last_became_active":"2023-11-28T16:57:03.888907+0000","last_became_peered":"2023-11-28T16:57:03.888907+0000","last_unstale":"2023-11-28T16:57:03.906583+0000","last_undegraded":"2023-11-28T16:57:03.906583+0000","last_fullsized":"2023-11-28T16:57:03.906583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.912485+0000","last_change":"2023-11-28T16:57:02.890396+0000","last_active":"2023-11-28T16:57:03.912485+0000","last_peered":"2023-11-28T16:57:03.912485+0000","last_clean":"2023-11-28T16:57:03.912485+0000","last_became_active":"2023-11-28T16:57:02.890068+0000","last_became_peered":"2023-11-28T16:57:02.890068+0000","last_unstale":"2023-11-28T16:57:03.912485+0000","last_undegraded":"2023-11-28T16:57:03.912485+0000","last_fullsized":"2023-11-28T16:57:03.912485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.117385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.907227+0000","last_change":"2023-11-28T16:57:03.905651+0000","last_active":"2023-11-28T16:57:03.907227+0000","last_peered":"2023-11-28T16:57:03.907227+0000","last_clean":"2023-11-28T16:57:03.907227+0000","last_became_active":"2023-11-28T16:57:03.904887+0000","last_became_peered":"2023-11-28T16:57:03.904887+0000","last_unstale":"2023-11-28T16:57:03.907227+0000","last_undegraded":"2023-11-28T16:57:03.907227+0000","last_fullsized":"2023-11-28T16:57:03.907227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.916045+0000","last_change":"2023-11-28T16:57:02.896876+0000","last_active":"2023-11-28T16:57:03.916045+0000","last_peered":"2023-11-28T16:57:03.916045+0000","last_clean":"2023-11-28T16:57:03.916045+0000","last_became_active":"2023-11-28T16:57:02.896650+0000","last_became_peered":"2023-11-28T16:57:02.896650+0000","last_unstale":"2023-11-28T16:57:03.916045+0000","last_undegraded":"2023-11-28T16:57:03.916045+0000","last_fullsized":"2023-11-28T16:57:03.916045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:45.191786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892990+0000","last_change":"2023-11-28T16:57:03.886262+0000","last_active":"2023-11-28T16:57:03.892990+0000","last_peered":"2023-11-28T16:57:03.892990+0000","last_clean":"2023-11-28T16:57:03.892990+0000","last_became_active":"2023-11-28T16:57:03.886052+0000","last_became_peered":"2023-11-28T16:57:03.886052+0000","last_unstale":"2023-11-28T16:57:03.892990+0000","last_undegraded":"2023-11-28T16:57:03.892990+0000","last_fullsized":"2023-11-28T16:57:03.892990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914280+0000","last_change":"2023-11-28T16:57:02.882053+0000","last_active":"2023-11-28T16:57:03.914280+0000","last_peered":"2023-11-28T16:57:03.914280+0000","last_clean":"2023-11-28T16:57:03.914280+0000","last_became_active":"2023-11-28T16:57:02.879776+0000","last_became_peered":"2023-11-28T16:57:02.879776+0000","last_unstale":"2023-11-28T16:57:03.914280+0000","last_undegraded":"2023-11-28T16:57:03.914280+0000","last_fullsized":"2023-11-28T16:57:03.914280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:20.111131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894635+0000","last_change":"2023-11-28T16:57:03.887114+0000","last_active":"2023-11-28T16:57:03.894635+0000","last_peered":"2023-11-28T16:57:03.894635+0000","last_clean":"2023-11-28T16:57:03.894635+0000","last_became_active":"2023-11-28T16:57:03.886543+0000","last_became_peered":"2023-11-28T16:57:03.886543+0000","last_unstale":"2023-11-28T16:57:03.894635+0000","last_undegraded":"2023-11-28T16:57:03.894635+0000","last_fullsized":"2023-11-28T16:57:03.894635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:24.050255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.868055+0000","last_change":"2023-11-28T16:57:02.881775+0000","last_active":"2023-11-28T16:57:03.868055+0000","last_peered":"2023-11-28T16:57:03.868055+0000","last_clean":"2023-11-28T16:57:03.868055+0000","last_became_active":"2023-11-28T16:57:02.881350+0000","last_became_peered":"2023-11-28T16:57:02.881350+0000","last_unstale":"2023-11-28T16:57:03.868055+0000","last_undegraded":"2023-11-28T16:57:03.868055+0000","last_fullsized":"2023-11-28T16:57:03.868055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:41.579988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899636+0000","last_change":"2023-11-28T16:57:03.887179+0000","last_active":"2023-11-28T16:57:03.899636+0000","last_peered":"2023-11-28T16:57:03.899636+0000","last_clean":"2023-11-28T16:57:03.899636+0000","last_became_active":"2023-11-28T16:57:03.886667+0000","last_became_peered":"2023-11-28T16:57:03.886667+0000","last_unstale":"2023-11-28T16:57:03.899636+0000","last_undegraded":"2023-11-28T16:57:03.899636+0000","last_fullsized":"2023-11-28T16:57:03.899636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872613+0000","last_change":"2023-11-28T16:57:02.892486+0000","last_active":"2023-11-28T16:57:03.872613+0000","last_peered":"2023-11-28T16:57:03.872613+0000","last_clean":"2023-11-28T16:57:03.872613+0000","last_became_active":"2023-11-28T16:57:02.892124+0000","last_became_peered":"2023-11-28T16:57:02.892124+0000","last_unstale":"2023-11-28T16:57:03.872613+0000","last_undegraded":"2023-11-28T16:57:03.872613+0000","last_fullsized":"2023-11-28T16:57:03.872613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911855+0000","last_change":"2023-11-28T16:57:03.898409+0000","last_active":"2023-11-28T16:57:03.911855+0000","last_peered":"2023-11-28T16:57:03.911855+0000","last_clean":"2023-11-28T16:57:03.911855+0000","last_became_active":"2023-11-28T16:57:03.895873+0000","last_became_peered":"2023-11-28T16:57:03.895873+0000","last_unstale":"2023-11-28T16:57:03.911855+0000","last_undegraded":"2023-11-28T16:57:03.911855+0000","last_fullsized":"2023-11-28T16:57:03.911855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:21.117551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914099+0000","last_change":"2023-11-28T16:57:02.874480+0000","last_active":"2023-11-28T16:57:03.914099+0000","last_peered":"2023-11-28T16:57:03.914099+0000","last_clean":"2023-11-28T16:57:03.914099+0000","last_became_active":"2023-11-28T16:57:02.874163+0000","last_became_peered":"2023-11-28T16:57:02.874163+0000","last_unstale":"2023-11-28T16:57:03.914099+0000","last_undegraded":"2023-11-28T16:57:03.914099+0000","last_fullsized":"2023-11-28T16:57:03.914099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:47.038335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894565+0000","last_change":"2023-11-28T16:57:03.890656+0000","last_active":"2023-11-28T16:57:03.894565+0000","last_peered":"2023-11-28T16:57:03.894565+0000","last_clean":"2023-11-28T16:57:03.894565+0000","last_became_active":"2023-11-28T16:57:03.890368+0000","last_became_peered":"2023-11-28T16:57:03.890368+0000","last_unstale":"2023-11-28T16:57:03.894565+0000","last_undegraded":"2023-11-28T16:57:03.894565+0000","last_fullsized":"2023-11-28T16:57:03.894565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:42.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.913817+0000","last_change":"2023-11-28T16:57:02.897594+0000","last_active":"2023-11-28T16:57:03.913817+0000","last_peered":"2023-11-28T16:57:03.913817+0000","last_clean":"2023-11-28T16:57:03.913817+0000","last_became_active":"2023-11-28T16:57:02.897292+0000","last_became_peered":"2023-11-28T16:57:02.897292+0000","last_unstale":"2023-11-28T16:57:03.913817+0000","last_undegraded":"2023-11-28T16:57:03.913817+0000","last_fullsized":"2023-11-28T16:57:03.913817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901041+0000","last_change":"2023-11-28T16:57:03.893627+0000","last_active":"2023-11-28T16:57:03.901041+0000","last_peered":"2023-11-28T16:57:03.901041+0000","last_clean":"2023-11-28T16:57:03.901041+0000","last_became_active":"2023-11-28T16:57:03.893378+0000","last_became_peered":"2023-11-28T16:57:03.893378+0000","last_unstale":"2023-11-28T16:57:03.901041+0000","last_undegraded":"2023-11-28T16:57:03.901041+0000","last_fullsized":"2023-11-28T16:57:03.901041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914127+0000","last_change":"2023-11-28T16:57:02.884158+0000","last_active":"2023-11-28T16:57:03.914127+0000","last_peered":"2023-11-28T16:57:03.914127+0000","last_clean":"2023-11-28T16:57:03.914127+0000","last_became_active":"2023-11-28T16:57:02.883646+0000","last_became_peered":"2023-11-28T16:57:02.883646+0000","last_unstale":"2023-11-28T16:57:03.914127+0000","last_undegraded":"2023-11-28T16:57:03.914127+0000","last_fullsized":"2023-11-28T16:57:03.914127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.885429+0000","last_change":"2023-11-28T16:57:03.881542+0000","last_active":"2023-11-28T16:57:03.885429+0000","last_peered":"2023-11-28T16:57:03.885429+0000","last_clean":"2023-11-28T16:57:03.885429+0000","last_became_active":"2023-11-28T16:57:03.880853+0000","last_became_peered":"2023-11-28T16:57:03.880853+0000","last_unstale":"2023-11-28T16:57:03.885429+0000","last_undegraded":"2023-11-28T16:57:03.885429+0000","last_fullsized":"2023-11-28T16:57:03.885429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:40.067864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.909072+0000","last_change":"2023-11-28T16:57:02.892637+0000","last_active":"2023-11-28T16:57:03.909072+0000","last_peered":"2023-11-28T16:57:03.909072+0000","last_clean":"2023-11-28T16:57:03.909072+0000","last_became_active":"2023-11-28T16:57:02.892297+0000","last_became_peered":"2023-11-28T16:57:02.892297+0000","last_unstale":"2023-11-28T16:57:03.909072+0000","last_undegraded":"2023-11-28T16:57:03.909072+0000","last_fullsized":"2023-11-28T16:57:03.909072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:56.815063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906647+0000","last_change":"2023-11-28T16:57:03.903216+0000","last_active":"2023-11-28T16:57:03.906647+0000","last_peered":"2023-11-28T16:57:03.906647+0000","last_clean":"2023-11-28T16:57:03.906647+0000","last_became_active":"2023-11-28T16:57:03.901859+0000","last_became_peered":"2023-11-28T16:57:03.901859+0000","last_unstale":"2023-11-28T16:57:03.906647+0000","last_undegraded":"2023-11-28T16:57:03.906647+0000","last_fullsized":"2023-11-28T16:57:03.906647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:01.464912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872395+0000","last_change":"2023-11-28T16:57:02.890920+0000","last_active":"2023-11-28T16:57:03.872395+0000","last_peered":"2023-11-28T16:57:03.872395+0000","last_clean":"2023-11-28T16:57:03.872395+0000","last_became_active":"2023-11-28T16:57:02.890605+0000","last_became_peered":"2023-11-28T16:57:02.890605+0000","last_unstale":"2023-11-28T16:57:03.872395+0000","last_undegraded":"2023-11-28T16:57:03.872395+0000","last_fullsized":"2023-11-28T16:57:03.872395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:39.061444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897463+0000","last_change":"2023-11-28T16:57:03.892487+0000","last_active":"2023-11-28T16:57:03.897463+0000","last_peered":"2023-11-28T16:57:03.897463+0000","last_clean":"2023-11-28T16:57:03.897463+0000","last_became_active":"2023-11-28T16:57:03.892192+0000","last_became_peered":"2023-11-28T16:57:03.892192+0000","last_unstale":"2023-11-28T16:57:03.897463+0000","last_undegraded":"2023-11-28T16:57:03.897463+0000","last_fullsized":"2023-11-28T16:57:03.897463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:24.316823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.910243+0000","last_change":"2023-11-28T16:57:02.887769+0000","last_active":"2023-11-28T16:57:03.910243+0000","last_peered":"2023-11-28T16:57:03.910243+0000","last_clean":"2023-11-28T16:57:03.910243+0000","last_became_active":"2023-11-28T16:57:02.887489+0000","last_became_peered":"2023-11-28T16:57:02.887489+0000","last_unstale":"2023-11-28T16:57:03.910243+0000","last_undegraded":"2023-11-28T16:57:03.910243+0000","last_fullsized":"2023-11-28T16:57:03.910243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.890874+0000","last_change":"2023-11-28T16:57:03.887058+0000","last_active":"2023-11-28T16:57:03.890874+0000","last_peered":"2023-11-28T16:57:03.890874+0000","last_clean":"2023-11-28T16:57:03.890874+0000","last_became_active":"2023-11-28T16:57:03.886373+0000","last_became_peered":"2023-11-28T16:57:03.886373+0000","last_unstale":"2023-11-28T16:57:03.890874+0000","last_undegraded":"2023-11-28T16:57:03.890874+0000","last_fullsized":"2023-11-28T16:57:03.890874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:55.969624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897003+0000","last_change":"2023-11-28T16:57:02.889539+0000","last_active":"2023-11-28T16:57:03.897003+0000","last_peered":"2023-11-28T16:57:03.897003+0000","last_clean":"2023-11-28T16:57:03.897003+0000","last_became_active":"2023-11-28T16:57:02.889270+0000","last_became_peered":"2023-11-28T16:57:02.889270+0000","last_unstale":"2023-11-28T16:57:03.897003+0000","last_undegraded":"2023-11-28T16:57:03.897003+0000","last_fullsized":"2023-11-28T16:57:03.897003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903724+0000","last_change":"2023-11-28T16:57:03.896248+0000","last_active":"2023-11-28T16:57:03.903724+0000","last_peered":"2023-11-28T16:57:03.903724+0000","last_clean":"2023-11-28T16:57:03.903724+0000","last_became_active":"2023-11-28T16:57:03.895989+0000","last_became_peered":"2023-11-28T16:57:03.895989+0000","last_unstale":"2023-11-28T16:57:03.903724+0000","last_undegraded":"2023-11-28T16:57:03.903724+0000","last_fullsized":"2023-11-28T16:57:03.903724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:52.513452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.871527+0000","last_change":"2023-11-28T16:57:02.887552+0000","last_active":"2023-11-28T16:57:03.871527+0000","last_peered":"2023-11-28T16:57:03.871527+0000","last_clean":"2023-11-28T16:57:03.871527+0000","last_became_active":"2023-11-28T16:57:02.887319+0000","last_became_peered":"2023-11-28T16:57:02.887319+0000","last_unstale":"2023-11-28T16:57:03.871527+0000","last_undegraded":"2023-11-28T16:57:03.871527+0000","last_fullsized":"2023-11-28T16:57:03.871527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:29:38.468989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903654+0000","last_change":"2023-11-28T16:57:03.896853+0000","last_active":"2023-11-28T16:57:03.903654+0000","last_peered":"2023-11-28T16:57:03.903654+0000","last_clean":"2023-11-28T16:57:03.903654+0000","last_became_active":"2023-11-28T16:57:03.896447+0000","last_became_peered":"2023-11-28T16:57:03.896447+0000","last_unstale":"2023-11-28T16:57:03.903654+0000","last_undegraded":"2023-11-28T16:57:03.903654+0000","last_fullsized":"2023-11-28T16:57:03.903654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.880839+0000","last_change":"2023-11-28T16:57:02.890124+0000","last_active":"2023-11-28T16:57:03.880839+0000","last_peered":"2023-11-28T16:57:03.880839+0000","last_clean":"2023-11-28T16:57:03.880839+0000","last_became_active":"2023-11-28T16:57:02.889786+0000","last_became_peered":"2023-11-28T16:57:02.889786+0000","last_unstale":"2023-11-28T16:57:03.880839+0000","last_undegraded":"2023-11-28T16:57:03.880839+0000","last_fullsized":"2023-11-28T16:57:03.880839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:46.580531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.895374+0000","last_change":"2023-11-28T16:57:03.892095+0000","last_active":"2023-11-28T16:57:03.895374+0000","last_peered":"2023-11-28T16:57:03.895374+0000","last_clean":"2023-11-28T16:57:03.895374+0000","last_became_active":"2023-11-28T16:57:03.891745+0000","last_became_peered":"2023-11-28T16:57:03.891745+0000","last_unstale":"2023-11-28T16:57:03.895374+0000","last_undegraded":"2023-11-28T16:57:03.895374+0000","last_fullsized":"2023-11-28T16:57:03.895374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:36.768629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.912697+0000","last_change":"2023-11-28T16:57:02.888301+0000","last_active":"2023-11-28T16:57:03.912697+0000","last_peered":"2023-11-28T16:57:03.912697+0000","last_clean":"2023-11-28T16:57:03.912697+0000","last_became_active":"2023-11-28T16:57:02.887892+0000","last_became_peered":"2023-11-28T16:57:02.887892+0000","last_unstale":"2023-11-28T16:57:03.912697+0000","last_undegraded":"2023-11-28T16:57:03.912697+0000","last_fullsized":"2023-11-28T16:57:03.912697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906408+0000","last_change":"2023-11-28T16:57:03.904348+0000","last_active":"2023-11-28T16:57:03.906408+0000","last_peered":"2023-11-28T16:57:03.906408+0000","last_clean":"2023-11-28T16:57:03.906408+0000","last_became_active":"2023-11-28T16:57:03.904090+0000","last_became_peered":"2023-11-28T16:57:03.904090+0000","last_unstale":"2023-11-28T16:57:03.906408+0000","last_undegraded":"2023-11-28T16:57:03.906408+0000","last_fullsized":"2023-11-28T16:57:03.906408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.869461+0000","last_change":"2023-11-28T16:57:02.886351+0000","last_active":"2023-11-28T16:57:03.869461+0000","last_peered":"2023-11-28T16:57:03.869461+0000","last_clean":"2023-11-28T16:57:03.869461+0000","last_became_active":"2023-11-28T16:57:02.886028+0000","last_became_peered":"2023-11-28T16:57:02.886028+0000","last_unstale":"2023-11-28T16:57:03.869461+0000","last_undegraded":"2023-11-28T16:57:03.869461+0000","last_fullsized":"2023-11-28T16:57:03.869461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:14.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.884783+0000","last_change":"2023-11-28T16:57:03.876059+0000","last_active":"2023-11-28T16:57:03.884783+0000","last_peered":"2023-11-28T16:57:03.884783+0000","last_clean":"2023-11-28T16:57:03.884783+0000","last_became_active":"2023-11-28T16:57:03.875768+0000","last_became_peered":"2023-11-28T16:57:03.875768+0000","last_unstale":"2023-11-28T16:57:03.884783+0000","last_undegraded":"2023-11-28T16:57:03.884783+0000","last_fullsized":"2023-11-28T16:57:03.884783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:42.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.868286+0000","last_change":"2023-11-28T16:57:02.890748+0000","last_active":"2023-11-28T16:57:03.868286+0000","last_peered":"2023-11-28T16:57:03.868286+0000","last_clean":"2023-11-28T16:57:03.868286+0000","last_became_active":"2023-11-28T16:57:02.890463+0000","last_became_peered":"2023-11-28T16:57:02.890463+0000","last_unstale":"2023-11-28T16:57:03.868286+0000","last_undegraded":"2023-11-28T16:57:03.868286+0000","last_fullsized":"2023-11-28T16:57:03.868286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.898978+0000","last_change":"2023-11-28T16:57:03.892153+0000","last_active":"2023-11-28T16:57:03.898978+0000","last_peered":"2023-11-28T16:57:03.898978+0000","last_clean":"2023-11-28T16:57:03.898978+0000","last_became_active":"2023-11-28T16:57:03.891822+0000","last_became_peered":"2023-11-28T16:57:03.891822+0000","last_unstale":"2023-11-28T16:57:03.898978+0000","last_undegraded":"2023-11-28T16:57:03.898978+0000","last_fullsized":"2023-11-28T16:57:03.898978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:00.206784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.869296+0000","last_change":"2023-11-28T16:57:02.883158+0000","last_active":"2023-11-28T16:57:03.869296+0000","last_peered":"2023-11-28T16:57:03.869296+0000","last_clean":"2023-11-28T16:57:03.869296+0000","last_became_active":"2023-11-28T16:57:02.882770+0000","last_became_peered":"2023-11-28T16:57:02.882770+0000","last_unstale":"2023-11-28T16:57:03.869296+0000","last_undegraded":"2023-11-28T16:57:03.869296+0000","last_fullsized":"2023-11-28T16:57:03.869296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.902772+0000","last_change":"2023-11-28T16:57:03.898729+0000","last_active":"2023-11-28T16:57:03.902772+0000","last_peered":"2023-11-28T16:57:03.902772+0000","last_clean":"2023-11-28T16:57:03.902772+0000","last_became_active":"2023-11-28T16:57:03.898497+0000","last_became_peered":"2023-11-28T16:57:03.898497+0000","last_unstale":"2023-11-28T16:57:03.902772+0000","last_undegraded":"2023-11-28T16:57:03.902772+0000","last_fullsized":"2023-11-28T16:57:03.902772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:21.117551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.868213+0000","last_change":"2023-11-28T16:57:02.881583+0000","last_active":"2023-11-28T16:57:03.868213+0000","last_peered":"2023-11-28T16:57:03.868213+0000","last_clean":"2023-11-28T16:57:03.868213+0000","last_became_active":"2023-11-28T16:57:02.880399+0000","last_became_peered":"2023-11-28T16:57:02.880399+0000","last_unstale":"2023-11-28T16:57:03.868213+0000","last_undegraded":"2023-11-28T16:57:03.868213+0000","last_fullsized":"2023-11-28T16:57:03.868213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.889315+0000","last_change":"2023-11-28T16:57:03.881044+0000","last_active":"2023-11-28T16:57:03.889315+0000","last_peered":"2023-11-28T16:57:03.889315+0000","last_clean":"2023-11-28T16:57:03.889315+0000","last_became_active":"2023-11-28T16:57:03.880727+0000","last_became_peered":"2023-11-28T16:57:03.880727+0000","last_unstale":"2023-11-28T16:57:03.889315+0000","last_undegraded":"2023-11-28T16:57:03.889315+0000","last_fullsized":"2023-11-28T16:57:03.889315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.871671+0000","last_change":"2023-11-28T16:57:02.880973+0000","last_active":"2023-11-28T16:57:03.871671+0000","last_peered":"2023-11-28T16:57:03.871671+0000","last_clean":"2023-11-28T16:57:03.871671+0000","last_became_active":"2023-11-28T16:57:02.880470+0000","last_became_peered":"2023-11-28T16:57:02.880470+0000","last_unstale":"2023-11-28T16:57:03.871671+0000","last_undegraded":"2023-11-28T16:57:03.871671+0000","last_fullsized":"2023-11-28T16:57:03.871671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:14.363778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892325+0000","last_change":"2023-11-28T16:57:03.888974+0000","last_active":"2023-11-28T16:57:03.892325+0000","last_peered":"2023-11-28T16:57:03.892325+0000","last_clean":"2023-11-28T16:57:03.892325+0000","last_became_active":"2023-11-28T16:57:03.888693+0000","last_became_peered":"2023-11-28T16:57:03.888693+0000","last_unstale":"2023-11-28T16:57:03.892325+0000","last_undegraded":"2023-11-28T16:57:03.892325+0000","last_fullsized":"2023-11-28T16:57:03.892325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:36.406739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.871969+0000","last_change":"2023-11-28T16:57:02.889684+0000","last_active":"2023-11-28T16:57:03.871969+0000","last_peered":"2023-11-28T16:57:03.871969+0000","last_clean":"2023-11-28T16:57:03.871969+0000","last_became_active":"2023-11-28T16:57:02.889040+0000","last_became_peered":"2023-11-28T16:57:02.889040+0000","last_unstale":"2023-11-28T16:57:03.871969+0000","last_undegraded":"2023-11-28T16:57:03.871969+0000","last_fullsized":"2023-11-28T16:57:03.871969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899301+0000","last_change":"2023-11-28T16:57:03.886837+0000","last_active":"2023-11-28T16:57:03.899301+0000","last_peered":"2023-11-28T16:57:03.899301+0000","last_clean":"2023-11-28T16:57:03.899301+0000","last_became_active":"2023-11-28T16:57:03.886378+0000","last_became_peered":"2023-11-28T16:57:03.886378+0000","last_unstale":"2023-11-28T16:57:03.899301+0000","last_undegraded":"2023-11-28T16:57:03.899301+0000","last_fullsized":"2023-11-28T16:57:03.899301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897048+0000","last_change":"2023-11-28T16:57:02.889062+0000","last_active":"2023-11-28T16:57:03.897048+0000","last_peered":"2023-11-28T16:57:03.897048+0000","last_clean":"2023-11-28T16:57:03.897048+0000","last_became_active":"2023-11-28T16:57:02.888650+0000","last_became_peered":"2023-11-28T16:57:02.888650+0000","last_unstale":"2023-11-28T16:57:03.897048+0000","last_undegraded":"2023-11-28T16:57:03.897048+0000","last_fullsized":"2023-11-28T16:57:03.897048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-28T16:57:02.867547+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:57:02.867547+0000","last_peered":"2023-11-28T16:57:02.867547+0000","last_clean":"2023-11-28T16:57:02.867547+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:57:02.867547+0000","last_undegraded":"2023-11-28T16:57:02.867547+0000","last_fullsized":"2023-11-28T16:57:02.867547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":723575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":133221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":134751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":723485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:57:07.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:57:08.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.162+0000 7f4ee805a640 1 Processor -- start 2023-11-28T16:57:08.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.162+0000 7f4ee805a640 1 -- start start 2023-11-28T16:57:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.162+0000 7f4ee805a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ee0152ce0 0x7f4ee006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee805a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee006d100 0x7f4ee00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee805a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee006bea0 con 0x7f4ee006db80 2023-11-28T16:57:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee805a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee0159b10 con 0x7f4ee0152ce0 2023-11-28T16:57:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee805a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0159550 con 0x7f4ee006d100 2023-11-28T16:57:08.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee5df6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ee0152ce0 0x7f4ee006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee65f7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee006d100 0x7f4ee00c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee55f5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4ee006db80 0x7f4ee00700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:47474/0 (socket says 172.21.15.26:47474) 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee55f5640 1 -- 172.21.15.26:0/907609692 learned_addr learned my addr 172.21.15.26:0/907609692 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee4df4640 1 -- 172.21.15.26:0/907609692 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108974010 0 0) 0x7f4ee006bea0 con 0x7f4ee006db80 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee4df4640 1 -- 172.21.15.26:0/907609692 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ecc003530 con 0x7f4ee006db80 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee5df6640 1 -- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee006d100 msgr2=0x7f4ee00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee5df6640 1 --2- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee006d100 0x7f4ee00c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee5df6640 1 -- 172.21.15.26:0/907609692 >> v1:172.21.15.79:6789/0 conn(0x7f4ee006db80 legacy=0x7f4ee00700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee5df6640 1 -- 172.21.15.26:0/907609692 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0159830 con 0x7f4ee0152ce0 2023-11-28T16:57:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.166+0000 7f4ee65f7640 1 --2- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee006d100 0x7f4ee00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee5df6640 1 --2- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee0152ce0 0x7f4ee006c940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0097c0 tx=0x7f4edc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22652457b2d5ee5f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee4df4640 1 -- 172.21.15.26:0/907609692 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0ab5f0 con 0x7f4ee0152ce0 2023-11-28T16:57:08.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee4df4640 1 -- 172.21.15.26:0/907609692 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc0ab750 con 0x7f4ee0152ce0 2023-11-28T16:57:08.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee4df4640 1 -- 172.21.15.26:0/907609692 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0abae0 con 0x7f4ee0152ce0 2023-11-28T16:57:08.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 -- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee0152ce0 msgr2=0x7f4ee006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 --2- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee0152ce0 0x7f4ee006c940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0097c0 tx=0x7f4edc01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 -- 172.21.15.26:0/907609692 shutdown_connections 2023-11-28T16:57:08.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 --2- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee006d100 0x7f4ee00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 --2- 172.21.15.26:0/907609692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee0152ce0 0x7f4ee006c940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 -- 172.21.15.26:0/907609692 >> 172.21.15.26:0/907609692 conn(0x7f4ee00c2ad0 msgr2=0x7f4ee00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:08.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 -- 172.21.15.26:0/907609692 shutdown_connections 2023-11-28T16:57:08.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 -- 172.21.15.26:0/907609692 wait complete. 2023-11-28T16:57:08.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 Processor -- start 2023-11-28T16:57:08.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.170+0000 7f4ee805a640 1 -- start start 2023-11-28T16:57:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee006d100 0x7f4ee015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ee006db80 0x7f4ee015b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee0152ce0 0x7f4ee01f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00a8e40 con 0x7f4ee006db80 2023-11-28T16:57:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00a9120 con 0x7f4ee006d100 2023-11-28T16:57:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee015c5c0 con 0x7f4ee0152ce0 2023-11-28T16:57:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ee006db80 0x7f4ee015b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ee006db80 0x7f4ee015b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51990/0 (socket says 172.21.15.26:51990) 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 -- 172.21.15.26:0/4188767740 learned_addr learned my addr 172.21.15.26:0/4188767740 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee5df6640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee006d100 0x7f4ee015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee65f7640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee0152ce0 0x7f4ee01f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 -- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee0152ce0 msgr2=0x7f4ee01f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee0152ce0 0x7f4ee01f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 -- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee006d100 msgr2=0x7f4ee015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee006d100 0x7f4ee015abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 -- 172.21.15.26:0/4188767740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009a70 con 0x7f4ee006db80 2023-11-28T16:57:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee55f5640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ee006db80 0x7f4ee015b0f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0001ec0 tx=0x7f4ed000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ed67fc640 1 -- 172.21.15.26:0/4188767740 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005cf0 con 0x7f4ee006db80 2023-11-28T16:57:08.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ed67fc640 1 -- 172.21.15.26:0/4188767740 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0005e50 con 0x7f4ee006db80 2023-11-28T16:57:08.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ed67fc640 1 -- 172.21.15.26:0/4188767740 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00072d0 con 0x7f4ee006db80 2023-11-28T16:57:08.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc009420 con 0x7f4ee006db80 2023-11-28T16:57:08.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee015b630 con 0x7f4ee006db80 2023-11-28T16:57:08.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee015a8d0 con 0x7f4ee006db80 2023-11-28T16:57:08.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.174+0000 7f4ed67fc640 1 -- 172.21.15.26:0/4188767740 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4ed0007430 con 0x7f4ee006db80 2023-11-28T16:57:08.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.178+0000 7f4ed67fc640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ec40668d0 0x7f4ec4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.178+0000 7f4ed67fc640 1 -- 172.21.15.26:0/4188767740 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ed0083600 con 0x7f4ee006db80 2023-11-28T16:57:08.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.178+0000 7f4ee5df6640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ec40668d0 0x7f4ec4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.178+0000 7f4ee5df6640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ec40668d0 0x7f4ec4068d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0af000 tx=0x7f4edc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.182+0000 7f4ed67fc640 1 -- 172.21.15.26:0/4188767740 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ee015a8d0 con 0x7f4ee006db80 2023-11-28T16:57:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.338+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ee015a8d0 con 0x7f4ec40668d0 2023-11-28T16:57:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.346+0000 7f4ed67fc640 1 -- 172.21.15.26:0/4188767740 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f4ee015a8d0 con 0x7f4ec40668d0 2023-11-28T16:57:08.353 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:08.355 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ec40668d0 msgr2=0x7f4ec4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ec40668d0 0x7f4ec4068d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0af000 tx=0x7f4edc0a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ee006db80 msgr2=0x7f4ee015b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ee006db80 0x7f4ee015b0f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0001ec0 tx=0x7f4ed000c8a0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 shutdown_connections 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ec40668d0 0x7f4ec4068d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee0152ce0 0x7f4ee01f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ee006db80 0x7f4ee015b0f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 --2- 172.21.15.26:0/4188767740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee006d100 0x7f4ee015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 >> 172.21.15.26:0/4188767740 conn(0x7f4ee00c2ad0 msgr2=0x7f4ee014fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 shutdown_connections 2023-11-28T16:57:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.350+0000 7f4ee805a640 1 -- 172.21.15.26:0/4188767740 wait complete. 2023-11-28T16:57:08.374 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-28T16:57:07.585308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236732,"kb_used_data":3916,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737988,"statfs":{"total":773094113280,"available":772851699712,"internally_reserved":0,"allocated":4009984,"data_stored":2242083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.729049"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900969+0000","last_change":"2023-11-28T16:57:03.894170+0000","last_active":"2023-11-28T16:57:03.900969+0000","last_peered":"2023-11-28T16:57:03.900969+0000","last_clean":"2023-11-28T16:57:03.900969+0000","last_became_active":"2023-11-28T16:57:03.893856+0000","last_became_peered":"2023-11-28T16:57:03.893856+0000","last_unstale":"2023-11-28T16:57:03.900969+0000","last_undegraded":"2023-11-28T16:57:03.900969+0000","last_fullsized":"2023-11-28T16:57:03.900969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:42.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911089+0000","last_change":"2023-11-28T16:57:03.896151+0000","last_active":"2023-11-28T16:57:03.911089+0000","last_peered":"2023-11-28T16:57:03.911089+0000","last_clean":"2023-11-28T16:57:03.911089+0000","last_became_active":"2023-11-28T16:57:03.891088+0000","last_became_peered":"2023-11-28T16:57:03.891088+0000","last_unstale":"2023-11-28T16:57:03.911089+0000","last_undegraded":"2023-11-28T16:57:03.911089+0000","last_fullsized":"2023-11-28T16:57:03.911089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.907201+0000","last_change":"2023-11-28T16:57:03.905652+0000","last_active":"2023-11-28T16:57:03.907201+0000","last_peered":"2023-11-28T16:57:03.907201+0000","last_clean":"2023-11-28T16:57:03.907201+0000","last_became_active":"2023-11-28T16:57:03.905310+0000","last_became_peered":"2023-11-28T16:57:03.905310+0000","last_unstale":"2023-11-28T16:57:03.907201+0000","last_undegraded":"2023-11-28T16:57:03.907201+0000","last_fullsized":"2023-11-28T16:57:03.907201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.885448+0000","last_change":"2023-11-28T16:57:03.881735+0000","last_active":"2023-11-28T16:57:03.885448+0000","last_peered":"2023-11-28T16:57:03.885448+0000","last_clean":"2023-11-28T16:57:03.885448+0000","last_became_active":"2023-11-28T16:57:03.881212+0000","last_became_peered":"2023-11-28T16:57:03.881212+0000","last_unstale":"2023-11-28T16:57:03.885448+0000","last_undegraded":"2023-11-28T16:57:03.885448+0000","last_fullsized":"2023-11-28T16:57:03.885448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:21.117551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900190+0000","last_change":"2023-11-28T16:57:03.895662+0000","last_active":"2023-11-28T16:57:03.900190+0000","last_peered":"2023-11-28T16:57:03.900190+0000","last_clean":"2023-11-28T16:57:03.900190+0000","last_became_active":"2023-11-28T16:57:03.895366+0000","last_became_peered":"2023-11-28T16:57:03.895366+0000","last_unstale":"2023-11-28T16:57:03.900190+0000","last_undegraded":"2023-11-28T16:57:03.900190+0000","last_fullsized":"2023-11-28T16:57:03.900190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:18:22.025823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894887+0000","last_change":"2023-11-28T16:57:03.884669+0000","last_active":"2023-11-28T16:57:03.894887+0000","last_peered":"2023-11-28T16:57:03.894887+0000","last_clean":"2023-11-28T16:57:03.894887+0000","last_became_active":"2023-11-28T16:57:03.884388+0000","last_became_peered":"2023-11-28T16:57:03.884388+0000","last_unstale":"2023-11-28T16:57:03.894887+0000","last_undegraded":"2023-11-28T16:57:03.894887+0000","last_fullsized":"2023-11-28T16:57:03.894887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903634+0000","last_change":"2023-11-28T16:57:03.896614+0000","last_active":"2023-11-28T16:57:03.903634+0000","last_peered":"2023-11-28T16:57:03.903634+0000","last_clean":"2023-11-28T16:57:03.903634+0000","last_became_active":"2023-11-28T16:57:03.896037+0000","last_became_peered":"2023-11-28T16:57:03.896037+0000","last_unstale":"2023-11-28T16:57:03.903634+0000","last_undegraded":"2023-11-28T16:57:03.903634+0000","last_fullsized":"2023-11-28T16:57:03.903634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.586951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903439+0000","last_change":"2023-11-28T16:57:03.894793+0000","last_active":"2023-11-28T16:57:03.903439+0000","last_peered":"2023-11-28T16:57:03.903439+0000","last_clean":"2023-11-28T16:57:03.903439+0000","last_became_active":"2023-11-28T16:57:03.887901+0000","last_became_peered":"2023-11-28T16:57:03.887901+0000","last_unstale":"2023-11-28T16:57:03.903439+0000","last_undegraded":"2023-11-28T16:57:03.903439+0000","last_fullsized":"2023-11-28T16:57:03.903439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.888467+0000","last_change":"2023-11-28T16:57:03.884223+0000","last_active":"2023-11-28T16:57:03.888467+0000","last_peered":"2023-11-28T16:57:03.888467+0000","last_clean":"2023-11-28T16:57:03.888467+0000","last_became_active":"2023-11-28T16:57:03.883861+0000","last_became_peered":"2023-11-28T16:57:03.883861+0000","last_unstale":"2023-11-28T16:57:03.888467+0000","last_undegraded":"2023-11-28T16:57:03.888467+0000","last_fullsized":"2023-11-28T16:57:03.888467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:07:32.729943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.908671+0000","last_change":"2023-11-28T16:57:03.898138+0000","last_active":"2023-11-28T16:57:03.908671+0000","last_peered":"2023-11-28T16:57:03.908671+0000","last_clean":"2023-11-28T16:57:03.908671+0000","last_became_active":"2023-11-28T16:57:03.897728+0000","last_became_peered":"2023-11-28T16:57:03.897728+0000","last_unstale":"2023-11-28T16:57:03.908671+0000","last_undegraded":"2023-11-28T16:57:03.908671+0000","last_fullsized":"2023-11-28T16:57:03.908671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899409+0000","last_change":"2023-11-28T16:57:03.887859+0000","last_active":"2023-11-28T16:57:03.899409+0000","last_peered":"2023-11-28T16:57:03.899409+0000","last_clean":"2023-11-28T16:57:03.899409+0000","last_became_active":"2023-11-28T16:57:03.887591+0000","last_became_peered":"2023-11-28T16:57:03.887591+0000","last_unstale":"2023-11-28T16:57:03.899409+0000","last_undegraded":"2023-11-28T16:57:03.899409+0000","last_fullsized":"2023-11-28T16:57:03.899409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:46.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901142+0000","last_change":"2023-11-28T16:57:03.896260+0000","last_active":"2023-11-28T16:57:03.901142+0000","last_peered":"2023-11-28T16:57:03.901142+0000","last_clean":"2023-11-28T16:57:03.901142+0000","last_became_active":"2023-11-28T16:57:03.894336+0000","last_became_peered":"2023-11-28T16:57:03.894336+0000","last_unstale":"2023-11-28T16:57:03.901142+0000","last_undegraded":"2023-11-28T16:57:03.901142+0000","last_fullsized":"2023-11-28T16:57:03.901142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894894+0000","last_change":"2023-11-28T16:57:03.890754+0000","last_active":"2023-11-28T16:57:03.894894+0000","last_peered":"2023-11-28T16:57:03.894894+0000","last_clean":"2023-11-28T16:57:03.894894+0000","last_became_active":"2023-11-28T16:57:03.890427+0000","last_became_peered":"2023-11-28T16:57:03.890427+0000","last_unstale":"2023-11-28T16:57:03.894894+0000","last_undegraded":"2023-11-28T16:57:03.894894+0000","last_fullsized":"2023-11-28T16:57:03.894894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:48.826550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.905608+0000","last_change":"2023-11-28T16:57:03.889443+0000","last_active":"2023-11-28T16:57:03.905608+0000","last_peered":"2023-11-28T16:57:03.905608+0000","last_clean":"2023-11-28T16:57:03.905608+0000","last_became_active":"2023-11-28T16:57:03.888958+0000","last_became_peered":"2023-11-28T16:57:03.888958+0000","last_unstale":"2023-11-28T16:57:03.905608+0000","last_undegraded":"2023-11-28T16:57:03.905608+0000","last_fullsized":"2023-11-28T16:57:03.905608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901302+0000","last_change":"2023-11-28T16:57:03.895417+0000","last_active":"2023-11-28T16:57:03.901302+0000","last_peered":"2023-11-28T16:57:03.901302+0000","last_clean":"2023-11-28T16:57:03.901302+0000","last_became_active":"2023-11-28T16:57:03.895139+0000","last_became_peered":"2023-11-28T16:57:03.895139+0000","last_unstale":"2023-11-28T16:57:03.901302+0000","last_undegraded":"2023-11-28T16:57:03.901302+0000","last_fullsized":"2023-11-28T16:57:03.901302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.904588+0000","last_change":"2023-11-28T16:57:03.899703+0000","last_active":"2023-11-28T16:57:03.904588+0000","last_peered":"2023-11-28T16:57:03.904588+0000","last_clean":"2023-11-28T16:57:03.904588+0000","last_became_active":"2023-11-28T16:57:03.899394+0000","last_became_peered":"2023-11-28T16:57:03.899394+0000","last_unstale":"2023-11-28T16:57:03.904588+0000","last_undegraded":"2023-11-28T16:57:03.904588+0000","last_fullsized":"2023-11-28T16:57:03.904588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.904543+0000","last_change":"2023-11-28T16:57:03.899079+0000","last_active":"2023-11-28T16:57:03.904543+0000","last_peered":"2023-11-28T16:57:03.904543+0000","last_clean":"2023-11-28T16:57:03.904543+0000","last_became_active":"2023-11-28T16:57:03.898739+0000","last_became_peered":"2023-11-28T16:57:03.898739+0000","last_unstale":"2023-11-28T16:57:03.904543+0000","last_undegraded":"2023-11-28T16:57:03.904543+0000","last_fullsized":"2023-11-28T16:57:03.904543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911301+0000","last_change":"2023-11-28T16:57:03.891691+0000","last_active":"2023-11-28T16:57:03.911301+0000","last_peered":"2023-11-28T16:57:03.911301+0000","last_clean":"2023-11-28T16:57:03.911301+0000","last_became_active":"2023-11-28T16:57:03.890689+0000","last_became_peered":"2023-11-28T16:57:03.890689+0000","last_unstale":"2023-11-28T16:57:03.911301+0000","last_undegraded":"2023-11-28T16:57:03.911301+0000","last_fullsized":"2023-11-28T16:57:03.911301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.913597+0000","last_change":"2023-11-28T16:57:03.910151+0000","last_active":"2023-11-28T16:57:03.913597+0000","last_peered":"2023-11-28T16:57:03.913597+0000","last_clean":"2023-11-28T16:57:03.913597+0000","last_became_active":"2023-11-28T16:57:03.909840+0000","last_became_peered":"2023-11-28T16:57:03.909840+0000","last_unstale":"2023-11-28T16:57:03.913597+0000","last_undegraded":"2023-11-28T16:57:03.913597+0000","last_fullsized":"2023-11-28T16:57:03.913597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.896731+0000","last_change":"2023-11-28T16:57:03.893588+0000","last_active":"2023-11-28T16:57:03.896731+0000","last_peered":"2023-11-28T16:57:03.896731+0000","last_clean":"2023-11-28T16:57:03.896731+0000","last_became_active":"2023-11-28T16:57:03.891825+0000","last_became_peered":"2023-11-28T16:57:03.891825+0000","last_unstale":"2023-11-28T16:57:03.896731+0000","last_undegraded":"2023-11-28T16:57:03.896731+0000","last_fullsized":"2023-11-28T16:57:03.896731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:18.679259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.890866+0000","last_change":"2023-11-28T16:57:03.885753+0000","last_active":"2023-11-28T16:57:03.890866+0000","last_peered":"2023-11-28T16:57:03.890866+0000","last_clean":"2023-11-28T16:57:03.890866+0000","last_became_active":"2023-11-28T16:57:03.885404+0000","last_became_peered":"2023-11-28T16:57:03.885404+0000","last_unstale":"2023-11-28T16:57:03.890866+0000","last_undegraded":"2023-11-28T16:57:03.890866+0000","last_fullsized":"2023-11-28T16:57:03.890866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:01.464912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892467+0000","last_change":"2023-11-28T16:57:03.888953+0000","last_active":"2023-11-28T16:57:03.892467+0000","last_peered":"2023-11-28T16:57:03.892467+0000","last_clean":"2023-11-28T16:57:03.892467+0000","last_became_active":"2023-11-28T16:57:03.888624+0000","last_became_peered":"2023-11-28T16:57:03.888624+0000","last_unstale":"2023-11-28T16:57:03.892467+0000","last_undegraded":"2023-11-28T16:57:03.892467+0000","last_fullsized":"2023-11-28T16:57:03.892467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:46.680946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897704+0000","last_change":"2023-11-28T16:57:03.888524+0000","last_active":"2023-11-28T16:57:03.897704+0000","last_peered":"2023-11-28T16:57:03.897704+0000","last_clean":"2023-11-28T16:57:03.897704+0000","last_became_active":"2023-11-28T16:57:03.885162+0000","last_became_peered":"2023-11-28T16:57:03.885162+0000","last_unstale":"2023-11-28T16:57:03.897704+0000","last_undegraded":"2023-11-28T16:57:03.897704+0000","last_fullsized":"2023-11-28T16:57:03.897704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900714+0000","last_change":"2023-11-28T16:57:03.889249+0000","last_active":"2023-11-28T16:57:03.900714+0000","last_peered":"2023-11-28T16:57:03.900714+0000","last_clean":"2023-11-28T16:57:03.900714+0000","last_became_active":"2023-11-28T16:57:03.888913+0000","last_became_peered":"2023-11-28T16:57:03.888913+0000","last_unstale":"2023-11-28T16:57:03.900714+0000","last_undegraded":"2023-11-28T16:57:03.900714+0000","last_fullsized":"2023-11-28T16:57:03.900714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894993+0000","last_change":"2023-11-28T16:57:03.885984+0000","last_active":"2023-11-28T16:57:03.894993+0000","last_peered":"2023-11-28T16:57:03.894993+0000","last_clean":"2023-11-28T16:57:03.894993+0000","last_became_active":"2023-11-28T16:57:03.885297+0000","last_became_peered":"2023-11-28T16:57:03.885297+0000","last_unstale":"2023-11-28T16:57:03.894993+0000","last_undegraded":"2023-11-28T16:57:03.894993+0000","last_fullsized":"2023-11-28T16:57:03.894993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.910413+0000","last_change":"2023-11-28T16:57:03.891455+0000","last_active":"2023-11-28T16:57:03.910413+0000","last_peered":"2023-11-28T16:57:03.910413+0000","last_clean":"2023-11-28T16:57:03.910413+0000","last_became_active":"2023-11-28T16:57:03.890363+0000","last_became_peered":"2023-11-28T16:57:03.890363+0000","last_unstale":"2023-11-28T16:57:03.910413+0000","last_undegraded":"2023-11-28T16:57:03.910413+0000","last_fullsized":"2023-11-28T16:57:03.910413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.586951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.908378+0000","last_change":"2023-11-28T16:57:03.899721+0000","last_active":"2023-11-28T16:57:03.908378+0000","last_peered":"2023-11-28T16:57:03.908378+0000","last_clean":"2023-11-28T16:57:03.908378+0000","last_became_active":"2023-11-28T16:57:03.898861+0000","last_became_peered":"2023-11-28T16:57:03.898861+0000","last_unstale":"2023-11-28T16:57:03.908378+0000","last_undegraded":"2023-11-28T16:57:03.908378+0000","last_fullsized":"2023-11-28T16:57:03.908378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901094+0000","last_change":"2023-11-28T16:57:03.894338+0000","last_active":"2023-11-28T16:57:03.901094+0000","last_peered":"2023-11-28T16:57:03.901094+0000","last_clean":"2023-11-28T16:57:03.901094+0000","last_became_active":"2023-11-28T16:57:03.894019+0000","last_became_peered":"2023-11-28T16:57:03.894019+0000","last_unstale":"2023-11-28T16:57:03.901094+0000","last_undegraded":"2023-11-28T16:57:03.901094+0000","last_fullsized":"2023-11-28T16:57:03.901094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.887828+0000","last_change":"2023-11-28T16:57:03.884478+0000","last_active":"2023-11-28T16:57:03.887828+0000","last_peered":"2023-11-28T16:57:03.887828+0000","last_clean":"2023-11-28T16:57:03.887828+0000","last_became_active":"2023-11-28T16:57:03.884199+0000","last_became_peered":"2023-11-28T16:57:03.884199+0000","last_unstale":"2023-11-28T16:57:03.887828+0000","last_undegraded":"2023-11-28T16:57:03.887828+0000","last_fullsized":"2023-11-28T16:57:03.887828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:39:05.732024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.907645+0000","last_change":"2023-11-28T16:57:03.904013+0000","last_active":"2023-11-28T16:57:03.907645+0000","last_peered":"2023-11-28T16:57:03.907645+0000","last_clean":"2023-11-28T16:57:03.907645+0000","last_became_active":"2023-11-28T16:57:03.903753+0000","last_became_peered":"2023-11-28T16:57:03.903753+0000","last_unstale":"2023-11-28T16:57:03.907645+0000","last_undegraded":"2023-11-28T16:57:03.907645+0000","last_fullsized":"2023-11-28T16:57:03.907645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.900375+0000","last_change":"2023-11-28T16:57:03.892625+0000","last_active":"2023-11-28T16:57:03.900375+0000","last_peered":"2023-11-28T16:57:03.900375+0000","last_clean":"2023-11-28T16:57:03.900375+0000","last_became_active":"2023-11-28T16:57:03.892360+0000","last_became_peered":"2023-11-28T16:57:03.892360+0000","last_unstale":"2023-11-28T16:57:03.900375+0000","last_undegraded":"2023-11-28T16:57:03.900375+0000","last_fullsized":"2023-11-28T16:57:03.900375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:40.067864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899617+0000","last_change":"2023-11-28T16:57:03.886973+0000","last_active":"2023-11-28T16:57:03.899617+0000","last_peered":"2023-11-28T16:57:03.899617+0000","last_clean":"2023-11-28T16:57:03.899617+0000","last_became_active":"2023-11-28T16:57:03.886340+0000","last_became_peered":"2023-11-28T16:57:03.886340+0000","last_unstale":"2023-11-28T16:57:03.899617+0000","last_undegraded":"2023-11-28T16:57:03.899617+0000","last_fullsized":"2023-11-28T16:57:03.899617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.898094+0000","last_change":"2023-11-28T16:57:03.894765+0000","last_active":"2023-11-28T16:57:03.898094+0000","last_peered":"2023-11-28T16:57:03.898094+0000","last_clean":"2023-11-28T16:57:03.898094+0000","last_became_active":"2023-11-28T16:57:03.894466+0000","last_became_peered":"2023-11-28T16:57:03.894466+0000","last_unstale":"2023-11-28T16:57:03.898094+0000","last_undegraded":"2023-11-28T16:57:03.898094+0000","last_fullsized":"2023-11-28T16:57:03.898094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:40.067864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914077+0000","last_change":"2023-11-28T16:57:02.890520+0000","last_active":"2023-11-28T16:57:03.914077+0000","last_peered":"2023-11-28T16:57:03.914077+0000","last_clean":"2023-11-28T16:57:03.914077+0000","last_became_active":"2023-11-28T16:57:02.890238+0000","last_became_peered":"2023-11-28T16:57:02.890238+0000","last_unstale":"2023-11-28T16:57:03.914077+0000","last_undegraded":"2023-11-28T16:57:03.914077+0000","last_fullsized":"2023-11-28T16:57:03.914077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899494+0000","last_change":"2023-11-28T16:57:03.891242+0000","last_active":"2023-11-28T16:57:03.899494+0000","last_peered":"2023-11-28T16:57:03.899494+0000","last_clean":"2023-11-28T16:57:03.899494+0000","last_became_active":"2023-11-28T16:57:03.890884+0000","last_became_peered":"2023-11-28T16:57:03.890884+0000","last_unstale":"2023-11-28T16:57:03.899494+0000","last_undegraded":"2023-11-28T16:57:03.899494+0000","last_fullsized":"2023-11-28T16:57:03.899494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:01.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906500+0000","last_change":"2023-11-28T16:57:02.878046+0000","last_active":"2023-11-28T16:57:03.906500+0000","last_peered":"2023-11-28T16:57:03.906500+0000","last_clean":"2023-11-28T16:57:03.906500+0000","last_became_active":"2023-11-28T16:57:02.877719+0000","last_became_peered":"2023-11-28T16:57:02.877719+0000","last_unstale":"2023-11-28T16:57:03.906500+0000","last_undegraded":"2023-11-28T16:57:03.906500+0000","last_fullsized":"2023-11-28T16:57:03.906500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.905279+0000","last_change":"2023-11-28T16:57:03.898573+0000","last_active":"2023-11-28T16:57:03.905279+0000","last_peered":"2023-11-28T16:57:03.905279+0000","last_clean":"2023-11-28T16:57:03.905279+0000","last_became_active":"2023-11-28T16:57:03.898275+0000","last_became_peered":"2023-11-28T16:57:03.898275+0000","last_unstale":"2023-11-28T16:57:03.905279+0000","last_undegraded":"2023-11-28T16:57:03.905279+0000","last_fullsized":"2023-11-28T16:57:03.905279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:56.812246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914016+0000","last_change":"2023-11-28T16:57:02.895629+0000","last_active":"2023-11-28T16:57:03.914016+0000","last_peered":"2023-11-28T16:57:03.914016+0000","last_clean":"2023-11-28T16:57:03.914016+0000","last_became_active":"2023-11-28T16:57:02.895339+0000","last_became_peered":"2023-11-28T16:57:02.895339+0000","last_unstale":"2023-11-28T16:57:03.914016+0000","last_undegraded":"2023-11-28T16:57:03.914016+0000","last_fullsized":"2023-11-28T16:57:03.914016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:22.670983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.908397+0000","last_change":"2023-11-28T16:57:03.899996+0000","last_active":"2023-11-28T16:57:03.908397+0000","last_peered":"2023-11-28T16:57:03.908397+0000","last_clean":"2023-11-28T16:57:03.908397+0000","last_became_active":"2023-11-28T16:57:03.899369+0000","last_became_peered":"2023-11-28T16:57:03.899369+0000","last_unstale":"2023-11-28T16:57:03.908397+0000","last_undegraded":"2023-11-28T16:57:03.908397+0000","last_fullsized":"2023-11-28T16:57:03.908397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911976+0000","last_change":"2023-11-28T16:57:02.893416+0000","last_active":"2023-11-28T16:57:03.911976+0000","last_peered":"2023-11-28T16:57:03.911976+0000","last_clean":"2023-11-28T16:57:03.911976+0000","last_became_active":"2023-11-28T16:57:02.892837+0000","last_became_peered":"2023-11-28T16:57:02.892837+0000","last_unstale":"2023-11-28T16:57:03.911976+0000","last_undegraded":"2023-11-28T16:57:03.911976+0000","last_fullsized":"2023-11-28T16:57:03.911976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:35.400319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.905658+0000","last_change":"2023-11-28T16:57:03.897702+0000","last_active":"2023-11-28T16:57:03.905658+0000","last_peered":"2023-11-28T16:57:03.905658+0000","last_clean":"2023-11-28T16:57:03.905658+0000","last_became_active":"2023-11-28T16:57:03.895461+0000","last_became_peered":"2023-11-28T16:57:03.895461+0000","last_unstale":"2023-11-28T16:57:03.905658+0000","last_undegraded":"2023-11-28T16:57:03.905658+0000","last_fullsized":"2023-11-28T16:57:03.905658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914405+0000","last_change":"2023-11-28T16:57:02.883245+0000","last_active":"2023-11-28T16:57:03.914405+0000","last_peered":"2023-11-28T16:57:03.914405+0000","last_clean":"2023-11-28T16:57:03.914405+0000","last_became_active":"2023-11-28T16:57:02.882929+0000","last_became_peered":"2023-11-28T16:57:02.882929+0000","last_unstale":"2023-11-28T16:57:03.914405+0000","last_undegraded":"2023-11-28T16:57:03.914405+0000","last_fullsized":"2023-11-28T16:57:03.914405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:57:59.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892622+0000","last_change":"2023-11-28T16:57:03.889038+0000","last_active":"2023-11-28T16:57:03.892622+0000","last_peered":"2023-11-28T16:57:03.892622+0000","last_clean":"2023-11-28T16:57:03.892622+0000","last_became_active":"2023-11-28T16:57:03.888749+0000","last_became_peered":"2023-11-28T16:57:03.888749+0000","last_unstale":"2023-11-28T16:57:03.892622+0000","last_undegraded":"2023-11-28T16:57:03.892622+0000","last_fullsized":"2023-11-28T16:57:03.892622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914338+0000","last_change":"2023-11-28T16:57:02.884058+0000","last_active":"2023-11-28T16:57:03.914338+0000","last_peered":"2023-11-28T16:57:03.914338+0000","last_clean":"2023-11-28T16:57:03.914338+0000","last_became_active":"2023-11-28T16:57:02.883737+0000","last_became_peered":"2023-11-28T16:57:02.883737+0000","last_unstale":"2023-11-28T16:57:03.914338+0000","last_undegraded":"2023-11-28T16:57:03.914338+0000","last_fullsized":"2023-11-28T16:57:03.914338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:17:33.236125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894363+0000","last_change":"2023-11-28T16:57:03.892365+0000","last_active":"2023-11-28T16:57:03.894363+0000","last_peered":"2023-11-28T16:57:03.894363+0000","last_clean":"2023-11-28T16:57:03.894363+0000","last_became_active":"2023-11-28T16:57:03.892096+0000","last_became_peered":"2023-11-28T16:57:03.892096+0000","last_unstale":"2023-11-28T16:57:03.894363+0000","last_undegraded":"2023-11-28T16:57:03.894363+0000","last_fullsized":"2023-11-28T16:57:03.894363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:23.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872761+0000","last_change":"2023-11-28T16:57:02.887000+0000","last_active":"2023-11-28T16:57:03.872761+0000","last_peered":"2023-11-28T16:57:03.872761+0000","last_clean":"2023-11-28T16:57:03.872761+0000","last_became_active":"2023-11-28T16:57:02.886730+0000","last_became_peered":"2023-11-28T16:57:02.886730+0000","last_unstale":"2023-11-28T16:57:03.872761+0000","last_undegraded":"2023-11-28T16:57:03.872761+0000","last_fullsized":"2023-11-28T16:57:03.872761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.909465+0000","last_change":"2023-11-28T16:57:03.902695+0000","last_active":"2023-11-28T16:57:03.909465+0000","last_peered":"2023-11-28T16:57:03.909465+0000","last_clean":"2023-11-28T16:57:03.909465+0000","last_became_active":"2023-11-28T16:57:03.902147+0000","last_became_peered":"2023-11-28T16:57:03.902147+0000","last_unstale":"2023-11-28T16:57:03.909465+0000","last_undegraded":"2023-11-28T16:57:03.909465+0000","last_fullsized":"2023-11-28T16:57:03.909465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:01.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872260+0000","last_change":"2023-11-28T16:57:02.883963+0000","last_active":"2023-11-28T16:57:03.872260+0000","last_peered":"2023-11-28T16:57:03.872260+0000","last_clean":"2023-11-28T16:57:03.872260+0000","last_became_active":"2023-11-28T16:57:02.883629+0000","last_became_peered":"2023-11-28T16:57:02.883629+0000","last_unstale":"2023-11-28T16:57:03.872260+0000","last_undegraded":"2023-11-28T16:57:03.872260+0000","last_fullsized":"2023-11-28T16:57:03.872260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:00.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.916110+0000","last_change":"2023-11-28T16:57:03.912991+0000","last_active":"2023-11-28T16:57:03.916110+0000","last_peered":"2023-11-28T16:57:03.916110+0000","last_clean":"2023-11-28T16:57:03.916110+0000","last_became_active":"2023-11-28T16:57:03.912733+0000","last_became_peered":"2023-11-28T16:57:03.912733+0000","last_unstale":"2023-11-28T16:57:03.916110+0000","last_undegraded":"2023-11-28T16:57:03.916110+0000","last_fullsized":"2023-11-28T16:57:03.916110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.880216+0000","last_change":"2023-11-28T16:57:02.893953+0000","last_active":"2023-11-28T16:57:03.880216+0000","last_peered":"2023-11-28T16:57:03.880216+0000","last_clean":"2023-11-28T16:57:03.880216+0000","last_became_active":"2023-11-28T16:57:02.892987+0000","last_became_peered":"2023-11-28T16:57:02.892987+0000","last_unstale":"2023-11-28T16:57:03.880216+0000","last_undegraded":"2023-11-28T16:57:03.880216+0000","last_fullsized":"2023-11-28T16:57:03.880216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:08.372872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911533+0000","last_change":"2023-11-28T16:57:03.904109+0000","last_active":"2023-11-28T16:57:03.911533+0000","last_peered":"2023-11-28T16:57:03.911533+0000","last_clean":"2023-11-28T16:57:03.911533+0000","last_became_active":"2023-11-28T16:57:03.903816+0000","last_became_peered":"2023-11-28T16:57:03.903816+0000","last_unstale":"2023-11-28T16:57:03.911533+0000","last_undegraded":"2023-11-28T16:57:03.911533+0000","last_fullsized":"2023-11-28T16:57:03.911533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.869490+0000","last_change":"2023-11-28T16:57:02.881277+0000","last_active":"2023-11-28T16:57:03.869490+0000","last_peered":"2023-11-28T16:57:03.869490+0000","last_clean":"2023-11-28T16:57:03.869490+0000","last_became_active":"2023-11-28T16:57:02.881004+0000","last_became_peered":"2023-11-28T16:57:02.881004+0000","last_unstale":"2023-11-28T16:57:03.869490+0000","last_undegraded":"2023-11-28T16:57:03.869490+0000","last_fullsized":"2023-11-28T16:57:03.869490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906583+0000","last_change":"2023-11-28T16:57:03.889206+0000","last_active":"2023-11-28T16:57:03.906583+0000","last_peered":"2023-11-28T16:57:03.906583+0000","last_clean":"2023-11-28T16:57:03.906583+0000","last_became_active":"2023-11-28T16:57:03.888907+0000","last_became_peered":"2023-11-28T16:57:03.888907+0000","last_unstale":"2023-11-28T16:57:03.906583+0000","last_undegraded":"2023-11-28T16:57:03.906583+0000","last_fullsized":"2023-11-28T16:57:03.906583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.912485+0000","last_change":"2023-11-28T16:57:02.890396+0000","last_active":"2023-11-28T16:57:03.912485+0000","last_peered":"2023-11-28T16:57:03.912485+0000","last_clean":"2023-11-28T16:57:03.912485+0000","last_became_active":"2023-11-28T16:57:02.890068+0000","last_became_peered":"2023-11-28T16:57:02.890068+0000","last_unstale":"2023-11-28T16:57:03.912485+0000","last_undegraded":"2023-11-28T16:57:03.912485+0000","last_fullsized":"2023-11-28T16:57:03.912485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.117385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.907227+0000","last_change":"2023-11-28T16:57:03.905651+0000","last_active":"2023-11-28T16:57:03.907227+0000","last_peered":"2023-11-28T16:57:03.907227+0000","last_clean":"2023-11-28T16:57:03.907227+0000","last_became_active":"2023-11-28T16:57:03.904887+0000","last_became_peered":"2023-11-28T16:57:03.904887+0000","last_unstale":"2023-11-28T16:57:03.907227+0000","last_undegraded":"2023-11-28T16:57:03.907227+0000","last_fullsized":"2023-11-28T16:57:03.907227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.916045+0000","last_change":"2023-11-28T16:57:02.896876+0000","last_active":"2023-11-28T16:57:03.916045+0000","last_peered":"2023-11-28T16:57:03.916045+0000","last_clean":"2023-11-28T16:57:03.916045+0000","last_became_active":"2023-11-28T16:57:02.896650+0000","last_became_peered":"2023-11-28T16:57:02.896650+0000","last_unstale":"2023-11-28T16:57:03.916045+0000","last_undegraded":"2023-11-28T16:57:03.916045+0000","last_fullsized":"2023-11-28T16:57:03.916045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:45.191786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892990+0000","last_change":"2023-11-28T16:57:03.886262+0000","last_active":"2023-11-28T16:57:03.892990+0000","last_peered":"2023-11-28T16:57:03.892990+0000","last_clean":"2023-11-28T16:57:03.892990+0000","last_became_active":"2023-11-28T16:57:03.886052+0000","last_became_peered":"2023-11-28T16:57:03.886052+0000","last_unstale":"2023-11-28T16:57:03.892990+0000","last_undegraded":"2023-11-28T16:57:03.892990+0000","last_fullsized":"2023-11-28T16:57:03.892990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914280+0000","last_change":"2023-11-28T16:57:02.882053+0000","last_active":"2023-11-28T16:57:03.914280+0000","last_peered":"2023-11-28T16:57:03.914280+0000","last_clean":"2023-11-28T16:57:03.914280+0000","last_became_active":"2023-11-28T16:57:02.879776+0000","last_became_peered":"2023-11-28T16:57:02.879776+0000","last_unstale":"2023-11-28T16:57:03.914280+0000","last_undegraded":"2023-11-28T16:57:03.914280+0000","last_fullsized":"2023-11-28T16:57:03.914280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:20.111131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894635+0000","last_change":"2023-11-28T16:57:03.887114+0000","last_active":"2023-11-28T16:57:03.894635+0000","last_peered":"2023-11-28T16:57:03.894635+0000","last_clean":"2023-11-28T16:57:03.894635+0000","last_became_active":"2023-11-28T16:57:03.886543+0000","last_became_peered":"2023-11-28T16:57:03.886543+0000","last_unstale":"2023-11-28T16:57:03.894635+0000","last_undegraded":"2023-11-28T16:57:03.894635+0000","last_fullsized":"2023-11-28T16:57:03.894635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:24.050255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.868055+0000","last_change":"2023-11-28T16:57:02.881775+0000","last_active":"2023-11-28T16:57:03.868055+0000","last_peered":"2023-11-28T16:57:03.868055+0000","last_clean":"2023-11-28T16:57:03.868055+0000","last_became_active":"2023-11-28T16:57:02.881350+0000","last_became_peered":"2023-11-28T16:57:02.881350+0000","last_unstale":"2023-11-28T16:57:03.868055+0000","last_undegraded":"2023-11-28T16:57:03.868055+0000","last_fullsized":"2023-11-28T16:57:03.868055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:41.579988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899636+0000","last_change":"2023-11-28T16:57:03.887179+0000","last_active":"2023-11-28T16:57:03.899636+0000","last_peered":"2023-11-28T16:57:03.899636+0000","last_clean":"2023-11-28T16:57:03.899636+0000","last_became_active":"2023-11-28T16:57:03.886667+0000","last_became_peered":"2023-11-28T16:57:03.886667+0000","last_unstale":"2023-11-28T16:57:03.899636+0000","last_undegraded":"2023-11-28T16:57:03.899636+0000","last_fullsized":"2023-11-28T16:57:03.899636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872613+0000","last_change":"2023-11-28T16:57:02.892486+0000","last_active":"2023-11-28T16:57:03.872613+0000","last_peered":"2023-11-28T16:57:03.872613+0000","last_clean":"2023-11-28T16:57:03.872613+0000","last_became_active":"2023-11-28T16:57:02.892124+0000","last_became_peered":"2023-11-28T16:57:02.892124+0000","last_unstale":"2023-11-28T16:57:03.872613+0000","last_undegraded":"2023-11-28T16:57:03.872613+0000","last_fullsized":"2023-11-28T16:57:03.872613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.911855+0000","last_change":"2023-11-28T16:57:03.898409+0000","last_active":"2023-11-28T16:57:03.911855+0000","last_peered":"2023-11-28T16:57:03.911855+0000","last_clean":"2023-11-28T16:57:03.911855+0000","last_became_active":"2023-11-28T16:57:03.895873+0000","last_became_peered":"2023-11-28T16:57:03.895873+0000","last_unstale":"2023-11-28T16:57:03.911855+0000","last_undegraded":"2023-11-28T16:57:03.911855+0000","last_fullsized":"2023-11-28T16:57:03.911855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:21.117551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914099+0000","last_change":"2023-11-28T16:57:02.874480+0000","last_active":"2023-11-28T16:57:03.914099+0000","last_peered":"2023-11-28T16:57:03.914099+0000","last_clean":"2023-11-28T16:57:03.914099+0000","last_became_active":"2023-11-28T16:57:02.874163+0000","last_became_peered":"2023-11-28T16:57:02.874163+0000","last_unstale":"2023-11-28T16:57:03.914099+0000","last_undegraded":"2023-11-28T16:57:03.914099+0000","last_fullsized":"2023-11-28T16:57:03.914099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:47.038335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.894565+0000","last_change":"2023-11-28T16:57:03.890656+0000","last_active":"2023-11-28T16:57:03.894565+0000","last_peered":"2023-11-28T16:57:03.894565+0000","last_clean":"2023-11-28T16:57:03.894565+0000","last_became_active":"2023-11-28T16:57:03.890368+0000","last_became_peered":"2023-11-28T16:57:03.890368+0000","last_unstale":"2023-11-28T16:57:03.894565+0000","last_undegraded":"2023-11-28T16:57:03.894565+0000","last_fullsized":"2023-11-28T16:57:03.894565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:42.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.913817+0000","last_change":"2023-11-28T16:57:02.897594+0000","last_active":"2023-11-28T16:57:03.913817+0000","last_peered":"2023-11-28T16:57:03.913817+0000","last_clean":"2023-11-28T16:57:03.913817+0000","last_became_active":"2023-11-28T16:57:02.897292+0000","last_became_peered":"2023-11-28T16:57:02.897292+0000","last_unstale":"2023-11-28T16:57:03.913817+0000","last_undegraded":"2023-11-28T16:57:03.913817+0000","last_fullsized":"2023-11-28T16:57:03.913817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.901041+0000","last_change":"2023-11-28T16:57:03.893627+0000","last_active":"2023-11-28T16:57:03.901041+0000","last_peered":"2023-11-28T16:57:03.901041+0000","last_clean":"2023-11-28T16:57:03.901041+0000","last_became_active":"2023-11-28T16:57:03.893378+0000","last_became_peered":"2023-11-28T16:57:03.893378+0000","last_unstale":"2023-11-28T16:57:03.901041+0000","last_undegraded":"2023-11-28T16:57:03.901041+0000","last_fullsized":"2023-11-28T16:57:03.901041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.914127+0000","last_change":"2023-11-28T16:57:02.884158+0000","last_active":"2023-11-28T16:57:03.914127+0000","last_peered":"2023-11-28T16:57:03.914127+0000","last_clean":"2023-11-28T16:57:03.914127+0000","last_became_active":"2023-11-28T16:57:02.883646+0000","last_became_peered":"2023-11-28T16:57:02.883646+0000","last_unstale":"2023-11-28T16:57:03.914127+0000","last_undegraded":"2023-11-28T16:57:03.914127+0000","last_fullsized":"2023-11-28T16:57:03.914127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.885429+0000","last_change":"2023-11-28T16:57:03.881542+0000","last_active":"2023-11-28T16:57:03.885429+0000","last_peered":"2023-11-28T16:57:03.885429+0000","last_clean":"2023-11-28T16:57:03.885429+0000","last_became_active":"2023-11-28T16:57:03.880853+0000","last_became_peered":"2023-11-28T16:57:03.880853+0000","last_unstale":"2023-11-28T16:57:03.885429+0000","last_undegraded":"2023-11-28T16:57:03.885429+0000","last_fullsized":"2023-11-28T16:57:03.885429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:40.067864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.909072+0000","last_change":"2023-11-28T16:57:02.892637+0000","last_active":"2023-11-28T16:57:03.909072+0000","last_peered":"2023-11-28T16:57:03.909072+0000","last_clean":"2023-11-28T16:57:03.909072+0000","last_became_active":"2023-11-28T16:57:02.892297+0000","last_became_peered":"2023-11-28T16:57:02.892297+0000","last_unstale":"2023-11-28T16:57:03.909072+0000","last_undegraded":"2023-11-28T16:57:03.909072+0000","last_fullsized":"2023-11-28T16:57:03.909072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:56.815063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906647+0000","last_change":"2023-11-28T16:57:03.903216+0000","last_active":"2023-11-28T16:57:03.906647+0000","last_peered":"2023-11-28T16:57:03.906647+0000","last_clean":"2023-11-28T16:57:03.906647+0000","last_became_active":"2023-11-28T16:57:03.901859+0000","last_became_peered":"2023-11-28T16:57:03.901859+0000","last_unstale":"2023-11-28T16:57:03.906647+0000","last_undegraded":"2023-11-28T16:57:03.906647+0000","last_fullsized":"2023-11-28T16:57:03.906647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:01.464912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.872395+0000","last_change":"2023-11-28T16:57:02.890920+0000","last_active":"2023-11-28T16:57:03.872395+0000","last_peered":"2023-11-28T16:57:03.872395+0000","last_clean":"2023-11-28T16:57:03.872395+0000","last_became_active":"2023-11-28T16:57:02.890605+0000","last_became_peered":"2023-11-28T16:57:02.890605+0000","last_unstale":"2023-11-28T16:57:03.872395+0000","last_undegraded":"2023-11-28T16:57:03.872395+0000","last_fullsized":"2023-11-28T16:57:03.872395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:39.061444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897463+0000","last_change":"2023-11-28T16:57:03.892487+0000","last_active":"2023-11-28T16:57:03.897463+0000","last_peered":"2023-11-28T16:57:03.897463+0000","last_clean":"2023-11-28T16:57:03.897463+0000","last_became_active":"2023-11-28T16:57:03.892192+0000","last_became_peered":"2023-11-28T16:57:03.892192+0000","last_unstale":"2023-11-28T16:57:03.897463+0000","last_undegraded":"2023-11-28T16:57:03.897463+0000","last_fullsized":"2023-11-28T16:57:03.897463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:24.316823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.910243+0000","last_change":"2023-11-28T16:57:02.887769+0000","last_active":"2023-11-28T16:57:03.910243+0000","last_peered":"2023-11-28T16:57:03.910243+0000","last_clean":"2023-11-28T16:57:03.910243+0000","last_became_active":"2023-11-28T16:57:02.887489+0000","last_became_peered":"2023-11-28T16:57:02.887489+0000","last_unstale":"2023-11-28T16:57:03.910243+0000","last_undegraded":"2023-11-28T16:57:03.910243+0000","last_fullsized":"2023-11-28T16:57:03.910243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.890874+0000","last_change":"2023-11-28T16:57:03.887058+0000","last_active":"2023-11-28T16:57:03.890874+0000","last_peered":"2023-11-28T16:57:03.890874+0000","last_clean":"2023-11-28T16:57:03.890874+0000","last_became_active":"2023-11-28T16:57:03.886373+0000","last_became_peered":"2023-11-28T16:57:03.886373+0000","last_unstale":"2023-11-28T16:57:03.890874+0000","last_undegraded":"2023-11-28T16:57:03.890874+0000","last_fullsized":"2023-11-28T16:57:03.890874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:55.969624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897003+0000","last_change":"2023-11-28T16:57:02.889539+0000","last_active":"2023-11-28T16:57:03.897003+0000","last_peered":"2023-11-28T16:57:03.897003+0000","last_clean":"2023-11-28T16:57:03.897003+0000","last_became_active":"2023-11-28T16:57:02.889270+0000","last_became_peered":"2023-11-28T16:57:02.889270+0000","last_unstale":"2023-11-28T16:57:03.897003+0000","last_undegraded":"2023-11-28T16:57:03.897003+0000","last_fullsized":"2023-11-28T16:57:03.897003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903724+0000","last_change":"2023-11-28T16:57:03.896248+0000","last_active":"2023-11-28T16:57:03.903724+0000","last_peered":"2023-11-28T16:57:03.903724+0000","last_clean":"2023-11-28T16:57:03.903724+0000","last_became_active":"2023-11-28T16:57:03.895989+0000","last_became_peered":"2023-11-28T16:57:03.895989+0000","last_unstale":"2023-11-28T16:57:03.903724+0000","last_undegraded":"2023-11-28T16:57:03.903724+0000","last_fullsized":"2023-11-28T16:57:03.903724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:52.513452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.871527+0000","last_change":"2023-11-28T16:57:02.887552+0000","last_active":"2023-11-28T16:57:03.871527+0000","last_peered":"2023-11-28T16:57:03.871527+0000","last_clean":"2023-11-28T16:57:03.871527+0000","last_became_active":"2023-11-28T16:57:02.887319+0000","last_became_peered":"2023-11-28T16:57:02.887319+0000","last_unstale":"2023-11-28T16:57:03.871527+0000","last_undegraded":"2023-11-28T16:57:03.871527+0000","last_fullsized":"2023-11-28T16:57:03.871527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:29:38.468989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.903654+0000","last_change":"2023-11-28T16:57:03.896853+0000","last_active":"2023-11-28T16:57:03.903654+0000","last_peered":"2023-11-28T16:57:03.903654+0000","last_clean":"2023-11-28T16:57:03.903654+0000","last_became_active":"2023-11-28T16:57:03.896447+0000","last_became_peered":"2023-11-28T16:57:03.896447+0000","last_unstale":"2023-11-28T16:57:03.903654+0000","last_undegraded":"2023-11-28T16:57:03.903654+0000","last_fullsized":"2023-11-28T16:57:03.903654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.880839+0000","last_change":"2023-11-28T16:57:02.890124+0000","last_active":"2023-11-28T16:57:03.880839+0000","last_peered":"2023-11-28T16:57:03.880839+0000","last_clean":"2023-11-28T16:57:03.880839+0000","last_became_active":"2023-11-28T16:57:02.889786+0000","last_became_peered":"2023-11-28T16:57:02.889786+0000","last_unstale":"2023-11-28T16:57:03.880839+0000","last_undegraded":"2023-11-28T16:57:03.880839+0000","last_fullsized":"2023-11-28T16:57:03.880839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:46.580531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.895374+0000","last_change":"2023-11-28T16:57:03.892095+0000","last_active":"2023-11-28T16:57:03.895374+0000","last_peered":"2023-11-28T16:57:03.895374+0000","last_clean":"2023-11-28T16:57:03.895374+0000","last_became_active":"2023-11-28T16:57:03.891745+0000","last_became_peered":"2023-11-28T16:57:03.891745+0000","last_unstale":"2023-11-28T16:57:03.895374+0000","last_undegraded":"2023-11-28T16:57:03.895374+0000","last_fullsized":"2023-11-28T16:57:03.895374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:36.768629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.912697+0000","last_change":"2023-11-28T16:57:02.888301+0000","last_active":"2023-11-28T16:57:03.912697+0000","last_peered":"2023-11-28T16:57:03.912697+0000","last_clean":"2023-11-28T16:57:03.912697+0000","last_became_active":"2023-11-28T16:57:02.887892+0000","last_became_peered":"2023-11-28T16:57:02.887892+0000","last_unstale":"2023-11-28T16:57:03.912697+0000","last_undegraded":"2023-11-28T16:57:03.912697+0000","last_fullsized":"2023-11-28T16:57:03.912697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.906408+0000","last_change":"2023-11-28T16:57:03.904348+0000","last_active":"2023-11-28T16:57:03.906408+0000","last_peered":"2023-11-28T16:57:03.906408+0000","last_clean":"2023-11-28T16:57:03.906408+0000","last_became_active":"2023-11-28T16:57:03.904090+0000","last_became_peered":"2023-11-28T16:57:03.904090+0000","last_unstale":"2023-11-28T16:57:03.906408+0000","last_undegraded":"2023-11-28T16:57:03.906408+0000","last_fullsized":"2023-11-28T16:57:03.906408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.869461+0000","last_change":"2023-11-28T16:57:02.886351+0000","last_active":"2023-11-28T16:57:03.869461+0000","last_peered":"2023-11-28T16:57:03.869461+0000","last_clean":"2023-11-28T16:57:03.869461+0000","last_became_active":"2023-11-28T16:57:02.886028+0000","last_became_peered":"2023-11-28T16:57:02.886028+0000","last_unstale":"2023-11-28T16:57:03.869461+0000","last_undegraded":"2023-11-28T16:57:03.869461+0000","last_fullsized":"2023-11-28T16:57:03.869461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:14.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.884783+0000","last_change":"2023-11-28T16:57:03.876059+0000","last_active":"2023-11-28T16:57:03.884783+0000","last_peered":"2023-11-28T16:57:03.884783+0000","last_clean":"2023-11-28T16:57:03.884783+0000","last_became_active":"2023-11-28T16:57:03.875768+0000","last_became_peered":"2023-11-28T16:57:03.875768+0000","last_unstale":"2023-11-28T16:57:03.884783+0000","last_undegraded":"2023-11-28T16:57:03.884783+0000","last_fullsized":"2023-11-28T16:57:03.884783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:42.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.868286+0000","last_change":"2023-11-28T16:57:02.890748+0000","last_active":"2023-11-28T16:57:03.868286+0000","last_peered":"2023-11-28T16:57:03.868286+0000","last_clean":"2023-11-28T16:57:03.868286+0000","last_became_active":"2023-11-28T16:57:02.890463+0000","last_became_peered":"2023-11-28T16:57:02.890463+0000","last_unstale":"2023-11-28T16:57:03.868286+0000","last_undegraded":"2023-11-28T16:57:03.868286+0000","last_fullsized":"2023-11-28T16:57:03.868286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.898978+0000","last_change":"2023-11-28T16:57:03.892153+0000","last_active":"2023-11-28T16:57:03.898978+0000","last_peered":"2023-11-28T16:57:03.898978+0000","last_clean":"2023-11-28T16:57:03.898978+0000","last_became_active":"2023-11-28T16:57:03.891822+0000","last_became_peered":"2023-11-28T16:57:03.891822+0000","last_unstale":"2023-11-28T16:57:03.898978+0000","last_undegraded":"2023-11-28T16:57:03.898978+0000","last_fullsized":"2023-11-28T16:57:03.898978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:00.206784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.869296+0000","last_change":"2023-11-28T16:57:02.883158+0000","last_active":"2023-11-28T16:57:03.869296+0000","last_peered":"2023-11-28T16:57:03.869296+0000","last_clean":"2023-11-28T16:57:03.869296+0000","last_became_active":"2023-11-28T16:57:02.882770+0000","last_became_peered":"2023-11-28T16:57:02.882770+0000","last_unstale":"2023-11-28T16:57:03.869296+0000","last_undegraded":"2023-11-28T16:57:03.869296+0000","last_fullsized":"2023-11-28T16:57:03.869296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.902772+0000","last_change":"2023-11-28T16:57:03.898729+0000","last_active":"2023-11-28T16:57:03.902772+0000","last_peered":"2023-11-28T16:57:03.902772+0000","last_clean":"2023-11-28T16:57:03.902772+0000","last_became_active":"2023-11-28T16:57:03.898497+0000","last_became_peered":"2023-11-28T16:57:03.898497+0000","last_unstale":"2023-11-28T16:57:03.902772+0000","last_undegraded":"2023-11-28T16:57:03.902772+0000","last_fullsized":"2023-11-28T16:57:03.902772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:21.117551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.868213+0000","last_change":"2023-11-28T16:57:02.881583+0000","last_active":"2023-11-28T16:57:03.868213+0000","last_peered":"2023-11-28T16:57:03.868213+0000","last_clean":"2023-11-28T16:57:03.868213+0000","last_became_active":"2023-11-28T16:57:02.880399+0000","last_became_peered":"2023-11-28T16:57:02.880399+0000","last_unstale":"2023-11-28T16:57:03.868213+0000","last_undegraded":"2023-11-28T16:57:03.868213+0000","last_fullsized":"2023-11-28T16:57:03.868213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.889315+0000","last_change":"2023-11-28T16:57:03.881044+0000","last_active":"2023-11-28T16:57:03.889315+0000","last_peered":"2023-11-28T16:57:03.889315+0000","last_clean":"2023-11-28T16:57:03.889315+0000","last_became_active":"2023-11-28T16:57:03.880727+0000","last_became_peered":"2023-11-28T16:57:03.880727+0000","last_unstale":"2023-11-28T16:57:03.889315+0000","last_undegraded":"2023-11-28T16:57:03.889315+0000","last_fullsized":"2023-11-28T16:57:03.889315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.871671+0000","last_change":"2023-11-28T16:57:02.880973+0000","last_active":"2023-11-28T16:57:03.871671+0000","last_peered":"2023-11-28T16:57:03.871671+0000","last_clean":"2023-11-28T16:57:03.871671+0000","last_became_active":"2023-11-28T16:57:02.880470+0000","last_became_peered":"2023-11-28T16:57:02.880470+0000","last_unstale":"2023-11-28T16:57:03.871671+0000","last_undegraded":"2023-11-28T16:57:03.871671+0000","last_fullsized":"2023-11-28T16:57:03.871671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:14.363778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.892325+0000","last_change":"2023-11-28T16:57:03.888974+0000","last_active":"2023-11-28T16:57:03.892325+0000","last_peered":"2023-11-28T16:57:03.892325+0000","last_clean":"2023-11-28T16:57:03.892325+0000","last_became_active":"2023-11-28T16:57:03.888693+0000","last_became_peered":"2023-11-28T16:57:03.888693+0000","last_unstale":"2023-11-28T16:57:03.892325+0000","last_undegraded":"2023-11-28T16:57:03.892325+0000","last_fullsized":"2023-11-28T16:57:03.892325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:36.406739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.871969+0000","last_change":"2023-11-28T16:57:02.889684+0000","last_active":"2023-11-28T16:57:03.871969+0000","last_peered":"2023-11-28T16:57:03.871969+0000","last_clean":"2023-11-28T16:57:03.871969+0000","last_became_active":"2023-11-28T16:57:02.889040+0000","last_became_peered":"2023-11-28T16:57:02.889040+0000","last_unstale":"2023-11-28T16:57:03.871969+0000","last_undegraded":"2023-11-28T16:57:03.871969+0000","last_fullsized":"2023-11-28T16:57:03.871969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.899301+0000","last_change":"2023-11-28T16:57:03.886837+0000","last_active":"2023-11-28T16:57:03.899301+0000","last_peered":"2023-11-28T16:57:03.899301+0000","last_clean":"2023-11-28T16:57:03.899301+0000","last_became_active":"2023-11-28T16:57:03.886378+0000","last_became_peered":"2023-11-28T16:57:03.886378+0000","last_unstale":"2023-11-28T16:57:03.899301+0000","last_undegraded":"2023-11-28T16:57:03.899301+0000","last_fullsized":"2023-11-28T16:57:03.899301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.897048+0000","last_change":"2023-11-28T16:57:02.889062+0000","last_active":"2023-11-28T16:57:03.897048+0000","last_peered":"2023-11-28T16:57:03.897048+0000","last_clean":"2023-11-28T16:57:03.897048+0000","last_became_active":"2023-11-28T16:57:02.888650+0000","last_became_peered":"2023-11-28T16:57:02.888650+0000","last_unstale":"2023-11-28T16:57:03.897048+0000","last_undegraded":"2023-11-28T16:57:03.897048+0000","last_fullsized":"2023-11-28T16:57:03.897048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-28T16:57:02.867547+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:57:02.867547+0000","last_peered":"2023-11-28T16:57:02.867547+0000","last_clean":"2023-11-28T16:57:02.867547+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:57:02.867547+0000","last_undegraded":"2023-11-28T16:57:02.867547+0000","last_fullsized":"2023-11-28T16:57:02.867547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":723575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":133221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":134751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":723485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:57:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T16:57:08.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T16:57:08.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4f1f8640 1 Processor -- start 2023-11-28T16:57:08.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4f1f8640 1 -- start start 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4f1f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4814eaf0 0x7f5c48151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4f1f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c480c0370 0x7f5c4806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4f1f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4806de00 con 0x7f5c48151f90 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4f1f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c48070390 con 0x7f5c480c0370 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4f1f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4814eed0 con 0x7f5c4814eaf0 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4d795640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c480c0370 0x7f5c4806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4d795640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c480c0370 0x7f5c4806d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52006/0 (socket says 172.21.15.26:52006) 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4d795640 1 -- 172.21.15.26:0/1947794821 learned_addr learned my addr 172.21.15.26:0/1947794821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4cf94640 1 --2- 172.21.15.26:0/1947794821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4814eaf0 0x7f5c48151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4d795640 1 -- 172.21.15.26:0/1947794821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4814eaf0 msgr2=0x7f5c48151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4d795640 1 --2- 172.21.15.26:0/1947794821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4814eaf0 0x7f5c48151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4d795640 1 -- 172.21.15.26:0/1947794821 >> v1:172.21.15.79:6789/0 conn(0x7f5c48151f90 legacy=0x7f5c4806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4d795640 1 -- 172.21.15.26:0/1947794821 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48151270 con 0x7f5c480c0370 2023-11-28T16:57:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.566+0000 7f5c4cf94640 1 --2- 172.21.15.26:0/1947794821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4814eaf0 0x7f5c48151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4d795640 1 --2- 172.21.15.26:0/1947794821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c480c0370 0x7f5c4806d820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009e50 tx=0x7f5c4001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a2ec5e181026c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c477fe640 1 -- 172.21.15.26:0/1947794821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400a5780 con 0x7f5c480c0370 2023-11-28T16:57:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c477fe640 1 -- 172.21.15.26:0/1947794821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c400a58e0 con 0x7f5c480c0370 2023-11-28T16:57:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c477fe640 1 -- 172.21.15.26:0/1947794821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400a5c70 con 0x7f5c480c0370 2023-11-28T16:57:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/1947794821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c480c0370 msgr2=0x7f5c4806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/1947794821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c480c0370 0x7f5c4806d820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009e50 tx=0x7f5c4001c8c0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/1947794821 shutdown_connections 2023-11-28T16:57:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/1947794821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c480c0370 0x7f5c4806d820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/1947794821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4814eaf0 0x7f5c48151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/1947794821 >> 172.21.15.26:0/1947794821 conn(0x7f5c480c2a60 msgr2=0x7f5c480c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/1947794821 shutdown_connections 2023-11-28T16:57:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.570+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/1947794821 wait complete. 2023-11-28T16:57:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 Processor -- start 2023-11-28T16:57:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 -- start start 2023-11-28T16:57:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c480c0370 0x7f5c480bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c4814eaf0 0x7f5c480c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4815d560 0x7f5c480c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4815ddc0 con 0x7f5c4814eaf0 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4815e930 con 0x7f5c480c0370 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480c3dd0 con 0x7f5c4815d560 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c4814eaf0 0x7f5c480c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c4814eaf0 0x7f5c480c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52022/0 (socket says 172.21.15.26:52022) 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 -- 172.21.15.26:0/2644838594 learned_addr learned my addr 172.21.15.26:0/2644838594 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4d795640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4815d560 0x7f5c480c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4cf94640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c480c0370 0x7f5c480bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 -- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4815d560 msgr2=0x7f5c480c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4815d560 0x7f5c480c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 -- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c480c0370 msgr2=0x7f5c480bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c480c0370 0x7f5c480bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 -- 172.21.15.26:0/2644838594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40009b30 con 0x7f5c4814eaf0 2023-11-28T16:57:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c47fff640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c4814eaf0 0x7f5c480c4580 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c3c0 tx=0x7f5c3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c457fa640 1 -- 172.21.15.26:0/2644838594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340052d0 con 0x7f5c4814eaf0 2023-11-28T16:57:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c457fa640 1 -- 172.21.15.26:0/2644838594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34005430 con 0x7f5c4814eaf0 2023-11-28T16:57:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c457fa640 1 -- 172.21.15.26:0/2644838594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34003840 con 0x7f5c4814eaf0 2023-11-28T16:57:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4815dae0 con 0x7f5c4814eaf0 2023-11-28T16:57:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.574+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4815e5c0 con 0x7f5c4814eaf0 2023-11-28T16:57:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.578+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4815e140 con 0x7f5c4814eaf0 2023-11-28T16:57:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.578+0000 7f5c457fa640 1 -- 172.21.15.26:0/2644838594 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5c340039a0 con 0x7f5c4814eaf0 2023-11-28T16:57:08.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.578+0000 7f5c457fa640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5c2c0668d0 0x7f5c2c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.578+0000 7f5c457fa640 1 -- 172.21.15.26:0/2644838594 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c34083920 con 0x7f5c4814eaf0 2023-11-28T16:57:08.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.578+0000 7f5c4cf94640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5c2c0668d0 0x7f5c2c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.578+0000 7f5c4cf94640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5c2c0668d0 0x7f5c2c068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009950 tx=0x7f5c3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.582+0000 7f5c457fa640 1 -- 172.21.15.26:0/2644838594 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c4815e140 con 0x7f5c4814eaf0 2023-11-28T16:57:08.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.794+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5c4815e140 con 0x7f5c4814eaf0 2023-11-28T16:57:08.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c457fa640 1 -- 172.21.15.26:0/2644838594 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5c4815e140 con 0x7f5c4814eaf0 2023-11-28T16:57:08.802 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-11-28T16:57:08.803 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw== 2023-11-28T16:57:08.803 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-11-28T16:57:08.803 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-11-28T16:57:08.803 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T16:57:08.803 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-11-28T16:57:08.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5c2c0668d0 msgr2=0x7f5c2c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5c2c0668d0 0x7f5c2c068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009950 tx=0x7f5c3c008040 comp rx=0 tx=0).stop 2023-11-28T16:57:08.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c4814eaf0 msgr2=0x7f5c480c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c4814eaf0 0x7f5c480c4580 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c3c0 tx=0x7f5c3400c880 comp rx=0 tx=0).stop 2023-11-28T16:57:08.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 shutdown_connections 2023-11-28T16:57:08.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5c2c0668d0 0x7f5c2c068d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4815d560 0x7f5c480c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c4814eaf0 0x7f5c480c4580 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 --2- 172.21.15.26:0/2644838594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c480c0370 0x7f5c480bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 >> 172.21.15.26:0/2644838594 conn(0x7f5c480c2a60 msgr2=0x7f5c480711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:08.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 shutdown_connections 2023-11-28T16:57:08.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.798+0000 7f5c4f1f8640 1 -- 172.21.15.26:0/2644838594 wait complete. 2023-11-28T16:57:08.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:08.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 Processor -- start 2023-11-28T16:57:08.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 -- start start 2023-11-28T16:57:08.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0440ca610 0x7ff0440c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440bd720 0x7ff0440c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff04406cd90 0x7ff044158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff044155790 con 0x7ff0440ca610 2023-11-28T16:57:08.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440c4b00 con 0x7ff04406cd90 2023-11-28T16:57:08.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04c59d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440c4de0 con 0x7ff0440bd720 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0440ca610 0x7ff0440c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0440ca610 0x7ff0440c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52038/0 (socket says 172.21.15.26:52038) 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 -- 172.21.15.26:0/3410569354 learned_addr learned my addr 172.21.15.26:0/3410569354 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04ab3a640 1 --2- 172.21.15.26:0/3410569354 >> v2:172.21.15.79:3300/0 conn(0x7ff04406cd90 0x7ff044158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff049b38640 1 --2- 172.21.15.26:0/3410569354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440bd720 0x7ff0440c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 -- 172.21.15.26:0/3410569354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440bd720 msgr2=0x7ff0440c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 --2- 172.21.15.26:0/3410569354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440bd720 0x7ff0440c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 -- 172.21.15.26:0/3410569354 >> v2:172.21.15.79:3300/0 conn(0x7ff04406cd90 msgr2=0x7ff044158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 --2- 172.21.15.26:0/3410569354 >> v2:172.21.15.79:3300/0 conn(0x7ff04406cd90 0x7ff044158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.962+0000 7ff04a339640 1 -- 172.21.15.26:0/3410569354 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044157e30 con 0x7ff0440ca610 2023-11-28T16:57:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04a339640 1 --2- 172.21.15.26:0/3410569354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440ca610 0x7ff0440c94c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff044152370 tx=0x7ff04001c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d031e0afb7b419 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff049337640 1 -- 172.21.15.26:0/3410569354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440c52d0 con 0x7ff0440ca610 2023-11-28T16:57:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff049337640 1 -- 172.21.15.26:0/3410569354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0400a4880 con 0x7ff0440ca610 2023-11-28T16:57:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff049337640 1 -- 172.21.15.26:0/3410569354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400a4c10 con 0x7ff0440ca610 2023-11-28T16:57:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 -- 172.21.15.26:0/3410569354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440ca610 msgr2=0x7ff0440c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3410569354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440ca610 0x7ff0440c94c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff044152370 tx=0x7ff04001c0c0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 -- 172.21.15.26:0/3410569354 shutdown_connections 2023-11-28T16:57:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3410569354 >> v2:172.21.15.79:3300/0 conn(0x7ff04406cd90 0x7ff044158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3410569354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440bd720 0x7ff0440c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3410569354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440ca610 0x7ff0440c94c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 -- 172.21.15.26:0/3410569354 >> 172.21.15.26:0/3410569354 conn(0x7ff044071ea0 msgr2=0x7ff0440722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 -- 172.21.15.26:0/3410569354 shutdown_connections 2023-11-28T16:57:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.966+0000 7ff04c59d640 1 -- 172.21.15.26:0/3410569354 wait complete. 2023-11-28T16:57:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 Processor -- start 2023-11-28T16:57:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 -- start start 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff04406cd90 0x7ff0441538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440bd720 0x7ff0440ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440ca610 0x7ff0440a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440ab6f0 con 0x7ff0440bd720 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440c3e10 con 0x7ff04406cd90 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440c40f0 con 0x7ff0440ca610 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440bd720 0x7ff0440ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440bd720 0x7ff0440ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52050/0 (socket says 172.21.15.26:52050) 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 -- 172.21.15.26:0/3382834467 learned_addr learned my addr 172.21.15.26:0/3382834467 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:08.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04a339640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff04406cd90 0x7ff0441538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04ab3a640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440ca610 0x7ff0440a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 -- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440ca610 msgr2=0x7ff0440a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440ca610 0x7ff0440a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 -- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff04406cd90 msgr2=0x7ff0441538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff04406cd90 0x7ff0441538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 -- 172.21.15.26:0/3382834467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400094d0 con 0x7ff0440bd720 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04ab3a640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440ca610 0x7ff0440a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff049b38640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440bd720 0x7ff0440ac1e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff03400e930 tx=0x7ff03400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff03affd640 1 -- 172.21.15.26:0/3382834467 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034009690 con 0x7ff0440bd720 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff03affd640 1 -- 172.21.15.26:0/3382834467 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03400ca00 con 0x7ff0440bd720 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff03affd640 1 -- 172.21.15.26:0/3382834467 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03400cd70 con 0x7ff0440bd720 2023-11-28T16:57:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0440ab310 con 0x7ff0440bd720 2023-11-28T16:57:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.970+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0440c43d0 con 0x7ff0440bd720 2023-11-28T16:57:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.974+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04404e890 con 0x7ff0440bd720 2023-11-28T16:57:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.974+0000 7ff03affd640 1 -- 172.21.15.26:0/3382834467 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff034013470 con 0x7ff0440bd720 2023-11-28T16:57:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.974+0000 7ff03affd640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff0280668d0 0x7ff028068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.974+0000 7ff03affd640 1 -- 172.21.15.26:0/3382834467 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff034084620 con 0x7ff0440bd720 2023-11-28T16:57:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.974+0000 7ff04a339640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff0280668d0 0x7ff028068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:08.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.974+0000 7ff04a339640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff0280668d0 0x7ff028068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0400ae000 tx=0x7ff0400a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:08.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:08.978+0000 7ff03affd640 1 -- 172.21.15.26:0/3382834467 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff034051930 con 0x7ff0440bd720 2023-11-28T16:57:09.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.166+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff04406cb70 con 0x7ff0440bd720 2023-11-28T16:57:09.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.166+0000 7ff03affd640 1 -- 172.21.15.26:0/3382834467 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7ff034054f50 con 0x7ff0440bd720 2023-11-28T16:57:09.174 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:09.174 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:03.255028+0000","modified":"2023-11-28T16:57:06.275664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4984":{"gid":4984,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/756252810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":756252810},{"type":"v1","addr":"172.21.15.26:6835","nonce":756252810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T16:57:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 16 2023-11-28T16:57:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff0280668d0 msgr2=0x7ff028068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff0280668d0 0x7ff028068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0400ae000 tx=0x7ff0400a6070 comp rx=0 tx=0).stop 2023-11-28T16:57:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440bd720 msgr2=0x7ff0440ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440bd720 0x7ff0440ac1e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff03400e930 tx=0x7ff03400edf0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 shutdown_connections 2023-11-28T16:57:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff0280668d0 0x7ff028068d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0440ca610 0x7ff0440a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0440bd720 0x7ff0440ac1e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 --2- 172.21.15.26:0/3382834467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff04406cd90 0x7ff0441538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 >> 172.21.15.26:0/3382834467 conn(0x7ff044071ea0 msgr2=0x7ff0440ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 shutdown_connections 2023-11-28T16:57:09.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.170+0000 7ff04c59d640 1 -- 172.21.15.26:0/3382834467 wait complete. 2023-11-28T16:57:09.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T16:57:03.255028+0000', 'modified': '2023-11-28T16:57:06.275664+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4984}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4984': {'gid': 4984, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/756252810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 756252810}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 756252810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T16:57:09.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T16:57:09.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T16:57:09.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99c5b1d640 1 Processor -- start 2023-11-28T16:57:09.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99c5b1d640 1 -- start start 2023-11-28T16:57:09.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99c5b1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99c006db80 0x7f99c006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99c5b1d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c006bea0 con 0x7f99c006d100 2023-11-28T16:57:09.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99c5b1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c0159550 con 0x7f99c0152ce0 2023-11-28T16:57:09.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99c5b1d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c0159b10 con 0x7f99c006db80 2023-11-28T16:57:09.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99bffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f99c006d100 0x7f99c00c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49438/0 (socket says 172.21.15.26:49438) 2023-11-28T16:57:09.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99bffff640 1 -- 172.21.15.26:0/2146550653 learned_addr learned my addr 172.21.15.26:0/2146550653 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:09.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99beffd640 1 --2- 172.21.15.26:0/2146550653 >> v2:172.21.15.79:3300/0 conn(0x7f99c006db80 0x7f99c006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99be7fc640 1 -- 172.21.15.26:0/2146550653 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140194905 0 0) 0x7f99c006bea0 con 0x7f99c006d100 2023-11-28T16:57:09.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99be7fc640 1 -- 172.21.15.26:0/2146550653 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a8003530 con 0x7f99c006d100 2023-11-28T16:57:09.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99beffd640 1 -- 172.21.15.26:0/2146550653 >> v1:172.21.15.79:6789/0 conn(0x7f99c0152ce0 legacy=0x7f99c00700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99beffd640 1 -- 172.21.15.26:0/2146550653 >> v1:172.21.15.26:6789/0 conn(0x7f99c006d100 legacy=0x7f99c00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.738+0000 7f99beffd640 1 -- 172.21.15.26:0/2146550653 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0159830 con 0x7f99c006db80 2023-11-28T16:57:09.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99beffd640 1 --2- 172.21.15.26:0/2146550653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c006db80 0x7f99c006c940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99b40097c0 tx=0x7f99b401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1f583f293b86a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99be7fc640 1 -- 172.21.15.26:0/2146550653 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40ab5f0 con 0x7f99c006db80 2023-11-28T16:57:09.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99be7fc640 1 -- 172.21.15.26:0/2146550653 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40ab750 con 0x7f99c006db80 2023-11-28T16:57:09.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99be7fc640 1 -- 172.21.15.26:0/2146550653 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40abac0 con 0x7f99c006db80 2023-11-28T16:57:09.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2146550653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c006db80 msgr2=0x7f99c006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2146550653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c006db80 0x7f99c006c940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99b40097c0 tx=0x7f99b401c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2146550653 shutdown_connections 2023-11-28T16:57:09.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2146550653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c006db80 0x7f99c006c940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2146550653 >> 172.21.15.26:0/2146550653 conn(0x7f99c00c2ad0 msgr2=0x7f99c00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2146550653 shutdown_connections 2023-11-28T16:57:09.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.742+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2146550653 wait complete. 2023-11-28T16:57:09.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 Processor -- start 2023-11-28T16:57:09.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 -- start start 2023-11-28T16:57:09.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99c006d100 0x7f99c00c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c006db80 0x7f99c0153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c0152ce0 0x7f99c0153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0156050 con 0x7f99c006db80 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c01f4950 con 0x7f99c0152ce0 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c01f4c30 con 0x7f99c006d100 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c006db80 0x7f99c0153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c006db80 0x7f99c0153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52054/0 (socket says 172.21.15.26:52054) 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 -- 172.21.15.26:0/2384100406 learned_addr learned my addr 172.21.15.26:0/2384100406 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99bffff640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c0152ce0 0x7f99c0153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99c006d100 0x7f99c00c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 -- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99c006d100 msgr2=0x7f99c00c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99c006d100 0x7f99c00c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 -- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c0152ce0 msgr2=0x7f99c0153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c0152ce0 0x7f99c0153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 -- 172.21.15.26:0/2384100406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009420 con 0x7f99c006db80 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99beffd640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c006db80 0x7f99c0153aa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99b40097c0 tx=0x7f99b401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99a7fff640 1 -- 172.21.15.26:0/2384100406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4004220 con 0x7f99c006db80 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99a7fff640 1 -- 172.21.15.26:0/2384100406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40b9070 con 0x7f99c006db80 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99a7fff640 1 -- 172.21.15.26:0/2384100406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4003620 con 0x7f99c006db80 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c01f4f10 con 0x7f99c006db80 2023-11-28T16:57:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.746+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c0153580 con 0x7f99c006db80 2023-11-28T16:57:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99a7fff640 1 -- 172.21.15.26:0/2384100406 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f99b4003780 con 0x7f99c006db80 2023-11-28T16:57:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99a7fff640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99ac0668d0 0x7f99ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99a7fff640 1 -- 172.21.15.26:0/2384100406 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b40bb070 con 0x7f99c006db80 2023-11-28T16:57:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99ac0668d0 0x7f99ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 Processor -- start 2023-11-28T16:57:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 -- start start 2023-11-28T16:57:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99ac0668d0 0x7f99ac068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f99b00015b0 tx=0x7f99b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b4fc0 0x55a7936b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b6200 0x55a7936ffad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a79357e110 con 0x55a7936b58e0 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a79350e9a0 con 0x55a7936b6200 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a79350bed0 con 0x55a7936b4fc0 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52060/0 (socket says 172.21.15.26:52060) 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99beffd640 1 -- 172.21.15.26:0/4002372779 learned_addr learned my addr 172.21.15.26:0/4002372779 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b4fc0 0x55a7936b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99bffff640 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b6200 0x55a7936ffad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99beffd640 1 -- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b4fc0 msgr2=0x55a7936b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.750+0000 7f99beffd640 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b4fc0 0x55a7936b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 -- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b6200 msgr2=0x55a7936ffad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b6200 0x55a7936ffad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 -- 172.21.15.26:0/4002372779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7931ff890 con 0x55a7936b58e0 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b4fc0 0x55a7936b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99bffff640 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b6200 0x55a7936ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936b5cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f99b40efb70 tx=0x7f99b4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51c4ae434840f0d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99a57fa640 1 -- 172.21.15.26:0/4002372779 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40f3d30 con 0x55a7936b58e0 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99a57fa640 1 -- 172.21.15.26:0/4002372779 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40f7ee0 con 0x55a7936b58e0 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99a57fa640 1 -- 172.21.15.26:0/4002372779 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40ec2f0 con 0x55a7936b58e0 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- 172.21.15.26:0/4002372779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 msgr2=0x55a7936b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936b5cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f99b40efb70 tx=0x7f99b4009190 comp rx=0 tx=0).stop 2023-11-28T16:57:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- 172.21.15.26:0/4002372779 shutdown_connections 2023-11-28T16:57:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b6200 0x55a7936ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936b5cc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4002372779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b4fc0 0x55a7936b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- 172.21.15.26:0/4002372779 >> 172.21.15.26:0/4002372779 conn(0x55a7936f3830 msgr2=0x55a7936f5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- 172.21.15.26:0/4002372779 shutdown_connections 2023-11-28T16:57:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- 172.21.15.26:0/4002372779 wait complete. 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- start start 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 Processor -- start 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b4fc0 0x55a7936bc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936bc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a7936bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7935077c0 con 0x55a7936b58e0 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7934bfbf0 con 0x55a7936b4fc0 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7934c5a90 con 0x55a7936b6200 2023-11-28T16:57:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99c8e82000 10 client.0 _ll_register_callbacks cb 0x55a7936a2e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:57:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936bc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936bc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52076/0 (socket says 172.21.15.26:52076) 2023-11-28T16:57:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 -- 172.21.15.26:0/2573768235 learned_addr learned my addr 172.21.15.26:0/2573768235 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b4fc0 0x55a7936bc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99bffff640 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a7936bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 -- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 msgr2=0x55a7936bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a7936bccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 -- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b4fc0 msgr2=0x55a7936bc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b4fc0 0x55a7936bc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.754+0000 7f99beffd640 1 -- 172.21.15.26:0/2573768235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c0153580 con 0x55a7936b58e0 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99beffd640 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936bc790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99b40ec0e0 tx=0x7f99b411cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d388d2b6a963b5b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 1 -- 172.21.15.26:0/2573768235 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40f9070 con 0x55a7936b58e0 2023-11-28T16:57:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 1 -- 172.21.15.26:0/2573768235 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b40a8050 con 0x55a7936b58e0 2023-11-28T16:57:09.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7934c9470 con 0x55a7936b58e0 2023-11-28T16:57:09.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 1 -- 172.21.15.26:0/2573768235 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b40f3d30 con 0x55a7936b58e0 2023-11-28T16:57:09.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 10 client.5136 fetch_fsmap learned FSMap version 16 2023-11-28T16:57:09.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a7934c8190 con 0x55a7936b58e0 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 1 -- 172.21.15.26:0/2573768235 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a7934c9470 con 0x55a7936b58e0 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 1 -- 172.21.15.26:0/2573768235 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f99b40aa070 con 0x55a7936b58e0 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 10 client.5136 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 10 client.5136 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 20 client.5136 populate_metadata read hostname 'smithi026' 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793709310 0x55a79370b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 4 client.5136 mds_command: new command op to 4984 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 --> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7934ccb50 con 0x55a793709310 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793709310 0x55a79370b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793709310 0x55a79370b700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=413d9db563847ed6 server_cookie=2a4bfe239d044f72 in_seq=0 out_seq=0 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 10 client.5136 ms_handle_connect on v2:172.21.15.26:6834/756252810 2023-11-28T16:57:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 1 -- 172.21.15.26:0/2573768235 <== mds.0 v2:172.21.15.26:6834/756252810 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a7934ccb50 con 0x55a793709310 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 10 client.5136 handle_command_reply: tid=0 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 client.5136 shutdown 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 msgr2=0x55a7936bc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936bc790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99b40ec0e0 tx=0x7f99b411cfc0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 shutdown_connections 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793709310 0x55a79370b700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a7936bccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b58e0 0x55a7936bc790 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 --2- 172.21.15.26:0/2573768235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b4fc0 0x55a7936bc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f999e7fc640 0 client.5136 ms_handle_reset on v2:172.21.15.26:6834/756252810 2023-11-28T16:57:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 >> 172.21.15.26:0/2573768235 conn(0x55a7936f3830 msgr2=0x55a7936f5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 shutdown_connections 2023-11-28T16:57:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 1 -- 172.21.15.26:0/2573768235 wait complete. 2023-11-28T16:57:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.758+0000 7f99c8e82000 20 client.5136 trim_cache size 0 max 16384 2023-11-28T16:57:09.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.774+0000 7f99c8e82000 1 Processor -- start 2023-11-28T16:57:09.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.774+0000 7f99c8e82000 1 -- start start 2023-11-28T16:57:09.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a7936b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a7936b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79370b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7931c0940 con 0x55a7936b4fc0 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a79358e570 con 0x55a7936b58e0 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7934dcb70 con 0x55a7936b6200 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a7936b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a7936b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52086/0 (socket says 172.21.15.26:52086) 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 -- 172.21.15.26:0/420264763 learned_addr learned my addr 172.21.15.26:0/420264763 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99beffd640 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a7936b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bffff640 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79370b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 -- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 msgr2=0x55a79370b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79370b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 -- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 msgr2=0x55a7936b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a7936b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 -- 172.21.15.26:0/420264763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7934ae490 con 0x55a7936b4fc0 2023-11-28T16:57:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a7936b4970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005630 tx=0x7f99b0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50405d8e22a8298 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99a5ffb640 1 -- 172.21.15.26:0/420264763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0025920 con 0x55a7936b4fc0 2023-11-28T16:57:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99a5ffb640 1 -- 172.21.15.26:0/420264763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0003ad0 con 0x55a7936b4fc0 2023-11-28T16:57:09.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99a5ffb640 1 -- 172.21.15.26:0/420264763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0003c40 con 0x55a7936b4fc0 2023-11-28T16:57:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- 172.21.15.26:0/420264763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 msgr2=0x55a7936b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a7936b4970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005630 tx=0x7f99b0012000 comp rx=0 tx=0).stop 2023-11-28T16:57:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- 172.21.15.26:0/420264763 shutdown_connections 2023-11-28T16:57:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79370b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a7936b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 --2- 172.21.15.26:0/420264763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a7936b4970 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- 172.21.15.26:0/420264763 >> 172.21.15.26:0/420264763 conn(0x55a7936f3830 msgr2=0x55a7936f2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- 172.21.15.26:0/420264763 shutdown_connections 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- 172.21.15.26:0/420264763 wait complete. 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 -- start start 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.778+0000 7f99c8e82000 1 Processor -- start 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a79375a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a79375a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79371e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793506650 con 0x55a7936b4fc0 2023-11-28T16:57:09.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7936bf510 con 0x55a7936b58e0 2023-11-28T16:57:09.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a793504fd0 con 0x55a7936b6200 2023-11-28T16:57:09.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 10 client.0 _ll_register_callbacks cb 0x55a7935128e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:57:09.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a79375a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a79375a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52100/0 (socket says 172.21.15.26:52100) 2023-11-28T16:57:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 -- 172.21.15.26:0/4028266299 learned_addr learned my addr 172.21.15.26:0/4028266299 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bffff640 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79371e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99beffd640 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a79375a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 -- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 msgr2=0x55a79371e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79371e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 -- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 msgr2=0x55a79375a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a79375a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 -- 172.21.15.26:0/4028266299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b001d040 con 0x55a7936b4fc0 2023-11-28T16:57:09.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99bf7fe640 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a79375a3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005420 tx=0x7f99b0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c63189f6a4aa59 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:57:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 1 -- 172.21.15.26:0/4028266299 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0003e50 con 0x55a7936b4fc0 2023-11-28T16:57:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 1 -- 172.21.15.26:0/4028266299 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b000e4b0 con 0x55a7936b4fc0 2023-11-28T16:57:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7936b9f60 con 0x55a7936b4fc0 2023-11-28T16:57:09.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 1 -- 172.21.15.26:0/4028266299 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b000e670 con 0x55a7936b4fc0 2023-11-28T16:57:09.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 10 client.5142 fetch_fsmap learned FSMap version 16 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a7931ffcc0 con 0x55a7936b4fc0 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 1 -- 172.21.15.26:0/4028266299 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a7936b9f60 con 0x55a7936b4fc0 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 1 -- 172.21.15.26:0/4028266299 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f99b002d030 con 0x55a7936b4fc0 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 10 client.5142 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 10 client.5142 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 20 client.5142 populate_metadata read hostname 'smithi026' 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793761220 0x55a793763610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 4 client.5142 mds_command: new command op to 4984 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 --> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a793506110 con 0x55a793761220 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99beffd640 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793761220 0x55a793763610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99beffd640 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793761220 0x55a793763610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7192bab2ea2df9d server_cookie=2538234dfc4bc806 in_seq=0 out_seq=0 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 10 client.5142 ms_handle_connect on v2:172.21.15.26:6834/756252810 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 1 -- 172.21.15.26:0/4028266299 <== mds.0 v2:172.21.15.26:6834/756252810 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a793506110 con 0x55a793761220 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 10 client.5142 handle_command_reply: tid=0 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 client.5142 shutdown 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 msgr2=0x55a79375a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a79375a3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005420 tx=0x7f99b0000bd0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 shutdown_connections 2023-11-28T16:57:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:6834/756252810,v1:172.21.15.26:6835/756252810] conn(0x55a793761220 0x55a793763610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55a7936b6200 0x55a79371e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a7936b58e0 0x55a79375a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f999e7fc640 0 client.5142 ms_handle_reset on v2:172.21.15.26:6834/756252810 2023-11-28T16:57:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 --2- 172.21.15.26:0/4028266299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a7936b4fc0 0x55a79375a3c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 >> 172.21.15.26:0/4028266299 conn(0x55a7936f3830 msgr2=0x55a7936f2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 shutdown_connections 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 1 -- 172.21.15.26:0/4028266299 wait complete. 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c8e82000 20 client.5142 trim_cache size 0 max 16384 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee", 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4984, 2023-11-28T16:57:09.801 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9041167149999998, 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 16, 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 32, 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 32, 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 13.751214235999999 2023-11-28T16:57:09.802 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:57:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99ac0668d0 msgr2=0x7f99ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.782+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99ac0668d0 0x7f99ac068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f99b00015b0 tx=0x7f99b0009040 comp rx=0 tx=0).stop 2023-11-28T16:57:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c006db80 msgr2=0x7f99c0153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c006db80 0x7f99c0153aa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99b40097c0 tx=0x7f99b401ac30 comp rx=0 tx=0).stop 2023-11-28T16:57:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 shutdown_connections 2023-11-28T16:57:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c0152ce0 0x7f99c0153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c006db80 0x7f99c0153aa0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f99ac0668d0 0x7f99ac068d90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 --2- 172.21.15.26:0/2384100406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99c006d100 0x7f99c00c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 >> 172.21.15.26:0/2384100406 conn(0x7f99c00c2ad0 msgr2=0x7f99c00c1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 shutdown_connections 2023-11-28T16:57:09.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.786+0000 7f99c5b1d640 1 -- 172.21.15.26:0/2384100406 wait complete. 2023-11-28T16:57:09.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:57:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.946+0000 7f5ffd155640 1 Processor -- start 2023-11-28T16:57:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.946+0000 7f5ffd155640 1 -- start start 2023-11-28T16:57:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ffd155640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff814fcc0 0x7f5ff8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ffd155640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ff806d980 0x7f5ff80aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ffd155640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff8152fe0 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ffd155640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80aa340 con 0x7f5ff806d980 2023-11-28T16:57:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ffd155640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff81532c0 con 0x7f5ff814fcc0 2023-11-28T16:57:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5feffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ff806d980 0x7f5ff80aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff759e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5ff80ab3b0 0x7f5ff80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49448/0 (socket says 172.21.15.26:49448) 2023-11-28T16:57:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff759e640 1 -- 172.21.15.26:0/189361407 learned_addr learned my addr 172.21.15.26:0/189361407 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff6d9d640 1 --2- 172.21.15.26:0/189361407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff814fcc0 0x7f5ff8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5feffff640 1 -- 172.21.15.26:0/189361407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff814fcc0 msgr2=0x7f5ff8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:09.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5feffff640 1 --2- 172.21.15.26:0/189361407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff814fcc0 0x7f5ff8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5feffff640 1 -- 172.21.15.26:0/189361407 >> v1:172.21.15.26:6789/0 conn(0x7f5ff80ab3b0 legacy=0x7f5ff80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5feffff640 1 -- 172.21.15.26:0/189361407 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8155a20 con 0x7f5ff806d980 2023-11-28T16:57:09.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff6d9d640 1 --2- 172.21.15.26:0/189361407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff814fcc0 0x7f5ff8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:09.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff659c640 1 -- 172.21.15.26:0/189361407 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064499958 0 0) 0x7f5ff8152fe0 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5feffff640 1 --2- 172.21.15.26:0/189361407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806d980 0x7f5ff80aae70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd37c5db7c8288c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff659c640 1 -- 172.21.15.26:0/189361407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab650 con 0x7f5ff806d980 2023-11-28T16:57:09.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff659c640 1 -- 172.21.15.26:0/189361407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00ab7b0 con 0x7f5ff806d980 2023-11-28T16:57:09.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.950+0000 7f5ff659c640 1 -- 172.21.15.26:0/189361407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00abb40 con 0x7f5ff806d980 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- 172.21.15.26:0/189361407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806d980 msgr2=0x7f5ff80aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 --2- 172.21.15.26:0/189361407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806d980 0x7f5ff80aae70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c450 comp rx=0 tx=0).stop 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- 172.21.15.26:0/189361407 shutdown_connections 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 --2- 172.21.15.26:0/189361407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806d980 0x7f5ff80aae70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 --2- 172.21.15.26:0/189361407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff814fcc0 0x7f5ff8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- 172.21.15.26:0/189361407 >> 172.21.15.26:0/189361407 conn(0x7f5ff80c2ad0 msgr2=0x7f5ff80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- 172.21.15.26:0/189361407 shutdown_connections 2023-11-28T16:57:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- 172.21.15.26:0/189361407 wait complete. 2023-11-28T16:57:09.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 Processor -- start 2023-11-28T16:57:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- start start 2023-11-28T16:57:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff806d980 0x7f5ff814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff80ab3b0 0x7f5ff814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff80c3c50 0x7f5ff814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff814ea80 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff814d590 con 0x7f5ff806d980 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ffd155640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8153c10 con 0x7f5ff80c3c50 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5feffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff80ab3b0 0x7f5ff814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5feffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff80ab3b0 0x7f5ff814b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52122/0 (socket says 172.21.15.26:52122) 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5feffff640 1 -- 172.21.15.26:0/364026851 learned_addr learned my addr 172.21.15.26:0/364026851 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.954+0000 7f5ff6d9d640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff806d980 0x7f5ff814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5ff759e640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff80c3c50 0x7f5ff814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5feffff640 1 -- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff80c3c50 msgr2=0x7f5ff814b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5feffff640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff80c3c50 0x7f5ff814b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5feffff640 1 -- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff806d980 msgr2=0x7f5ff814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:09.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5feffff640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff806d980 0x7f5ff814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:09.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5feffff640 1 -- 172.21.15.26:0/364026851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009420 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5feffff640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff80ab3b0 0x7f5ff814b200 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ad040 tx=0x7f5fe001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5fef7fe640 1 -- 172.21.15.26:0/364026851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00b5810 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5fef7fe640 1 -- 172.21.15.26:0/364026851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00b5990 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5fef7fe640 1 -- 172.21.15.26:0/364026851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00b5d40 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff814c490 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff81eec90 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff804e890 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5fef7fe640 1 -- 172.21.15.26:0/364026851 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5fe00bf410 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5fef7fe640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5fd8066900 0x7f5fd8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:09.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.958+0000 7f5fef7fe640 1 -- 172.21.15.26:0/364026851 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fe011f060 con 0x7f5ff80ab3b0 2023-11-28T16:57:09.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.962+0000 7f5ff6d9d640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5fd8066900 0x7f5fd8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:09.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.962+0000 7f5ff6d9d640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5fd8066900 0x7f5fd8068dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80045f0 tx=0x7f5fe8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:09.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:09.962+0000 7f5fef7fe640 1 -- 172.21.15.26:0/364026851 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5fe00ec3d0 con 0x7f5ff80ab3b0 2023-11-28T16:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.158+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ff8153d50 con 0x7f5ff80ab3b0 2023-11-28T16:57:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.158+0000 7f5fef7fe640 1 -- 172.21.15.26:0/364026851 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5fe00ef9f0 con 0x7f5ff80ab3b0 2023-11-28T16:57:10.168 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5fd8066900 msgr2=0x7f5fd8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5fd8066900 0x7f5fd8068dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80045f0 tx=0x7f5fe8008040 comp rx=0 tx=0).stop 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff80ab3b0 msgr2=0x7f5ff814b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff80ab3b0 0x7f5ff814b200 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ad040 tx=0x7f5fe001ac90 comp rx=0 tx=0).stop 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 shutdown_connections 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5fd8066900 0x7f5fd8068dc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ff80c3c50 0x7f5ff814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:10.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff80ab3b0 0x7f5ff814b200 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 --2- 172.21.15.26:0/364026851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff806d980 0x7f5ff814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 >> 172.21.15.26:0/364026851 conn(0x7f5ff80c2ad0 msgr2=0x7f5ff8146910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:10.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 shutdown_connections 2023-11-28T16:57:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:10.162+0000 7f5ffd155640 1 -- 172.21.15.26:0/364026851 wait complete. 2023-11-28T16:57:10.186 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T16:57:10.186 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:57:10.186 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-11-28T16:57:10.186 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T16:57:10.186 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:10.186 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T16:57:10.186 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:57:10.187 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:57:10.187 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:57:10.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.189 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-11-28T16:57:10.199 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:57:10.199 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:57:10.199 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:57:10.199 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:10.199 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-11-28T16:57:10.199 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:10.200 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:10.200 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:10.200 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-11-28T16:57:10.200 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:10.200 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:10.200 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-11-28T16:57:10.201 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:57:10.201 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:10.202 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-11-28T16:57:10.203 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T16:57:10.203 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42345sec preferred_lft 42345sec 2023-11-28T16:57:10.204 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:1b:cd:da:6f brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:57:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:57:10.206 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:10.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.207 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:57:10.273 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-11-28T16:57:10.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.276 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-11-28T16:57:10.328 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-11-28T16:57:10.328 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:57:10.328 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T16:57:10.328 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:57:10.328 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T16:57:10.328 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:57:10.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.329 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:57:10.329 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:57:10.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T16:57:10.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T16:57:10.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T16:57:10.329 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:57:10.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.427 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:57:10.437 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T16:57:10.437 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:57:10.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-11-28T16:57:10.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:10.499 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:10.554 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:57:10.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:10.555 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:10.610 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T16:57:10.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.610 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:10.706 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:10.706 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:10.719 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:10.719 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:10.720 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:57:10.720 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:57:10.720 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:57:10.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:57:10.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:10.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:10.745 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:57:10.803 INFO:teuthology.orchestra.run.smithi026.stdout:client5146 2023-11-28T16:57:10.804 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:10.804 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:10.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:57:11.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f284c83a640 1 Processor -- start 2023-11-28T16:57:11.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f284c83a640 1 -- start start 2023-11-28T16:57:11.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f284c83a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480c4890 0x7f28480caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f284c83a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284806b7d0 con 0x7f28480ca620 2023-11-28T16:57:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f284c83a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2848155160 con 0x7f28480bd5a0 2023-11-28T16:57:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f284c83a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284806b180 con 0x7f28480c4890 2023-11-28T16:57:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f28477fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f28480ca620 0x7f28480c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49458/0 (socket says 172.21.15.26:49458) 2023-11-28T16:57:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f28477fe640 1 -- 172.21.15.26:0/3850720010 learned_addr learned my addr 172.21.15.26:0/3850720010 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f2846ffd640 1 --2- 172.21.15.26:0/3850720010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480c4890 0x7f28480caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f28467fc640 1 -- 172.21.15.26:0/3850720010 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520426975 0 0) 0x7f284806b7d0 con 0x7f28480ca620 2023-11-28T16:57:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f28467fc640 1 -- 172.21.15.26:0/3850720010 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2830003530 con 0x7f28480ca620 2023-11-28T16:57:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f28467fc640 1 -- 172.21.15.26:0/3850720010 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397834642 0 0) 0x7f2848155160 con 0x7f28480bd5a0 2023-11-28T16:57:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f28467fc640 1 -- 172.21.15.26:0/3850720010 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284806b7d0 con 0x7f28480bd5a0 2023-11-28T16:57:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f2846ffd640 1 -- 172.21.15.26:0/3850720010 >> v1:172.21.15.79:6789/0 conn(0x7f28480bd5a0 legacy=0x7f28480c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f2846ffd640 1 -- 172.21.15.26:0/3850720010 >> v1:172.21.15.26:6789/0 conn(0x7f28480ca620 legacy=0x7f28480c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.042+0000 7f2846ffd640 1 -- 172.21.15.26:0/3850720010 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284806b460 con 0x7f28480c4890 2023-11-28T16:57:11.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f2846ffd640 1 --2- 172.21.15.26:0/3850720010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480c4890 0x7f28480caa00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097f0 tx=0x7f283c01c080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64452eb2e2e68631 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:11.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f28467fc640 1 -- 172.21.15.26:0/3850720010 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0a4830 con 0x7f28480c4890 2023-11-28T16:57:11.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f28467fc640 1 -- 172.21.15.26:0/3850720010 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28480c9da0 con 0x7f28480c4890 2023-11-28T16:57:11.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f28467fc640 1 -- 172.21.15.26:0/3850720010 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0a4bb0 con 0x7f28480c4890 2023-11-28T16:57:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 -- 172.21.15.26:0/3850720010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480c4890 msgr2=0x7f28480caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 --2- 172.21.15.26:0/3850720010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480c4890 0x7f28480caa00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097f0 tx=0x7f283c01c080 comp rx=0 tx=0).stop 2023-11-28T16:57:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 -- 172.21.15.26:0/3850720010 shutdown_connections 2023-11-28T16:57:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 --2- 172.21.15.26:0/3850720010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480c4890 0x7f28480caa00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 -- 172.21.15.26:0/3850720010 >> 172.21.15.26:0/3850720010 conn(0x7f28480ac0a0 msgr2=0x7f28480c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 -- 172.21.15.26:0/3850720010 shutdown_connections 2023-11-28T16:57:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 -- 172.21.15.26:0/3850720010 wait complete. 2023-11-28T16:57:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.046+0000 7f284c83a640 1 Processor -- start 2023-11-28T16:57:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 -- start start 2023-11-28T16:57:11.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28480bd5a0 0x7f2848150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28480c4890 0x7f284814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480ca620 0x7f284814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848157520 con 0x7f28480bd5a0 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28480c0d80 con 0x7f28480c4890 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2848155900 con 0x7f28480ca620 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28480bd5a0 0x7f2848150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28480bd5a0 0x7f2848150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52132/0 (socket says 172.21.15.26:52132) 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 -- 172.21.15.26:0/3900883179 learned_addr learned my addr 172.21.15.26:0/3900883179 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f2846ffd640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28480c4890 0x7f284814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f2847fff640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480ca620 0x7f284814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 -- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480ca620 msgr2=0x7f284814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480ca620 0x7f284814e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 -- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28480c4890 msgr2=0x7f284814e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28480c4890 0x7f284814e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 -- 172.21.15.26:0/3900883179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c009420 con 0x7f28480bd5a0 2023-11-28T16:57:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f2846ffd640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28480c4890 0x7f284814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f2847fff640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480ca620 0x7f284814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f28477fe640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28480bd5a0 0x7f2848150db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f283800c4d0 tx=0x7f283800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f282ffff640 1 -- 172.21.15.26:0/3900883179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838005cf0 con 0x7f28480bd5a0 2023-11-28T16:57:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f282ffff640 1 -- 172.21.15.26:0/3900883179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838005e50 con 0x7f28480bd5a0 2023-11-28T16:57:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28480c2750 con 0x7f28480bd5a0 2023-11-28T16:57:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f282ffff640 1 -- 172.21.15.26:0/3900883179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28380072b0 con 0x7f28480bd5a0 2023-11-28T16:57:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2848158720 con 0x7f28480bd5a0 2023-11-28T16:57:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.050+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28481f0a00 con 0x7f28480bd5a0 2023-11-28T16:57:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.054+0000 7f282ffff640 1 -- 172.21.15.26:0/3900883179 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2838007410 con 0x7f28480bd5a0 2023-11-28T16:57:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.054+0000 7f282ffff640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28340668d0 0x7f2834068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.054+0000 7f282ffff640 1 -- 172.21.15.26:0/3900883179 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2838083a40 con 0x7f28480bd5a0 2023-11-28T16:57:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.054+0000 7f2846ffd640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28340668d0 0x7f2834068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.054+0000 7f2846ffd640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28340668d0 0x7f2834068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f283c0ae000 tx=0x7f283c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:11.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.058+0000 7f282ffff640 1 -- 172.21.15.26:0/3900883179 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2838050c70 con 0x7f28480bd5a0 2023-11-28T16:57:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f284804e890 con 0x7f28480bd5a0 2023-11-28T16:57:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f282ffff640 1 -- 172.21.15.26:0/3900883179 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2838017020 con 0x7f28480bd5a0 2023-11-28T16:57:11.251 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:57:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28340668d0 msgr2=0x7f2834068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28340668d0 0x7f2834068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f283c0ae000 tx=0x7f283c008040 comp rx=0 tx=0).stop 2023-11-28T16:57:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28480bd5a0 msgr2=0x7f2848150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28480bd5a0 0x7f2848150db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f283800c4d0 tx=0x7f283800c990 comp rx=0 tx=0).stop 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 shutdown_connections 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28340668d0 0x7f2834068d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28480ca620 0x7f284814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28480c4890 0x7f284814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 --2- 172.21.15.26:0/3900883179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28480bd5a0 0x7f2848150db0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 >> 172.21.15.26:0/3900883179 conn(0x7f28480ac0a0 msgr2=0x7f28481523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 shutdown_connections 2023-11-28T16:57:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:11.246+0000 7f284c83a640 1 -- 172.21.15.26:0/3900883179 wait complete. 2023-11-28T16:57:11.272 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T16:57:11.272 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:57:11.273 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:57:11.273 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T16:57:11.273 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:11.273 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T16:57:11.273 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:57:11.273 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:57:11.273 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:57:11.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.273 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:57:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:57:11.284 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:57:11.284 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:57:11.284 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:11.284 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:57:11.284 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42335sec preferred_lft 42335sec 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:57:11.285 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:57:11.287 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:57:11.287 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:57:11.287 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:11.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.287 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:57:11.351 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:57:11.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.354 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:57:11.406 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:57:11.406 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:57:11.406 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:57:11.406 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:57:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:57:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:57:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:57:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:57:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:57:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:57:11.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.407 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:57:11.407 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:57:11.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:57:11.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:57:11.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:57:11.408 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:57:11.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.506 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:57:11.515 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:57:11.516 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:57:11.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:57:11.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:11.585 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:11.635 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:57:11.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:11.635 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:11.686 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T16:57:11.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:11.782 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:11.782 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:11.796 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:11.797 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:11.797 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:57:11.797 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:57:11.797 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:57:11.801 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:57:11.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:11.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:11.822 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:57:11.878 INFO:teuthology.orchestra.run.smithi079.stdout:client5155 2023-11-28T16:57:11.878 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:11.879 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:11.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-28T16:57:12.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.074+0000 7f663e19d640 1 Processor -- start 2023-11-28T16:57:12.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.074+0000 7f663e19d640 1 -- start start 2023-11-28T16:57:12.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f663e19d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f663814fcc0 0x7f6638156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f663e19d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f663806d980 0x7f66380aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f663e19d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6638152fe0 con 0x7f66380ab3b0 2023-11-28T16:57:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f663e19d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380aa340 con 0x7f663814fcc0 2023-11-28T16:57:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f663e19d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66381532c0 con 0x7f663806d980 2023-11-28T16:57:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f66377fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f663814fcc0 0x7f6638156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f6636ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f663806d980 0x7f66380aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f6637fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f66380ab3b0 0x7f66380c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:57584/0 (socket says 172.21.15.26:57584) 2023-11-28T16:57:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f6637fff640 1 -- 172.21.15.26:0/2172722674 learned_addr learned my addr 172.21.15.26:0/2172722674 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f66377fe640 1 -- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f663806d980 msgr2=0x7f66380aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:12.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f66377fe640 1 --2- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f663806d980 0x7f66380aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f66377fe640 1 -- 172.21.15.26:0/2172722674 >> v1:172.21.15.79:6789/0 conn(0x7f66380ab3b0 legacy=0x7f66380c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f66377fe640 1 -- 172.21.15.26:0/2172722674 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638155a20 con 0x7f663814fcc0 2023-11-28T16:57:12.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f6636ffd640 1 --2- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f663806d980 0x7f66380aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.078+0000 7f66367fc640 1 -- 172.21.15.26:0/2172722674 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189891330 0 0) 0x7f6638152fe0 con 0x7f66380ab3b0 2023-11-28T16:57:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f66377fe640 1 --2- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663814fcc0 0x7f6638156500 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66280097c0 tx=0x7f662801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=335b430a0bb036de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f66367fc640 1 -- 172.21.15.26:0/2172722674 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280ab650 con 0x7f663814fcc0 2023-11-28T16:57:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f66367fc640 1 -- 172.21.15.26:0/2172722674 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280ab7b0 con 0x7f663814fcc0 2023-11-28T16:57:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f66367fc640 1 -- 172.21.15.26:0/2172722674 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280abb40 con 0x7f663814fcc0 2023-11-28T16:57:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 -- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663814fcc0 msgr2=0x7f6638156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 --2- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663814fcc0 0x7f6638156500 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66280097c0 tx=0x7f662801c450 comp rx=0 tx=0).stop 2023-11-28T16:57:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 -- 172.21.15.26:0/2172722674 shutdown_connections 2023-11-28T16:57:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 --2- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f663806d980 0x7f66380aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 --2- 172.21.15.26:0/2172722674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663814fcc0 0x7f6638156500 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 -- 172.21.15.26:0/2172722674 >> 172.21.15.26:0/2172722674 conn(0x7f66380c2ad0 msgr2=0x7f66380c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:12.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 -- 172.21.15.26:0/2172722674 shutdown_connections 2023-11-28T16:57:12.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 -- 172.21.15.26:0/2172722674 wait complete. 2023-11-28T16:57:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 Processor -- start 2023-11-28T16:57:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 -- start start 2023-11-28T16:57:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663806d980 0x7f663814a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.082+0000 7f663e19d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66380ab3b0 0x7f66381f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f663e19d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66381f0c80 0x7f663814c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f663e19d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381f1420 con 0x7f66380ab3b0 2023-11-28T16:57:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f663e19d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381f1140 con 0x7f663806d980 2023-11-28T16:57:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f663e19d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6638155370 con 0x7f66381f0c80 2023-11-28T16:57:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66380ab3b0 0x7f66381f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66380ab3b0 0x7f66381f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49980/0 (socket says 172.21.15.26:49980) 2023-11-28T16:57:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 -- 172.21.15.26:0/2343891295 learned_addr learned my addr 172.21.15.26:0/2343891295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f66377fe640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663806d980 0x7f663814a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6637fff640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66381f0c80 0x7f663814c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 -- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66381f0c80 msgr2=0x7f663814c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66381f0c80 0x7f663814c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 -- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663806d980 msgr2=0x7f663814a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663806d980 0x7f663814a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 -- 172.21.15.26:0/2343891295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009420 con 0x7f66380ab3b0 2023-11-28T16:57:12.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f6636ffd640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66380ab3b0 0x7f66381f0740 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f662c00ebe0 tx=0x7f662c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f661ffff640 1 -- 172.21.15.26:0/2343891295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00eee0 con 0x7f66380ab3b0 2023-11-28T16:57:12.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f661ffff640 1 -- 172.21.15.26:0/2343891295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00cc30 con 0x7f66380ab3b0 2023-11-28T16:57:12.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f661ffff640 1 -- 172.21.15.26:0/2343891295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c013470 con 0x7f66380ab3b0 2023-11-28T16:57:12.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628009420 con 0x7f66380ab3b0 2023-11-28T16:57:12.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663814b900 con 0x7f66380ab3b0 2023-11-28T16:57:12.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663804e890 con 0x7f66380ab3b0 2023-11-28T16:57:12.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.086+0000 7f661ffff640 1 -- 172.21.15.26:0/2343891295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f662c0135d0 con 0x7f66380ab3b0 2023-11-28T16:57:12.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.090+0000 7f661ffff640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6624066900 0x7f6624068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.090+0000 7f661ffff640 1 -- 172.21.15.26:0/2343891295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f662c084580 con 0x7f66380ab3b0 2023-11-28T16:57:12.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.090+0000 7f66377fe640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6624066900 0x7f6624068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.090+0000 7f66377fe640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6624066900 0x7f6624068dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f66280af000 tx=0x7f66280a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.090+0000 7f661ffff640 1 -- 172.21.15.26:0/2343891295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f662c051900 con 0x7f66380ab3b0 2023-11-28T16:57:12.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.306+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f6638072670 con 0x7f66380ab3b0 2023-11-28T16:57:12.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.306+0000 7f661ffff640 1 -- 172.21.15.26:0/2343891295 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7f662c054f20 con 0x7f66380ab3b0 2023-11-28T16:57:12.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6624066900 msgr2=0x7f6624068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6624066900 0x7f6624068dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f66280af000 tx=0x7f66280a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:12.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66380ab3b0 msgr2=0x7f66381f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66380ab3b0 0x7f66381f0740 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f662c00ebe0 tx=0x7f662c00c520 comp rx=0 tx=0).stop 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 shutdown_connections 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6624066900 0x7f6624068dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66381f0c80 0x7f663814c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66380ab3b0 0x7f66381f0740 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 --2- 172.21.15.26:0/2343891295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f663806d980 0x7f663814a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 >> 172.21.15.26:0/2343891295 conn(0x7f66380c2ad0 msgr2=0x7f66381519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 shutdown_connections 2023-11-28T16:57:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.310+0000 7f663e19d640 1 -- 172.21.15.26:0/2343891295 wait complete. 2023-11-28T16:57:12.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:12.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.470+0000 7f6614a32640 1 Processor -- start 2023-11-28T16:57:12.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.470+0000 7f6614a32640 1 -- start start 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f6614a32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f661014fcc0 0x7f6610156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f6614a32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f66100c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f6614a32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100ab580 con 0x7f661006d980 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f6614a32640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66100aa340 con 0x7f661014fcc0 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f6614a32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6610152fe0 con 0x7f66100c19e0 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660ed9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f66100c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f661014fcc0 0x7f6610156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660ed9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f66100c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:53428/0 (socket says 172.21.15.26:53428) 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660dd9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f661006d980 0x7f66100aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:57586/0 (socket says 172.21.15.26:57586) 2023-11-28T16:57:12.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660ed9d640 1 -- 172.21.15.26:0/2630618398 learned_addr learned my addr 172.21.15.26:0/2630618398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:12.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660ed9d640 1 -- 172.21.15.26:0/2630618398 >> v2:172.21.15.79:3300/0 conn(0x7f661014fcc0 msgr2=0x7f6610156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:12.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660ed9d640 1 --2- 172.21.15.26:0/2630618398 >> v2:172.21.15.79:3300/0 conn(0x7f661014fcc0 0x7f6610156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660ed9d640 1 -- 172.21.15.26:0/2630618398 >> v1:172.21.15.79:6789/0 conn(0x7f661006d980 legacy=0x7f66100aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.474+0000 7f660ed9d640 1 -- 172.21.15.26:0/2630618398 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66101532c0 con 0x7f66100c19e0 2023-11-28T16:57:12.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f660ed9d640 1 --2- 172.21.15.26:0/2630618398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f66100c1e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6608009e50 tx=0x7f660801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e55ed401d5a154 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f660d59a640 1 -- 172.21.15.26:0/2630618398 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080a57c0 con 0x7f66100c19e0 2023-11-28T16:57:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f660d59a640 1 -- 172.21.15.26:0/2630618398 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66080a5920 con 0x7f66100c19e0 2023-11-28T16:57:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f660d59a640 1 -- 172.21.15.26:0/2630618398 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080a5cb0 con 0x7f66100c19e0 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 -- 172.21.15.26:0/2630618398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 msgr2=0x7f66100c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 --2- 172.21.15.26:0/2630618398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f66100c1e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6608009e50 tx=0x7f660801c9e0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 -- 172.21.15.26:0/2630618398 shutdown_connections 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 --2- 172.21.15.26:0/2630618398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f66100c1e70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 --2- 172.21.15.26:0/2630618398 >> v2:172.21.15.79:3300/0 conn(0x7f661014fcc0 0x7f6610156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 -- 172.21.15.26:0/2630618398 >> 172.21.15.26:0/2630618398 conn(0x7f66100c2ad0 msgr2=0x7f66100c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 -- 172.21.15.26:0/2630618398 shutdown_connections 2023-11-28T16:57:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 -- 172.21.15.26:0/2630618398 wait complete. 2023-11-28T16:57:12.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 Processor -- start 2023-11-28T16:57:12.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.478+0000 7f6614a32640 1 -- start start 2023-11-28T16:57:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f661006d980 0x7f661015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f6610151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f661015b0c0 0x7f66101eab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101ee9b0 con 0x7f661006d980 2023-11-28T16:57:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6610148fb0 con 0x7f661015b0c0 2023-11-28T16:57:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661015bb70 con 0x7f66100c19e0 2023-11-28T16:57:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f661006d980 0x7f661015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f661006d980 0x7f661015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49996/0 (socket says 172.21.15.26:49996) 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 -- 172.21.15.26:0/1844457220 learned_addr learned my addr 172.21.15.26:0/1844457220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660ed9d640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f661015b0c0 0x7f66101eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660dd9b640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f6610151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 -- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 msgr2=0x7f6610151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f6610151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 -- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f661015b0c0 msgr2=0x7f66101eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f661015b0c0 0x7f66101eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 -- 172.21.15.26:0/1844457220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608009b30 con 0x7f661006d980 2023-11-28T16:57:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f660e59c640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f661006d980 0x7f661015ab80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f660000e870 tx=0x7f660000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f65feffd640 1 -- 172.21.15.26:0/1844457220 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600009510 con 0x7f661006d980 2023-11-28T16:57:12.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f65feffd640 1 -- 172.21.15.26:0/1844457220 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660000eec0 con 0x7f661006d980 2023-11-28T16:57:12.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f65feffd640 1 -- 172.21.15.26:0/1844457220 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660000cae0 con 0x7f661006d980 2023-11-28T16:57:12.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66101eebc0 con 0x7f661006d980 2023-11-28T16:57:12.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661014ef50 con 0x7f661006d980 2023-11-28T16:57:12.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661006dd60 con 0x7f661006d980 2023-11-28T16:57:12.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.482+0000 7f65feffd640 1 -- 172.21.15.26:0/1844457220 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f660000cc40 con 0x7f661006d980 2023-11-28T16:57:12.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.486+0000 7f65feffd640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65f0066900 0x7f65f0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.486+0000 7f65feffd640 1 -- 172.21.15.26:0/1844457220 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6600084400 con 0x7f661006d980 2023-11-28T16:57:12.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.486+0000 7f660dd9b640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65f0066900 0x7f65f0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.486+0000 7f660dd9b640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65f0066900 0x7f65f0068dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6610158000 tx=0x7f6604007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.490+0000 7f65feffd640 1 -- 172.21.15.26:0/1844457220 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f661006dd60 con 0x7f661006d980 2023-11-28T16:57:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.646+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f661006dd60 con 0x7f661006d980 2023-11-28T16:57:12.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f65feffd640 1 -- 172.21.15.26:0/1844457220 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16497 (secure 0 0 0) 0x7f661006dd60 con 0x7f661006d980 2023-11-28T16:57:12.654 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:12.654 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:04.874436+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65f0066900 msgr2=0x7f65f0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65f0066900 0x7f65f0068dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6610158000 tx=0x7f6604007e90 comp rx=0 tx=0).stop 2023-11-28T16:57:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f661006d980 msgr2=0x7f661015ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f661006d980 0x7f661015ab80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f660000e870 tx=0x7f660000ec70 comp rx=0 tx=0).stop 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 shutdown_connections 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f661015b0c0 0x7f66101eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65f0066900 0x7f65f0068dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66100c19e0 0x7f6610151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 --2- 172.21.15.26:0/1844457220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f661006d980 0x7f661015ab80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 >> 172.21.15.26:0/1844457220 conn(0x7f66100c2ad0 msgr2=0x7f6610156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 shutdown_connections 2023-11-28T16:57:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.650+0000 7f6614a32640 1 -- 172.21.15.26:0/1844457220 wait complete. 2023-11-28T16:57:12.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:01.716708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:02.252332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:12.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:12.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.814+0000 7fdf1759e640 1 Processor -- start 2023-11-28T16:57:12.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.814+0000 7fdf1759e640 1 -- start start 2023-11-28T16:57:12.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf1759e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf180c7d40 0x7fdf18154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf1759e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1806b3d0 con 0x7fdf1814e590 2023-11-28T16:57:12.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf1759e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1814e970 con 0x7fdf1806b860 2023-11-28T16:57:12.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf1759e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf181554a0 con 0x7fdf180c7d40 2023-11-28T16:57:12.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf0ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf180c7d40 0x7fdf18154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf1659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdf1814e590 0x7fdf180c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52720/0 (socket says 172.21.15.26:52720) 2023-11-28T16:57:12.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf1659c640 1 -- 172.21.15.26:0/2151124034 learned_addr learned my addr 172.21.15.26:0/2151124034 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:12.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf0ffff640 1 -- 172.21.15.26:0/2151124034 >> v1:172.21.15.79:6789/0 conn(0x7fdf1806b860 legacy=0x7fdf1806bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf0ffff640 1 -- 172.21.15.26:0/2151124034 >> v1:172.21.15.26:6789/0 conn(0x7fdf1814e590 legacy=0x7fdf180c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf0ffff640 1 -- 172.21.15.26:0/2151124034 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf180bd720 con 0x7fdf180c7d40 2023-11-28T16:57:12.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.818+0000 7fdf15d9b640 1 -- 172.21.15.26:0/2151124034 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814325156 0 0) 0x7fdf1806b3d0 con 0x7fdf1814e590 2023-11-28T16:57:12.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf0ffff640 1 --2- 172.21.15.26:0/2151124034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf180c7d40 0x7fdf18154f60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcce822c40523bd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf15d9b640 1 -- 172.21.15.26:0/2151124034 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000ab5f0 con 0x7fdf180c7d40 2023-11-28T16:57:12.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf15d9b640 1 -- 172.21.15.26:0/2151124034 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf000ab750 con 0x7fdf180c7d40 2023-11-28T16:57:12.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf15d9b640 1 -- 172.21.15.26:0/2151124034 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000abae0 con 0x7fdf180c7d40 2023-11-28T16:57:12.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- 172.21.15.26:0/2151124034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf180c7d40 msgr2=0x7fdf18154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 --2- 172.21.15.26:0/2151124034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf180c7d40 0x7fdf18154f60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- 172.21.15.26:0/2151124034 shutdown_connections 2023-11-28T16:57:12.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 --2- 172.21.15.26:0/2151124034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf180c7d40 0x7fdf18154f60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- 172.21.15.26:0/2151124034 >> 172.21.15.26:0/2151124034 conn(0x7fdf180abd70 msgr2=0x7fdf180ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:12.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- 172.21.15.26:0/2151124034 shutdown_connections 2023-11-28T16:57:12.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- 172.21.15.26:0/2151124034 wait complete. 2023-11-28T16:57:12.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 Processor -- start 2023-11-28T16:57:12.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- start start 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1806b860 0x7fdf181512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf180c7d40 0x7fdf180aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdf1814e590 0x7fdf180af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180ad020 con 0x7fdf1806b860 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18151810 con 0x7fdf180c7d40 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.822+0000 7fdf1759e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180aca60 con 0x7fdf1814e590 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1806b860 0x7fdf181512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1806b860 0x7fdf181512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50008/0 (socket says 172.21.15.26:50008) 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 -- 172.21.15.26:0/983482610 learned_addr learned my addr 172.21.15.26:0/983482610 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:12.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf0ffff640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf180c7d40 0x7fdf180aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf16d9d640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdf1814e590 0x7fdf180af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 -- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdf1814e590 msgr2=0x7fdf180af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdf1814e590 0x7fdf180af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 -- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf180c7d40 msgr2=0x7fdf180aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf180c7d40 0x7fdf180aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 -- 172.21.15.26:0/983482610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009420 con 0x7fdf1806b860 2023-11-28T16:57:12.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1659c640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1806b860 0x7fdf181512d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c410 tx=0x7fdf0800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf0effd640 1 -- 172.21.15.26:0/983482610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf080074e0 con 0x7fdf1806b860 2023-11-28T16:57:12.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf0effd640 1 -- 172.21.15.26:0/983482610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf08007640 con 0x7fdf1806b860 2023-11-28T16:57:12.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf181ed3c0 con 0x7fdf1806b860 2023-11-28T16:57:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf0effd640 1 -- 172.21.15.26:0/983482610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08004a30 con 0x7fdf1806b860 2023-11-28T16:57:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf181ed710 con 0x7fdf1806b860 2023-11-28T16:57:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf180afe50 con 0x7fdf1806b860 2023-11-28T16:57:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.826+0000 7fdf0effd640 1 -- 172.21.15.26:0/983482610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdf08004b90 con 0x7fdf1806b860 2023-11-28T16:57:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.830+0000 7fdf0effd640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdef80668d0 0x7fdef8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:12.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.830+0000 7fdf0effd640 1 -- 172.21.15.26:0/983482610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf08084100 con 0x7fdf1806b860 2023-11-28T16:57:12.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.830+0000 7fdf0ffff640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdef80668d0 0x7fdef8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:12.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.830+0000 7fdf0ffff640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdef80668d0 0x7fdef8068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdf000af000 tx=0x7fdf000a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:12.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.834+0000 7fdf0effd640 1 -- 172.21.15.26:0/983482610 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf080513e0 con 0x7fdf1806b860 2023-11-28T16:57:12.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf18074970 con 0x7fdf1806b860 2023-11-28T16:57:12.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf0effd640 1 -- 172.21.15.26:0/983482610 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf08054a00 con 0x7fdf1806b860 2023-11-28T16:57:12.997 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:12.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdef80668d0 msgr2=0x7fdef8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdef80668d0 0x7fdef8068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdf000af000 tx=0x7fdf000a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:12.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1806b860 msgr2=0x7fdf181512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:12.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1806b860 0x7fdf181512d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c410 tx=0x7fdf0800c8d0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 shutdown_connections 2023-11-28T16:57:12.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdef80668d0 0x7fdef8068d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdf1814e590 0x7fdf180af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf180c7d40 0x7fdf180aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 --2- 172.21.15.26:0/983482610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1806b860 0x7fdf181512d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:12.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.990+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 >> 172.21.15.26:0/983482610 conn(0x7fdf180abd70 msgr2=0x7fdf1814d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:12.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.994+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 shutdown_connections 2023-11-28T16:57:12.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:12.994+0000 7fdf1759e640 1 -- 172.21.15.26:0/983482610 wait complete. 2023-11-28T16:57:13.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:57:13.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d8cfe640 1 Processor -- start 2023-11-28T16:57:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d8cfe640 1 -- start start 2023-11-28T16:57:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d8cfe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 0x7f37d414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d8cfe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37d414fb30 0x7f37d40aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d8cfe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d4152d90 con 0x7f37d40a86d0 2023-11-28T16:57:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d8cfe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d4152480 con 0x7f37d414fb30 2023-11-28T16:57:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d8cfe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40a9760 con 0x7f37d4156600 2023-11-28T16:57:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37d40a86d0 0x7f37d40a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52726/0 (socket says 172.21.15.26:52726) 2023-11-28T16:57:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d259c640 1 -- 172.21.15.26:0/3498041638 learned_addr learned my addr 172.21.15.26:0/3498041638 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:13.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 0x7f37d414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d2d9d640 1 --2- 172.21.15.26:0/3498041638 >> v2:172.21.15.79:3300/0 conn(0x7f37d414fb30 0x7f37d40aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159678141 0 0) 0x7f37d4152d90 con 0x7f37d40a86d0 2023-11-28T16:57:13.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c0003530 con 0x7f37d40a86d0 2023-11-28T16:57:13.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4100792927 0 0) 0x7f37c0003530 con 0x7f37d40a86d0 2023-11-28T16:57:13.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 msgr2=0x7f37d414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:13.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 0x7f37d414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 >> v2:172.21.15.79:3300/0 conn(0x7f37d414fb30 msgr2=0x7f37d40aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 --2- 172.21.15.26:0/3498041638 >> v2:172.21.15.79:3300/0 conn(0x7f37d414fb30 0x7f37d40aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4152740 con 0x7f37d40a86d0 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f37c4001680 con 0x7f37d40a86d0 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 0x7f37d414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 >> v1:172.21.15.26:6789/0 conn(0x7f37d40a86d0 legacy=0x7f37d40a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0003980 0x7f37c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 0x7f37c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4152480 con 0x7f37c00047d0 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40a9760 con 0x7f37c0003980 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c000b990 con 0x7f37d4156600 2023-11-28T16:57:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d259c640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0003980 0x7f37c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d2d9d640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 0x7f37c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 -- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 msgr2=0x7f37c0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4156600 0x7f37c0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 -- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0003980 msgr2=0x7f37c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0003980 0x7f37c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37cbfff640 1 -- 172.21.15.26:0/3498041638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc009420 con 0x7f37c00047d0 2023-11-28T16:57:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.158+0000 7f37d259c640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0003980 0x7f37c0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:13.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37c0004c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009cb0 tx=0x7f37bc01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c999da36013a158 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0a56c0 con 0x7f37c00047d0 2023-11-28T16:57:13.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc0a5820 con 0x7f37c00047d0 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d1d9b640 1 -- 172.21.15.26:0/3498041638 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0a5b90 con 0x7f37c00047d0 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3498041638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 msgr2=0x7f37c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d8cfe640 1 --2- 172.21.15.26:0/3498041638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37c0004c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009cb0 tx=0x7f37bc01cbf0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d2d9d640 1 -- 172.21.15.26:0/3498041638 reap_dead start 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3498041638 shutdown_connections 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3498041638 >> 172.21.15.26:0/3498041638 conn(0x7f37d40c2a60 msgr2=0x7f37d40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3498041638 shutdown_connections 2023-11-28T16:57:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.162+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3498041638 wait complete. 2023-11-28T16:57:13.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 Processor -- start 2023-11-28T16:57:13.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 -- start start 2023-11-28T16:57:13.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37d41edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4070d00 0x7f37d4071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37d4154aa0 0x7f37d40bf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40708e0 con 0x7f37c00047d0 2023-11-28T16:57:13.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4071aa0 con 0x7f37d4154aa0 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4071fb0 con 0x7f37d4070d00 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37d41edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37d41edd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50026/0 (socket says 172.21.15.26:50026) 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 -- 172.21.15.26:0/3577312241 learned_addr learned my addr 172.21.15.26:0/3577312241 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4070d00 0x7f37d4071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d2d9d640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37d4154aa0 0x7f37d40bf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 -- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4070d00 msgr2=0x7f37d4071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4070d00 0x7f37d4071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 -- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37d4154aa0 msgr2=0x7f37d40bf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37d4154aa0 0x7f37d40bf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 -- 172.21.15.26:0/3577312241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d41533a0 con 0x7f37c00047d0 2023-11-28T16:57:13.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4070d00 0x7f37d4071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d259c640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37d41edd30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f37c4012540 tx=0x7f37c4012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37caffd640 1 -- 172.21.15.26:0/3577312241 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4014810 con 0x7f37c00047d0 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37caffd640 1 -- 172.21.15.26:0/3577312241 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c4014970 con 0x7f37c00047d0 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37caffd640 1 -- 172.21.15.26:0/3577312241 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4014ce0 con 0x7f37c00047d0 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d4071160 con 0x7f37c00047d0 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.166+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d4070220 con 0x7f37c00047d0 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.170+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d4070a20 con 0x7f37c00047d0 2023-11-28T16:57:13.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.170+0000 7f37caffd640 1 -- 172.21.15.26:0/3577312241 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f37c40153e0 con 0x7f37c00047d0 2023-11-28T16:57:13.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.170+0000 7f37caffd640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37b4066900 0x7f37b4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.170+0000 7f37caffd640 1 -- 172.21.15.26:0/3577312241 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37c4086e90 con 0x7f37c00047d0 2023-11-28T16:57:13.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.170+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37b4066900 0x7f37b4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.170+0000 7f37cbfff640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37b4066900 0x7f37b4068dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0af000 tx=0x7f37bc0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.174+0000 7f37caffd640 1 -- 172.21.15.26:0/3577312241 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37d4070a20 con 0x7f37c00047d0 2023-11-28T16:57:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.330+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37d4070a20 con 0x7f37c00047d0 2023-11-28T16:57:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37caffd640 1 -- 172.21.15.26:0/3577312241 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37c401c020 con 0x7f37c00047d0 2023-11-28T16:57:13.338 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37b4066900 msgr2=0x7f37b4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37b4066900 0x7f37b4068dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0af000 tx=0x7f37bc0046d0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 msgr2=0x7f37d41edd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37d41edd30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f37c4012540 tx=0x7f37c4012a00 comp rx=0 tx=0).stop 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 shutdown_connections 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37d4154aa0 0x7f37d40bf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37b4066900 0x7f37b4068dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37d4070d00 0x7f37d4071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 --2- 172.21.15.26:0/3577312241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37c00047d0 0x7f37d41edd30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 >> 172.21.15.26:0/3577312241 conn(0x7f37d40c2a60 msgr2=0x7f37d41518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 shutdown_connections 2023-11-28T16:57:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.334+0000 7f37d8cfe640 1 -- 172.21.15.26:0/3577312241 wait complete. 2023-11-28T16:57:13.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:57:13.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bd1c5a640 1 Processor -- start 2023-11-28T16:57:13.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bd1c5a640 1 -- start start 2023-11-28T16:57:13.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bd1c5a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bcc0c7f20 0x7f0bcc06be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bd1c5a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc06cf70 con 0x7f0bcc151d80 2023-11-28T16:57:13.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bd1c5a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc152160 con 0x7f0bcc0c8430 2023-11-28T16:57:13.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bd1c5a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c6a30 con 0x7f0bcc0c7f20 2023-11-28T16:57:13.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bcbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bcc0c7f20 0x7f0bcc06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bcb7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0bcc151d80 0x7f0bcc0c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52730/0 (socket says 172.21.15.26:52730) 2023-11-28T16:57:13.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bcb7fe640 1 -- 172.21.15.26:0/1475099315 learned_addr learned my addr 172.21.15.26:0/1475099315 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:13.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bcbfff640 1 -- 172.21.15.26:0/1475099315 >> v1:172.21.15.79:6789/0 conn(0x7f0bcc0c8430 legacy=0x7f0bcc06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:13.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bca7fc640 1 -- 172.21.15.26:0/1475099315 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988034318 0 0) 0x7f0bcc06cf70 con 0x7f0bcc151d80 2023-11-28T16:57:13.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bcbfff640 1 -- 172.21.15.26:0/1475099315 >> v1:172.21.15.26:6789/0 conn(0x7f0bcc151d80 legacy=0x7f0bcc0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.502+0000 7f0bcbfff640 1 -- 172.21.15.26:0/1475099315 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0c72d0 con 0x7f0bcc0c7f20 2023-11-28T16:57:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bcbfff640 1 --2- 172.21.15.26:0/1475099315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c7f20 0x7f0bcc06be30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d90 tx=0x7f0bc401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d235fb536339c8c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bca7fc640 1 -- 172.21.15.26:0/1475099315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a5950 con 0x7f0bcc0c7f20 2023-11-28T16:57:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bca7fc640 1 -- 172.21.15.26:0/1475099315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40a5ab0 con 0x7f0bcc0c7f20 2023-11-28T16:57:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bca7fc640 1 -- 172.21.15.26:0/1475099315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a5e40 con 0x7f0bcc0c7f20 2023-11-28T16:57:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1475099315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c7f20 msgr2=0x7f0bcc06be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1475099315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c7f20 0x7f0bcc06be30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d90 tx=0x7f0bc401c890 comp rx=0 tx=0).stop 2023-11-28T16:57:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1475099315 shutdown_connections 2023-11-28T16:57:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1475099315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c7f20 0x7f0bcc06be30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1475099315 >> 172.21.15.26:0/1475099315 conn(0x7f0bcc0abd00 msgr2=0x7f0bcc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1475099315 shutdown_connections 2023-11-28T16:57:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1475099315 wait complete. 2023-11-28T16:57:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 Processor -- start 2023-11-28T16:57:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.506+0000 7f0bd1c5a640 1 -- start start 2023-11-28T16:57:13.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0bcc0c7f20 0x7f0bcc158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c8430 0x7f0bcc0bca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bcc151d80 0x7f0bcc0bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc155ab0 con 0x7f0bcc0c8430 2023-11-28T16:57:13.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1f1c00 con 0x7f0bcc151d80 2023-11-28T16:57:13.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1f1680 con 0x7f0bcc0c7f20 2023-11-28T16:57:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c8430 0x7f0bcc0bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c8430 0x7f0bcc0bca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50058/0 (socket says 172.21.15.26:50058) 2023-11-28T16:57:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 -- 172.21.15.26:0/1593653057 learned_addr learned my addr 172.21.15.26:0/1593653057 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcbfff640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bcc151d80 0x7f0bcc0bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcb7fe640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0bcc0c7f20 0x7f0bcc158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 -- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0bcc0c7f20 msgr2=0x7f0bcc158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0bcc0c7f20 0x7f0bcc158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 -- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bcc151d80 msgr2=0x7f0bcc0bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bcc151d80 0x7f0bcc0bcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 -- 172.21.15.26:0/1593653057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009a70 con 0x7f0bcc0c8430 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bcaffd640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c8430 0x7f0bcc0bca10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c500 tx=0x7f0bc000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bb3fff640 1 -- 172.21.15.26:0/1593653057 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0005220 con 0x7f0bcc0c8430 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bb3fff640 1 -- 172.21.15.26:0/1593653057 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc0005380 con 0x7f0bcc0c8430 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bb3fff640 1 -- 172.21.15.26:0/1593653057 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0007270 con 0x7f0bcc0c8430 2023-11-28T16:57:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0acc60 con 0x7f0bcc0c8430 2023-11-28T16:57:13.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc157fc0 con 0x7f0bcc0c8430 2023-11-28T16:57:13.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc04e890 con 0x7f0bcc0c8430 2023-11-28T16:57:13.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.510+0000 7f0bb3fff640 1 -- 172.21.15.26:0/1593653057 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0bc00073d0 con 0x7f0bcc0c8430 2023-11-28T16:57:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.514+0000 7f0bb3fff640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bb80668d0 0x7f0bb8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.514+0000 7f0bb3fff640 1 -- 172.21.15.26:0/1593653057 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bc0083530 con 0x7f0bcc0c8430 2023-11-28T16:57:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.514+0000 7f0bcb7fe640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bb80668d0 0x7f0bb8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.514+0000 7f0bcb7fe640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bb80668d0 0x7f0bb8068d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0011f0 tx=0x7f0bbc001140 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.518+0000 7f0bb3fff640 1 -- 172.21.15.26:0/1593653057 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bc0050830 con 0x7f0bcc0c8430 2023-11-28T16:57:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bcc152160 con 0x7f0bcc0c8430 2023-11-28T16:57:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bb3fff640 1 -- 172.21.15.26:0/1593653057 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bcc152160 con 0x7f0bcc0c8430 2023-11-28T16:57:13.683 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bb80668d0 msgr2=0x7f0bb8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bb80668d0 0x7f0bb8068d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0011f0 tx=0x7f0bbc001140 comp rx=0 tx=0).stop 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c8430 msgr2=0x7f0bcc0bca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c8430 0x7f0bcc0bca10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c500 tx=0x7f0bc000c9c0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 shutdown_connections 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bcc151d80 0x7f0bcc0bcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bcc0c8430 0x7f0bcc0bca10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0bb80668d0 0x7f0bb8068d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 --2- 172.21.15.26:0/1593653057 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0bcc0c7f20 0x7f0bcc158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 >> 172.21.15.26:0/1593653057 conn(0x7f0bcc0abd00 msgr2=0x7f0bcc14ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 shutdown_connections 2023-11-28T16:57:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.678+0000 7f0bd1c5a640 1 -- 172.21.15.26:0/1593653057 wait complete. 2023-11-28T16:57:13.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T16:57:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.842+0000 7fef07217640 1 Processor -- start 2023-11-28T16:57:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.842+0000 7fef07217640 1 -- start start 2023-11-28T16:57:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7fef07217640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef00156500 0x7fef0006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7fef07217640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0006dec0 con 0x7fef0014fcc0 2023-11-28T16:57:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7fef07217640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef00156980 con 0x7fef000c19e0 2023-11-28T16:57:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7fef07217640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000aa340 con 0x7fef00156500 2023-11-28T16:57:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7feefffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef00156500 0x7fef0006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7fef04fb3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fef0014fcc0 0x7fef000aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52742/0 (socket says 172.21.15.26:52742) 2023-11-28T16:57:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7fef04fb3640 1 -- 172.21.15.26:0/4123515168 learned_addr learned my addr 172.21.15.26:0/4123515168 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7feefffff640 1 -- 172.21.15.26:0/4123515168 >> v1:172.21.15.79:6789/0 conn(0x7fef000c19e0 legacy=0x7fef000c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7feefffff640 1 -- 172.21.15.26:0/4123515168 >> v1:172.21.15.26:6789/0 conn(0x7fef0014fcc0 legacy=0x7fef000aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7feefffff640 1 -- 172.21.15.26:0/4123515168 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000ab580 con 0x7fef00156500 2023-11-28T16:57:13.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7feeff7fe640 1 -- 172.21.15.26:0/4123515168 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132599056 0 0) 0x7fef0006dec0 con 0x7fef0014fcc0 2023-11-28T16:57:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.846+0000 7feefffff640 1 --2- 172.21.15.26:0/4123515168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0006d980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7feeec0097c0 tx=0x7feeec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31a960b607a06bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7feeff7fe640 1 -- 172.21.15.26:0/4123515168 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0ab650 con 0x7fef00156500 2023-11-28T16:57:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7feeff7fe640 1 -- 172.21.15.26:0/4123515168 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec0ab7b0 con 0x7fef00156500 2023-11-28T16:57:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7feeff7fe640 1 -- 172.21.15.26:0/4123515168 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0abb40 con 0x7fef00156500 2023-11-28T16:57:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- 172.21.15.26:0/4123515168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 msgr2=0x7fef0006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 --2- 172.21.15.26:0/4123515168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0006d980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7feeec0097c0 tx=0x7feeec01c450 comp rx=0 tx=0).stop 2023-11-28T16:57:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- 172.21.15.26:0/4123515168 shutdown_connections 2023-11-28T16:57:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 --2- 172.21.15.26:0/4123515168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0006d980 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- 172.21.15.26:0/4123515168 >> 172.21.15.26:0/4123515168 conn(0x7fef000c2ad0 msgr2=0x7fef000c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- 172.21.15.26:0/4123515168 shutdown_connections 2023-11-28T16:57:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- 172.21.15.26:0/4123515168 wait complete. 2023-11-28T16:57:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 Processor -- start 2023-11-28T16:57:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- start start 2023-11-28T16:57:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef000c19e0 0x7fef000c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0014e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef00153590 0x7fef000c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00143750 con 0x7fef00156500 2023-11-28T16:57:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00071c40 con 0x7fef00153590 2023-11-28T16:57:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7fef07217640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef00151bf0 con 0x7fef000c19e0 2023-11-28T16:57:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7feefffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7feefffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0014e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50076/0 (socket says 172.21.15.26:50076) 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.850+0000 7feefffff640 1 -- 172.21.15.26:0/6574336 learned_addr learned my addr 172.21.15.26:0/6574336 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7fef04fb3640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef000c19e0 0x7fef000c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefffff640 1 -- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef000c19e0 msgr2=0x7fef000c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7fef057b4640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef00153590 0x7fef000c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefffff640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef000c19e0 0x7fef000c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefffff640 1 -- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef00153590 msgr2=0x7fef000c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefffff640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef00153590 0x7fef000c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefffff640 1 -- 172.21.15.26:0/6574336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009420 con 0x7fef00156500 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7fef04fb3640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef000c19e0 0x7fef000c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7fef057b4640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef00153590 0x7fef000c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefffff640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0014e570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ad040 tx=0x7feeec01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefd7fa640 1 -- 172.21.15.26:0/6574336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0b5810 con 0x7fef00156500 2023-11-28T16:57:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefd7fa640 1 -- 172.21.15.26:0/6574336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec0b5970 con 0x7fef00156500 2023-11-28T16:57:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefd7fa640 1 -- 172.21.15.26:0/6574336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0b5d20 con 0x7fef00156500 2023-11-28T16:57:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef00151ed0 con 0x7fef00156500 2023-11-28T16:57:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0014eab0 con 0x7fef00156500 2023-11-28T16:57:13.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0004e890 con 0x7fef00156500 2023-11-28T16:57:13.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefd7fa640 1 -- 172.21.15.26:0/6574336 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feeec0bf410 con 0x7fef00156500 2023-11-28T16:57:13.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefd7fa640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feee40668d0 0x7feee4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:13.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.854+0000 7feefd7fa640 1 -- 172.21.15.26:0/6574336 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeec11f0d0 con 0x7fef00156500 2023-11-28T16:57:13.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.858+0000 7fef04fb3640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feee40668d0 0x7feee4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:13.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.858+0000 7fef04fb3640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feee40668d0 0x7feee4068d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feef4000f70 tx=0x7feef4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:13.858+0000 7feefd7fa640 1 -- 172.21.15.26:0/6574336 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feeec0ec390 con 0x7fef00156500 2023-11-28T16:57:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fef0006ce10 con 0x7fef00156500 2023-11-28T16:57:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7feefd7fa640 1 -- 172.21.15.26:0/6574336 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+207 (secure 0 0 0) 0x7feeec0ef9b0 con 0x7fef00156500 2023-11-28T16:57:14.024 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 4, 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "cephfs_metadata" 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 5, 2023-11-28T16:57:14.026 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "cephfs_data" 2023-11-28T16:57:14.026 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:14.026 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feee40668d0 msgr2=0x7feee4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feee40668d0 0x7feee4068d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feef4000f70 tx=0x7feef4009040 comp rx=0 tx=0).stop 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 msgr2=0x7fef0014e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0014e570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ad040 tx=0x7feeec01ac90 comp rx=0 tx=0).stop 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 shutdown_connections 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef00153590 0x7fef000c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef00156500 0x7fef0014e570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feee40668d0 0x7feee4068d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 --2- 172.21.15.26:0/6574336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef000c19e0 0x7fef000c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 >> 172.21.15.26:0/6574336 conn(0x7fef000c2ad0 msgr2=0x7fef0006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:14.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 shutdown_connections 2023-11-28T16:57:14.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.018+0000 7fef07217640 1 -- 172.21.15.26:0/6574336 wait complete. 2023-11-28T16:57:14.046 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-28T16:57:14.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-28T16:57:14.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 Processor -- start 2023-11-28T16:57:14.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 -- start start 2023-11-28T16:57:14.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26bc155f00 0x7f26bc0a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:14.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f26bc1562e0 0x7f26bc06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc0c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc0abb60 con 0x7f26bc155f00 2023-11-28T16:57:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc06c7a0 con 0x7f26bc1562e0 2023-11-28T16:57:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.186+0000 7f26c09b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0abdb0 con 0x7f26bc156770 2023-11-28T16:57:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26bc155f00 0x7f26bc0a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26bc155f00 0x7f26bc0a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50092/0 (socket says 172.21.15.26:50092) 2023-11-28T16:57:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 -- 172.21.15.26:0/2543062547 learned_addr learned my addr 172.21.15.26:0/2543062547 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26b3fff640 1 --2- 172.21.15.26:0/2543062547 >> v2:172.21.15.79:3300/0 conn(0x7f26bc1562e0 0x7f26bc06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26bad9d640 1 --2- 172.21.15.26:0/2543062547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc0c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 -- 172.21.15.26:0/2543062547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 msgr2=0x7f26bc0c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 --2- 172.21.15.26:0/2543062547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc0c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 -- 172.21.15.26:0/2543062547 >> v2:172.21.15.79:3300/0 conn(0x7f26bc1562e0 msgr2=0x7f26bc06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:14.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 --2- 172.21.15.26:0/2543062547 >> v2:172.21.15.79:3300/0 conn(0x7f26bc1562e0 0x7f26bc06cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 -- 172.21.15.26:0/2543062547 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0ac090 con 0x7f26bc155f00 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.190+0000 7f26ba59c640 1 --2- 172.21.15.26:0/2543062547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0a9770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009870 tx=0x7f26ac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37baa02c1be98d2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26b9d9b640 1 -- 172.21.15.26:0/2543062547 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0ab600 con 0x7f26bc155f00 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26b9d9b640 1 -- 172.21.15.26:0/2543062547 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac0a7050 con 0x7f26bc155f00 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26b9d9b640 1 -- 172.21.15.26:0/2543062547 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0ab980 con 0x7f26bc155f00 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- 172.21.15.26:0/2543062547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 msgr2=0x7f26bc0a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 --2- 172.21.15.26:0/2543062547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0a9770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009870 tx=0x7f26ac01c470 comp rx=0 tx=0).stop 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- 172.21.15.26:0/2543062547 shutdown_connections 2023-11-28T16:57:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 --2- 172.21.15.26:0/2543062547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc0c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 --2- 172.21.15.26:0/2543062547 >> v2:172.21.15.79:3300/0 conn(0x7f26bc1562e0 0x7f26bc06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 --2- 172.21.15.26:0/2543062547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0a9770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- 172.21.15.26:0/2543062547 >> 172.21.15.26:0/2543062547 conn(0x7f26bc06a5a0 msgr2=0x7f26bc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- 172.21.15.26:0/2543062547 shutdown_connections 2023-11-28T16:57:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- 172.21.15.26:0/2543062547 wait complete. 2023-11-28T16:57:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 Processor -- start 2023-11-28T16:57:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- start start 2023-11-28T16:57:14.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:14.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26bc1562e0 0x7f26bc147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:14.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:14.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc154910 con 0x7f26bc155f00 2023-11-28T16:57:14.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc1486c0 con 0x7f26bc1562e0 2023-11-28T16:57:14.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26c09b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc154300 con 0x7f26bc156770 2023-11-28T16:57:14.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26ba59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:14.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26ba59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50100/0 (socket says 172.21.15.26:50100) 2023-11-28T16:57:14.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26ba59c640 1 -- 172.21.15.26:0/841630503 learned_addr learned my addr 172.21.15.26:0/841630503 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:14.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.194+0000 7f26b3fff640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26bc1562e0 0x7f26bc147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:14.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26bad9d640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:14.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26ba59c640 1 -- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 msgr2=0x7f26bc148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:14.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26ba59c640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26ba59c640 1 -- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26bc1562e0 msgr2=0x7f26bc147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:14.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26ba59c640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26bc1562e0 0x7f26bc147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:14.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26ba59c640 1 -- 172.21.15.26:0/841630503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac0094d0 con 0x7f26bc155f00 2023-11-28T16:57:14.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26bad9d640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:14.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26ba59c640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0c5750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0ae040 tx=0x7f26bc1536c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:14.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26b2ffd640 1 -- 172.21.15.26:0/841630503 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0abe90 con 0x7f26bc155f00 2023-11-28T16:57:14.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26b2ffd640 1 -- 172.21.15.26:0/841630503 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac0b4440 con 0x7f26bc155f00 2023-11-28T16:57:14.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26b2ffd640 1 -- 172.21.15.26:0/841630503 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0b47d0 con 0x7f26bc155f00 2023-11-28T16:57:14.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc149d70 con 0x7f26bc155f00 2023-11-28T16:57:14.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc14a050 con 0x7f26bc155f00 2023-11-28T16:57:14.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc04e890 con 0x7f26bc155f00 2023-11-28T16:57:14.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26b2ffd640 1 -- 172.21.15.26:0/841630503 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f26ac0b2070 con 0x7f26bc155f00 2023-11-28T16:57:14.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26b2ffd640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f269c066900 0x7f269c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:14.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.198+0000 7f26b2ffd640 1 -- 172.21.15.26:0/841630503 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26ac11e1c0 con 0x7f26bc155f00 2023-11-28T16:57:14.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.202+0000 7f26b3fff640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f269c066900 0x7f269c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:14.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.202+0000 7f26b3fff640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f269c066900 0x7f269c068dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26bc14f130 tx=0x7f26a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:14.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.202+0000 7f26b2ffd640 1 -- 172.21.15.26:0/841630503 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26ac0eb3e0 con 0x7f26bc155f00 2023-11-28T16:57:14.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:14.362+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f26bc06b420 con 0x7f26bc155f00 2023-11-28T16:57:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26b2ffd640 1 -- 172.21.15.26:0/841630503 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v33) v1 ==== 140+0+0 (secure 0 0 0) 0x7f26ac0eea00 con 0x7f26bc155f00 2023-11-28T16:57:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_metadata' created 2023-11-28T16:57:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f269c066900 msgr2=0x7f269c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f269c066900 0x7f269c068dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26bc14f130 tx=0x7f26a4009190 comp rx=0 tx=0).stop 2023-11-28T16:57:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 msgr2=0x7f26bc0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0c5750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0ae040 tx=0x7f26bc1536c0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 shutdown_connections 2023-11-28T16:57:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f269c066900 0x7f269c068dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26bc156770 0x7f26bc148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26bc1562e0 0x7f26bc147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 --2- 172.21.15.26:0/841630503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26bc155f00 0x7f26bc0c5750 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 >> 172.21.15.26:0/841630503 conn(0x7f26bc06a5a0 msgr2=0x7f26bc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 shutdown_connections 2023-11-28T16:57:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.282+0000 7f26c09b8640 1 -- 172.21.15.26:0/841630503 wait complete. 2023-11-28T16:57:15.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T16:57:15.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 Processor -- start 2023-11-28T16:57:15.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 -- start start 2023-11-28T16:57:15.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb0151d80 0x7f5bb00c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:15.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bb00c8430 0x7f5bb006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5bb00c7f20 0x7f5bb006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb006cf70 con 0x7f5bb00c8430 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb0152160 con 0x7f5bb00c7f20 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.462+0000 7f5bb5a54640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00c6a30 con 0x7f5bb0151d80 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bb00c8430 0x7f5bb006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bb00c8430 0x7f5bb006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50110/0 (socket says 172.21.15.26:50110) 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 -- 172.21.15.26:0/230463842 learned_addr learned my addr 172.21.15.26:0/230463842 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5baf7fe640 1 --2- 172.21.15.26:0/230463842 >> v2:172.21.15.79:3300/0 conn(0x7f5bb00c7f20 0x7f5bb006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5baeffd640 1 --2- 172.21.15.26:0/230463842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb0151d80 0x7f5bb00c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 -- 172.21.15.26:0/230463842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb0151d80 msgr2=0x7f5bb00c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 --2- 172.21.15.26:0/230463842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb0151d80 0x7f5bb00c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 -- 172.21.15.26:0/230463842 >> v2:172.21.15.79:3300/0 conn(0x7f5bb00c7f20 msgr2=0x7f5bb006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 --2- 172.21.15.26:0/230463842 >> v2:172.21.15.79:3300/0 conn(0x7f5bb00c7f20 0x7f5bb006bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 -- 172.21.15.26:0/230463842 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00c72d0 con 0x7f5bb00c8430 2023-11-28T16:57:15.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5baf7fe640 1 --2- 172.21.15.26:0/230463842 >> v2:172.21.15.79:3300/0 conn(0x7f5bb00c7f20 0x7f5bb006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:15.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5bae7fc640 1 --2- 172.21.15.26:0/230463842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb00c8430 0x7f5bb006b720 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00bdb20 tx=0x7f5ba401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce90d846d48e3de6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5badffb640 1 -- 172.21.15.26:0/230463842 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40ab600 con 0x7f5bb00c8430 2023-11-28T16:57:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5badffb640 1 -- 172.21.15.26:0/230463842 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba40ab760 con 0x7f5bb00c8430 2023-11-28T16:57:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.466+0000 7f5badffb640 1 -- 172.21.15.26:0/230463842 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40abaf0 con 0x7f5bb00c8430 2023-11-28T16:57:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- 172.21.15.26:0/230463842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb00c8430 msgr2=0x7f5bb006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/230463842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb00c8430 0x7f5bb006b720 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00bdb20 tx=0x7f5ba401c440 comp rx=0 tx=0).stop 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- 172.21.15.26:0/230463842 shutdown_connections 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/230463842 >> v2:172.21.15.79:3300/0 conn(0x7f5bb00c7f20 0x7f5bb006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/230463842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb00c8430 0x7f5bb006b720 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/230463842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb0151d80 0x7f5bb00c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- 172.21.15.26:0/230463842 >> 172.21.15.26:0/230463842 conn(0x7f5bb00abd00 msgr2=0x7f5bb00ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- 172.21.15.26:0/230463842 shutdown_connections 2023-11-28T16:57:15.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- 172.21.15.26:0/230463842 wait complete. 2023-11-28T16:57:15.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 Processor -- start 2023-11-28T16:57:15.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- start start 2023-11-28T16:57:15.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb00c7f20 0x7f5bb014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bb00c8430 0x7f5bb0147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb0151d80 0x7f5bb0147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00c3fc0 con 0x7f5bb0151d80 2023-11-28T16:57:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01542f0 con 0x7f5bb00c8430 2023-11-28T16:57:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bb5a54640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0157640 con 0x7f5bb00c7f20 2023-11-28T16:57:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb0151d80 0x7f5bb0147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb0151d80 0x7f5bb0147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50116/0 (socket says 172.21.15.26:50116) 2023-11-28T16:57:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 -- 172.21.15.26:0/1644641859 learned_addr learned my addr 172.21.15.26:0/1644641859 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baeffd640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb00c7f20 0x7f5bb014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5bae7fc640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bb00c8430 0x7f5bb0147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 -- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb00c7f20 msgr2=0x7f5bb014a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb00c7f20 0x7f5bb014a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 -- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bb00c8430 msgr2=0x7f5bb0147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bb00c8430 0x7f5bb0147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baf7fe640 1 -- 172.21.15.26:0/1644641859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40094d0 con 0x7f5bb0151d80 2023-11-28T16:57:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.470+0000 7f5baeffd640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb00c7f20 0x7f5bb014a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.474+0000 7f5baf7fe640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb0151d80 0x7f5bb0147840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8007d60 tx=0x7f5ba800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:15.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.474+0000 7f5b97fff640 1 -- 172.21.15.26:0/1644641859 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80039a0 con 0x7f5bb0151d80 2023-11-28T16:57:15.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.474+0000 7f5b97fff640 1 -- 172.21.15.26:0/1644641859 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba800f040 con 0x7f5bb0151d80 2023-11-28T16:57:15.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.474+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb0157920 con 0x7f5bb0151d80 2023-11-28T16:57:15.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.474+0000 7f5b97fff640 1 -- 172.21.15.26:0/1644641859 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8003d40 con 0x7f5bb0151d80 2023-11-28T16:57:15.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.474+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb014ae50 con 0x7f5bb0151d80 2023-11-28T16:57:15.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.474+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb0157b10 con 0x7f5bb0151d80 2023-11-28T16:57:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.478+0000 7f5b97fff640 1 -- 172.21.15.26:0/1644641859 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5ba8004030 con 0x7f5bb0151d80 2023-11-28T16:57:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.478+0000 7f5b97fff640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b9c0668d0 0x7f5b9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.478+0000 7f5b97fff640 1 -- 172.21.15.26:0/1644641859 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f5ba8084cc0 con 0x7f5bb0151d80 2023-11-28T16:57:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.478+0000 7f5baeffd640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b9c0668d0 0x7f5b9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.478+0000 7f5baeffd640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b9c0668d0 0x7f5b9c068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000b9f0 tx=0x7f5ba0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.482+0000 7f5b97fff640 1 -- 172.21.15.26:0/1644641859 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ba8051d10 con 0x7f5bb0151d80 2023-11-28T16:57:15.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:15.638+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5bb01547d0 con 0x7f5bb0151d80 2023-11-28T16:57:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5b97fff640 1 -- 172.21.15.26:0/1644641859 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v34) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5bb01547d0 con 0x7f5bb0151d80 2023-11-28T16:57:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_data' created 2023-11-28T16:57:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b9c0668d0 msgr2=0x7f5b9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b9c0668d0 0x7f5b9c068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000b9f0 tx=0x7f5ba0008040 comp rx=0 tx=0).stop 2023-11-28T16:57:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb0151d80 msgr2=0x7f5bb0147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb0151d80 0x7f5bb0147840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8007d60 tx=0x7f5ba800d4a0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 shutdown_connections 2023-11-28T16:57:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb0151d80 0x7f5bb0147840 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bb00c8430 0x7f5bb0147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b9c0668d0 0x7f5b9c068d90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 --2- 172.21.15.26:0/1644641859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bb00c7f20 0x7f5bb014a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 >> 172.21.15.26:0/1644641859 conn(0x7f5bb00abd00 msgr2=0x7f5bb00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 shutdown_connections 2023-11-28T16:57:16.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.290+0000 7f5bb5a54640 1 -- 172.21.15.26:0/1644641859 wait complete. 2023-11-28T16:57:16.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-28T16:57:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.486+0000 7f01e87aa640 1 Processor -- start 2023-11-28T16:57:16.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.486+0000 7f01e87aa640 1 -- start start 2023-11-28T16:57:16.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e87aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01e0151ee0 0x7f01e0072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:16.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e87aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e00c1ae0 0x7f01e006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:16.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e87aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01e006aae0 0x7f01e00c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:16.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e87aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e0072870 con 0x7f01e006aae0 2023-11-28T16:57:16.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e87aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e01522c0 con 0x7f01e0151ee0 2023-11-28T16:57:16.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e87aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e0155040 con 0x7f01e00c1ae0 2023-11-28T16:57:16.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01e006aae0 0x7f01e00c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:16.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01e006aae0 0x7f01e00c09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50120/0 (socket says 172.21.15.26:50120) 2023-11-28T16:57:16.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 -- 172.21.15.26:0/1827961234 learned_addr learned my addr 172.21.15.26:0/1827961234 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:16.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6546640 1 --2- 172.21.15.26:0/1827961234 >> v2:172.21.15.79:3300/0 conn(0x7f01e0151ee0 0x7f01e0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:16.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e5d45640 1 --2- 172.21.15.26:0/1827961234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e00c1ae0 0x7f01e006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:16.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 -- 172.21.15.26:0/1827961234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e00c1ae0 msgr2=0x7f01e006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:16.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 --2- 172.21.15.26:0/1827961234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e00c1ae0 0x7f01e006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 -- 172.21.15.26:0/1827961234 >> v2:172.21.15.79:3300/0 conn(0x7f01e0151ee0 msgr2=0x7f01e0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:16.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 --2- 172.21.15.26:0/1827961234 >> v2:172.21.15.79:3300/0 conn(0x7f01e0151ee0 0x7f01e0072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.490+0000 7f01e6d47640 1 -- 172.21.15.26:0/1827961234 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e01555c0 con 0x7f01e006aae0 2023-11-28T16:57:16.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e6d47640 1 --2- 172.21.15.26:0/1827961234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e006aae0 0x7f01e00c09c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f01e006c5b0 tx=0x7f01d801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda749e46d2e1947 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:16.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e5544640 1 -- 172.21.15.26:0/1827961234 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80a5740 con 0x7f01e006aae0 2023-11-28T16:57:16.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e5544640 1 -- 172.21.15.26:0/1827961234 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80a58a0 con 0x7f01e006aae0 2023-11-28T16:57:16.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e5544640 1 -- 172.21.15.26:0/1827961234 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80a5c30 con 0x7f01e006aae0 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 -- 172.21.15.26:0/1827961234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e006aae0 msgr2=0x7f01e00c09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 --2- 172.21.15.26:0/1827961234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e006aae0 0x7f01e00c09c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f01e006c5b0 tx=0x7f01d801c940 comp rx=0 tx=0).stop 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 -- 172.21.15.26:0/1827961234 shutdown_connections 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 --2- 172.21.15.26:0/1827961234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e006aae0 0x7f01e00c09c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 --2- 172.21.15.26:0/1827961234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e00c1ae0 0x7f01e006a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 --2- 172.21.15.26:0/1827961234 >> v2:172.21.15.79:3300/0 conn(0x7f01e0151ee0 0x7f01e0072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 -- 172.21.15.26:0/1827961234 >> 172.21.15.26:0/1827961234 conn(0x7f01e00c3b70 msgr2=0x7f01e00c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:16.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 -- 172.21.15.26:0/1827961234 shutdown_connections 2023-11-28T16:57:16.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 -- 172.21.15.26:0/1827961234 wait complete. 2023-11-28T16:57:16.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 Processor -- start 2023-11-28T16:57:16.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.494+0000 7f01e87aa640 1 -- start start 2023-11-28T16:57:16.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e006aae0 0x7f01e00c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00c1ae0 0x7f01e00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e0151ee0 0x7f01e01f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00c57a0 con 0x7f01e0151ee0 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00a90e0 con 0x7f01e00c1ae0 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00a93c0 con 0x7f01e006aae0 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e0151ee0 0x7f01e01f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e0151ee0 0x7f01e01f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50132/0 (socket says 172.21.15.26:50132) 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 -- 172.21.15.26:0/4101231120 learned_addr learned my addr 172.21.15.26:0/4101231120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e5d45640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00c1ae0 0x7f01e00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:16.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 -- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e006aae0 msgr2=0x7f01e00c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e006aae0 0x7f01e00c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 -- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00c1ae0 msgr2=0x7f01e00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00c1ae0 0x7f01e00c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 -- 172.21.15.26:0/4101231120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d8009b30 con 0x7f01e0151ee0 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e5d45640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00c1ae0 0x7f01e00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e6d47640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e0151ee0 0x7f01e01f0800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f01d80af040 tx=0x7f01d80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01d6ffd640 1 -- 172.21.15.26:0/4101231120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80b8670 con 0x7f01e0151ee0 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01d6ffd640 1 -- 172.21.15.26:0/4101231120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80b87d0 con 0x7f01e0151ee0 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01d6ffd640 1 -- 172.21.15.26:0/4101231120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80b8b80 con 0x7f01e0151ee0 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e00a96a0 con 0x7f01e0151ee0 2023-11-28T16:57:16.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e00aa3c0 con 0x7f01e0151ee0 2023-11-28T16:57:16.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e004e890 con 0x7f01e0151ee0 2023-11-28T16:57:16.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.498+0000 7f01d6ffd640 1 -- 172.21.15.26:0/4101231120 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f01d80b8ce0 con 0x7f01e0151ee0 2023-11-28T16:57:16.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.502+0000 7f01d6ffd640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c4066900 0x7f01c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:16.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.502+0000 7f01d6ffd640 1 -- 172.21.15.26:0/4101231120 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f01d811fa00 con 0x7f01e0151ee0 2023-11-28T16:57:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.502+0000 7f01e6546640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c4066900 0x7f01c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.502+0000 7f01e6546640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c4066900 0x7f01c4068dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f01e0154e30 tx=0x7f01dc009480 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:16.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.506+0000 7f01d6ffd640 1 -- 172.21.15.26:0/4101231120 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01d80ecaa0 con 0x7f01e0151ee0 2023-11-28T16:57:16.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:16.694+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f01e00c58e0 con 0x7f01e0151ee0 2023-11-28T16:57:17.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01d6ffd640 1 -- 172.21.15.26:0/4101231120 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 175+0+0 (secure 0 0 0) 0x7f01e00c58e0 con 0x7f01e0151ee0 2023-11-28T16:57:17.300 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 6 and data pool 7 2023-11-28T16:57:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c4066900 msgr2=0x7f01c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c4066900 0x7f01c4068dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f01e0154e30 tx=0x7f01dc009480 comp rx=0 tx=0).stop 2023-11-28T16:57:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e0151ee0 msgr2=0x7f01e01f0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e0151ee0 0x7f01e01f0800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f01d80af040 tx=0x7f01d80196e0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 shutdown_connections 2023-11-28T16:57:17.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01e0151ee0 0x7f01e01f0800 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00c1ae0 0x7f01e00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c4066900 0x7f01c4068dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 --2- 172.21.15.26:0/4101231120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01e006aae0 0x7f01e00c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 >> 172.21.15.26:0/4101231120 conn(0x7f01e00c3b70 msgr2=0x7f01e014ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 shutdown_connections 2023-11-28T16:57:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.294+0000 7f01e87aa640 1 -- 172.21.15.26:0/4101231120 wait complete. 2023-11-28T16:57:17.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:17.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.470+0000 7f2a0999d640 1 Processor -- start 2023-11-28T16:57:17.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.470+0000 7f2a0999d640 1 -- start start 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f2a0999d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a04156500 0x7f2a0406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f2a0999d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a040c19e0 0x7f2a040c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f2a0999d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0406dec0 con 0x7f2a0414fcc0 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f2a0999d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a040aa340 con 0x7f2a04156500 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f2a0999d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a04156980 con 0x7f2a040c19e0 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f29fbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a04156500 0x7f2a0406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f29fbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a04156500 0x7f2a0406d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50148/0 (socket says 172.21.15.26:50148) 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f29fbfff640 1 -- 172.21.15.26:0/1145668555 learned_addr learned my addr 172.21.15.26:0/1145668555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f2a037fe640 1 --2- 172.21.15.26:0/1145668555 >> v2:172.21.15.79:3300/0 conn(0x7f2a040c19e0 0x7f2a040c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f29fbfff640 1 -- 172.21.15.26:0/1145668555 >> v2:172.21.15.79:3300/0 conn(0x7f2a040c19e0 msgr2=0x7f2a040c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:17.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f29fbfff640 1 --2- 172.21.15.26:0/1145668555 >> v2:172.21.15.79:3300/0 conn(0x7f2a040c19e0 0x7f2a040c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f29fbfff640 1 -- 172.21.15.26:0/1145668555 >> v1:172.21.15.79:6789/0 conn(0x7f2a0414fcc0 legacy=0x7f2a040aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.474+0000 7f29fbfff640 1 -- 172.21.15.26:0/1145668555 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040ab580 con 0x7f2a04156500 2023-11-28T16:57:17.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f29fbfff640 1 --2- 172.21.15.26:0/1145668555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a04156500 0x7f2a0406d980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2a040c3b30 tx=0x7f29ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb62c47c351b4ee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:17.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a027fc640 1 -- 172.21.15.26:0/1145668555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0ac640 con 0x7f2a04156500 2023-11-28T16:57:17.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a027fc640 1 -- 172.21.15.26:0/1145668555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec0ac7a0 con 0x7f2a04156500 2023-11-28T16:57:17.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a027fc640 1 -- 172.21.15.26:0/1145668555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0acb30 con 0x7f2a04156500 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 -- 172.21.15.26:0/1145668555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a04156500 msgr2=0x7f2a0406d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 --2- 172.21.15.26:0/1145668555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a04156500 0x7f2a0406d980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2a040c3b30 tx=0x7f29ec01c4d0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 -- 172.21.15.26:0/1145668555 shutdown_connections 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 --2- 172.21.15.26:0/1145668555 >> v2:172.21.15.79:3300/0 conn(0x7f2a040c19e0 0x7f2a040c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 --2- 172.21.15.26:0/1145668555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a04156500 0x7f2a0406d980 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 -- 172.21.15.26:0/1145668555 >> 172.21.15.26:0/1145668555 conn(0x7f2a040c2ad0 msgr2=0x7f2a040c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 -- 172.21.15.26:0/1145668555 shutdown_connections 2023-11-28T16:57:17.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 -- 172.21.15.26:0/1145668555 wait complete. 2023-11-28T16:57:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 Processor -- start 2023-11-28T16:57:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.478+0000 7f2a0999d640 1 -- start start 2023-11-28T16:57:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a040c19e0 0x7f2a041ebe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a04156500 0x7f2a041edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a041ec3b0 0x7f2a041ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a041eeab0 con 0x7f2a040c19e0 2023-11-28T16:57:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04153fb0 con 0x7f2a041ec3b0 2023-11-28T16:57:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04154290 con 0x7f2a04156500 2023-11-28T16:57:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a040c19e0 0x7f2a041ebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a040c19e0 0x7f2a041ebe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50152/0 (socket says 172.21.15.26:50152) 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 -- 172.21.15.26:0/205860399 learned_addr learned my addr 172.21.15.26:0/205860399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f29fbfff640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a04156500 0x7f2a041edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a037fe640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a041ec3b0 0x7f2a041ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 -- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a04156500 msgr2=0x7f2a041edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a04156500 0x7f2a041edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 -- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a041ec3b0 msgr2=0x7f2a041ee4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a041ec3b0 0x7f2a041ee4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 -- 172.21.15.26:0/205860399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0094d0 con 0x7f2a040c19e0 2023-11-28T16:57:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a02ffd640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a040c19e0 0x7f2a041ebe70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c500 tx=0x7f29f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a00ff9640 1 -- 172.21.15.26:0/205860399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4005220 con 0x7f2a040c19e0 2023-11-28T16:57:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a00ff9640 1 -- 172.21.15.26:0/205860399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4005380 con 0x7f2a040c19e0 2023-11-28T16:57:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a00ff9640 1 -- 172.21.15.26:0/205860399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4007270 con 0x7f2a040c19e0 2023-11-28T16:57:17.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a04154570 con 0x7f2a040c19e0 2023-11-28T16:57:17.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a04156d80 con 0x7f2a040c19e0 2023-11-28T16:57:17.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0404e890 con 0x7f2a040c19e0 2023-11-28T16:57:17.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.482+0000 7f2a00ff9640 1 -- 172.21.15.26:0/205860399 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f29f40073d0 con 0x7f2a040c19e0 2023-11-28T16:57:17.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.486+0000 7f2a00ff9640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29e40668d0 0x7f29e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.486+0000 7f2a00ff9640 1 -- 172.21.15.26:0/205860399 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f29f4083fb0 con 0x7f2a040c19e0 2023-11-28T16:57:17.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.486+0000 7f29fbfff640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29e40668d0 0x7f29e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.486+0000 7f29fbfff640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29e40668d0 0x7f29e4068d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0ae000 tx=0x7f29ec0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.490+0000 7f2a00ff9640 1 -- 172.21.15.26:0/205860399 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29f4050eb0 con 0x7f2a040c19e0 2023-11-28T16:57:17.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.646+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a0406ce10 con 0x7f2a040c19e0 2023-11-28T16:57:17.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.646+0000 7f2a00ff9640 1 -- 172.21.15.26:0/205860399 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f29f40544d0 con 0x7f2a040c19e0 2023-11-28T16:57:17.655 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:17.655 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":35,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:16.699446+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:17.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29e40668d0 msgr2=0x7f29e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29e40668d0 0x7f29e4068d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0ae000 tx=0x7f29ec0a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:17.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a040c19e0 msgr2=0x7f2a041ebe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a040c19e0 0x7f2a041ebe70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c500 tx=0x7f29f400c9c0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 shutdown_connections 2023-11-28T16:57:17.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a041ec3b0 0x7f2a041ee4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29e40668d0 0x7f29e4068d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a04156500 0x7f2a041edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 --2- 172.21.15.26:0/205860399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a040c19e0 0x7f2a041ebe70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 >> 172.21.15.26:0/205860399 conn(0x7f2a040c2ad0 msgr2=0x7f2a04151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:17.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 shutdown_connections 2023-11-28T16:57:17.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.650+0000 7f2a0999d640 1 -- 172.21.15.26:0/205860399 wait complete. 2023-11-28T16:57:17.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:17.727 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:57:17.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:57:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 Processor -- start 2023-11-28T16:57:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 -- start start 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bdc14fcc0 0x7f5bdc156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5bdc06d980 0x7f5bdc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0aa340 con 0x7f5bdc14fcc0 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc152fe0 con 0x7f5bdc06d980 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be4232640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc1532c0 con 0x7f5bdc0ab3b0 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be1fce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bdc14fcc0 0x7f5bdc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be1fce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bdc14fcc0 0x7f5bdc156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50154/0 (socket says 172.21.15.26:50154) 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be1fce640 1 -- 172.21.15.26:0/2056154445 learned_addr learned my addr 172.21.15.26:0/2056154445 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be17cd640 1 --2- 172.21.15.26:0/2056154445 >> v2:172.21.15.79:3300/0 conn(0x7f5bdc06d980 0x7f5bdc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.814+0000 7f5be27cf640 1 --2- 172.21.15.26:0/2056154445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be1fce640 1 -- 172.21.15.26:0/2056154445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 msgr2=0x7f5bdc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be1fce640 1 --2- 172.21.15.26:0/2056154445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be1fce640 1 -- 172.21.15.26:0/2056154445 >> v2:172.21.15.79:3300/0 conn(0x7f5bdc06d980 msgr2=0x7f5bdc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be1fce640 1 --2- 172.21.15.26:0/2056154445 >> v2:172.21.15.79:3300/0 conn(0x7f5bdc06d980 0x7f5bdc0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be1fce640 1 -- 172.21.15.26:0/2056154445 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc155a20 con 0x7f5bdc14fcc0 2023-11-28T16:57:17.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be1fce640 1 --2- 172.21.15.26:0/2056154445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc14fcc0 0x7f5bdc156500 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc06b4e0 tx=0x7f5bd801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374a8ef322b6748 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:17.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be0fcc640 1 -- 172.21.15.26:0/2056154445 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80aa5f0 con 0x7f5bdc14fcc0 2023-11-28T16:57:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be0fcc640 1 -- 172.21.15.26:0/2056154445 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd80aa750 con 0x7f5bdc14fcc0 2023-11-28T16:57:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.818+0000 7f5be0fcc640 1 -- 172.21.15.26:0/2056154445 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80aaae0 con 0x7f5bdc14fcc0 2023-11-28T16:57:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- 172.21.15.26:0/2056154445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc14fcc0 msgr2=0x7f5bdc156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 --2- 172.21.15.26:0/2056154445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc14fcc0 0x7f5bdc156500 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc06b4e0 tx=0x7f5bd801c4d0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- 172.21.15.26:0/2056154445 shutdown_connections 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 --2- 172.21.15.26:0/2056154445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 --2- 172.21.15.26:0/2056154445 >> v2:172.21.15.79:3300/0 conn(0x7f5bdc06d980 0x7f5bdc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 --2- 172.21.15.26:0/2056154445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc14fcc0 0x7f5bdc156500 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- 172.21.15.26:0/2056154445 >> 172.21.15.26:0/2056154445 conn(0x7f5bdc0c2ad0 msgr2=0x7f5bdc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- 172.21.15.26:0/2056154445 shutdown_connections 2023-11-28T16:57:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- 172.21.15.26:0/2056154445 wait complete. 2023-11-28T16:57:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 Processor -- start 2023-11-28T16:57:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- start start 2023-11-28T16:57:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bdc06d980 0x7f5bdc1e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc1ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc155590 0x7f5bdc0bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc15bd20 con 0x7f5bdc155590 2023-11-28T16:57:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc1ec9b0 con 0x7f5bdc06d980 2023-11-28T16:57:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be4232640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc15b9b0 con 0x7f5bdc0ab3b0 2023-11-28T16:57:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc155590 0x7f5bdc0bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc155590 0x7f5bdc0bd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50164/0 (socket says 172.21.15.26:50164) 2023-11-28T16:57:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 -- 172.21.15.26:0/780272714 learned_addr learned my addr 172.21.15.26:0/780272714 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be17cd640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc1ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be1fce640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bdc06d980 0x7f5bdc1e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 -- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 msgr2=0x7f5bdc1ebf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc1ebf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 -- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bdc06d980 msgr2=0x7f5bdc1e9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bdc06d980 0x7f5bdc1e9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 -- 172.21.15.26:0/780272714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80094d0 con 0x7f5bdc155590 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.822+0000 7f5be27cf640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc155590 0x7f5bdc0bd6a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400ef90 tx=0x7f5bd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5bd27fc640 1 -- 172.21.15.26:0/780272714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4009ca0 con 0x7f5bdc155590 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5bd27fc640 1 -- 172.21.15.26:0/780272714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd400f040 con 0x7f5bdc155590 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc154f20 con 0x7f5bdc155590 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5bd27fc640 1 -- 172.21.15.26:0/780272714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40146c0 con 0x7f5bdc155590 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc1ea340 con 0x7f5bdc155590 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc15bb80 con 0x7f5bdc155590 2023-11-28T16:57:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5bd27fc640 1 -- 172.21.15.26:0/780272714 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5bd4014820 con 0x7f5bdc155590 2023-11-28T16:57:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5bd27fc640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5bc00668d0 0x7f5bc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5bd27fc640 1 -- 172.21.15.26:0/780272714 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5bd40854f0 con 0x7f5bdc155590 2023-11-28T16:57:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.826+0000 7f5be1fce640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5bc00668d0 0x7f5bc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.830+0000 7f5be1fce640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5bc00668d0 0x7f5bc0068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80ae000 tx=0x7f5bd80b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.830+0000 7f5bd27fc640 1 -- 172.21.15.26:0/780272714 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5bdc15bb80 con 0x7f5bdc155590 2023-11-28T16:57:17.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.990+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bdc1550b0 con 0x7f5bdc155590 2023-11-28T16:57:17.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5bd27fc640 1 -- 172.21.15.26:0/780272714 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f5bd40524f0 con 0x7f5bdc155590 2023-11-28T16:57:17.999 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:17.999 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":35,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:16.699446+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5bc00668d0 msgr2=0x7f5bc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5bc00668d0 0x7f5bc0068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80ae000 tx=0x7f5bd80b5040 comp rx=0 tx=0).stop 2023-11-28T16:57:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc155590 msgr2=0x7f5bdc0bd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc155590 0x7f5bdc0bd6a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400ef90 tx=0x7f5bd400c490 comp rx=0 tx=0).stop 2023-11-28T16:57:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 shutdown_connections 2023-11-28T16:57:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bdc155590 0x7f5bdc0bd6a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5bc00668d0 0x7f5bc0068d90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bdc0ab3b0 0x7f5bdc1ebf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 --2- 172.21.15.26:0/780272714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bdc06d980 0x7f5bdc1e9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 >> 172.21.15.26:0/780272714 conn(0x7f5bdc0c2ad0 msgr2=0x7f5bdc0c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 shutdown_connections 2023-11-28T16:57:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:17.994+0000 7f5be4232640 1 -- 172.21.15.26:0/780272714 wait complete. 2023-11-28T16:57:18.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-28T16:57:18.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b2da32640 1 Processor -- start 2023-11-28T16:57:18.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b2da32640 1 -- start start 2023-11-28T16:57:18.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b2da32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b280c6220 0x7f5b28158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:18.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b2da32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b280c13a0 0x7f5b280c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b2da32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b28158580 con 0x7f5b28151bf0 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b2da32640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b28157f50 con 0x7f5b280c13a0 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b2da32640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b280c1f60 con 0x7f5b280c6220 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b267fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b280c13a0 0x7f5b280c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b267fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b280c13a0 0x7f5b280c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50178/0 (socket says 172.21.15.26:50178) 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b267fc640 1 -- 172.21.15.26:0/3728249182 learned_addr learned my addr 172.21.15.26:0/3728249182 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b26ffd640 1 --2- 172.21.15.26:0/3728249182 >> v2:172.21.15.79:3300/0 conn(0x7f5b280c6220 0x7f5b28158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b267fc640 1 -- 172.21.15.26:0/3728249182 >> v2:172.21.15.79:3300/0 conn(0x7f5b280c6220 msgr2=0x7f5b28158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b267fc640 1 --2- 172.21.15.26:0/3728249182 >> v2:172.21.15.79:3300/0 conn(0x7f5b280c6220 0x7f5b28158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b267fc640 1 -- 172.21.15.26:0/3728249182 >> v1:172.21.15.79:6789/0 conn(0x7f5b28151bf0 legacy=0x7f5b280a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:18.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.162+0000 7f5b267fc640 1 -- 172.21.15.26:0/3728249182 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280c2240 con 0x7f5b280c13a0 2023-11-28T16:57:18.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b267fc640 1 --2- 172.21.15.26:0/3728249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280c13a0 0x7f5b280c28c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5b2806b500 tx=0x7f5b1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3493e40ce11fa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:18.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b25ffb640 1 -- 172.21.15.26:0/3728249182 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0aa430 con 0x7f5b280c13a0 2023-11-28T16:57:18.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b25ffb640 1 -- 172.21.15.26:0/3728249182 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0aa590 con 0x7f5b280c13a0 2023-11-28T16:57:18.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b25ffb640 1 -- 172.21.15.26:0/3728249182 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0aa920 con 0x7f5b280c13a0 2023-11-28T16:57:18.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 -- 172.21.15.26:0/3728249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280c13a0 msgr2=0x7f5b280c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:18.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 --2- 172.21.15.26:0/3728249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280c13a0 0x7f5b280c28c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5b2806b500 tx=0x7f5b1c01c4d0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 -- 172.21.15.26:0/3728249182 shutdown_connections 2023-11-28T16:57:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 --2- 172.21.15.26:0/3728249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280c13a0 0x7f5b280c28c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 --2- 172.21.15.26:0/3728249182 >> v2:172.21.15.79:3300/0 conn(0x7f5b280c6220 0x7f5b28158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 -- 172.21.15.26:0/3728249182 >> 172.21.15.26:0/3728249182 conn(0x7f5b2806a5a0 msgr2=0x7f5b2806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 -- 172.21.15.26:0/3728249182 shutdown_connections 2023-11-28T16:57:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.166+0000 7f5b2da32640 1 -- 172.21.15.26:0/3728249182 wait complete. 2023-11-28T16:57:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 Processor -- start 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 -- start start 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b280c13a0 0x7f5b28146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b280c6220 0x7f5b28143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28151bf0 0x7f5b2806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b28147460 con 0x7f5b28151bf0 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2806b6b0 con 0x7f5b280c13a0 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2806bf50 con 0x7f5b280c6220 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28151bf0 0x7f5b2806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b26ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b280c13a0 0x7f5b28146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28151bf0 0x7f5b2806c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50186/0 (socket says 172.21.15.26:50186) 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 -- 172.21.15.26:0/164970836 learned_addr learned my addr 172.21.15.26:0/164970836 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b267fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b280c6220 0x7f5b28143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 -- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b280c6220 msgr2=0x7f5b28143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b280c6220 0x7f5b28143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 -- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b280c13a0 msgr2=0x7f5b28146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b280c13a0 0x7f5b28146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 -- 172.21.15.26:0/164970836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c009480 con 0x7f5b28151bf0 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b277fe640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28151bf0 0x7f5b2806c3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c7a0 tx=0x7f5b2000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b0ffff640 1 -- 172.21.15.26:0/164970836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20003b80 con 0x7f5b28151bf0 2023-11-28T16:57:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b0ffff640 1 -- 172.21.15.26:0/164970836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20003ce0 con 0x7f5b28151bf0 2023-11-28T16:57:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b281f1ff0 con 0x7f5b28151bf0 2023-11-28T16:57:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b0ffff640 1 -- 172.21.15.26:0/164970836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000aa90 con 0x7f5b28151bf0 2023-11-28T16:57:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2806bbe0 con 0x7f5b28151bf0 2023-11-28T16:57:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.170+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2804e890 con 0x7f5b28151bf0 2023-11-28T16:57:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.174+0000 7f5b0ffff640 1 -- 172.21.15.26:0/164970836 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5b2000abf0 con 0x7f5b28151bf0 2023-11-28T16:57:18.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.174+0000 7f5b0ffff640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b140668d0 0x7f5b14068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:18.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.174+0000 7f5b0ffff640 1 -- 172.21.15.26:0/164970836 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5b200844b0 con 0x7f5b28151bf0 2023-11-28T16:57:18.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.174+0000 7f5b26ffd640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b140668d0 0x7f5b14068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:18.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.174+0000 7f5b26ffd640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b140668d0 0x7f5b14068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b28067a60 tx=0x7f5b18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.178+0000 7f5b0ffff640 1 -- 172.21.15.26:0/164970836 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b20051430 con 0x7f5b28151bf0 2023-11-28T16:57:18.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:18.374+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5b2806c090 con 0x7f5b28151bf0 2023-11-28T16:57:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.317+0000 7f5b0ffff640 1 -- 172.21.15.26:0/164970836 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7f5b20054a50 con 0x7f5b28151bf0 2023-11-28T16:57:19.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b140668d0 msgr2=0x7f5b14068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:19.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b140668d0 0x7f5b14068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b28067a60 tx=0x7f5b18008040 comp rx=0 tx=0).stop 2023-11-28T16:57:19.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28151bf0 msgr2=0x7f5b2806c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28151bf0 0x7f5b2806c3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c7a0 tx=0x7f5b2000cc60 comp rx=0 tx=0).stop 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 shutdown_connections 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b28151bf0 0x7f5b2806c3e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5b140668d0 0x7f5b14068d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b280c6220 0x7f5b28143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 --2- 172.21.15.26:0/164970836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b280c13a0 0x7f5b28146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 >> 172.21.15.26:0/164970836 conn(0x7f5b2806a5a0 msgr2=0x7f5b280c3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 shutdown_connections 2023-11-28T16:57:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.321+0000 7f5b2da32640 1 -- 172.21.15.26:0/164970836 wait complete. 2023-11-28T16:57:19.351 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T16:57:19.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-28T16:57:19.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595edd8640 1 Processor -- start 2023-11-28T16:57:19.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595edd8640 1 -- start start 2023-11-28T16:57:19.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595edd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580c0370 0x7f595806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:19.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595edd8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59580a8470 0x7f595806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595edd8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595806de00 con 0x7f595814eaf0 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595edd8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5958070390 con 0x7f59580a8470 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595edd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595806db90 con 0x7f59580c0370 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595d375640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59580a8470 0x7f595806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595cb74640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f595814eaf0 0x7f5958151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52744/0 (socket says 172.21.15.26:52744) 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595cb74640 1 -- 172.21.15.26:0/2117954266 learned_addr learned my addr 172.21.15.26:0/2117954266 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f5957fff640 1 --2- 172.21.15.26:0/2117954266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580c0370 0x7f595806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595d375640 1 -- 172.21.15.26:0/2117954266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580c0370 msgr2=0x7f595806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595d375640 1 --2- 172.21.15.26:0/2117954266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580c0370 0x7f595806d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595d375640 1 -- 172.21.15.26:0/2117954266 >> v1:172.21.15.26:6789/0 conn(0x7f595814eaf0 legacy=0x7f5958151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:19.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.497+0000 7f595d375640 1 -- 172.21.15.26:0/2117954266 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595814eed0 con 0x7f59580a8470 2023-11-28T16:57:19.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595d375640 1 --2- 172.21.15.26:0/2117954266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580a8470 0x7f595806d650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5950009d90 tx=0x7f595001ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eea1eb87d7b15e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f59577fe640 1 -- 172.21.15.26:0/2117954266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500a7b30 con 0x7f59580a8470 2023-11-28T16:57:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f59577fe640 1 -- 172.21.15.26:0/2117954266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500a7c90 con 0x7f59580a8470 2023-11-28T16:57:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f59577fe640 1 -- 172.21.15.26:0/2117954266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500af440 con 0x7f59580a8470 2023-11-28T16:57:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 -- 172.21.15.26:0/2117954266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580a8470 msgr2=0x7f595806d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 --2- 172.21.15.26:0/2117954266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580a8470 0x7f595806d650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5950009d90 tx=0x7f595001ea40 comp rx=0 tx=0).stop 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 -- 172.21.15.26:0/2117954266 shutdown_connections 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 --2- 172.21.15.26:0/2117954266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580a8470 0x7f595806d650 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 --2- 172.21.15.26:0/2117954266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580c0370 0x7f595806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 -- 172.21.15.26:0/2117954266 >> 172.21.15.26:0/2117954266 conn(0x7f59580c2a60 msgr2=0x7f59580c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 -- 172.21.15.26:0/2117954266 shutdown_connections 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 -- 172.21.15.26:0/2117954266 wait complete. 2023-11-28T16:57:19.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 Processor -- start 2023-11-28T16:57:19.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.501+0000 7f595edd8640 1 -- start start 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580a8470 0x7f5958071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580c0370 0x7f5958149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595814eaf0 0x7f59581496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581f0710 con 0x7f59580c0370 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581f09f0 con 0x7f595814eaf0 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59581f0cd0 con 0x7f59580a8470 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580c0370 0x7f5958149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580c0370 0x7f5958149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50212/0 (socket says 172.21.15.26:50212) 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 -- 172.21.15.26:0/2622496897 learned_addr learned my addr 172.21.15.26:0/2622496897 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595d375640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595814eaf0 0x7f59581496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:19.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595cb74640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580a8470 0x7f5958071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 -- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580a8470 msgr2=0x7f5958071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580a8470 0x7f5958071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 -- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595814eaf0 msgr2=0x7f59581496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595814eaf0 0x7f59581496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 -- 172.21.15.26:0/2622496897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009a70 con 0x7f59580c0370 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595d375640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595814eaf0 0x7f59581496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595cb74640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580a8470 0x7f5958071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f5957fff640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580c0370 0x7f5958149180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f594400d7d0 tx=0x7f594400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f59557fa640 1 -- 172.21.15.26:0/2622496897 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594400b6c0 con 0x7f59580c0370 2023-11-28T16:57:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f59557fa640 1 -- 172.21.15.26:0/2622496897 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594400b820 con 0x7f59580c0370 2023-11-28T16:57:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f59557fa640 1 -- 172.21.15.26:0/2622496897 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594400bbd0 con 0x7f59580c0370 2023-11-28T16:57:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59581f0fb0 con 0x7f59580c0370 2023-11-28T16:57:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5958149c00 con 0x7f59580c0370 2023-11-28T16:57:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.505+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595804e890 con 0x7f59580c0370 2023-11-28T16:57:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.509+0000 7f59557fa640 1 -- 172.21.15.26:0/2622496897 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f594400bd30 con 0x7f59580c0370 2023-11-28T16:57:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.509+0000 7f59557fa640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f593c066900 0x7f593c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.509+0000 7f59557fa640 1 -- 172.21.15.26:0/2622496897 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5944084e50 con 0x7f59580c0370 2023-11-28T16:57:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.509+0000 7f595cb74640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f593c066900 0x7f593c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:19.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.509+0000 7f595cb74640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f593c066900 0x7f593c068dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f594c005890 tx=0x7f594c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.513+0000 7f59557fa640 1 -- 172.21.15.26:0/2622496897 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5944051c00 con 0x7f59580c0370 2023-11-28T16:57:19.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:19.705+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f595813dc70 con 0x7f59580c0370 2023-11-28T16:57:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f59557fa640 1 -- 172.21.15.26:0/2622496897 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5944055220 con 0x7f59580c0370 2023-11-28T16:57:20.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f593c066900 msgr2=0x7f593c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f593c066900 0x7f593c068dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f594c005890 tx=0x7f594c009040 comp rx=0 tx=0).stop 2023-11-28T16:57:20.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580c0370 msgr2=0x7f5958149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580c0370 0x7f5958149180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f594400d7d0 tx=0x7f594400dc90 comp rx=0 tx=0).stop 2023-11-28T16:57:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 shutdown_connections 2023-11-28T16:57:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595814eaf0 0x7f59581496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580c0370 0x7f5958149180 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f593c066900 0x7f593c068dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 --2- 172.21.15.26:0/2622496897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59580a8470 0x7f5958071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 >> 172.21.15.26:0/2622496897 conn(0x7f59580c2a60 msgr2=0x7f595806d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:20.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 shutdown_connections 2023-11-28T16:57:20.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.325+0000 7f595edd8640 1 -- 172.21.15.26:0/2622496897 wait complete. 2023-11-28T16:57:20.353 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-28T16:57:20.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:20.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.489+0000 7fc736f96640 1 Processor -- start 2023-11-28T16:57:20.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.489+0000 7fc736f96640 1 -- start start 2023-11-28T16:57:20.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc736f96640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc73014e9d0 0x7fc730151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc736f96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7300a8470 0x7fc73006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc736f96640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73006d320 con 0x7fc730070b80 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc736f96640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300721b0 con 0x7fc73014e9d0 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc736f96640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300c2830 con 0x7fc7300a8470 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc734d32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc73014e9d0 0x7fc730151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc72ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc730070b80 0x7fc7300c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52750/0 (socket says 172.21.15.26:52750) 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc734d32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc73014e9d0 0x7fc730151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50226/0 (socket says 172.21.15.26:50226) 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc72ffff640 1 -- 172.21.15.26:0/3684571238 learned_addr learned my addr 172.21.15.26:0/3684571238 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc735533640 1 --2- 172.21.15.26:0/3684571238 >> v2:172.21.15.79:3300/0 conn(0x7fc7300a8470 0x7fc73006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc734d32640 1 -- 172.21.15.26:0/3684571238 >> v2:172.21.15.79:3300/0 conn(0x7fc7300a8470 msgr2=0x7fc73006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc734d32640 1 --2- 172.21.15.26:0/3684571238 >> v2:172.21.15.79:3300/0 conn(0x7fc7300a8470 0x7fc73006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc734d32640 1 -- 172.21.15.26:0/3684571238 >> v1:172.21.15.26:6789/0 conn(0x7fc730070b80 legacy=0x7fc7300c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc734d32640 1 -- 172.21.15.26:0/3684571238 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730072450 con 0x7fc73014e9d0 2023-11-28T16:57:20.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.493+0000 7fc72f7fe640 1 -- 172.21.15.26:0/3684571238 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164341823 0 0) 0x7fc73006d320 con 0x7fc730070b80 2023-11-28T16:57:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc734d32640 1 --2- 172.21.15.26:0/3684571238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc73014e9d0 0x7fc730151e60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc7300c3b30 tx=0x7fc72401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5ddd9087845026 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc72f7fe640 1 -- 172.21.15.26:0/3684571238 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240ab600 con 0x7fc73014e9d0 2023-11-28T16:57:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc72f7fe640 1 -- 172.21.15.26:0/3684571238 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7240a7050 con 0x7fc73014e9d0 2023-11-28T16:57:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc72f7fe640 1 -- 172.21.15.26:0/3684571238 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240ab980 con 0x7fc73014e9d0 2023-11-28T16:57:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 -- 172.21.15.26:0/3684571238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc73014e9d0 msgr2=0x7fc730151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 --2- 172.21.15.26:0/3684571238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc73014e9d0 0x7fc730151e60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc7300c3b30 tx=0x7fc72401c3b0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 -- 172.21.15.26:0/3684571238 shutdown_connections 2023-11-28T16:57:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 --2- 172.21.15.26:0/3684571238 >> v2:172.21.15.79:3300/0 conn(0x7fc7300a8470 0x7fc73006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 --2- 172.21.15.26:0/3684571238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc73014e9d0 0x7fc730151e60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 -- 172.21.15.26:0/3684571238 >> 172.21.15.26:0/3684571238 conn(0x7fc7300c2ad0 msgr2=0x7fc7300c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 -- 172.21.15.26:0/3684571238 shutdown_connections 2023-11-28T16:57:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 -- 172.21.15.26:0/3684571238 wait complete. 2023-11-28T16:57:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 Processor -- start 2023-11-28T16:57:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.497+0000 7fc736f96640 1 -- start start 2023-11-28T16:57:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc730070b80 0x7fc7300ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7300a8470 0x7fc7301f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc73014e9d0 0x7fc73014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301551a0 con 0x7fc730070b80 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301edc90 con 0x7fc73014e9d0 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300ac100 con 0x7fc7300a8470 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc730070b80 0x7fc7300ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc730070b80 0x7fc7300ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50236/0 (socket says 172.21.15.26:50236) 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 -- 172.21.15.26:0/799462192 learned_addr learned my addr 172.21.15.26:0/799462192 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc72ffff640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7300a8470 0x7fc7301f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc735533640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc73014e9d0 0x7fc73014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 -- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7300a8470 msgr2=0x7fc7301f07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7300a8470 0x7fc7301f07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 -- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc73014e9d0 msgr2=0x7fc73014b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc73014e9d0 0x7fc73014b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 -- 172.21.15.26:0/799462192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009420 con 0x7fc730070b80 2023-11-28T16:57:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc72ffff640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7300a8470 0x7fc7301f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc734d32640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc730070b80 0x7fc7300ab450 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc7240ae040 tx=0x7fc72401abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc72d7fa640 1 -- 172.21.15.26:0/799462192 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240b7450 con 0x7fc730070b80 2023-11-28T16:57:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc72d7fa640 1 -- 172.21.15.26:0/799462192 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7240b75b0 con 0x7fc730070b80 2023-11-28T16:57:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc72d7fa640 1 -- 172.21.15.26:0/799462192 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240b7960 con 0x7fc730070b80 2023-11-28T16:57:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7301f1220 con 0x7fc730070b80 2023-11-28T16:57:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7300abc80 con 0x7fc730070b80 2023-11-28T16:57:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.501+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73004e890 con 0x7fc730070b80 2023-11-28T16:57:20.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.505+0000 7fc72d7fa640 1 -- 172.21.15.26:0/799462192 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7240b7ac0 con 0x7fc730070b80 2023-11-28T16:57:20.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.505+0000 7fc72d7fa640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7140668d0 0x7fc714068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.505+0000 7fc72d7fa640 1 -- 172.21.15.26:0/799462192 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc72411eec0 con 0x7fc730070b80 2023-11-28T16:57:20.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.505+0000 7fc72ffff640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7140668d0 0x7fc714068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.505+0000 7fc72ffff640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7140668d0 0x7fc714068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc71c007fd0 tx=0x7fc71c007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:20.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.509+0000 7fc72d7fa640 1 -- 172.21.15.26:0/799462192 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7240ebd90 con 0x7fc730070b80 2023-11-28T16:57:20.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.697+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc73015b600 con 0x7fc730070b80 2023-11-28T16:57:20.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.697+0000 7fc72d7fa640 1 -- 172.21.15.26:0/799462192 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6127 (secure 0 0 0) 0x7fc7240b0090 con 0x7fc730070b80 2023-11-28T16:57:20.707 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:20.707 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:03.255028+0000","modified":"2023-11-28T16:57:06.275664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4984":{"gid":4984,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/756252810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":756252810},{"type":"v1","addr":"172.21.15.26:6835","nonce":756252810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2023-11-28T16:57:20.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7140668d0 msgr2=0x7fc714068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7140668d0 0x7fc714068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc71c007fd0 tx=0x7fc71c007c20 comp rx=0 tx=0).stop 2023-11-28T16:57:20.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc730070b80 msgr2=0x7fc7300ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc730070b80 0x7fc7300ab450 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc7240ae040 tx=0x7fc72401abf0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 shutdown_connections 2023-11-28T16:57:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc73014e9d0 0x7fc73014b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7140668d0 0x7fc714068d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7300a8470 0x7fc7301f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 --2- 172.21.15.26:0/799462192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc730070b80 0x7fc7300ab450 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 >> 172.21.15.26:0/799462192 conn(0x7fc7300c2ad0 msgr2=0x7fc73006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:20.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 shutdown_connections 2023-11-28T16:57:20.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.701+0000 7fc736f96640 1 -- 172.21.15.26:0/799462192 wait complete. 2023-11-28T16:57:20.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 Processor -- start 2023-11-28T16:57:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 -- start start 2023-11-28T16:57:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ba4070b80 0x7f3ba40c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ba40c1f20 0x7f3ba406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba406d320 con 0x7f3ba4070b80 2023-11-28T16:57:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40721b0 con 0x7f3ba40c1f20 2023-11-28T16:57:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3bab009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c2830 con 0x7f3ba414e9d0 2023-11-28T16:57:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ba4070b80 0x7f3ba40c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ba4070b80 0x7f3ba40c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50250/0 (socket says 172.21.15.26:50250) 2023-11-28T16:57:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 -- 172.21.15.26:0/4243626083 learned_addr learned my addr 172.21.15.26:0/4243626083 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba8da5640 1 --2- 172.21.15.26:0/4243626083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba95a6640 1 --2- 172.21.15.26:0/4243626083 >> v2:172.21.15.79:3300/0 conn(0x7f3ba40c1f20 0x7f3ba406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 -- 172.21.15.26:0/4243626083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 msgr2=0x7f3ba4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/4243626083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 -- 172.21.15.26:0/4243626083 >> v2:172.21.15.79:3300/0 conn(0x7f3ba40c1f20 msgr2=0x7f3ba406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/4243626083 >> v2:172.21.15.79:3300/0 conn(0x7f3ba40c1f20 0x7f3ba406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.865+0000 7f3ba3fff640 1 -- 172.21.15.26:0/4243626083 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4072450 con 0x7f3ba4070b80 2023-11-28T16:57:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/4243626083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c19e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40704f0 tx=0x7f3b9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429264daa7ee418b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3ba37fe640 1 -- 172.21.15.26:0/4243626083 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900ab600 con 0x7f3ba4070b80 2023-11-28T16:57:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3ba37fe640 1 -- 172.21.15.26:0/4243626083 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900a7050 con 0x7f3ba4070b80 2023-11-28T16:57:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3ba37fe640 1 -- 172.21.15.26:0/4243626083 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900ab980 con 0x7f3ba4070b80 2023-11-28T16:57:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 -- 172.21.15.26:0/4243626083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 msgr2=0x7f3ba40c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 --2- 172.21.15.26:0/4243626083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c19e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40704f0 tx=0x7f3b9001c470 comp rx=0 tx=0).stop 2023-11-28T16:57:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 -- 172.21.15.26:0/4243626083 shutdown_connections 2023-11-28T16:57:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 --2- 172.21.15.26:0/4243626083 >> v2:172.21.15.79:3300/0 conn(0x7f3ba40c1f20 0x7f3ba406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 --2- 172.21.15.26:0/4243626083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c19e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 --2- 172.21.15.26:0/4243626083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 -- 172.21.15.26:0/4243626083 >> 172.21.15.26:0/4243626083 conn(0x7f3ba40c2ad0 msgr2=0x7f3ba40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 -- 172.21.15.26:0/4243626083 shutdown_connections 2023-11-28T16:57:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.869+0000 7f3bab009640 1 -- 172.21.15.26:0/4243626083 wait complete. 2023-11-28T16:57:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 Processor -- start 2023-11-28T16:57:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 -- start start 2023-11-28T16:57:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ba40c1f20 0x7f3ba4153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c4270 con 0x7f3ba4070b80 2023-11-28T16:57:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c5d70 con 0x7f3ba40c1f20 2023-11-28T16:57:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c3cf0 con 0x7f3ba414e9d0 2023-11-28T16:57:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50254/0 (socket says 172.21.15.26:50254) 2023-11-28T16:57:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 -- 172.21.15.26:0/3646514267 learned_addr learned my addr 172.21.15.26:0/3646514267 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ba40c1f20 0x7f3ba4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba95a6640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 -- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 msgr2=0x7f3ba4142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 -- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ba40c1f20 msgr2=0x7f3ba4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ba40c1f20 0x7f3ba4153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 -- 172.21.15.26:0/3646514267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900094d0 con 0x7f3ba4070b80 2023-11-28T16:57:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba95a6640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba8da5640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c5790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800e870 tx=0x7f3b9800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba17fa640 1 -- 172.21.15.26:0/3646514267 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98009510 con 0x7f3ba4070b80 2023-11-28T16:57:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba17fa640 1 -- 172.21.15.26:0/3646514267 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800eec0 con 0x7f3ba4070b80 2023-11-28T16:57:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3ba17fa640 1 -- 172.21.15.26:0/3646514267 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800cb40 con 0x7f3ba4070b80 2023-11-28T16:57:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba4147660 con 0x7f3ba4070b80 2023-11-28T16:57:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.873+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba40c3f90 con 0x7f3ba4070b80 2023-11-28T16:57:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.877+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba404e890 con 0x7f3ba4070b80 2023-11-28T16:57:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.877+0000 7f3ba17fa640 1 -- 172.21.15.26:0/3646514267 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3b9800cca0 con 0x7f3ba4070b80 2023-11-28T16:57:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.877+0000 7f3ba17fa640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3b880668d0 0x7f3b88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.877+0000 7f3ba17fa640 1 -- 172.21.15.26:0/3646514267 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3b98084bd0 con 0x7f3ba4070b80 2023-11-28T16:57:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.877+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3b880668d0 0x7f3b88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.877+0000 7f3ba3fff640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3b880668d0 0x7f3b88068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406e350 tx=0x7f3b90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:20.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:20.881+0000 7f3ba17fa640 1 -- 172.21.15.26:0/3646514267 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b98051b60 con 0x7f3ba4070b80 2023-11-28T16:57:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba41477f0 con 0x7f3ba4070b80 2023-11-28T16:57:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3ba17fa640 1 -- 172.21.15.26:0/3646514267 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20157 (secure 0 0 0) 0x7f3ba41477f0 con 0x7f3ba4070b80 2023-11-28T16:57:21.048 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:21.048 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:18.259952+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3b880668d0 msgr2=0x7f3b88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3b880668d0 0x7f3b88068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406e350 tx=0x7f3b90008040 comp rx=0 tx=0).stop 2023-11-28T16:57:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 msgr2=0x7f3ba40c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c5790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800e870 tx=0x7f3b9800ec70 comp rx=0 tx=0).stop 2023-11-28T16:57:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 shutdown_connections 2023-11-28T16:57:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3b880668d0 0x7f3b88068d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ba414e9d0 0x7f3ba4142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ba40c1f20 0x7f3ba4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 --2- 172.21.15.26:0/3646514267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ba4070b80 0x7f3ba40c5790 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.041+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 >> 172.21.15.26:0/3646514267 conn(0x7f3ba40c2ad0 msgr2=0x7f3ba40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.045+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 shutdown_connections 2023-11-28T16:57:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.045+0000 7f3bab009640 1 -- 172.21.15.26:0/3646514267 wait complete. 2023-11-28T16:57:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T16:57:21.070 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:57:21.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.205+0000 7f28e209c640 1 Processor -- start 2023-11-28T16:57:21.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.205+0000 7f28e209c640 1 -- start start 2023-11-28T16:57:21.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.205+0000 7f28e209c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc14e9d0 0x7f28dc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28e209c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc06d320 con 0x7f28dc070b80 2023-11-28T16:57:21.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28e209c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc0721b0 con 0x7f28dc0a8470 2023-11-28T16:57:21.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28e209c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c2830 con 0x7f28dc14e9d0 2023-11-28T16:57:21.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28daffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f28dc070b80 0x7f28dc0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52752/0 (socket says 172.21.15.26:52752) 2023-11-28T16:57:21.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28daffd640 1 -- 172.21.15.26:0/565865134 learned_addr learned my addr 172.21.15.26:0/565865134 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:21.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28db7fe640 1 --2- 172.21.15.26:0/565865134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc14e9d0 0x7f28dc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28da7fc640 1 -- 172.21.15.26:0/565865134 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374697550 0 0) 0x7f28dc06d320 con 0x7f28dc070b80 2023-11-28T16:57:21.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28da7fc640 1 -- 172.21.15.26:0/565865134 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c4003530 con 0x7f28dc070b80 2023-11-28T16:57:21.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28da7fc640 1 -- 172.21.15.26:0/565865134 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137509842 0 0) 0x7f28dc0721b0 con 0x7f28dc0a8470 2023-11-28T16:57:21.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28da7fc640 1 -- 172.21.15.26:0/565865134 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28dc06d320 con 0x7f28dc0a8470 2023-11-28T16:57:21.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28db7fe640 1 -- 172.21.15.26:0/565865134 >> v1:172.21.15.79:6789/0 conn(0x7f28dc0a8470 legacy=0x7f28dc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28db7fe640 1 -- 172.21.15.26:0/565865134 >> v1:172.21.15.26:6789/0 conn(0x7f28dc070b80 legacy=0x7f28dc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.209+0000 7f28db7fe640 1 -- 172.21.15.26:0/565865134 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc072450 con 0x7f28dc14e9d0 2023-11-28T16:57:21.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28db7fe640 1 --2- 172.21.15.26:0/565865134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc14e9d0 0x7f28dc151e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0097f0 tx=0x7f28cc01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57746975d9d6a28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:21.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28da7fc640 1 -- 172.21.15.26:0/565865134 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0ab600 con 0x7f28dc14e9d0 2023-11-28T16:57:21.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28da7fc640 1 -- 172.21.15.26:0/565865134 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0a7050 con 0x7f28dc14e9d0 2023-11-28T16:57:21.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28da7fc640 1 -- 172.21.15.26:0/565865134 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0ab980 con 0x7f28dc14e9d0 2023-11-28T16:57:21.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- 172.21.15.26:0/565865134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc14e9d0 msgr2=0x7f28dc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 --2- 172.21.15.26:0/565865134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc14e9d0 0x7f28dc151e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0097f0 tx=0x7f28cc01c430 comp rx=0 tx=0).stop 2023-11-28T16:57:21.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- 172.21.15.26:0/565865134 shutdown_connections 2023-11-28T16:57:21.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 --2- 172.21.15.26:0/565865134 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc14e9d0 0x7f28dc151e60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- 172.21.15.26:0/565865134 >> 172.21.15.26:0/565865134 conn(0x7f28dc0c2ad0 msgr2=0x7f28dc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:21.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- 172.21.15.26:0/565865134 shutdown_connections 2023-11-28T16:57:21.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- 172.21.15.26:0/565865134 wait complete. 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 Processor -- start 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- start start 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc070b80 0x7f28dc14a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc0a8470 0x7f28dc0c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc14e9d0 0x7f28dc0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c4c00 con 0x7f28dc070b80 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1ec020 con 0x7f28dc14e9d0 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.213+0000 7f28e209c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0abfe0 con 0x7f28dc0a8470 2023-11-28T16:57:21.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc070b80 0x7f28dc14a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc070b80 0x7f28dc14a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50266/0 (socket says 172.21.15.26:50266) 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 -- 172.21.15.26:0/424210472 learned_addr learned my addr 172.21.15.26:0/424210472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28dbfff640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc14e9d0 0x7f28dc0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28daffd640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc0a8470 0x7f28dc0c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 -- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc0a8470 msgr2=0x7f28dc0c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc0a8470 0x7f28dc0c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 -- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc14e9d0 msgr2=0x7f28dc0c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc14e9d0 0x7f28dc0c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 -- 172.21.15.26:0/424210472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009420 con 0x7f28dc070b80 2023-11-28T16:57:21.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28dbfff640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc14e9d0 0x7f28dc0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:21.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28db7fe640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc070b80 0x7f28dc14a2a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28cc019040 tx=0x7f28cc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:21.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28c3fff640 1 -- 172.21.15.26:0/424210472 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0b7450 con 0x7f28dc070b80 2023-11-28T16:57:21.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28c3fff640 1 -- 172.21.15.26:0/424210472 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0b75d0 con 0x7f28dc070b80 2023-11-28T16:57:21.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc0c5aa0 con 0x7f28dc070b80 2023-11-28T16:57:21.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28c3fff640 1 -- 172.21.15.26:0/424210472 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0b7980 con 0x7f28dc070b80 2023-11-28T16:57:21.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc0c4540 con 0x7f28dc070b80 2023-11-28T16:57:21.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc04e890 con 0x7f28dc070b80 2023-11-28T16:57:21.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.217+0000 7f28c3fff640 1 -- 172.21.15.26:0/424210472 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f28cc0b7ae0 con 0x7f28dc070b80 2023-11-28T16:57:21.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.221+0000 7f28c3fff640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28c80668d0 0x7f28c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.221+0000 7f28c3fff640 1 -- 172.21.15.26:0/424210472 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f28cc11eda0 con 0x7f28dc070b80 2023-11-28T16:57:21.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.221+0000 7f28daffd640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28c80668d0 0x7f28c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.221+0000 7f28daffd640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28c80668d0 0x7f28c8068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f28dc1ef170 tx=0x7f28d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:21.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.225+0000 7f28c3fff640 1 -- 172.21.15.26:0/424210472 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28cc0ebc70 con 0x7f28dc070b80 2023-11-28T16:57:21.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.377+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28dc0a9150 con 0x7f28c80668d0 2023-11-28T16:57:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.393+0000 7f28c3fff640 1 -- 172.21.15.26:0/424210472 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+512836 (secure 0 0 0) 0x7f28dc0a9150 con 0x7f28c80668d0 2023-11-28T16:57:21.403 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:57:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28c80668d0 msgr2=0x7f28c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28c80668d0 0x7f28c8068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f28dc1ef170 tx=0x7f28d0009040 comp rx=0 tx=0).stop 2023-11-28T16:57:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc070b80 msgr2=0x7f28dc14a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc070b80 0x7f28dc14a2a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28cc019040 tx=0x7f28cc01ac70 comp rx=0 tx=0).stop 2023-11-28T16:57:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 shutdown_connections 2023-11-28T16:57:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc14e9d0 0x7f28dc0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f28c80668d0 0x7f28c8068d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28dc0a8470 0x7f28dc0c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 --2- 172.21.15.26:0/424210472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc070b80 0x7f28dc14a2a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 >> 172.21.15.26:0/424210472 conn(0x7f28dc0c2ad0 msgr2=0x7f28dc0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:21.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 shutdown_connections 2023-11-28T16:57:21.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.397+0000 7f28e209c640 1 -- 172.21.15.26:0/424210472 wait complete. 2023-11-28T16:57:21.423 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-28T16:57:19.587749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236868,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737852,"statfs":{"total":773094113280,"available":772851560448,"internally_reserved":0,"allocated":4136960,"data_stored":2303882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.295555"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:03.876501+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:57:03.876501+0000","last_peered":"2023-11-28T16:57:03.876501+0000","last_clean":"2023-11-28T16:57:03.876501+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:57:03.876501+0000","last_undegraded":"2023-11-28T16:57:03.876501+0000","last_fullsized":"2023-11-28T16:57:03.876501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599541+0000","last_change":"2023-11-28T16:57:02.889062+0000","last_active":"2023-11-28T16:57:04.599541+0000","last_peered":"2023-11-28T16:57:04.599541+0000","last_clean":"2023-11-28T16:57:04.599541+0000","last_became_active":"2023-11-28T16:57:02.888650+0000","last_became_peered":"2023-11-28T16:57:02.888650+0000","last_unstale":"2023-11-28T16:57:04.599541+0000","last_undegraded":"2023-11-28T16:57:04.599541+0000","last_fullsized":"2023-11-28T16:57:04.599541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903259+0000","last_change":"2023-11-28T16:57:03.886837+0000","last_active":"2023-11-28T16:57:04.903259+0000","last_peered":"2023-11-28T16:57:04.903259+0000","last_clean":"2023-11-28T16:57:04.903259+0000","last_became_active":"2023-11-28T16:57:03.886378+0000","last_became_peered":"2023-11-28T16:57:03.886378+0000","last_unstale":"2023-11-28T16:57:04.903259+0000","last_undegraded":"2023-11-28T16:57:04.903259+0000","last_fullsized":"2023-11-28T16:57:04.903259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:14.424053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.596701+0000","last_change":"2023-11-28T16:57:02.889684+0000","last_active":"2023-11-28T16:57:04.596701+0000","last_peered":"2023-11-28T16:57:04.596701+0000","last_clean":"2023-11-28T16:57:04.596701+0000","last_became_active":"2023-11-28T16:57:02.889040+0000","last_became_peered":"2023-11-28T16:57:02.889040+0000","last_unstale":"2023-11-28T16:57:04.596701+0000","last_undegraded":"2023-11-28T16:57:04.596701+0000","last_fullsized":"2023-11-28T16:57:04.596701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.887984+0000","last_change":"2023-11-28T16:57:03.888974+0000","last_active":"2023-11-28T16:57:04.887984+0000","last_peered":"2023-11-28T16:57:04.887984+0000","last_clean":"2023-11-28T16:57:04.887984+0000","last_became_active":"2023-11-28T16:57:03.888693+0000","last_became_peered":"2023-11-28T16:57:03.888693+0000","last_unstale":"2023-11-28T16:57:04.887984+0000","last_undegraded":"2023-11-28T16:57:04.887984+0000","last_fullsized":"2023-11-28T16:57:04.887984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599152+0000","last_change":"2023-11-28T16:57:02.880973+0000","last_active":"2023-11-28T16:57:04.599152+0000","last_peered":"2023-11-28T16:57:04.599152+0000","last_clean":"2023-11-28T16:57:04.599152+0000","last_became_active":"2023-11-28T16:57:02.880470+0000","last_became_peered":"2023-11-28T16:57:02.880470+0000","last_unstale":"2023-11-28T16:57:04.599152+0000","last_undegraded":"2023-11-28T16:57:04.599152+0000","last_fullsized":"2023-11-28T16:57:04.599152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:14.363778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.883504+0000","last_change":"2023-11-28T16:57:03.881044+0000","last_active":"2023-11-28T16:57:04.883504+0000","last_peered":"2023-11-28T16:57:04.883504+0000","last_clean":"2023-11-28T16:57:04.883504+0000","last_became_active":"2023-11-28T16:57:03.880727+0000","last_became_peered":"2023-11-28T16:57:03.880727+0000","last_unstale":"2023-11-28T16:57:04.883504+0000","last_undegraded":"2023-11-28T16:57:04.883504+0000","last_fullsized":"2023-11-28T16:57:04.883504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:45.769525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.597008+0000","last_change":"2023-11-28T16:57:02.881583+0000","last_active":"2023-11-28T16:57:04.597008+0000","last_peered":"2023-11-28T16:57:04.597008+0000","last_clean":"2023-11-28T16:57:04.597008+0000","last_became_active":"2023-11-28T16:57:02.880399+0000","last_became_peered":"2023-11-28T16:57:02.880399+0000","last_unstale":"2023-11-28T16:57:04.597008+0000","last_undegraded":"2023-11-28T16:57:04.597008+0000","last_fullsized":"2023-11-28T16:57:04.597008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.885021+0000","last_change":"2023-11-28T16:57:03.898729+0000","last_active":"2023-11-28T16:57:04.885021+0000","last_peered":"2023-11-28T16:57:04.885021+0000","last_clean":"2023-11-28T16:57:04.885021+0000","last_became_active":"2023-11-28T16:57:03.898497+0000","last_became_peered":"2023-11-28T16:57:03.898497+0000","last_unstale":"2023-11-28T16:57:04.885021+0000","last_undegraded":"2023-11-28T16:57:04.885021+0000","last_fullsized":"2023-11-28T16:57:04.885021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.598261+0000","last_change":"2023-11-28T16:57:02.883158+0000","last_active":"2023-11-28T16:57:04.598261+0000","last_peered":"2023-11-28T16:57:04.598261+0000","last_clean":"2023-11-28T16:57:04.598261+0000","last_became_active":"2023-11-28T16:57:02.882770+0000","last_became_peered":"2023-11-28T16:57:02.882770+0000","last_unstale":"2023-11-28T16:57:04.598261+0000","last_undegraded":"2023-11-28T16:57:04.598261+0000","last_fullsized":"2023-11-28T16:57:04.598261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902800+0000","last_change":"2023-11-28T16:57:03.892153+0000","last_active":"2023-11-28T16:57:04.902800+0000","last_peered":"2023-11-28T16:57:04.902800+0000","last_clean":"2023-11-28T16:57:04.902800+0000","last_became_active":"2023-11-28T16:57:03.891822+0000","last_became_peered":"2023-11-28T16:57:03.891822+0000","last_unstale":"2023-11-28T16:57:04.902800+0000","last_undegraded":"2023-11-28T16:57:04.902800+0000","last_fullsized":"2023-11-28T16:57:04.902800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.597062+0000","last_change":"2023-11-28T16:57:02.890748+0000","last_active":"2023-11-28T16:57:04.597062+0000","last_peered":"2023-11-28T16:57:04.597062+0000","last_clean":"2023-11-28T16:57:04.597062+0000","last_became_active":"2023-11-28T16:57:02.890463+0000","last_became_peered":"2023-11-28T16:57:02.890463+0000","last_unstale":"2023-11-28T16:57:04.597062+0000","last_undegraded":"2023-11-28T16:57:04.597062+0000","last_fullsized":"2023-11-28T16:57:04.597062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.885022+0000","last_change":"2023-11-28T16:57:03.876059+0000","last_active":"2023-11-28T16:57:04.885022+0000","last_peered":"2023-11-28T16:57:04.885022+0000","last_clean":"2023-11-28T16:57:04.885022+0000","last_became_active":"2023-11-28T16:57:03.875768+0000","last_became_peered":"2023-11-28T16:57:03.875768+0000","last_unstale":"2023-11-28T16:57:04.885022+0000","last_undegraded":"2023-11-28T16:57:04.885022+0000","last_fullsized":"2023-11-28T16:57:04.885022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.885261+0000","last_change":"2023-11-28T16:57:02.886351+0000","last_active":"2023-11-28T16:57:04.885261+0000","last_peered":"2023-11-28T16:57:04.885261+0000","last_clean":"2023-11-28T16:57:04.885261+0000","last_became_active":"2023-11-28T16:57:02.886028+0000","last_became_peered":"2023-11-28T16:57:02.886028+0000","last_unstale":"2023-11-28T16:57:04.885261+0000","last_undegraded":"2023-11-28T16:57:04.885261+0000","last_fullsized":"2023-11-28T16:57:04.885261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:14.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904369+0000","last_change":"2023-11-28T16:57:03.904348+0000","last_active":"2023-11-28T16:57:04.904369+0000","last_peered":"2023-11-28T16:57:04.904369+0000","last_clean":"2023-11-28T16:57:04.904369+0000","last_became_active":"2023-11-28T16:57:03.904090+0000","last_became_peered":"2023-11-28T16:57:03.904090+0000","last_unstale":"2023-11-28T16:57:04.904369+0000","last_undegraded":"2023-11-28T16:57:04.904369+0000","last_fullsized":"2023-11-28T16:57:04.904369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:40:05.723124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.597154+0000","last_change":"2023-11-28T16:57:02.888301+0000","last_active":"2023-11-28T16:57:04.597154+0000","last_peered":"2023-11-28T16:57:04.597154+0000","last_clean":"2023-11-28T16:57:04.597154+0000","last_became_active":"2023-11-28T16:57:02.887892+0000","last_became_peered":"2023-11-28T16:57:02.887892+0000","last_unstale":"2023-11-28T16:57:04.597154+0000","last_undegraded":"2023-11-28T16:57:04.597154+0000","last_fullsized":"2023-11-28T16:57:04.597154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902014+0000","last_change":"2023-11-28T16:57:03.892095+0000","last_active":"2023-11-28T16:57:04.902014+0000","last_peered":"2023-11-28T16:57:04.902014+0000","last_clean":"2023-11-28T16:57:04.902014+0000","last_became_active":"2023-11-28T16:57:03.891745+0000","last_became_peered":"2023-11-28T16:57:03.891745+0000","last_unstale":"2023-11-28T16:57:04.902014+0000","last_undegraded":"2023-11-28T16:57:04.902014+0000","last_fullsized":"2023-11-28T16:57:04.902014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:39:05.732024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.600102+0000","last_change":"2023-11-28T16:57:02.890124+0000","last_active":"2023-11-28T16:57:04.600102+0000","last_peered":"2023-11-28T16:57:04.600102+0000","last_clean":"2023-11-28T16:57:04.600102+0000","last_became_active":"2023-11-28T16:57:02.889786+0000","last_became_peered":"2023-11-28T16:57:02.889786+0000","last_unstale":"2023-11-28T16:57:04.600102+0000","last_undegraded":"2023-11-28T16:57:04.600102+0000","last_fullsized":"2023-11-28T16:57:04.600102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:46.580531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903176+0000","last_change":"2023-11-28T16:57:03.896853+0000","last_active":"2023-11-28T16:57:04.903176+0000","last_peered":"2023-11-28T16:57:04.903176+0000","last_clean":"2023-11-28T16:57:04.903176+0000","last_became_active":"2023-11-28T16:57:03.896447+0000","last_became_peered":"2023-11-28T16:57:03.896447+0000","last_unstale":"2023-11-28T16:57:04.903176+0000","last_undegraded":"2023-11-28T16:57:04.903176+0000","last_fullsized":"2023-11-28T16:57:04.903176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:22.391277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599134+0000","last_change":"2023-11-28T16:57:02.887552+0000","last_active":"2023-11-28T16:57:04.599134+0000","last_peered":"2023-11-28T16:57:04.599134+0000","last_clean":"2023-11-28T16:57:04.599134+0000","last_became_active":"2023-11-28T16:57:02.887319+0000","last_became_peered":"2023-11-28T16:57:02.887319+0000","last_unstale":"2023-11-28T16:57:04.599134+0000","last_undegraded":"2023-11-28T16:57:04.599134+0000","last_fullsized":"2023-11-28T16:57:04.599134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:29:38.468989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901000+0000","last_change":"2023-11-28T16:57:03.896248+0000","last_active":"2023-11-28T16:57:04.901000+0000","last_peered":"2023-11-28T16:57:04.901000+0000","last_clean":"2023-11-28T16:57:04.901000+0000","last_became_active":"2023-11-28T16:57:03.895989+0000","last_became_peered":"2023-11-28T16:57:03.895989+0000","last_unstale":"2023-11-28T16:57:04.901000+0000","last_undegraded":"2023-11-28T16:57:04.901000+0000","last_fullsized":"2023-11-28T16:57:04.901000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:07:32.729943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599530+0000","last_change":"2023-11-28T16:57:02.889539+0000","last_active":"2023-11-28T16:57:04.599530+0000","last_peered":"2023-11-28T16:57:04.599530+0000","last_clean":"2023-11-28T16:57:04.599530+0000","last_became_active":"2023-11-28T16:57:02.889270+0000","last_became_peered":"2023-11-28T16:57:02.889270+0000","last_unstale":"2023-11-28T16:57:04.599530+0000","last_undegraded":"2023-11-28T16:57:04.599530+0000","last_fullsized":"2023-11-28T16:57:04.599530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901847+0000","last_change":"2023-11-28T16:57:03.887058+0000","last_active":"2023-11-28T16:57:04.901847+0000","last_peered":"2023-11-28T16:57:04.901847+0000","last_clean":"2023-11-28T16:57:04.901847+0000","last_became_active":"2023-11-28T16:57:03.886373+0000","last_became_peered":"2023-11-28T16:57:03.886373+0000","last_unstale":"2023-11-28T16:57:04.901847+0000","last_undegraded":"2023-11-28T16:57:04.901847+0000","last_fullsized":"2023-11-28T16:57:04.901847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:17:34.242546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.598252+0000","last_change":"2023-11-28T16:57:02.887769+0000","last_active":"2023-11-28T16:57:04.598252+0000","last_peered":"2023-11-28T16:57:04.598252+0000","last_clean":"2023-11-28T16:57:04.598252+0000","last_became_active":"2023-11-28T16:57:02.887489+0000","last_became_peered":"2023-11-28T16:57:02.887489+0000","last_unstale":"2023-11-28T16:57:04.598252+0000","last_undegraded":"2023-11-28T16:57:04.598252+0000","last_fullsized":"2023-11-28T16:57:04.598252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901229+0000","last_change":"2023-11-28T16:57:03.892487+0000","last_active":"2023-11-28T16:57:04.901229+0000","last_peered":"2023-11-28T16:57:04.901229+0000","last_clean":"2023-11-28T16:57:04.901229+0000","last_became_active":"2023-11-28T16:57:03.892192+0000","last_became_peered":"2023-11-28T16:57:03.892192+0000","last_unstale":"2023-11-28T16:57:04.901229+0000","last_undegraded":"2023-11-28T16:57:04.901229+0000","last_fullsized":"2023-11-28T16:57:04.901229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:56.812246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599309+0000","last_change":"2023-11-28T16:57:02.890920+0000","last_active":"2023-11-28T16:57:04.599309+0000","last_peered":"2023-11-28T16:57:04.599309+0000","last_clean":"2023-11-28T16:57:04.599309+0000","last_became_active":"2023-11-28T16:57:02.890605+0000","last_became_peered":"2023-11-28T16:57:02.890605+0000","last_unstale":"2023-11-28T16:57:04.599309+0000","last_undegraded":"2023-11-28T16:57:04.599309+0000","last_fullsized":"2023-11-28T16:57:04.599309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:39.061444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901980+0000","last_change":"2023-11-28T16:57:03.903216+0000","last_active":"2023-11-28T16:57:04.901980+0000","last_peered":"2023-11-28T16:57:04.901980+0000","last_clean":"2023-11-28T16:57:04.901980+0000","last_became_active":"2023-11-28T16:57:03.901859+0000","last_became_peered":"2023-11-28T16:57:03.901859+0000","last_unstale":"2023-11-28T16:57:04.901980+0000","last_undegraded":"2023-11-28T16:57:04.901980+0000","last_fullsized":"2023-11-28T16:57:04.901980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:15.370198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599329+0000","last_change":"2023-11-28T16:57:02.892637+0000","last_active":"2023-11-28T16:57:04.599329+0000","last_peered":"2023-11-28T16:57:04.599329+0000","last_clean":"2023-11-28T16:57:04.599329+0000","last_became_active":"2023-11-28T16:57:02.892297+0000","last_became_peered":"2023-11-28T16:57:02.892297+0000","last_unstale":"2023-11-28T16:57:04.599329+0000","last_undegraded":"2023-11-28T16:57:04.599329+0000","last_fullsized":"2023-11-28T16:57:04.599329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:56.815063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901459+0000","last_change":"2023-11-28T16:57:03.881542+0000","last_active":"2023-11-28T16:57:04.901459+0000","last_peered":"2023-11-28T16:57:04.901459+0000","last_clean":"2023-11-28T16:57:04.901459+0000","last_became_active":"2023-11-28T16:57:03.880853+0000","last_became_peered":"2023-11-28T16:57:03.880853+0000","last_unstale":"2023-11-28T16:57:04.901459+0000","last_undegraded":"2023-11-28T16:57:04.901459+0000","last_fullsized":"2023-11-28T16:57:04.901459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599370+0000","last_change":"2023-11-28T16:57:02.884158+0000","last_active":"2023-11-28T16:57:04.599370+0000","last_peered":"2023-11-28T16:57:04.599370+0000","last_clean":"2023-11-28T16:57:04.599370+0000","last_became_active":"2023-11-28T16:57:02.883646+0000","last_became_peered":"2023-11-28T16:57:02.883646+0000","last_unstale":"2023-11-28T16:57:04.599370+0000","last_undegraded":"2023-11-28T16:57:04.599370+0000","last_fullsized":"2023-11-28T16:57:04.599370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904329+0000","last_change":"2023-11-28T16:57:03.893627+0000","last_active":"2023-11-28T16:57:04.904329+0000","last_peered":"2023-11-28T16:57:04.904329+0000","last_clean":"2023-11-28T16:57:04.904329+0000","last_became_active":"2023-11-28T16:57:03.893378+0000","last_became_peered":"2023-11-28T16:57:03.893378+0000","last_unstale":"2023-11-28T16:57:04.904329+0000","last_undegraded":"2023-11-28T16:57:04.904329+0000","last_fullsized":"2023-11-28T16:57:04.904329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:22.391277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.597144+0000","last_change":"2023-11-28T16:57:02.897594+0000","last_active":"2023-11-28T16:57:04.597144+0000","last_peered":"2023-11-28T16:57:04.597144+0000","last_clean":"2023-11-28T16:57:04.597144+0000","last_became_active":"2023-11-28T16:57:02.897292+0000","last_became_peered":"2023-11-28T16:57:02.897292+0000","last_unstale":"2023-11-28T16:57:04.597144+0000","last_undegraded":"2023-11-28T16:57:04.597144+0000","last_fullsized":"2023-11-28T16:57:04.597144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.887951+0000","last_change":"2023-11-28T16:57:03.890656+0000","last_active":"2023-11-28T16:57:04.887951+0000","last_peered":"2023-11-28T16:57:04.887951+0000","last_clean":"2023-11-28T16:57:04.887951+0000","last_became_active":"2023-11-28T16:57:03.890368+0000","last_became_peered":"2023-11-28T16:57:03.890368+0000","last_unstale":"2023-11-28T16:57:04.887951+0000","last_undegraded":"2023-11-28T16:57:04.887951+0000","last_fullsized":"2023-11-28T16:57:04.887951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.596710+0000","last_change":"2023-11-28T16:57:02.874480+0000","last_active":"2023-11-28T16:57:04.596710+0000","last_peered":"2023-11-28T16:57:04.596710+0000","last_clean":"2023-11-28T16:57:04.596710+0000","last_became_active":"2023-11-28T16:57:02.874163+0000","last_became_peered":"2023-11-28T16:57:02.874163+0000","last_unstale":"2023-11-28T16:57:04.596710+0000","last_undegraded":"2023-11-28T16:57:04.596710+0000","last_fullsized":"2023-11-28T16:57:04.596710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:47.038335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902856+0000","last_change":"2023-11-28T16:57:03.898409+0000","last_active":"2023-11-28T16:57:04.902856+0000","last_peered":"2023-11-28T16:57:04.902856+0000","last_clean":"2023-11-28T16:57:04.902856+0000","last_became_active":"2023-11-28T16:57:03.895873+0000","last_became_peered":"2023-11-28T16:57:03.895873+0000","last_unstale":"2023-11-28T16:57:04.902856+0000","last_undegraded":"2023-11-28T16:57:04.902856+0000","last_fullsized":"2023-11-28T16:57:04.902856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.596720+0000","last_change":"2023-11-28T16:57:02.892486+0000","last_active":"2023-11-28T16:57:04.596720+0000","last_peered":"2023-11-28T16:57:04.596720+0000","last_clean":"2023-11-28T16:57:04.596720+0000","last_became_active":"2023-11-28T16:57:02.892124+0000","last_became_peered":"2023-11-28T16:57:02.892124+0000","last_unstale":"2023-11-28T16:57:04.596720+0000","last_undegraded":"2023-11-28T16:57:04.596720+0000","last_fullsized":"2023-11-28T16:57:04.596720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902951+0000","last_change":"2023-11-28T16:57:03.887179+0000","last_active":"2023-11-28T16:57:04.902951+0000","last_peered":"2023-11-28T16:57:04.902951+0000","last_clean":"2023-11-28T16:57:04.902951+0000","last_became_active":"2023-11-28T16:57:03.886667+0000","last_became_peered":"2023-11-28T16:57:03.886667+0000","last_unstale":"2023-11-28T16:57:04.902951+0000","last_undegraded":"2023-11-28T16:57:04.902951+0000","last_fullsized":"2023-11-28T16:57:04.902951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:53.206562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.596987+0000","last_change":"2023-11-28T16:57:02.881775+0000","last_active":"2023-11-28T16:57:04.596987+0000","last_peered":"2023-11-28T16:57:04.596987+0000","last_clean":"2023-11-28T16:57:04.596987+0000","last_became_active":"2023-11-28T16:57:02.881350+0000","last_became_peered":"2023-11-28T16:57:02.881350+0000","last_unstale":"2023-11-28T16:57:04.596987+0000","last_undegraded":"2023-11-28T16:57:04.596987+0000","last_fullsized":"2023-11-28T16:57:04.596987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:41.579988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884249+0000","last_change":"2023-11-28T16:57:03.887114+0000","last_active":"2023-11-28T16:57:04.884249+0000","last_peered":"2023-11-28T16:57:04.884249+0000","last_clean":"2023-11-28T16:57:04.884249+0000","last_became_active":"2023-11-28T16:57:03.886543+0000","last_became_peered":"2023-11-28T16:57:03.886543+0000","last_unstale":"2023-11-28T16:57:04.884249+0000","last_undegraded":"2023-11-28T16:57:04.884249+0000","last_fullsized":"2023-11-28T16:57:04.884249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:22.391277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599271+0000","last_change":"2023-11-28T16:57:02.882053+0000","last_active":"2023-11-28T16:57:04.599271+0000","last_peered":"2023-11-28T16:57:04.599271+0000","last_clean":"2023-11-28T16:57:04.599271+0000","last_became_active":"2023-11-28T16:57:02.879776+0000","last_became_peered":"2023-11-28T16:57:02.879776+0000","last_unstale":"2023-11-28T16:57:04.599271+0000","last_undegraded":"2023-11-28T16:57:04.599271+0000","last_fullsized":"2023-11-28T16:57:04.599271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:20.111131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.900918+0000","last_change":"2023-11-28T16:57:03.886262+0000","last_active":"2023-11-28T16:57:04.900918+0000","last_peered":"2023-11-28T16:57:04.900918+0000","last_clean":"2023-11-28T16:57:04.900918+0000","last_became_active":"2023-11-28T16:57:03.886052+0000","last_became_peered":"2023-11-28T16:57:03.886052+0000","last_unstale":"2023-11-28T16:57:04.900918+0000","last_undegraded":"2023-11-28T16:57:04.900918+0000","last_fullsized":"2023-11-28T16:57:04.900918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:11.042126+0000","last_change":"2023-11-28T16:57:02.896876+0000","last_active":"2023-11-28T16:57:11.042126+0000","last_peered":"2023-11-28T16:57:11.042126+0000","last_clean":"2023-11-28T16:57:11.042126+0000","last_became_active":"2023-11-28T16:57:02.896650+0000","last_became_peered":"2023-11-28T16:57:02.896650+0000","last_unstale":"2023-11-28T16:57:11.042126+0000","last_undegraded":"2023-11-28T16:57:11.042126+0000","last_fullsized":"2023-11-28T16:57:11.042126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:45.191786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904036+0000","last_change":"2023-11-28T16:57:03.905651+0000","last_active":"2023-11-28T16:57:04.904036+0000","last_peered":"2023-11-28T16:57:04.904036+0000","last_clean":"2023-11-28T16:57:04.904036+0000","last_became_active":"2023-11-28T16:57:03.904887+0000","last_became_peered":"2023-11-28T16:57:03.904887+0000","last_unstale":"2023-11-28T16:57:04.904036+0000","last_undegraded":"2023-11-28T16:57:04.904036+0000","last_fullsized":"2023-11-28T16:57:04.904036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.600184+0000","last_change":"2023-11-28T16:57:02.890396+0000","last_active":"2023-11-28T16:57:04.600184+0000","last_peered":"2023-11-28T16:57:04.600184+0000","last_clean":"2023-11-28T16:57:04.600184+0000","last_became_active":"2023-11-28T16:57:02.890068+0000","last_became_peered":"2023-11-28T16:57:02.890068+0000","last_unstale":"2023-11-28T16:57:04.600184+0000","last_undegraded":"2023-11-28T16:57:04.600184+0000","last_fullsized":"2023-11-28T16:57:04.600184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.117385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884425+0000","last_change":"2023-11-28T16:57:03.889206+0000","last_active":"2023-11-28T16:57:04.884425+0000","last_peered":"2023-11-28T16:57:04.884425+0000","last_clean":"2023-11-28T16:57:04.884425+0000","last_became_active":"2023-11-28T16:57:03.888907+0000","last_became_peered":"2023-11-28T16:57:03.888907+0000","last_unstale":"2023-11-28T16:57:04.884425+0000","last_undegraded":"2023-11-28T16:57:04.884425+0000","last_fullsized":"2023-11-28T16:57:04.884425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:14.424053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.598305+0000","last_change":"2023-11-28T16:57:02.881277+0000","last_active":"2023-11-28T16:57:04.598305+0000","last_peered":"2023-11-28T16:57:04.598305+0000","last_clean":"2023-11-28T16:57:04.598305+0000","last_became_active":"2023-11-28T16:57:02.881004+0000","last_became_peered":"2023-11-28T16:57:02.881004+0000","last_unstale":"2023-11-28T16:57:04.598305+0000","last_undegraded":"2023-11-28T16:57:04.598305+0000","last_fullsized":"2023-11-28T16:57:04.598305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884368+0000","last_change":"2023-11-28T16:57:03.904109+0000","last_active":"2023-11-28T16:57:04.884368+0000","last_peered":"2023-11-28T16:57:04.884368+0000","last_clean":"2023-11-28T16:57:04.884368+0000","last_became_active":"2023-11-28T16:57:03.903816+0000","last_became_peered":"2023-11-28T16:57:03.903816+0000","last_unstale":"2023-11-28T16:57:04.884368+0000","last_undegraded":"2023-11-28T16:57:04.884368+0000","last_fullsized":"2023-11-28T16:57:04.884368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:40:05.723124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.596842+0000","last_change":"2023-11-28T16:57:02.893953+0000","last_active":"2023-11-28T16:57:04.596842+0000","last_peered":"2023-11-28T16:57:04.596842+0000","last_clean":"2023-11-28T16:57:04.596842+0000","last_became_active":"2023-11-28T16:57:02.892987+0000","last_became_peered":"2023-11-28T16:57:02.892987+0000","last_unstale":"2023-11-28T16:57:04.596842+0000","last_undegraded":"2023-11-28T16:57:04.596842+0000","last_fullsized":"2023-11-28T16:57:04.596842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:08.372872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904220+0000","last_change":"2023-11-28T16:57:03.912991+0000","last_active":"2023-11-28T16:57:04.904220+0000","last_peered":"2023-11-28T16:57:04.904220+0000","last_clean":"2023-11-28T16:57:04.904220+0000","last_became_active":"2023-11-28T16:57:03.912733+0000","last_became_peered":"2023-11-28T16:57:03.912733+0000","last_unstale":"2023-11-28T16:57:04.904220+0000","last_undegraded":"2023-11-28T16:57:04.904220+0000","last_fullsized":"2023-11-28T16:57:04.904220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:53.206562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599094+0000","last_change":"2023-11-28T16:57:02.883963+0000","last_active":"2023-11-28T16:57:04.599094+0000","last_peered":"2023-11-28T16:57:04.599094+0000","last_clean":"2023-11-28T16:57:04.599094+0000","last_became_active":"2023-11-28T16:57:02.883629+0000","last_became_peered":"2023-11-28T16:57:02.883629+0000","last_unstale":"2023-11-28T16:57:04.599094+0000","last_undegraded":"2023-11-28T16:57:04.599094+0000","last_fullsized":"2023-11-28T16:57:04.599094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:00.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.900862+0000","last_change":"2023-11-28T16:57:03.902695+0000","last_active":"2023-11-28T16:57:04.900862+0000","last_peered":"2023-11-28T16:57:04.900862+0000","last_clean":"2023-11-28T16:57:04.900862+0000","last_became_active":"2023-11-28T16:57:03.902147+0000","last_became_peered":"2023-11-28T16:57:03.902147+0000","last_unstale":"2023-11-28T16:57:04.900862+0000","last_undegraded":"2023-11-28T16:57:04.900862+0000","last_fullsized":"2023-11-28T16:57:04.900862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.596730+0000","last_change":"2023-11-28T16:57:02.887000+0000","last_active":"2023-11-28T16:57:04.596730+0000","last_peered":"2023-11-28T16:57:04.596730+0000","last_clean":"2023-11-28T16:57:04.596730+0000","last_became_active":"2023-11-28T16:57:02.886730+0000","last_became_peered":"2023-11-28T16:57:02.886730+0000","last_unstale":"2023-11-28T16:57:04.596730+0000","last_undegraded":"2023-11-28T16:57:04.596730+0000","last_fullsized":"2023-11-28T16:57:04.596730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.887833+0000","last_change":"2023-11-28T16:57:03.892365+0000","last_active":"2023-11-28T16:57:04.887833+0000","last_peered":"2023-11-28T16:57:04.887833+0000","last_clean":"2023-11-28T16:57:04.887833+0000","last_became_active":"2023-11-28T16:57:03.892096+0000","last_became_peered":"2023-11-28T16:57:03.892096+0000","last_unstale":"2023-11-28T16:57:04.887833+0000","last_undegraded":"2023-11-28T16:57:04.887833+0000","last_fullsized":"2023-11-28T16:57:04.887833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599189+0000","last_change":"2023-11-28T16:57:02.884058+0000","last_active":"2023-11-28T16:57:04.599189+0000","last_peered":"2023-11-28T16:57:04.599189+0000","last_clean":"2023-11-28T16:57:04.599189+0000","last_became_active":"2023-11-28T16:57:02.883737+0000","last_became_peered":"2023-11-28T16:57:02.883737+0000","last_unstale":"2023-11-28T16:57:04.599189+0000","last_undegraded":"2023-11-28T16:57:04.599189+0000","last_fullsized":"2023-11-28T16:57:04.599189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:17:33.236125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904162+0000","last_change":"2023-11-28T16:57:03.889038+0000","last_active":"2023-11-28T16:57:04.904162+0000","last_peered":"2023-11-28T16:57:04.904162+0000","last_clean":"2023-11-28T16:57:04.904162+0000","last_became_active":"2023-11-28T16:57:03.888749+0000","last_became_peered":"2023-11-28T16:57:03.888749+0000","last_unstale":"2023-11-28T16:57:04.904162+0000","last_undegraded":"2023-11-28T16:57:04.904162+0000","last_fullsized":"2023-11-28T16:57:04.904162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:45.769525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599251+0000","last_change":"2023-11-28T16:57:02.883245+0000","last_active":"2023-11-28T16:57:04.599251+0000","last_peered":"2023-11-28T16:57:04.599251+0000","last_clean":"2023-11-28T16:57:04.599251+0000","last_became_active":"2023-11-28T16:57:02.882929+0000","last_became_peered":"2023-11-28T16:57:02.882929+0000","last_unstale":"2023-11-28T16:57:04.599251+0000","last_undegraded":"2023-11-28T16:57:04.599251+0000","last_fullsized":"2023-11-28T16:57:04.599251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:57:59.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903209+0000","last_change":"2023-11-28T16:57:03.897702+0000","last_active":"2023-11-28T16:57:04.903209+0000","last_peered":"2023-11-28T16:57:04.903209+0000","last_clean":"2023-11-28T16:57:04.903209+0000","last_became_active":"2023-11-28T16:57:03.895461+0000","last_became_peered":"2023-11-28T16:57:03.895461+0000","last_unstale":"2023-11-28T16:57:04.903209+0000","last_undegraded":"2023-11-28T16:57:04.903209+0000","last_fullsized":"2023-11-28T16:57:04.903209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:40:05.723124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.607390+0000","last_change":"2023-11-28T16:57:02.893416+0000","last_active":"2023-11-28T16:57:04.607390+0000","last_peered":"2023-11-28T16:57:04.607390+0000","last_clean":"2023-11-28T16:57:04.607390+0000","last_became_active":"2023-11-28T16:57:02.892837+0000","last_became_peered":"2023-11-28T16:57:02.892837+0000","last_unstale":"2023-11-28T16:57:04.607390+0000","last_undegraded":"2023-11-28T16:57:04.607390+0000","last_fullsized":"2023-11-28T16:57:04.607390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:35.400319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901658+0000","last_change":"2023-11-28T16:57:03.899996+0000","last_active":"2023-11-28T16:57:04.901658+0000","last_peered":"2023-11-28T16:57:04.901658+0000","last_clean":"2023-11-28T16:57:04.901658+0000","last_became_active":"2023-11-28T16:57:03.899369+0000","last_became_peered":"2023-11-28T16:57:03.899369+0000","last_unstale":"2023-11-28T16:57:04.901658+0000","last_undegraded":"2023-11-28T16:57:04.901658+0000","last_fullsized":"2023-11-28T16:57:04.901658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:46.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.596800+0000","last_change":"2023-11-28T16:57:02.895629+0000","last_active":"2023-11-28T16:57:04.596800+0000","last_peered":"2023-11-28T16:57:04.596800+0000","last_clean":"2023-11-28T16:57:04.596800+0000","last_became_active":"2023-11-28T16:57:02.895339+0000","last_became_peered":"2023-11-28T16:57:02.895339+0000","last_unstale":"2023-11-28T16:57:04.596800+0000","last_undegraded":"2023-11-28T16:57:04.596800+0000","last_fullsized":"2023-11-28T16:57:04.596800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:22.670983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.888394+0000","last_change":"2023-11-28T16:57:03.898573+0000","last_active":"2023-11-28T16:57:04.888394+0000","last_peered":"2023-11-28T16:57:04.888394+0000","last_clean":"2023-11-28T16:57:04.888394+0000","last_became_active":"2023-11-28T16:57:03.898275+0000","last_became_peered":"2023-11-28T16:57:03.898275+0000","last_unstale":"2023-11-28T16:57:04.888394+0000","last_undegraded":"2023-11-28T16:57:04.888394+0000","last_fullsized":"2023-11-28T16:57:04.888394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.598288+0000","last_change":"2023-11-28T16:57:02.878046+0000","last_active":"2023-11-28T16:57:04.598288+0000","last_peered":"2023-11-28T16:57:04.598288+0000","last_clean":"2023-11-28T16:57:04.598288+0000","last_became_active":"2023-11-28T16:57:02.877719+0000","last_became_peered":"2023-11-28T16:57:02.877719+0000","last_unstale":"2023-11-28T16:57:04.598288+0000","last_undegraded":"2023-11-28T16:57:04.598288+0000","last_fullsized":"2023-11-28T16:57:04.598288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902975+0000","last_change":"2023-11-28T16:57:03.891242+0000","last_active":"2023-11-28T16:57:04.902975+0000","last_peered":"2023-11-28T16:57:04.902975+0000","last_clean":"2023-11-28T16:57:04.902975+0000","last_became_active":"2023-11-28T16:57:03.890884+0000","last_became_peered":"2023-11-28T16:57:03.890884+0000","last_unstale":"2023-11-28T16:57:04.902975+0000","last_undegraded":"2023-11-28T16:57:04.902975+0000","last_fullsized":"2023-11-28T16:57:04.902975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.599575+0000","last_change":"2023-11-28T16:57:02.890520+0000","last_active":"2023-11-28T16:57:04.599575+0000","last_peered":"2023-11-28T16:57:04.599575+0000","last_clean":"2023-11-28T16:57:04.599575+0000","last_became_active":"2023-11-28T16:57:02.890238+0000","last_became_peered":"2023-11-28T16:57:02.890238+0000","last_unstale":"2023-11-28T16:57:04.599575+0000","last_undegraded":"2023-11-28T16:57:04.599575+0000","last_fullsized":"2023-11-28T16:57:04.599575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.885196+0000","last_change":"2023-11-28T16:57:03.894765+0000","last_active":"2023-11-28T16:57:04.885196+0000","last_peered":"2023-11-28T16:57:04.885196+0000","last_clean":"2023-11-28T16:57:04.885196+0000","last_became_active":"2023-11-28T16:57:03.894466+0000","last_became_peered":"2023-11-28T16:57:03.894466+0000","last_unstale":"2023-11-28T16:57:04.885196+0000","last_undegraded":"2023-11-28T16:57:04.885196+0000","last_fullsized":"2023-11-28T16:57:04.885196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:15.278759+0000","last_change":"2023-11-28T16:57:15.278759+0000","last_active":"2023-11-28T16:57:15.278759+0000","last_peered":"2023-11-28T16:57:15.278759+0000","last_clean":"2023-11-28T16:57:15.278759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:15.278759+0000","last_undegraded":"2023-11-28T16:57:15.278759+0000","last_fullsized":"2023-11-28T16:57:15.278759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902901+0000","last_change":"2023-11-28T16:57:03.886973+0000","last_active":"2023-11-28T16:57:04.902901+0000","last_peered":"2023-11-28T16:57:04.902901+0000","last_clean":"2023-11-28T16:57:04.902901+0000","last_became_active":"2023-11-28T16:57:03.886340+0000","last_became_peered":"2023-11-28T16:57:03.886340+0000","last_unstale":"2023-11-28T16:57:04.902901+0000","last_undegraded":"2023-11-28T16:57:04.902901+0000","last_fullsized":"2023-11-28T16:57:04.902901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:45.769525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902849+0000","last_change":"2023-11-28T16:57:03.892625+0000","last_active":"2023-11-28T16:57:04.902849+0000","last_peered":"2023-11-28T16:57:04.902849+0000","last_clean":"2023-11-28T16:57:04.902849+0000","last_became_active":"2023-11-28T16:57:03.892360+0000","last_became_peered":"2023-11-28T16:57:03.892360+0000","last_unstale":"2023-11-28T16:57:04.902849+0000","last_undegraded":"2023-11-28T16:57:04.902849+0000","last_fullsized":"2023-11-28T16:57:04.902849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903349+0000","last_change":"2023-11-28T16:57:03.904013+0000","last_active":"2023-11-28T16:57:04.903349+0000","last_peered":"2023-11-28T16:57:04.903349+0000","last_clean":"2023-11-28T16:57:04.903349+0000","last_became_active":"2023-11-28T16:57:03.903753+0000","last_became_peered":"2023-11-28T16:57:03.903753+0000","last_unstale":"2023-11-28T16:57:04.903349+0000","last_undegraded":"2023-11-28T16:57:04.903349+0000","last_fullsized":"2023-11-28T16:57:04.903349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:43.387129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.888382+0000","last_change":"2023-11-28T16:57:03.884478+0000","last_active":"2023-11-28T16:57:04.888382+0000","last_peered":"2023-11-28T16:57:04.888382+0000","last_clean":"2023-11-28T16:57:04.888382+0000","last_became_active":"2023-11-28T16:57:03.884199+0000","last_became_peered":"2023-11-28T16:57:03.884199+0000","last_unstale":"2023-11-28T16:57:04.888382+0000","last_undegraded":"2023-11-28T16:57:04.888382+0000","last_fullsized":"2023-11-28T16:57:04.888382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904280+0000","last_change":"2023-11-28T16:57:03.894338+0000","last_active":"2023-11-28T16:57:04.904280+0000","last_peered":"2023-11-28T16:57:04.904280+0000","last_clean":"2023-11-28T16:57:04.904280+0000","last_became_active":"2023-11-28T16:57:03.894019+0000","last_became_peered":"2023-11-28T16:57:03.894019+0000","last_unstale":"2023-11-28T16:57:04.904280+0000","last_undegraded":"2023-11-28T16:57:04.904280+0000","last_fullsized":"2023-11-28T16:57:04.904280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:11.545685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901608+0000","last_change":"2023-11-28T16:57:03.899721+0000","last_active":"2023-11-28T16:57:04.901608+0000","last_peered":"2023-11-28T16:57:04.901608+0000","last_clean":"2023-11-28T16:57:04.901608+0000","last_became_active":"2023-11-28T16:57:03.898861+0000","last_became_peered":"2023-11-28T16:57:03.898861+0000","last_unstale":"2023-11-28T16:57:04.901608+0000","last_undegraded":"2023-11-28T16:57:04.901608+0000","last_fullsized":"2023-11-28T16:57:04.901608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884780+0000","last_change":"2023-11-28T16:57:03.891455+0000","last_active":"2023-11-28T16:57:04.884780+0000","last_peered":"2023-11-28T16:57:04.884780+0000","last_clean":"2023-11-28T16:57:04.884780+0000","last_became_active":"2023-11-28T16:57:03.890363+0000","last_became_peered":"2023-11-28T16:57:03.890363+0000","last_unstale":"2023-11-28T16:57:04.884780+0000","last_undegraded":"2023-11-28T16:57:04.884780+0000","last_fullsized":"2023-11-28T16:57:04.884780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:01.651003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901677+0000","last_change":"2023-11-28T16:57:03.885984+0000","last_active":"2023-11-28T16:57:04.901677+0000","last_peered":"2023-11-28T16:57:04.901677+0000","last_clean":"2023-11-28T16:57:04.901677+0000","last_became_active":"2023-11-28T16:57:03.885297+0000","last_became_peered":"2023-11-28T16:57:03.885297+0000","last_unstale":"2023-11-28T16:57:04.901677+0000","last_undegraded":"2023-11-28T16:57:04.901677+0000","last_fullsized":"2023-11-28T16:57:04.901677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903820+0000","last_change":"2023-11-28T16:57:03.889249+0000","last_active":"2023-11-28T16:57:04.903820+0000","last_peered":"2023-11-28T16:57:04.903820+0000","last_clean":"2023-11-28T16:57:04.903820+0000","last_became_active":"2023-11-28T16:57:03.888913+0000","last_became_peered":"2023-11-28T16:57:03.888913+0000","last_unstale":"2023-11-28T16:57:04.903820+0000","last_undegraded":"2023-11-28T16:57:04.903820+0000","last_fullsized":"2023-11-28T16:57:04.903820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:46.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884958+0000","last_change":"2023-11-28T16:57:03.888524+0000","last_active":"2023-11-28T16:57:04.884958+0000","last_peered":"2023-11-28T16:57:04.884958+0000","last_clean":"2023-11-28T16:57:04.884958+0000","last_became_active":"2023-11-28T16:57:03.885162+0000","last_became_peered":"2023-11-28T16:57:03.885162+0000","last_unstale":"2023-11-28T16:57:04.884958+0000","last_undegraded":"2023-11-28T16:57:04.884958+0000","last_fullsized":"2023-11-28T16:57:04.884958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.888119+0000","last_change":"2023-11-28T16:57:03.888953+0000","last_active":"2023-11-28T16:57:04.888119+0000","last_peered":"2023-11-28T16:57:04.888119+0000","last_clean":"2023-11-28T16:57:04.888119+0000","last_became_active":"2023-11-28T16:57:03.888624+0000","last_became_peered":"2023-11-28T16:57:03.888624+0000","last_unstale":"2023-11-28T16:57:04.888119+0000","last_undegraded":"2023-11-28T16:57:04.888119+0000","last_fullsized":"2023-11-28T16:57:04.888119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.888117+0000","last_change":"2023-11-28T16:57:03.885753+0000","last_active":"2023-11-28T16:57:04.888117+0000","last_peered":"2023-11-28T16:57:04.888117+0000","last_clean":"2023-11-28T16:57:04.888117+0000","last_became_active":"2023-11-28T16:57:03.885404+0000","last_became_peered":"2023-11-28T16:57:03.885404+0000","last_unstale":"2023-11-28T16:57:04.888117+0000","last_undegraded":"2023-11-28T16:57:04.888117+0000","last_fullsized":"2023-11-28T16:57:04.888117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901945+0000","last_change":"2023-11-28T16:57:03.893588+0000","last_active":"2023-11-28T16:57:04.901945+0000","last_peered":"2023-11-28T16:57:04.901945+0000","last_clean":"2023-11-28T16:57:04.901945+0000","last_became_active":"2023-11-28T16:57:03.891825+0000","last_became_peered":"2023-11-28T16:57:03.891825+0000","last_unstale":"2023-11-28T16:57:04.901945+0000","last_undegraded":"2023-11-28T16:57:04.901945+0000","last_fullsized":"2023-11-28T16:57:04.901945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:29:39.475409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884128+0000","last_change":"2023-11-28T16:57:03.910151+0000","last_active":"2023-11-28T16:57:04.884128+0000","last_peered":"2023-11-28T16:57:04.884128+0000","last_clean":"2023-11-28T16:57:04.884128+0000","last_became_active":"2023-11-28T16:57:03.909840+0000","last_became_peered":"2023-11-28T16:57:03.909840+0000","last_unstale":"2023-11-28T16:57:04.884128+0000","last_undegraded":"2023-11-28T16:57:04.884128+0000","last_fullsized":"2023-11-28T16:57:04.884128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:11.545685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884672+0000","last_change":"2023-11-28T16:57:03.891691+0000","last_active":"2023-11-28T16:57:04.884672+0000","last_peered":"2023-11-28T16:57:04.884672+0000","last_clean":"2023-11-28T16:57:04.884672+0000","last_became_active":"2023-11-28T16:57:03.890689+0000","last_became_peered":"2023-11-28T16:57:03.890689+0000","last_unstale":"2023-11-28T16:57:04.884672+0000","last_undegraded":"2023-11-28T16:57:04.884672+0000","last_fullsized":"2023-11-28T16:57:04.884672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:12.894945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903652+0000","last_change":"2023-11-28T16:57:03.899079+0000","last_active":"2023-11-28T16:57:04.903652+0000","last_peered":"2023-11-28T16:57:04.903652+0000","last_clean":"2023-11-28T16:57:04.903652+0000","last_became_active":"2023-11-28T16:57:03.898739+0000","last_became_peered":"2023-11-28T16:57:03.898739+0000","last_unstale":"2023-11-28T16:57:04.903652+0000","last_undegraded":"2023-11-28T16:57:04.903652+0000","last_fullsized":"2023-11-28T16:57:04.903652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:12.894945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902974+0000","last_change":"2023-11-28T16:57:03.899703+0000","last_active":"2023-11-28T16:57:04.902974+0000","last_peered":"2023-11-28T16:57:04.902974+0000","last_clean":"2023-11-28T16:57:04.902974+0000","last_became_active":"2023-11-28T16:57:03.899394+0000","last_became_peered":"2023-11-28T16:57:03.899394+0000","last_unstale":"2023-11-28T16:57:04.902974+0000","last_undegraded":"2023-11-28T16:57:04.902974+0000","last_fullsized":"2023-11-28T16:57:04.902974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:11.545685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903825+0000","last_change":"2023-11-28T16:57:03.895417+0000","last_active":"2023-11-28T16:57:04.903825+0000","last_peered":"2023-11-28T16:57:04.903825+0000","last_clean":"2023-11-28T16:57:04.903825+0000","last_became_active":"2023-11-28T16:57:03.895139+0000","last_became_peered":"2023-11-28T16:57:03.895139+0000","last_unstale":"2023-11-28T16:57:04.903825+0000","last_undegraded":"2023-11-28T16:57:04.903825+0000","last_fullsized":"2023-11-28T16:57:04.903825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884590+0000","last_change":"2023-11-28T16:57:03.889443+0000","last_active":"2023-11-28T16:57:04.884590+0000","last_peered":"2023-11-28T16:57:04.884590+0000","last_clean":"2023-11-28T16:57:04.884590+0000","last_became_active":"2023-11-28T16:57:03.888958+0000","last_became_peered":"2023-11-28T16:57:03.888958+0000","last_unstale":"2023-11-28T16:57:04.884590+0000","last_undegraded":"2023-11-28T16:57:04.884590+0000","last_fullsized":"2023-11-28T16:57:04.884590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:43.387129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901618+0000","last_change":"2023-11-28T16:57:03.890754+0000","last_active":"2023-11-28T16:57:04.901618+0000","last_peered":"2023-11-28T16:57:04.901618+0000","last_clean":"2023-11-28T16:57:04.901618+0000","last_became_active":"2023-11-28T16:57:03.890427+0000","last_became_peered":"2023-11-28T16:57:03.890427+0000","last_unstale":"2023-11-28T16:57:04.901618+0000","last_undegraded":"2023-11-28T16:57:04.901618+0000","last_fullsized":"2023-11-28T16:57:04.901618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:46.680946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904145+0000","last_change":"2023-11-28T16:57:03.896260+0000","last_active":"2023-11-28T16:57:04.904145+0000","last_peered":"2023-11-28T16:57:04.904145+0000","last_clean":"2023-11-28T16:57:04.904145+0000","last_became_active":"2023-11-28T16:57:03.894336+0000","last_became_peered":"2023-11-28T16:57:03.894336+0000","last_unstale":"2023-11-28T16:57:04.904145+0000","last_undegraded":"2023-11-28T16:57:04.904145+0000","last_fullsized":"2023-11-28T16:57:04.904145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:40.156796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.903438+0000","last_change":"2023-11-28T16:57:03.887859+0000","last_active":"2023-11-28T16:57:04.903438+0000","last_peered":"2023-11-28T16:57:04.903438+0000","last_clean":"2023-11-28T16:57:04.903438+0000","last_became_active":"2023-11-28T16:57:03.887591+0000","last_became_peered":"2023-11-28T16:57:03.887591+0000","last_unstale":"2023-11-28T16:57:04.903438+0000","last_undegraded":"2023-11-28T16:57:04.903438+0000","last_fullsized":"2023-11-28T16:57:04.903438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:03.076231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901426+0000","last_change":"2023-11-28T16:57:03.898138+0000","last_active":"2023-11-28T16:57:04.901426+0000","last_peered":"2023-11-28T16:57:04.901426+0000","last_clean":"2023-11-28T16:57:04.901426+0000","last_became_active":"2023-11-28T16:57:03.897728+0000","last_became_peered":"2023-11-28T16:57:03.897728+0000","last_unstale":"2023-11-28T16:57:04.901426+0000","last_undegraded":"2023-11-28T16:57:04.901426+0000","last_fullsized":"2023-11-28T16:57:04.901426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.888553+0000","last_change":"2023-11-28T16:57:03.884223+0000","last_active":"2023-11-28T16:57:04.888553+0000","last_peered":"2023-11-28T16:57:04.888553+0000","last_clean":"2023-11-28T16:57:04.888553+0000","last_became_active":"2023-11-28T16:57:03.883861+0000","last_became_peered":"2023-11-28T16:57:03.883861+0000","last_unstale":"2023-11-28T16:57:04.888553+0000","last_undegraded":"2023-11-28T16:57:04.888553+0000","last_fullsized":"2023-11-28T16:57:04.888553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902717+0000","last_change":"2023-11-28T16:57:03.894793+0000","last_active":"2023-11-28T16:57:04.902717+0000","last_peered":"2023-11-28T16:57:04.902717+0000","last_clean":"2023-11-28T16:57:04.902717+0000","last_became_active":"2023-11-28T16:57:03.887901+0000","last_became_peered":"2023-11-28T16:57:03.887901+0000","last_unstale":"2023-11-28T16:57:04.902717+0000","last_undegraded":"2023-11-28T16:57:04.902717+0000","last_fullsized":"2023-11-28T16:57:04.902717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:40.156796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902621+0000","last_change":"2023-11-28T16:57:03.896614+0000","last_active":"2023-11-28T16:57:04.902621+0000","last_peered":"2023-11-28T16:57:04.902621+0000","last_clean":"2023-11-28T16:57:04.902621+0000","last_became_active":"2023-11-28T16:57:03.896037+0000","last_became_peered":"2023-11-28T16:57:03.896037+0000","last_unstale":"2023-11-28T16:57:04.902621+0000","last_undegraded":"2023-11-28T16:57:04.902621+0000","last_fullsized":"2023-11-28T16:57:04.902621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:09.379292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884011+0000","last_change":"2023-11-28T16:57:03.884669+0000","last_active":"2023-11-28T16:57:04.884011+0000","last_peered":"2023-11-28T16:57:04.884011+0000","last_clean":"2023-11-28T16:57:04.884011+0000","last_became_active":"2023-11-28T16:57:03.884388+0000","last_became_peered":"2023-11-28T16:57:03.884388+0000","last_unstale":"2023-11-28T16:57:04.884011+0000","last_undegraded":"2023-11-28T16:57:04.884011+0000","last_fullsized":"2023-11-28T16:57:04.884011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:53.206562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901272+0000","last_change":"2023-11-28T16:57:03.895662+0000","last_active":"2023-11-28T16:57:04.901272+0000","last_peered":"2023-11-28T16:57:04.901272+0000","last_clean":"2023-11-28T16:57:04.901272+0000","last_became_active":"2023-11-28T16:57:03.895366+0000","last_became_peered":"2023-11-28T16:57:03.895366+0000","last_unstale":"2023-11-28T16:57:04.901272+0000","last_undegraded":"2023-11-28T16:57:04.901272+0000","last_fullsized":"2023-11-28T16:57:04.901272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:57.821483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.901423+0000","last_change":"2023-11-28T16:57:03.881735+0000","last_active":"2023-11-28T16:57:04.901423+0000","last_peered":"2023-11-28T16:57:04.901423+0000","last_clean":"2023-11-28T16:57:04.901423+0000","last_became_active":"2023-11-28T16:57:03.881212+0000","last_became_peered":"2023-11-28T16:57:03.881212+0000","last_unstale":"2023-11-28T16:57:04.901423+0000","last_undegraded":"2023-11-28T16:57:04.901423+0000","last_fullsized":"2023-11-28T16:57:04.901423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.586951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.904101+0000","last_change":"2023-11-28T16:57:03.905652+0000","last_active":"2023-11-28T16:57:04.904101+0000","last_peered":"2023-11-28T16:57:04.904101+0000","last_clean":"2023-11-28T16:57:04.904101+0000","last_became_active":"2023-11-28T16:57:03.905310+0000","last_became_peered":"2023-11-28T16:57:03.905310+0000","last_unstale":"2023-11-28T16:57:04.904101+0000","last_undegraded":"2023-11-28T16:57:04.904101+0000","last_fullsized":"2023-11-28T16:57:04.904101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:09.379292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.884660+0000","last_change":"2023-11-28T16:57:03.896151+0000","last_active":"2023-11-28T16:57:04.884660+0000","last_peered":"2023-11-28T16:57:04.884660+0000","last_clean":"2023-11-28T16:57:04.884660+0000","last_became_active":"2023-11-28T16:57:03.891088+0000","last_became_peered":"2023-11-28T16:57:03.891088+0000","last_unstale":"2023-11-28T16:57:04.884660+0000","last_undegraded":"2023-11-28T16:57:04.884660+0000","last_fullsized":"2023-11-28T16:57:04.884660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:03.076231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:16.286528+0000","last_change":"2023-11-28T16:57:16.286528+0000","last_active":"2023-11-28T16:57:16.286528+0000","last_peered":"2023-11-28T16:57:16.286528+0000","last_clean":"2023-11-28T16:57:16.286528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:16.286528+0000","last_undegraded":"2023-11-28T16:57:16.286528+0000","last_fullsized":"2023-11-28T16:57:16.286528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T16:57:04.902827+0000","last_change":"2023-11-28T16:57:03.894170+0000","last_active":"2023-11-28T16:57:04.902827+0000","last_peered":"2023-11-28T16:57:04.902827+0000","last_clean":"2023-11-28T16:57:04.902827+0000","last_became_active":"2023-11-28T16:57:03.893856+0000","last_became_peered":"2023-11-28T16:57:03.893856+0000","last_unstale":"2023-11-28T16:57:04.902827+0000","last_undegraded":"2023-11-28T16:57:04.902827+0000","last_fullsized":"2023-11-28T16:57:04.902827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.749}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.505}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.64200000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.83399999999999996}]},{"osd":1,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.749},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.73399999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.77000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72899999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80600000000000005}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.83399999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59099999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.751},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.624}]},{"osd":7,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":139521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.501},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.73999999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.54300000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.57399999999999995}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.621},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67100000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":142546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.498}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.628}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.71499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":139487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.437}]},{"osd":1,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.316},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":142546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.29999999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.443},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.53000000000000003}]},{"osd":3,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.622},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.47099999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.63800000000000001}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.58199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":954368,"data_stored":729785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.2869999999999999,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.436}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.65300000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.621}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:57:21.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:57:21.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f91aa640 1 Processor -- start 2023-11-28T16:57:21.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f91aa640 1 -- start start 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f91aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4f40c5f20 0x7fa4f4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f91aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4f4152070 0x7fa4f40c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f91aa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f4158b20 con 0x7fa4f40c2ac0 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f91aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f4157f10 con 0x7fa4f4152070 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f91aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f41581f0 con 0x7fa4f40c5f20 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f2d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa4f40c2ac0 0x7fa4f4070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60206/0 (socket says 172.21.15.26:60206) 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f2d9d640 1 -- 172.21.15.26:0/2893724280 learned_addr learned my addr 172.21.15.26:0/2893724280 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:21.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.601+0000 7fa4f359e640 1 --2- 172.21.15.26:0/2893724280 >> v2:172.21.15.26:3300/0 conn(0x7fa4f4152070 0x7fa4f40c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f259c640 1 --2- 172.21.15.26:0/2893724280 >> v2:172.21.15.79:3300/0 conn(0x7fa4f40c5f20 0x7fa4f4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f1d9b640 1 -- 172.21.15.26:0/2893724280 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593760671 0 0) 0x7fa4f4158b20 con 0x7fa4f40c2ac0 2023-11-28T16:57:21.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f1d9b640 1 -- 172.21.15.26:0/2893724280 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4dc003530 con 0x7fa4f40c2ac0 2023-11-28T16:57:21.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f359e640 1 -- 172.21.15.26:0/2893724280 >> v2:172.21.15.79:3300/0 conn(0x7fa4f40c5f20 msgr2=0x7fa4f4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:21.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f359e640 1 --2- 172.21.15.26:0/2893724280 >> v2:172.21.15.79:3300/0 conn(0x7fa4f40c5f20 0x7fa4f4151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f359e640 1 -- 172.21.15.26:0/2893724280 >> v1:172.21.15.26:6789/0 conn(0x7fa4f40c2ac0 legacy=0x7fa4f4070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f359e640 1 -- 172.21.15.26:0/2893724280 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f41584d0 con 0x7fa4f4152070 2023-11-28T16:57:21.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f359e640 1 --2- 172.21.15.26:0/2893724280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f4152070 0x7fa4f40c1290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40680b0 tx=0x7fa4ec01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3470c3fe5ce49c28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:21.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f1d9b640 1 -- 172.21.15.26:0/2893724280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40c1fe0 con 0x7fa4f4152070 2023-11-28T16:57:21.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f1d9b640 1 -- 172.21.15.26:0/2893724280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec0a5930 con 0x7fa4f4152070 2023-11-28T16:57:21.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.605+0000 7fa4f1d9b640 1 -- 172.21.15.26:0/2893724280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec0a5cc0 con 0x7fa4f4152070 2023-11-28T16:57:21.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- 172.21.15.26:0/2893724280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f4152070 msgr2=0x7fa4f40c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/2893724280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f4152070 0x7fa4f40c1290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40680b0 tx=0x7fa4ec01c850 comp rx=0 tx=0).stop 2023-11-28T16:57:21.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- 172.21.15.26:0/2893724280 shutdown_connections 2023-11-28T16:57:21.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/2893724280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f4152070 0x7fa4f40c1290 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/2893724280 >> v2:172.21.15.79:3300/0 conn(0x7fa4f40c5f20 0x7fa4f4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- 172.21.15.26:0/2893724280 >> 172.21.15.26:0/2893724280 conn(0x7fa4f40a9c10 msgr2=0x7fa4f40aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:21.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- 172.21.15.26:0/2893724280 shutdown_connections 2023-11-28T16:57:21.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- 172.21.15.26:0/2893724280 wait complete. 2023-11-28T16:57:21.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 Processor -- start 2023-11-28T16:57:21.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- start start 2023-11-28T16:57:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4f40c2ac0 0x7fa4f414a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f40c5f20 0x7fa4f406cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f4152070 0x7fa4f413f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f41ed820 con 0x7fa4f40c5f20 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f41ecba0 con 0x7fa4f4152070 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f91aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f41ece80 con 0x7fa4f40c2ac0 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f40c5f20 0x7fa4f406cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f40c5f20 0x7fa4f406cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33900/0 (socket says 172.21.15.26:33900) 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 -- 172.21.15.26:0/1859133891 learned_addr learned my addr 172.21.15.26:0/1859133891 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f2d9d640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4f40c2ac0 0x7fa4f414a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f359e640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f4152070 0x7fa4f413f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 -- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4f40c2ac0 msgr2=0x7fa4f414a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4f40c2ac0 0x7fa4f414a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 -- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f4152070 msgr2=0x7fa4f413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f4152070 0x7fa4f413f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f259c640 1 -- 172.21.15.26:0/1859133891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec009a70 con 0x7fa4f40c5f20 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f2d9d640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4f40c2ac0 0x7fa4f414a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.609+0000 7fa4f359e640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f4152070 0x7fa4f413f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4f259c640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f40c5f20 0x7fa4f406cda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800e930 tx=0x7fa4e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4db7fe640 1 -- 172.21.15.26:0/1859133891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8009690 con 0x7fa4f40c5f20 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4db7fe640 1 -- 172.21.15.26:0/1859133891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e800ca00 con 0x7fa4f40c5f20 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f41ed160 con 0x7fa4f40c5f20 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4db7fe640 1 -- 172.21.15.26:0/1859133891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800cd70 con 0x7fa4f40c5f20 2023-11-28T16:57:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f414ace0 con 0x7fa4f40c5f20 2023-11-28T16:57:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f404e890 con 0x7fa4f40c5f20 2023-11-28T16:57:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4db7fe640 1 -- 172.21.15.26:0/1859133891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa4e8013470 con 0x7fa4f40c5f20 2023-11-28T16:57:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4db7fe640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4e00668d0 0x7fa4e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4db7fe640 1 -- 172.21.15.26:0/1859133891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa4e8084a80 con 0x7fa4f40c5f20 2023-11-28T16:57:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.613+0000 7fa4f2d9d640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4e00668d0 0x7fa4e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.617+0000 7fa4f2d9d640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4e00668d0 0x7fa4e0068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40011f0 tx=0x7fa4e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:21.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.617+0000 7fa4db7fe640 1 -- 172.21.15.26:0/1859133891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4e8051a10 con 0x7fa4f40c5f20 2023-11-28T16:57:21.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.773+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4f40c8a90 con 0x7fa4e00668d0 2023-11-28T16:57:21.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.789+0000 7fa4db7fe640 1 -- 172.21.15.26:0/1859133891 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527706 (secure 0 0 0) 0x7fa4f40c8a90 con 0x7fa4e00668d0 2023-11-28T16:57:21.799 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4e00668d0 msgr2=0x7fa4e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4e00668d0 0x7fa4e0068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40011f0 tx=0x7fa4e4009040 comp rx=0 tx=0).stop 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f40c5f20 msgr2=0x7fa4f406cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f40c5f20 0x7fa4f406cda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800e930 tx=0x7fa4e800edf0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 shutdown_connections 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f4152070 0x7fa4f413f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4f40c5f20 0x7fa4f406cda0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa4e00668d0 0x7fa4e0068d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 --2- 172.21.15.26:0/1859133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4f40c2ac0 0x7fa4f414a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 >> 172.21.15.26:0/1859133891 conn(0x7fa4f40a9c10 msgr2=0x7fa4f40a9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 shutdown_connections 2023-11-28T16:57:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.793+0000 7fa4f91aa640 1 -- 172.21.15.26:0/1859133891 wait complete. 2023-11-28T16:57:21.819 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-11-28T16:57:21.588308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":377,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237300,"kb_used_data":4488,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737420,"statfs":{"total":773094113280,"available":772851118080,"internally_reserved":0,"allocated":4595712,"data_stored":2537366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268353+0000","last_change":"2023-11-28T16:57:17.280539+0000","last_active":"2023-11-28T16:57:18.268353+0000","last_peered":"2023-11-28T16:57:18.268353+0000","last_clean":"2023-11-28T16:57:18.268353+0000","last_became_active":"2023-11-28T16:57:17.280240+0000","last_became_peered":"2023-11-28T16:57:17.280240+0000","last_unstale":"2023-11-28T16:57:18.268353+0000","last_undegraded":"2023-11-28T16:57:18.268353+0000","last_fullsized":"2023-11-28T16:57:18.268353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:26.877132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265633+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:57:17.265633+0000","last_peered":"2023-11-28T16:57:17.265633+0000","last_clean":"2023-11-28T16:57:17.265633+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:57:17.265633+0000","last_undegraded":"2023-11-28T16:57:17.265633+0000","last_fullsized":"2023-11-28T16:57:17.265633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.283262+0000","last_change":"2023-11-28T16:57:02.889062+0000","last_active":"2023-11-28T16:57:17.283262+0000","last_peered":"2023-11-28T16:57:17.283262+0000","last_clean":"2023-11-28T16:57:17.283262+0000","last_became_active":"2023-11-28T16:57:02.888650+0000","last_became_peered":"2023-11-28T16:57:02.888650+0000","last_unstale":"2023-11-28T16:57:17.283262+0000","last_undegraded":"2023-11-28T16:57:17.283262+0000","last_fullsized":"2023-11-28T16:57:17.283262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.266137+0000","last_change":"2023-11-28T16:57:03.886837+0000","last_active":"2023-11-28T16:57:17.266137+0000","last_peered":"2023-11-28T16:57:17.266137+0000","last_clean":"2023-11-28T16:57:17.266137+0000","last_became_active":"2023-11-28T16:57:03.886378+0000","last_became_peered":"2023-11-28T16:57:03.886378+0000","last_unstale":"2023-11-28T16:57:17.266137+0000","last_undegraded":"2023-11-28T16:57:17.266137+0000","last_fullsized":"2023-11-28T16:57:17.266137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:14.424053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.389616+0000","last_change":"2023-11-28T16:57:16.320375+0000","last_active":"2023-11-28T16:57:18.389616+0000","last_peered":"2023-11-28T16:57:18.389616+0000","last_clean":"2023-11-28T16:57:18.389616+0000","last_became_active":"2023-11-28T16:57:16.320068+0000","last_became_peered":"2023-11-28T16:57:16.320068+0000","last_unstale":"2023-11-28T16:57:18.389616+0000","last_undegraded":"2023-11-28T16:57:18.389616+0000","last_fullsized":"2023-11-28T16:57:18.389616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:11.182607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302007+0000","last_change":"2023-11-28T16:57:17.282727+0000","last_active":"2023-11-28T16:57:18.302007+0000","last_peered":"2023-11-28T16:57:18.302007+0000","last_clean":"2023-11-28T16:57:18.302007+0000","last_became_active":"2023-11-28T16:57:17.282415+0000","last_became_peered":"2023-11-28T16:57:17.282415+0000","last_unstale":"2023-11-28T16:57:18.302007+0000","last_undegraded":"2023-11-28T16:57:18.302007+0000","last_fullsized":"2023-11-28T16:57:18.302007+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:02:46.954825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279099+0000","last_change":"2023-11-28T16:57:02.889684+0000","last_active":"2023-11-28T16:57:17.279099+0000","last_peered":"2023-11-28T16:57:17.279099+0000","last_clean":"2023-11-28T16:57:17.279099+0000","last_became_active":"2023-11-28T16:57:02.889040+0000","last_became_peered":"2023-11-28T16:57:02.889040+0000","last_unstale":"2023-11-28T16:57:17.279099+0000","last_undegraded":"2023-11-28T16:57:17.279099+0000","last_fullsized":"2023-11-28T16:57:17.279099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274759+0000","last_change":"2023-11-28T16:57:03.888974+0000","last_active":"2023-11-28T16:57:17.274759+0000","last_peered":"2023-11-28T16:57:17.274759+0000","last_clean":"2023-11-28T16:57:17.274759+0000","last_became_active":"2023-11-28T16:57:03.888693+0000","last_became_peered":"2023-11-28T16:57:03.888693+0000","last_unstale":"2023-11-28T16:57:17.274759+0000","last_undegraded":"2023-11-28T16:57:17.274759+0000","last_fullsized":"2023-11-28T16:57:17.274759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271253+0000","last_change":"2023-11-28T16:57:16.319899+0000","last_active":"2023-11-28T16:57:18.271253+0000","last_peered":"2023-11-28T16:57:18.271253+0000","last_clean":"2023-11-28T16:57:18.271253+0000","last_became_active":"2023-11-28T16:57:16.319609+0000","last_became_peered":"2023-11-28T16:57:16.319609+0000","last_unstale":"2023-11-28T16:57:18.271253+0000","last_undegraded":"2023-11-28T16:57:18.271253+0000","last_fullsized":"2023-11-28T16:57:18.271253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:44:52.715542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302333+0000","last_change":"2023-11-28T16:57:17.290586+0000","last_active":"2023-11-28T16:57:18.302333+0000","last_peered":"2023-11-28T16:57:18.302333+0000","last_clean":"2023-11-28T16:57:18.302333+0000","last_became_active":"2023-11-28T16:57:17.290268+0000","last_became_peered":"2023-11-28T16:57:17.290268+0000","last_unstale":"2023-11-28T16:57:18.302333+0000","last_undegraded":"2023-11-28T16:57:18.302333+0000","last_fullsized":"2023-11-28T16:57:18.302333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:14.523905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274934+0000","last_change":"2023-11-28T16:57:02.880973+0000","last_active":"2023-11-28T16:57:17.274934+0000","last_peered":"2023-11-28T16:57:17.274934+0000","last_clean":"2023-11-28T16:57:17.274934+0000","last_became_active":"2023-11-28T16:57:02.880470+0000","last_became_peered":"2023-11-28T16:57:02.880470+0000","last_unstale":"2023-11-28T16:57:17.274934+0000","last_undegraded":"2023-11-28T16:57:17.274934+0000","last_fullsized":"2023-11-28T16:57:17.274934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:14.363778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.283645+0000","last_change":"2023-11-28T16:57:03.881044+0000","last_active":"2023-11-28T16:57:17.283645+0000","last_peered":"2023-11-28T16:57:17.283645+0000","last_clean":"2023-11-28T16:57:17.283645+0000","last_became_active":"2023-11-28T16:57:03.880727+0000","last_became_peered":"2023-11-28T16:57:03.880727+0000","last_unstale":"2023-11-28T16:57:17.283645+0000","last_undegraded":"2023-11-28T16:57:17.283645+0000","last_fullsized":"2023-11-28T16:57:17.283645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:45.769525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268880+0000","last_change":"2023-11-28T16:57:16.318794+0000","last_active":"2023-11-28T16:57:18.268880+0000","last_peered":"2023-11-28T16:57:18.268880+0000","last_clean":"2023-11-28T16:57:18.268880+0000","last_became_active":"2023-11-28T16:57:16.318485+0000","last_became_peered":"2023-11-28T16:57:16.318485+0000","last_unstale":"2023-11-28T16:57:18.268880+0000","last_undegraded":"2023-11-28T16:57:18.268880+0000","last_fullsized":"2023-11-28T16:57:18.268880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:11.182607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.270606+0000","last_change":"2023-11-28T16:57:17.286198+0000","last_active":"2023-11-28T16:57:18.270606+0000","last_peered":"2023-11-28T16:57:18.270606+0000","last_clean":"2023-11-28T16:57:18.270606+0000","last_became_active":"2023-11-28T16:57:17.285856+0000","last_became_peered":"2023-11-28T16:57:17.285856+0000","last_unstale":"2023-11-28T16:57:18.270606+0000","last_undegraded":"2023-11-28T16:57:18.270606+0000","last_fullsized":"2023-11-28T16:57:18.270606+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:43.855608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274507+0000","last_change":"2023-11-28T16:57:02.881583+0000","last_active":"2023-11-28T16:57:17.274507+0000","last_peered":"2023-11-28T16:57:17.274507+0000","last_clean":"2023-11-28T16:57:17.274507+0000","last_became_active":"2023-11-28T16:57:02.880399+0000","last_became_peered":"2023-11-28T16:57:02.880399+0000","last_unstale":"2023-11-28T16:57:17.274507+0000","last_undegraded":"2023-11-28T16:57:17.274507+0000","last_fullsized":"2023-11-28T16:57:17.274507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267383+0000","last_change":"2023-11-28T16:57:03.898729+0000","last_active":"2023-11-28T16:57:17.267383+0000","last_peered":"2023-11-28T16:57:17.267383+0000","last_clean":"2023-11-28T16:57:17.267383+0000","last_became_active":"2023-11-28T16:57:03.898497+0000","last_became_peered":"2023-11-28T16:57:03.898497+0000","last_unstale":"2023-11-28T16:57:17.267383+0000","last_undegraded":"2023-11-28T16:57:17.267383+0000","last_fullsized":"2023-11-28T16:57:17.267383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267656+0000","last_change":"2023-11-28T16:57:16.321963+0000","last_active":"2023-11-28T16:57:18.267656+0000","last_peered":"2023-11-28T16:57:18.267656+0000","last_clean":"2023-11-28T16:57:18.267656+0000","last_became_active":"2023-11-28T16:57:16.321590+0000","last_became_peered":"2023-11-28T16:57:16.321590+0000","last_unstale":"2023-11-28T16:57:18.267656+0000","last_undegraded":"2023-11-28T16:57:18.267656+0000","last_fullsized":"2023-11-28T16:57:18.267656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:54.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388852+0000","last_change":"2023-11-28T16:57:17.286570+0000","last_active":"2023-11-28T16:57:18.388852+0000","last_peered":"2023-11-28T16:57:18.388852+0000","last_clean":"2023-11-28T16:57:18.388852+0000","last_became_active":"2023-11-28T16:57:17.286230+0000","last_became_peered":"2023-11-28T16:57:17.286230+0000","last_unstale":"2023-11-28T16:57:18.388852+0000","last_undegraded":"2023-11-28T16:57:18.388852+0000","last_fullsized":"2023-11-28T16:57:18.388852+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:24.721287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267686+0000","last_change":"2023-11-28T16:57:02.883158+0000","last_active":"2023-11-28T16:57:17.267686+0000","last_peered":"2023-11-28T16:57:17.267686+0000","last_clean":"2023-11-28T16:57:17.267686+0000","last_became_active":"2023-11-28T16:57:02.882770+0000","last_became_peered":"2023-11-28T16:57:02.882770+0000","last_unstale":"2023-11-28T16:57:17.267686+0000","last_undegraded":"2023-11-28T16:57:17.267686+0000","last_fullsized":"2023-11-28T16:57:17.267686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.281425+0000","last_change":"2023-11-28T16:57:03.892153+0000","last_active":"2023-11-28T16:57:17.281425+0000","last_peered":"2023-11-28T16:57:17.281425+0000","last_clean":"2023-11-28T16:57:17.281425+0000","last_became_active":"2023-11-28T16:57:03.891822+0000","last_became_peered":"2023-11-28T16:57:03.891822+0000","last_unstale":"2023-11-28T16:57:17.281425+0000","last_undegraded":"2023-11-28T16:57:17.281425+0000","last_fullsized":"2023-11-28T16:57:17.281425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388095+0000","last_change":"2023-11-28T16:57:16.320926+0000","last_active":"2023-11-28T16:57:18.388095+0000","last_peered":"2023-11-28T16:57:18.388095+0000","last_clean":"2023-11-28T16:57:18.388095+0000","last_became_active":"2023-11-28T16:57:16.320456+0000","last_became_peered":"2023-11-28T16:57:16.320456+0000","last_unstale":"2023-11-28T16:57:18.388095+0000","last_undegraded":"2023-11-28T16:57:18.388095+0000","last_fullsized":"2023-11-28T16:57:18.388095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:14.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391614+0000","last_change":"2023-11-28T16:57:17.292567+0000","last_active":"2023-11-28T16:57:18.391614+0000","last_peered":"2023-11-28T16:57:18.391614+0000","last_clean":"2023-11-28T16:57:18.391614+0000","last_became_active":"2023-11-28T16:57:17.292188+0000","last_became_peered":"2023-11-28T16:57:17.292188+0000","last_unstale":"2023-11-28T16:57:18.391614+0000","last_undegraded":"2023-11-28T16:57:18.391614+0000","last_fullsized":"2023-11-28T16:57:18.391614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:28.071859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277481+0000","last_change":"2023-11-28T16:57:02.890748+0000","last_active":"2023-11-28T16:57:17.277481+0000","last_peered":"2023-11-28T16:57:17.277481+0000","last_clean":"2023-11-28T16:57:17.277481+0000","last_became_active":"2023-11-28T16:57:02.890463+0000","last_became_peered":"2023-11-28T16:57:02.890463+0000","last_unstale":"2023-11-28T16:57:17.277481+0000","last_undegraded":"2023-11-28T16:57:17.277481+0000","last_fullsized":"2023-11-28T16:57:17.277481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:23.043834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265314+0000","last_change":"2023-11-28T16:57:03.876059+0000","last_active":"2023-11-28T16:57:17.265314+0000","last_peered":"2023-11-28T16:57:17.265314+0000","last_clean":"2023-11-28T16:57:17.265314+0000","last_became_active":"2023-11-28T16:57:03.875768+0000","last_became_peered":"2023-11-28T16:57:03.875768+0000","last_unstale":"2023-11-28T16:57:17.265314+0000","last_undegraded":"2023-11-28T16:57:17.265314+0000","last_fullsized":"2023-11-28T16:57:17.265314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302478+0000","last_change":"2023-11-28T16:57:16.323582+0000","last_active":"2023-11-28T16:57:18.302478+0000","last_peered":"2023-11-28T16:57:18.302478+0000","last_clean":"2023-11-28T16:57:18.302478+0000","last_became_active":"2023-11-28T16:57:16.323308+0000","last_became_peered":"2023-11-28T16:57:16.323308+0000","last_unstale":"2023-11-28T16:57:18.302478+0000","last_undegraded":"2023-11-28T16:57:18.302478+0000","last_fullsized":"2023-11-28T16:57:18.302478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:57.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.269550+0000","last_change":"2023-11-28T16:57:17.279891+0000","last_active":"2023-11-28T16:57:18.269550+0000","last_peered":"2023-11-28T16:57:18.269550+0000","last_clean":"2023-11-28T16:57:18.269550+0000","last_became_active":"2023-11-28T16:57:17.276501+0000","last_became_peered":"2023-11-28T16:57:17.276501+0000","last_unstale":"2023-11-28T16:57:18.269550+0000","last_undegraded":"2023-11-28T16:57:18.269550+0000","last_fullsized":"2023-11-28T16:57:18.269550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:47.139536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267711+0000","last_change":"2023-11-28T16:57:02.886351+0000","last_active":"2023-11-28T16:57:17.267711+0000","last_peered":"2023-11-28T16:57:17.267711+0000","last_clean":"2023-11-28T16:57:17.267711+0000","last_became_active":"2023-11-28T16:57:02.886028+0000","last_became_peered":"2023-11-28T16:57:02.886028+0000","last_unstale":"2023-11-28T16:57:17.267711+0000","last_undegraded":"2023-11-28T16:57:17.267711+0000","last_fullsized":"2023-11-28T16:57:17.267711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:14.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277115+0000","last_change":"2023-11-28T16:57:03.904348+0000","last_active":"2023-11-28T16:57:17.277115+0000","last_peered":"2023-11-28T16:57:17.277115+0000","last_clean":"2023-11-28T16:57:17.277115+0000","last_became_active":"2023-11-28T16:57:03.904090+0000","last_became_peered":"2023-11-28T16:57:03.904090+0000","last_unstale":"2023-11-28T16:57:17.277115+0000","last_undegraded":"2023-11-28T16:57:17.277115+0000","last_fullsized":"2023-11-28T16:57:17.277115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:40:05.723124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388398+0000","last_change":"2023-11-28T16:57:16.321326+0000","last_active":"2023-11-28T16:57:18.388398+0000","last_peered":"2023-11-28T16:57:18.388398+0000","last_clean":"2023-11-28T16:57:18.388398+0000","last_became_active":"2023-11-28T16:57:16.321032+0000","last_became_peered":"2023-11-28T16:57:16.321032+0000","last_unstale":"2023-11-28T16:57:18.388398+0000","last_undegraded":"2023-11-28T16:57:18.388398+0000","last_fullsized":"2023-11-28T16:57:18.388398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:44:52.715542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268038+0000","last_change":"2023-11-28T16:57:17.280554+0000","last_active":"2023-11-28T16:57:18.268038+0000","last_peered":"2023-11-28T16:57:18.268038+0000","last_clean":"2023-11-28T16:57:18.268038+0000","last_became_active":"2023-11-28T16:57:17.280231+0000","last_became_peered":"2023-11-28T16:57:17.280231+0000","last_unstale":"2023-11-28T16:57:18.268038+0000","last_undegraded":"2023-11-28T16:57:18.268038+0000","last_fullsized":"2023-11-28T16:57:18.268038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:01.370617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277478+0000","last_change":"2023-11-28T16:57:02.888301+0000","last_active":"2023-11-28T16:57:17.277478+0000","last_peered":"2023-11-28T16:57:17.277478+0000","last_clean":"2023-11-28T16:57:17.277478+0000","last_became_active":"2023-11-28T16:57:02.887892+0000","last_became_peered":"2023-11-28T16:57:02.887892+0000","last_unstale":"2023-11-28T16:57:17.277478+0000","last_undegraded":"2023-11-28T16:57:17.277478+0000","last_fullsized":"2023-11-28T16:57:17.277478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.269687+0000","last_change":"2023-11-28T16:57:03.892095+0000","last_active":"2023-11-28T16:57:17.269687+0000","last_peered":"2023-11-28T16:57:17.269687+0000","last_clean":"2023-11-28T16:57:17.269687+0000","last_became_active":"2023-11-28T16:57:03.891745+0000","last_became_peered":"2023-11-28T16:57:03.891745+0000","last_unstale":"2023-11-28T16:57:17.269687+0000","last_undegraded":"2023-11-28T16:57:17.269687+0000","last_fullsized":"2023-11-28T16:57:17.269687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:39:05.732024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.269237+0000","last_change":"2023-11-28T16:57:16.314749+0000","last_active":"2023-11-28T16:57:18.269237+0000","last_peered":"2023-11-28T16:57:18.269237+0000","last_clean":"2023-11-28T16:57:18.269237+0000","last_became_active":"2023-11-28T16:57:16.313883+0000","last_became_peered":"2023-11-28T16:57:16.313883+0000","last_unstale":"2023-11-28T16:57:18.269237+0000","last_undegraded":"2023-11-28T16:57:18.269237+0000","last_fullsized":"2023-11-28T16:57:18.269237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:06.888463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388243+0000","last_change":"2023-11-28T16:57:17.291754+0000","last_active":"2023-11-28T16:57:18.388243+0000","last_peered":"2023-11-28T16:57:18.388243+0000","last_clean":"2023-11-28T16:57:18.388243+0000","last_became_active":"2023-11-28T16:57:17.291439+0000","last_became_peered":"2023-11-28T16:57:17.291439+0000","last_unstale":"2023-11-28T16:57:18.388243+0000","last_undegraded":"2023-11-28T16:57:18.388243+0000","last_fullsized":"2023-11-28T16:57:18.388243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:14.919909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274111+0000","last_change":"2023-11-28T16:57:02.890124+0000","last_active":"2023-11-28T16:57:17.274111+0000","last_peered":"2023-11-28T16:57:17.274111+0000","last_clean":"2023-11-28T16:57:17.274111+0000","last_became_active":"2023-11-28T16:57:02.889786+0000","last_became_peered":"2023-11-28T16:57:02.889786+0000","last_unstale":"2023-11-28T16:57:17.274111+0000","last_undegraded":"2023-11-28T16:57:17.274111+0000","last_fullsized":"2023-11-28T16:57:17.274111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:46.580531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.266319+0000","last_change":"2023-11-28T16:57:03.896853+0000","last_active":"2023-11-28T16:57:17.266319+0000","last_peered":"2023-11-28T16:57:17.266319+0000","last_clean":"2023-11-28T16:57:17.266319+0000","last_became_active":"2023-11-28T16:57:03.896447+0000","last_became_peered":"2023-11-28T16:57:03.896447+0000","last_unstale":"2023-11-28T16:57:17.266319+0000","last_undegraded":"2023-11-28T16:57:17.266319+0000","last_fullsized":"2023-11-28T16:57:17.266319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:22.391277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388967+0000","last_change":"2023-11-28T16:57:16.322902+0000","last_active":"2023-11-28T16:57:18.388967+0000","last_peered":"2023-11-28T16:57:18.388967+0000","last_clean":"2023-11-28T16:57:18.388967+0000","last_became_active":"2023-11-28T16:57:16.322565+0000","last_became_peered":"2023-11-28T16:57:16.322565+0000","last_unstale":"2023-11-28T16:57:18.388967+0000","last_undegraded":"2023-11-28T16:57:18.388967+0000","last_fullsized":"2023-11-28T16:57:18.388967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:08:02.889771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.301967+0000","last_change":"2023-11-28T16:57:17.289189+0000","last_active":"2023-11-28T16:57:18.301967+0000","last_peered":"2023-11-28T16:57:18.301967+0000","last_clean":"2023-11-28T16:57:18.301967+0000","last_became_active":"2023-11-28T16:57:17.284849+0000","last_became_peered":"2023-11-28T16:57:17.284849+0000","last_unstale":"2023-11-28T16:57:18.301967+0000","last_undegraded":"2023-11-28T16:57:18.301967+0000","last_fullsized":"2023-11-28T16:57:18.301967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:56.317705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274851+0000","last_change":"2023-11-28T16:57:02.887552+0000","last_active":"2023-11-28T16:57:17.274851+0000","last_peered":"2023-11-28T16:57:17.274851+0000","last_clean":"2023-11-28T16:57:17.274851+0000","last_became_active":"2023-11-28T16:57:02.887319+0000","last_became_peered":"2023-11-28T16:57:02.887319+0000","last_unstale":"2023-11-28T16:57:17.274851+0000","last_undegraded":"2023-11-28T16:57:17.274851+0000","last_fullsized":"2023-11-28T16:57:17.274851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:29:38.468989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.270696+0000","last_change":"2023-11-28T16:57:03.896248+0000","last_active":"2023-11-28T16:57:17.270696+0000","last_peered":"2023-11-28T16:57:17.270696+0000","last_clean":"2023-11-28T16:57:17.270696+0000","last_became_active":"2023-11-28T16:57:03.895989+0000","last_became_peered":"2023-11-28T16:57:03.895989+0000","last_unstale":"2023-11-28T16:57:17.270696+0000","last_undegraded":"2023-11-28T16:57:17.270696+0000","last_fullsized":"2023-11-28T16:57:17.270696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:07:32.729943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302290+0000","last_change":"2023-11-28T16:57:16.322999+0000","last_active":"2023-11-28T16:57:18.302290+0000","last_peered":"2023-11-28T16:57:18.302290+0000","last_clean":"2023-11-28T16:57:18.302290+0000","last_became_active":"2023-11-28T16:57:16.322673+0000","last_became_peered":"2023-11-28T16:57:16.322673+0000","last_unstale":"2023-11-28T16:57:18.302290+0000","last_undegraded":"2023-11-28T16:57:18.302290+0000","last_fullsized":"2023-11-28T16:57:18.302290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:46.131767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267540+0000","last_change":"2023-11-28T16:57:17.286023+0000","last_active":"2023-11-28T16:57:18.267540+0000","last_peered":"2023-11-28T16:57:18.267540+0000","last_clean":"2023-11-28T16:57:18.267540+0000","last_became_active":"2023-11-28T16:57:17.285634+0000","last_became_peered":"2023-11-28T16:57:17.285634+0000","last_unstale":"2023-11-28T16:57:18.267540+0000","last_undegraded":"2023-11-28T16:57:18.267540+0000","last_fullsized":"2023-11-28T16:57:18.267540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:12.190376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.281455+0000","last_change":"2023-11-28T16:57:02.889539+0000","last_active":"2023-11-28T16:57:17.281455+0000","last_peered":"2023-11-28T16:57:17.281455+0000","last_clean":"2023-11-28T16:57:17.281455+0000","last_became_active":"2023-11-28T16:57:02.889270+0000","last_became_peered":"2023-11-28T16:57:02.889270+0000","last_unstale":"2023-11-28T16:57:17.281455+0000","last_undegraded":"2023-11-28T16:57:17.281455+0000","last_fullsized":"2023-11-28T16:57:17.281455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.270414+0000","last_change":"2023-11-28T16:57:03.887058+0000","last_active":"2023-11-28T16:57:17.270414+0000","last_peered":"2023-11-28T16:57:17.270414+0000","last_clean":"2023-11-28T16:57:17.270414+0000","last_became_active":"2023-11-28T16:57:03.886373+0000","last_became_peered":"2023-11-28T16:57:03.886373+0000","last_unstale":"2023-11-28T16:57:17.270414+0000","last_undegraded":"2023-11-28T16:57:17.270414+0000","last_fullsized":"2023-11-28T16:57:17.270414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:17:34.242546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268522+0000","last_change":"2023-11-28T16:57:16.316582+0000","last_active":"2023-11-28T16:57:18.268522+0000","last_peered":"2023-11-28T16:57:18.268522+0000","last_clean":"2023-11-28T16:57:18.268522+0000","last_became_active":"2023-11-28T16:57:16.316306+0000","last_became_peered":"2023-11-28T16:57:16.316306+0000","last_unstale":"2023-11-28T16:57:18.268522+0000","last_undegraded":"2023-11-28T16:57:18.268522+0000","last_fullsized":"2023-11-28T16:57:18.268522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:08:02.889771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387290+0000","last_change":"2023-11-28T16:57:17.281389+0000","last_active":"2023-11-28T16:57:18.387290+0000","last_peered":"2023-11-28T16:57:18.387290+0000","last_clean":"2023-11-28T16:57:18.387290+0000","last_became_active":"2023-11-28T16:57:17.281074+0000","last_became_peered":"2023-11-28T16:57:17.281074+0000","last_unstale":"2023-11-28T16:57:18.387290+0000","last_undegraded":"2023-11-28T16:57:18.387290+0000","last_fullsized":"2023-11-28T16:57:18.387290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:51.137402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267480+0000","last_change":"2023-11-28T16:57:02.887769+0000","last_active":"2023-11-28T16:57:17.267480+0000","last_peered":"2023-11-28T16:57:17.267480+0000","last_clean":"2023-11-28T16:57:17.267480+0000","last_became_active":"2023-11-28T16:57:02.887489+0000","last_became_peered":"2023-11-28T16:57:02.887489+0000","last_unstale":"2023-11-28T16:57:17.267480+0000","last_undegraded":"2023-11-28T16:57:17.267480+0000","last_fullsized":"2023-11-28T16:57:17.267480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.270079+0000","last_change":"2023-11-28T16:57:03.892487+0000","last_active":"2023-11-28T16:57:17.270079+0000","last_peered":"2023-11-28T16:57:17.270079+0000","last_clean":"2023-11-28T16:57:17.270079+0000","last_became_active":"2023-11-28T16:57:03.892192+0000","last_became_peered":"2023-11-28T16:57:03.892192+0000","last_unstale":"2023-11-28T16:57:17.270079+0000","last_undegraded":"2023-11-28T16:57:17.270079+0000","last_fullsized":"2023-11-28T16:57:17.270079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:56.812246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267569+0000","last_change":"2023-11-28T16:57:16.313914+0000","last_active":"2023-11-28T16:57:18.267569+0000","last_peered":"2023-11-28T16:57:18.267569+0000","last_clean":"2023-11-28T16:57:18.267569+0000","last_became_active":"2023-11-28T16:57:16.313406+0000","last_became_peered":"2023-11-28T16:57:16.313406+0000","last_unstale":"2023-11-28T16:57:18.267569+0000","last_undegraded":"2023-11-28T16:57:18.267569+0000","last_fullsized":"2023-11-28T16:57:18.267569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:42.847839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268396+0000","last_change":"2023-11-28T16:57:17.285563+0000","last_active":"2023-11-28T16:57:18.268396+0000","last_peered":"2023-11-28T16:57:18.268396+0000","last_clean":"2023-11-28T16:57:18.268396+0000","last_became_active":"2023-11-28T16:57:17.285256+0000","last_became_peered":"2023-11-28T16:57:17.285256+0000","last_unstale":"2023-11-28T16:57:18.268396+0000","last_undegraded":"2023-11-28T16:57:18.268396+0000","last_fullsized":"2023-11-28T16:57:18.268396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:58.249158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.278591+0000","last_change":"2023-11-28T16:57:02.890920+0000","last_active":"2023-11-28T16:57:17.278591+0000","last_peered":"2023-11-28T16:57:17.278591+0000","last_clean":"2023-11-28T16:57:17.278591+0000","last_became_active":"2023-11-28T16:57:02.890605+0000","last_became_peered":"2023-11-28T16:57:02.890605+0000","last_unstale":"2023-11-28T16:57:17.278591+0000","last_undegraded":"2023-11-28T16:57:17.278591+0000","last_fullsized":"2023-11-28T16:57:17.278591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:39.061444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.270506+0000","last_change":"2023-11-28T16:57:03.903216+0000","last_active":"2023-11-28T16:57:17.270506+0000","last_peered":"2023-11-28T16:57:17.270506+0000","last_clean":"2023-11-28T16:57:17.270506+0000","last_became_active":"2023-11-28T16:57:03.901859+0000","last_became_peered":"2023-11-28T16:57:03.901859+0000","last_unstale":"2023-11-28T16:57:17.270506+0000","last_undegraded":"2023-11-28T16:57:17.270506+0000","last_fullsized":"2023-11-28T16:57:17.270506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:15.370198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271343+0000","last_change":"2023-11-28T16:57:16.319263+0000","last_active":"2023-11-28T16:57:18.271343+0000","last_peered":"2023-11-28T16:57:18.271343+0000","last_clean":"2023-11-28T16:57:18.271343+0000","last_became_active":"2023-11-28T16:57:16.318964+0000","last_became_peered":"2023-11-28T16:57:16.318964+0000","last_unstale":"2023-11-28T16:57:18.271343+0000","last_undegraded":"2023-11-28T16:57:18.271343+0000","last_fullsized":"2023-11-28T16:57:18.271343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:05.052779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387884+0000","last_change":"2023-11-28T16:57:17.289055+0000","last_active":"2023-11-28T16:57:18.387884+0000","last_peered":"2023-11-28T16:57:18.387884+0000","last_clean":"2023-11-28T16:57:18.387884+0000","last_became_active":"2023-11-28T16:57:17.288682+0000","last_became_peered":"2023-11-28T16:57:17.288682+0000","last_unstale":"2023-11-28T16:57:18.387884+0000","last_undegraded":"2023-11-28T16:57:18.387884+0000","last_fullsized":"2023-11-28T16:57:18.387884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:01.019823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277712+0000","last_change":"2023-11-28T16:57:02.892637+0000","last_active":"2023-11-28T16:57:17.277712+0000","last_peered":"2023-11-28T16:57:17.277712+0000","last_clean":"2023-11-28T16:57:17.277712+0000","last_became_active":"2023-11-28T16:57:02.892297+0000","last_became_peered":"2023-11-28T16:57:02.892297+0000","last_unstale":"2023-11-28T16:57:17.277712+0000","last_undegraded":"2023-11-28T16:57:17.277712+0000","last_fullsized":"2023-11-28T16:57:17.277712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:56.815063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277389+0000","last_change":"2023-11-28T16:57:03.881542+0000","last_active":"2023-11-28T16:57:17.277389+0000","last_peered":"2023-11-28T16:57:17.277389+0000","last_clean":"2023-11-28T16:57:17.277389+0000","last_became_active":"2023-11-28T16:57:03.880853+0000","last_became_peered":"2023-11-28T16:57:03.880853+0000","last_unstale":"2023-11-28T16:57:17.277389+0000","last_undegraded":"2023-11-28T16:57:17.277389+0000","last_fullsized":"2023-11-28T16:57:17.277389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:17.248616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387885+0000","last_change":"2023-11-28T16:57:16.329071+0000","last_active":"2023-11-28T16:57:18.387885+0000","last_peered":"2023-11-28T16:57:18.387885+0000","last_clean":"2023-11-28T16:57:18.387885+0000","last_became_active":"2023-11-28T16:57:16.328774+0000","last_became_peered":"2023-11-28T16:57:16.328774+0000","last_unstale":"2023-11-28T16:57:18.387885+0000","last_undegraded":"2023-11-28T16:57:18.387885+0000","last_fullsized":"2023-11-28T16:57:18.387885+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:45.432920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391266+0000","last_change":"2023-11-28T16:57:17.297387+0000","last_active":"2023-11-28T16:57:18.391266+0000","last_peered":"2023-11-28T16:57:18.391266+0000","last_clean":"2023-11-28T16:57:18.391266+0000","last_became_active":"2023-11-28T16:57:17.297057+0000","last_became_peered":"2023-11-28T16:57:17.297057+0000","last_unstale":"2023-11-28T16:57:18.391266+0000","last_undegraded":"2023-11-28T16:57:18.391266+0000","last_fullsized":"2023-11-28T16:57:18.391266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:06.060548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280202+0000","last_change":"2023-11-28T16:57:02.884158+0000","last_active":"2023-11-28T16:57:17.280202+0000","last_peered":"2023-11-28T16:57:17.280202+0000","last_clean":"2023-11-28T16:57:17.280202+0000","last_became_active":"2023-11-28T16:57:02.883646+0000","last_became_peered":"2023-11-28T16:57:02.883646+0000","last_unstale":"2023-11-28T16:57:17.280202+0000","last_undegraded":"2023-11-28T16:57:17.280202+0000","last_fullsized":"2023-11-28T16:57:17.280202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:02.150576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277033+0000","last_change":"2023-11-28T16:57:03.893627+0000","last_active":"2023-11-28T16:57:17.277033+0000","last_peered":"2023-11-28T16:57:17.277033+0000","last_clean":"2023-11-28T16:57:17.277033+0000","last_became_active":"2023-11-28T16:57:03.893378+0000","last_became_peered":"2023-11-28T16:57:03.893378+0000","last_unstale":"2023-11-28T16:57:17.277033+0000","last_undegraded":"2023-11-28T16:57:17.277033+0000","last_fullsized":"2023-11-28T16:57:17.277033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:22.391277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302427+0000","last_change":"2023-11-28T16:57:16.328189+0000","last_active":"2023-11-28T16:57:18.302427+0000","last_peered":"2023-11-28T16:57:18.302427+0000","last_clean":"2023-11-28T16:57:18.302427+0000","last_became_active":"2023-11-28T16:57:16.327968+0000","last_became_peered":"2023-11-28T16:57:16.327968+0000","last_unstale":"2023-11-28T16:57:18.302427+0000","last_undegraded":"2023-11-28T16:57:18.302427+0000","last_fullsized":"2023-11-28T16:57:18.302427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:56.441496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391210+0000","last_change":"2023-11-28T16:57:17.290819+0000","last_active":"2023-11-28T16:57:18.391210+0000","last_peered":"2023-11-28T16:57:18.391210+0000","last_clean":"2023-11-28T16:57:18.391210+0000","last_became_active":"2023-11-28T16:57:17.289942+0000","last_became_peered":"2023-11-28T16:57:17.289942+0000","last_unstale":"2023-11-28T16:57:18.391210+0000","last_undegraded":"2023-11-28T16:57:18.391210+0000","last_fullsized":"2023-11-28T16:57:18.391210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:44:53.723311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277377+0000","last_change":"2023-11-28T16:57:02.897594+0000","last_active":"2023-11-28T16:57:17.277377+0000","last_peered":"2023-11-28T16:57:17.277377+0000","last_clean":"2023-11-28T16:57:17.277377+0000","last_became_active":"2023-11-28T16:57:02.897292+0000","last_became_peered":"2023-11-28T16:57:02.897292+0000","last_unstale":"2023-11-28T16:57:17.277377+0000","last_undegraded":"2023-11-28T16:57:17.277377+0000","last_fullsized":"2023-11-28T16:57:17.277377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280113+0000","last_change":"2023-11-28T16:57:03.890656+0000","last_active":"2023-11-28T16:57:17.280113+0000","last_peered":"2023-11-28T16:57:17.280113+0000","last_clean":"2023-11-28T16:57:17.280113+0000","last_became_active":"2023-11-28T16:57:03.890368+0000","last_became_peered":"2023-11-28T16:57:03.890368+0000","last_unstale":"2023-11-28T16:57:17.280113+0000","last_undegraded":"2023-11-28T16:57:17.280113+0000","last_fullsized":"2023-11-28T16:57:17.280113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:15.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.389212+0000","last_change":"2023-11-28T16:57:16.321989+0000","last_active":"2023-11-28T16:57:18.389212+0000","last_peered":"2023-11-28T16:57:18.389212+0000","last_clean":"2023-11-28T16:57:18.389212+0000","last_became_active":"2023-11-28T16:57:16.321699+0000","last_became_peered":"2023-11-28T16:57:16.321699+0000","last_unstale":"2023-11-28T16:57:18.389212+0000","last_undegraded":"2023-11-28T16:57:18.389212+0000","last_fullsized":"2023-11-28T16:57:18.389212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:20.488379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268539+0000","last_change":"2023-11-28T16:57:17.280776+0000","last_active":"2023-11-28T16:57:18.268539+0000","last_peered":"2023-11-28T16:57:18.268539+0000","last_clean":"2023-11-28T16:57:18.268539+0000","last_became_active":"2023-11-28T16:57:17.280196+0000","last_became_peered":"2023-11-28T16:57:17.280196+0000","last_unstale":"2023-11-28T16:57:18.268539+0000","last_undegraded":"2023-11-28T16:57:18.268539+0000","last_fullsized":"2023-11-28T16:57:18.268539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:35.569140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279198+0000","last_change":"2023-11-28T16:57:02.874480+0000","last_active":"2023-11-28T16:57:17.279198+0000","last_peered":"2023-11-28T16:57:17.279198+0000","last_clean":"2023-11-28T16:57:17.279198+0000","last_became_active":"2023-11-28T16:57:02.874163+0000","last_became_peered":"2023-11-28T16:57:02.874163+0000","last_unstale":"2023-11-28T16:57:17.279198+0000","last_undegraded":"2023-11-28T16:57:17.279198+0000","last_fullsized":"2023-11-28T16:57:17.279198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:47.038335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280796+0000","last_change":"2023-11-28T16:57:03.898409+0000","last_active":"2023-11-28T16:57:17.280796+0000","last_peered":"2023-11-28T16:57:17.280796+0000","last_clean":"2023-11-28T16:57:17.280796+0000","last_became_active":"2023-11-28T16:57:03.895873+0000","last_became_peered":"2023-11-28T16:57:03.895873+0000","last_unstale":"2023-11-28T16:57:17.280796+0000","last_undegraded":"2023-11-28T16:57:17.280796+0000","last_fullsized":"2023-11-28T16:57:17.280796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268573+0000","last_change":"2023-11-28T16:57:16.312064+0000","last_active":"2023-11-28T16:57:18.268573+0000","last_peered":"2023-11-28T16:57:18.268573+0000","last_clean":"2023-11-28T16:57:18.268573+0000","last_became_active":"2023-11-28T16:57:16.311776+0000","last_became_peered":"2023-11-28T16:57:16.311776+0000","last_unstale":"2023-11-28T16:57:18.268573+0000","last_undegraded":"2023-11-28T16:57:18.268573+0000","last_fullsized":"2023-11-28T16:57:18.268573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:20.488379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.390902+0000","last_change":"2023-11-28T16:57:17.293999+0000","last_active":"2023-11-28T16:57:18.390902+0000","last_peered":"2023-11-28T16:57:18.390902+0000","last_clean":"2023-11-28T16:57:18.390902+0000","last_became_active":"2023-11-28T16:57:17.292410+0000","last_became_peered":"2023-11-28T16:57:17.292410+0000","last_unstale":"2023-11-28T16:57:18.390902+0000","last_undegraded":"2023-11-28T16:57:18.390902+0000","last_fullsized":"2023-11-28T16:57:18.390902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:16.509103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.278923+0000","last_change":"2023-11-28T16:57:02.892486+0000","last_active":"2023-11-28T16:57:17.278923+0000","last_peered":"2023-11-28T16:57:17.278923+0000","last_clean":"2023-11-28T16:57:17.278923+0000","last_became_active":"2023-11-28T16:57:02.892124+0000","last_became_peered":"2023-11-28T16:57:02.892124+0000","last_unstale":"2023-11-28T16:57:17.278923+0000","last_undegraded":"2023-11-28T16:57:17.278923+0000","last_fullsized":"2023-11-28T16:57:17.278923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:23.155077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265309+0000","last_change":"2023-11-28T16:57:03.887179+0000","last_active":"2023-11-28T16:57:17.265309+0000","last_peered":"2023-11-28T16:57:17.265309+0000","last_clean":"2023-11-28T16:57:17.265309+0000","last_became_active":"2023-11-28T16:57:03.886667+0000","last_became_peered":"2023-11-28T16:57:03.886667+0000","last_unstale":"2023-11-28T16:57:17.265309+0000","last_undegraded":"2023-11-28T16:57:17.265309+0000","last_fullsized":"2023-11-28T16:57:17.265309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:53.206562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302094+0000","last_change":"2023-11-28T16:57:16.327661+0000","last_active":"2023-11-28T16:57:18.302094+0000","last_peered":"2023-11-28T16:57:18.302094+0000","last_clean":"2023-11-28T16:57:18.302094+0000","last_became_active":"2023-11-28T16:57:16.327364+0000","last_became_peered":"2023-11-28T16:57:16.327364+0000","last_unstale":"2023-11-28T16:57:18.302094+0000","last_undegraded":"2023-11-28T16:57:18.302094+0000","last_fullsized":"2023-11-28T16:57:18.302094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:00.110836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268717+0000","last_change":"2023-11-28T16:57:17.292894+0000","last_active":"2023-11-28T16:57:18.268717+0000","last_peered":"2023-11-28T16:57:18.268717+0000","last_clean":"2023-11-28T16:57:18.268717+0000","last_became_active":"2023-11-28T16:57:17.292516+0000","last_became_peered":"2023-11-28T16:57:17.292516+0000","last_unstale":"2023-11-28T16:57:18.268717+0000","last_undegraded":"2023-11-28T16:57:18.268717+0000","last_fullsized":"2023-11-28T16:57:18.268717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:35.569140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274413+0000","last_change":"2023-11-28T16:57:02.881775+0000","last_active":"2023-11-28T16:57:17.274413+0000","last_peered":"2023-11-28T16:57:17.274413+0000","last_clean":"2023-11-28T16:57:17.274413+0000","last_became_active":"2023-11-28T16:57:02.881350+0000","last_became_peered":"2023-11-28T16:57:02.881350+0000","last_unstale":"2023-11-28T16:57:17.274413+0000","last_undegraded":"2023-11-28T16:57:17.274413+0000","last_fullsized":"2023-11-28T16:57:17.274413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:41.579988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.282004+0000","last_change":"2023-11-28T16:57:03.887114+0000","last_active":"2023-11-28T16:57:17.282004+0000","last_peered":"2023-11-28T16:57:17.282004+0000","last_clean":"2023-11-28T16:57:17.282004+0000","last_became_active":"2023-11-28T16:57:03.886543+0000","last_became_peered":"2023-11-28T16:57:03.886543+0000","last_unstale":"2023-11-28T16:57:17.282004+0000","last_undegraded":"2023-11-28T16:57:17.282004+0000","last_fullsized":"2023-11-28T16:57:17.282004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:22.391277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267638+0000","last_change":"2023-11-28T16:57:16.316039+0000","last_active":"2023-11-28T16:57:18.267638+0000","last_peered":"2023-11-28T16:57:18.267638+0000","last_clean":"2023-11-28T16:57:18.267638+0000","last_became_active":"2023-11-28T16:57:16.315739+0000","last_became_peered":"2023-11-28T16:57:16.315739+0000","last_unstale":"2023-11-28T16:57:18.267638+0000","last_undegraded":"2023-11-28T16:57:18.267638+0000","last_fullsized":"2023-11-28T16:57:18.267638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:13.912140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.301835+0000","last_change":"2023-11-28T16:57:17.284148+0000","last_active":"2023-11-28T16:57:18.301835+0000","last_peered":"2023-11-28T16:57:18.301835+0000","last_clean":"2023-11-28T16:57:18.301835+0000","last_became_active":"2023-11-28T16:57:17.283834+0000","last_became_peered":"2023-11-28T16:57:17.283834+0000","last_unstale":"2023-11-28T16:57:18.301835+0000","last_undegraded":"2023-11-28T16:57:18.301835+0000","last_fullsized":"2023-11-28T16:57:18.301835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:01.341180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277678+0000","last_change":"2023-11-28T16:57:02.882053+0000","last_active":"2023-11-28T16:57:17.277678+0000","last_peered":"2023-11-28T16:57:17.277678+0000","last_clean":"2023-11-28T16:57:17.277678+0000","last_became_active":"2023-11-28T16:57:02.879776+0000","last_became_peered":"2023-11-28T16:57:02.879776+0000","last_unstale":"2023-11-28T16:57:17.277678+0000","last_undegraded":"2023-11-28T16:57:17.277678+0000","last_fullsized":"2023-11-28T16:57:17.277678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:20.111131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274284+0000","last_change":"2023-11-28T16:57:03.886262+0000","last_active":"2023-11-28T16:57:17.274284+0000","last_peered":"2023-11-28T16:57:17.274284+0000","last_clean":"2023-11-28T16:57:17.274284+0000","last_became_active":"2023-11-28T16:57:03.886052+0000","last_became_peered":"2023-11-28T16:57:03.886052+0000","last_unstale":"2023-11-28T16:57:17.274284+0000","last_undegraded":"2023-11-28T16:57:17.274284+0000","last_fullsized":"2023-11-28T16:57:17.274284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:58.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.301953+0000","last_change":"2023-11-28T16:57:16.329850+0000","last_active":"2023-11-28T16:57:18.301953+0000","last_peered":"2023-11-28T16:57:18.301953+0000","last_clean":"2023-11-28T16:57:18.301953+0000","last_became_active":"2023-11-28T16:57:16.329103+0000","last_became_peered":"2023-11-28T16:57:16.329103+0000","last_unstale":"2023-11-28T16:57:18.301953+0000","last_undegraded":"2023-11-28T16:57:18.301953+0000","last_fullsized":"2023-11-28T16:57:18.301953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:25.869363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.269619+0000","last_change":"2023-11-28T16:57:17.286888+0000","last_active":"2023-11-28T16:57:18.269619+0000","last_peered":"2023-11-28T16:57:18.269619+0000","last_clean":"2023-11-28T16:57:18.269619+0000","last_became_active":"2023-11-28T16:57:17.286479+0000","last_became_peered":"2023-11-28T16:57:17.286479+0000","last_unstale":"2023-11-28T16:57:18.269619+0000","last_undegraded":"2023-11-28T16:57:18.269619+0000","last_fullsized":"2023-11-28T16:57:18.269619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:57.520358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279318+0000","last_change":"2023-11-28T16:57:02.896876+0000","last_active":"2023-11-28T16:57:17.279318+0000","last_peered":"2023-11-28T16:57:17.279318+0000","last_clean":"2023-11-28T16:57:17.279318+0000","last_became_active":"2023-11-28T16:57:02.896650+0000","last_became_peered":"2023-11-28T16:57:02.896650+0000","last_unstale":"2023-11-28T16:57:17.279318+0000","last_undegraded":"2023-11-28T16:57:17.279318+0000","last_fullsized":"2023-11-28T16:57:17.279318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:45.191786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274146+0000","last_change":"2023-11-28T16:57:03.905651+0000","last_active":"2023-11-28T16:57:17.274146+0000","last_peered":"2023-11-28T16:57:17.274146+0000","last_clean":"2023-11-28T16:57:17.274146+0000","last_became_active":"2023-11-28T16:57:03.904887+0000","last_became_peered":"2023-11-28T16:57:03.904887+0000","last_unstale":"2023-11-28T16:57:17.274146+0000","last_undegraded":"2023-11-28T16:57:17.274146+0000","last_fullsized":"2023-11-28T16:57:17.274146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268159+0000","last_change":"2023-11-28T16:57:16.314852+0000","last_active":"2023-11-28T16:57:18.268159+0000","last_peered":"2023-11-28T16:57:18.268159+0000","last_clean":"2023-11-28T16:57:18.268159+0000","last_became_active":"2023-11-28T16:57:16.314572+0000","last_became_peered":"2023-11-28T16:57:16.314572+0000","last_unstale":"2023-11-28T16:57:18.268159+0000","last_undegraded":"2023-11-28T16:57:18.268159+0000","last_fullsized":"2023-11-28T16:57:18.268159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:15.959814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271324+0000","last_change":"2023-11-28T16:57:17.285518+0000","last_active":"2023-11-28T16:57:18.271324+0000","last_peered":"2023-11-28T16:57:18.271324+0000","last_clean":"2023-11-28T16:57:18.271324+0000","last_became_active":"2023-11-28T16:57:17.285238+0000","last_became_peered":"2023-11-28T16:57:17.285238+0000","last_unstale":"2023-11-28T16:57:18.271324+0000","last_undegraded":"2023-11-28T16:57:18.271324+0000","last_fullsized":"2023-11-28T16:57:18.271324+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:21.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274324+0000","last_change":"2023-11-28T16:57:02.890396+0000","last_active":"2023-11-28T16:57:17.274324+0000","last_peered":"2023-11-28T16:57:17.274324+0000","last_clean":"2023-11-28T16:57:17.274324+0000","last_became_active":"2023-11-28T16:57:02.890068+0000","last_became_peered":"2023-11-28T16:57:02.890068+0000","last_unstale":"2023-11-28T16:57:17.274324+0000","last_undegraded":"2023-11-28T16:57:17.274324+0000","last_fullsized":"2023-11-28T16:57:17.274324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.117385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279159+0000","last_change":"2023-11-28T16:57:03.889206+0000","last_active":"2023-11-28T16:57:17.279159+0000","last_peered":"2023-11-28T16:57:17.279159+0000","last_clean":"2023-11-28T16:57:17.279159+0000","last_became_active":"2023-11-28T16:57:03.888907+0000","last_became_peered":"2023-11-28T16:57:03.888907+0000","last_unstale":"2023-11-28T16:57:17.279159+0000","last_undegraded":"2023-11-28T16:57:17.279159+0000","last_fullsized":"2023-11-28T16:57:17.279159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:14.424053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271429+0000","last_change":"2023-11-28T16:57:16.318596+0000","last_active":"2023-11-28T16:57:18.271429+0000","last_peered":"2023-11-28T16:57:18.271429+0000","last_clean":"2023-11-28T16:57:18.271429+0000","last_became_active":"2023-11-28T16:57:16.318281+0000","last_became_peered":"2023-11-28T16:57:16.318281+0000","last_unstale":"2023-11-28T16:57:18.271429+0000","last_undegraded":"2023-11-28T16:57:18.271429+0000","last_fullsized":"2023-11-28T16:57:18.271429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:14.379445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.269057+0000","last_change":"2023-11-28T16:57:17.286895+0000","last_active":"2023-11-28T16:57:18.269057+0000","last_peered":"2023-11-28T16:57:18.269057+0000","last_clean":"2023-11-28T16:57:18.269057+0000","last_became_active":"2023-11-28T16:57:17.285206+0000","last_became_peered":"2023-11-28T16:57:17.285206+0000","last_unstale":"2023-11-28T16:57:18.269057+0000","last_undegraded":"2023-11-28T16:57:18.269057+0000","last_fullsized":"2023-11-28T16:57:18.269057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:16.986905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267795+0000","last_change":"2023-11-28T16:57:02.881277+0000","last_active":"2023-11-28T16:57:17.267795+0000","last_peered":"2023-11-28T16:57:17.267795+0000","last_clean":"2023-11-28T16:57:17.267795+0000","last_became_active":"2023-11-28T16:57:02.881004+0000","last_became_peered":"2023-11-28T16:57:02.881004+0000","last_unstale":"2023-11-28T16:57:17.267795+0000","last_undegraded":"2023-11-28T16:57:17.267795+0000","last_fullsized":"2023-11-28T16:57:17.267795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:42.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280166+0000","last_change":"2023-11-28T16:57:03.904109+0000","last_active":"2023-11-28T16:57:17.280166+0000","last_peered":"2023-11-28T16:57:17.280166+0000","last_clean":"2023-11-28T16:57:17.280166+0000","last_became_active":"2023-11-28T16:57:03.903816+0000","last_became_peered":"2023-11-28T16:57:03.903816+0000","last_unstale":"2023-11-28T16:57:17.280166+0000","last_undegraded":"2023-11-28T16:57:17.280166+0000","last_fullsized":"2023-11-28T16:57:17.280166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:40:05.723124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387912+0000","last_change":"2023-11-28T16:57:16.323306+0000","last_active":"2023-11-28T16:57:18.387912+0000","last_peered":"2023-11-28T16:57:18.387912+0000","last_clean":"2023-11-28T16:57:18.387912+0000","last_became_active":"2023-11-28T16:57:16.323029+0000","last_became_peered":"2023-11-28T16:57:16.323029+0000","last_unstale":"2023-11-28T16:57:18.387912+0000","last_undegraded":"2023-11-28T16:57:18.387912+0000","last_fullsized":"2023-11-28T16:57:18.387912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:46:00.469858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302297+0000","last_change":"2023-11-28T16:57:17.293041+0000","last_active":"2023-11-28T16:57:18.302297+0000","last_peered":"2023-11-28T16:57:18.302297+0000","last_clean":"2023-11-28T16:57:18.302297+0000","last_became_active":"2023-11-28T16:57:17.292732+0000","last_became_peered":"2023-11-28T16:57:17.292732+0000","last_unstale":"2023-11-28T16:57:18.302297+0000","last_undegraded":"2023-11-28T16:57:18.302297+0000","last_fullsized":"2023-11-28T16:57:18.302297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:37.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280253+0000","last_change":"2023-11-28T16:57:02.893953+0000","last_active":"2023-11-28T16:57:17.280253+0000","last_peered":"2023-11-28T16:57:17.280253+0000","last_clean":"2023-11-28T16:57:17.280253+0000","last_became_active":"2023-11-28T16:57:02.892987+0000","last_became_peered":"2023-11-28T16:57:02.892987+0000","last_unstale":"2023-11-28T16:57:17.280253+0000","last_undegraded":"2023-11-28T16:57:17.280253+0000","last_fullsized":"2023-11-28T16:57:17.280253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:08.372872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274014+0000","last_change":"2023-11-28T16:57:03.912991+0000","last_active":"2023-11-28T16:57:17.274014+0000","last_peered":"2023-11-28T16:57:17.274014+0000","last_clean":"2023-11-28T16:57:17.274014+0000","last_became_active":"2023-11-28T16:57:03.912733+0000","last_became_peered":"2023-11-28T16:57:03.912733+0000","last_unstale":"2023-11-28T16:57:17.274014+0000","last_undegraded":"2023-11-28T16:57:17.274014+0000","last_fullsized":"2023-11-28T16:57:17.274014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:53.206562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.269154+0000","last_change":"2023-11-28T16:57:16.316192+0000","last_active":"2023-11-28T16:57:18.269154+0000","last_peered":"2023-11-28T16:57:18.269154+0000","last_clean":"2023-11-28T16:57:18.269154+0000","last_became_active":"2023-11-28T16:57:16.315877+0000","last_became_peered":"2023-11-28T16:57:16.315877+0000","last_unstale":"2023-11-28T16:57:18.269154+0000","last_undegraded":"2023-11-28T16:57:18.269154+0000","last_fullsized":"2023-11-28T16:57:18.269154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:12:13.525628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268011+0000","last_change":"2023-11-28T16:57:17.279417+0000","last_active":"2023-11-28T16:57:18.268011+0000","last_peered":"2023-11-28T16:57:18.268011+0000","last_clean":"2023-11-28T16:57:18.268011+0000","last_became_active":"2023-11-28T16:57:17.278414+0000","last_became_peered":"2023-11-28T16:57:17.278414+0000","last_unstale":"2023-11-28T16:57:18.268011+0000","last_undegraded":"2023-11-28T16:57:18.268011+0000","last_fullsized":"2023-11-28T16:57:18.268011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:26.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274583+0000","last_change":"2023-11-28T16:57:02.883963+0000","last_active":"2023-11-28T16:57:17.274583+0000","last_peered":"2023-11-28T16:57:17.274583+0000","last_clean":"2023-11-28T16:57:17.274583+0000","last_became_active":"2023-11-28T16:57:02.883629+0000","last_became_peered":"2023-11-28T16:57:02.883629+0000","last_unstale":"2023-11-28T16:57:17.274583+0000","last_undegraded":"2023-11-28T16:57:17.274583+0000","last_fullsized":"2023-11-28T16:57:17.274583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:00.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.273044+0000","last_change":"2023-11-28T16:57:03.902695+0000","last_active":"2023-11-28T16:57:17.273044+0000","last_peered":"2023-11-28T16:57:17.273044+0000","last_clean":"2023-11-28T16:57:17.273044+0000","last_became_active":"2023-11-28T16:57:03.902147+0000","last_became_peered":"2023-11-28T16:57:03.902147+0000","last_unstale":"2023-11-28T16:57:17.273044+0000","last_undegraded":"2023-11-28T16:57:17.273044+0000","last_fullsized":"2023-11-28T16:57:17.273044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271023+0000","last_change":"2023-11-28T16:57:16.316379+0000","last_active":"2023-11-28T16:57:18.271023+0000","last_peered":"2023-11-28T16:57:18.271023+0000","last_clean":"2023-11-28T16:57:18.271023+0000","last_became_active":"2023-11-28T16:57:16.315880+0000","last_became_peered":"2023-11-28T16:57:16.315880+0000","last_unstale":"2023-11-28T16:57:18.271023+0000","last_undegraded":"2023-11-28T16:57:18.271023+0000","last_fullsized":"2023-11-28T16:57:18.271023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:14.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.270764+0000","last_change":"2023-11-28T16:57:17.296551+0000","last_active":"2023-11-28T16:57:18.270764+0000","last_peered":"2023-11-28T16:57:18.270764+0000","last_clean":"2023-11-28T16:57:18.270764+0000","last_became_active":"2023-11-28T16:57:17.296277+0000","last_became_peered":"2023-11-28T16:57:17.296277+0000","last_unstale":"2023-11-28T16:57:18.270764+0000","last_undegraded":"2023-11-28T16:57:18.270764+0000","last_fullsized":"2023-11-28T16:57:18.270764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:55.659722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279014+0000","last_change":"2023-11-28T16:57:02.887000+0000","last_active":"2023-11-28T16:57:17.279014+0000","last_peered":"2023-11-28T16:57:17.279014+0000","last_clean":"2023-11-28T16:57:17.279014+0000","last_became_active":"2023-11-28T16:57:02.886730+0000","last_became_peered":"2023-11-28T16:57:02.886730+0000","last_unstale":"2023-11-28T16:57:17.279014+0000","last_undegraded":"2023-11-28T16:57:17.279014+0000","last_fullsized":"2023-11-28T16:57:17.279014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:36.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274492+0000","last_change":"2023-11-28T16:57:03.892365+0000","last_active":"2023-11-28T16:57:17.274492+0000","last_peered":"2023-11-28T16:57:17.274492+0000","last_clean":"2023-11-28T16:57:17.274492+0000","last_became_active":"2023-11-28T16:57:03.892096+0000","last_became_peered":"2023-11-28T16:57:03.892096+0000","last_unstale":"2023-11-28T16:57:17.274492+0000","last_undegraded":"2023-11-28T16:57:17.274492+0000","last_fullsized":"2023-11-28T16:57:17.274492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:40.648716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302048+0000","last_change":"2023-11-28T16:57:16.322836+0000","last_active":"2023-11-28T16:57:18.302048+0000","last_peered":"2023-11-28T16:57:18.302048+0000","last_clean":"2023-11-28T16:57:18.302048+0000","last_became_active":"2023-11-28T16:57:16.322488+0000","last_became_peered":"2023-11-28T16:57:16.322488+0000","last_unstale":"2023-11-28T16:57:18.302048+0000","last_undegraded":"2023-11-28T16:57:18.302048+0000","last_fullsized":"2023-11-28T16:57:18.302048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:15.979136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.390715+0000","last_change":"2023-11-28T16:57:17.281960+0000","last_active":"2023-11-28T16:57:18.390715+0000","last_peered":"2023-11-28T16:57:18.390715+0000","last_clean":"2023-11-28T16:57:18.390715+0000","last_became_active":"2023-11-28T16:57:17.281682+0000","last_became_peered":"2023-11-28T16:57:17.281682+0000","last_unstale":"2023-11-28T16:57:18.390715+0000","last_undegraded":"2023-11-28T16:57:18.390715+0000","last_fullsized":"2023-11-28T16:57:18.390715+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:27.856924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277934+0000","last_change":"2023-11-28T16:57:02.884058+0000","last_active":"2023-11-28T16:57:17.277934+0000","last_peered":"2023-11-28T16:57:17.277934+0000","last_clean":"2023-11-28T16:57:17.277934+0000","last_became_active":"2023-11-28T16:57:02.883737+0000","last_became_peered":"2023-11-28T16:57:02.883737+0000","last_unstale":"2023-11-28T16:57:17.277934+0000","last_undegraded":"2023-11-28T16:57:17.277934+0000","last_fullsized":"2023-11-28T16:57:17.277934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:17:33.236125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.273661+0000","last_change":"2023-11-28T16:57:03.889038+0000","last_active":"2023-11-28T16:57:17.273661+0000","last_peered":"2023-11-28T16:57:17.273661+0000","last_clean":"2023-11-28T16:57:17.273661+0000","last_became_active":"2023-11-28T16:57:03.888749+0000","last_became_peered":"2023-11-28T16:57:03.888749+0000","last_unstale":"2023-11-28T16:57:17.273661+0000","last_undegraded":"2023-11-28T16:57:17.273661+0000","last_fullsized":"2023-11-28T16:57:17.273661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:45.769525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267574+0000","last_change":"2023-11-28T16:57:16.324487+0000","last_active":"2023-11-28T16:57:18.267574+0000","last_peered":"2023-11-28T16:57:18.267574+0000","last_clean":"2023-11-28T16:57:18.267574+0000","last_became_active":"2023-11-28T16:57:16.324158+0000","last_became_peered":"2023-11-28T16:57:16.324158+0000","last_unstale":"2023-11-28T16:57:18.267574+0000","last_undegraded":"2023-11-28T16:57:18.267574+0000","last_fullsized":"2023-11-28T16:57:18.267574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:14.379445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267531+0000","last_change":"2023-11-28T16:57:17.295115+0000","last_active":"2023-11-28T16:57:18.267531+0000","last_peered":"2023-11-28T16:57:18.267531+0000","last_clean":"2023-11-28T16:57:18.267531+0000","last_became_active":"2023-11-28T16:57:17.293664+0000","last_became_peered":"2023-11-28T16:57:17.293664+0000","last_unstale":"2023-11-28T16:57:18.267531+0000","last_undegraded":"2023-11-28T16:57:18.267531+0000","last_fullsized":"2023-11-28T16:57:18.267531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:21.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277566+0000","last_change":"2023-11-28T16:57:02.883245+0000","last_active":"2023-11-28T16:57:17.277566+0000","last_peered":"2023-11-28T16:57:17.277566+0000","last_clean":"2023-11-28T16:57:17.277566+0000","last_became_active":"2023-11-28T16:57:02.882929+0000","last_became_peered":"2023-11-28T16:57:02.882929+0000","last_unstale":"2023-11-28T16:57:17.277566+0000","last_undegraded":"2023-11-28T16:57:17.277566+0000","last_fullsized":"2023-11-28T16:57:17.277566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:57:59.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265576+0000","last_change":"2023-11-28T16:57:03.897702+0000","last_active":"2023-11-28T16:57:17.265576+0000","last_peered":"2023-11-28T16:57:17.265576+0000","last_clean":"2023-11-28T16:57:17.265576+0000","last_became_active":"2023-11-28T16:57:03.895461+0000","last_became_peered":"2023-11-28T16:57:03.895461+0000","last_unstale":"2023-11-28T16:57:17.265576+0000","last_undegraded":"2023-11-28T16:57:17.265576+0000","last_fullsized":"2023-11-28T16:57:17.265576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:40:05.723124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388941+0000","last_change":"2023-11-28T16:57:16.320298+0000","last_active":"2023-11-28T16:57:18.388941+0000","last_peered":"2023-11-28T16:57:18.388941+0000","last_clean":"2023-11-28T16:57:18.388941+0000","last_became_active":"2023-11-28T16:57:16.320016+0000","last_became_peered":"2023-11-28T16:57:16.320016+0000","last_unstale":"2023-11-28T16:57:18.388941+0000","last_undegraded":"2023-11-28T16:57:18.388941+0000","last_fullsized":"2023-11-28T16:57:18.388941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:15.959814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391435+0000","last_change":"2023-11-28T16:57:17.291422+0000","last_active":"2023-11-28T16:57:18.391435+0000","last_peered":"2023-11-28T16:57:18.391435+0000","last_clean":"2023-11-28T16:57:18.391435+0000","last_became_active":"2023-11-28T16:57:17.291137+0000","last_became_peered":"2023-11-28T16:57:17.291137+0000","last_unstale":"2023-11-28T16:57:18.391435+0000","last_undegraded":"2023-11-28T16:57:18.391435+0000","last_fullsized":"2023-11-28T16:57:18.391435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:15.387214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271453+0000","last_change":"2023-11-28T16:57:16.316919+0000","last_active":"2023-11-28T16:57:18.271453+0000","last_peered":"2023-11-28T16:57:18.271453+0000","last_clean":"2023-11-28T16:57:18.271453+0000","last_became_active":"2023-11-28T16:57:16.316589+0000","last_became_peered":"2023-11-28T16:57:16.316589+0000","last_unstale":"2023-11-28T16:57:18.271453+0000","last_undegraded":"2023-11-28T16:57:18.271453+0000","last_fullsized":"2023-11-28T16:57:18.271453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:13.912140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.270079+0000","last_change":"2023-11-28T16:57:02.893416+0000","last_active":"2023-11-28T16:57:17.270079+0000","last_peered":"2023-11-28T16:57:17.270079+0000","last_clean":"2023-11-28T16:57:17.270079+0000","last_became_active":"2023-11-28T16:57:02.892837+0000","last_became_peered":"2023-11-28T16:57:02.892837+0000","last_unstale":"2023-11-28T16:57:17.270079+0000","last_undegraded":"2023-11-28T16:57:17.270079+0000","last_fullsized":"2023-11-28T16:57:17.270079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:35.400319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.278577+0000","last_change":"2023-11-28T16:57:03.899996+0000","last_active":"2023-11-28T16:57:17.278577+0000","last_peered":"2023-11-28T16:57:17.278577+0000","last_clean":"2023-11-28T16:57:17.278577+0000","last_became_active":"2023-11-28T16:57:03.899369+0000","last_became_peered":"2023-11-28T16:57:03.899369+0000","last_unstale":"2023-11-28T16:57:17.278577+0000","last_undegraded":"2023-11-28T16:57:17.278577+0000","last_fullsized":"2023-11-28T16:57:17.278577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:46.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388793+0000","last_change":"2023-11-28T16:57:17.285838+0000","last_active":"2023-11-28T16:57:18.388793+0000","last_peered":"2023-11-28T16:57:18.388793+0000","last_clean":"2023-11-28T16:57:18.388793+0000","last_became_active":"2023-11-28T16:57:17.285529+0000","last_became_peered":"2023-11-28T16:57:17.285529+0000","last_unstale":"2023-11-28T16:57:18.388793+0000","last_undegraded":"2023-11-28T16:57:18.388793+0000","last_fullsized":"2023-11-28T16:57:18.388793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:28.071859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302687+0000","last_change":"2023-11-28T16:57:16.327985+0000","last_active":"2023-11-28T16:57:18.302687+0000","last_peered":"2023-11-28T16:57:18.302687+0000","last_clean":"2023-11-28T16:57:18.302687+0000","last_became_active":"2023-11-28T16:57:16.327626+0000","last_became_peered":"2023-11-28T16:57:16.327626+0000","last_unstale":"2023-11-28T16:57:18.302687+0000","last_undegraded":"2023-11-28T16:57:18.302687+0000","last_fullsized":"2023-11-28T16:57:18.302687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:34.561371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.278730+0000","last_change":"2023-11-28T16:57:02.895629+0000","last_active":"2023-11-28T16:57:17.278730+0000","last_peered":"2023-11-28T16:57:17.278730+0000","last_clean":"2023-11-28T16:57:17.278730+0000","last_became_active":"2023-11-28T16:57:02.895339+0000","last_became_peered":"2023-11-28T16:57:02.895339+0000","last_unstale":"2023-11-28T16:57:17.278730+0000","last_undegraded":"2023-11-28T16:57:17.278730+0000","last_fullsized":"2023-11-28T16:57:17.278730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:22.670983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.278508+0000","last_change":"2023-11-28T16:57:03.898573+0000","last_active":"2023-11-28T16:57:17.278508+0000","last_peered":"2023-11-28T16:57:17.278508+0000","last_clean":"2023-11-28T16:57:17.278508+0000","last_became_active":"2023-11-28T16:57:03.898275+0000","last_became_peered":"2023-11-28T16:57:03.898275+0000","last_unstale":"2023-11-28T16:57:17.278508+0000","last_undegraded":"2023-11-28T16:57:17.278508+0000","last_fullsized":"2023-11-28T16:57:17.278508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:37.704530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388728+0000","last_change":"2023-11-28T16:57:17.291996+0000","last_active":"2023-11-28T16:57:18.388728+0000","last_peered":"2023-11-28T16:57:18.388728+0000","last_clean":"2023-11-28T16:57:18.388728+0000","last_became_active":"2023-11-28T16:57:17.291656+0000","last_became_peered":"2023-11-28T16:57:17.291656+0000","last_unstale":"2023-11-28T16:57:18.388728+0000","last_undegraded":"2023-11-28T16:57:18.388728+0000","last_fullsized":"2023-11-28T16:57:18.388728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:43.855608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267612+0000","last_change":"2023-11-28T16:57:02.878046+0000","last_active":"2023-11-28T16:57:17.267612+0000","last_peered":"2023-11-28T16:57:17.267612+0000","last_clean":"2023-11-28T16:57:17.267612+0000","last_became_active":"2023-11-28T16:57:02.877719+0000","last_became_peered":"2023-11-28T16:57:02.877719+0000","last_unstale":"2023-11-28T16:57:17.267612+0000","last_undegraded":"2023-11-28T16:57:17.267612+0000","last_fullsized":"2023-11-28T16:57:17.267612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.283187+0000","last_change":"2023-11-28T16:57:03.891242+0000","last_active":"2023-11-28T16:57:17.283187+0000","last_peered":"2023-11-28T16:57:17.283187+0000","last_clean":"2023-11-28T16:57:17.283187+0000","last_became_active":"2023-11-28T16:57:03.890884+0000","last_became_peered":"2023-11-28T16:57:03.890884+0000","last_unstale":"2023-11-28T16:57:17.283187+0000","last_undegraded":"2023-11-28T16:57:17.283187+0000","last_fullsized":"2023-11-28T16:57:17.283187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.269029+0000","last_change":"2023-11-28T16:57:16.315209+0000","last_active":"2023-11-28T16:57:18.269029+0000","last_peered":"2023-11-28T16:57:18.269029+0000","last_clean":"2023-11-28T16:57:18.269029+0000","last_became_active":"2023-11-28T16:57:16.314887+0000","last_became_peered":"2023-11-28T16:57:16.314887+0000","last_unstale":"2023-11-28T16:57:18.269029+0000","last_undegraded":"2023-11-28T16:57:18.269029+0000","last_fullsized":"2023-11-28T16:57:18.269029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:05.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.389441+0000","last_change":"2023-11-28T16:57:17.287994+0000","last_active":"2023-11-28T16:57:18.389441+0000","last_peered":"2023-11-28T16:57:18.389441+0000","last_clean":"2023-11-28T16:57:18.389441+0000","last_became_active":"2023-11-28T16:57:17.287669+0000","last_became_peered":"2023-11-28T16:57:17.287669+0000","last_unstale":"2023-11-28T16:57:18.389441+0000","last_undegraded":"2023-11-28T16:57:18.389441+0000","last_fullsized":"2023-11-28T16:57:18.389441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:12:14.533397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.283263+0000","last_change":"2023-11-28T16:57:02.890520+0000","last_active":"2023-11-28T16:57:17.283263+0000","last_peered":"2023-11-28T16:57:17.283263+0000","last_clean":"2023-11-28T16:57:17.283263+0000","last_became_active":"2023-11-28T16:57:02.890238+0000","last_became_peered":"2023-11-28T16:57:02.890238+0000","last_unstale":"2023-11-28T16:57:17.283263+0000","last_undegraded":"2023-11-28T16:57:17.283263+0000","last_fullsized":"2023-11-28T16:57:17.283263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:01.847236+0000","last_clean_scrub_stamp":"2023-11-28T16:57:01.847236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:39.642296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267518+0000","last_change":"2023-11-28T16:57:03.894765+0000","last_active":"2023-11-28T16:57:17.267518+0000","last_peered":"2023-11-28T16:57:17.267518+0000","last_clean":"2023-11-28T16:57:17.267518+0000","last_became_active":"2023-11-28T16:57:03.894466+0000","last_became_peered":"2023-11-28T16:57:03.894466+0000","last_unstale":"2023-11-28T16:57:17.267518+0000","last_undegraded":"2023-11-28T16:57:17.267518+0000","last_fullsized":"2023-11-28T16:57:17.267518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.388837+0000","last_change":"2023-11-28T16:57:16.326472+0000","last_active":"2023-11-28T16:57:18.388837+0000","last_peered":"2023-11-28T16:57:18.388837+0000","last_clean":"2023-11-28T16:57:18.388837+0000","last_became_active":"2023-11-28T16:57:16.326082+0000","last_became_peered":"2023-11-28T16:57:16.326082+0000","last_unstale":"2023-11-28T16:57:18.388837+0000","last_undegraded":"2023-11-28T16:57:18.388837+0000","last_fullsized":"2023-11-28T16:57:18.388837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:15.278759+0000","last_clean_scrub_stamp":"2023-11-28T16:57:15.278759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:05.052779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.270763+0000","last_change":"2023-11-28T16:57:17.283419+0000","last_active":"2023-11-28T16:57:18.270763+0000","last_peered":"2023-11-28T16:57:18.270763+0000","last_clean":"2023-11-28T16:57:18.270763+0000","last_became_active":"2023-11-28T16:57:17.283130+0000","last_became_peered":"2023-11-28T16:57:17.283130+0000","last_unstale":"2023-11-28T16:57:18.270763+0000","last_undegraded":"2023-11-28T16:57:18.270763+0000","last_fullsized":"2023-11-28T16:57:18.270763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:28.071859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265298+0000","last_change":"2023-11-28T16:57:03.886973+0000","last_active":"2023-11-28T16:57:17.265298+0000","last_peered":"2023-11-28T16:57:17.265298+0000","last_clean":"2023-11-28T16:57:17.265298+0000","last_became_active":"2023-11-28T16:57:03.886340+0000","last_became_peered":"2023-11-28T16:57:03.886340+0000","last_unstale":"2023-11-28T16:57:17.265298+0000","last_undegraded":"2023-11-28T16:57:17.265298+0000","last_fullsized":"2023-11-28T16:57:17.265298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:45.769525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391033+0000","last_change":"2023-11-28T16:57:17.291406+0000","last_active":"2023-11-28T16:57:18.391033+0000","last_peered":"2023-11-28T16:57:18.391033+0000","last_clean":"2023-11-28T16:57:18.391033+0000","last_became_active":"2023-11-28T16:57:17.290782+0000","last_became_peered":"2023-11-28T16:57:17.290782+0000","last_unstale":"2023-11-28T16:57:18.391033+0000","last_undegraded":"2023-11-28T16:57:18.391033+0000","last_fullsized":"2023-11-28T16:57:18.391033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:26.327817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280730+0000","last_change":"2023-11-28T16:57:03.892625+0000","last_active":"2023-11-28T16:57:17.280730+0000","last_peered":"2023-11-28T16:57:17.280730+0000","last_clean":"2023-11-28T16:57:17.280730+0000","last_became_active":"2023-11-28T16:57:03.892360+0000","last_became_peered":"2023-11-28T16:57:03.892360+0000","last_unstale":"2023-11-28T16:57:17.280730+0000","last_undegraded":"2023-11-28T16:57:17.280730+0000","last_fullsized":"2023-11-28T16:57:17.280730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387490+0000","last_change":"2023-11-28T16:57:17.288107+0000","last_active":"2023-11-28T16:57:18.387490+0000","last_peered":"2023-11-28T16:57:18.387490+0000","last_clean":"2023-11-28T16:57:18.387490+0000","last_became_active":"2023-11-28T16:57:17.287714+0000","last_became_peered":"2023-11-28T16:57:17.287714+0000","last_unstale":"2023-11-28T16:57:18.387490+0000","last_undegraded":"2023-11-28T16:57:18.387490+0000","last_fullsized":"2023-11-28T16:57:18.387490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:39.556677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265515+0000","last_change":"2023-11-28T16:57:03.904013+0000","last_active":"2023-11-28T16:57:17.265515+0000","last_peered":"2023-11-28T16:57:17.265515+0000","last_clean":"2023-11-28T16:57:17.265515+0000","last_became_active":"2023-11-28T16:57:03.903753+0000","last_became_peered":"2023-11-28T16:57:03.903753+0000","last_unstale":"2023-11-28T16:57:17.265515+0000","last_undegraded":"2023-11-28T16:57:17.265515+0000","last_fullsized":"2023-11-28T16:57:17.265515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:43.387129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.301966+0000","last_change":"2023-11-28T16:57:17.290152+0000","last_active":"2023-11-28T16:57:18.301966+0000","last_peered":"2023-11-28T16:57:18.301966+0000","last_clean":"2023-11-28T16:57:18.301966+0000","last_became_active":"2023-11-28T16:57:17.289765+0000","last_became_peered":"2023-11-28T16:57:17.289765+0000","last_unstale":"2023-11-28T16:57:18.301966+0000","last_undegraded":"2023-11-28T16:57:18.301966+0000","last_fullsized":"2023-11-28T16:57:18.301966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:38.777942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277457+0000","last_change":"2023-11-28T16:57:03.884478+0000","last_active":"2023-11-28T16:57:17.277457+0000","last_peered":"2023-11-28T16:57:17.277457+0000","last_clean":"2023-11-28T16:57:17.277457+0000","last_became_active":"2023-11-28T16:57:03.884199+0000","last_became_peered":"2023-11-28T16:57:03.884199+0000","last_unstale":"2023-11-28T16:57:17.277457+0000","last_undegraded":"2023-11-28T16:57:17.277457+0000","last_fullsized":"2023-11-28T16:57:17.277457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:24.161497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387767+0000","last_change":"2023-11-28T16:57:17.287172+0000","last_active":"2023-11-28T16:57:18.387767+0000","last_peered":"2023-11-28T16:57:18.387767+0000","last_clean":"2023-11-28T16:57:18.387767+0000","last_became_active":"2023-11-28T16:57:17.286571+0000","last_became_peered":"2023-11-28T16:57:17.286571+0000","last_unstale":"2023-11-28T16:57:18.387767+0000","last_undegraded":"2023-11-28T16:57:18.387767+0000","last_fullsized":"2023-11-28T16:57:18.387767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:37.110275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.273804+0000","last_change":"2023-11-28T16:57:03.894338+0000","last_active":"2023-11-28T16:57:17.273804+0000","last_peered":"2023-11-28T16:57:17.273804+0000","last_clean":"2023-11-28T16:57:17.273804+0000","last_became_active":"2023-11-28T16:57:03.894019+0000","last_became_peered":"2023-11-28T16:57:03.894019+0000","last_unstale":"2023-11-28T16:57:17.273804+0000","last_undegraded":"2023-11-28T16:57:17.273804+0000","last_fullsized":"2023-11-28T16:57:17.273804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:11.545685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391550+0000","last_change":"2023-11-28T16:57:17.297986+0000","last_active":"2023-11-28T16:57:18.391550+0000","last_peered":"2023-11-28T16:57:18.391550+0000","last_clean":"2023-11-28T16:57:18.391550+0000","last_became_active":"2023-11-28T16:57:17.296980+0000","last_became_peered":"2023-11-28T16:57:17.296980+0000","last_unstale":"2023-11-28T16:57:18.391550+0000","last_undegraded":"2023-11-28T16:57:18.391550+0000","last_fullsized":"2023-11-28T16:57:18.391550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:43.855608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.278677+0000","last_change":"2023-11-28T16:57:03.899721+0000","last_active":"2023-11-28T16:57:17.278677+0000","last_peered":"2023-11-28T16:57:17.278677+0000","last_clean":"2023-11-28T16:57:17.278677+0000","last_became_active":"2023-11-28T16:57:03.898861+0000","last_became_peered":"2023-11-28T16:57:03.898861+0000","last_unstale":"2023-11-28T16:57:17.278677+0000","last_undegraded":"2023-11-28T16:57:17.278677+0000","last_fullsized":"2023-11-28T16:57:17.278677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.389172+0000","last_change":"2023-11-28T16:57:17.288314+0000","last_active":"2023-11-28T16:57:18.389172+0000","last_peered":"2023-11-28T16:57:18.389172+0000","last_clean":"2023-11-28T16:57:18.389172+0000","last_became_active":"2023-11-28T16:57:17.284874+0000","last_became_peered":"2023-11-28T16:57:17.284874+0000","last_unstale":"2023-11-28T16:57:18.389172+0000","last_undegraded":"2023-11-28T16:57:18.389172+0000","last_fullsized":"2023-11-28T16:57:18.389172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:26.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280025+0000","last_change":"2023-11-28T16:57:03.891455+0000","last_active":"2023-11-28T16:57:17.280025+0000","last_peered":"2023-11-28T16:57:17.280025+0000","last_clean":"2023-11-28T16:57:17.280025+0000","last_became_active":"2023-11-28T16:57:03.890363+0000","last_became_peered":"2023-11-28T16:57:03.890363+0000","last_unstale":"2023-11-28T16:57:17.280025+0000","last_undegraded":"2023-11-28T16:57:17.280025+0000","last_fullsized":"2023-11-28T16:57:17.280025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:01.651003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271045+0000","last_change":"2023-11-28T16:57:17.284268+0000","last_active":"2023-11-28T16:57:18.271045+0000","last_peered":"2023-11-28T16:57:18.271045+0000","last_clean":"2023-11-28T16:57:18.271045+0000","last_became_active":"2023-11-28T16:57:17.284013+0000","last_became_peered":"2023-11-28T16:57:17.284013+0000","last_unstale":"2023-11-28T16:57:18.271045+0000","last_undegraded":"2023-11-28T16:57:18.271045+0000","last_fullsized":"2023-11-28T16:57:18.271045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:29.046687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277636+0000","last_change":"2023-11-28T16:57:03.885984+0000","last_active":"2023-11-28T16:57:17.277636+0000","last_peered":"2023-11-28T16:57:17.277636+0000","last_clean":"2023-11-28T16:57:17.277636+0000","last_became_active":"2023-11-28T16:57:03.885297+0000","last_became_peered":"2023-11-28T16:57:03.885297+0000","last_unstale":"2023-11-28T16:57:17.277636+0000","last_undegraded":"2023-11-28T16:57:17.277636+0000","last_fullsized":"2023-11-28T16:57:17.277636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:50.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267803+0000","last_change":"2023-11-28T16:57:17.292501+0000","last_active":"2023-11-28T16:57:18.267803+0000","last_peered":"2023-11-28T16:57:18.267803+0000","last_clean":"2023-11-28T16:57:18.267803+0000","last_became_active":"2023-11-28T16:57:17.292210+0000","last_became_peered":"2023-11-28T16:57:17.292210+0000","last_unstale":"2023-11-28T16:57:18.267803+0000","last_undegraded":"2023-11-28T16:57:18.267803+0000","last_fullsized":"2023-11-28T16:57:18.267803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:06.229422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274167+0000","last_change":"2023-11-28T16:57:03.889249+0000","last_active":"2023-11-28T16:57:17.274167+0000","last_peered":"2023-11-28T16:57:17.274167+0000","last_clean":"2023-11-28T16:57:17.274167+0000","last_became_active":"2023-11-28T16:57:03.888913+0000","last_became_peered":"2023-11-28T16:57:03.888913+0000","last_unstale":"2023-11-28T16:57:17.274167+0000","last_undegraded":"2023-11-28T16:57:17.274167+0000","last_fullsized":"2023-11-28T16:57:17.274167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:46.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302480+0000","last_change":"2023-11-28T16:57:17.294468+0000","last_active":"2023-11-28T16:57:18.302480+0000","last_peered":"2023-11-28T16:57:18.302480+0000","last_clean":"2023-11-28T16:57:18.302480+0000","last_became_active":"2023-11-28T16:57:17.294242+0000","last_became_peered":"2023-11-28T16:57:17.294242+0000","last_unstale":"2023-11-28T16:57:18.302480+0000","last_undegraded":"2023-11-28T16:57:18.302480+0000","last_fullsized":"2023-11-28T16:57:18.302480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:07.203701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.266342+0000","last_change":"2023-11-28T16:57:03.888524+0000","last_active":"2023-11-28T16:57:17.266342+0000","last_peered":"2023-11-28T16:57:17.266342+0000","last_clean":"2023-11-28T16:57:17.266342+0000","last_became_active":"2023-11-28T16:57:03.885162+0000","last_became_peered":"2023-11-28T16:57:03.885162+0000","last_unstale":"2023-11-28T16:57:17.266342+0000","last_undegraded":"2023-11-28T16:57:17.266342+0000","last_fullsized":"2023-11-28T16:57:17.266342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.390656+0000","last_change":"2023-11-28T16:57:17.290833+0000","last_active":"2023-11-28T16:57:18.390656+0000","last_peered":"2023-11-28T16:57:18.390656+0000","last_clean":"2023-11-28T16:57:18.390656+0000","last_became_active":"2023-11-28T16:57:17.288915+0000","last_became_peered":"2023-11-28T16:57:17.288915+0000","last_unstale":"2023-11-28T16:57:18.390656+0000","last_undegraded":"2023-11-28T16:57:18.390656+0000","last_fullsized":"2023-11-28T16:57:18.390656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:40:19.155996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277709+0000","last_change":"2023-11-28T16:57:03.888953+0000","last_active":"2023-11-28T16:57:17.277709+0000","last_peered":"2023-11-28T16:57:17.277709+0000","last_clean":"2023-11-28T16:57:17.277709+0000","last_became_active":"2023-11-28T16:57:03.888624+0000","last_became_peered":"2023-11-28T16:57:03.888624+0000","last_unstale":"2023-11-28T16:57:17.277709+0000","last_undegraded":"2023-11-28T16:57:17.277709+0000","last_fullsized":"2023-11-28T16:57:17.277709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:48.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391155+0000","last_change":"2023-11-28T16:57:17.282824+0000","last_active":"2023-11-28T16:57:18.391155+0000","last_peered":"2023-11-28T16:57:18.391155+0000","last_clean":"2023-11-28T16:57:18.391155+0000","last_became_active":"2023-11-28T16:57:17.282429+0000","last_became_peered":"2023-11-28T16:57:17.282429+0000","last_unstale":"2023-11-28T16:57:18.391155+0000","last_undegraded":"2023-11-28T16:57:18.391155+0000","last_fullsized":"2023-11-28T16:57:18.391155+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:15.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277352+0000","last_change":"2023-11-28T16:57:03.885753+0000","last_active":"2023-11-28T16:57:17.277352+0000","last_peered":"2023-11-28T16:57:17.277352+0000","last_clean":"2023-11-28T16:57:17.277352+0000","last_became_active":"2023-11-28T16:57:03.885404+0000","last_became_peered":"2023-11-28T16:57:03.885404+0000","last_unstale":"2023-11-28T16:57:17.277352+0000","last_undegraded":"2023-11-28T16:57:17.277352+0000","last_fullsized":"2023-11-28T16:57:17.277352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:33.007817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271227+0000","last_change":"2023-11-28T16:57:17.290139+0000","last_active":"2023-11-28T16:57:18.271227+0000","last_peered":"2023-11-28T16:57:18.271227+0000","last_clean":"2023-11-28T16:57:18.271227+0000","last_became_active":"2023-11-28T16:57:17.289789+0000","last_became_peered":"2023-11-28T16:57:17.289789+0000","last_unstale":"2023-11-28T16:57:18.271227+0000","last_undegraded":"2023-11-28T16:57:18.271227+0000","last_fullsized":"2023-11-28T16:57:18.271227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:16.967583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.269887+0000","last_change":"2023-11-28T16:57:03.893588+0000","last_active":"2023-11-28T16:57:17.269887+0000","last_peered":"2023-11-28T16:57:17.269887+0000","last_clean":"2023-11-28T16:57:17.269887+0000","last_became_active":"2023-11-28T16:57:03.891825+0000","last_became_peered":"2023-11-28T16:57:03.891825+0000","last_unstale":"2023-11-28T16:57:17.269887+0000","last_undegraded":"2023-11-28T16:57:17.269887+0000","last_fullsized":"2023-11-28T16:57:17.269887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:29:39.475409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271320+0000","last_change":"2023-11-28T16:57:17.292172+0000","last_active":"2023-11-28T16:57:18.271320+0000","last_peered":"2023-11-28T16:57:18.271320+0000","last_clean":"2023-11-28T16:57:18.271320+0000","last_became_active":"2023-11-28T16:57:17.290028+0000","last_became_peered":"2023-11-28T16:57:17.290028+0000","last_unstale":"2023-11-28T16:57:18.271320+0000","last_undegraded":"2023-11-28T16:57:18.271320+0000","last_fullsized":"2023-11-28T16:57:18.271320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:08:03.897540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.278588+0000","last_change":"2023-11-28T16:57:03.910151+0000","last_active":"2023-11-28T16:57:17.278588+0000","last_peered":"2023-11-28T16:57:17.278588+0000","last_clean":"2023-11-28T16:57:17.278588+0000","last_became_active":"2023-11-28T16:57:03.909840+0000","last_became_peered":"2023-11-28T16:57:03.909840+0000","last_unstale":"2023-11-28T16:57:17.278588+0000","last_undegraded":"2023-11-28T16:57:17.278588+0000","last_fullsized":"2023-11-28T16:57:17.278588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:11.545685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387926+0000","last_change":"2023-11-28T16:57:17.282245+0000","last_active":"2023-11-28T16:57:18.387926+0000","last_peered":"2023-11-28T16:57:18.387926+0000","last_clean":"2023-11-28T16:57:18.387926+0000","last_became_active":"2023-11-28T16:57:17.281932+0000","last_became_peered":"2023-11-28T16:57:17.281932+0000","last_unstale":"2023-11-28T16:57:18.387926+0000","last_undegraded":"2023-11-28T16:57:18.387926+0000","last_fullsized":"2023-11-28T16:57:18.387926+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:30.681487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279918+0000","last_change":"2023-11-28T16:57:03.891691+0000","last_active":"2023-11-28T16:57:17.279918+0000","last_peered":"2023-11-28T16:57:17.279918+0000","last_clean":"2023-11-28T16:57:17.279918+0000","last_became_active":"2023-11-28T16:57:03.890689+0000","last_became_peered":"2023-11-28T16:57:03.890689+0000","last_unstale":"2023-11-28T16:57:17.279918+0000","last_undegraded":"2023-11-28T16:57:17.279918+0000","last_fullsized":"2023-11-28T16:57:17.279918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:12.894945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.391466+0000","last_change":"2023-11-28T16:57:17.294589+0000","last_active":"2023-11-28T16:57:18.391466+0000","last_peered":"2023-11-28T16:57:18.391466+0000","last_clean":"2023-11-28T16:57:18.391466+0000","last_became_active":"2023-11-28T16:57:17.294296+0000","last_became_peered":"2023-11-28T16:57:17.294296+0000","last_unstale":"2023-11-28T16:57:18.391466+0000","last_undegraded":"2023-11-28T16:57:18.391466+0000","last_fullsized":"2023-11-28T16:57:18.391466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:14.919909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267912+0000","last_change":"2023-11-28T16:57:03.899079+0000","last_active":"2023-11-28T16:57:17.267912+0000","last_peered":"2023-11-28T16:57:17.267912+0000","last_clean":"2023-11-28T16:57:17.267912+0000","last_became_active":"2023-11-28T16:57:03.898739+0000","last_became_peered":"2023-11-28T16:57:03.898739+0000","last_unstale":"2023-11-28T16:57:17.267912+0000","last_undegraded":"2023-11-28T16:57:17.267912+0000","last_fullsized":"2023-11-28T16:57:17.267912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:12.894945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267754+0000","last_change":"2023-11-28T16:57:17.286514+0000","last_active":"2023-11-28T16:57:18.267754+0000","last_peered":"2023-11-28T16:57:18.267754+0000","last_clean":"2023-11-28T16:57:18.267754+0000","last_became_active":"2023-11-28T16:57:17.286205+0000","last_became_peered":"2023-11-28T16:57:17.286205+0000","last_unstale":"2023-11-28T16:57:18.267754+0000","last_undegraded":"2023-11-28T16:57:18.267754+0000","last_fullsized":"2023-11-28T16:57:18.267754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:24.721287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265673+0000","last_change":"2023-11-28T16:57:03.899703+0000","last_active":"2023-11-28T16:57:17.265673+0000","last_peered":"2023-11-28T16:57:17.265673+0000","last_clean":"2023-11-28T16:57:17.265673+0000","last_became_active":"2023-11-28T16:57:03.899394+0000","last_became_peered":"2023-11-28T16:57:03.899394+0000","last_unstale":"2023-11-28T16:57:17.265673+0000","last_undegraded":"2023-11-28T16:57:17.265673+0000","last_fullsized":"2023-11-28T16:57:17.265673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:11.545685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.387548+0000","last_change":"2023-11-28T16:57:17.284727+0000","last_active":"2023-11-28T16:57:18.387548+0000","last_peered":"2023-11-28T16:57:18.387548+0000","last_clean":"2023-11-28T16:57:18.387548+0000","last_became_active":"2023-11-28T16:57:17.284452+0000","last_became_peered":"2023-11-28T16:57:17.284452+0000","last_unstale":"2023-11-28T16:57:18.387548+0000","last_undegraded":"2023-11-28T16:57:18.387548+0000","last_fullsized":"2023-11-28T16:57:18.387548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:40:11.509341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.275643+0000","last_change":"2023-11-28T16:57:03.895417+0000","last_active":"2023-11-28T16:57:17.275643+0000","last_peered":"2023-11-28T16:57:17.275643+0000","last_clean":"2023-11-28T16:57:17.275643+0000","last_became_active":"2023-11-28T16:57:03.895139+0000","last_became_peered":"2023-11-28T16:57:03.895139+0000","last_unstale":"2023-11-28T16:57:17.275643+0000","last_undegraded":"2023-11-28T16:57:17.275643+0000","last_fullsized":"2023-11-28T16:57:17.275643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:39.503006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.390756+0000","last_change":"2023-11-28T16:57:17.294769+0000","last_active":"2023-11-28T16:57:18.390756+0000","last_peered":"2023-11-28T16:57:18.390756+0000","last_clean":"2023-11-28T16:57:18.390756+0000","last_became_active":"2023-11-28T16:57:17.294124+0000","last_became_peered":"2023-11-28T16:57:17.294124+0000","last_unstale":"2023-11-28T16:57:18.390756+0000","last_undegraded":"2023-11-28T16:57:18.390756+0000","last_fullsized":"2023-11-28T16:57:18.390756+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:56.820001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279497+0000","last_change":"2023-11-28T16:57:03.889443+0000","last_active":"2023-11-28T16:57:17.279497+0000","last_peered":"2023-11-28T16:57:17.279497+0000","last_clean":"2023-11-28T16:57:17.279497+0000","last_became_active":"2023-11-28T16:57:03.888958+0000","last_became_peered":"2023-11-28T16:57:03.888958+0000","last_unstale":"2023-11-28T16:57:17.279497+0000","last_undegraded":"2023-11-28T16:57:17.279497+0000","last_fullsized":"2023-11-28T16:57:17.279497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:43.387129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.301861+0000","last_change":"2023-11-28T16:57:17.286913+0000","last_active":"2023-11-28T16:57:18.301861+0000","last_peered":"2023-11-28T16:57:18.301861+0000","last_clean":"2023-11-28T16:57:18.301861+0000","last_became_active":"2023-11-28T16:57:17.284804+0000","last_became_peered":"2023-11-28T16:57:17.284804+0000","last_unstale":"2023-11-28T16:57:18.301861+0000","last_undegraded":"2023-11-28T16:57:18.301861+0000","last_fullsized":"2023-11-28T16:57:18.301861+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:04:57.180805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.270371+0000","last_change":"2023-11-28T16:57:03.890754+0000","last_active":"2023-11-28T16:57:17.270371+0000","last_peered":"2023-11-28T16:57:17.270371+0000","last_clean":"2023-11-28T16:57:17.270371+0000","last_became_active":"2023-11-28T16:57:03.890427+0000","last_became_peered":"2023-11-28T16:57:03.890427+0000","last_unstale":"2023-11-28T16:57:17.270371+0000","last_undegraded":"2023-11-28T16:57:17.270371+0000","last_fullsized":"2023-11-28T16:57:17.270371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:46.680946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268166+0000","last_change":"2023-11-28T16:57:17.293268+0000","last_active":"2023-11-28T16:57:18.268166+0000","last_peered":"2023-11-28T16:57:18.268166+0000","last_clean":"2023-11-28T16:57:18.268166+0000","last_became_active":"2023-11-28T16:57:17.292314+0000","last_became_peered":"2023-11-28T16:57:17.292314+0000","last_unstale":"2023-11-28T16:57:18.268166+0000","last_undegraded":"2023-11-28T16:57:18.268166+0000","last_fullsized":"2023-11-28T16:57:18.268166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:12:14.533397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.273704+0000","last_change":"2023-11-28T16:57:03.896260+0000","last_active":"2023-11-28T16:57:17.273704+0000","last_peered":"2023-11-28T16:57:17.273704+0000","last_clean":"2023-11-28T16:57:17.273704+0000","last_became_active":"2023-11-28T16:57:03.894336+0000","last_became_peered":"2023-11-28T16:57:03.894336+0000","last_unstale":"2023-11-28T16:57:17.273704+0000","last_undegraded":"2023-11-28T16:57:17.273704+0000","last_fullsized":"2023-11-28T16:57:17.273704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:40.156796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268360+0000","last_change":"2023-11-28T16:57:17.281318+0000","last_active":"2023-11-28T16:57:18.268360+0000","last_peered":"2023-11-28T16:57:18.268360+0000","last_clean":"2023-11-28T16:57:18.268360+0000","last_became_active":"2023-11-28T16:57:17.281015+0000","last_became_peered":"2023-11-28T16:57:17.281015+0000","last_unstale":"2023-11-28T16:57:18.268360+0000","last_undegraded":"2023-11-28T16:57:18.268360+0000","last_fullsized":"2023-11-28T16:57:18.268360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:57.449265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.267279+0000","last_change":"2023-11-28T16:57:03.887859+0000","last_active":"2023-11-28T16:57:17.267279+0000","last_peered":"2023-11-28T16:57:17.267279+0000","last_clean":"2023-11-28T16:57:17.267279+0000","last_became_active":"2023-11-28T16:57:03.887591+0000","last_became_peered":"2023-11-28T16:57:03.887591+0000","last_unstale":"2023-11-28T16:57:17.267279+0000","last_undegraded":"2023-11-28T16:57:17.267279+0000","last_fullsized":"2023-11-28T16:57:17.267279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:03.076231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.389078+0000","last_change":"2023-11-28T16:57:17.287358+0000","last_active":"2023-11-28T16:57:18.389078+0000","last_peered":"2023-11-28T16:57:18.389078+0000","last_clean":"2023-11-28T16:57:18.389078+0000","last_became_active":"2023-11-28T16:57:17.285457+0000","last_became_peered":"2023-11-28T16:57:17.285457+0000","last_unstale":"2023-11-28T16:57:18.389078+0000","last_undegraded":"2023-11-28T16:57:18.389078+0000","last_fullsized":"2023-11-28T16:57:18.389078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:06.229422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277369+0000","last_change":"2023-11-28T16:57:03.898138+0000","last_active":"2023-11-28T16:57:17.277369+0000","last_peered":"2023-11-28T16:57:17.277369+0000","last_clean":"2023-11-28T16:57:17.277369+0000","last_became_active":"2023-11-28T16:57:03.897728+0000","last_became_peered":"2023-11-28T16:57:03.897728+0000","last_unstale":"2023-11-28T16:57:17.277369+0000","last_undegraded":"2023-11-28T16:57:17.277369+0000","last_fullsized":"2023-11-28T16:57:17.277369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268269+0000","last_change":"2023-11-28T16:57:17.285980+0000","last_active":"2023-11-28T16:57:18.268269+0000","last_peered":"2023-11-28T16:57:18.268269+0000","last_clean":"2023-11-28T16:57:18.268269+0000","last_became_active":"2023-11-28T16:57:17.285555+0000","last_became_peered":"2023-11-28T16:57:17.285555+0000","last_unstale":"2023-11-28T16:57:18.268269+0000","last_undegraded":"2023-11-28T16:57:18.268269+0000","last_fullsized":"2023-11-28T16:57:18.268269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:07.896232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.280123+0000","last_change":"2023-11-28T16:57:03.884223+0000","last_active":"2023-11-28T16:57:17.280123+0000","last_peered":"2023-11-28T16:57:17.280123+0000","last_clean":"2023-11-28T16:57:17.280123+0000","last_became_active":"2023-11-28T16:57:03.883861+0000","last_became_peered":"2023-11-28T16:57:03.883861+0000","last_unstale":"2023-11-28T16:57:17.280123+0000","last_undegraded":"2023-11-28T16:57:17.280123+0000","last_fullsized":"2023-11-28T16:57:17.280123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.123805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.302288+0000","last_change":"2023-11-28T16:57:17.287987+0000","last_active":"2023-11-28T16:57:18.302288+0000","last_peered":"2023-11-28T16:57:18.302288+0000","last_clean":"2023-11-28T16:57:18.302288+0000","last_became_active":"2023-11-28T16:57:17.287711+0000","last_became_peered":"2023-11-28T16:57:17.287711+0000","last_unstale":"2023-11-28T16:57:18.302288+0000","last_undegraded":"2023-11-28T16:57:18.302288+0000","last_fullsized":"2023-11-28T16:57:18.302288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:55.418370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.265139+0000","last_change":"2023-11-28T16:57:03.894793+0000","last_active":"2023-11-28T16:57:17.265139+0000","last_peered":"2023-11-28T16:57:17.265139+0000","last_clean":"2023-11-28T16:57:17.265139+0000","last_became_active":"2023-11-28T16:57:03.887901+0000","last_became_peered":"2023-11-28T16:57:03.887901+0000","last_unstale":"2023-11-28T16:57:17.265139+0000","last_undegraded":"2023-11-28T16:57:17.265139+0000","last_fullsized":"2023-11-28T16:57:17.265139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:40.156796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.389349+0000","last_change":"2023-11-28T16:57:17.291821+0000","last_active":"2023-11-28T16:57:18.389349+0000","last_peered":"2023-11-28T16:57:18.389349+0000","last_clean":"2023-11-28T16:57:18.389349+0000","last_became_active":"2023-11-28T16:57:17.290567+0000","last_became_peered":"2023-11-28T16:57:17.290567+0000","last_unstale":"2023-11-28T16:57:18.389349+0000","last_undegraded":"2023-11-28T16:57:18.389349+0000","last_fullsized":"2023-11-28T16:57:18.389349+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:01.370617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.266106+0000","last_change":"2023-11-28T16:57:03.896614+0000","last_active":"2023-11-28T16:57:17.266106+0000","last_peered":"2023-11-28T16:57:17.266106+0000","last_clean":"2023-11-28T16:57:17.266106+0000","last_became_active":"2023-11-28T16:57:03.896037+0000","last_became_peered":"2023-11-28T16:57:03.896037+0000","last_unstale":"2023-11-28T16:57:17.266106+0000","last_undegraded":"2023-11-28T16:57:17.266106+0000","last_fullsized":"2023-11-28T16:57:17.266106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:09.379292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.267478+0000","last_change":"2023-11-28T16:57:17.293061+0000","last_active":"2023-11-28T16:57:18.267478+0000","last_peered":"2023-11-28T16:57:18.267478+0000","last_clean":"2023-11-28T16:57:18.267478+0000","last_became_active":"2023-11-28T16:57:17.292765+0000","last_became_peered":"2023-11-28T16:57:17.292765+0000","last_unstale":"2023-11-28T16:57:18.267478+0000","last_undegraded":"2023-11-28T16:57:18.267478+0000","last_fullsized":"2023-11-28T16:57:18.267478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:08:03.897540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279416+0000","last_change":"2023-11-28T16:57:03.884669+0000","last_active":"2023-11-28T16:57:17.279416+0000","last_peered":"2023-11-28T16:57:17.279416+0000","last_clean":"2023-11-28T16:57:17.279416+0000","last_became_active":"2023-11-28T16:57:03.884388+0000","last_became_peered":"2023-11-28T16:57:03.884388+0000","last_unstale":"2023-11-28T16:57:17.279416+0000","last_undegraded":"2023-11-28T16:57:17.279416+0000","last_fullsized":"2023-11-28T16:57:17.279416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:53.206562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268540+0000","last_change":"2023-11-28T16:57:17.276871+0000","last_active":"2023-11-28T16:57:18.268540+0000","last_peered":"2023-11-28T16:57:18.268540+0000","last_clean":"2023-11-28T16:57:18.268540+0000","last_became_active":"2023-11-28T16:57:17.276546+0000","last_became_peered":"2023-11-28T16:57:17.276546+0000","last_unstale":"2023-11-28T16:57:18.268540+0000","last_undegraded":"2023-11-28T16:57:18.268540+0000","last_fullsized":"2023-11-28T16:57:18.268540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:58.249158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.270336+0000","last_change":"2023-11-28T16:57:03.895662+0000","last_active":"2023-11-28T16:57:17.270336+0000","last_peered":"2023-11-28T16:57:17.270336+0000","last_clean":"2023-11-28T16:57:17.270336+0000","last_became_active":"2023-11-28T16:57:03.895366+0000","last_became_peered":"2023-11-28T16:57:03.895366+0000","last_unstale":"2023-11-28T16:57:17.270336+0000","last_undegraded":"2023-11-28T16:57:17.270336+0000","last_fullsized":"2023-11-28T16:57:17.270336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:57.821483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.389398+0000","last_change":"2023-11-28T16:57:17.290424+0000","last_active":"2023-11-28T16:57:18.389398+0000","last_peered":"2023-11-28T16:57:18.389398+0000","last_clean":"2023-11-28T16:57:18.389398+0000","last_became_active":"2023-11-28T16:57:17.290094+0000","last_became_peered":"2023-11-28T16:57:17.290094+0000","last_unstale":"2023-11-28T16:57:18.389398+0000","last_undegraded":"2023-11-28T16:57:18.389398+0000","last_fullsized":"2023-11-28T16:57:18.389398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:49.573992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.277389+0000","last_change":"2023-11-28T16:57:03.881735+0000","last_active":"2023-11-28T16:57:17.277389+0000","last_peered":"2023-11-28T16:57:17.277389+0000","last_clean":"2023-11-28T16:57:17.277389+0000","last_became_active":"2023-11-28T16:57:03.881212+0000","last_became_peered":"2023-11-28T16:57:03.881212+0000","last_unstale":"2023-11-28T16:57:17.277389+0000","last_undegraded":"2023-11-28T16:57:17.277389+0000","last_fullsized":"2023-11-28T16:57:17.277389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.586951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.269357+0000","last_change":"2023-11-28T16:57:17.276739+0000","last_active":"2023-11-28T16:57:18.269357+0000","last_peered":"2023-11-28T16:57:18.269357+0000","last_clean":"2023-11-28T16:57:18.269357+0000","last_became_active":"2023-11-28T16:57:17.276403+0000","last_became_peered":"2023-11-28T16:57:17.276403+0000","last_unstale":"2023-11-28T16:57:18.269357+0000","last_undegraded":"2023-11-28T16:57:18.269357+0000","last_fullsized":"2023-11-28T16:57:18.269357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:01.118605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.274233+0000","last_change":"2023-11-28T16:57:03.905652+0000","last_active":"2023-11-28T16:57:17.274233+0000","last_peered":"2023-11-28T16:57:17.274233+0000","last_clean":"2023-11-28T16:57:17.274233+0000","last_became_active":"2023-11-28T16:57:03.905310+0000","last_became_peered":"2023-11-28T16:57:03.905310+0000","last_unstale":"2023-11-28T16:57:17.274233+0000","last_undegraded":"2023-11-28T16:57:17.274233+0000","last_fullsized":"2023-11-28T16:57:17.274233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:09.379292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.268112+0000","last_change":"2023-11-28T16:57:17.294482+0000","last_active":"2023-11-28T16:57:18.268112+0000","last_peered":"2023-11-28T16:57:18.268112+0000","last_clean":"2023-11-28T16:57:18.268112+0000","last_became_active":"2023-11-28T16:57:17.293440+0000","last_became_peered":"2023-11-28T16:57:17.293440+0000","last_unstale":"2023-11-28T16:57:18.268112+0000","last_undegraded":"2023-11-28T16:57:18.268112+0000","last_fullsized":"2023-11-28T16:57:18.268112+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:49.573992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.279819+0000","last_change":"2023-11-28T16:57:03.896151+0000","last_active":"2023-11-28T16:57:17.279819+0000","last_peered":"2023-11-28T16:57:17.279819+0000","last_clean":"2023-11-28T16:57:17.279819+0000","last_became_active":"2023-11-28T16:57:03.891088+0000","last_became_peered":"2023-11-28T16:57:03.891088+0000","last_unstale":"2023-11-28T16:57:17.279819+0000","last_undegraded":"2023-11-28T16:57:17.279819+0000","last_fullsized":"2023-11-28T16:57:17.279819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:03.076231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T16:57:18.271199+0000","last_change":"2023-11-28T16:57:17.276357+0000","last_active":"2023-11-28T16:57:18.271199+0000","last_peered":"2023-11-28T16:57:18.271199+0000","last_clean":"2023-11-28T16:57:18.271199+0000","last_became_active":"2023-11-28T16:57:17.275663+0000","last_became_peered":"2023-11-28T16:57:17.275663+0000","last_unstale":"2023-11-28T16:57:18.271199+0000","last_undegraded":"2023-11-28T16:57:18.271199+0000","last_fullsized":"2023-11-28T16:57:18.271199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:16.286528+0000","last_clean_scrub_stamp":"2023-11-28T16:57:16.286528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:23:58.225999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T16:57:17.283107+0000","last_change":"2023-11-28T16:57:03.894170+0000","last_active":"2023-11-28T16:57:17.283107+0000","last_peered":"2023-11-28T16:57:17.283107+0000","last_clean":"2023-11-28T16:57:17.283107+0000","last_became_active":"2023-11-28T16:57:03.893856+0000","last_became_peered":"2023-11-28T16:57:03.893856+0000","last_unstale":"2023-11-28T16:57:17.283107+0000","last_undegraded":"2023-11-28T16:57:17.283107+0000","last_fullsized":"2023-11-28T16:57:17.283107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:02.853656+0000","last_clean_scrub_stamp":"2023-11-28T16:57:02.853656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:43.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1011712,"data_stored":758548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68899999999999995}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.65200000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.755}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.44400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":169288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.68300000000000005}]},{"osd":1,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.623},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.64100000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53000000000000003}]},{"osd":3,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61499999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.432}]},{"osd":5,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.51700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":168742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.874},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.70299999999999996}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.96999999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.91200000000000003}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.89200000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.436}]},{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.54800000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.377}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.40000000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.65400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":171767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.45200000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.623},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.376},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35199999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.31}]},{"osd":3,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41699999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.627}]},{"osd":5,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":430080,"data_stored":171199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.308},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.39400000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.36799999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":758402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.372}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.2869999999999999,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.33200000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.71399999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:57:21.830 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T16:57:21.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-28T16:57:21.848 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-11-28T16:57:21.841+0000 7f2ac441b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:57:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.989+0000 7f9ea8232640 1 Processor -- start 2023-11-28T16:57:21.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.989+0000 7f9ea8232640 1 -- start start 2023-11-28T16:57:21.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea8232640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea00701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea8232640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ea0158ff0 0x7f9ea0159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea8232640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea01599c0 con 0x7f9ea0070760 2023-11-28T16:57:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea8232640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea0071020 con 0x7f9ea0158ff0 2023-11-28T16:57:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea8232640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0071300 con 0x7f9ea01561d0 2023-11-28T16:57:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea67cf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ea0158ff0 0x7f9ea0159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea67cf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ea0158ff0 0x7f9ea0159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33902/0 (socket says 172.21.15.26:33902) 2023-11-28T16:57:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea67cf640 1 -- 172.21.15.26:0/1385700222 learned_addr learned my addr 172.21.15.26:0/1385700222 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea5fce640 1 --2- 172.21.15.26:0/1385700222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea00701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea67cf640 1 -- 172.21.15.26:0/1385700222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 msgr2=0x7f9ea00701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea67cf640 1 --2- 172.21.15.26:0/1385700222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea00701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea67cf640 1 -- 172.21.15.26:0/1385700222 >> v1:172.21.15.79:6789/0 conn(0x7f9ea0070760 legacy=0x7f9ea006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea67cf640 1 -- 172.21.15.26:0/1385700222 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00715e0 con 0x7f9ea0158ff0 2023-11-28T16:57:22.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.993+0000 7f9ea4fcc640 1 -- 172.21.15.26:0/1385700222 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013853118 0 0) 0x7f9ea01599c0 con 0x7f9ea0070760 2023-11-28T16:57:22.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea67cf640 1 --2- 172.21.15.26:0/1385700222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0159480 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009e50 tx=0x7f9e9801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2764ec1987fdf794 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea4fcc640 1 -- 172.21.15.26:0/1385700222 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980a5750 con 0x7f9ea0158ff0 2023-11-28T16:57:22.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea4fcc640 1 -- 172.21.15.26:0/1385700222 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e980a58b0 con 0x7f9ea0158ff0 2023-11-28T16:57:22.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea4fcc640 1 -- 172.21.15.26:0/1385700222 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980a5c40 con 0x7f9ea0158ff0 2023-11-28T16:57:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 -- 172.21.15.26:0/1385700222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 msgr2=0x7f9ea0159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 --2- 172.21.15.26:0/1385700222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0159480 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009e50 tx=0x7f9e9801c980 comp rx=0 tx=0).stop 2023-11-28T16:57:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 -- 172.21.15.26:0/1385700222 shutdown_connections 2023-11-28T16:57:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 --2- 172.21.15.26:0/1385700222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0159480 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 --2- 172.21.15.26:0/1385700222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea00701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 -- 172.21.15.26:0/1385700222 >> 172.21.15.26:0/1385700222 conn(0x7f9ea00c2a60 msgr2=0x7f9ea00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 -- 172.21.15.26:0/1385700222 shutdown_connections 2023-11-28T16:57:22.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 -- 172.21.15.26:0/1385700222 wait complete. 2023-11-28T16:57:22.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 Processor -- start 2023-11-28T16:57:22.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 -- start start 2023-11-28T16:57:22.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea0070760 0x7f9ea014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea0145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:21.997+0000 7f9ea8232640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea8232640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea014e230 con 0x7f9ea0158ff0 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea8232640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea01480c0 con 0x7f9ea0070760 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea8232640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea01469a0 con 0x7f9ea01561d0 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33918/0 (socket says 172.21.15.26:33918) 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 -- 172.21.15.26:0/3051148671 learned_addr learned my addr 172.21.15.26:0/3051148671 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea5fce640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea0070760 0x7f9ea014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea57cd640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea0145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 -- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 msgr2=0x7f9ea0145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea0145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 -- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea0070760 msgr2=0x7f9ea014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea0070760 0x7f9ea014fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 -- 172.21.15.26:0/3051148671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009b30 con 0x7f9ea0158ff0 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea5fce640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea0070760 0x7f9ea014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea57cd640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea0145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea67cf640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0146460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af040 tx=0x7f9e98019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9e967fc640 1 -- 172.21.15.26:0/3051148671 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980b8670 con 0x7f9ea0158ff0 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9e967fc640 1 -- 172.21.15.26:0/3051148671 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e980b87d0 con 0x7f9ea0158ff0 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9e967fc640 1 -- 172.21.15.26:0/3051148671 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980b8b80 con 0x7f9ea0158ff0 2023-11-28T16:57:22.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea014dc90 con 0x7f9ea0158ff0 2023-11-28T16:57:22.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea014df50 con 0x7f9ea0158ff0 2023-11-28T16:57:22.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea0147e90 con 0x7f9ea0158ff0 2023-11-28T16:57:22.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.001+0000 7f9e967fc640 1 -- 172.21.15.26:0/3051148671 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e980b8ce0 con 0x7f9ea0158ff0 2023-11-28T16:57:22.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.005+0000 7f9e967fc640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e840668d0 0x7f9e84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.005+0000 7f9e967fc640 1 -- 172.21.15.26:0/3051148671 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e9811fcd0 con 0x7f9ea0158ff0 2023-11-28T16:57:22.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.005+0000 7f9ea5fce640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e840668d0 0x7f9e84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.005+0000 7f9ea5fce640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e840668d0 0x7f9e84068d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009b10 tx=0x7f9e9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.009+0000 7f9e967fc640 1 -- 172.21.15.26:0/3051148671 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ea0147e90 con 0x7f9ea0158ff0 2023-11-28T16:57:22.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.217+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f9ea0148270 con 0x7f9ea0158ff0 2023-11-28T16:57:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.221+0000 7f9e967fc640 1 -- 172.21.15.26:0/3051148671 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7f9ea0148270 con 0x7f9ea0158ff0 2023-11-28T16:57:22.229 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-11-28T16:57:22.229 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg== 2023-11-28T16:57:22.230 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-11-28T16:57:22.230 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-11-28T16:57:22.230 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-28T16:57:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.1 2023-11-28T16:57:22.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e840668d0 msgr2=0x7f9e84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e840668d0 0x7f9e84068d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009b10 tx=0x7f9e9c008040 comp rx=0 tx=0).stop 2023-11-28T16:57:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 msgr2=0x7f9ea0146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0146460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af040 tx=0x7f9e98019720 comp rx=0 tx=0).stop 2023-11-28T16:57:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 shutdown_connections 2023-11-28T16:57:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea0158ff0 0x7f9ea0146460 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e840668d0 0x7f9e84068d90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ea01561d0 0x7f9ea0145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 --2- 172.21.15.26:0/3051148671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea0070760 0x7f9ea014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 >> 172.21.15.26:0/3051148671 conn(0x7f9ea00c2a60 msgr2=0x7f9ea01571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 shutdown_connections 2023-11-28T16:57:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.225+0000 7f9ea8232640 1 -- 172.21.15.26:0/3051148671 wait complete. 2023-11-28T16:57:22.251 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:22.251 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:22.261 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:22.261 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:22.312 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187e6d6640 1 Processor -- start 2023-11-28T16:57:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187e6d6640 1 -- start start 2023-11-28T16:57:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187e6d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1878154870 0x7f187806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187e6d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1878072780 con 0x7f18780700a0 2023-11-28T16:57:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187e6d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18780ac160 con 0x7f18780aacd0 2023-11-28T16:57:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187e6d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18780abe80 con 0x7f1878154870 2023-11-28T16:57:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187cc73640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f18780700a0 0x7f187806ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60214/0 (socket says 172.21.15.26:60214) 2023-11-28T16:57:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f187cc73640 1 -- 172.21.15.26:0/3936217084 learned_addr learned my addr 172.21.15.26:0/3936217084 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.449+0000 7f18777fe640 1 --2- 172.21.15.26:0/3936217084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1878154870 0x7f187806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f1876ffd640 1 -- 172.21.15.26:0/3936217084 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109177587 0 0) 0x7f1878072780 con 0x7f18780700a0 2023-11-28T16:57:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f1876ffd640 1 -- 172.21.15.26:0/3936217084 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1860003530 con 0x7f18780700a0 2023-11-28T16:57:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f1876ffd640 1 -- 172.21.15.26:0/3936217084 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975240463 0 0) 0x7f18780ac160 con 0x7f18780aacd0 2023-11-28T16:57:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f1876ffd640 1 -- 172.21.15.26:0/3936217084 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1878072780 con 0x7f18780aacd0 2023-11-28T16:57:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f18777fe640 1 -- 172.21.15.26:0/3936217084 >> v1:172.21.15.79:6789/0 conn(0x7f18780aacd0 legacy=0x7f1878154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f18777fe640 1 -- 172.21.15.26:0/3936217084 >> v1:172.21.15.26:6789/0 conn(0x7f18780700a0 legacy=0x7f187806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f18777fe640 1 -- 172.21.15.26:0/3936217084 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1878154cf0 con 0x7f1878154870 2023-11-28T16:57:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f18777fe640 1 --2- 172.21.15.26:0/3936217084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1878154870 0x7f187806c950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f186c0097f0 tx=0x7f186c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd9424d79baffe17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f1876ffd640 1 -- 172.21.15.26:0/3936217084 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0ab600 con 0x7f1878154870 2023-11-28T16:57:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f1876ffd640 1 -- 172.21.15.26:0/3936217084 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c0ab760 con 0x7f1878154870 2023-11-28T16:57:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f1876ffd640 1 -- 172.21.15.26:0/3936217084 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0abaf0 con 0x7f1878154870 2023-11-28T16:57:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f187e6d6640 1 -- 172.21.15.26:0/3936217084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1878154870 msgr2=0x7f187806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.453+0000 7f187e6d6640 1 --2- 172.21.15.26:0/3936217084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1878154870 0x7f187806c950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f186c0097f0 tx=0x7f186c01c400 comp rx=0 tx=0).stop 2023-11-28T16:57:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- 172.21.15.26:0/3936217084 shutdown_connections 2023-11-28T16:57:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 --2- 172.21.15.26:0/3936217084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1878154870 0x7f187806c950 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- 172.21.15.26:0/3936217084 >> 172.21.15.26:0/3936217084 conn(0x7f18780c2ad0 msgr2=0x7f18780c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- 172.21.15.26:0/3936217084 shutdown_connections 2023-11-28T16:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- 172.21.15.26:0/3936217084 wait complete. 2023-11-28T16:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 Processor -- start 2023-11-28T16:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- start start 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18780700a0 0x7f18781460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18780aacd0 0x7f1878143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1878154870 0x7f18781443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18780c4b40 con 0x7f1878154870 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781439e0 con 0x7f18780700a0 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187e6d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18780c3f50 con 0x7f18780aacd0 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1878154870 0x7f18781443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1878154870 0x7f18781443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33934/0 (socket says 172.21.15.26:33934) 2023-11-28T16:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 -- 172.21.15.26:0/1971712770 learned_addr learned my addr 172.21.15.26:0/1971712770 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f18777fe640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18780aacd0 0x7f1878143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f1877fff640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18780700a0 0x7f18781460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 -- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18780aacd0 msgr2=0x7f1878143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18780aacd0 0x7f1878143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 -- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18780700a0 msgr2=0x7f18781460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18780700a0 0x7f18781460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.457+0000 7f187cc73640 1 -- 172.21.15.26:0/1971712770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009420 con 0x7f1878154870 2023-11-28T16:57:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f187cc73640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1878154870 0x7f18781443b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f187000caa0 tx=0x7f187000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f1874ff9640 1 -- 172.21.15.26:0/1971712770 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000ac00 con 0x7f1878154870 2023-11-28T16:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f1874ff9640 1 -- 172.21.15.26:0/1971712770 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000ad80 con 0x7f1878154870 2023-11-28T16:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f1874ff9640 1 -- 172.21.15.26:0/1971712770 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870012640 con 0x7f1878154870 2023-11-28T16:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18780c4230 con 0x7f1878154870 2023-11-28T16:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878143630 con 0x7f1878154870 2023-11-28T16:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1878143b50 con 0x7f1878154870 2023-11-28T16:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f1874ff9640 1 -- 172.21.15.26:0/1971712770 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1870007070 con 0x7f1878154870 2023-11-28T16:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f1874ff9640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f18640668d0 0x7f1864068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f1874ff9640 1 -- 172.21.15.26:0/1971712770 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1870084670 con 0x7f1878154870 2023-11-28T16:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.461+0000 7f1877fff640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f18640668d0 0x7f1864068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.465+0000 7f1877fff640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f18640668d0 0x7f1864068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18680017c0 tx=0x7f1868009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.465+0000 7f1874ff9640 1 -- 172.21.15.26:0/1971712770 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18700515f0 con 0x7f1878154870 2023-11-28T16:57:22.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.625+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f187804e890 con 0x7f1878154870 2023-11-28T16:57:22.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f1874ff9640 1 -- 172.21.15.26:0/1971712770 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20157 (secure 0 0 0) 0x7f1870054c10 con 0x7f1878154870 2023-11-28T16:57:22.636 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:22.636 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:18.259952+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f18640668d0 msgr2=0x7f1864068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f18640668d0 0x7f1864068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18680017c0 tx=0x7f1868009040 comp rx=0 tx=0).stop 2023-11-28T16:57:22.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1878154870 msgr2=0x7f18781443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1878154870 0x7f18781443b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f187000caa0 tx=0x7f187000cf60 comp rx=0 tx=0).stop 2023-11-28T16:57:22.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 shutdown_connections 2023-11-28T16:57:22.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1878154870 0x7f18781443b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f18640668d0 0x7f1864068d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18780aacd0 0x7f1878143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 --2- 172.21.15.26:0/1971712770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18780700a0 0x7f18781460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 >> 172.21.15.26:0/1971712770 conn(0x7f18780c2ad0 msgr2=0x7f18780c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 shutdown_connections 2023-11-28T16:57:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.629+0000 7f187e6d6640 1 -- 172.21.15.26:0/1971712770 wait complete. 2023-11-28T16:57:22.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:01.716708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:02.252332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:57:14.412799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:57:15.689901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:22.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e51dd1640 1 Processor -- start 2023-11-28T16:57:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e51dd1640 1 -- start start 2023-11-28T16:57:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e51dd1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e51dd1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e4c151f90 0x7f6e4c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e51dd1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c06de00 con 0x7f6e4c0c0370 2023-11-28T16:57:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e51dd1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c070390 con 0x7f6e4c151f90 2023-11-28T16:57:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e51dd1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c14eed0 con 0x7f6e4c14eaf0 2023-11-28T16:57:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e4b7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e4affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e4c151f90 0x7f6e4c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e4bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e4c0c0370 0x7f6e4c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:48200/0 (socket says 172.21.15.26:48200) 2023-11-28T16:57:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e4b7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:45892/0 (socket says 172.21.15.26:45892) 2023-11-28T16:57:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.797+0000 7f6e4bfff640 1 -- 172.21.15.26:0/1082523569 learned_addr learned my addr 172.21.15.26:0/1082523569 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4b7fe640 1 -- 172.21.15.26:0/1082523569 >> v2:172.21.15.79:3300/0 conn(0x7f6e4c151f90 msgr2=0x7f6e4c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4b7fe640 1 --2- 172.21.15.26:0/1082523569 >> v2:172.21.15.79:3300/0 conn(0x7f6e4c151f90 0x7f6e4c06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4b7fe640 1 -- 172.21.15.26:0/1082523569 >> v1:172.21.15.79:6789/0 conn(0x7f6e4c0c0370 legacy=0x7f6e4c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4b7fe640 1 -- 172.21.15.26:0/1082523569 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c151270 con 0x7f6e4c14eaf0 2023-11-28T16:57:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4a7fc640 1 -- 172.21.15.26:0/1082523569 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921320906 0 0) 0x7f6e4c06de00 con 0x7f6e4c0c0370 2023-11-28T16:57:22.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4b7fe640 1 --2- 172.21.15.26:0/1082523569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c151a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0097c0 tx=0x7f6e3c01e540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d9ac31920b8323 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4a7fc640 1 -- 172.21.15.26:0/1082523569 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0ab610 con 0x7f6e4c14eaf0 2023-11-28T16:57:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4a7fc640 1 -- 172.21.15.26:0/1082523569 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0ab770 con 0x7f6e4c14eaf0 2023-11-28T16:57:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.801+0000 7f6e4a7fc640 1 -- 172.21.15.26:0/1082523569 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0abb00 con 0x7f6e4c14eaf0 2023-11-28T16:57:22.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1082523569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 msgr2=0x7f6e4c151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1082523569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c151a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0097c0 tx=0x7f6e3c01e540 comp rx=0 tx=0).stop 2023-11-28T16:57:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1082523569 shutdown_connections 2023-11-28T16:57:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1082523569 >> v2:172.21.15.79:3300/0 conn(0x7f6e4c151f90 0x7f6e4c06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1082523569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c151a50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1082523569 >> 172.21.15.26:0/1082523569 conn(0x7f6e4c0c2a60 msgr2=0x7f6e4c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1082523569 shutdown_connections 2023-11-28T16:57:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1082523569 wait complete. 2023-11-28T16:57:22.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 Processor -- start 2023-11-28T16:57:22.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- start start 2023-11-28T16:57:22.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4c0c0370 0x7f6e4c1ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c13aa70 0x7f6e4c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c13a8b0 con 0x7f6e4c13aa70 2023-11-28T16:57:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1edb10 con 0x7f6e4c0c0370 2023-11-28T16:57:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e51dd1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0c4090 con 0x7f6e4c14eaf0 2023-11-28T16:57:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c13aa70 0x7f6e4c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c13aa70 0x7f6e4c14a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33942/0 (socket says 172.21.15.26:33942) 2023-11-28T16:57:22.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 -- 172.21.15.26:0/1249640196 learned_addr learned my addr 172.21.15.26:0/1249640196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4b7fe640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4c0c0370 0x7f6e4c1ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4affd640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 -- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 msgr2=0x7f6e4c0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 -- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4c0c0370 msgr2=0x7f6e4c1ed5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4c0c0370 0x7f6e4c1ed5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.805+0000 7f6e4bfff640 1 -- 172.21.15.26:0/1249640196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c009420 con 0x7f6e4c13aa70 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e4bfff640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c13aa70 0x7f6e4c14a020 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c7a0 tx=0x7f6e4400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e33fff640 1 -- 172.21.15.26:0/1249640196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400a640 con 0x7f6e4c13aa70 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e33fff640 1 -- 172.21.15.26:0/1249640196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4400a7a0 con 0x7f6e4c13aa70 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c0aa520 con 0x7f6e4c13aa70 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e33fff640 1 -- 172.21.15.26:0/1249640196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400abd0 con 0x7f6e4c13aa70 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c0aaae0 con 0x7f6e4c13aa70 2023-11-28T16:57:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c0aad00 con 0x7f6e4c13aa70 2023-11-28T16:57:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e33fff640 1 -- 172.21.15.26:0/1249640196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6e4400ad30 con 0x7f6e4c13aa70 2023-11-28T16:57:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e33fff640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6e380668d0 0x7f6e38068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e33fff640 1 -- 172.21.15.26:0/1249640196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6e44083c80 con 0x7f6e4c13aa70 2023-11-28T16:57:22.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.809+0000 7f6e4b7fe640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6e380668d0 0x7f6e38068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:22.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.813+0000 7f6e4b7fe640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6e380668d0 0x7f6e38068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0b0000 tx=0x7f6e3c0a9000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.813+0000 7f6e33fff640 1 -- 172.21.15.26:0/1249640196 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e44050c00 con 0x7f6e4c13aa70 2023-11-28T16:57:22.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e4c04e890 con 0x7f6e4c13aa70 2023-11-28T16:57:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e33fff640 1 -- 172.21.15.26:0/1249640196 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e44018070 con 0x7f6e4c13aa70 2023-11-28T16:57:22.979 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6e380668d0 msgr2=0x7f6e38068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6e380668d0 0x7f6e38068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0b0000 tx=0x7f6e3c0a9000 comp rx=0 tx=0).stop 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c13aa70 msgr2=0x7f6e4c14a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c13aa70 0x7f6e4c14a020 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c7a0 tx=0x7f6e4400cc60 comp rx=0 tx=0).stop 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 shutdown_connections 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c13aa70 0x7f6e4c14a020 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6e380668d0 0x7f6e38068d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4c14eaf0 0x7f6e4c0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 --2- 172.21.15.26:0/1249640196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4c0c0370 0x7f6e4c1ed5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 >> 172.21.15.26:0/1249640196 conn(0x7f6e4c0c2a60 msgr2=0x7f6e4c14c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:22.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 shutdown_connections 2023-11-28T16:57:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:22.973+0000 7f6e51dd1640 1 -- 172.21.15.26:0/1249640196 wait complete. 2023-11-28T16:57:23.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:57:23.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd855bdf640 1 Processor -- start 2023-11-28T16:57:23.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd855bdf640 1 -- start start 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd855bdf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd85006b810 0x7fd850156300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd855bdf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8500c17b0 0x7fd8500719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd855bdf640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd850155c40 con 0x7fd850156840 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd855bdf640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd850073590 con 0x7fd8500c17b0 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd855bdf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8500c60c0 con 0x7fd85006b810 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8500c17b0 0x7fd8500719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd850156840 0x7fd850071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60230/0 (socket says 172.21.15.26:60230) 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84ffff640 1 -- 172.21.15.26:0/4193623862 learned_addr learned my addr 172.21.15.26:0/4193623862 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84f7fe640 1 --2- 172.21.15.26:0/4193623862 >> v2:172.21.15.79:3300/0 conn(0x7fd85006b810 0x7fd850156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84effd640 1 -- 172.21.15.26:0/4193623862 >> v2:172.21.15.79:3300/0 conn(0x7fd85006b810 msgr2=0x7fd850156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84effd640 1 --2- 172.21.15.26:0/4193623862 >> v2:172.21.15.79:3300/0 conn(0x7fd85006b810 0x7fd850156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84effd640 1 -- 172.21.15.26:0/4193623862 >> v1:172.21.15.26:6789/0 conn(0x7fd850156840 legacy=0x7fd850071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84effd640 1 -- 172.21.15.26:0/4193623862 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850073800 con 0x7fd8500c17b0 2023-11-28T16:57:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.141+0000 7fd84e7fc640 1 -- 172.21.15.26:0/4193623862 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712884808 0 0) 0x7fd850155c40 con 0x7fd850156840 2023-11-28T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd84effd640 1 --2- 172.21.15.26:0/4193623862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8500c17b0 0x7fd8500719e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd8500aca60 tx=0x7fd84401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93133eab5ca4427b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd84e7fc640 1 -- 172.21.15.26:0/4193623862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440ab600 con 0x7fd8500c17b0 2023-11-28T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd84e7fc640 1 -- 172.21.15.26:0/4193623862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8440a7050 con 0x7fd8500c17b0 2023-11-28T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd84e7fc640 1 -- 172.21.15.26:0/4193623862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440ab980 con 0x7fd8500c17b0 2023-11-28T16:57:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 -- 172.21.15.26:0/4193623862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8500c17b0 msgr2=0x7fd8500719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 --2- 172.21.15.26:0/4193623862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8500c17b0 0x7fd8500719e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd8500aca60 tx=0x7fd84401c460 comp rx=0 tx=0).stop 2023-11-28T16:57:23.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 -- 172.21.15.26:0/4193623862 shutdown_connections 2023-11-28T16:57:23.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 --2- 172.21.15.26:0/4193623862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8500c17b0 0x7fd8500719e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 --2- 172.21.15.26:0/4193623862 >> v2:172.21.15.79:3300/0 conn(0x7fd85006b810 0x7fd850156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 -- 172.21.15.26:0/4193623862 >> 172.21.15.26:0/4193623862 conn(0x7fd8500c3240 msgr2=0x7fd8500c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 -- 172.21.15.26:0/4193623862 shutdown_connections 2023-11-28T16:57:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 -- 172.21.15.26:0/4193623862 wait complete. 2023-11-28T16:57:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.145+0000 7fd855bdf640 1 Processor -- start 2023-11-28T16:57:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 -- start start 2023-11-28T16:57:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd85006b810 0x7fd85014a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8500c17b0 0x7fd850149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd850156840 0x7fd85015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500ab6f0 con 0x7fd85006b810 2023-11-28T16:57:23.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501ed950 con 0x7fd850156840 2023-11-28T16:57:23.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501edc30 con 0x7fd8500c17b0 2023-11-28T16:57:23.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd85006b810 0x7fd85014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd85006b810 0x7fd85014a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33948/0 (socket says 172.21.15.26:33948) 2023-11-28T16:57:23.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 -- 172.21.15.26:0/1932904765 learned_addr learned my addr 172.21.15.26:0/1932904765 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 -- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8500c17b0 msgr2=0x7fd850149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8500c17b0 0x7fd850149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 -- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd850156840 msgr2=0x7fd85015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd850156840 0x7fd85015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 -- 172.21.15.26:0/1932904765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844009420 con 0x7fd85006b810 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd84f7fe640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd85006b810 0x7fd85014a200 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e870 tx=0x7fd84000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd837fff640 1 -- 172.21.15.26:0/1932904765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840009510 con 0x7fd85006b810 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd837fff640 1 -- 172.21.15.26:0/1932904765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000eec0 con 0x7fd85006b810 2023-11-28T16:57:23.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8501edf10 con 0x7fd85006b810 2023-11-28T16:57:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd837fff640 1 -- 172.21.15.26:0/1932904765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000cb40 con 0x7fd85006b810 2023-11-28T16:57:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8501ee4d0 con 0x7fd85006b810 2023-11-28T16:57:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.149+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85004e890 con 0x7fd85006b810 2023-11-28T16:57:23.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.153+0000 7fd837fff640 1 -- 172.21.15.26:0/1932904765 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd84000cca0 con 0x7fd85006b810 2023-11-28T16:57:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.153+0000 7fd837fff640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd83c0668d0 0x7fd83c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.153+0000 7fd837fff640 1 -- 172.21.15.26:0/1932904765 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd8400848e0 con 0x7fd85006b810 2023-11-28T16:57:23.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.153+0000 7fd84effd640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd83c0668d0 0x7fd83c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.153+0000 7fd84effd640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd83c0668d0 0x7fd83c068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd8440ad000 tx=0x7fd844004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.157+0000 7fd837fff640 1 -- 172.21.15.26:0/1932904765 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8400517b0 con 0x7fd85006b810 2023-11-28T16:57:23.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.313+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8500c0e20 con 0x7fd85006b810 2023-11-28T16:57:23.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd837fff640 1 -- 172.21.15.26:0/1932904765 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd840054dd0 con 0x7fd85006b810 2023-11-28T16:57:23.322 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd83c0668d0 msgr2=0x7fd83c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd83c0668d0 0x7fd83c068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd8440ad000 tx=0x7fd844004740 comp rx=0 tx=0).stop 2023-11-28T16:57:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd85006b810 msgr2=0x7fd85014a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd85006b810 0x7fd85014a200 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e870 tx=0x7fd84000ec70 comp rx=0 tx=0).stop 2023-11-28T16:57:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 shutdown_connections 2023-11-28T16:57:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd850156840 0x7fd85015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd83c0668d0 0x7fd83c068d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8500c17b0 0x7fd850149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 --2- 172.21.15.26:0/1932904765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd85006b810 0x7fd85014a200 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 >> 172.21.15.26:0/1932904765 conn(0x7fd8500c3240 msgr2=0x7fd8501557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 shutdown_connections 2023-11-28T16:57:23.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.317+0000 7fd855bdf640 1 -- 172.21.15.26:0/1932904765 wait complete. 2023-11-28T16:57:23.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:57:23.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe296c9640 1 Processor -- start 2023-11-28T16:57:23.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe296c9640 1 -- start start 2023-11-28T16:57:23.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe296c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe24158a10 0x7efe240c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe296c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 0x7efe24152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe296c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe24158580 con 0x7efe240c6220 2023-11-28T16:57:23.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe296c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe24158e60 con 0x7efe24158a10 2023-11-28T16:57:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe296c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe24157f50 con 0x7efe24151bf0 2023-11-28T16:57:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe227fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe24158a10 0x7efe240c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe22ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe240c6220 0x7efe240c13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60236/0 (socket says 172.21.15.26:60236) 2023-11-28T16:57:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe22ffd640 1 -- 172.21.15.26:0/717901706 learned_addr learned my addr 172.21.15.26:0/717901706 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe227fc640 1 -- 172.21.15.26:0/717901706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 msgr2=0x7efe24152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe227fc640 1 --2- 172.21.15.26:0/717901706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 0x7efe24152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe227fc640 1 -- 172.21.15.26:0/717901706 >> v1:172.21.15.26:6789/0 conn(0x7efe240c6220 legacy=0x7efe240c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe227fc640 1 -- 172.21.15.26:0/717901706 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240c1f60 con 0x7efe24158a10 2023-11-28T16:57:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.485+0000 7efe21ffb640 1 -- 172.21.15.26:0/717901706 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292259561 0 0) 0x7efe24158580 con 0x7efe240c6220 2023-11-28T16:57:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe227fc640 1 --2- 172.21.15.26:0/717901706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe24158a10 0x7efe240c28c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efe180097a0 tx=0x7efe1801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e719d3ca84db9739 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe21ffb640 1 -- 172.21.15.26:0/717901706 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180a7070 con 0x7efe24158a10 2023-11-28T16:57:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe21ffb640 1 -- 172.21.15.26:0/717901706 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe180ab430 con 0x7efe24158a10 2023-11-28T16:57:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe21ffb640 1 -- 172.21.15.26:0/717901706 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180ab7c0 con 0x7efe24158a10 2023-11-28T16:57:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 -- 172.21.15.26:0/717901706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe24158a10 msgr2=0x7efe240c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 --2- 172.21.15.26:0/717901706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe24158a10 0x7efe240c28c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efe180097a0 tx=0x7efe1801c430 comp rx=0 tx=0).stop 2023-11-28T16:57:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 -- 172.21.15.26:0/717901706 shutdown_connections 2023-11-28T16:57:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 --2- 172.21.15.26:0/717901706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 0x7efe24152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 --2- 172.21.15.26:0/717901706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe24158a10 0x7efe240c28c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 -- 172.21.15.26:0/717901706 >> 172.21.15.26:0/717901706 conn(0x7efe2406a5a0 msgr2=0x7efe2406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 -- 172.21.15.26:0/717901706 shutdown_connections 2023-11-28T16:57:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 -- 172.21.15.26:0/717901706 wait complete. 2023-11-28T16:57:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.489+0000 7efe296c9640 1 Processor -- start 2023-11-28T16:57:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 -- start start 2023-11-28T16:57:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240c6220 0x7efe240c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 0x7efe241ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24158a10 0x7efe2414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24149bd0 con 0x7efe240c6220 2023-11-28T16:57:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240abd70 con 0x7efe24158a10 2023-11-28T16:57:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe241eff60 con 0x7efe24151bf0 2023-11-28T16:57:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240c6220 0x7efe240c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240c6220 0x7efe240c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33954/0 (socket says 172.21.15.26:33954) 2023-11-28T16:57:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653524483 learned_addr learned my addr 172.21.15.26:0/1653524483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe227fc640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 0x7efe241ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe237fe640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24158a10 0x7efe2414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 msgr2=0x7efe241ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 0x7efe241ec8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24158a10 msgr2=0x7efe2414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24158a10 0x7efe2414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653524483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180093b0 con 0x7efe240c6220 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe237fe640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24158a10 0x7efe2414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe22ffd640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240c6220 0x7efe240c3580 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c480 tx=0x7efe1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe0b7fe640 1 -- 172.21.15.26:0/1653524483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140074e0 con 0x7efe240c6220 2023-11-28T16:57:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe0b7fe640 1 -- 172.21.15.26:0/1653524483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14007660 con 0x7efe240c6220 2023-11-28T16:57:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe0b7fe640 1 -- 172.21.15.26:0/1653524483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14004a30 con 0x7efe240c6220 2023-11-28T16:57:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe240aba90 con 0x7efe240c6220 2023-11-28T16:57:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe241f04e0 con 0x7efe240c6220 2023-11-28T16:57:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.493+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe241f0700 con 0x7efe240c6220 2023-11-28T16:57:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.497+0000 7efe0b7fe640 1 -- 172.21.15.26:0/1653524483 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efe14004b90 con 0x7efe240c6220 2023-11-28T16:57:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.497+0000 7efe0b7fe640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe100668d0 0x7efe10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.497+0000 7efe0b7fe640 1 -- 172.21.15.26:0/1653524483 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efe140839c0 con 0x7efe240c6220 2023-11-28T16:57:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.497+0000 7efe227fc640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe100668d0 0x7efe10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.497+0000 7efe227fc640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe100668d0 0x7efe10068d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efe180af000 tx=0x7efe180a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.501+0000 7efe0b7fe640 1 -- 172.21.15.26:0/1653524483 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe14054320 con 0x7efe240c6220 2023-11-28T16:57:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.661+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe2404e890 con 0x7efe240c6220 2023-11-28T16:57:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.661+0000 7efe0b7fe640 1 -- 172.21.15.26:0/1653524483 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe140180a0 con 0x7efe240c6220 2023-11-28T16:57:23.669 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe100668d0 msgr2=0x7efe10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe100668d0 0x7efe10068d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efe180af000 tx=0x7efe180a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240c6220 msgr2=0x7efe240c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240c6220 0x7efe240c3580 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c480 tx=0x7efe1400c940 comp rx=0 tx=0).stop 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 shutdown_connections 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24158a10 0x7efe2414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe100668d0 0x7efe10068d90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe24151bf0 0x7efe241ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 --2- 172.21.15.26:0/1653524483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240c6220 0x7efe240c3580 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 >> 172.21.15.26:0/1653524483 conn(0x7efe2406a5a0 msgr2=0x7efe2414f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 shutdown_connections 2023-11-28T16:57:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.665+0000 7efe296c9640 1 -- 172.21.15.26:0/1653524483 wait complete. 2023-11-28T16:57:23.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:57:23.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08f9f8640 1 Processor -- start 2023-11-28T16:57:23.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08f9f8640 1 -- start start 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08f9f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd08814eaf0 0x7fd088151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08f9f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd088151f90 0x7fd08806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08f9f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08806de00 con 0x7fd0880c0370 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08f9f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd088070390 con 0x7fd088151f90 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08f9f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08814eed0 con 0x7fd08814eaf0 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08cf93640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd088151f90 0x7fd08806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08cf93640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd088151f90 0x7fd08806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33960/0 (socket says 172.21.15.26:33960) 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08cf93640 1 -- 172.21.15.26:0/2954423826 learned_addr learned my addr 172.21.15.26:0/2954423826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:23.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08cf93640 1 -- 172.21.15.26:0/2954423826 >> v2:172.21.15.79:3300/0 conn(0x7fd08814eaf0 msgr2=0x7fd088151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:23.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08cf93640 1 --2- 172.21.15.26:0/2954423826 >> v2:172.21.15.79:3300/0 conn(0x7fd08814eaf0 0x7fd088151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08cf93640 1 -- 172.21.15.26:0/2954423826 >> v1:172.21.15.79:6789/0 conn(0x7fd0880c0370 legacy=0x7fd08806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:23.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.829+0000 7fd08cf93640 1 -- 172.21.15.26:0/2954423826 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088151270 con 0x7fd088151f90 2023-11-28T16:57:23.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08cf93640 1 --2- 172.21.15.26:0/2954423826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd088151f90 0x7fd08806d110 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd0880c3b00 tx=0x7fd07801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0dd39e4f4abcc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd07ffff640 1 -- 172.21.15.26:0/2954423826 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780ab600 con 0x7fd088151f90 2023-11-28T16:57:23.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd07ffff640 1 -- 172.21.15.26:0/2954423826 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0780a7050 con 0x7fd088151f90 2023-11-28T16:57:23.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd07ffff640 1 -- 172.21.15.26:0/2954423826 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780ab980 con 0x7fd088151f90 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 -- 172.21.15.26:0/2954423826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd088151f90 msgr2=0x7fd08806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/2954423826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd088151f90 0x7fd08806d110 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd0880c3b00 tx=0x7fd07801c370 comp rx=0 tx=0).stop 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 -- 172.21.15.26:0/2954423826 shutdown_connections 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/2954423826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd088151f90 0x7fd08806d110 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/2954423826 >> v2:172.21.15.79:3300/0 conn(0x7fd08814eaf0 0x7fd088151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 -- 172.21.15.26:0/2954423826 >> 172.21.15.26:0/2954423826 conn(0x7fd0880c2a60 msgr2=0x7fd0880c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 -- 172.21.15.26:0/2954423826 shutdown_connections 2023-11-28T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.833+0000 7fd08f9f8640 1 -- 172.21.15.26:0/2954423826 wait complete. 2023-11-28T16:57:23.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 Processor -- start 2023-11-28T16:57:23.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 -- start start 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0880c0370 0x7fd0880c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08814eaf0 0x7fd08814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0880aa0a0 0x7fd088140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880c4310 con 0x7fd0880c0370 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0881f1950 con 0x7fd08814eaf0 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880c4090 con 0x7fd0880aa0a0 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0880c0370 0x7fd0880c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0880c0370 0x7fd0880c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33962/0 (socket says 172.21.15.26:33962) 2023-11-28T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 -- 172.21.15.26:0/133727494 learned_addr learned my addr 172.21.15.26:0/133727494 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08df95640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0880aa0a0 0x7fd088140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08cf93640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08814eaf0 0x7fd08814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 -- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0880aa0a0 msgr2=0x7fd088140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0880aa0a0 0x7fd088140740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 -- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08814eaf0 msgr2=0x7fd08814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08814eaf0 0x7fd08814a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 -- 172.21.15.26:0/133727494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0780094d0 con 0x7fd0880c0370 2023-11-28T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08d794640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0880c0370 0x7fd0880c3b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd08400b410 tx=0x7fd08400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd07dffb640 1 -- 172.21.15.26:0/133727494 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084011830 con 0x7fd0880c0370 2023-11-28T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd07dffb640 1 -- 172.21.15.26:0/133727494 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084011990 con 0x7fd0880c0370 2023-11-28T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd07dffb640 1 -- 172.21.15.26:0/133727494 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084011d40 con 0x7fd0880c0370 2023-11-28T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.837+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0881f0b90 con 0x7fd0880c0370 2023-11-28T16:57:23.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.841+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0881f1150 con 0x7fd0880c0370 2023-11-28T16:57:23.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.841+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08804e890 con 0x7fd0880c0370 2023-11-28T16:57:23.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.841+0000 7fd07dffb640 1 -- 172.21.15.26:0/133727494 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd08401a400 con 0x7fd0880c0370 2023-11-28T16:57:23.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.841+0000 7fd07dffb640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd06c0668d0 0x7fd06c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:23.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.841+0000 7fd07dffb640 1 -- 172.21.15.26:0/133727494 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd0840847a0 con 0x7fd0880c0370 2023-11-28T16:57:23.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.841+0000 7fd08cf93640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd06c0668d0 0x7fd06c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:23.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.845+0000 7fd08cf93640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd06c0668d0 0x7fd06c068d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0780ad000 tx=0x7fd078008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:23.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:23.845+0000 7fd07dffb640 1 -- 172.21.15.26:0/133727494 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd084051730 con 0x7fd0880c0370 2023-11-28T16:57:24.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.005+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd088145130 con 0x7fd0880c0370 2023-11-28T16:57:24.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.005+0000 7fd07dffb640 1 -- 172.21.15.26:0/133727494 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd084054d50 con 0x7fd0880c0370 2023-11-28T16:57:24.013 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:24.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd06c0668d0 msgr2=0x7fd06c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd06c0668d0 0x7fd06c068d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0780ad000 tx=0x7fd078008040 comp rx=0 tx=0).stop 2023-11-28T16:57:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0880c0370 msgr2=0x7fd0880c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0880c0370 0x7fd0880c3b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd08400b410 tx=0x7fd08400b8d0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 shutdown_connections 2023-11-28T16:57:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd06c0668d0 0x7fd06c068d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0880aa0a0 0x7fd088140740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08814eaf0 0x7fd08814a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 --2- 172.21.15.26:0/133727494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0880c0370 0x7fd0880c3b50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 >> 172.21.15.26:0/133727494 conn(0x7fd0880c2a60 msgr2=0x7fd08814f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 shutdown_connections 2023-11-28T16:57:24.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.009+0000 7fd08f9f8640 1 -- 172.21.15.26:0/133727494 wait complete. 2023-11-28T16:57:24.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:57:24.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 Processor -- start 2023-11-28T16:57:24.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 -- start start 2023-11-28T16:57:24.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c0a86d0 0x7ff96c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff96c156600 0x7ff96c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff96c14fb30 0x7ff96c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c152d90 con 0x7ff96c156600 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c152480 con 0x7ff96c14fb30 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff973a6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0a9760 con 0x7ff96c0a86d0 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff96c156600 0x7ff96c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff96c156600 0x7ff96c14f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33978/0 (socket says 172.21.15.26:33978) 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 -- 172.21.15.26:0/984943564 learned_addr learned my addr 172.21.15.26:0/984943564 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971807640 1 --2- 172.21.15.26:0/984943564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c0a86d0 0x7ff96c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff972008640 1 --2- 172.21.15.26:0/984943564 >> v2:172.21.15.79:3300/0 conn(0x7ff96c14fb30 0x7ff96c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 -- 172.21.15.26:0/984943564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c0a86d0 msgr2=0x7ff96c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 --2- 172.21.15.26:0/984943564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c0a86d0 0x7ff96c0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 -- 172.21.15.26:0/984943564 >> v2:172.21.15.79:3300/0 conn(0x7ff96c14fb30 msgr2=0x7ff96c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 --2- 172.21.15.26:0/984943564 >> v2:172.21.15.79:3300/0 conn(0x7ff96c14fb30 0x7ff96c0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff971006640 1 -- 172.21.15.26:0/984943564 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c152740 con 0x7ff96c156600 2023-11-28T16:57:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.173+0000 7ff972008640 1 --2- 172.21.15.26:0/984943564 >> v2:172.21.15.79:3300/0 conn(0x7ff96c14fb30 0x7ff96c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff971006640 1 --2- 172.21.15.26:0/984943564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c14f5f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff96c074300 tx=0x7ff95c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31d6fad56abdc2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff970805640 1 -- 172.21.15.26:0/984943564 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0ab600 con 0x7ff96c156600 2023-11-28T16:57:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff970805640 1 -- 172.21.15.26:0/984943564 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0a7050 con 0x7ff96c156600 2023-11-28T16:57:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff970805640 1 -- 172.21.15.26:0/984943564 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0ab980 con 0x7ff96c156600 2023-11-28T16:57:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 -- 172.21.15.26:0/984943564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 msgr2=0x7ff96c14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 --2- 172.21.15.26:0/984943564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c14f5f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff96c074300 tx=0x7ff95c01c500 comp rx=0 tx=0).stop 2023-11-28T16:57:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 -- 172.21.15.26:0/984943564 shutdown_connections 2023-11-28T16:57:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 --2- 172.21.15.26:0/984943564 >> v2:172.21.15.79:3300/0 conn(0x7ff96c14fb30 0x7ff96c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 --2- 172.21.15.26:0/984943564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c14f5f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 --2- 172.21.15.26:0/984943564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c0a86d0 0x7ff96c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 -- 172.21.15.26:0/984943564 >> 172.21.15.26:0/984943564 conn(0x7ff96c0c2a60 msgr2=0x7ff96c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 -- 172.21.15.26:0/984943564 shutdown_connections 2023-11-28T16:57:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.177+0000 7ff973a6b640 1 -- 172.21.15.26:0/984943564 wait complete. 2023-11-28T16:57:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 Processor -- start 2023-11-28T16:57:24.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 -- start start 2023-11-28T16:57:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff96c0a86d0 0x7ff96c1f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c14fb30 0x7ff96c0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c1447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c14cb20 con 0x7ff96c156600 2023-11-28T16:57:24.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0723e0 con 0x7ff96c0a86d0 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c1f1580 con 0x7ff96c14fb30 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c1447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c1447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33994/0 (socket says 172.21.15.26:33994) 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 -- 172.21.15.26:0/548980385 learned_addr learned my addr 172.21.15.26:0/548980385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff971006640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c14fb30 0x7ff96c0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff971807640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff96c0a86d0 0x7ff96c1f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 -- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c14fb30 msgr2=0x7ff96c0c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c14fb30 0x7ff96c0c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 -- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff96c0a86d0 msgr2=0x7ff96c1f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff96c0a86d0 0x7ff96c1f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 -- 172.21.15.26:0/548980385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c0094d0 con 0x7ff96c156600 2023-11-28T16:57:24.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff972008640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c1447f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff964009fa0 tx=0x7ff96400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:24.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff9627fc640 1 -- 172.21.15.26:0/548980385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964003ba0 con 0x7ff96c156600 2023-11-28T16:57:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff9627fc640 1 -- 172.21.15.26:0/548980385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96400f040 con 0x7ff96c156600 2023-11-28T16:57:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff9627fc640 1 -- 172.21.15.26:0/548980385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964004030 con 0x7ff96c156600 2023-11-28T16:57:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c071e20 con 0x7ff96c156600 2023-11-28T16:57:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.181+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c14ddc0 con 0x7ff96c156600 2023-11-28T16:57:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.185+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c04e890 con 0x7ff96c156600 2023-11-28T16:57:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.185+0000 7ff9627fc640 1 -- 172.21.15.26:0/548980385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff964004190 con 0x7ff96c156600 2023-11-28T16:57:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.185+0000 7ff9627fc640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff950066900 0x7ff950068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.185+0000 7ff9627fc640 1 -- 172.21.15.26:0/548980385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff9640849f0 con 0x7ff96c156600 2023-11-28T16:57:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.185+0000 7ff971807640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff950066900 0x7ff950068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.185+0000 7ff971807640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff950066900 0x7ff950068dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff968009a50 tx=0x7ff968008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.189+0000 7ff9627fc640 1 -- 172.21.15.26:0/548980385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff964051970 con 0x7ff96c156600 2023-11-28T16:57:24.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff96c0bf670 con 0x7ff96c156600 2023-11-28T16:57:24.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff9627fc640 1 -- 172.21.15.26:0/548980385 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff96401a0a0 con 0x7ff96c156600 2023-11-28T16:57:24.356 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff950066900 msgr2=0x7ff950068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff950066900 0x7ff950068dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff968009a50 tx=0x7ff968008040 comp rx=0 tx=0).stop 2023-11-28T16:57:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 msgr2=0x7ff96c1447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c1447f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff964009fa0 tx=0x7ff96400d560 comp rx=0 tx=0).stop 2023-11-28T16:57:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 shutdown_connections 2023-11-28T16:57:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96c156600 0x7ff96c1447f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff950066900 0x7ff950068dc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff96c14fb30 0x7ff96c0c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 --2- 172.21.15.26:0/548980385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff96c0a86d0 0x7ff96c1f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 >> 172.21.15.26:0/548980385 conn(0x7ff96c0c2a60 msgr2=0x7ff96c14b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 shutdown_connections 2023-11-28T16:57:24.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.349+0000 7ff973a6b640 1 -- 172.21.15.26:0/548980385 wait complete. 2023-11-28T16:57:24.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:57:24.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.513+0000 7f1650f0f640 1 Processor -- start 2023-11-28T16:57:24.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.513+0000 7f1650f0f640 1 -- start start 2023-11-28T16:57:24.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.513+0000 7f1650f0f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f164c156500 0x7f164c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.513+0000 7f1650f0f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c06dec0 con 0x7f164c14fcc0 2023-11-28T16:57:24.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.513+0000 7f1650f0f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c156980 con 0x7f164c0c19e0 2023-11-28T16:57:24.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.513+0000 7f1650f0f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0aa340 con 0x7f164c156500 2023-11-28T16:57:24.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f164a59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f164c14fcc0 0x7f164c0aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60246/0 (socket says 172.21.15.26:60246) 2023-11-28T16:57:24.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f164a59c640 1 -- 172.21.15.26:0/3920066589 learned_addr learned my addr 172.21.15.26:0/3920066589 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:24.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1643fff640 1 --2- 172.21.15.26:0/3920066589 >> v2:172.21.15.26:3300/0 conn(0x7f164c156500 0x7f164c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1649d9b640 1 -- 172.21.15.26:0/3920066589 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173396318 0 0) 0x7f164c06dec0 con 0x7f164c14fcc0 2023-11-28T16:57:24.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1649d9b640 1 -- 172.21.15.26:0/3920066589 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1638003530 con 0x7f164c14fcc0 2023-11-28T16:57:24.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1643fff640 1 -- 172.21.15.26:0/3920066589 >> v1:172.21.15.79:6789/0 conn(0x7f164c0c19e0 legacy=0x7f164c0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1643fff640 1 -- 172.21.15.26:0/3920066589 >> v1:172.21.15.26:6789/0 conn(0x7f164c14fcc0 legacy=0x7f164c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1643fff640 1 -- 172.21.15.26:0/3920066589 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0ab580 con 0x7f164c156500 2023-11-28T16:57:24.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1643fff640 1 --2- 172.21.15.26:0/3920066589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c06d980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f16340097c0 tx=0x7f163401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8b0c533b8214af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:24.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1649d9b640 1 -- 172.21.15.26:0/3920066589 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16340ab650 con 0x7f164c156500 2023-11-28T16:57:24.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1649d9b640 1 -- 172.21.15.26:0/3920066589 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16340ab7b0 con 0x7f164c156500 2023-11-28T16:57:24.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.517+0000 7f1649d9b640 1 -- 172.21.15.26:0/3920066589 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16340abb20 con 0x7f164c156500 2023-11-28T16:57:24.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- 172.21.15.26:0/3920066589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 msgr2=0x7f164c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 --2- 172.21.15.26:0/3920066589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c06d980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f16340097c0 tx=0x7f163401c450 comp rx=0 tx=0).stop 2023-11-28T16:57:24.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- 172.21.15.26:0/3920066589 shutdown_connections 2023-11-28T16:57:24.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 --2- 172.21.15.26:0/3920066589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c06d980 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- 172.21.15.26:0/3920066589 >> 172.21.15.26:0/3920066589 conn(0x7f164c0c2ad0 msgr2=0x7f164c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:24.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- 172.21.15.26:0/3920066589 shutdown_connections 2023-11-28T16:57:24.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- 172.21.15.26:0/3920066589 wait complete. 2023-11-28T16:57:24.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 Processor -- start 2023-11-28T16:57:24.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- start start 2023-11-28T16:57:24.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f164c0c19e0 0x7f164c1f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c14ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f164c0c40d0 0x7f164c1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1ecc50 con 0x7f164c156500 2023-11-28T16:57:24.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c150ab0 con 0x7f164c0c19e0 2023-11-28T16:57:24.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1650f0f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c150d90 con 0x7f164c0c40d0 2023-11-28T16:57:24.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1643fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c14ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1643fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c14ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34008/0 (socket says 172.21.15.26:34008) 2023-11-28T16:57:24.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f1643fff640 1 -- 172.21.15.26:0/4214409427 learned_addr learned my addr 172.21.15.26:0/4214409427 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:24.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f164a59c640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f164c0c19e0 0x7f164c1f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.521+0000 7f164ad9d640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f164c0c40d0 0x7f164c1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1643fff640 1 -- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f164c0c40d0 msgr2=0x7f164c1ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1643fff640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f164c0c40d0 0x7f164c1ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1643fff640 1 -- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f164c0c19e0 msgr2=0x7f164c1f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1643fff640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f164c0c19e0 0x7f164c1f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1643fff640 1 -- 172.21.15.26:0/4214409427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634009420 con 0x7f164c156500 2023-11-28T16:57:24.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f164ad9d640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f164c0c40d0 0x7f164c1ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:24.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1643fff640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c14ca90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f16340097c0 tx=0x7f163401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:24.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1642ffd640 1 -- 172.21.15.26:0/4214409427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634004230 con 0x7f164c156500 2023-11-28T16:57:24.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1642ffd640 1 -- 172.21.15.26:0/4214409427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16340b9070 con 0x7f164c156500 2023-11-28T16:57:24.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c151070 con 0x7f164c156500 2023-11-28T16:57:24.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1642ffd640 1 -- 172.21.15.26:0/4214409427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634003620 con 0x7f164c156500 2023-11-28T16:57:24.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c151350 con 0x7f164c156500 2023-11-28T16:57:24.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c1ece00 con 0x7f164c156500 2023-11-28T16:57:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1642ffd640 1 -- 172.21.15.26:0/4214409427 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1634003780 con 0x7f164c156500 2023-11-28T16:57:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1642ffd640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f162c0668d0 0x7f162c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.525+0000 7f1642ffd640 1 -- 172.21.15.26:0/4214409427 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f16340bb070 con 0x7f164c156500 2023-11-28T16:57:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.529+0000 7f164a59c640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f162c0668d0 0x7f162c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.529+0000 7f164a59c640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f162c0668d0 0x7f162c068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f163c0011f0 tx=0x7f163c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.529+0000 7f1642ffd640 1 -- 172.21.15.26:0/4214409427 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f164c1ece00 con 0x7f164c156500 2023-11-28T16:57:24.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.697+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f164c1ece00 con 0x7f164c156500 2023-11-28T16:57:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1642ffd640 1 -- 172.21.15.26:0/4214409427 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f164c1ece00 con 0x7f164c156500 2023-11-28T16:57:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f162c0668d0 msgr2=0x7f162c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f162c0668d0 0x7f162c068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f163c0011f0 tx=0x7f163c009040 comp rx=0 tx=0).stop 2023-11-28T16:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 msgr2=0x7f164c14ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c14ca90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f16340097c0 tx=0x7f163401ac90 comp rx=0 tx=0).stop 2023-11-28T16:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 shutdown_connections 2023-11-28T16:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f162c0668d0 0x7f162c068d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f164c0c40d0 0x7f164c1ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164c156500 0x7f164c14ca90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 --2- 172.21.15.26:0/4214409427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f164c0c19e0 0x7f164c1f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 >> 172.21.15.26:0/4214409427 conn(0x7f164c0c2ad0 msgr2=0x7f164c0bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 shutdown_connections 2023-11-28T16:57:24.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:24.701+0000 7f1650f0f640 1 -- 172.21.15.26:0/4214409427 wait complete. 2023-11-28T16:57:24.728 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T16:57:24.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:24.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:24.759 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:57:24.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:24.759 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:57:24.812 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:24.812 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:24.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:57:24.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:57:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce2572640 1 Processor -- start 2023-11-28T16:57:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce2572640 1 -- start start 2023-11-28T16:57:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce2572640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0cdc0ca610 0x7f0cdc0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:25.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce2572640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc06cd90 0x7f0cdc0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:25.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce2572640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc155790 con 0x7f0cdc0bd720 2023-11-28T16:57:25.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce2572640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cdc0c4b00 con 0x7f0cdc0ca610 2023-11-28T16:57:25.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce2572640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0c4de0 con 0x7f0cdc06cd90 2023-11-28T16:57:25.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdb7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0cdc0bd720 0x7f0cdc158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60262/0 (socket says 172.21.15.26:60262) 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdb7fe640 1 -- 172.21.15.26:0/3072716954 learned_addr learned my addr 172.21.15.26:0/3072716954 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdbfff640 1 --2- 172.21.15.26:0/3072716954 >> v2:172.21.15.26:3300/0 conn(0x7f0cdc0ca610 0x7f0cdc0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0ce0b0f640 1 --2- 172.21.15.26:0/3072716954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc06cd90 0x7f0cdc0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdbfff640 1 -- 172.21.15.26:0/3072716954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc06cd90 msgr2=0x7f0cdc0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdbfff640 1 --2- 172.21.15.26:0/3072716954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc06cd90 0x7f0cdc0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdbfff640 1 -- 172.21.15.26:0/3072716954 >> v1:172.21.15.26:6789/0 conn(0x7f0cdc0bd720 legacy=0x7f0cdc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdbfff640 1 -- 172.21.15.26:0/3072716954 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc157e30 con 0x7f0cdc0ca610 2023-11-28T16:57:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.001+0000 7f0cdaffd640 1 -- 172.21.15.26:0/3072716954 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272689426 0 0) 0x7f0cdc155790 con 0x7f0cdc0bd720 2023-11-28T16:57:25.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0cdbfff640 1 --2- 172.21.15.26:0/3072716954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc0ca610 0x7f0cdc0c94c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097c0 tx=0x7f0ccc01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b3454c504af00e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:25.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0cdaffd640 1 -- 172.21.15.26:0/3072716954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0c52d0 con 0x7f0cdc0ca610 2023-11-28T16:57:25.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0cdaffd640 1 -- 172.21.15.26:0/3072716954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0a4880 con 0x7f0cdc0ca610 2023-11-28T16:57:25.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0cdaffd640 1 -- 172.21.15.26:0/3072716954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0a4c10 con 0x7f0cdc0ca610 2023-11-28T16:57:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 -- 172.21.15.26:0/3072716954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc0ca610 msgr2=0x7f0cdc0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 --2- 172.21.15.26:0/3072716954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc0ca610 0x7f0cdc0c94c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097c0 tx=0x7f0ccc01c040 comp rx=0 tx=0).stop 2023-11-28T16:57:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 -- 172.21.15.26:0/3072716954 shutdown_connections 2023-11-28T16:57:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 --2- 172.21.15.26:0/3072716954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc06cd90 0x7f0cdc0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 --2- 172.21.15.26:0/3072716954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc0ca610 0x7f0cdc0c94c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 -- 172.21.15.26:0/3072716954 >> 172.21.15.26:0/3072716954 conn(0x7f0cdc071ea0 msgr2=0x7f0cdc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:25.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 -- 172.21.15.26:0/3072716954 shutdown_connections 2023-11-28T16:57:25.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.005+0000 7f0ce2572640 1 -- 172.21.15.26:0/3072716954 wait complete. 2023-11-28T16:57:25.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 Processor -- start 2023-11-28T16:57:25.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 -- start start 2023-11-28T16:57:25.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc06cd90 0x7f0cdc1516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:25.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc0bd720 0x7f0cdc1f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc0ca610 0x7f0cdc148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0aa930 con 0x7f0cdc06cd90 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1f1aa0 con 0x7f0cdc0ca610 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc149610 con 0x7f0cdc0bd720 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc06cd90 0x7f0cdc1516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc06cd90 0x7f0cdc1516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34024/0 (socket says 172.21.15.26:34024) 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 -- 172.21.15.26:0/2091750490 learned_addr learned my addr 172.21.15.26:0/2091750490 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdb7fe640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc0bd720 0x7f0cdc1f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce0b0f640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc0ca610 0x7f0cdc148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 -- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc0bd720 msgr2=0x7f0cdc1f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc0bd720 0x7f0cdc1f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 -- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc0ca610 msgr2=0x7f0cdc148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc0ca610 0x7f0cdc148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 -- 172.21.15.26:0/2091750490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc009420 con 0x7f0cdc06cd90 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cdbfff640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc06cd90 0x7f0cdc1516d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097c0 tx=0x7f0ccc019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cd8ff9640 1 -- 172.21.15.26:0/2091750490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0ac850 con 0x7f0cdc06cd90 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cd8ff9640 1 -- 172.21.15.26:0/2091750490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0ac9b0 con 0x7f0cdc06cd90 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc0aa370 con 0x7f0cdc06cd90 2023-11-28T16:57:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0cd8ff9640 1 -- 172.21.15.26:0/2091750490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0acd60 con 0x7f0cdc06cd90 2023-11-28T16:57:25.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.009+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc151c10 con 0x7f0cdc06cd90 2023-11-28T16:57:25.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.013+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc1f1d10 con 0x7f0cdc06cd90 2023-11-28T16:57:25.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.013+0000 7f0cd8ff9640 1 -- 172.21.15.26:0/2091750490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ccc0b3040 con 0x7f0cdc06cd90 2023-11-28T16:57:25.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.013+0000 7f0cd8ff9640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0cc8066900 0x7f0cc8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:25.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.013+0000 7f0cd8ff9640 1 -- 172.21.15.26:0/2091750490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0cdc0cac00 con 0x7f0cdc06cd90 2023-11-28T16:57:25.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.013+0000 7f0cdb7fe640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0cc8066900 0x7f0cc8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:25.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.013+0000 7f0cdb7fe640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0cc8066900 0x7f0cc8068dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0af1f0 tx=0x7f0cd0007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:25.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.017+0000 7f0cd8ff9640 1 -- 172.21.15.26:0/2091750490 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ccc0eadf0 con 0x7f0cdc06cd90 2023-11-28T16:57:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0cdc04e890 con 0x7f0cdc06cd90 2023-11-28T16:57:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0cd8ff9640 1 -- 172.21.15.26:0/2091750490 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7f0ccc0b10b0 con 0x7f0cdc06cd90 2023-11-28T16:57:25.215 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:57:25.215 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T16:57:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0cc8066900 msgr2=0x7f0cc8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0cc8066900 0x7f0cc8068dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0af1f0 tx=0x7f0cd0007b80 comp rx=0 tx=0).stop 2023-11-28T16:57:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc06cd90 msgr2=0x7f0cdc1516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc06cd90 0x7f0cdc1516d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097c0 tx=0x7f0ccc019100 comp rx=0 tx=0).stop 2023-11-28T16:57:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 shutdown_connections 2023-11-28T16:57:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc0ca610 0x7f0cdc148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0cc8066900 0x7f0cc8068dc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cdc0bd720 0x7f0cdc1f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 --2- 172.21.15.26:0/2091750490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cdc06cd90 0x7f0cdc1516d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:25.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 >> 172.21.15.26:0/2091750490 conn(0x7f0cdc071ea0 msgr2=0x7f0cdc15f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:25.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 shutdown_connections 2023-11-28T16:57:25.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:25.209+0000 7f0ce2572640 1 -- 172.21.15.26:0/2091750490 wait complete. 2023-11-28T16:57:25.236 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T16:57:25.236 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:57:25.236 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:57:25.236 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T16:57:25.236 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:25.236 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T16:57:25.236 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:57:25.237 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:57:25.237 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:57:25.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.237 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:57:25.249 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:57:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:57:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:57:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:57:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:25.249 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:57:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42321sec preferred_lft 42321sec 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:25.251 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:57:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:57:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:57:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:25.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.252 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:57:25.313 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:57:25.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.315 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:57:25.371 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:57:25.372 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:57:25.372 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:57:25.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.372 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:57:25.372 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:57:25.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:57:25.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:57:25.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:57:25.373 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:57:25.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.465 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:57:25.475 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:57:25.475 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:57:25.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:57:25.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:25.539 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:25.591 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:57:25.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:25.591 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:25.643 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-11-28T16:57:25.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:25.735 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:25.736 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:25.748 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:25.748 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:25.748 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:57:25.748 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs2=/ 2023-11-28T16:57:25.748 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:57:25.752 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:57:25.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:25.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:25.773 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:57:25.833 INFO:teuthology.orchestra.run.smithi079.stdout:client5337 2023-11-28T16:57:25.834 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:25.834 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:25.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-11-28T16:57:26.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45ed25f640 1 Processor -- start 2023-11-28T16:57:26.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45ed25f640 1 -- start start 2023-11-28T16:57:26.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45ed25f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45e8072800 0x7f45e80c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45ed25f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e8154840 con 0x7f45e80c1410 2023-11-28T16:57:26.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45ed25f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e8072be0 con 0x7f45e80bf860 2023-11-28T16:57:26.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45ed25f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e80c2840 con 0x7f45e8072800 2023-11-28T16:57:26.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f45e80c1410 0x7f45e8154cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60276/0 (socket says 172.21.15.26:60276) 2023-11-28T16:57:26.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e659c640 1 -- 172.21.15.26:0/3663885786 learned_addr learned my addr 172.21.15.26:0/3663885786 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:26.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e6d9d640 1 --2- 172.21.15.26:0/3663885786 >> v2:172.21.15.79:3300/0 conn(0x7f45e8072800 0x7f45e80c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e5d9b640 1 -- 172.21.15.26:0/3663885786 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997066944 0 0) 0x7f45e8154840 con 0x7f45e80c1410 2023-11-28T16:57:26.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e5d9b640 1 -- 172.21.15.26:0/3663885786 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d0003530 con 0x7f45e80c1410 2023-11-28T16:57:26.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e6d9d640 1 -- 172.21.15.26:0/3663885786 >> v1:172.21.15.79:6789/0 conn(0x7f45e80bf860 legacy=0x7f45e815efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e5d9b640 1 -- 172.21.15.26:0/3663885786 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230974169 0 0) 0x7f45e8072be0 con 0x7f45e80bf860 2023-11-28T16:57:26.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e6d9d640 1 -- 172.21.15.26:0/3663885786 >> v1:172.21.15.26:6789/0 conn(0x7f45e80c1410 legacy=0x7f45e8154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.029+0000 7f45e6d9d640 1 -- 172.21.15.26:0/3663885786 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e80bfd60 con 0x7f45e8072800 2023-11-28T16:57:26.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45e6d9d640 1 --2- 172.21.15.26:0/3663885786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e8072800 0x7f45e80c1840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45d80097f0 tx=0x7f45d801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24503275893ea90 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45e5d9b640 1 -- 172.21.15.26:0/3663885786 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d80ac620 con 0x7f45e8072800 2023-11-28T16:57:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45e5d9b640 1 -- 172.21.15.26:0/3663885786 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d80ac780 con 0x7f45e8072800 2023-11-28T16:57:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45e5d9b640 1 -- 172.21.15.26:0/3663885786 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d80acb10 con 0x7f45e8072800 2023-11-28T16:57:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45ed25f640 1 -- 172.21.15.26:0/3663885786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e8072800 msgr2=0x7f45e80c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45ed25f640 1 --2- 172.21.15.26:0/3663885786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e8072800 0x7f45e80c1840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45d80097f0 tx=0x7f45d801c3c0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45ed25f640 1 -- 172.21.15.26:0/3663885786 shutdown_connections 2023-11-28T16:57:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45ed25f640 1 --2- 172.21.15.26:0/3663885786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e8072800 0x7f45e80c1840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45ed25f640 1 -- 172.21.15.26:0/3663885786 >> 172.21.15.26:0/3663885786 conn(0x7f45e80c6830 msgr2=0x7f45e80c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45ed25f640 1 -- 172.21.15.26:0/3663885786 shutdown_connections 2023-11-28T16:57:26.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.033+0000 7f45ed25f640 1 -- 172.21.15.26:0/3663885786 wait complete. 2023-11-28T16:57:26.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 Processor -- start 2023-11-28T16:57:26.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 -- start start 2023-11-28T16:57:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45e8072800 0x7f45e81f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e80bf860 0x7f45e80abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45e80c1410 0x7f45e81569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e80ac490 con 0x7f45e80c1410 2023-11-28T16:57:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8150c40 con 0x7f45e80bf860 2023-11-28T16:57:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8151f00 con 0x7f45e8072800 2023-11-28T16:57:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45e80c1410 0x7f45e81569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e80bf860 0x7f45e80abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e6d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45e8072800 0x7f45e81f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e6d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45e8072800 0x7f45e81f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:45980/0 (socket says 172.21.15.26:45980) 2023-11-28T16:57:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e6d9d640 1 -- 172.21.15.26:0/1083779208 learned_addr learned my addr 172.21.15.26:0/1083779208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e659c640 1 -- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45e8072800 msgr2=0x7f45e81f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e659c640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45e8072800 0x7f45e81f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e659c640 1 -- 172.21.15.26:0/1083779208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45e80c1410 msgr2=0x7f45e81569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e659c640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45e80c1410 0x7f45e81569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e659c640 1 -- 172.21.15.26:0/1083779208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8009420 con 0x7f45e80bf860 2023-11-28T16:57:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45e659c640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e80bf860 0x7f45e80abf50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45dc007fd0 tx=0x7f45dc00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45cf7fe640 1 -- 172.21.15.26:0/1083779208 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc005cf0 con 0x7f45e80bf860 2023-11-28T16:57:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45cf7fe640 1 -- 172.21.15.26:0/1083779208 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc005e50 con 0x7f45e80bf860 2023-11-28T16:57:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e8150e90 con 0x7f45e80bf860 2023-11-28T16:57:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45cf7fe640 1 -- 172.21.15.26:0/1083779208 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0072f0 con 0x7f45e80bf860 2023-11-28T16:57:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.037+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e80a9d20 con 0x7f45e80bf860 2023-11-28T16:57:26.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.041+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e80a9f40 con 0x7f45e80bf860 2023-11-28T16:57:26.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.041+0000 7f45cf7fe640 1 -- 172.21.15.26:0/1083779208 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f45dc007450 con 0x7f45e80bf860 2023-11-28T16:57:26.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.041+0000 7f45cf7fe640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45d40668d0 0x7f45d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.041+0000 7f45cf7fe640 1 -- 172.21.15.26:0/1083779208 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f45dc083c90 con 0x7f45e80bf860 2023-11-28T16:57:26.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.041+0000 7f45e6d9d640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45d40668d0 0x7f45d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.041+0000 7f45e6d9d640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45d40668d0 0x7f45d4068d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f45d8019ff0 tx=0x7f45d80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.045+0000 7f45cf7fe640 1 -- 172.21.15.26:0/1083779208 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45dc050c10 con 0x7f45e80bf860 2023-11-28T16:57:26.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.237+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f45e804e890 con 0x7f45e80bf860 2023-11-28T16:57:26.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.241+0000 7f45cf7fe640 1 -- 172.21.15.26:0/1083779208 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v15) v1 ==== 134+0+185 (secure 0 0 0) 0x7f45dc017070 con 0x7f45e80bf860 2023-11-28T16:57:26.250 INFO:teuthology.orchestra.run.smithi026.stdout:[client.testuser] 2023-11-28T16:57:26.250 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQD2G2ZlyL6NDhAAeORl3eJBkAIlPygrNBLnaQ== 2023-11-28T16:57:26.250 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-28T16:57:26.250 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r fsname=cephfs" 2023-11-28T16:57:26.250 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T16:57:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45d40668d0 msgr2=0x7f45d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45d40668d0 0x7f45d4068d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f45d8019ff0 tx=0x7f45d80a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e80bf860 msgr2=0x7f45e80abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e80bf860 0x7f45e80abf50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45dc007fd0 tx=0x7f45dc00c890 comp rx=0 tx=0).stop 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 shutdown_connections 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45e80c1410 0x7f45e81569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45e80bf860 0x7f45e80abf50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45d40668d0 0x7f45d4068d90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 --2- 172.21.15.26:0/1083779208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45e8072800 0x7f45e81f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 >> 172.21.15.26:0/1083779208 conn(0x7f45e80c6830 msgr2=0x7f45e8152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 shutdown_connections 2023-11-28T16:57:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.245+0000 7f45ed25f640 1 -- 172.21.15.26:0/1083779208 wait complete. 2023-11-28T16:57:26.271 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-11-28T16:57:26.279 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.DK0oKg6m0r 2023-11-28T16:57:26.280 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:26.280 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/tmp/tmp.DK0oKg6m0r 2023-11-28T16:57:26.334 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:26.335 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:26.387 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:26.387 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:26.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d29f8640 1 Processor -- start 2023-11-28T16:57:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d29f8640 1 -- start start 2023-11-28T16:57:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d29f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0cc06e7c0 0x7fa0cc06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d29f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0cc1580b0 0x7fa0cc158500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d29f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc06e280 con 0x7fa0cc155360 2023-11-28T16:57:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d29f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc0c2150 con 0x7fa0cc1580b0 2023-11-28T16:57:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d29f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc157c60 con 0x7fa0cc06e7c0 2023-11-28T16:57:26.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0cbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa0cc155360 0x7fa0cc06b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60278/0 (socket says 172.21.15.26:60278) 2023-11-28T16:57:26.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0cbfff640 1 -- 172.21.15.26:0/441983255 learned_addr learned my addr 172.21.15.26:0/441983255 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:26.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0d0f95640 1 --2- 172.21.15.26:0/441983255 >> v2:172.21.15.26:3300/0 conn(0x7fa0cc1580b0 0x7fa0cc158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.617+0000 7fa0cb7fe640 1 --2- 172.21.15.26:0/441983255 >> v2:172.21.15.79:3300/0 conn(0x7fa0cc06e7c0 0x7fa0cc06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0caffd640 1 -- 172.21.15.26:0/441983255 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572819228 0 0) 0x7fa0cc06e280 con 0x7fa0cc155360 2023-11-28T16:57:26.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0caffd640 1 -- 172.21.15.26:0/441983255 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b4003530 con 0x7fa0cc155360 2023-11-28T16:57:26.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d0f95640 1 -- 172.21.15.26:0/441983255 >> v2:172.21.15.79:3300/0 conn(0x7fa0cc06e7c0 msgr2=0x7fa0cc06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:26.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d0f95640 1 --2- 172.21.15.26:0/441983255 >> v2:172.21.15.79:3300/0 conn(0x7fa0cc06e7c0 0x7fa0cc06ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d0f95640 1 -- 172.21.15.26:0/441983255 >> v1:172.21.15.26:6789/0 conn(0x7fa0cc155360 legacy=0x7fa0cc06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d0f95640 1 -- 172.21.15.26:0/441983255 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0c1bd0 con 0x7fa0cc1580b0 2023-11-28T16:57:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0cb7fe640 1 --2- 172.21.15.26:0/441983255 >> v2:172.21.15.79:3300/0 conn(0x7fa0cc06e7c0 0x7fa0cc06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d0f95640 1 --2- 172.21.15.26:0/441983255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc1580b0 0x7fa0cc158500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0c0d80 tx=0x7fa0c401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954b682bbe1d0567 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0caffd640 1 -- 172.21.15.26:0/441983255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40a58e0 con 0x7fa0cc1580b0 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0caffd640 1 -- 172.21.15.26:0/441983255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c40a5a40 con 0x7fa0cc1580b0 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0caffd640 1 -- 172.21.15.26:0/441983255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40a5dd0 con 0x7fa0cc1580b0 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d29f8640 1 -- 172.21.15.26:0/441983255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc1580b0 msgr2=0x7fa0cc158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/441983255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc1580b0 0x7fa0cc158500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0c0d80 tx=0x7fa0c401c910 comp rx=0 tx=0).stop 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d29f8640 1 -- 172.21.15.26:0/441983255 shutdown_connections 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/441983255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc1580b0 0x7fa0cc158500 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/441983255 >> v2:172.21.15.79:3300/0 conn(0x7fa0cc06e7c0 0x7fa0cc06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d29f8640 1 -- 172.21.15.26:0/441983255 >> 172.21.15.26:0/441983255 conn(0x7fa0cc0c3240 msgr2=0x7fa0cc0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.621+0000 7fa0d29f8640 1 -- 172.21.15.26:0/441983255 shutdown_connections 2023-11-28T16:57:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 -- 172.21.15.26:0/441983255 wait complete. 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 Processor -- start 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 -- start start 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0cc06e7c0 0x7fa0cc06ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc155360 0x7fa0cc14c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc1580b0 0x7fa0cc14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0a82e0 con 0x7fa0cc155360 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc151f20 con 0x7fa0cc1580b0 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc14d1d0 con 0x7fa0cc06e7c0 2023-11-28T16:57:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc155360 0x7fa0cc14c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc155360 0x7fa0cc14c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34052/0 (socket says 172.21.15.26:34052) 2023-11-28T16:57:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 -- 172.21.15.26:0/1046739340 learned_addr learned my addr 172.21.15.26:0/1046739340 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cbfff640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0cc06e7c0 0x7fa0cc06ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d0f95640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc1580b0 0x7fa0cc14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 -- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0cc06e7c0 msgr2=0x7fa0cc06ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0cc06e7c0 0x7fa0cc06ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 -- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc1580b0 msgr2=0x7fa0cc14ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc1580b0 0x7fa0cc14ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 -- 172.21.15.26:0/1046739340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4009a70 con 0x7fa0cc155360 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0cb7fe640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc155360 0x7fa0cc14c500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000d800 tx=0x7fa0c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0c8ff9640 1 -- 172.21.15.26:0/1046739340 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00096c0 con 0x7fa0cc155360 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0c8ff9640 1 -- 172.21.15.26:0/1046739340 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c0009820 con 0x7fa0cc155360 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0c8ff9640 1 -- 172.21.15.26:0/1046739340 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0009bd0 con 0x7fa0cc155360 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.625+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc151c60 con 0x7fa0cc155360 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.629+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc1ec8a0 con 0x7fa0cc155360 2023-11-28T16:57:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.629+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc14d340 con 0x7fa0cc155360 2023-11-28T16:57:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.629+0000 7fa0c8ff9640 1 -- 172.21.15.26:0/1046739340 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa0c0009d30 con 0x7fa0cc155360 2023-11-28T16:57:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.629+0000 7fa0c8ff9640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa0b80668d0 0x7fa0b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.629+0000 7fa0c8ff9640 1 -- 172.21.15.26:0/1046739340 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa0c0084d80 con 0x7fa0cc155360 2023-11-28T16:57:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.629+0000 7fa0cbfff640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa0b80668d0 0x7fa0b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.633+0000 7fa0cbfff640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa0b80668d0 0x7fa0b8068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc007fd0 tx=0x7fa0bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.633+0000 7fa0c8ff9640 1 -- 172.21.15.26:0/1046739340 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0c0051d00 con 0x7fa0cc155360 2023-11-28T16:57:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0cc06bca0 con 0x7fa0cc155360 2023-11-28T16:57:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0c8ff9640 1 -- 172.21.15.26:0/1046739340 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20157 (secure 0 0 0) 0x7fa0cc06bca0 con 0x7fa0cc155360 2023-11-28T16:57:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:26.804 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:18.259952+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa0b80668d0 msgr2=0x7fa0b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa0b80668d0 0x7fa0b8068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc007fd0 tx=0x7fa0bc009040 comp rx=0 tx=0).stop 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc155360 msgr2=0x7fa0cc14c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc155360 0x7fa0cc14c500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000d800 tx=0x7fa0c000dcc0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 shutdown_connections 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc1580b0 0x7fa0cc14ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0cc155360 0x7fa0cc14c500 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa0b80668d0 0x7fa0b8068d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.797+0000 7fa0d29f8640 1 --2- 172.21.15.26:0/1046739340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0cc06e7c0 0x7fa0cc06ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.801+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 >> 172.21.15.26:0/1046739340 conn(0x7fa0cc0c3240 msgr2=0x7fa0cc0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.801+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 shutdown_connections 2023-11-28T16:57:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.801+0000 7fa0d29f8640 1 -- 172.21.15.26:0/1046739340 wait complete. 2023-11-28T16:57:26.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:01.716708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:02.252332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:57:14.412799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:57:15.689901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:26.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:26.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.965+0000 7f6f3891d640 1 Processor -- start 2023-11-28T16:57:26.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.965+0000 7f6f3891d640 1 -- start start 2023-11-28T16:57:26.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f3891d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f340c0370 0x7f6f3406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f3891d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3406de00 con 0x7f6f340a8470 2023-11-28T16:57:26.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f3891d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f34070390 con 0x7f6f3414eaf0 2023-11-28T16:57:26.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f3891d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3414eed0 con 0x7f6f340c0370 2023-11-28T16:57:26.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6f340a8470 0x7f6f3406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60288/0 (socket says 172.21.15.26:60288) 2023-11-28T16:57:26.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 -- 172.21.15.26:0/864649969 learned_addr learned my addr 172.21.15.26:0/864649969 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:26.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f2bfff640 1 --2- 172.21.15.26:0/864649969 >> v2:172.21.15.79:3300/0 conn(0x7f6f340c0370 0x7f6f3406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257547541 0 0) 0x7f6f3406de00 con 0x7f6f340a8470 2023-11-28T16:57:26.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f20003530 con 0x7f6f340a8470 2023-11-28T16:57:26.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389432258 0 0) 0x7f6f20003530 con 0x7f6f340a8470 2023-11-28T16:57:26.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 >> v2:172.21.15.79:3300/0 conn(0x7f6f340c0370 msgr2=0x7f6f3406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:26.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 --2- 172.21.15.26:0/864649969 >> v2:172.21.15.79:3300/0 conn(0x7f6f340c0370 0x7f6f3406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 >> v1:172.21.15.79:6789/0 conn(0x7f6f3414eaf0 legacy=0x7f6f34151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34151270 con 0x7f6f340a8470 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f6f2c001a00 con 0x7f6f340a8470 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 >> v1:172.21.15.26:6789/0 conn(0x7f6f340a8470 legacy=0x7f6f3406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20003980 0x7f6f20003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f200047d0 0x7f6f20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f20005190 0x7f6f2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3414eed0 con 0x7f6f20005190 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2000c0e0 con 0x7f6f20003980 2023-11-28T16:57:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2000c2a0 con 0x7f6f200047d0 2023-11-28T16:57:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f20005190 0x7f6f2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f2bfff640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f200047d0 0x7f6f20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f3259c640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20003980 0x7f6f20003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 -- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f200047d0 msgr2=0x7f6f20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f200047d0 0x7f6f20004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 -- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20003980 msgr2=0x7f6f20003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20003980 0x7f6f20003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.969+0000 7f6f32d9d640 1 -- 172.21.15.26:0/864649969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20003530 con 0x7f6f20005190 2023-11-28T16:57:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f32d9d640 1 -- 172.21.15.26:0/864649969 reap_dead start 2023-11-28T16:57:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f32d9d640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f20005190 0x7f6f2000b990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6f34072d30 tx=0x7f6f2c01f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bee952a2985ad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0ae630 con 0x7f6f20005190 2023-11-28T16:57:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0ae7b0 con 0x7f6f20005190 2023-11-28T16:57:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f31d9b640 1 -- 172.21.15.26:0/864649969 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0aeb60 con 0x7f6f20005190 2023-11-28T16:57:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f3891d640 1 -- 172.21.15.26:0/864649969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f20005190 msgr2=0x7f6f2000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f3891d640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f20005190 0x7f6f2000b990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6f34072d30 tx=0x7f6f2c01f510 comp rx=0 tx=0).stop 2023-11-28T16:57:26.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f3891d640 1 -- 172.21.15.26:0/864649969 shutdown_connections 2023-11-28T16:57:26.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f3891d640 1 --2- 172.21.15.26:0/864649969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f20005190 0x7f6f2000b990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f3891d640 1 -- 172.21.15.26:0/864649969 >> 172.21.15.26:0/864649969 conn(0x7f6f340c2a60 msgr2=0x7f6f340c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:26.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f3891d640 1 -- 172.21.15.26:0/864649969 shutdown_connections 2023-11-28T16:57:26.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.973+0000 7f6f3891d640 1 -- 172.21.15.26:0/864649969 wait complete. 2023-11-28T16:57:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 Processor -- start 2023-11-28T16:57:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 -- start start 2023-11-28T16:57:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20005190 0x7f6f3414c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f340c25f0 0x7f6f3414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f341409e0 0x7f6f34140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f341413a0 con 0x7f6f340c25f0 2023-11-28T16:57:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340c5400 con 0x7f6f20005190 2023-11-28T16:57:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3414cde0 con 0x7f6f341409e0 2023-11-28T16:57:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f340c25f0 0x7f6f3414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f340c25f0 0x7f6f3414d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34068/0 (socket says 172.21.15.26:34068) 2023-11-28T16:57:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 -- 172.21.15.26:0/1838497839 learned_addr learned my addr 172.21.15.26:0/1838497839 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f32d9d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f341409e0 0x7f6f34140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3259c640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20005190 0x7f6f3414c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 -- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f341409e0 msgr2=0x7f6f34140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f341409e0 0x7f6f34140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 -- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20005190 msgr2=0x7f6f3414c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20005190 0x7f6f3414c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 -- 172.21.15.26:0/1838497839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340c5940 con 0x7f6f340c25f0 2023-11-28T16:57:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f32d9d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f341409e0 0x7f6f34140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3259c640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20005190 0x7f6f3414c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:26.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2bfff640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f340c25f0 0x7f6f3414d370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c011960 tx=0x7f6f1c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2affd640 1 -- 172.21.15.26:0/1838497839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c004240 con 0x7f6f340c25f0 2023-11-28T16:57:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2affd640 1 -- 172.21.15.26:0/1838497839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0043a0 con 0x7f6f340c25f0 2023-11-28T16:57:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f340c5c20 con 0x7f6f340c25f0 2023-11-28T16:57:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f2affd640 1 -- 172.21.15.26:0/1838497839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00fb00 con 0x7f6f340c25f0 2023-11-28T16:57:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3414c380 con 0x7f6f340c25f0 2023-11-28T16:57:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.977+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3404e890 con 0x7f6f340c25f0 2023-11-28T16:57:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.981+0000 7f6f2affd640 1 -- 172.21.15.26:0/1838497839 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6f1c00fc60 con 0x7f6f340c25f0 2023-11-28T16:57:26.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.981+0000 7f6f2affd640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6f140668d0 0x7f6f14068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:26.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.981+0000 7f6f2affd640 1 -- 172.21.15.26:0/1838497839 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6f1c084e00 con 0x7f6f340c25f0 2023-11-28T16:57:26.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.981+0000 7f6f3259c640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6f140668d0 0x7f6f14068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:26.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.981+0000 7f6f3259c640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6f140668d0 0x7f6f14068d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f3406d410 tx=0x7f6f240013f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:26.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:26.985+0000 7f6f2affd640 1 -- 172.21.15.26:0/1838497839 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f1c051d80 con 0x7f6f340c25f0 2023-11-28T16:57:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.145+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f34154660 con 0x7f6f340c25f0 2023-11-28T16:57:27.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.145+0000 7f6f2affd640 1 -- 172.21.15.26:0/1838497839 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f1c0230a0 con 0x7f6f340c25f0 2023-11-28T16:57:27.153 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:27.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6f140668d0 msgr2=0x7f6f14068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6f140668d0 0x7f6f14068d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f3406d410 tx=0x7f6f240013f0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f340c25f0 msgr2=0x7f6f3414d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f340c25f0 0x7f6f3414d370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c011960 tx=0x7f6f1c011e20 comp rx=0 tx=0).stop 2023-11-28T16:57:27.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 shutdown_connections 2023-11-28T16:57:27.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6f140668d0 0x7f6f14068d90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f341409e0 0x7f6f34140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f340c25f0 0x7f6f3414d370 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 --2- 172.21.15.26:0/1838497839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f20005190 0x7f6f3414c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 >> 172.21.15.26:0/1838497839 conn(0x7f6f340c2a60 msgr2=0x7f6f3406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 shutdown_connections 2023-11-28T16:57:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.149+0000 7f6f3891d640 1 -- 172.21.15.26:0/1838497839 wait complete. 2023-11-28T16:57:27.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:57:27.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.313+0000 7f704a51d640 1 Processor -- start 2023-11-28T16:57:27.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.313+0000 7f704a51d640 1 -- start start 2023-11-28T16:57:27.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f704a51d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f704414eaf0 0x7f7044151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f704a51d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7044151f90 0x7f704406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f704a51d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70440c0370 0x7f704406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f704a51d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704406de00 con 0x7f7044151f90 2023-11-28T16:57:27.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f704a51d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7044070390 con 0x7f70440c0370 2023-11-28T16:57:27.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f704a51d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704406db90 con 0x7f704414eaf0 2023-11-28T16:57:27.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7044151f90 0x7f704406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7044151f90 0x7f704406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34078/0 (socket says 172.21.15.26:34078) 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 -- 172.21.15.26:0/3503461376 learned_addr learned my addr 172.21.15.26:0/3503461376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f7043fff640 1 --2- 172.21.15.26:0/3503461376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f704414eaf0 0x7f7044151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f7048aba640 1 --2- 172.21.15.26:0/3503461376 >> v2:172.21.15.79:3300/0 conn(0x7f70440c0370 0x7f704406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 -- 172.21.15.26:0/3503461376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f704414eaf0 msgr2=0x7f7044151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 --2- 172.21.15.26:0/3503461376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f704414eaf0 0x7f7044151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 -- 172.21.15.26:0/3503461376 >> v2:172.21.15.79:3300/0 conn(0x7f70440c0370 msgr2=0x7f704406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 --2- 172.21.15.26:0/3503461376 >> v2:172.21.15.79:3300/0 conn(0x7f70440c0370 0x7f704406d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.317+0000 7f70437fe640 1 -- 172.21.15.26:0/3503461376 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704414eed0 con 0x7f7044151f90 2023-11-28T16:57:27.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f70437fe640 1 --2- 172.21.15.26:0/3503461376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7044151f90 0x7f704406d110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f70440ac250 tx=0x7f703801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b328c9cba97c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:27.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f7042ffd640 1 -- 172.21.15.26:0/3503461376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380ac600 con 0x7f7044151f90 2023-11-28T16:57:27.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f7042ffd640 1 -- 172.21.15.26:0/3503461376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70380a8050 con 0x7f7044151f90 2023-11-28T16:57:27.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f7042ffd640 1 -- 172.21.15.26:0/3503461376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380ac980 con 0x7f7044151f90 2023-11-28T16:57:27.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 -- 172.21.15.26:0/3503461376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7044151f90 msgr2=0x7f704406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 --2- 172.21.15.26:0/3503461376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7044151f90 0x7f704406d110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f70440ac250 tx=0x7f703801c3e0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 -- 172.21.15.26:0/3503461376 shutdown_connections 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 --2- 172.21.15.26:0/3503461376 >> v2:172.21.15.79:3300/0 conn(0x7f70440c0370 0x7f704406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 --2- 172.21.15.26:0/3503461376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7044151f90 0x7f704406d110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 --2- 172.21.15.26:0/3503461376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f704414eaf0 0x7f7044151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 -- 172.21.15.26:0/3503461376 >> 172.21.15.26:0/3503461376 conn(0x7f70440c2a60 msgr2=0x7f70440c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 -- 172.21.15.26:0/3503461376 shutdown_connections 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 -- 172.21.15.26:0/3503461376 wait complete. 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 Processor -- start 2023-11-28T16:57:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.321+0000 7f704a51d640 1 -- start start 2023-11-28T16:57:27.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70440c0370 0x7f70440bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f704414eaf0 0x7f70440aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70440aace0 0x7f704413ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440a9d50 con 0x7f70440c0370 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440aa310 con 0x7f704414eaf0 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704413d680 con 0x7f70440aace0 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70440c0370 0x7f70440bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70440c0370 0x7f70440bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34090/0 (socket says 172.21.15.26:34090) 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 -- 172.21.15.26:0/3266531363 learned_addr learned my addr 172.21.15.26:0/3266531363 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f70437fe640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f704414eaf0 0x7f70440aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7048aba640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70440aace0 0x7f704413ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 -- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70440aace0 msgr2=0x7f704413ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70440aace0 0x7f704413ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 -- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f704414eaf0 msgr2=0x7f70440aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f704414eaf0 0x7f70440aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 -- 172.21.15.26:0/3266531363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380094d0 con 0x7f70440c0370 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f70437fe640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f704414eaf0 0x7f70440aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7043fff640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70440c0370 0x7f70440bf5f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f703400d830 tx=0x7f703400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7040ff9640 1 -- 172.21.15.26:0/3266531363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400b6c0 con 0x7f70440c0370 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7040ff9640 1 -- 172.21.15.26:0/3266531363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703400b820 con 0x7f70440c0370 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70440a9fa0 con 0x7f70440c0370 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7040ff9640 1 -- 172.21.15.26:0/3266531363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400bb90 con 0x7f70440c0370 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70440ab170 con 0x7f70440c0370 2023-11-28T16:57:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704404e890 con 0x7f70440c0370 2023-11-28T16:57:27.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.325+0000 7f7040ff9640 1 -- 172.21.15.26:0/3266531363 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f703401e460 con 0x7f70440c0370 2023-11-28T16:57:27.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.329+0000 7f7040ff9640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70300668d0 0x7f7030068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.329+0000 7f7040ff9640 1 -- 172.21.15.26:0/3266531363 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7034084e40 con 0x7f70440c0370 2023-11-28T16:57:27.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.329+0000 7f70437fe640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70300668d0 0x7f7030068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.329+0000 7f70437fe640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70300668d0 0x7f7030068d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f70380ae000 tx=0x7f70380a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.333+0000 7f7040ff9640 1 -- 172.21.15.26:0/3266531363 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7034051dc0 con 0x7f70440c0370 2023-11-28T16:57:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.489+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70440675c0 con 0x7f70440c0370 2023-11-28T16:57:27.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.489+0000 7f7040ff9640 1 -- 172.21.15.26:0/3266531363 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70340553e0 con 0x7f70440c0370 2023-11-28T16:57:27.497 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70300668d0 msgr2=0x7f7030068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70300668d0 0x7f7030068d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f70380ae000 tx=0x7f70380a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70440c0370 msgr2=0x7f70440bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70440c0370 0x7f70440bf5f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f703400d830 tx=0x7f703400dcf0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 shutdown_connections 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70300668d0 0x7f7030068d90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70440aace0 0x7f704413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f704414eaf0 0x7f70440aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 --2- 172.21.15.26:0/3266531363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70440c0370 0x7f70440bf5f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 >> 172.21.15.26:0/3266531363 conn(0x7f70440c2a60 msgr2=0x7f704414f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 shutdown_connections 2023-11-28T16:57:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.493+0000 7f704a51d640 1 -- 172.21.15.26:0/3266531363 wait complete. 2023-11-28T16:57:27.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:57:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4d04f2a640 1 Processor -- start 2023-11-28T16:57:27.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4d04f2a640 1 -- start start 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4d04f2a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d000c24a0 0x7f4d001588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4d04f2a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d00157d20 con 0x7f4d000c1bd0 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4d04f2a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0006deb0 con 0x7f4d0006c5c0 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4d04f2a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0006e100 con 0x7f4d000c24a0 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4cfed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d000c24a0 0x7f4d001588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4cfe59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d000c1bd0 0x7f4d00151c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60302/0 (socket says 172.21.15.26:60302) 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4cfed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d000c24a0 0x7f4d001588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34104/0 (socket says 172.21.15.26:34104) 2023-11-28T16:57:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.657+0000 7f4cfe59c640 1 -- 172.21.15.26:0/1598398136 learned_addr learned my addr 172.21.15.26:0/1598398136 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4cfed9d640 1 -- 172.21.15.26:0/1598398136 >> v1:172.21.15.79:6789/0 conn(0x7f4d0006c5c0 legacy=0x7f4d001581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4cfed9d640 1 -- 172.21.15.26:0/1598398136 >> v1:172.21.15.26:6789/0 conn(0x7f4d000c1bd0 legacy=0x7f4d00151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4cfed9d640 1 -- 172.21.15.26:0/1598398136 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000700f0 con 0x7f4d000c24a0 2023-11-28T16:57:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4cfed9d640 1 --2- 172.21.15.26:0/1598398136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d001588c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009d90 tx=0x7f4cf801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bc07cae259e635 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4cfdd9b640 1 -- 172.21.15.26:0/1598398136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80a5910 con 0x7f4d000c24a0 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4cfdd9b640 1 -- 172.21.15.26:0/1598398136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf80a5a70 con 0x7f4d000c24a0 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4cfdd9b640 1 -- 172.21.15.26:0/1598398136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80a5e00 con 0x7f4d000c24a0 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4d04f2a640 1 -- 172.21.15.26:0/1598398136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 msgr2=0x7f4d001588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/1598398136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d001588c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009d90 tx=0x7f4cf801c830 comp rx=0 tx=0).stop 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4d04f2a640 1 -- 172.21.15.26:0/1598398136 shutdown_connections 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.661+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/1598398136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d001588c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 -- 172.21.15.26:0/1598398136 >> 172.21.15.26:0/1598398136 conn(0x7f4d000c2a60 msgr2=0x7f4d000c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 -- 172.21.15.26:0/1598398136 shutdown_connections 2023-11-28T16:57:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 -- 172.21.15.26:0/1598398136 wait complete. 2023-11-28T16:57:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 Processor -- start 2023-11-28T16:57:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 -- start start 2023-11-28T16:57:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d0006c5c0 0x7f4d00146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d000c1bd0 0x7f4d000a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d000a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001ed650 con 0x7f4d000c24a0 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001ecd20 con 0x7f4d000c1bd0 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4d04f2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001ed000 con 0x7f4d0006c5c0 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d000a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d000a9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34106/0 (socket says 172.21.15.26:34106) 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 -- 172.21.15.26:0/445485555 learned_addr learned my addr 172.21.15.26:0/445485555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cf7fff640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d000c1bd0 0x7f4d000a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfe59c640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d0006c5c0 0x7f4d00146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 -- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d0006c5c0 msgr2=0x7f4d00146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d0006c5c0 0x7f4d00146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 -- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d000c1bd0 msgr2=0x7f4d000a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d000c1bd0 0x7f4d000a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 -- 172.21.15.26:0/445485555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8009a70 con 0x7f4d000c24a0 2023-11-28T16:57:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.665+0000 7f4cfed9d640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d000a9ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4cf801a460 tx=0x7f4cf80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4cf6ffd640 1 -- 172.21.15.26:0/445485555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80b9860 con 0x7f4d000c24a0 2023-11-28T16:57:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4cf6ffd640 1 -- 172.21.15.26:0/445485555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf80b99c0 con 0x7f4d000c24a0 2023-11-28T16:57:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d001ed2e0 con 0x7f4d000c24a0 2023-11-28T16:57:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4cf6ffd640 1 -- 172.21.15.26:0/445485555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80b9d50 con 0x7f4d000c24a0 2023-11-28T16:57:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d001ec9d0 con 0x7f4d000c24a0 2023-11-28T16:57:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d001ed7c0 con 0x7f4d000c24a0 2023-11-28T16:57:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4cf6ffd640 1 -- 172.21.15.26:0/445485555 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4cf80ad440 con 0x7f4d000c24a0 2023-11-28T16:57:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4cf6ffd640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ce00668d0 0x7f4ce0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4cf6ffd640 1 -- 172.21.15.26:0/445485555 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4cf811fb40 con 0x7f4d000c24a0 2023-11-28T16:57:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.669+0000 7f4cfe59c640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ce00668d0 0x7f4ce0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.673+0000 7f4cfe59c640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ce00668d0 0x7f4ce0068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0005890 tx=0x7f4cf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:27.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.673+0000 7f4cf6ffd640 1 -- 172.21.15.26:0/445485555 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cf80eca30 con 0x7f4d000c24a0 2023-11-28T16:57:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.829+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d0004e890 con 0x7f4d000c24a0 2023-11-28T16:57:27.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4cf6ffd640 1 -- 172.21.15.26:0/445485555 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cf80f0050 con 0x7f4d000c24a0 2023-11-28T16:57:27.839 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ce00668d0 msgr2=0x7f4ce0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ce00668d0 0x7f4ce0068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0005890 tx=0x7f4cf0009040 comp rx=0 tx=0).stop 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 msgr2=0x7f4d000a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d000a9ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4cf801a460 tx=0x7f4cf80195d0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 shutdown_connections 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d000c24a0 0x7f4d000a9ca0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d000c1bd0 0x7f4d000a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ce00668d0 0x7f4ce0068d90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 --2- 172.21.15.26:0/445485555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d0006c5c0 0x7f4d00146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 >> 172.21.15.26:0/445485555 conn(0x7f4d000c2a60 msgr2=0x7f4d00071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 shutdown_connections 2023-11-28T16:57:27.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:27.833+0000 7f4d04f2a640 1 -- 172.21.15.26:0/445485555 wait complete. 2023-11-28T16:57:27.860 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:57:28.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.001+0000 7f9a5c5f8640 1 Processor -- start 2023-11-28T16:57:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.001+0000 7f9a5c5f8640 1 -- start start 2023-11-28T16:57:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.001+0000 7f9a5c5f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a5414eaf0 0x7f9a54151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.001+0000 7f9a5c5f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a540c0370 0x7f9a5406d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.001+0000 7f9a5c5f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5406de00 con 0x7f9a54151f90 2023-11-28T16:57:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.001+0000 7f9a5c5f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a54070390 con 0x7f9a5414eaf0 2023-11-28T16:57:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.001+0000 7f9a5c5f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5414eed0 con 0x7f9a540c0370 2023-11-28T16:57:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a5414eaf0 0x7f9a54151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a5414eaf0 0x7f9a54151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34118/0 (socket says 172.21.15.26:34118) 2023-11-28T16:57:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 -- 172.21.15.26:0/2515428004 learned_addr learned my addr 172.21.15.26:0/2515428004 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 -- 172.21.15.26:0/2515428004 >> v2:172.21.15.79:3300/0 conn(0x7f9a540c0370 msgr2=0x7f9a5406d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5ab95640 1 --2- 172.21.15.26:0/2515428004 >> v2:172.21.15.79:3300/0 conn(0x7f9a540c0370 0x7f9a5406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 --2- 172.21.15.26:0/2515428004 >> v2:172.21.15.79:3300/0 conn(0x7f9a540c0370 0x7f9a5406d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 -- 172.21.15.26:0/2515428004 >> v1:172.21.15.79:6789/0 conn(0x7f9a54151f90 legacy=0x7f9a5406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 -- 172.21.15.26:0/2515428004 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54151270 con 0x7f9a5414eaf0 2023-11-28T16:57:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5ab95640 1 --2- 172.21.15.26:0/2515428004 >> v2:172.21.15.79:3300/0 conn(0x7f9a540c0370 0x7f9a5406d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a5a394640 1 --2- 172.21.15.26:0/2515428004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a54151a50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9a54066cc0 tx=0x7f9a5001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bcbc881f0bd206 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a59392640 1 -- 172.21.15.26:0/2515428004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500ab600 con 0x7f9a5414eaf0 2023-11-28T16:57:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a59392640 1 -- 172.21.15.26:0/2515428004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a500a7050 con 0x7f9a5414eaf0 2023-11-28T16:57:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.005+0000 7f9a59392640 1 -- 172.21.15.26:0/2515428004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500ab980 con 0x7f9a5414eaf0 2023-11-28T16:57:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/2515428004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 msgr2=0x7f9a54151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/2515428004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a54151a50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9a54066cc0 tx=0x7f9a5001c370 comp rx=0 tx=0).stop 2023-11-28T16:57:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/2515428004 shutdown_connections 2023-11-28T16:57:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/2515428004 >> v2:172.21.15.79:3300/0 conn(0x7f9a540c0370 0x7f9a5406d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/2515428004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a54151a50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/2515428004 >> 172.21.15.26:0/2515428004 conn(0x7f9a540c2a60 msgr2=0x7f9a540c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/2515428004 shutdown_connections 2023-11-28T16:57:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/2515428004 wait complete. 2023-11-28T16:57:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 Processor -- start 2023-11-28T16:57:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- start start 2023-11-28T16:57:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a540c0370 0x7f9a54141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a540714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a540aa760 0x7f9a541ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540ac060 con 0x7f9a5414eaf0 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a541eec00 con 0x7f9a540aa760 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5c5f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54141cd0 con 0x7f9a540c0370 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a540714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a540714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34132/0 (socket says 172.21.15.26:34132) 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 -- 172.21.15.26:0/234442490 learned_addr learned my addr 172.21.15.26:0/234442490 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5a394640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a540c0370 0x7f9a54141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5ab95640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a540aa760 0x7f9a541ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 -- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a540c0370 msgr2=0x7f9a54141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a540c0370 0x7f9a54141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 -- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a540aa760 msgr2=0x7f9a541ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a540aa760 0x7f9a541ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a59b93640 1 -- 172.21.15.26:0/234442490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500094d0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.009+0000 7f9a5ab95640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a540aa760 0x7f9a541ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a59b93640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a540714a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400b440 tx=0x7f9a4400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a4affd640 1 -- 172.21.15.26:0/234442490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44011890 con 0x7f9a5414eaf0 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a4affd640 1 -- 172.21.15.26:0/234442490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a440119f0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a541414f0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a4affd640 1 -- 172.21.15.26:0/234442490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44011da0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a540c5b90 con 0x7f9a5414eaf0 2023-11-28T16:57:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a541eedb0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a4affd640 1 -- 172.21.15.26:0/234442490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9a4401a400 con 0x7f9a5414eaf0 2023-11-28T16:57:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a4affd640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a380668d0 0x7f9a38068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a4affd640 1 -- 172.21.15.26:0/234442490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9a44084a00 con 0x7f9a5414eaf0 2023-11-28T16:57:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.013+0000 7f9a5a394640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a380668d0 0x7f9a38068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.017+0000 7f9a5a394640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a380668d0 0x7f9a38068d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9a500ad000 tx=0x7f9a50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.017+0000 7f9a4affd640 1 -- 172.21.15.26:0/234442490 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a541eedb0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a541eedb0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a4affd640 1 -- 172.21.15.26:0/234442490 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9a541eedb0 con 0x7f9a5414eaf0 2023-11-28T16:57:28.184 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:28.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a380668d0 msgr2=0x7f9a38068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a380668d0 0x7f9a38068d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9a500ad000 tx=0x7f9a50008040 comp rx=0 tx=0).stop 2023-11-28T16:57:28.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 msgr2=0x7f9a540714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a540714a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400b440 tx=0x7f9a4400b900 comp rx=0 tx=0).stop 2023-11-28T16:57:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 shutdown_connections 2023-11-28T16:57:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a540aa760 0x7f9a541ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a5414eaf0 0x7f9a540714a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a380668d0 0x7f9a38068d90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 --2- 172.21.15.26:0/234442490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a540c0370 0x7f9a54141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 >> 172.21.15.26:0/234442490 conn(0x7f9a540c2a60 msgr2=0x7f9a54070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:28.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 shutdown_connections 2023-11-28T16:57:28.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.177+0000 7f9a5c5f8640 1 -- 172.21.15.26:0/234442490 wait complete. 2023-11-28T16:57:28.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:57:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69bc765640 1 Processor -- start 2023-11-28T16:57:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69bc765640 1 -- start start 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69bc765640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69b40a86d0 0x7f69b40a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69bc765640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b4156600 0x7f69b414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69bc765640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b4152d90 con 0x7f69b414fb30 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69bc765640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b4152480 con 0x7f69b40a86d0 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69bc765640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40a9760 con 0x7f69b4156600 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69ba501640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69b40a86d0 0x7f69b40a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69ba501640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69b40a86d0 0x7f69b40a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34138/0 (socket says 172.21.15.26:34138) 2023-11-28T16:57:28.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69ba501640 1 -- 172.21.15.26:0/1116358813 learned_addr learned my addr 172.21.15.26:0/1116358813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69b9d00640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b4156600 0x7f69b414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69ba501640 1 -- 172.21.15.26:0/1116358813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b4156600 msgr2=0x7f69b414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69ba501640 1 --2- 172.21.15.26:0/1116358813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b4156600 0x7f69b414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.349+0000 7f69ba501640 1 -- 172.21.15.26:0/1116358813 >> v1:172.21.15.79:6789/0 conn(0x7f69b414fb30 legacy=0x7f69b40aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.353+0000 7f69ba501640 1 -- 172.21.15.26:0/1116358813 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4152740 con 0x7f69b40a86d0 2023-11-28T16:57:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.353+0000 7f69ba501640 1 --2- 172.21.15.26:0/1116358813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b40a8f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009870 tx=0x7f69b001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2993aa7498c49a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.353+0000 7f69b94ff640 1 -- 172.21.15.26:0/1116358813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00ab600 con 0x7f69b40a86d0 2023-11-28T16:57:28.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.353+0000 7f69b94ff640 1 -- 172.21.15.26:0/1116358813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b00a7050 con 0x7f69b40a86d0 2023-11-28T16:57:28.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.353+0000 7f69b94ff640 1 -- 172.21.15.26:0/1116358813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00ab980 con 0x7f69b40a86d0 2023-11-28T16:57:28.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- 172.21.15.26:0/1116358813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 msgr2=0x7f69b40a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 --2- 172.21.15.26:0/1116358813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b40a8f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009870 tx=0x7f69b001c540 comp rx=0 tx=0).stop 2023-11-28T16:57:28.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- 172.21.15.26:0/1116358813 shutdown_connections 2023-11-28T16:57:28.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 --2- 172.21.15.26:0/1116358813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b4156600 0x7f69b414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 --2- 172.21.15.26:0/1116358813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b40a8f30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- 172.21.15.26:0/1116358813 >> 172.21.15.26:0/1116358813 conn(0x7f69b40c2a60 msgr2=0x7f69b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:28.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- 172.21.15.26:0/1116358813 shutdown_connections 2023-11-28T16:57:28.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- 172.21.15.26:0/1116358813 wait complete. 2023-11-28T16:57:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 Processor -- start 2023-11-28T16:57:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- start start 2023-11-28T16:57:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b4155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b414fb30 0x7f69b415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4156600 0x7f69b41ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4071a00 con 0x7f69b40a86d0 2023-11-28T16:57:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4071ce0 con 0x7f69b4156600 2023-11-28T16:57:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bc765640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4071fc0 con 0x7f69b414fb30 2023-11-28T16:57:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69ba501640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b4155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69ba501640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b4155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34152/0 (socket says 172.21.15.26:34152) 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69ba501640 1 -- 172.21.15.26:0/104148480 learned_addr learned my addr 172.21.15.26:0/104148480 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69b9d00640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b414fb30 0x7f69b415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69bad02640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4156600 0x7f69b41ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69ba501640 1 -- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b414fb30 msgr2=0x7f69b415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.357+0000 7f69ba501640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b414fb30 0x7f69b415b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69ba501640 1 -- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4156600 msgr2=0x7f69b41ed560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69ba501640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4156600 0x7f69b41ed560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69ba501640 1 -- 172.21.15.26:0/104148480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b00094d0 con 0x7f69b40a86d0 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69ba501640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b4155720 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f69b001abf0 tx=0x7f69b00192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69aaffd640 1 -- 172.21.15.26:0/104148480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00b6440 con 0x7f69b40a86d0 2023-11-28T16:57:28.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69aaffd640 1 -- 172.21.15.26:0/104148480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b00b65c0 con 0x7f69b40a86d0 2023-11-28T16:57:28.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4154f20 con 0x7f69b40a86d0 2023-11-28T16:57:28.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69aaffd640 1 -- 172.21.15.26:0/104148480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00b6970 con 0x7f69b40a86d0 2023-11-28T16:57:28.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b415b8a0 con 0x7f69b40a86d0 2023-11-28T16:57:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b404e890 con 0x7f69b40a86d0 2023-11-28T16:57:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69aaffd640 1 -- 172.21.15.26:0/104148480 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f69b00b2040 con 0x7f69b40a86d0 2023-11-28T16:57:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69aaffd640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69980668d0 0x7f6998068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.361+0000 7f69aaffd640 1 -- 172.21.15.26:0/104148480 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f69b011e400 con 0x7f69b40a86d0 2023-11-28T16:57:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.365+0000 7f69b9d00640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69980668d0 0x7f6998068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.365+0000 7f69b9d00640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69980668d0 0x7f6998068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69b4155e60 tx=0x7f69a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.365+0000 7f69aaffd640 1 -- 172.21.15.26:0/104148480 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69b00eb380 con 0x7f69b40a86d0 2023-11-28T16:57:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f69b40c48f0 con 0x7f69b40a86d0 2023-11-28T16:57:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69aaffd640 1 -- 172.21.15.26:0/104148480 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7f69b00ee9a0 con 0x7f69b40a86d0 2023-11-28T16:57:28.531 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69980668d0 msgr2=0x7f6998068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69980668d0 0x7f6998068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69b4155e60 tx=0x7f69a4009190 comp rx=0 tx=0).stop 2023-11-28T16:57:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 msgr2=0x7f69b4155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b4155720 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f69b001abf0 tx=0x7f69b00192e0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 shutdown_connections 2023-11-28T16:57:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4156600 0x7f69b41ed560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69980668d0 0x7f6998068d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69b414fb30 0x7f69b415b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 --2- 172.21.15.26:0/104148480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69b40a86d0 0x7f69b4155720 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 >> 172.21.15.26:0/104148480 conn(0x7f69b40c2a60 msgr2=0x7f69b40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 shutdown_connections 2023-11-28T16:57:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.525+0000 7f69bc765640 1 -- 172.21.15.26:0/104148480 wait complete. 2023-11-28T16:57:28.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:57:28.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.689+0000 7f71fa29c640 1 Processor -- start 2023-11-28T16:57:28.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.689+0000 7f71fa29c640 1 -- start start 2023-11-28T16:57:28.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.689+0000 7f71fa29c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f414e9d0 0x7f71f4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.689+0000 7f71fa29c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f406d320 con 0x7f71f4070b80 2023-11-28T16:57:28.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.689+0000 7f71fa29c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40721b0 con 0x7f71f40a8470 2023-11-28T16:57:28.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.689+0000 7f71fa29c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40c2830 con 0x7f71f414e9d0 2023-11-28T16:57:28.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f71f4070b80 0x7f71f40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60306/0 (socket says 172.21.15.26:60306) 2023-11-28T16:57:28.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f37fe640 1 -- 172.21.15.26:0/3741997771 learned_addr learned my addr 172.21.15.26:0/3741997771 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:28.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f3fff640 1 --2- 172.21.15.26:0/3741997771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f414e9d0 0x7f71f4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f2ffd640 1 -- 172.21.15.26:0/3741997771 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933604334 0 0) 0x7f71f406d320 con 0x7f71f4070b80 2023-11-28T16:57:28.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f2ffd640 1 -- 172.21.15.26:0/3741997771 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71dc003530 con 0x7f71f4070b80 2023-11-28T16:57:28.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f3fff640 1 -- 172.21.15.26:0/3741997771 >> v1:172.21.15.79:6789/0 conn(0x7f71f40a8470 legacy=0x7f71f406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f2ffd640 1 -- 172.21.15.26:0/3741997771 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218736335 0 0) 0x7f71f40721b0 con 0x7f71f40a8470 2023-11-28T16:57:28.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f3fff640 1 -- 172.21.15.26:0/3741997771 >> v1:172.21.15.26:6789/0 conn(0x7f71f4070b80 legacy=0x7f71f40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.693+0000 7f71f3fff640 1 -- 172.21.15.26:0/3741997771 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f4072450 con 0x7f71f414e9d0 2023-11-28T16:57:28.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71f3fff640 1 --2- 172.21.15.26:0/3741997771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f414e9d0 0x7f71f4151e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71e40097f0 tx=0x7f71e401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19f8000269b1a483 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71f2ffd640 1 -- 172.21.15.26:0/3741997771 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40ab600 con 0x7f71f414e9d0 2023-11-28T16:57:28.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71f2ffd640 1 -- 172.21.15.26:0/3741997771 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40a7050 con 0x7f71f414e9d0 2023-11-28T16:57:28.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71f2ffd640 1 -- 172.21.15.26:0/3741997771 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40ab980 con 0x7f71f414e9d0 2023-11-28T16:57:28.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- 172.21.15.26:0/3741997771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f414e9d0 msgr2=0x7f71f4151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 --2- 172.21.15.26:0/3741997771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f414e9d0 0x7f71f4151e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71e40097f0 tx=0x7f71e401c430 comp rx=0 tx=0).stop 2023-11-28T16:57:28.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- 172.21.15.26:0/3741997771 shutdown_connections 2023-11-28T16:57:28.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 --2- 172.21.15.26:0/3741997771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f414e9d0 0x7f71f4151e60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- 172.21.15.26:0/3741997771 >> 172.21.15.26:0/3741997771 conn(0x7f71f40c2ad0 msgr2=0x7f71f40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:28.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- 172.21.15.26:0/3741997771 shutdown_connections 2023-11-28T16:57:28.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- 172.21.15.26:0/3741997771 wait complete. 2023-11-28T16:57:28.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 Processor -- start 2023-11-28T16:57:28.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- start start 2023-11-28T16:57:28.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f4070b80 0x7f71f40c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71f40a8470 0x7f71f4144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f414e9d0 0x7f71f4144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f414a060 con 0x7f71f414e9d0 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4070750 con 0x7f71f40a8470 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.697+0000 7f71fa29c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40c5a10 con 0x7f71f4070b80 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f4070b80 0x7f71f40c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f8839640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f414e9d0 0x7f71f4144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71f40a8470 0x7f71f4144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f4070b80 0x7f71f40c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:46080/0 (socket says 172.21.15.26:46080) 2023-11-28T16:57:28.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 -- 172.21.15.26:0/258372164 learned_addr learned my addr 172.21.15.26:0/258372164 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 -- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71f40a8470 msgr2=0x7f71f4144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71f40a8470 0x7f71f4144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 -- 172.21.15.26:0/258372164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f414e9d0 msgr2=0x7f71f4144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f414e9d0 0x7f71f4144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 -- 172.21.15.26:0/258372164 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009420 con 0x7f71f4070b80 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f8839640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f414e9d0 0x7f71f4144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f3fff640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f4070b80 0x7f71f40c4e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71e4019040 tx=0x7f71e401ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f0ff9640 1 -- 172.21.15.26:0/258372164 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40b7650 con 0x7f71f4070b80 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f0ff9640 1 -- 172.21.15.26:0/258372164 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40b77d0 con 0x7f71f4070b80 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f0ff9640 1 -- 172.21.15.26:0/258372164 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40b7b80 con 0x7f71f4070b80 2023-11-28T16:57:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f40c5cf0 con 0x7f71f4070b80 2023-11-28T16:57:28.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f4149a10 con 0x7f71f4070b80 2023-11-28T16:57:28.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f404e890 con 0x7f71f4070b80 2023-11-28T16:57:28.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.701+0000 7f71f0ff9640 1 -- 172.21.15.26:0/258372164 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71e40b7ce0 con 0x7f71f4070b80 2023-11-28T16:57:28.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.705+0000 7f71f0ff9640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71e00668d0 0x7f71e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:28.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.705+0000 7f71f0ff9640 1 -- 172.21.15.26:0/258372164 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f71e411f6f0 con 0x7f71f4070b80 2023-11-28T16:57:28.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.705+0000 7f71f37fe640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71e00668d0 0x7f71e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:28.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.705+0000 7f71f37fe640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71e00668d0 0x7f71e0068d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f71f40c2640 tx=0x7f71e8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:28.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.709+0000 7f71f0ff9640 1 -- 172.21.15.26:0/258372164 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71e40ec6f0 con 0x7f71f4070b80 2023-11-28T16:57:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.877+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f71f40700a0 con 0x7f71f4070b80 2023-11-28T16:57:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71f0ff9640 1 -- 172.21.15.26:0/258372164 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f71e40efd10 con 0x7f71f4070b80 2023-11-28T16:57:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:57:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71e00668d0 msgr2=0x7f71e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71e00668d0 0x7f71e0068d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f71f40c2640 tx=0x7f71e8007d40 comp rx=0 tx=0).stop 2023-11-28T16:57:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f4070b80 msgr2=0x7f71f40c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f4070b80 0x7f71f40c4e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71e4019040 tx=0x7f71e401ac70 comp rx=0 tx=0).stop 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 shutdown_connections 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f414e9d0 0x7f71f4144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71f40a8470 0x7f71f4144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f71e00668d0 0x7f71e0068d90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 --2- 172.21.15.26:0/258372164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71f4070b80 0x7f71f40c4e70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 >> 172.21.15.26:0/258372164 conn(0x7f71f40c2ad0 msgr2=0x7f71f40bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 shutdown_connections 2023-11-28T16:57:28.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:28.881+0000 7f71fa29c640 1 -- 172.21.15.26:0/258372164 wait complete. 2023-11-28T16:57:28.907 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T16:57:28.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:28.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:28.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:57:28.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:28.937 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T16:57:28.991 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:28.991 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:29.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:57:29.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:57:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.221+0000 7f38d1baa640 1 Processor -- start 2023-11-28T16:57:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.221+0000 7f38d1baa640 1 -- start start 2023-11-28T16:57:29.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38d1baa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc14fcc0 0x7f38cc156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38d1baa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38cc06d980 0x7f38cc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38d1baa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38cc152fe0 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38d1baa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc0aa340 con 0x7f38cc06d980 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38d1baa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1532c0 con 0x7f38cc14fcc0 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38cbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f38cc0ab3b0 0x7f38cc0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60322/0 (socket says 172.21.15.26:60322) 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38cbfff640 1 -- 172.21.15.26:0/2979045210 learned_addr learned my addr 172.21.15.26:0/2979045210 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38c3fff640 1 --2- 172.21.15.26:0/2979045210 >> v2:172.21.15.79:3300/0 conn(0x7f38cc06d980 0x7f38cc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38cb7fe640 1 --2- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc14fcc0 0x7f38cc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38caffd640 1 -- 172.21.15.26:0/2979045210 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354177474 0 0) 0x7f38cc152fe0 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38caffd640 1 -- 172.21.15.26:0/2979045210 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b8003530 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38c3fff640 1 -- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc14fcc0 msgr2=0x7f38cc156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38c3fff640 1 --2- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc14fcc0 0x7f38cc156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38c3fff640 1 -- 172.21.15.26:0/2979045210 >> v1:172.21.15.26:6789/0 conn(0x7f38cc0ab3b0 legacy=0x7f38cc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:29.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38c3fff640 1 -- 172.21.15.26:0/2979045210 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc155a20 con 0x7f38cc06d980 2023-11-28T16:57:29.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.225+0000 7f38cb7fe640 1 --2- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc14fcc0 0x7f38cc156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:29.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38c3fff640 1 --2- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc06d980 0x7f38cc0aae70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38b40097c0 tx=0x7f38b401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf373e632ae816a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:29.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38caffd640 1 -- 172.21.15.26:0/2979045210 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40ab650 con 0x7f38cc06d980 2023-11-28T16:57:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38caffd640 1 -- 172.21.15.26:0/2979045210 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b40ab7b0 con 0x7f38cc06d980 2023-11-28T16:57:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38caffd640 1 -- 172.21.15.26:0/2979045210 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40abb40 con 0x7f38cc06d980 2023-11-28T16:57:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc06d980 msgr2=0x7f38cc0aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 --2- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc06d980 0x7f38cc0aae70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38b40097c0 tx=0x7f38b401c450 comp rx=0 tx=0).stop 2023-11-28T16:57:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- 172.21.15.26:0/2979045210 shutdown_connections 2023-11-28T16:57:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 --2- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc06d980 0x7f38cc0aae70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 --2- 172.21.15.26:0/2979045210 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc14fcc0 0x7f38cc156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- 172.21.15.26:0/2979045210 >> 172.21.15.26:0/2979045210 conn(0x7f38cc0c2ad0 msgr2=0x7f38cc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- 172.21.15.26:0/2979045210 shutdown_connections 2023-11-28T16:57:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- 172.21.15.26:0/2979045210 wait complete. 2023-11-28T16:57:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 Processor -- start 2023-11-28T16:57:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- start start 2023-11-28T16:57:29.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc06d980 0x7f38cc1ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:29.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38cc0ab3b0 0x7f38cc1483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:29.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc071510 0x7f38cc071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc157410 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1ed930 con 0x7f38cc071510 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.229+0000 7f38d1baa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc15bd00 con 0x7f38cc06d980 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38cc0ab3b0 0x7f38cc1483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38cc0ab3b0 0x7f38cc1483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34164/0 (socket says 172.21.15.26:34164) 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 -- 172.21.15.26:0/660964403 learned_addr learned my addr 172.21.15.26:0/660964403 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38cb7fe640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc06d980 0x7f38cc1ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38cbfff640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc071510 0x7f38cc071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 -- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc06d980 msgr2=0x7f38cc1ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc06d980 0x7f38cc1ed3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 -- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc071510 msgr2=0x7f38cc071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc071510 0x7f38cc071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 -- 172.21.15.26:0/660964403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009420 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38cbfff640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc071510 0x7f38cc071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c3fff640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38cc0ab3b0 0x7f38cc1483e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f38b40ad040 tx=0x7f38b401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c8ff9640 1 -- 172.21.15.26:0/660964403 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40bf610 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c8ff9640 1 -- 172.21.15.26:0/660964403 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b40bf7b0 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c8ff9640 1 -- 172.21.15.26:0/660964403 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40bfb60 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b4009420 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc15b6b0 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc15b510 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.233+0000 7f38c8ff9640 1 -- 172.21.15.26:0/660964403 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f38b40b5400 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.237+0000 7f38c8ff9640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38ac0668d0 0x7f38ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.237+0000 7f38c8ff9640 1 -- 172.21.15.26:0/660964403 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f38b411f120 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.237+0000 7f38cb7fe640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38ac0668d0 0x7f38ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.237+0000 7f38cb7fe640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38ac0668d0 0x7f38ac068d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009c50 tx=0x7f38bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:29.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.237+0000 7f38c8ff9640 1 -- 172.21.15.26:0/660964403 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38cc15b510 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.433+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38cc15b510 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38c8ff9640 1 -- 172.21.15.26:0/660964403 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7f38cc15b510 con 0x7f38cc0ab3b0 2023-11-28T16:57:29.443 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:57:29.443 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38ac0668d0 msgr2=0x7f38ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38ac0668d0 0x7f38ac068d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009c50 tx=0x7f38bc009190 comp rx=0 tx=0).stop 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38cc0ab3b0 msgr2=0x7f38cc1483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38cc0ab3b0 0x7f38cc1483e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f38b40ad040 tx=0x7f38b401ac90 comp rx=0 tx=0).stop 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 shutdown_connections 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38cc071510 0x7f38cc071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38cc0ab3b0 0x7f38cc1483e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38ac0668d0 0x7f38ac068d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 --2- 172.21.15.26:0/660964403 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38cc06d980 0x7f38cc1ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 >> 172.21.15.26:0/660964403 conn(0x7f38cc0c2ad0 msgr2=0x7f38cc156450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 shutdown_connections 2023-11-28T16:57:29.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:29.437+0000 7f38d1baa640 1 -- 172.21.15.26:0/660964403 wait complete. 2023-11-28T16:57:29.464 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T16:57:29.464 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:57:29.464 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-11-28T16:57:29.464 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T16:57:29.464 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:29.464 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T16:57:29.464 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:57:29.465 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.DK0oKg6m0r 2023-11-28T16:57:29.465 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-11-28T16:57:29.474 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.RSEWYPqSIY 2023-11-28T16:57:29.474 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /tmp/tmp.DK0oKg6m0r /tmp/tmp.RSEWYPqSIY 2023-11-28T16:57:29.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.RSEWYPqSIY 2023-11-28T16:57:29.664 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.RSEWYPqSIY is 185B 2023-11-28T16:57:29.680 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.RSEWYPqSIY 2023-11-28T16:57:29.689 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQD2G2ZlyL6NDhAAeORl3eJBkAIlPygrNBLnaQ== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T16:57:29.689 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:57:29.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:29.689 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-11-28T16:57:29.739 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:1b:cd:da:6f brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:29.741 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:57:29.742 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:57:29.742 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:57:29.742 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:57:29.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:29.743 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:57:29.805 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-11-28T16:57:29.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:29.807 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-11-28T16:57:29.859 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-11-28T16:57:29.860 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:57:29.860 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T16:57:29.860 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:57:29.860 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T16:57:29.860 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:57:29.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:29.860 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:57:29.861 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:57:29.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T16:57:29.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T16:57:29.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T16:57:29.861 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:57:29.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:29.954 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:57:29.963 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T16:57:29.964 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:57:29.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:29.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-11-28T16:57:30.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:30.027 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:30.078 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:57:30.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:57:30.080 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:57:30.130 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:30.130 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/tmp/tmp.DK0oKg6m0r of=/dev/stdout 2023-11-28T16:57:30.183 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-11-28T16:57:30.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:30.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQD2G2ZlyL6NDhAAeORl3eJBkAIlPygrNBLnaQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:30.278 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,secret=AQD2G2ZlyL6NDhAAeORl3eJBkAIlPygrNBLnaQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:30.281 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:30.281 INFO:teuthology.orchestra.run.smithi026.stdout:keyring.get_secret failed 2023-11-28T16:57:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:mount.ceph: kernel BUG! 2023-11-28T16:57:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:mount error: no mds server is up or the cluster is laggy 2023-11-28T16:57:30.289 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,secret=AQD2G2ZlyL6NDhAAeORl3eJBkAIlPygrNBLnaQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:57:30.289 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:57:30.289 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:57:30.289 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: testuser@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs2=/ 2023-11-28T16:57:30.289 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:57:30.293 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T16:57:30.293 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-28T16:57:30.293 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T16:57:30.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:57:30.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:57:30.407 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T16:57:30.410 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:30.410 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:30.419 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:57:30.420 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:30.420 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:30.430 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:30.430 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:30.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4bafe640 1 Processor -- start 2023-11-28T16:57:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4bafe640 1 -- start start 2023-11-28T16:57:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4bafe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc440ca610 0x7fbc440c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4bafe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc440c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4bafe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc44155790 con 0x7fbc4406cd90 2023-11-28T16:57:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4bafe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440c4b00 con 0x7fbc440ca610 2023-11-28T16:57:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4bafe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440c4de0 con 0x7fbc440bd720 2023-11-28T16:57:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc49099640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc440c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4989a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc440ca610 0x7fbc440c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc49099640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc440c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:46122/0 (socket says 172.21.15.26:46122) 2023-11-28T16:57:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4989a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc440ca610 0x7fbc440c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:58842/0 (socket says 172.21.15.26:58842) 2023-11-28T16:57:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc49099640 1 -- 172.21.15.26:0/2940504936 learned_addr learned my addr 172.21.15.26:0/2940504936 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc4a09b640 1 --1- 172.21.15.26:0/2940504936 >> v1:172.21.15.79:6789/0 conn(0x7fbc4406cd90 0x7fbc44158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:48302/0 (socket says 172.21.15.26:48302) 2023-11-28T16:57:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc49099640 1 -- 172.21.15.26:0/2940504936 >> v2:172.21.15.79:3300/0 conn(0x7fbc440ca610 msgr2=0x7fbc440c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc49099640 1 --2- 172.21.15.26:0/2940504936 >> v2:172.21.15.79:3300/0 conn(0x7fbc440ca610 0x7fbc440c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc49099640 1 -- 172.21.15.26:0/2940504936 >> v1:172.21.15.79:6789/0 conn(0x7fbc4406cd90 legacy=0x7fbc44158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.621+0000 7fbc49099640 1 -- 172.21.15.26:0/2940504936 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44157e30 con 0x7fbc440bd720 2023-11-28T16:57:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc49099640 1 --2- 172.21.15.26:0/2940504936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc440c9a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3401c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e587a12440adbdfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc48898640 1 -- 172.21.15.26:0/2940504936 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc440c52d0 con 0x7fbc440bd720 2023-11-28T16:57:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc48898640 1 -- 172.21.15.26:0/2940504936 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340a4940 con 0x7fbc440bd720 2023-11-28T16:57:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc48898640 1 -- 172.21.15.26:0/2940504936 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340a4cd0 con 0x7fbc440bd720 2023-11-28T16:57:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2940504936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 msgr2=0x7fbc440c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2940504936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc440c9a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3401c100 comp rx=0 tx=0).stop 2023-11-28T16:57:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2940504936 shutdown_connections 2023-11-28T16:57:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2940504936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc440c9a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2940504936 >> v2:172.21.15.79:3300/0 conn(0x7fbc440ca610 0x7fbc440c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2940504936 >> 172.21.15.26:0/2940504936 conn(0x7fbc44071ea0 msgr2=0x7fbc440722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2940504936 shutdown_connections 2023-11-28T16:57:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.625+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2940504936 wait complete. 2023-11-28T16:57:30.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 Processor -- start 2023-11-28T16:57:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 -- start start 2023-11-28T16:57:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc4406cd90 0x7fbc441f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc441f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440ca610 0x7fbc440c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44151680 con 0x7fbc4406cd90 2023-11-28T16:57:30.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440be000 con 0x7fbc440ca610 2023-11-28T16:57:30.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44151e20 con 0x7fbc440bd720 2023-11-28T16:57:30.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc4406cd90 0x7fbc441f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc4406cd90 0x7fbc441f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34174/0 (socket says 172.21.15.26:34174) 2023-11-28T16:57:30.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 -- 172.21.15.26:0/2300287674 learned_addr learned my addr 172.21.15.26:0/2300287674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:30.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc49099640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc441f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4a09b640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440ca610 0x7fbc440c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 -- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 msgr2=0x7fbc441f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc441f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 -- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440ca610 msgr2=0x7fbc440c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440ca610 0x7fbc440c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 -- 172.21.15.26:0/2300287674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340094d0 con 0x7fbc4406cd90 2023-11-28T16:57:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4989a640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc4406cd90 0x7fbc441f1b60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000e870 tx=0x7fbc4000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc3a7fc640 1 -- 172.21.15.26:0/2300287674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40009510 con 0x7fbc4406cd90 2023-11-28T16:57:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc3a7fc640 1 -- 172.21.15.26:0/2300287674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4000eec0 con 0x7fbc4406cd90 2023-11-28T16:57:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc3a7fc640 1 -- 172.21.15.26:0/2300287674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000cb40 con 0x7fbc4406cd90 2023-11-28T16:57:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44151860 con 0x7fbc4406cd90 2023-11-28T16:57:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.629+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc440bdc90 con 0x7fbc4406cd90 2023-11-28T16:57:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.633+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4404e890 con 0x7fbc4406cd90 2023-11-28T16:57:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.633+0000 7fbc3a7fc640 1 -- 172.21.15.26:0/2300287674 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbc4000cca0 con 0x7fbc4406cd90 2023-11-28T16:57:30.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.633+0000 7fbc3a7fc640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc280668d0 0x7fbc28068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.633+0000 7fbc3a7fc640 1 -- 172.21.15.26:0/2300287674 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbc40084880 con 0x7fbc4406cd90 2023-11-28T16:57:30.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.633+0000 7fbc49099640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc280668d0 0x7fbc28068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.633+0000 7fbc49099640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc280668d0 0x7fbc28068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc340ae000 tx=0x7fbc34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:30.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.637+0000 7fbc3a7fc640 1 -- 172.21.15.26:0/2300287674 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc40051800 con 0x7fbc4406cd90 2023-11-28T16:57:30.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.793+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc44157910 con 0x7fbc4406cd90 2023-11-28T16:57:30.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc3a7fc640 1 -- 172.21.15.26:0/2300287674 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20157 (secure 0 0 0) 0x7fbc40054e20 con 0x7fbc4406cd90 2023-11-28T16:57:30.803 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:30.804 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:18.259952+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc280668d0 msgr2=0x7fbc28068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc280668d0 0x7fbc28068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc340ae000 tx=0x7fbc34009040 comp rx=0 tx=0).stop 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc4406cd90 msgr2=0x7fbc441f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc4406cd90 0x7fbc441f1b60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000e870 tx=0x7fbc4000ec70 comp rx=0 tx=0).stop 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 shutdown_connections 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440ca610 0x7fbc440c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc280668d0 0x7fbc28068d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc440bd720 0x7fbc441f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 --2- 172.21.15.26:0/2300287674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc4406cd90 0x7fbc441f1b60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 >> 172.21.15.26:0/2300287674 conn(0x7fbc44071ea0 msgr2=0x7fbc4415f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:30.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 shutdown_connections 2023-11-28T16:57:30.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.797+0000 7fbc4bafe640 1 -- 172.21.15.26:0/2300287674 wait complete. 2023-11-28T16:57:30.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:01.716708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:02.252332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:57:14.412799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:57:15.689901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:30.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:30.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c49232640 1 Processor -- start 2023-11-28T16:57:30.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c49232640 1 -- start start 2023-11-28T16:57:30.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c49232640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c440a86d0 0x7f6c440a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c49232640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c44156600 0x7f6c4414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c49232640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c44152d90 con 0x7f6c4414fb30 2023-11-28T16:57:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c49232640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4414ffa0 con 0x7f6c44156600 2023-11-28T16:57:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c49232640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c44152480 con 0x7f6c440a86d0 2023-11-28T16:57:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c4259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c44156600 0x7f6c4414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c4359e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6c4414fb30 0x7f6c440aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60324/0 (socket says 172.21.15.26:60324) 2023-11-28T16:57:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c4359e640 1 -- 172.21.15.26:0/1637088789 learned_addr learned my addr 172.21.15.26:0/1637088789 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c42d9d640 1 --2- 172.21.15.26:0/1637088789 >> v2:172.21.15.79:3300/0 conn(0x7f6c440a86d0 0x7f6c440a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c4259c640 1 -- 172.21.15.26:0/1637088789 >> v2:172.21.15.79:3300/0 conn(0x7f6c440a86d0 msgr2=0x7f6c440a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c4259c640 1 --2- 172.21.15.26:0/1637088789 >> v2:172.21.15.79:3300/0 conn(0x7f6c440a86d0 0x7f6c440a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c4259c640 1 -- 172.21.15.26:0/1637088789 >> v1:172.21.15.26:6789/0 conn(0x7f6c4414fb30 legacy=0x7f6c440aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c4259c640 1 -- 172.21.15.26:0/1637088789 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440a9760 con 0x7f6c44156600 2023-11-28T16:57:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.965+0000 7f6c41d9b640 1 -- 172.21.15.26:0/1637088789 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093328545 0 0) 0x7f6c44152d90 con 0x7f6c4414fb30 2023-11-28T16:57:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c4259c640 1 --2- 172.21.15.26:0/1637088789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c44156600 0x7f6c4414f5f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c380097c0 tx=0x7f6c3801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f603d91f16e5e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c41d9b640 1 -- 172.21.15.26:0/1637088789 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380ab600 con 0x7f6c44156600 2023-11-28T16:57:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c41d9b640 1 -- 172.21.15.26:0/1637088789 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c380a7050 con 0x7f6c44156600 2023-11-28T16:57:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c41d9b640 1 -- 172.21.15.26:0/1637088789 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380ab980 con 0x7f6c44156600 2023-11-28T16:57:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 -- 172.21.15.26:0/1637088789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c44156600 msgr2=0x7f6c4414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 --2- 172.21.15.26:0/1637088789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c44156600 0x7f6c4414f5f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c380097c0 tx=0x7f6c3801c440 comp rx=0 tx=0).stop 2023-11-28T16:57:30.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 -- 172.21.15.26:0/1637088789 shutdown_connections 2023-11-28T16:57:30.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 --2- 172.21.15.26:0/1637088789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c44156600 0x7f6c4414f5f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 --2- 172.21.15.26:0/1637088789 >> v2:172.21.15.79:3300/0 conn(0x7f6c440a86d0 0x7f6c440a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 -- 172.21.15.26:0/1637088789 >> 172.21.15.26:0/1637088789 conn(0x7f6c440c2a60 msgr2=0x7f6c440c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:30.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 -- 172.21.15.26:0/1637088789 shutdown_connections 2023-11-28T16:57:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 -- 172.21.15.26:0/1637088789 wait complete. 2023-11-28T16:57:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 Processor -- start 2023-11-28T16:57:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.969+0000 7f6c49232640 1 -- start start 2023-11-28T16:57:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c440a86d0 0x7f6c441ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c4414fb30 0x7f6c440bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44156600 0x7f6c441416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441edba0 con 0x7f6c440a86d0 2023-11-28T16:57:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44070260 con 0x7f6c4414fb30 2023-11-28T16:57:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441ed300 con 0x7f6c44156600 2023-11-28T16:57:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c440a86d0 0x7f6c441ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c440a86d0 0x7f6c441ecc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34198/0 (socket says 172.21.15.26:34198) 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 -- 172.21.15.26:0/779560462 learned_addr learned my addr 172.21.15.26:0/779560462 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c4259c640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c4414fb30 0x7f6c440bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c4359e640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44156600 0x7f6c441416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 -- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44156600 msgr2=0x7f6c441416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44156600 0x7f6c441416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 -- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c4414fb30 msgr2=0x7f6c440bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c4414fb30 0x7f6c440bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 -- 172.21.15.26:0/779560462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38009420 con 0x7f6c440a86d0 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c4259c640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c4414fb30 0x7f6c440bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c42d9d640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c440a86d0 0x7f6c441ecc00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400d5f0 tx=0x7f6c3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c2b7fe640 1 -- 172.21.15.26:0/779560462 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340125f0 con 0x7f6c440a86d0 2023-11-28T16:57:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c2b7fe640 1 -- 172.21.15.26:0/779560462 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c34012750 con 0x7f6c440a86d0 2023-11-28T16:57:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c441ed5e0 con 0x7f6c440a86d0 2023-11-28T16:57:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c2b7fe640 1 -- 172.21.15.26:0/779560462 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34012ae0 con 0x7f6c440a86d0 2023-11-28T16:57:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c44070f20 con 0x7f6c440a86d0 2023-11-28T16:57:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.973+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4404e890 con 0x7f6c440a86d0 2023-11-28T16:57:30.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.977+0000 7f6c2b7fe640 1 -- 172.21.15.26:0/779560462 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c34012c40 con 0x7f6c440a86d0 2023-11-28T16:57:30.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.977+0000 7f6c2b7fe640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6c300668d0 0x7f6c30068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:30.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.977+0000 7f6c2b7fe640 1 -- 172.21.15.26:0/779560462 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6c34084b50 con 0x7f6c440a86d0 2023-11-28T16:57:30.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.977+0000 7f6c4259c640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6c300668d0 0x7f6c30068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:30.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.977+0000 7f6c4259c640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6c300668d0 0x7f6c30068d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c380ad000 tx=0x7f6c380a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:30.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:30.985+0000 7f6c2b7fe640 1 -- 172.21.15.26:0/779560462 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c34051ac0 con 0x7f6c440a86d0 2023-11-28T16:57:31.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c440c31c0 con 0x7f6c440a86d0 2023-11-28T16:57:31.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c2b7fe640 1 -- 172.21.15.26:0/779560462 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c34007380 con 0x7f6c440a86d0 2023-11-28T16:57:31.149 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6c300668d0 msgr2=0x7f6c30068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6c300668d0 0x7f6c30068d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c380ad000 tx=0x7f6c380a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c440a86d0 msgr2=0x7f6c441ecc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c440a86d0 0x7f6c441ecc00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400d5f0 tx=0x7f6c3400dab0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 shutdown_connections 2023-11-28T16:57:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6c300668d0 0x7f6c30068d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44156600 0x7f6c441416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c4414fb30 0x7f6c440bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 --2- 172.21.15.26:0/779560462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c440a86d0 0x7f6c441ecc00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 >> 172.21.15.26:0/779560462 conn(0x7f6c440c2a60 msgr2=0x7f6c4414eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 shutdown_connections 2023-11-28T16:57:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.141+0000 7f6c49232640 1 -- 172.21.15.26:0/779560462 wait complete. 2023-11-28T16:57:31.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:57:31.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c10ad640 1 Processor -- start 2023-11-28T16:57:31.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c10ad640 1 -- start start 2023-11-28T16:57:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c10ad640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c2750 0x7f55bc0bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c10ad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f55bc071f30 0x7f55bc0bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c10ad640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc0c1410 con 0x7f55bc0c0460 2023-11-28T16:57:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c10ad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc0c0e90 con 0x7f55bc071f30 2023-11-28T16:57:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c10ad640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc0c1130 con 0x7f55bc0c2750 2023-11-28T16:57:31.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c08ac640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f55bc071f30 0x7f55bc0bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55bb7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f55bc0c0460 0x7f55bc0c4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49498/0 (socket says 172.21.15.26:49498) 2023-11-28T16:57:31.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55bb7fe640 1 -- 172.21.15.26:0/2313781480 learned_addr learned my addr 172.21.15.26:0/2313781480 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:31.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55bbfff640 1 --2- 172.21.15.26:0/2313781480 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c2750 0x7f55bc0bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c08ac640 1 -- 172.21.15.26:0/2313781480 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c2750 msgr2=0x7f55bc0bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:31.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c08ac640 1 --2- 172.21.15.26:0/2313781480 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c2750 0x7f55bc0bc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c08ac640 1 -- 172.21.15.26:0/2313781480 >> v1:172.21.15.26:6789/0 conn(0x7f55bc0c0460 legacy=0x7f55bc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.313+0000 7f55c08ac640 1 -- 172.21.15.26:0/2313781480 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc06da20 con 0x7f55bc071f30 2023-11-28T16:57:31.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c08ac640 1 --2- 172.21.15.26:0/2313781480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc071f30 0x7f55bc0bc8b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0c3620 tx=0x7f55b401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e40d642ec8b60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:31.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55baffd640 1 -- 172.21.15.26:0/2313781480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40a5930 con 0x7f55bc071f30 2023-11-28T16:57:31.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55baffd640 1 -- 172.21.15.26:0/2313781480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc0c4020 con 0x7f55bc071f30 2023-11-28T16:57:31.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55baffd640 1 -- 172.21.15.26:0/2313781480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40a5cb0 con 0x7f55bc071f30 2023-11-28T16:57:31.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 -- 172.21.15.26:0/2313781480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc071f30 msgr2=0x7f55bc0bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 --2- 172.21.15.26:0/2313781480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc071f30 0x7f55bc0bc8b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0c3620 tx=0x7f55b401c850 comp rx=0 tx=0).stop 2023-11-28T16:57:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 -- 172.21.15.26:0/2313781480 shutdown_connections 2023-11-28T16:57:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 --2- 172.21.15.26:0/2313781480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc071f30 0x7f55bc0bc8b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 --2- 172.21.15.26:0/2313781480 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c2750 0x7f55bc0bc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 -- 172.21.15.26:0/2313781480 >> 172.21.15.26:0/2313781480 conn(0x7f55bc0c5a60 msgr2=0x7f55bc0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 -- 172.21.15.26:0/2313781480 shutdown_connections 2023-11-28T16:57:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.317+0000 7f55c10ad640 1 -- 172.21.15.26:0/2313781480 wait complete. 2023-11-28T16:57:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 Processor -- start 2023-11-28T16:57:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 -- start start 2023-11-28T16:57:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc071f30 0x7f55bc150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c0460 0x7f55bc06c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc0c2750 0x7f55bc070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc150970 con 0x7f55bc0c2750 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc071cf0 con 0x7f55bc0c0460 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0a8e40 con 0x7f55bc071f30 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc0c2750 0x7f55bc070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc0c2750 0x7f55bc070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34920/0 (socket says 172.21.15.26:34920) 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 -- 172.21.15.26:0/848392573 learned_addr learned my addr 172.21.15.26:0/848392573 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55bb7fe640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c0460 0x7f55bc06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55bbfff640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc071f30 0x7f55bc150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 -- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc071f30 msgr2=0x7f55bc150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc071f30 0x7f55bc150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 -- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c0460 msgr2=0x7f55bc06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c0460 0x7f55bc06c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 -- 172.21.15.26:0/848392573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b4009a70 con 0x7f55bc0c2750 2023-11-28T16:57:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55bb7fe640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c0460 0x7f55bc06c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c08ac640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc0c2750 0x7f55bc070a70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f55b4019460 tx=0x7f55b40195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55b8ff9640 1 -- 172.21.15.26:0/848392573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40b9860 con 0x7f55bc0c2750 2023-11-28T16:57:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55b8ff9640 1 -- 172.21.15.26:0/848392573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b40b99c0 con 0x7f55bc0c2750 2023-11-28T16:57:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc14ff10 con 0x7f55bc0c2750 2023-11-28T16:57:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55b8ff9640 1 -- 172.21.15.26:0/848392573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40b9d70 con 0x7f55bc0c2750 2023-11-28T16:57:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc072950 con 0x7f55bc0c2750 2023-11-28T16:57:31.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.321+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc0680c0 con 0x7f55bc0c2750 2023-11-28T16:57:31.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.325+0000 7f55b8ff9640 1 -- 172.21.15.26:0/848392573 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f55b40ad440 con 0x7f55bc0c2750 2023-11-28T16:57:31.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.325+0000 7f55b8ff9640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55a80668d0 0x7f55a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.325+0000 7f55b8ff9640 1 -- 172.21.15.26:0/848392573 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f55b411fa40 con 0x7f55bc0c2750 2023-11-28T16:57:31.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.325+0000 7f55bbfff640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55a80668d0 0x7f55a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.325+0000 7f55bbfff640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55a80668d0 0x7f55a8068d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0079c0 tx=0x7f55ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:31.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.329+0000 7f55b8ff9640 1 -- 172.21.15.26:0/848392573 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55b40ec9a0 con 0x7f55bc0c2750 2023-11-28T16:57:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55bc074970 con 0x7f55bc0c2750 2023-11-28T16:57:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55b8ff9640 1 -- 172.21.15.26:0/848392573 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55b4009450 con 0x7f55bc0c2750 2023-11-28T16:57:31.495 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55a80668d0 msgr2=0x7f55a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55a80668d0 0x7f55a8068d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0079c0 tx=0x7f55ac008040 comp rx=0 tx=0).stop 2023-11-28T16:57:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc0c2750 msgr2=0x7f55bc070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc0c2750 0x7f55bc070a70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f55b4019460 tx=0x7f55b40195f0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 shutdown_connections 2023-11-28T16:57:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55bc0c2750 0x7f55bc070a70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c0460 0x7f55bc06c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55a80668d0 0x7f55a8068d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 --2- 172.21.15.26:0/848392573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc071f30 0x7f55bc150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 >> 172.21.15.26:0/848392573 conn(0x7f55bc0c5a60 msgr2=0x7f55bc0c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 shutdown_connections 2023-11-28T16:57:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.489+0000 7f55c10ad640 1 -- 172.21.15.26:0/848392573 wait complete. 2023-11-28T16:57:31.516 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:57:31.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 Processor -- start 2023-11-28T16:57:31.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 -- start start 2023-11-28T16:57:31.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded806dfb0 0x7fded80c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fded80728f0 0x7fded80a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fded80a5210 0x7fded8071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded814ee20 con 0x7fded80a5210 2023-11-28T16:57:31.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded806e390 con 0x7fded80728f0 2023-11-28T16:57:31.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdede5c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded806be30 con 0x7fded806dfb0 2023-11-28T16:57:31.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fded80a5210 0x7fded8071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fded80a5210 0x7fded8071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34936/0 (socket says 172.21.15.26:34936) 2023-11-28T16:57:31.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 -- 172.21.15.26:0/1782361328 learned_addr learned my addr 172.21.15.26:0/1782361328 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:31.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 -- 172.21.15.26:0/1782361328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded806dfb0 msgr2=0x7fded80c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:31.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fded7fff640 1 --2- 172.21.15.26:0/1782361328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded806dfb0 0x7fded80c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fded77fe640 1 --2- 172.21.15.26:0/1782361328 >> v2:172.21.15.79:3300/0 conn(0x7fded80728f0 0x7fded80a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 --2- 172.21.15.26:0/1782361328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded806dfb0 0x7fded80c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 -- 172.21.15.26:0/1782361328 >> v2:172.21.15.79:3300/0 conn(0x7fded80728f0 msgr2=0x7fded80a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:31.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 --2- 172.21.15.26:0/1782361328 >> v2:172.21.15.79:3300/0 conn(0x7fded80728f0 0x7fded80a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fdedcb61640 1 -- 172.21.15.26:0/1782361328 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded8151f60 con 0x7fded80a5210 2023-11-28T16:57:31.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fded7fff640 1 --2- 172.21.15.26:0/1782361328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded806dfb0 0x7fded80c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:31.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.661+0000 7fded77fe640 1 --2- 172.21.15.26:0/1782361328 >> v2:172.21.15.79:3300/0 conn(0x7fded80728f0 0x7fded80a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:31.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdedcb61640 1 --2- 172.21.15.26:0/1782361328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded80a5210 0x7fded8071530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fded80a8ae0 tx=0x7fded001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41e9c681ae52399 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:31.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fded6ffd640 1 -- 172.21.15.26:0/1782361328 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8072280 con 0x7fded80a5210 2023-11-28T16:57:31.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fded6ffd640 1 -- 172.21.15.26:0/1782361328 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded00a5650 con 0x7fded80a5210 2023-11-28T16:57:31.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fded6ffd640 1 -- 172.21.15.26:0/1782361328 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00a59e0 con 0x7fded80a5210 2023-11-28T16:57:31.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 -- 172.21.15.26:0/1782361328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded80a5210 msgr2=0x7fded8071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1782361328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded80a5210 0x7fded8071530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fded80a8ae0 tx=0x7fded001c9d0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 -- 172.21.15.26:0/1782361328 shutdown_connections 2023-11-28T16:57:31.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1782361328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded80a5210 0x7fded8071530 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1782361328 >> v2:172.21.15.79:3300/0 conn(0x7fded80728f0 0x7fded80a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1782361328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded806dfb0 0x7fded80c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 -- 172.21.15.26:0/1782361328 >> 172.21.15.26:0/1782361328 conn(0x7fded80a7a20 msgr2=0x7fded80a7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:31.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 -- 172.21.15.26:0/1782361328 shutdown_connections 2023-11-28T16:57:31.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 -- 172.21.15.26:0/1782361328 wait complete. 2023-11-28T16:57:31.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 Processor -- start 2023-11-28T16:57:31.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.665+0000 7fdede5c4640 1 -- start start 2023-11-28T16:57:31.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded806dfb0 0x7fded8150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded80728f0 0x7fded814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded80a5210 0x7fded814b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded814e900 con 0x7fded806dfb0 2023-11-28T16:57:31.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded81ed6d0 con 0x7fded80a5210 2023-11-28T16:57:31.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded81ed3f0 con 0x7fded80728f0 2023-11-28T16:57:31.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded806dfb0 0x7fded8150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded806dfb0 0x7fded8150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34946/0 (socket says 172.21.15.26:34946) 2023-11-28T16:57:31.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 -- 172.21.15.26:0/1993735862 learned_addr learned my addr 172.21.15.26:0/1993735862 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:31.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdedcb61640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded80a5210 0x7fded814b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded77fe640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded80728f0 0x7fded814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 -- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded80728f0 msgr2=0x7fded814e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded80728f0 0x7fded814e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 -- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded80a5210 msgr2=0x7fded814b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded80a5210 0x7fded814b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 -- 172.21.15.26:0/1993735862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0009b30 con 0x7fded806dfb0 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded7fff640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded806dfb0 0x7fded8150e10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c7c0 tx=0x7fdec800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded4ff9640 1 -- 172.21.15.26:0/1993735862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007a30 con 0x7fded806dfb0 2023-11-28T16:57:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded4ff9640 1 -- 172.21.15.26:0/1993735862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8007b90 con 0x7fded806dfb0 2023-11-28T16:57:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded814f2e0 con 0x7fded806dfb0 2023-11-28T16:57:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fded4ff9640 1 -- 172.21.15.26:0/1993735862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec800ce70 con 0x7fded806dfb0 2023-11-28T16:57:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded814b6c0 con 0x7fded806dfb0 2023-11-28T16:57:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.669+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded814f790 con 0x7fded806dfb0 2023-11-28T16:57:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.673+0000 7fded4ff9640 1 -- 172.21.15.26:0/1993735862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdec80113f0 con 0x7fded806dfb0 2023-11-28T16:57:31.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.673+0000 7fded4ff9640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdec40668d0 0x7fdec4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:31.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.673+0000 7fded4ff9640 1 -- 172.21.15.26:0/1993735862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdec8084ba0 con 0x7fded806dfb0 2023-11-28T16:57:31.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.673+0000 7fded77fe640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdec40668d0 0x7fdec4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:31.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.673+0000 7fded77fe640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdec40668d0 0x7fdec4068d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fded8072610 tx=0x7fdecc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:31.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.677+0000 7fded4ff9640 1 -- 172.21.15.26:0/1993735862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fded814f790 con 0x7fded806dfb0 2023-11-28T16:57:31.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.833+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fded814f790 con 0x7fded806dfb0 2023-11-28T16:57:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.833+0000 7fded4ff9640 1 -- 172.21.15.26:0/1993735862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fded814f790 con 0x7fded806dfb0 2023-11-28T16:57:31.838 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdec40668d0 msgr2=0x7fdec4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdec40668d0 0x7fdec4068d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fded8072610 tx=0x7fdecc008040 comp rx=0 tx=0).stop 2023-11-28T16:57:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded806dfb0 msgr2=0x7fded8150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded806dfb0 0x7fded8150e10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c7c0 tx=0x7fdec800cc80 comp rx=0 tx=0).stop 2023-11-28T16:57:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 shutdown_connections 2023-11-28T16:57:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded80a5210 0x7fded814b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdec40668d0 0x7fdec4068d90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded80728f0 0x7fded814e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 --2- 172.21.15.26:0/1993735862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fded806dfb0 0x7fded8150e10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 >> 172.21.15.26:0/1993735862 conn(0x7fded80a7a20 msgr2=0x7fded8154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 shutdown_connections 2023-11-28T16:57:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:31.837+0000 7fdede5c4640 1 -- 172.21.15.26:0/1993735862 wait complete. 2023-11-28T16:57:31.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:57:32.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.001+0000 7f8b870dc640 1 Processor -- start 2023-11-28T16:57:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.001+0000 7f8b870dc640 1 -- start start 2023-11-28T16:57:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b870dc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b80151ab0 0x7f8b80154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b870dc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b800c7ce0 0x7f8b800c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b870dc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b8006b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b870dc640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b80151e90 con 0x7f8b800c7ce0 2023-11-28T16:57:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b870dc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b800c71a0 con 0x7f8b80151ab0 2023-11-28T16:57:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b870dc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b800c6900 con 0x7f8b800c4ca0 2023-11-28T16:57:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b800c7ce0 0x7f8b800c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b800c7ce0 0x7f8b800c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34950/0 (socket says 172.21.15.26:34950) 2023-11-28T16:57:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 -- 172.21.15.26:0/1684966671 learned_addr learned my addr 172.21.15.26:0/1684966671 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b868db640 1 --2- 172.21.15.26:0/1684966671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b8006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b860da640 1 --2- 172.21.15.26:0/1684966671 >> v2:172.21.15.79:3300/0 conn(0x7f8b80151ab0 0x7f8b80154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 -- 172.21.15.26:0/1684966671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 msgr2=0x7f8b8006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 --2- 172.21.15.26:0/1684966671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b8006b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 -- 172.21.15.26:0/1684966671 >> v2:172.21.15.79:3300/0 conn(0x7f8b80151ab0 msgr2=0x7f8b80154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 --2- 172.21.15.26:0/1684966671 >> v2:172.21.15.79:3300/0 conn(0x7f8b80151ab0 0x7f8b80154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.005+0000 7f8b858d9640 1 -- 172.21.15.26:0/1684966671 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800c6be0 con 0x7f8b800c7ce0 2023-11-28T16:57:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b858d9640 1 --2- 172.21.15.26:0/1684966671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b800c7ce0 0x7f8b800c4760 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8b8008b290 tx=0x7f8b7001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f461d170b64a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b850d8640 1 -- 172.21.15.26:0/1684966671 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b700ab600 con 0x7f8b800c7ce0 2023-11-28T16:57:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b850d8640 1 -- 172.21.15.26:0/1684966671 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b700a7050 con 0x7f8b800c7ce0 2023-11-28T16:57:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b850d8640 1 -- 172.21.15.26:0/1684966671 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b700ab980 con 0x7f8b800c7ce0 2023-11-28T16:57:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 -- 172.21.15.26:0/1684966671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b800c7ce0 msgr2=0x7f8b800c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 --2- 172.21.15.26:0/1684966671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b800c7ce0 0x7f8b800c4760 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8b8008b290 tx=0x7f8b7001c430 comp rx=0 tx=0).stop 2023-11-28T16:57:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 -- 172.21.15.26:0/1684966671 shutdown_connections 2023-11-28T16:57:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 --2- 172.21.15.26:0/1684966671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b8006b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 --2- 172.21.15.26:0/1684966671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b800c7ce0 0x7f8b800c4760 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 --2- 172.21.15.26:0/1684966671 >> v2:172.21.15.79:3300/0 conn(0x7f8b80151ab0 0x7f8b80154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 -- 172.21.15.26:0/1684966671 >> 172.21.15.26:0/1684966671 conn(0x7f8b800abba0 msgr2=0x7f8b800abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 -- 172.21.15.26:0/1684966671 shutdown_connections 2023-11-28T16:57:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 -- 172.21.15.26:0/1684966671 wait complete. 2023-11-28T16:57:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 Processor -- start 2023-11-28T16:57:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.009+0000 7f8b870dc640 1 -- start start 2023-11-28T16:57:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b800ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b800c7ce0 0x7f8b8014af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b80151ab0 0x7f8b8014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b801f0b50 con 0x7f8b80151ab0 2023-11-28T16:57:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b801f1080 con 0x7f8b800c7ce0 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b800be000 con 0x7f8b800c4ca0 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b80151ab0 0x7f8b8014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b80151ab0 0x7f8b8014b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34954/0 (socket says 172.21.15.26:34954) 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 -- 172.21.15.26:0/3903345545 learned_addr learned my addr 172.21.15.26:0/3903345545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b860da640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b800ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b858d9640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b800c7ce0 0x7f8b8014af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 -- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 msgr2=0x7f8b800ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b800ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 -- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b800c7ce0 msgr2=0x7f8b8014af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b800c7ce0 0x7f8b8014af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 -- 172.21.15.26:0/3903345545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b700094d0 con 0x7f8b80151ab0 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b868db640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b80151ab0 0x7f8b8014b4b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009dd0 tx=0x7f8b7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b76ffd640 1 -- 172.21.15.26:0/3903345545 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78014480 con 0x7f8b80151ab0 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b76ffd640 1 -- 172.21.15.26:0/3903345545 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7800f040 con 0x7f8b80151ab0 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b800ade20 con 0x7f8b80151ab0 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b76ffd640 1 -- 172.21.15.26:0/3903345545 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78014840 con 0x7f8b80151ab0 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b800bda40 con 0x7f8b80151ab0 2023-11-28T16:57:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b80067a10 con 0x7f8b80151ab0 2023-11-28T16:57:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.013+0000 7f8b76ffd640 1 -- 172.21.15.26:0/3903345545 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8b780149a0 con 0x7f8b80151ab0 2023-11-28T16:57:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.017+0000 7f8b76ffd640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b640668d0 0x7f8b64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.017+0000 7f8b76ffd640 1 -- 172.21.15.26:0/3903345545 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8b780851f0 con 0x7f8b80151ab0 2023-11-28T16:57:32.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.017+0000 7f8b860da640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b640668d0 0x7f8b64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.017+0000 7f8b860da640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b640668d0 0x7f8b64068d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009a40 tx=0x7f8b7c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.021+0000 7f8b76ffd640 1 -- 172.21.15.26:0/3903345545 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b78052170 con 0x7f8b80151ab0 2023-11-28T16:57:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b80074970 con 0x7f8b80151ab0 2023-11-28T16:57:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b76ffd640 1 -- 172.21.15.26:0/3903345545 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8b78055790 con 0x7f8b80151ab0 2023-11-28T16:57:32.184 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b640668d0 msgr2=0x7f8b64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b640668d0 0x7f8b64068d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009a40 tx=0x7f8b7c009190 comp rx=0 tx=0).stop 2023-11-28T16:57:32.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b80151ab0 msgr2=0x7f8b8014b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b80151ab0 0x7f8b8014b4b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009dd0 tx=0x7f8b7800c490 comp rx=0 tx=0).stop 2023-11-28T16:57:32.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 shutdown_connections 2023-11-28T16:57:32.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b80151ab0 0x7f8b8014b4b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b800c7ce0 0x7f8b8014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8b640668d0 0x7f8b64068d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 --2- 172.21.15.26:0/3903345545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b800c4ca0 0x7f8b800ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 >> 172.21.15.26:0/3903345545 conn(0x7f8b800abba0 msgr2=0x7f8b8014e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:32.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 shutdown_connections 2023-11-28T16:57:32.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.181+0000 7f8b870dc640 1 -- 172.21.15.26:0/3903345545 wait complete. 2023-11-28T16:57:32.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:57:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e2faa640 1 Processor -- start 2023-11-28T16:57:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e2faa640 1 -- start start 2023-11-28T16:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e2faa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8dc151d80 0x7fa8dc0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e2faa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc06cf70 con 0x7fa8dc0c7f20 2023-11-28T16:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e2faa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc152160 con 0x7fa8dc0c8430 2023-11-28T16:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e2faa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc0c6a30 con 0x7fa8dc151d80 2023-11-28T16:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e0d46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8dc151d80 0x7fa8dc0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e1547640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa8dc0c7f20 0x7fa8dc06be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49504/0 (socket says 172.21.15.26:49504) 2023-11-28T16:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e0d46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8dc151d80 0x7fa8dc0c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34960/0 (socket says 172.21.15.26:34960) 2023-11-28T16:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e1547640 1 -- 172.21.15.26:0/2564239660 learned_addr learned my addr 172.21.15.26:0/2564239660 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e0d46640 1 -- 172.21.15.26:0/2564239660 >> v1:172.21.15.79:6789/0 conn(0x7fa8dc0c8430 legacy=0x7fa8dc06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e0d46640 1 -- 172.21.15.26:0/2564239660 >> v1:172.21.15.26:6789/0 conn(0x7fa8dc0c7f20 legacy=0x7fa8dc06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8e0d46640 1 -- 172.21.15.26:0/2564239660 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0c72d0 con 0x7fa8dc151d80 2023-11-28T16:57:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.353+0000 7fa8db7fe640 1 -- 172.21.15.26:0/2564239660 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539777759 0 0) 0x7fa8dc06cf70 con 0x7fa8dc0c7f20 2023-11-28T16:57:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e0d46640 1 --2- 172.21.15.26:0/2564239660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc0c49a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00097c0 tx=0x7fa8d001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecbe1e91b8be65e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8db7fe640 1 -- 172.21.15.26:0/2564239660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00ab600 con 0x7fa8dc151d80 2023-11-28T16:57:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8db7fe640 1 -- 172.21.15.26:0/2564239660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d00a7050 con 0x7fa8dc151d80 2023-11-28T16:57:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8db7fe640 1 -- 172.21.15.26:0/2564239660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00ab980 con 0x7fa8dc151d80 2023-11-28T16:57:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2564239660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 msgr2=0x7fa8dc0c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2564239660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc0c49a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00097c0 tx=0x7fa8d001c330 comp rx=0 tx=0).stop 2023-11-28T16:57:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2564239660 shutdown_connections 2023-11-28T16:57:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2564239660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc0c49a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2564239660 >> 172.21.15.26:0/2564239660 conn(0x7fa8dc0abd00 msgr2=0x7fa8dc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2564239660 shutdown_connections 2023-11-28T16:57:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.357+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2564239660 wait complete. 2023-11-28T16:57:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 Processor -- start 2023-11-28T16:57:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 -- start start 2023-11-28T16:57:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8dc0c7f20 0x7fa8dc14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc0c8430 0x7fa8dc142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc1426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc153540 con 0x7fa8dc151d80 2023-11-28T16:57:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc142c10 con 0x7fa8dc0c8430 2023-11-28T16:57:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc153150 con 0x7fa8dc0c7f20 2023-11-28T16:57:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc1426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc1426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34972/0 (socket says 172.21.15.26:34972) 2023-11-28T16:57:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 -- 172.21.15.26:0/2508097516 learned_addr learned my addr 172.21.15.26:0/2508097516 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e0d46640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8dc0c7f20 0x7fa8dc14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8dbfff640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc0c8430 0x7fa8dc142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 -- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8dc0c7f20 msgr2=0x7fa8dc14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8dc0c7f20 0x7fa8dc14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 -- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc0c8430 msgr2=0x7fa8dc142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc0c8430 0x7fa8dc142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 -- 172.21.15.26:0/2508097516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0009420 con 0x7fa8dc151d80 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8dbfff640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc0c8430 0x7fa8dc142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e0d46640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8dc0c7f20 0x7fa8dc14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e1547640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc1426d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400cac0 tx=0x7fa8d400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8d97fa640 1 -- 172.21.15.26:0/2508097516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400ab70 con 0x7fa8dc151d80 2023-11-28T16:57:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8d97fa640 1 -- 172.21.15.26:0/2508097516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d400acd0 con 0x7fa8dc151d80 2023-11-28T16:57:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc1525d0 con 0x7fa8dc151d80 2023-11-28T16:57:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8d97fa640 1 -- 172.21.15.26:0/2508097516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4012600 con 0x7fa8dc151d80 2023-11-28T16:57:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc152b90 con 0x7fa8dc151d80 2023-11-28T16:57:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.361+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc04e890 con 0x7fa8dc151d80 2023-11-28T16:57:32.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.365+0000 7fa8d97fa640 1 -- 172.21.15.26:0/2508097516 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa8d4007070 con 0x7fa8dc151d80 2023-11-28T16:57:32.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.365+0000 7fa8d97fa640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8c0066900 0x7fa8c0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.365+0000 7fa8d97fa640 1 -- 172.21.15.26:0/2508097516 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa8d40844b0 con 0x7fa8dc151d80 2023-11-28T16:57:32.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.365+0000 7fa8e0d46640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8c0066900 0x7fa8c0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.365+0000 7fa8e0d46640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8c0066900 0x7fa8c0068dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00ad000 tx=0x7fa8d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.369+0000 7fa8d97fa640 1 -- 172.21.15.26:0/2508097516 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8d4051430 con 0x7fa8dc151d80 2023-11-28T16:57:32.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.529+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa8dc06cb20 con 0x7fa8dc151d80 2023-11-28T16:57:32.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.529+0000 7fa8d97fa640 1 -- 172.21.15.26:0/2508097516 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa8d4054a50 con 0x7fa8dc151d80 2023-11-28T16:57:32.535 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8c0066900 msgr2=0x7fa8c0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8c0066900 0x7fa8c0068dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00ad000 tx=0x7fa8d0008040 comp rx=0 tx=0).stop 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 msgr2=0x7fa8dc1426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc1426d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400cac0 tx=0x7fa8d400cf80 comp rx=0 tx=0).stop 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 shutdown_connections 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc151d80 0x7fa8dc1426d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc0c8430 0x7fa8dc142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8c0066900 0x7fa8c0068dc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 --2- 172.21.15.26:0/2508097516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8dc0c7f20 0x7fa8dc14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 >> 172.21.15.26:0/2508097516 conn(0x7fa8dc0abd00 msgr2=0x7fa8dc148510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 shutdown_connections 2023-11-28T16:57:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.533+0000 7fa8e2faa640 1 -- 172.21.15.26:0/2508097516 wait complete. 2023-11-28T16:57:32.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:57:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc80979d640 1 Processor -- start 2023-11-28T16:57:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc80979d640 1 -- start start 2023-11-28T16:57:32.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc80979d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8040ca610 0x7fc8040c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc80979d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8040bd720 0x7fc8040c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc80979d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc804155790 con 0x7fc80406cd90 2023-11-28T16:57:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc80979d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8040c4b00 con 0x7fc8040ca610 2023-11-28T16:57:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc80979d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8040c4de0 con 0x7fc8040bd720 2023-11-28T16:57:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc802ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8040ca610 0x7fc8040c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc802ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8040ca610 0x7fc8040c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34986/0 (socket says 172.21.15.26:34986) 2023-11-28T16:57:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc802ffd640 1 -- 172.21.15.26:0/2421378717 learned_addr learned my addr 172.21.15.26:0/2421378717 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc7fbfff640 1 --2- 172.21.15.26:0/2421378717 >> v2:172.21.15.79:3300/0 conn(0x7fc8040bd720 0x7fc8040c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc802ffd640 1 -- 172.21.15.26:0/2421378717 >> v2:172.21.15.79:3300/0 conn(0x7fc8040bd720 msgr2=0x7fc8040c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc802ffd640 1 --2- 172.21.15.26:0/2421378717 >> v2:172.21.15.79:3300/0 conn(0x7fc8040bd720 0x7fc8040c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc802ffd640 1 -- 172.21.15.26:0/2421378717 >> v1:172.21.15.79:6789/0 conn(0x7fc80406cd90 legacy=0x7fc804158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.697+0000 7fc802ffd640 1 -- 172.21.15.26:0/2421378717 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804157e30 con 0x7fc8040ca610 2023-11-28T16:57:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc802ffd640 1 --2- 172.21.15.26:0/2421378717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040ca610 0x7fc8040c94c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc8040ca380 tx=0x7fc7f401c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bb4dccbef521c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc8027fc640 1 -- 172.21.15.26:0/2421378717 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040c52d0 con 0x7fc8040ca610 2023-11-28T16:57:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc8027fc640 1 -- 172.21.15.26:0/2421378717 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f40a4900 con 0x7fc8040ca610 2023-11-28T16:57:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc8027fc640 1 -- 172.21.15.26:0/2421378717 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40a4c90 con 0x7fc8040ca610 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 -- 172.21.15.26:0/2421378717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040ca610 msgr2=0x7fc8040c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 --2- 172.21.15.26:0/2421378717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040ca610 0x7fc8040c94c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc8040ca380 tx=0x7fc7f401c0c0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 -- 172.21.15.26:0/2421378717 shutdown_connections 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 --2- 172.21.15.26:0/2421378717 >> v2:172.21.15.79:3300/0 conn(0x7fc8040bd720 0x7fc8040c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 --2- 172.21.15.26:0/2421378717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040ca610 0x7fc8040c94c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 -- 172.21.15.26:0/2421378717 >> 172.21.15.26:0/2421378717 conn(0x7fc804071ea0 msgr2=0x7fc8040722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 -- 172.21.15.26:0/2421378717 shutdown_connections 2023-11-28T16:57:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.701+0000 7fc80979d640 1 -- 172.21.15.26:0/2421378717 wait complete. 2023-11-28T16:57:32.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 Processor -- start 2023-11-28T16:57:32.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 -- start start 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc80406cd90 0x7fc804151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040bd720 0x7fc804153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8040ca610 0x7fc80414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8041530a0 con 0x7fc8040bd720 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8041511b0 con 0x7fc8040ca610 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc804151490 con 0x7fc80406cd90 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040bd720 0x7fc804153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040bd720 0x7fc804153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34990/0 (socket says 172.21.15.26:34990) 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 -- 172.21.15.26:0/840752431 learned_addr learned my addr 172.21.15.26:0/840752431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc802ffd640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc80406cd90 0x7fc804151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc8037fe640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8040ca610 0x7fc80414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 -- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc80406cd90 msgr2=0x7fc804151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc80406cd90 0x7fc804151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 -- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8040ca610 msgr2=0x7fc80414cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8040ca610 0x7fc80414cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 -- 172.21.15.26:0/840752431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40094d0 con 0x7fc8040bd720 2023-11-28T16:57:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fbfff640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040bd720 0x7fc804153b60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00d800 tx=0x7fc7ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fb7fe640 1 -- 172.21.15.26:0/840752431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00b6c0 con 0x7fc8040bd720 2023-11-28T16:57:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fb7fe640 1 -- 172.21.15.26:0/840752431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec00b820 con 0x7fc8040bd720 2023-11-28T16:57:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc804153360 con 0x7fc8040bd720 2023-11-28T16:57:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc7fb7fe640 1 -- 172.21.15.26:0/840752431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00bb90 con 0x7fc8040bd720 2023-11-28T16:57:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.705+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80414d2c0 con 0x7fc8040bd720 2023-11-28T16:57:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.709+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80404e890 con 0x7fc8040bd720 2023-11-28T16:57:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.709+0000 7fc7fb7fe640 1 -- 172.21.15.26:0/840752431 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7ec00bcf0 con 0x7fc8040bd720 2023-11-28T16:57:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.709+0000 7fc7fb7fe640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7e4066900 0x7fc7e4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.709+0000 7fc7fb7fe640 1 -- 172.21.15.26:0/840752431 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc7ec084ae0 con 0x7fc8040bd720 2023-11-28T16:57:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.709+0000 7fc802ffd640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7e4066900 0x7fc7e4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.709+0000 7fc802ffd640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7e4066900 0x7fc7e4068dc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ae000 tx=0x7fc7f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:32.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.713+0000 7fc7fb7fe640 1 -- 172.21.15.26:0/840752431 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7ec051b00 con 0x7fc8040bd720 2023-11-28T16:57:32.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc80406cb70 con 0x7fc8040bd720 2023-11-28T16:57:32.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc7fb7fe640 1 -- 172.21.15.26:0/840752431 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc7ec055120 con 0x7fc8040bd720 2023-11-28T16:57:32.888 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:57:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7e4066900 msgr2=0x7fc7e4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7e4066900 0x7fc7e4068dc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ae000 tx=0x7fc7f4008040 comp rx=0 tx=0).stop 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040bd720 msgr2=0x7fc804153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040bd720 0x7fc804153b60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00d800 tx=0x7fc7ec00dcc0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 shutdown_connections 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8040ca610 0x7fc80414cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8040bd720 0x7fc804153b60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7e4066900 0x7fc7e4068dc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 --2- 172.21.15.26:0/840752431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc80406cd90 0x7fc804151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 >> 172.21.15.26:0/840752431 conn(0x7fc804071ea0 msgr2=0x7fc804072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 shutdown_connections 2023-11-28T16:57:32.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:32.885+0000 7fc80979d640 1 -- 172.21.15.26:0/840752431 wait complete. 2023-11-28T16:57:32.909 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T16:57:32.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:32.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T16:57:32.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:57:32.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:57:32.937 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:57:32.988 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:33.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc95605f640 1 Processor -- start 2023-11-28T16:57:33.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc95605f640 1 -- start start 2023-11-28T16:57:33.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc95605f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9500bd720 0x7fc950158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc95605f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc95006cd90 0x7fc950158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc95605f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc950155790 con 0x7fc9500ca610 2023-11-28T16:57:33.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc95605f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9500c4b00 con 0x7fc95006cd90 2023-11-28T16:57:33.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc95605f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500c4de0 con 0x7fc9500bd720 2023-11-28T16:57:33.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc9500ca610 0x7fc9500c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49512/0 (socket says 172.21.15.26:49512) 2023-11-28T16:57:33.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94f7fe640 1 -- 172.21.15.26:0/1783743606 learned_addr learned my addr 172.21.15.26:0/1783743606 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94effd640 1 --2- 172.21.15.26:0/1783743606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9500bd720 0x7fc950158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94ffff640 1 --2- 172.21.15.26:0/1783743606 >> v2:172.21.15.79:3300/0 conn(0x7fc95006cd90 0x7fc950158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94e7fc640 1 -- 172.21.15.26:0/1783743606 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285142295 0 0) 0x7fc950155790 con 0x7fc9500ca610 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94e7fc640 1 -- 172.21.15.26:0/1783743606 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc938003530 con 0x7fc9500ca610 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94effd640 1 -- 172.21.15.26:0/1783743606 >> v2:172.21.15.79:3300/0 conn(0x7fc95006cd90 msgr2=0x7fc950158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94effd640 1 --2- 172.21.15.26:0/1783743606 >> v2:172.21.15.79:3300/0 conn(0x7fc95006cd90 0x7fc950158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94effd640 1 -- 172.21.15.26:0/1783743606 >> v1:172.21.15.26:6789/0 conn(0x7fc9500ca610 legacy=0x7fc9500c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94effd640 1 -- 172.21.15.26:0/1783743606 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950157e30 con 0x7fc9500bd720 2023-11-28T16:57:33.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.129+0000 7fc94ffff640 1 --2- 172.21.15.26:0/1783743606 >> v2:172.21.15.79:3300/0 conn(0x7fc95006cd90 0x7fc950158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:33.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc94effd640 1 --2- 172.21.15.26:0/1783743606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9500bd720 0x7fc950158350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9440097c0 tx=0x7fc94401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e8e6509f2df1cf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc94e7fc640 1 -- 172.21.15.26:0/1783743606 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500c52d0 con 0x7fc9500bd720 2023-11-28T16:57:33.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc94e7fc640 1 -- 172.21.15.26:0/1783743606 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9440a7050 con 0x7fc9500bd720 2023-11-28T16:57:33.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc94e7fc640 1 -- 172.21.15.26:0/1783743606 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440ab800 con 0x7fc9500bd720 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 -- 172.21.15.26:0/1783743606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9500bd720 msgr2=0x7fc950158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 --2- 172.21.15.26:0/1783743606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9500bd720 0x7fc950158350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9440097c0 tx=0x7fc94401c360 comp rx=0 tx=0).stop 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 -- 172.21.15.26:0/1783743606 shutdown_connections 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 --2- 172.21.15.26:0/1783743606 >> v2:172.21.15.79:3300/0 conn(0x7fc95006cd90 0x7fc950158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 --2- 172.21.15.26:0/1783743606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9500bd720 0x7fc950158350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 -- 172.21.15.26:0/1783743606 >> 172.21.15.26:0/1783743606 conn(0x7fc950071ea0 msgr2=0x7fc9500722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 -- 172.21.15.26:0/1783743606 shutdown_connections 2023-11-28T16:57:33.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.133+0000 7fc95605f640 1 -- 172.21.15.26:0/1783743606 wait complete. 2023-11-28T16:57:33.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 Processor -- start 2023-11-28T16:57:33.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 -- start start 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc95006cd90 0x7fc9500aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9500bd720 0x7fc950151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9500ca610 0x7fc95014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9501511f0 con 0x7fc9500ca610 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95014c110 con 0x7fc9500bd720 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500aa690 con 0x7fc95006cd90 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9500ca610 0x7fc95014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9500ca610 0x7fc95014a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34996/0 (socket says 172.21.15.26:34996) 2023-11-28T16:57:33.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 -- 172.21.15.26:0/3845886752 learned_addr learned my addr 172.21.15.26:0/3845886752 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94f7fe640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc95006cd90 0x7fc9500aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94effd640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9500bd720 0x7fc950151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 -- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc95006cd90 msgr2=0x7fc9500aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc95006cd90 0x7fc9500aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 -- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9500bd720 msgr2=0x7fc950151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9500bd720 0x7fc950151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 -- 172.21.15.26:0/3845886752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948009a70 con 0x7fc9500ca610 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94effd640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9500bd720 0x7fc950151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:33.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94f7fe640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc95006cd90 0x7fc9500aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:33.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc94ffff640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9500ca610 0x7fc95014a760 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc94800efc0 tx=0x7fc94800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc937fff640 1 -- 172.21.15.26:0/3845886752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948009cd0 con 0x7fc9500ca610 2023-11-28T16:57:33.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc937fff640 1 -- 172.21.15.26:0/3845886752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94800f040 con 0x7fc9500ca610 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc937fff640 1 -- 172.21.15.26:0/3845886752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9480039a0 con 0x7fc9500ca610 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc944009420 con 0x7fc9500ca610 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.137+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95014c6b0 con 0x7fc9500ca610 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.141+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc950151360 con 0x7fc9500ca610 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.141+0000 7fc937fff640 1 -- 172.21.15.26:0/3845886752 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc948014480 con 0x7fc9500ca610 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.141+0000 7fc937fff640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc93c066900 0x7fc93c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.141+0000 7fc937fff640 1 -- 172.21.15.26:0/3845886752 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc948085380 con 0x7fc9500ca610 2023-11-28T16:57:33.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.141+0000 7fc94f7fe640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc93c066900 0x7fc93c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.141+0000 7fc94f7fe640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc93c066900 0x7fc93c068dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc940005890 tx=0x7fc940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.145+0000 7fc937fff640 1 -- 172.21.15.26:0/3845886752 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc948052250 con 0x7fc9500ca610 2023-11-28T16:57:33.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.337+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9500c9de0 con 0x7fc9500ca610 2023-11-28T16:57:33.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.337+0000 7fc937fff640 1 -- 172.21.15.26:0/3845886752 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6127 (secure 0 0 0) 0x7fc948055870 con 0x7fc9500ca610 2023-11-28T16:57:33.341 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:33.342 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:03.255028+0000","modified":"2023-11-28T16:57:06.275664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4984":{"gid":4984,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/756252810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":756252810},{"type":"v1","addr":"172.21.15.26:6835","nonce":756252810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:33.342 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2023-11-28T16:57:33.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc93c066900 msgr2=0x7fc93c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc93c066900 0x7fc93c068dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc940005890 tx=0x7fc940009040 comp rx=0 tx=0).stop 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9500ca610 msgr2=0x7fc95014a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9500ca610 0x7fc95014a760 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc94800efc0 tx=0x7fc94800c490 comp rx=0 tx=0).stop 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 shutdown_connections 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9500ca610 0x7fc95014a760 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9500bd720 0x7fc950151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc93c066900 0x7fc93c068dc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 --2- 172.21.15.26:0/3845886752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc95006cd90 0x7fc9500aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 >> 172.21.15.26:0/3845886752 conn(0x7fc950071ea0 msgr2=0x7fc950158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 shutdown_connections 2023-11-28T16:57:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.341+0000 7fc95605f640 1 -- 172.21.15.26:0/3845886752 wait complete. 2023-11-28T16:57:33.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:33.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de429a640 1 Processor -- start 2023-11-28T16:57:33.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de429a640 1 -- start start 2023-11-28T16:57:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de429a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ddc14fcc0 0x7f7ddc156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de429a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc06d980 0x7f7ddc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de429a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc152fe0 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de429a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc0aa340 con 0x7f7ddc14fcc0 2023-11-28T16:57:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de429a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1532c0 con 0x7f7ddc06d980 2023-11-28T16:57:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de2036640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ddc14fcc0 0x7f7ddc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de2036640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ddc14fcc0 0x7f7ddc156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34998/0 (socket says 172.21.15.26:34998) 2023-11-28T16:57:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de2036640 1 -- 172.21.15.26:0/3573001387 learned_addr learned my addr 172.21.15.26:0/3573001387 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de1835640 1 --2- 172.21.15.26:0/3573001387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc06d980 0x7f7ddc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de2036640 1 -- 172.21.15.26:0/3573001387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc06d980 msgr2=0x7f7ddc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de2036640 1 --2- 172.21.15.26:0/3573001387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc06d980 0x7f7ddc0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de2036640 1 -- 172.21.15.26:0/3573001387 >> v1:172.21.15.79:6789/0 conn(0x7f7ddc0ab3b0 legacy=0x7f7ddc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.505+0000 7f7de2036640 1 -- 172.21.15.26:0/3573001387 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc155a20 con 0x7f7ddc14fcc0 2023-11-28T16:57:33.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de2036640 1 --2- 172.21.15.26:0/3573001387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc14fcc0 0x7f7ddc156500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c14df5a0c57f61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de1034640 1 -- 172.21.15.26:0/3573001387 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80aa670 con 0x7f7ddc14fcc0 2023-11-28T16:57:33.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de1034640 1 -- 172.21.15.26:0/3573001387 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd80aa7d0 con 0x7f7ddc14fcc0 2023-11-28T16:57:33.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de1034640 1 -- 172.21.15.26:0/3573001387 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80aab60 con 0x7f7ddc14fcc0 2023-11-28T16:57:33.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 -- 172.21.15.26:0/3573001387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc14fcc0 msgr2=0x7f7ddc156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 --2- 172.21.15.26:0/3573001387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc14fcc0 0x7f7ddc156500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd801c510 comp rx=0 tx=0).stop 2023-11-28T16:57:33.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 -- 172.21.15.26:0/3573001387 shutdown_connections 2023-11-28T16:57:33.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 --2- 172.21.15.26:0/3573001387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc06d980 0x7f7ddc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 --2- 172.21.15.26:0/3573001387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc14fcc0 0x7f7ddc156500 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 -- 172.21.15.26:0/3573001387 >> 172.21.15.26:0/3573001387 conn(0x7f7ddc0c2ad0 msgr2=0x7f7ddc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:33.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 -- 172.21.15.26:0/3573001387 shutdown_connections 2023-11-28T16:57:33.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.509+0000 7f7de429a640 1 -- 172.21.15.26:0/3573001387 wait complete. 2023-11-28T16:57:33.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 Processor -- start 2023-11-28T16:57:33.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 -- start start 2023-11-28T16:57:33.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc06d980 0x7f7ddc1ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc0ab3b0 0x7f7ddc0c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc146d60 0x7f7ddc147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1ed5d0 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc150910 con 0x7f7ddc06d980 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc150630 con 0x7f7ddc146d60 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc0ab3b0 0x7f7ddc0c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc0ab3b0 0x7f7ddc0c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35000/0 (socket says 172.21.15.26:35000) 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 -- 172.21.15.26:0/1966616272 learned_addr learned my addr 172.21.15.26:0/1966616272 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de2036640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc06d980 0x7f7ddc1ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de2837640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc146d60 0x7f7ddc147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 -- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc146d60 msgr2=0x7f7ddc147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc146d60 0x7f7ddc147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 -- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc06d980 msgr2=0x7f7ddc1ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc06d980 0x7f7ddc1ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 -- 172.21.15.26:0/1966616272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80094d0 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de2036640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc06d980 0x7f7ddc1ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:33.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de1835640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc0ab3b0 0x7f7ddc0c01e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e930 tx=0x7f7dcc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7dd2ffd640 1 -- 172.21.15.26:0/1966616272 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc009690 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7dd2ffd640 1 -- 172.21.15.26:0/1966616272 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00ca00 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7dd2ffd640 1 -- 172.21.15.26:0/1966616272 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00cd70 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc150d90 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.513+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc0c0720 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.517+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc04e890 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.517+0000 7f7dd2ffd640 1 -- 172.21.15.26:0/1966616272 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7dcc013470 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.517+0000 7f7dd2ffd640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7dc00668d0 0x7f7dc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.517+0000 7f7dd2ffd640 1 -- 172.21.15.26:0/1966616272 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7dcc0849d0 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.517+0000 7f7de2036640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7dc00668d0 0x7f7dc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.517+0000 7f7de2036640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7dc00668d0 0x7f7dc0068d90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80ae000 tx=0x7f7dd80b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.521+0000 7f7dd2ffd640 1 -- 172.21.15.26:0/1966616272 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7dcc051a10 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.681+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ddc14b260 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.681+0000 7f7dd2ffd640 1 -- 172.21.15.26:0/1966616272 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20157 (secure 0 0 0) 0x7f7dcc055030 con 0x7f7ddc0ab3b0 2023-11-28T16:57:33.685 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:33.685 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:18.259952+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7dc00668d0 msgr2=0x7f7dc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7dc00668d0 0x7f7dc0068d90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80ae000 tx=0x7f7dd80b5040 comp rx=0 tx=0).stop 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc0ab3b0 msgr2=0x7f7ddc0c01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc0ab3b0 0x7f7ddc0c01e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e930 tx=0x7f7dcc00edf0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 shutdown_connections 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7dc00668d0 0x7f7dc0068d90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ddc146d60 0x7f7ddc147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ddc0ab3b0 0x7f7ddc0c01e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 --2- 172.21.15.26:0/1966616272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc06d980 0x7f7ddc1ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 >> 172.21.15.26:0/1966616272 conn(0x7f7ddc0c2ad0 msgr2=0x7f7ddc14ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:33.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 shutdown_connections 2023-11-28T16:57:33.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.685+0000 7f7de429a640 1 -- 172.21.15.26:0/1966616272 wait complete. 2023-11-28T16:57:33.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:01.716708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:02.252332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:57:14.412799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:57:15.689901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:33.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8ebcabb640 1 Processor -- start 2023-11-28T16:57:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8ebcabb640 1 -- start start 2023-11-28T16:57:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8ebcabb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c7d60 0x7f8eb80c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8ebcabb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8eb80c4d20 0x7f8eb8154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8ebcabb640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb8151fc0 con 0x7f8eb8151be0 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8ebcabb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb8154640 con 0x7f8eb80c4d20 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8ebcabb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80c6910 con 0x7f8eb80c7d60 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb77fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8eb8151be0 0x7f8eb8158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49528/0 (socket says 172.21.15.26:49528) 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb77fe640 1 -- 172.21.15.26:0/1768558831 learned_addr learned my addr 172.21.15.26:0/1768558831 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb6ffd640 1 --2- 172.21.15.26:0/1768558831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c7d60 0x7f8eb80c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb7fff640 1 --2- 172.21.15.26:0/1768558831 >> v2:172.21.15.79:3300/0 conn(0x7f8eb80c4d20 0x7f8eb8154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb67fc640 1 -- 172.21.15.26:0/1768558831 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663989210 0 0) 0x7f8ea8001120 con 0x7f8eb8151be0 2023-11-28T16:57:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb67fc640 1 -- 172.21.15.26:0/1768558831 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea0003530 con 0x7f8eb8151be0 2023-11-28T16:57:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb6ffd640 1 -- 172.21.15.26:0/1768558831 >> v2:172.21.15.79:3300/0 conn(0x7f8eb80c4d20 msgr2=0x7f8eb8154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb6ffd640 1 --2- 172.21.15.26:0/1768558831 >> v2:172.21.15.79:3300/0 conn(0x7f8eb80c4d20 0x7f8eb8154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb6ffd640 1 -- 172.21.15.26:0/1768558831 >> v1:172.21.15.26:6789/0 conn(0x7f8eb8151be0 legacy=0x7f8eb8158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb6ffd640 1 -- 172.21.15.26:0/1768558831 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80c77e0 con 0x7f8eb80c7d60 2023-11-28T16:57:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.853+0000 7f8eb7fff640 1 --2- 172.21.15.26:0/1768558831 >> v2:172.21.15.79:3300/0 conn(0x7f8eb80c4d20 0x7f8eb8154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:33.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8eb6ffd640 1 --2- 172.21.15.26:0/1768558831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c7d60 0x7f8eb80c47e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0097c0 tx=0x7f8eac01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b85b3216f50109f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8eb67fc640 1 -- 172.21.15.26:0/1768558831 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0ab600 con 0x7f8eb80c7d60 2023-11-28T16:57:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8eb67fc640 1 -- 172.21.15.26:0/1768558831 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac0a7050 con 0x7f8eb80c7d60 2023-11-28T16:57:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8eb67fc640 1 -- 172.21.15.26:0/1768558831 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0ab980 con 0x7f8eb80c7d60 2023-11-28T16:57:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 -- 172.21.15.26:0/1768558831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c7d60 msgr2=0x7f8eb80c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/1768558831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c7d60 0x7f8eb80c47e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0097c0 tx=0x7f8eac01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 -- 172.21.15.26:0/1768558831 shutdown_connections 2023-11-28T16:57:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/1768558831 >> v2:172.21.15.79:3300/0 conn(0x7f8eb80c4d20 0x7f8eb8154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/1768558831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c7d60 0x7f8eb80c47e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 -- 172.21.15.26:0/1768558831 >> 172.21.15.26:0/1768558831 conn(0x7f8eb80aba30 msgr2=0x7f8eb80abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 -- 172.21.15.26:0/1768558831 shutdown_connections 2023-11-28T16:57:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 -- 172.21.15.26:0/1768558831 wait complete. 2023-11-28T16:57:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.857+0000 7f8ebcabb640 1 Processor -- start 2023-11-28T16:57:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 -- start start 2023-11-28T16:57:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c4d20 0x7f8eb81ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb80c7d60 0x7f8eb814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8151be0 0x7f8eb81501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8159e50 con 0x7f8eb80c7d60 2023-11-28T16:57:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8155c00 con 0x7f8eb8151be0 2023-11-28T16:57:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8155e50 con 0x7f8eb80c4d20 2023-11-28T16:57:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb80c7d60 0x7f8eb814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb80c7d60 0x7f8eb814fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35010/0 (socket says 172.21.15.26:35010) 2023-11-28T16:57:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 -- 172.21.15.26:0/3736947562 learned_addr learned my addr 172.21.15.26:0/3736947562 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb7fff640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8151be0 0x7f8eb81501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb77fe640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c4d20 0x7f8eb81ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 -- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c4d20 msgr2=0x7f8eb81ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c4d20 0x7f8eb81ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 -- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8151be0 msgr2=0x7f8eb81501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8151be0 0x7f8eb81501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 -- 172.21.15.26:0/3736947562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009a70 con 0x7f8eb80c7d60 2023-11-28T16:57:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8eb6ffd640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb80c7d60 0x7f8eb814fc80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8eac01a020 tx=0x7f8eac019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8e9ffff640 1 -- 172.21.15.26:0/3736947562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0abea0 con 0x7f8eb80c7d60 2023-11-28T16:57:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8e9ffff640 1 -- 172.21.15.26:0/3736947562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac0b4410 con 0x7f8eb80c7d60 2023-11-28T16:57:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8e9ffff640 1 -- 172.21.15.26:0/3736947562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0b47a0 con 0x7f8eb80c7d60 2023-11-28T16:57:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac009420 con 0x7f8eb80c7d60 2023-11-28T16:57:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb80bf070 con 0x7f8eb80c7d60 2023-11-28T16:57:33.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.861+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb80c81f0 con 0x7f8eb80c7d60 2023-11-28T16:57:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.865+0000 7f8e9ffff640 1 -- 172.21.15.26:0/3736947562 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8eac0b2040 con 0x7f8eb80c7d60 2023-11-28T16:57:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.865+0000 7f8e9ffff640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ea40668d0 0x7f8ea4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.865+0000 7f8e9ffff640 1 -- 172.21.15.26:0/3736947562 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8eac11e680 con 0x7f8eb80c7d60 2023-11-28T16:57:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.865+0000 7f8eb77fe640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ea40668d0 0x7f8ea4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.865+0000 7f8eb77fe640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ea40668d0 0x7f8ea4068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8001280 tx=0x7f8ea8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:33.869+0000 7f8e9ffff640 1 -- 172.21.15.26:0/3736947562 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8eac0eb720 con 0x7f8eb80c7d60 2023-11-28T16:57:34.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8eb8074970 con 0x7f8eb80c7d60 2023-11-28T16:57:34.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8e9ffff640 1 -- 172.21.15.26:0/3736947562 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8eac0c2020 con 0x7f8eb80c7d60 2023-11-28T16:57:34.036 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:34.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ea40668d0 msgr2=0x7f8ea4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ea40668d0 0x7f8ea4068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8001280 tx=0x7f8ea8009040 comp rx=0 tx=0).stop 2023-11-28T16:57:34.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb80c7d60 msgr2=0x7f8eb814fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb80c7d60 0x7f8eb814fc80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8eac01a020 tx=0x7f8eac019190 comp rx=0 tx=0).stop 2023-11-28T16:57:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 shutdown_connections 2023-11-28T16:57:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8151be0 0x7f8eb81501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb80c7d60 0x7f8eb814fc80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ea40668d0 0x7f8ea4068d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 --2- 172.21.15.26:0/3736947562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8eb80c4d20 0x7f8eb81ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 >> 172.21.15.26:0/3736947562 conn(0x7f8eb80aba30 msgr2=0x7f8eb81530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:34.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 shutdown_connections 2023-11-28T16:57:34.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.033+0000 7f8ebcabb640 1 -- 172.21.15.26:0/3736947562 wait complete. 2023-11-28T16:57:34.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:57:34.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0abd72640 1 Processor -- start 2023-11-28T16:57:34.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0abd72640 1 -- start start 2023-11-28T16:57:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0abd72640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0a4070760 0x7fc0a40701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0abd72640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4071020 con 0x7fc0a4158ff0 2023-11-28T16:57:34.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0abd72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4071300 con 0x7fc0a41561d0 2023-11-28T16:57:34.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0abd72640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40715e0 con 0x7fc0a4070760 2023-11-28T16:57:34.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0a930d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0a4070760 0x7fc0a40701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0aa30f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc0a4158ff0 0x7fc0a4159440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49540/0 (socket says 172.21.15.26:49540) 2023-11-28T16:57:34.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0aa30f640 1 -- 172.21.15.26:0/3048801540 learned_addr learned my addr 172.21.15.26:0/3048801540 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:34.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0a8b0c640 1 -- 172.21.15.26:0/3048801540 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326921232 0 0) 0x7fc0a4071020 con 0x7fc0a4158ff0 2023-11-28T16:57:34.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0a930d640 1 -- 172.21.15.26:0/3048801540 >> v1:172.21.15.79:6789/0 conn(0x7fc0a41561d0 legacy=0x7fc0a406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0a930d640 1 -- 172.21.15.26:0/3048801540 >> v1:172.21.15.26:6789/0 conn(0x7fc0a4158ff0 legacy=0x7fc0a4159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.201+0000 7fc0a930d640 1 -- 172.21.15.26:0/3048801540 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40718c0 con 0x7fc0a4070760 2023-11-28T16:57:34.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0a930d640 1 --2- 172.21.15.26:0/3048801540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40701f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc0940097c0 tx=0x7fc09401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e848f19078b78c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0a8b0c640 1 -- 172.21.15.26:0/3048801540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940ab600 con 0x7fc0a4070760 2023-11-28T16:57:34.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0a8b0c640 1 -- 172.21.15.26:0/3048801540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0940a7050 con 0x7fc0a4070760 2023-11-28T16:57:34.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0a8b0c640 1 -- 172.21.15.26:0/3048801540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940ab980 con 0x7fc0a4070760 2023-11-28T16:57:34.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0abd72640 1 -- 172.21.15.26:0/3048801540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 msgr2=0x7fc0a40701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0abd72640 1 --2- 172.21.15.26:0/3048801540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40701f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc0940097c0 tx=0x7fc09401c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0abd72640 1 -- 172.21.15.26:0/3048801540 shutdown_connections 2023-11-28T16:57:34.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0abd72640 1 --2- 172.21.15.26:0/3048801540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40701f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0abd72640 1 -- 172.21.15.26:0/3048801540 >> 172.21.15.26:0/3048801540 conn(0x7fc0a40c2a60 msgr2=0x7fc0a40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0abd72640 1 -- 172.21.15.26:0/3048801540 shutdown_connections 2023-11-28T16:57:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.205+0000 7fc0abd72640 1 -- 172.21.15.26:0/3048801540 wait complete. 2023-11-28T16:57:34.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 Processor -- start 2023-11-28T16:57:34.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 -- start start 2023-11-28T16:57:34.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a41561d0 0x7fc0a4149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a4158ff0 0x7fc0a41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41f12e0 con 0x7fc0a4070760 2023-11-28T16:57:34.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40aa610 con 0x7fc0a4158ff0 2023-11-28T16:57:34.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40aaf20 con 0x7fc0a41561d0 2023-11-28T16:57:34.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35028/0 (socket says 172.21.15.26:35028) 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 -- 172.21.15.26:0/2624870175 learned_addr learned my addr 172.21.15.26:0/2624870175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a930d640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a41561d0 0x7fc0a4149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0aa30f640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a4158ff0 0x7fc0a41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 -- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a41561d0 msgr2=0x7fc0a4149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a41561d0 0x7fc0a4149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 -- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a4158ff0 msgr2=0x7fc0a41524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a4158ff0 0x7fc0a41524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 -- 172.21.15.26:0/2624870175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094009420 con 0x7fc0a4070760 2023-11-28T16:57:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a930d640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a41561d0 0x7fc0a4149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0aa30f640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a4158ff0 0x7fc0a41524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0a9b0e640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40c4e00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c500 tx=0x7fc0a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc09a7fc640 1 -- 172.21.15.26:0/2624870175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0005220 con 0x7fc0a4070760 2023-11-28T16:57:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc09a7fc640 1 -- 172.21.15.26:0/2624870175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a0005380 con 0x7fc0a4070760 2023-11-28T16:57:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a41f14d0 con 0x7fc0a4070760 2023-11-28T16:57:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc09a7fc640 1 -- 172.21.15.26:0/2624870175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0007270 con 0x7fc0a4070760 2023-11-28T16:57:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a41f1a70 con 0x7fc0a4070760 2023-11-28T16:57:34.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.209+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a404e890 con 0x7fc0a4070760 2023-11-28T16:57:34.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.213+0000 7fc09a7fc640 1 -- 172.21.15.26:0/2624870175 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc0a00073d0 con 0x7fc0a4070760 2023-11-28T16:57:34.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.213+0000 7fc09a7fc640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc088066900 0x7fc088068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.213+0000 7fc09a7fc640 1 -- 172.21.15.26:0/2624870175 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc0a0083ce0 con 0x7fc0a4070760 2023-11-28T16:57:34.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.213+0000 7fc0a930d640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc088066900 0x7fc088068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.213+0000 7fc0a930d640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc088066900 0x7fc088068dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ad000 tx=0x7fc0940a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.217+0000 7fc09a7fc640 1 -- 172.21.15.26:0/2624870175 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0a0050b30 con 0x7fc0a4070760 2023-11-28T16:57:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.373+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0a40c2770 con 0x7fc0a4070760 2023-11-28T16:57:34.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc09a7fc640 1 -- 172.21.15.26:0/2624870175 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0a0054150 con 0x7fc0a4070760 2023-11-28T16:57:34.379 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:34.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc088066900 msgr2=0x7fc088068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc088066900 0x7fc088068dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ad000 tx=0x7fc0940a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:34.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 msgr2=0x7fc0a40c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40c4e00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c500 tx=0x7fc0a000c9c0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 shutdown_connections 2023-11-28T16:57:34.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a4158ff0 0x7fc0a41524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc088066900 0x7fc088068dc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a41561d0 0x7fc0a4149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 --2- 172.21.15.26:0/2624870175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a4070760 0x7fc0a40c4e00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 >> 172.21.15.26:0/2624870175 conn(0x7fc0a40c2a60 msgr2=0x7fc0a4157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 shutdown_connections 2023-11-28T16:57:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.377+0000 7fc0abd72640 1 -- 172.21.15.26:0/2624870175 wait complete. 2023-11-28T16:57:34.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:57:34.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe197632640 1 Processor -- start 2023-11-28T16:57:34.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe197632640 1 -- start start 2023-11-28T16:57:34.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe197632640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1900c6220 0x7fe190158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe197632640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe190151bf0 0x7fe190152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe197632640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe190158580 con 0x7fe1900c13a0 2023-11-28T16:57:34.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe197632640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900c2fd0 con 0x7fe1900c6220 2023-11-28T16:57:34.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe197632640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe190157f50 con 0x7fe190151bf0 2023-11-28T16:57:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe1953ce640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1900c6220 0x7fe190158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe195bcf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe190151bf0 0x7fe190152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe1953ce640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1900c6220 0x7fe190158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:34942/0 (socket says 172.21.15.26:34942) 2023-11-28T16:57:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe1953ce640 1 -- 172.21.15.26:0/2975145879 learned_addr learned my addr 172.21.15.26:0/2975145879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe195bcf640 1 -- 172.21.15.26:0/2975145879 >> v2:172.21.15.79:3300/0 conn(0x7fe1900c6220 msgr2=0x7fe190158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe195bcf640 1 --2- 172.21.15.26:0/2975145879 >> v2:172.21.15.79:3300/0 conn(0x7fe1900c6220 0x7fe190158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe195bcf640 1 -- 172.21.15.26:0/2975145879 >> v1:172.21.15.79:6789/0 conn(0x7fe1900c13a0 legacy=0x7fe1900c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.545+0000 7fe195bcf640 1 -- 172.21.15.26:0/2975145879 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900c1f60 con 0x7fe190151bf0 2023-11-28T16:57:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe195bcf640 1 --2- 172.21.15.26:0/2975145879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe190151bf0 0x7fe190152060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe188009d90 tx=0x7fe18801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6b639bab03fde6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe187fff640 1 -- 172.21.15.26:0/2975145879 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880a59e0 con 0x7fe190151bf0 2023-11-28T16:57:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe187fff640 1 -- 172.21.15.26:0/2975145879 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1880a5b40 con 0x7fe190151bf0 2023-11-28T16:57:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe187fff640 1 -- 172.21.15.26:0/2975145879 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880ad440 con 0x7fe190151bf0 2023-11-28T16:57:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 -- 172.21.15.26:0/2975145879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe190151bf0 msgr2=0x7fe190152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 --2- 172.21.15.26:0/2975145879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe190151bf0 0x7fe190152060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe188009d90 tx=0x7fe18801c920 comp rx=0 tx=0).stop 2023-11-28T16:57:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 -- 172.21.15.26:0/2975145879 shutdown_connections 2023-11-28T16:57:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 --2- 172.21.15.26:0/2975145879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe190151bf0 0x7fe190152060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 --2- 172.21.15.26:0/2975145879 >> v2:172.21.15.79:3300/0 conn(0x7fe1900c6220 0x7fe190158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 -- 172.21.15.26:0/2975145879 >> 172.21.15.26:0/2975145879 conn(0x7fe19006a5a0 msgr2=0x7fe19006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 -- 172.21.15.26:0/2975145879 shutdown_connections 2023-11-28T16:57:34.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.549+0000 7fe197632640 1 -- 172.21.15.26:0/2975145879 wait complete. 2023-11-28T16:57:34.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 Processor -- start 2023-11-28T16:57:34.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 -- start start 2023-11-28T16:57:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1900c13a0 0x7fe1901ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1900c6220 0x7fe190150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe190151bf0 0x7fe1901f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1901f02a0 con 0x7fe190151bf0 2023-11-28T16:57:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19014e010 con 0x7fe1900c6220 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19014e2f0 con 0x7fe1900c13a0 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe190151bf0 0x7fe1901f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe190151bf0 0x7fe1901f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35036/0 (socket says 172.21.15.26:35036) 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 -- 172.21.15.26:0/1604985253 learned_addr learned my addr 172.21.15.26:0/1604985253 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe1953ce640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1900c13a0 0x7fe1901ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe194bcd640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1900c6220 0x7fe190150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 -- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1900c13a0 msgr2=0x7fe1901ec9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1900c13a0 0x7fe1901ec9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 -- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1900c6220 msgr2=0x7fe190150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1900c6220 0x7fe190150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 -- 172.21.15.26:0/1604985253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188009a70 con 0x7fe190151bf0 2023-11-28T16:57:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe194bcd640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1900c6220 0x7fe190150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe195bcf640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe190151bf0 0x7fe1901f0730 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe1880b0040 tx=0x7fe1880196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe185ffb640 1 -- 172.21.15.26:0/1604985253 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880add90 con 0x7fe190151bf0 2023-11-28T16:57:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe185ffb640 1 -- 172.21.15.26:0/1604985253 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188009450 con 0x7fe190151bf0 2023-11-28T16:57:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe185ffb640 1 -- 172.21.15.26:0/1604985253 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880b9690 con 0x7fe190151bf0 2023-11-28T16:57:34.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19014e5d0 con 0x7fe190151bf0 2023-11-28T16:57:34.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1901511f0 con 0x7fe190151bf0 2023-11-28T16:57:34.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.553+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19004e890 con 0x7fe190151bf0 2023-11-28T16:57:34.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.557+0000 7fe185ffb640 1 -- 172.21.15.26:0/1604985253 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe1880b97f0 con 0x7fe190151bf0 2023-11-28T16:57:34.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.557+0000 7fe185ffb640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe1740668d0 0x7fe174068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.557+0000 7fe185ffb640 1 -- 172.21.15.26:0/1604985253 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe18811fe60 con 0x7fe190151bf0 2023-11-28T16:57:34.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.557+0000 7fe1953ce640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe1740668d0 0x7fe174068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.557+0000 7fe1953ce640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe1740668d0 0x7fe174068d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009b50 tx=0x7fe18c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.561+0000 7fe185ffb640 1 -- 172.21.15.26:0/1604985253 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1880ecd30 con 0x7fe190151bf0 2023-11-28T16:57:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1901f03e0 con 0x7fe190151bf0 2023-11-28T16:57:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe185ffb640 1 -- 172.21.15.26:0/1604985253 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1880f0350 con 0x7fe190151bf0 2023-11-28T16:57:34.723 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe1740668d0 msgr2=0x7fe174068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe1740668d0 0x7fe174068d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009b50 tx=0x7fe18c009240 comp rx=0 tx=0).stop 2023-11-28T16:57:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe190151bf0 msgr2=0x7fe1901f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe190151bf0 0x7fe1901f0730 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe1880b0040 tx=0x7fe1880196c0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 shutdown_connections 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe190151bf0 0x7fe1901f0730 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1900c6220 0x7fe190150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe1740668d0 0x7fe174068d90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 --2- 172.21.15.26:0/1604985253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1900c13a0 0x7fe1901ec9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 >> 172.21.15.26:0/1604985253 conn(0x7fe19006a5a0 msgr2=0x7fe1900c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 shutdown_connections 2023-11-28T16:57:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.721+0000 7fe197632640 1 -- 172.21.15.26:0/1604985253 wait complete. 2023-11-28T16:57:34.745 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:57:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff78d617640 1 Processor -- start 2023-11-28T16:57:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff78d617640 1 -- start start 2023-11-28T16:57:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff78d617640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff7880c7d40 0x7ff788154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff78d617640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78806b3d0 con 0x7ff78814e590 2023-11-28T16:57:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff78d617640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78814e970 con 0x7ff78806b860 2023-11-28T16:57:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff78d617640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7881554a0 con 0x7ff7880c7d40 2023-11-28T16:57:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff787fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff78814e590 0x7ff7880c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49552/0 (socket says 172.21.15.26:49552) 2023-11-28T16:57:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff787fff640 1 -- 172.21.15.26:0/2534583596 learned_addr learned my addr 172.21.15.26:0/2534583596 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff7877fe640 1 --2- 172.21.15.26:0/2534583596 >> v2:172.21.15.79:3300/0 conn(0x7ff7880c7d40 0x7ff788154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff786ffd640 1 -- 172.21.15.26:0/2534583596 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164964196 0 0) 0x7ff78806b3d0 con 0x7ff78814e590 2023-11-28T16:57:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff786ffd640 1 -- 172.21.15.26:0/2534583596 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff770003530 con 0x7ff78814e590 2023-11-28T16:57:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff786ffd640 1 -- 172.21.15.26:0/2534583596 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314622488 0 0) 0x7ff78814e970 con 0x7ff78806b860 2023-11-28T16:57:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff786ffd640 1 -- 172.21.15.26:0/2534583596 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff78806b3d0 con 0x7ff78806b860 2023-11-28T16:57:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff7877fe640 1 -- 172.21.15.26:0/2534583596 >> v1:172.21.15.79:6789/0 conn(0x7ff78806b860 legacy=0x7ff78806bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff7877fe640 1 -- 172.21.15.26:0/2534583596 >> v1:172.21.15.26:6789/0 conn(0x7ff78814e590 legacy=0x7ff7880c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.889+0000 7ff7877fe640 1 -- 172.21.15.26:0/2534583596 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7880bd720 con 0x7ff7880c7d40 2023-11-28T16:57:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.893+0000 7ff7877fe640 1 --2- 172.21.15.26:0/2534583596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff788154f60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0097c0 tx=0x7ff77c01c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfefcca8310e3447 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.893+0000 7ff786ffd640 1 -- 172.21.15.26:0/2534583596 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778001680 con 0x7ff7880c7d40 2023-11-28T16:57:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.893+0000 7ff786ffd640 1 -- 172.21.15.26:0/2534583596 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c0a7050 con 0x7ff7880c7d40 2023-11-28T16:57:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.893+0000 7ff786ffd640 1 -- 172.21.15.26:0/2534583596 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0ab620 con 0x7ff7880c7d40 2023-11-28T16:57:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- 172.21.15.26:0/2534583596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 msgr2=0x7ff788154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 --2- 172.21.15.26:0/2534583596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff788154f60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0097c0 tx=0x7ff77c01c230 comp rx=0 tx=0).stop 2023-11-28T16:57:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- 172.21.15.26:0/2534583596 shutdown_connections 2023-11-28T16:57:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 --2- 172.21.15.26:0/2534583596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff788154f60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- 172.21.15.26:0/2534583596 >> 172.21.15.26:0/2534583596 conn(0x7ff7880abd70 msgr2=0x7ff7880ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- 172.21.15.26:0/2534583596 shutdown_connections 2023-11-28T16:57:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- 172.21.15.26:0/2534583596 wait complete. 2023-11-28T16:57:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 Processor -- start 2023-11-28T16:57:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- start start 2023-11-28T16:57:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806b860 0x7ff788157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff7881f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff78814e590 0x7ff7881f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880ad500 con 0x7ff78806b860 2023-11-28T16:57:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880af300 con 0x7ff7880c7d40 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78d617640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7881f0a80 con 0x7ff78814e590 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff787fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806b860 0x7ff788157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff787fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806b860 0x7ff788157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35052/0 (socket says 172.21.15.26:35052) 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff787fff640 1 -- 172.21.15.26:0/374983484 learned_addr learned my addr 172.21.15.26:0/374983484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff78ce16640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff78814e590 0x7ff7881f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.897+0000 7ff7877fe640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff7881f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff787fff640 1 -- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff78814e590 msgr2=0x7ff7881f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff787fff640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff78814e590 0x7ff7881f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff787fff640 1 -- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 msgr2=0x7ff7881f0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff787fff640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff7881f0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff787fff640 1 -- 172.21.15.26:0/374983484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c009420 con 0x7ff78806b860 2023-11-28T16:57:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff7877fe640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff7881f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:34.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff787fff640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806b860 0x7ff788157780 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff7780011f0 tx=0x7ff77800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff784ff9640 1 -- 172.21.15.26:0/374983484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7780074e0 con 0x7ff78806b860 2023-11-28T16:57:34.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff784ff9640 1 -- 172.21.15.26:0/374983484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778007640 con 0x7ff78806b860 2023-11-28T16:57:34.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff784ff9640 1 -- 172.21.15.26:0/374983484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7780049f0 con 0x7ff78806b860 2023-11-28T16:57:34.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff788158760 con 0x7ff78806b860 2023-11-28T16:57:34.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7880af830 con 0x7ff78806b860 2023-11-28T16:57:34.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff788074970 con 0x7ff78806b860 2023-11-28T16:57:34.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff784ff9640 1 -- 172.21.15.26:0/374983484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff778004b50 con 0x7ff78806b860 2023-11-28T16:57:34.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff784ff9640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7740668d0 0x7ff774068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:34.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.901+0000 7ff784ff9640 1 -- 172.21.15.26:0/374983484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff778083c00 con 0x7ff78806b860 2023-11-28T16:57:34.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.905+0000 7ff7877fe640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7740668d0 0x7ff774068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:34.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.905+0000 7ff7877fe640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7740668d0 0x7ff774068d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0ad000 tx=0x7ff77c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:34.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:34.905+0000 7ff784ff9640 1 -- 172.21.15.26:0/374983484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff778050b80 con 0x7ff78806b860 2023-11-28T16:57:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff78806c9c0 con 0x7ff78806b860 2023-11-28T16:57:35.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff784ff9640 1 -- 172.21.15.26:0/374983484 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff778018070 con 0x7ff78806b860 2023-11-28T16:57:35.068 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7740668d0 msgr2=0x7ff774068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7740668d0 0x7ff774068d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0ad000 tx=0x7ff77c0a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806b860 msgr2=0x7ff788157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806b860 0x7ff788157780 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff7780011f0 tx=0x7ff77800cc00 comp rx=0 tx=0).stop 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 shutdown_connections 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7740668d0 0x7ff774068d90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff78814e590 0x7ff7881f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7880c7d40 0x7ff7881f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 --2- 172.21.15.26:0/374983484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78806b860 0x7ff788157780 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 >> 172.21.15.26:0/374983484 conn(0x7ff7880abd70 msgr2=0x7ff7880a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:35.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 shutdown_connections 2023-11-28T16:57:35.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.065+0000 7ff78d617640 1 -- 172.21.15.26:0/374983484 wait complete. 2023-11-28T16:57:35.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:57:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 Processor -- start 2023-11-28T16:57:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 -- start start 2023-11-28T16:57:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414eaf0 0x7fe874151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe874151f90 0x7fe87406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8740c0370 0x7fe87406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87406de00 con 0x7fe874151f90 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe874070390 con 0x7fe8740c0370 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe878d1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87406db90 con 0x7fe87414eaf0 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe874151f90 0x7fe87406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe874151f90 0x7fe87406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35064/0 (socket says 172.21.15.26:35064) 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 -- 172.21.15.26:0/2673470060 learned_addr learned my addr 172.21.15.26:0/2673470060 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe87259c640 1 --2- 172.21.15.26:0/2673470060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414eaf0 0x7fe874151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe872d9d640 1 --2- 172.21.15.26:0/2673470060 >> v2:172.21.15.79:3300/0 conn(0x7fe8740c0370 0x7fe87406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 -- 172.21.15.26:0/2673470060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414eaf0 msgr2=0x7fe874151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 --2- 172.21.15.26:0/2673470060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414eaf0 0x7fe874151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 -- 172.21.15.26:0/2673470060 >> v2:172.21.15.79:3300/0 conn(0x7fe8740c0370 msgr2=0x7fe87406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 --2- 172.21.15.26:0/2673470060 >> v2:172.21.15.79:3300/0 conn(0x7fe8740c0370 0x7fe87406d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.241+0000 7fe86bfff640 1 -- 172.21.15.26:0/2673470060 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87414eed0 con 0x7fe874151f90 2023-11-28T16:57:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe86bfff640 1 --2- 172.21.15.26:0/2673470060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe874151f90 0x7fe87406d110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe8740ac250 tx=0x7fe85c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05f4f378119b2c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe871d9b640 1 -- 172.21.15.26:0/2673470060 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0ac600 con 0x7fe874151f90 2023-11-28T16:57:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe871d9b640 1 -- 172.21.15.26:0/2673470060 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c0a8050 con 0x7fe874151f90 2023-11-28T16:57:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe871d9b640 1 -- 172.21.15.26:0/2673470060 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0ac980 con 0x7fe874151f90 2023-11-28T16:57:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 -- 172.21.15.26:0/2673470060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe874151f90 msgr2=0x7fe87406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 --2- 172.21.15.26:0/2673470060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe874151f90 0x7fe87406d110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe8740ac250 tx=0x7fe85c01c3e0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 -- 172.21.15.26:0/2673470060 shutdown_connections 2023-11-28T16:57:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 --2- 172.21.15.26:0/2673470060 >> v2:172.21.15.79:3300/0 conn(0x7fe8740c0370 0x7fe87406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 --2- 172.21.15.26:0/2673470060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe874151f90 0x7fe87406d110 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 --2- 172.21.15.26:0/2673470060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414eaf0 0x7fe874151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 -- 172.21.15.26:0/2673470060 >> 172.21.15.26:0/2673470060 conn(0x7fe8740c2a60 msgr2=0x7fe8740c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 -- 172.21.15.26:0/2673470060 shutdown_connections 2023-11-28T16:57:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 -- 172.21.15.26:0/2673470060 wait complete. 2023-11-28T16:57:35.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 Processor -- start 2023-11-28T16:57:35.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.245+0000 7fe878d1d640 1 -- start start 2023-11-28T16:57:35.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8740c0370 0x7fe8741483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe87414eaf0 0x7fe8740bf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414e100 0x7fe874137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8741f14e0 con 0x7fe87414eaf0 2023-11-28T16:57:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8741f08f0 con 0x7fe8740c0370 2023-11-28T16:57:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8741f0b40 con 0x7fe87414e100 2023-11-28T16:57:35.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe87414eaf0 0x7fe8740bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe87414eaf0 0x7fe8740bf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35078/0 (socket says 172.21.15.26:35078) 2023-11-28T16:57:35.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 -- 172.21.15.26:0/3546250355 learned_addr learned my addr 172.21.15.26:0/3546250355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:35.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe87259c640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8740c0370 0x7fe8741483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe872d9d640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414e100 0x7fe874137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 -- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414e100 msgr2=0x7fe874137720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414e100 0x7fe874137720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 -- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8740c0370 msgr2=0x7fe8741483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8740c0370 0x7fe8741483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 -- 172.21.15.26:0/3546250355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0094d0 con 0x7fe87414eaf0 2023-11-28T16:57:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86bfff640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe87414eaf0 0x7fe8740bf620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe85c01cc80 tx=0x7fe85c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86affd640 1 -- 172.21.15.26:0/3546250355 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0b7830 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86affd640 1 -- 172.21.15.26:0/3546250355 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c0ace90 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe86affd640 1 -- 172.21.15.26:0/3546250355 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0b7b90 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8741f0e20 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe874148910 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.249+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8741f1620 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.253+0000 7fe86affd640 1 -- 172.21.15.26:0/3546250355 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe85c0b3040 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.253+0000 7fe86affd640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8540668d0 0x7fe854068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.253+0000 7fe86affd640 1 -- 172.21.15.26:0/3546250355 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe85c11ece0 con 0x7fe87414eaf0 2023-11-28T16:57:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.253+0000 7fe87259c640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8540668d0 0x7fe854068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.253+0000 7fe87259c640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8540668d0 0x7fe854068d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe864007a60 tx=0x7fe864008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.257+0000 7fe86affd640 1 -- 172.21.15.26:0/3546250355 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe85c0ebd00 con 0x7fe87414eaf0 2023-11-28T16:57:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe8741f1800 con 0x7fe87414eaf0 2023-11-28T16:57:35.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe86affd640 1 -- 172.21.15.26:0/3546250355 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe85c0ef320 con 0x7fe87414eaf0 2023-11-28T16:57:35.416 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8540668d0 msgr2=0x7fe854068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8540668d0 0x7fe854068d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe864007a60 tx=0x7fe864008040 comp rx=0 tx=0).stop 2023-11-28T16:57:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe87414eaf0 msgr2=0x7fe8740bf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe87414eaf0 0x7fe8740bf620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe85c01cc80 tx=0x7fe85c01ac20 comp rx=0 tx=0).stop 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 shutdown_connections 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8540668d0 0x7fe854068d90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe87414e100 0x7fe874137720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe87414eaf0 0x7fe8740bf620 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 --2- 172.21.15.26:0/3546250355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8740c0370 0x7fe8741483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 >> 172.21.15.26:0/3546250355 conn(0x7fe8740c2a60 msgr2=0x7fe8740a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 shutdown_connections 2023-11-28T16:57:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.413+0000 7fe878d1d640 1 -- 172.21.15.26:0/3546250355 wait complete. 2023-11-28T16:57:35.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:35.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.577+0000 7f765c432640 1 Processor -- start 2023-11-28T16:57:35.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.577+0000 7f765c432640 1 -- start start 2023-11-28T16:57:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765c432640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f765414fcc0 0x7f7654156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765c432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765c432640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7654152fe0 con 0x7f76540ab3b0 2023-11-28T16:57:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765c432640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76540aa340 con 0x7f765414fcc0 2023-11-28T16:57:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765c432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76541532c0 con 0x7f765406d980 2023-11-28T16:57:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765a9cf640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f76540ab3b0 0x7f76540c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49564/0 (socket says 172.21.15.26:49564) 2023-11-28T16:57:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765a9cf640 1 -- 172.21.15.26:0/2747897274 learned_addr learned my addr 172.21.15.26:0/2747897274 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765a1ce640 1 --2- 172.21.15.26:0/2747897274 >> v2:172.21.15.79:3300/0 conn(0x7f765414fcc0 0x7f7654156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f76599cd640 1 --2- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f76591cc640 1 -- 172.21.15.26:0/2747897274 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523299794 0 0) 0x7f7654152fe0 con 0x7f76540ab3b0 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f76591cc640 1 -- 172.21.15.26:0/2747897274 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7640003530 con 0x7f76540ab3b0 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765a1ce640 1 -- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 msgr2=0x7f76540aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765a1ce640 1 --2- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f76591cc640 1 -- 172.21.15.26:0/2747897274 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3298191311 0 0) 0x7f7640003530 con 0x7f76540ab3b0 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765a1ce640 1 -- 172.21.15.26:0/2747897274 >> v1:172.21.15.26:6789/0 conn(0x7f76540ab3b0 legacy=0x7f76540c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.581+0000 7f765a1ce640 1 -- 172.21.15.26:0/2747897274 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7654155a20 con 0x7f765414fcc0 2023-11-28T16:57:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765a1ce640 1 --2- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765414fcc0 0x7f7654156500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76500097c0 tx=0x7f765001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8093ab92bbb5436 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f76591cc640 1 -- 172.21.15.26:0/2747897274 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c001a00 con 0x7f765414fcc0 2023-11-28T16:57:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f76591cc640 1 -- 172.21.15.26:0/2747897274 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500a7050 con 0x7f765414fcc0 2023-11-28T16:57:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f76591cc640 1 -- 172.21.15.26:0/2747897274 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500ab600 con 0x7f765414fcc0 2023-11-28T16:57:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 -- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765414fcc0 msgr2=0x7f7654156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 --2- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765414fcc0 0x7f7654156500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76500097c0 tx=0x7f765001c370 comp rx=0 tx=0).stop 2023-11-28T16:57:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 -- 172.21.15.26:0/2747897274 shutdown_connections 2023-11-28T16:57:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 --2- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 --2- 172.21.15.26:0/2747897274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765414fcc0 0x7f7654156500 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 -- 172.21.15.26:0/2747897274 >> 172.21.15.26:0/2747897274 conn(0x7f76540c2ad0 msgr2=0x7f76540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 -- 172.21.15.26:0/2747897274 shutdown_connections 2023-11-28T16:57:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.585+0000 7f765c432640 1 -- 172.21.15.26:0/2747897274 wait complete. 2023-11-28T16:57:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 Processor -- start 2023-11-28T16:57:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 -- start start 2023-11-28T16:57:35.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76540ab3b0 0x7f7654144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7654155560 0x7f7654145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c1410 con 0x7f7654155560 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c1660 con 0x7f76540ab3b0 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7654144100 con 0x7f765406d980 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7654155560 0x7f7654145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7654155560 0x7f7654145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35080/0 (socket says 172.21.15.26:35080) 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 -- 172.21.15.26:0/3892974548 learned_addr learned my addr 172.21.15.26:0/3892974548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a1ce640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f76599cd640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76540ab3b0 0x7f7654144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 -- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 msgr2=0x7f76540c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 -- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76540ab3b0 msgr2=0x7f7654144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76540ab3b0 0x7f7654144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 -- 172.21.15.26:0/3892974548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650009420 con 0x7f7654155560 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f76599cd640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76540ab3b0 0x7f7654144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765a9cf640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7654155560 0x7f7654145120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f764c00cc90 tx=0x7f764c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f764affd640 1 -- 172.21.15.26:0/3892974548 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00cea0 con 0x7f7654155560 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f764affd640 1 -- 172.21.15.26:0/3892974548 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c012400 con 0x7f7654155560 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f764affd640 1 -- 172.21.15.26:0/3892974548 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0127b0 con 0x7f7654155560 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76541443e0 con 0x7f7654155560 2023-11-28T16:57:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76540c4730 con 0x7f7654155560 2023-11-28T16:57:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.589+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7654144900 con 0x7f7654155560 2023-11-28T16:57:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.593+0000 7f764affd640 1 -- 172.21.15.26:0/3892974548 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f764c007070 con 0x7f7654155560 2023-11-28T16:57:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.593+0000 7f764affd640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76380668d0 0x7f7638068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.593+0000 7f764affd640 1 -- 172.21.15.26:0/3892974548 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f764c084960 con 0x7f7654155560 2023-11-28T16:57:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.593+0000 7f765a1ce640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76380668d0 0x7f7638068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.593+0000 7f765a1ce640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76380668d0 0x7f7638068d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76500ad000 tx=0x7f7650008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.597+0000 7f764affd640 1 -- 172.21.15.26:0/3892974548 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7654144900 con 0x7f7654155560 2023-11-28T16:57:35.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7654144900 con 0x7f7654155560 2023-11-28T16:57:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f764affd640 1 -- 172.21.15.26:0/3892974548 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6127 (secure 0 0 0) 0x7f7654144900 con 0x7f7654155560 2023-11-28T16:57:35.792 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:35.792 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:03.255028+0000","modified":"2023-11-28T16:57:06.275664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4984":{"gid":4984,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/756252810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":756252810},{"type":"v1","addr":"172.21.15.26:6835","nonce":756252810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:35.793 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2023-11-28T16:57:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76380668d0 msgr2=0x7f7638068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76380668d0 0x7f7638068d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76500ad000 tx=0x7f7650008040 comp rx=0 tx=0).stop 2023-11-28T16:57:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7654155560 msgr2=0x7f7654145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7654155560 0x7f7654145120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f764c00cc90 tx=0x7f764c00a430 comp rx=0 tx=0).stop 2023-11-28T16:57:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 shutdown_connections 2023-11-28T16:57:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7654155560 0x7f7654145120 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76540ab3b0 0x7f7654144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f76380668d0 0x7f7638068d90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 --2- 172.21.15.26:0/3892974548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f765406d980 0x7f76540c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 >> 172.21.15.26:0/3892974548 conn(0x7f76540c2ad0 msgr2=0x7f765406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 shutdown_connections 2023-11-28T16:57:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.789+0000 7f765c432640 1 -- 172.21.15.26:0/3892974548 wait complete. 2023-11-28T16:57:35.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:35.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e96f9d640 1 Processor -- start 2023-11-28T16:57:35.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e96f9d640 1 -- start start 2023-11-28T16:57:35.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e96f9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e900ca610 0x7f9e900c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e96f9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e900bd720 0x7f9e900c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e96f9d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e90155790 con 0x7f9e9006cd90 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e96f9d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e900c4b00 con 0x7f9e900ca610 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e96f9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e900c4de0 con 0x7f9e900bd720 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e94d39640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e900ca610 0x7f9e900c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e9553a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e9006cd90 0x7f9e90158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49578/0 (socket says 172.21.15.26:49578) 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e9553a640 1 -- 172.21.15.26:0/2063236501 learned_addr learned my addr 172.21.15.26:0/2063236501 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e8ffff640 1 --2- 172.21.15.26:0/2063236501 >> v2:172.21.15.79:3300/0 conn(0x7f9e900bd720 0x7f9e900c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e94d39640 1 -- 172.21.15.26:0/2063236501 >> v2:172.21.15.79:3300/0 conn(0x7f9e900bd720 msgr2=0x7f9e900c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e94d39640 1 --2- 172.21.15.26:0/2063236501 >> v2:172.21.15.79:3300/0 conn(0x7f9e900bd720 0x7f9e900c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e94d39640 1 -- 172.21.15.26:0/2063236501 >> v1:172.21.15.26:6789/0 conn(0x7f9e9006cd90 legacy=0x7f9e90158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.957+0000 7f9e94d39640 1 -- 172.21.15.26:0/2063236501 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90157e30 con 0x7f9e900ca610 2023-11-28T16:57:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e94d39640 1 --2- 172.21.15.26:0/2063236501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e900ca610 0x7f9e900c94c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9e900ca380 tx=0x7f9e8401c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ddcf84334fd66b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e8f7fe640 1 -- 172.21.15.26:0/2063236501 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900c52d0 con 0x7f9e900ca610 2023-11-28T16:57:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e8f7fe640 1 -- 172.21.15.26:0/2063236501 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e840a4860 con 0x7f9e900ca610 2023-11-28T16:57:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e8f7fe640 1 -- 172.21.15.26:0/2063236501 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840a4bf0 con 0x7f9e900ca610 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 -- 172.21.15.26:0/2063236501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e900ca610 msgr2=0x7f9e900c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/2063236501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e900ca610 0x7f9e900c94c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9e900ca380 tx=0x7f9e8401c020 comp rx=0 tx=0).stop 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 -- 172.21.15.26:0/2063236501 shutdown_connections 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/2063236501 >> v2:172.21.15.79:3300/0 conn(0x7f9e900bd720 0x7f9e900c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/2063236501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e900ca610 0x7f9e900c94c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 -- 172.21.15.26:0/2063236501 >> 172.21.15.26:0/2063236501 conn(0x7f9e90071ea0 msgr2=0x7f9e900722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 -- 172.21.15.26:0/2063236501 shutdown_connections 2023-11-28T16:57:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.961+0000 7f9e96f9d640 1 -- 172.21.15.26:0/2063236501 wait complete. 2023-11-28T16:57:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 Processor -- start 2023-11-28T16:57:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 -- start start 2023-11-28T16:57:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9006cd90 0x7f9e900c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e900bd720 0x7f9e90149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e900ca610 0x7f9e90149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9014a090 con 0x7f9e9006cd90 2023-11-28T16:57:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9014d5e0 con 0x7f9e900bd720 2023-11-28T16:57:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9014b5e0 con 0x7f9e900ca610 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9006cd90 0x7f9e900c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9006cd90 0x7f9e900c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35098/0 (socket says 172.21.15.26:35098) 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 -- 172.21.15.26:0/1125675472 learned_addr learned my addr 172.21.15.26:0/1125675472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 -- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e900ca610 msgr2=0x7f9e90149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e900ca610 0x7f9e90149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 -- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e900bd720 msgr2=0x7f9e90149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e900bd720 0x7f9e90149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 -- 172.21.15.26:0/1125675472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84009420 con 0x7f9e9006cd90 2023-11-28T16:57:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e94d39640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9006cd90 0x7f9e900c3c30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9e840af040 tx=0x7f9e840190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e8d7fa640 1 -- 172.21.15.26:0/1125675472 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ac850 con 0x7f9e9006cd90 2023-11-28T16:57:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e8d7fa640 1 -- 172.21.15.26:0/1125675472 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e840ac9d0 con 0x7f9e9006cd90 2023-11-28T16:57:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e8d7fa640 1 -- 172.21.15.26:0/1125675472 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840acd80 con 0x7f9e9006cd90 2023-11-28T16:57:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e900c1fd0 con 0x7f9e9006cd90 2023-11-28T16:57:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.965+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9014b880 con 0x7f9e9006cd90 2023-11-28T16:57:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.969+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9004e890 con 0x7f9e9006cd90 2023-11-28T16:57:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.969+0000 7f9e8d7fa640 1 -- 172.21.15.26:0/1125675472 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e840b3040 con 0x7f9e9006cd90 2023-11-28T16:57:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.969+0000 7f9e8d7fa640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e74066920 0x7f9e74068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.969+0000 7f9e8d7fa640 1 -- 172.21.15.26:0/1125675472 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e900cac00 con 0x7f9e9006cd90 2023-11-28T16:57:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.969+0000 7f9e8ffff640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e74066920 0x7f9e74068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.969+0000 7f9e8ffff640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e74066920 0x7f9e74068de0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e900c4450 tx=0x7f9e7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:35.973+0000 7f9e8d7fa640 1 -- 172.21.15.26:0/1125675472 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e840eb2f0 con 0x7f9e9006cd90 2023-11-28T16:57:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.133+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e9006cb70 con 0x7f9e9006cd90 2023-11-28T16:57:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.133+0000 7f9e8d7fa640 1 -- 172.21.15.26:0/1125675472 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20157 (secure 0 0 0) 0x7f9e840ee910 con 0x7f9e9006cd90 2023-11-28T16:57:36.137 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:36.137 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:18.259952+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e74066920 msgr2=0x7f9e74068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e74066920 0x7f9e74068de0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e900c4450 tx=0x7f9e7c008040 comp rx=0 tx=0).stop 2023-11-28T16:57:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9006cd90 msgr2=0x7f9e900c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9006cd90 0x7f9e900c3c30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9e840af040 tx=0x7f9e840190e0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 shutdown_connections 2023-11-28T16:57:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e74066920 0x7f9e74068de0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e900ca610 0x7f9e90149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e900bd720 0x7f9e90149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 --2- 172.21.15.26:0/1125675472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9006cd90 0x7f9e900c3c30 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 >> 172.21.15.26:0/1125675472 conn(0x7f9e90071ea0 msgr2=0x7f9e900c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 shutdown_connections 2023-11-28T16:57:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.137+0000 7f9e96f9d640 1 -- 172.21.15.26:0/1125675472 wait complete. 2023-11-28T16:57:36.158 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T16:57:36.159 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:36.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.297+0000 7f7ec8d57640 1 Processor -- start 2023-11-28T16:57:36.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.297+0000 7f7ec8d57640 1 -- start start 2023-11-28T16:57:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec8d57640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ec4155360 0x7f7ec406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec8d57640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ec41580b0 0x7f7ec4158500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec8d57640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec406e280 con 0x7f7ec406baf0 2023-11-28T16:57:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec8d57640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec40c2150 con 0x7f7ec4155360 2023-11-28T16:57:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec8d57640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec4157c60 con 0x7f7ec41580b0 2023-11-28T16:57:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ec4155360 0x7f7ec406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7eb9d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7ec406baf0 0x7f7ec406e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49586/0 (socket says 172.21.15.26:49586) 2023-11-28T16:57:36.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7eb9d9b640 1 -- 172.21.15.26:0/1119369013 learned_addr learned my addr 172.21.15.26:0/1119369013 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:36.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec2d9d640 1 --2- 172.21.15.26:0/1119369013 >> v2:172.21.15.79:3300/0 conn(0x7f7ec41580b0 0x7f7ec4158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec259c640 1 -- 172.21.15.26:0/1119369013 >> v2:172.21.15.79:3300/0 conn(0x7f7ec41580b0 msgr2=0x7f7ec4158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:36.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec259c640 1 --2- 172.21.15.26:0/1119369013 >> v2:172.21.15.79:3300/0 conn(0x7f7ec41580b0 0x7f7ec4158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec259c640 1 -- 172.21.15.26:0/1119369013 >> v1:172.21.15.26:6789/0 conn(0x7f7ec406baf0 legacy=0x7f7ec406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec259c640 1 -- 172.21.15.26:0/1119369013 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40c1bd0 con 0x7f7ec4155360 2023-11-28T16:57:36.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.301+0000 7f7ec1d9b640 1 -- 172.21.15.26:0/1119369013 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147455411 0 0) 0x7f7ec406e280 con 0x7f7ec406baf0 2023-11-28T16:57:36.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec259c640 1 --2- 172.21.15.26:0/1119369013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec4155360 0x7f7ec406b5b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ec406d3a0 tx=0x7f7eb401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aecab39643cda6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:36.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec1d9b640 1 -- 172.21.15.26:0/1119369013 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40a58c0 con 0x7f7ec4155360 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec1d9b640 1 -- 172.21.15.26:0/1119369013 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb40a5a20 con 0x7f7ec4155360 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec1d9b640 1 -- 172.21.15.26:0/1119369013 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40a5db0 con 0x7f7ec4155360 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 -- 172.21.15.26:0/1119369013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec4155360 msgr2=0x7f7ec406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/1119369013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec4155360 0x7f7ec406b5b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ec406d3a0 tx=0x7f7eb401c910 comp rx=0 tx=0).stop 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 -- 172.21.15.26:0/1119369013 shutdown_connections 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/1119369013 >> v2:172.21.15.79:3300/0 conn(0x7f7ec41580b0 0x7f7ec4158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/1119369013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec4155360 0x7f7ec406b5b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 -- 172.21.15.26:0/1119369013 >> 172.21.15.26:0/1119369013 conn(0x7f7ec40c3240 msgr2=0x7f7ec40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 -- 172.21.15.26:0/1119369013 shutdown_connections 2023-11-28T16:57:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 -- 172.21.15.26:0/1119369013 wait complete. 2023-11-28T16:57:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 Processor -- start 2023-11-28T16:57:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.305+0000 7f7ec8d57640 1 -- start start 2023-11-28T16:57:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec406baf0 0x7f7ec40a6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ec4155360 0x7f7ec40a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ec41580b0 0x7f7ec41ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41ec980 con 0x7f7ec406baf0 2023-11-28T16:57:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4071070 con 0x7f7ec41580b0 2023-11-28T16:57:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4070860 con 0x7f7ec4155360 2023-11-28T16:57:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec406baf0 0x7f7ec40a6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec406baf0 0x7f7ec40a6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35104/0 (socket says 172.21.15.26:35104) 2023-11-28T16:57:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 -- 172.21.15.26:0/931501286 learned_addr learned my addr 172.21.15.26:0/931501286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7eb9d9b640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ec4155360 0x7f7ec40a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec2d9d640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ec41580b0 0x7f7ec41ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 -- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ec4155360 msgr2=0x7f7ec40a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ec4155360 0x7f7ec40a7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 -- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ec41580b0 msgr2=0x7f7ec41ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ec41580b0 0x7f7ec41ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 -- 172.21.15.26:0/931501286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4009a70 con 0x7f7ec406baf0 2023-11-28T16:57:36.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec259c640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec406baf0 0x7f7ec40a6be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40b0040 tx=0x7f7eb40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ebb7fe640 1 -- 172.21.15.26:0/931501286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40ad850 con 0x7f7ec406baf0 2023-11-28T16:57:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ebb7fe640 1 -- 172.21.15.26:0/931501286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb40ad9b0 con 0x7f7ec406baf0 2023-11-28T16:57:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ebb7fe640 1 -- 172.21.15.26:0/931501286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40add60 con 0x7f7ec406baf0 2023-11-28T16:57:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec4070ab0 con 0x7f7ec406baf0 2023-11-28T16:57:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec41ecb90 con 0x7f7ec406baf0 2023-11-28T16:57:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec41ecd80 con 0x7f7ec406baf0 2023-11-28T16:57:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.309+0000 7f7ebb7fe640 1 -- 172.21.15.26:0/931501286 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7eb40b4050 con 0x7f7ec406baf0 2023-11-28T16:57:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.313+0000 7f7ebb7fe640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7ea40668d0 0x7f7ea4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.313+0000 7f7ebb7fe640 1 -- 172.21.15.26:0/931501286 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7eb411fa30 con 0x7f7ec406baf0 2023-11-28T16:57:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.313+0000 7f7eb9d9b640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7ea40668d0 0x7f7ea4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.313+0000 7f7eb9d9b640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7ea40668d0 0x7f7ea4068d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4152670 tx=0x7f7eac007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.317+0000 7f7ebb7fe640 1 -- 172.21.15.26:0/931501286 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7eb40ec9b0 con 0x7f7ec406baf0 2023-11-28T16:57:36.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.505+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ec404e890 con 0x7f7ec406baf0 2023-11-28T16:57:36.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.505+0000 7f7ebb7fe640 1 -- 172.21.15.26:0/931501286 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6127 (secure 0 0 0) 0x7f7eb40b2090 con 0x7f7ec406baf0 2023-11-28T16:57:36.510 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:36.511 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:03.255028+0000","modified":"2023-11-28T16:57:06.275664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4984":{"gid":4984,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/756252810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":756252810},{"type":"v1","addr":"172.21.15.26:6835","nonce":756252810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:36.511 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2023-11-28T16:57:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7ea40668d0 msgr2=0x7f7ea4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7ea40668d0 0x7f7ea4068d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4152670 tx=0x7f7eac007df0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec406baf0 msgr2=0x7f7ec40a6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec406baf0 0x7f7ec40a6be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40b0040 tx=0x7f7eb40196b0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 shutdown_connections 2023-11-28T16:57:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ec41580b0 0x7f7ec41ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7ea40668d0 0x7f7ea4068d90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ec4155360 0x7f7ec40a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 --2- 172.21.15.26:0/931501286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ec406baf0 0x7f7ec40a6be0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 >> 172.21.15.26:0/931501286 conn(0x7f7ec40c3240 msgr2=0x7f7ec406d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 shutdown_connections 2023-11-28T16:57:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.509+0000 7f7ec8d57640 1 -- 172.21.15.26:0/931501286 wait complete. 2023-11-28T16:57:36.531 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa8921b8640 1 Processor -- start 2023-11-28T16:57:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa8921b8640 1 -- start start 2023-11-28T16:57:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa8921b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 0x7fa88c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa8921b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa88c070b80 0x7fa88c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa8921b8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c06d320 con 0x7fa88c0c1f20 2023-11-28T16:57:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa8921b8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c0721b0 con 0x7fa88c070b80 2023-11-28T16:57:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa8921b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0c2830 con 0x7fa88c14e9d0 2023-11-28T16:57:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa88c0c1f20 0x7fa88c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49592/0 (socket says 172.21.15.26:49592) 2023-11-28T16:57:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 -- 172.21.15.26:0/1392534205 learned_addr learned my addr 172.21.15.26:0/1392534205 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88affd640 1 --2- 172.21.15.26:0/1392534205 >> v2:172.21.15.79:3300/0 conn(0x7fa88c070b80 0x7fa88c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88b7fe640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 0x7fa88c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839358504 0 0) 0x7fa88c06d320 con 0x7fa88c0c1f20 2023-11-28T16:57:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa874003530 con 0x7fa88c0c1f20 2023-11-28T16:57:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 162484787 0 0) 0x7fa874003530 con 0x7fa88c0c1f20 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 msgr2=0x7fa88c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 0x7fa88c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 >> v2:172.21.15.79:3300/0 conn(0x7fa88c070b80 msgr2=0x7fa88c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 --2- 172.21.15.26:0/1392534205 >> v2:172.21.15.79:3300/0 conn(0x7fa88c070b80 0x7fa88c0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c072450 con 0x7fa88c0c1f20 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fa884001a00 con 0x7fa88c0c1f20 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 >> v1:172.21.15.26:6789/0 conn(0x7fa88c0c1f20 legacy=0x7fa88c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 0x7fa874003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874003f00 0x7fa8740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa874004d10 0x7fa874005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0721b0 con 0x7fa874004d10 2023-11-28T16:57:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0c2830 con 0x7fa874003f00 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87400dbf0 con 0x7fa88c14e9d0 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa874004d10 0x7fa874005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88b7fe640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 0x7fa874003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88affd640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874003f00 0x7fa8740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 -- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 msgr2=0x7fa874003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c14e9d0 0x7fa874003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 -- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874003f00 msgr2=0x7fa8740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874003f00 0x7fa8740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.673+0000 7fa88bfff640 1 -- 172.21.15.26:0/1392534205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874003530 con 0x7fa874004d10 2023-11-28T16:57:36.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa88bfff640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa874004d10 0x7fa874005190 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa88400a860 tx=0x7fa88401fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac30763212807e44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:36.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840aa6b0 con 0x7fa874004d10 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840aa810 con 0x7fa874004d10 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa88a7fc640 1 -- 172.21.15.26:0/1392534205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840aabc0 con 0x7fa874004d10 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa8921b8640 1 -- 172.21.15.26:0/1392534205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa874004d10 msgr2=0x7fa874005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa8921b8640 1 --2- 172.21.15.26:0/1392534205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa874004d10 0x7fa874005190 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa88400a860 tx=0x7fa88401fa80 comp rx=0 tx=0).stop 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa88bfff640 1 -- 172.21.15.26:0/1392534205 reap_dead start 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa8921b8640 1 -- 172.21.15.26:0/1392534205 shutdown_connections 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa8921b8640 1 -- 172.21.15.26:0/1392534205 >> 172.21.15.26:0/1392534205 conn(0x7fa88c0c2ad0 msgr2=0x7fa88c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa8921b8640 1 -- 172.21.15.26:0/1392534205 shutdown_connections 2023-11-28T16:57:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.677+0000 7fa8921b8640 1 -- 172.21.15.26:0/1392534205 wait complete. 2023-11-28T16:57:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 Processor -- start 2023-11-28T16:57:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 -- start start 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874004d10 0x7fa88c0a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c150dd0 0x7fa88c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c13e890 0x7fa88c13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0c5d40 con 0x7fa88c150dd0 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0c4880 con 0x7fa874004d10 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0c4b60 con 0x7fa88c13e890 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c150dd0 0x7fa88c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c150dd0 0x7fa88c14fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35126/0 (socket says 172.21.15.26:35126) 2023-11-28T16:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 -- 172.21.15.26:0/4168394610 learned_addr learned my addr 172.21.15.26:0/4168394610 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88bfff640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c13e890 0x7fa88c13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88b7fe640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874004d10 0x7fa88c0a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 -- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c13e890 msgr2=0x7fa88c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c13e890 0x7fa88c13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 -- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874004d10 msgr2=0x7fa88c0a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874004d10 0x7fa88c0a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 -- 172.21.15.26:0/4168394610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0c4e40 con 0x7fa88c150dd0 2023-11-28T16:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa88affd640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c150dd0 0x7fa88c14fe50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa880011960 tx=0x7fa880011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa873fff640 1 -- 172.21.15.26:0/4168394610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880004300 con 0x7fa88c150dd0 2023-11-28T16:57:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa873fff640 1 -- 172.21.15.26:0/4168394610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa880004460 con 0x7fa88c150dd0 2023-11-28T16:57:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa873fff640 1 -- 172.21.15.26:0/4168394610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000fa60 con 0x7fa88c150dd0 2023-11-28T16:57:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c0c5120 con 0x7fa88c150dd0 2023-11-28T16:57:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.681+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c0c5400 con 0x7fa88c150dd0 2023-11-28T16:57:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.685+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c067a40 con 0x7fa88c150dd0 2023-11-28T16:57:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.685+0000 7fa873fff640 1 -- 172.21.15.26:0/4168394610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa88000fbc0 con 0x7fa88c150dd0 2023-11-28T16:57:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.685+0000 7fa873fff640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8780668d0 0x7fa878068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.685+0000 7fa873fff640 1 -- 172.21.15.26:0/4168394610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa880084e00 con 0x7fa88c150dd0 2023-11-28T16:57:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.685+0000 7fa88b7fe640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8780668d0 0x7fa878068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.685+0000 7fa88b7fe640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8780668d0 0x7fa878068d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009b20 tx=0x7fa87c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:36.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.689+0000 7fa873fff640 1 -- 172.21.15.26:0/4168394610 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa880051cd0 con 0x7fa88c150dd0 2023-11-28T16:57:36.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.877+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa88c04e890 con 0x7fa88c150dd0 2023-11-28T16:57:36.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.877+0000 7fa873fff640 1 -- 172.21.15.26:0/4168394610 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6127 (secure 0 0 0) 0x7fa880023090 con 0x7fa88c150dd0 2023-11-28T16:57:36.882 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:36.882 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:03.255028+0000","modified":"2023-11-28T16:57:06.275664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4984":{"gid":4984,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/756252810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":756252810},{"type":"v1","addr":"172.21.15.26:6835","nonce":756252810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:36.882 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2023-11-28T16:57:36.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8780668d0 msgr2=0x7fa878068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8780668d0 0x7fa878068d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009b20 tx=0x7fa87c008040 comp rx=0 tx=0).stop 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c150dd0 msgr2=0x7fa88c14fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c150dd0 0x7fa88c14fe50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa880011960 tx=0x7fa880011d60 comp rx=0 tx=0).stop 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 shutdown_connections 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa8780668d0 0x7fa878068d90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa88c13e890 0x7fa88c13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c150dd0 0x7fa88c14fe50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 --2- 172.21.15.26:0/4168394610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa874004d10 0x7fa88c0a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 >> 172.21.15.26:0/4168394610 conn(0x7fa88c0c2ad0 msgr2=0x7fa88c143010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 shutdown_connections 2023-11-28T16:57:36.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:36.881+0000 7fa8921b8640 1 -- 172.21.15.26:0/4168394610 wait complete. 2023-11-28T16:57:36.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:37.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.041+0000 7f4c4c1d8640 1 Processor -- start 2023-11-28T16:57:37.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.041+0000 7f4c4c1d8640 1 -- start start 2023-11-28T16:57:37.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4c1d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c44151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4c1d8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c44070b80 0x7f4c440c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4c1d8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c440c1f20 0x7f4c4406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4c1d8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4406d320 con 0x7f4c440c1f20 2023-11-28T16:57:37.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4c1d8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c440721b0 con 0x7f4c44070b80 2023-11-28T16:57:37.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4c1d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440c2830 con 0x7f4c4414e9d0 2023-11-28T16:57:37.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c440c1f20 0x7f4c4406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c440c1f20 0x7f4c4406d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35140/0 (socket says 172.21.15.26:35140) 2023-11-28T16:57:37.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 -- 172.21.15.26:0/2388014611 learned_addr learned my addr 172.21.15.26:0/2388014611 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:37.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c49773640 1 --2- 172.21.15.26:0/2388014611 >> v2:172.21.15.79:3300/0 conn(0x7f4c44070b80 0x7f4c440c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c49f74640 1 --2- 172.21.15.26:0/2388014611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c44151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 -- 172.21.15.26:0/2388014611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 msgr2=0x7f4c44151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:37.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 --2- 172.21.15.26:0/2388014611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c44151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 -- 172.21.15.26:0/2388014611 >> v2:172.21.15.79:3300/0 conn(0x7f4c44070b80 msgr2=0x7f4c440c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:37.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 --2- 172.21.15.26:0/2388014611 >> v2:172.21.15.79:3300/0 conn(0x7f4c44070b80 0x7f4c440c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c4a775640 1 -- 172.21.15.26:0/2388014611 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44072450 con 0x7f4c440c1f20 2023-11-28T16:57:37.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.045+0000 7f4c49773640 1 --2- 172.21.15.26:0/2388014611 >> v2:172.21.15.79:3300/0 conn(0x7f4c44070b80 0x7f4c440c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:37.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4a775640 1 --2- 172.21.15.26:0/2388014611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c440c1f20 0x7f4c4406d7b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c4406e350 tx=0x7f4c3c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef48cf0d6d1db22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c48f72640 1 -- 172.21.15.26:0/2388014611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0a56d0 con 0x7f4c440c1f20 2023-11-28T16:57:37.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c48f72640 1 -- 172.21.15.26:0/2388014611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c0a5830 con 0x7f4c440c1f20 2023-11-28T16:57:37.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c48f72640 1 -- 172.21.15.26:0/2388014611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0a5bc0 con 0x7f4c440c1f20 2023-11-28T16:57:37.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/2388014611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c440c1f20 msgr2=0x7f4c4406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/2388014611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c440c1f20 0x7f4c4406d7b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c4406e350 tx=0x7f4c3c01c940 comp rx=0 tx=0).stop 2023-11-28T16:57:37.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/2388014611 shutdown_connections 2023-11-28T16:57:37.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/2388014611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c440c1f20 0x7f4c4406d7b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/2388014611 >> v2:172.21.15.79:3300/0 conn(0x7f4c44070b80 0x7f4c440c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/2388014611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c44151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/2388014611 >> 172.21.15.26:0/2388014611 conn(0x7f4c440c2ad0 msgr2=0x7f4c440c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:37.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/2388014611 shutdown_connections 2023-11-28T16:57:37.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/2388014611 wait complete. 2023-11-28T16:57:37.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 Processor -- start 2023-11-28T16:57:37.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- start start 2023-11-28T16:57:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44070b80 0x7f4c4415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c440c1f20 0x7f4c440aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c440ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44154470 con 0x7f4c44070b80 2023-11-28T16:57:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44146ae0 con 0x7f4c440c1f20 2023-11-28T16:57:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.049+0000 7f4c4c1d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44146dc0 con 0x7f4c4414e9d0 2023-11-28T16:57:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44070b80 0x7f4c4415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44070b80 0x7f4c4415a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35152/0 (socket says 172.21.15.26:35152) 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 -- 172.21.15.26:0/1707230492 learned_addr learned my addr 172.21.15.26:0/1707230492 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49773640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c440c1f20 0x7f4c440aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c4a775640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c440ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 -- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 msgr2=0x7f4c440ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c440ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 -- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c440c1f20 msgr2=0x7f4c440aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c440c1f20 0x7f4c440aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 -- 172.21.15.26:0/1707230492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c009b30 con 0x7f4c44070b80 2023-11-28T16:57:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c49f74640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44070b80 0x7f4c4415a3a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000d5f0 tx=0x7f4c4000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c3a7fc640 1 -- 172.21.15.26:0/1707230492 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400125f0 con 0x7f4c44070b80 2023-11-28T16:57:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c3a7fc640 1 -- 172.21.15.26:0/1707230492 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40012750 con 0x7f4c44070b80 2023-11-28T16:57:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c3a7fc640 1 -- 172.21.15.26:0/1707230492 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40012ae0 con 0x7f4c44070b80 2023-11-28T16:57:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c441470a0 con 0x7f4c44070b80 2023-11-28T16:57:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c440aa910 con 0x7f4c44070b80 2023-11-28T16:57:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440aab00 con 0x7f4c44070b80 2023-11-28T16:57:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c3a7fc640 1 -- 172.21.15.26:0/1707230492 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4c40012c40 con 0x7f4c44070b80 2023-11-28T16:57:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c3a7fc640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c280668d0 0x7f4c28068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.053+0000 7f4c3a7fc640 1 -- 172.21.15.26:0/1707230492 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4c40084bc0 con 0x7f4c44070b80 2023-11-28T16:57:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.057+0000 7f4c49773640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c280668d0 0x7f4c28068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.057+0000 7f4c49773640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c280668d0 0x7f4c28068d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4c441eae30 tx=0x7f4c34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.057+0000 7f4c3a7fc640 1 -- 172.21.15.26:0/1707230492 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c40051ab0 con 0x7f4c44070b80 2023-11-28T16:57:37.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.217+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c4404e890 con 0x7f4c44070b80 2023-11-28T16:57:37.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.217+0000 7f4c3a7fc640 1 -- 172.21.15.26:0/1707230492 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20157 (secure 0 0 0) 0x7f4c400550d0 con 0x7f4c44070b80 2023-11-28T16:57:37.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:37.221 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:18.259952+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:01.716708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:02.252332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:37.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c280668d0 msgr2=0x7f4c28068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c280668d0 0x7f4c28068d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4c441eae30 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2023-11-28T16:57:37.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44070b80 msgr2=0x7f4c4415a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44070b80 0x7f4c4415a3a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000d5f0 tx=0x7f4c4000dab0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 shutdown_connections 2023-11-28T16:57:37.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c280668d0 0x7f4c28068d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c4414e9d0 0x7f4c440ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c440c1f20 0x7f4c440aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 --2- 172.21.15.26:0/1707230492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44070b80 0x7f4c4415a3a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 >> 172.21.15.26:0/1707230492 conn(0x7f4c440c2ad0 msgr2=0x7f4c4414d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:37.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 shutdown_connections 2023-11-28T16:57:37.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.221+0000 7f4c4c1d8640 1 -- 172.21.15.26:0/1707230492 wait complete. 2023-11-28T16:57:37.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T16:57:37.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8fddf640 1 Processor -- start 2023-11-28T16:57:37.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8fddf640 1 -- start start 2023-11-28T16:57:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8fddf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8fddf640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8806d320 con 0x7fcc8814e9d0 2023-11-28T16:57:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8fddf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880721b0 con 0x7fcc88070b80 2023-11-28T16:57:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8fddf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880c2830 con 0x7fcc880a8470 2023-11-28T16:57:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8db7b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcc8814e9d0 0x7fcc880c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49594/0 (socket says 172.21.15.26:49594) 2023-11-28T16:57:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8db7b640 1 -- 172.21.15.26:0/1588924650 learned_addr learned my addr 172.21.15.26:0/1588924650 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8e37c640 1 --2- 172.21.15.26:0/1588924650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8cb79640 1 -- 172.21.15.26:0/1588924650 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131454705 0 0) 0x7fcc8806d320 con 0x7fcc8814e9d0 2023-11-28T16:57:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8cb79640 1 -- 172.21.15.26:0/1588924650 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc74003530 con 0x7fcc8814e9d0 2023-11-28T16:57:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8cb79640 1 -- 172.21.15.26:0/1588924650 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862117020 0 0) 0x7fcc880721b0 con 0x7fcc88070b80 2023-11-28T16:57:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8cb79640 1 -- 172.21.15.26:0/1588924650 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc8806d320 con 0x7fcc88070b80 2023-11-28T16:57:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8e37c640 1 -- 172.21.15.26:0/1588924650 >> v1:172.21.15.79:6789/0 conn(0x7fcc88070b80 legacy=0x7fcc8806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8e37c640 1 -- 172.21.15.26:0/1588924650 >> v1:172.21.15.26:6789/0 conn(0x7fcc8814e9d0 legacy=0x7fcc880c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.385+0000 7fcc8e37c640 1 -- 172.21.15.26:0/1588924650 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88072450 con 0x7fcc880a8470 2023-11-28T16:57:37.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8e37c640 1 --2- 172.21.15.26:0/1588924650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88151e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009dc0 tx=0x7fcc8001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcd51b77e2abcbb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8cb79640 1 -- 172.21.15.26:0/1588924650 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc800a58b0 con 0x7fcc880a8470 2023-11-28T16:57:37.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8cb79640 1 -- 172.21.15.26:0/1588924650 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc800a5a10 con 0x7fcc880a8470 2023-11-28T16:57:37.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8cb79640 1 -- 172.21.15.26:0/1588924650 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc800a5da0 con 0x7fcc880a8470 2023-11-28T16:57:37.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1588924650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 msgr2=0x7fcc88151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1588924650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88151e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009dc0 tx=0x7fcc8001c8e0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1588924650 shutdown_connections 2023-11-28T16:57:37.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1588924650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88151e60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1588924650 >> 172.21.15.26:0/1588924650 conn(0x7fcc880c2ad0 msgr2=0x7fcc880c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:37.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1588924650 shutdown_connections 2023-11-28T16:57:37.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.389+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1588924650 wait complete. 2023-11-28T16:57:37.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 Processor -- start 2023-11-28T16:57:37.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 -- start start 2023-11-28T16:57:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc88070b80 0x7fcc881eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc8814e9d0 0x7fcc88147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880baff0 con 0x7fcc88070b80 2023-11-28T16:57:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880bb790 con 0x7fcc8814e9d0 2023-11-28T16:57:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8fddf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88150e80 con 0x7fcc880a8470 2023-11-28T16:57:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc88070b80 0x7fcc881eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc88070b80 0x7fcc881eb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35162/0 (socket says 172.21.15.26:35162) 2023-11-28T16:57:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 -- 172.21.15.26:0/1279191070 learned_addr learned my addr 172.21.15.26:0/1279191070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8d37a640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8e37c640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc8814e9d0 0x7fcc88147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 -- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 msgr2=0x7fcc88150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 -- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc8814e9d0 msgr2=0x7fcc88147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc8814e9d0 0x7fcc88147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 -- 172.21.15.26:0/1279191070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009a70 con 0x7fcc88070b80 2023-11-28T16:57:37.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.393+0000 7fcc8db7b640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc88070b80 0x7fcc881eb3c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c420 tx=0x7fcc8400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc7e7fc640 1 -- 172.21.15.26:0/1279191070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84005cf0 con 0x7fcc88070b80 2023-11-28T16:57:37.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc7e7fc640 1 -- 172.21.15.26:0/1279191070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84005e50 con 0x7fcc88070b80 2023-11-28T16:57:37.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc7e7fc640 1 -- 172.21.15.26:0/1279191070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc840072d0 con 0x7fcc88070b80 2023-11-28T16:57:37.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc881515b0 con 0x7fcc88070b80 2023-11-28T16:57:37.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc880bb4b0 con 0x7fcc88070b80 2023-11-28T16:57:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8804e890 con 0x7fcc88070b80 2023-11-28T16:57:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc7e7fc640 1 -- 172.21.15.26:0/1279191070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc84007430 con 0x7fcc88070b80 2023-11-28T16:57:37.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.397+0000 7fcc7e7fc640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c0668d0 0x7fcc6c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.401+0000 7fcc7e7fc640 1 -- 172.21.15.26:0/1279191070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcc84083c80 con 0x7fcc88070b80 2023-11-28T16:57:37.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.401+0000 7fcc8d37a640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c0668d0 0x7fcc6c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.401+0000 7fcc8d37a640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c0668d0 0x7fcc6c068d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc881e8780 tx=0x7fcc78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.401+0000 7fcc7e7fc640 1 -- 172.21.15.26:0/1279191070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc84050c00 con 0x7fcc88070b80 2023-11-28T16:57:37.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.593+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcc880700a0 con 0x7fcc88070b80 2023-11-28T16:57:37.595 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-11-28T16:57:37.593+0000 7fcd77275640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T16:57:37.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc7e7fc640 1 -- 172.21.15.26:0/1279191070 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcc84017020 con 0x7fcc88070b80 2023-11-28T16:57:37.599 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T16:57:37.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c0668d0 msgr2=0x7fcc6c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c0668d0 0x7fcc6c068d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc881e8780 tx=0x7fcc78009040 comp rx=0 tx=0).stop 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc88070b80 msgr2=0x7fcc881eb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc88070b80 0x7fcc881eb3c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c420 tx=0x7fcc8400c8e0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 shutdown_connections 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc8814e9d0 0x7fcc88147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcc6c0668d0 0x7fcc6c068d90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcc880a8470 0x7fcc88150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 --2- 172.21.15.26:0/1279191070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc88070b80 0x7fcc881eb3c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 >> 172.21.15.26:0/1279191070 conn(0x7fcc880c2ad0 msgr2=0x7fcc8806d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:37.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 shutdown_connections 2023-11-28T16:57:37.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.597+0000 7fcc8fddf640 1 -- 172.21.15.26:0/1279191070 wait complete. 2023-11-28T16:57:37.609 INFO:tasks.ceph.mds.c.smithi026.stderr: -2701> 2023-11-28T16:57:06.842+0000 7f274f58a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:57:37.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T16:57:37.658 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-11-28T16:57:37.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff076565640 1 Processor -- start 2023-11-28T16:57:37.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff076565640 1 -- start start 2023-11-28T16:57:37.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff076565640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff070151ee0 0x7ff070072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff076565640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c09c0 0x7ff0700c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff076565640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0701522c0 con 0x7ff0700c1ae0 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff076565640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff070072870 con 0x7ff070151ee0 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff076565640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff070155040 con 0x7ff0700c09c0 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff074b02640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c09c0 0x7ff0700c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff06f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff0700c1ae0 0x7ff07006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:40112/0 (socket says 172.21.15.26:40112) 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff06f7fe640 1 -- 172.21.15.26:0/3068239095 learned_addr learned my addr 172.21.15.26:0/3068239095 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.769+0000 7ff06ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff070151ee0 0x7ff070072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06ffff640 1 -- 172.21.15.26:0/3068239095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c09c0 msgr2=0x7ff0700c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06ffff640 1 --2- 172.21.15.26:0/3068239095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c09c0 0x7ff0700c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06ffff640 1 -- 172.21.15.26:0/3068239095 >> v1:172.21.15.79:6789/0 conn(0x7ff0700c1ae0 legacy=0x7ff07006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06ffff640 1 -- 172.21.15.26:0/3068239095 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0701555c0 con 0x7ff070151ee0 2023-11-28T16:57:37.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06effd640 1 -- 172.21.15.26:0/3068239095 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281058581 0 0) 0x7ff0701522c0 con 0x7ff0700c1ae0 2023-11-28T16:57:37.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06ffff640 1 --2- 172.21.15.26:0/3068239095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070072330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff0600097c0 tx=0x7ff06001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc17b78bc1cb24b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06effd640 1 -- 172.21.15.26:0/3068239095 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600ab5f0 con 0x7ff070151ee0 2023-11-28T16:57:37.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06effd640 1 -- 172.21.15.26:0/3068239095 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0600ab750 con 0x7ff070151ee0 2023-11-28T16:57:37.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff06effd640 1 -- 172.21.15.26:0/3068239095 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600abae0 con 0x7ff070151ee0 2023-11-28T16:57:37.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff076565640 1 -- 172.21.15.26:0/3068239095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 msgr2=0x7ff070072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff076565640 1 --2- 172.21.15.26:0/3068239095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070072330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff0600097c0 tx=0x7ff06001c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff076565640 1 -- 172.21.15.26:0/3068239095 shutdown_connections 2023-11-28T16:57:37.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff076565640 1 --2- 172.21.15.26:0/3068239095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c09c0 0x7ff0700c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.773+0000 7ff076565640 1 --2- 172.21.15.26:0/3068239095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070072330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 -- 172.21.15.26:0/3068239095 >> 172.21.15.26:0/3068239095 conn(0x7ff0700c3b70 msgr2=0x7ff0700c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:37.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 -- 172.21.15.26:0/3068239095 shutdown_connections 2023-11-28T16:57:37.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 -- 172.21.15.26:0/3068239095 wait complete. 2023-11-28T16:57:37.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 Processor -- start 2023-11-28T16:57:37.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 -- start start 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0700c09c0 0x7ff0701f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c1ae0 0x7ff0701f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070158bf0 con 0x7ff0700c09c0 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701f4d10 con 0x7ff070151ee0 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff076565640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701f1fc0 con 0x7ff0700c1ae0 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0700c09c0 0x7ff0701f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0700c09c0 0x7ff0701f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35188/0 (socket says 172.21.15.26:35188) 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 -- 172.21.15.26:0/1320256483 learned_addr learned my addr 172.21.15.26:0/1320256483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06f7fe640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c1ae0 0x7ff0701f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff074b02640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 -- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c1ae0 msgr2=0x7ff0701f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c1ae0 0x7ff0701f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 -- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 msgr2=0x7ff070149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 -- 172.21.15.26:0/1320256483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060009420 con 0x7ff0700c09c0 2023-11-28T16:57:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06f7fe640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c1ae0 0x7ff0701f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff074b02640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.777+0000 7ff06ffff640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0700c09c0 0x7ff0701f5130 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff06001a020 tx=0x7ff06001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff06cff9640 1 -- 172.21.15.26:0/1320256483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600bf610 con 0x7ff0700c09c0 2023-11-28T16:57:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff06cff9640 1 -- 172.21.15.26:0/1320256483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0600bf770 con 0x7ff0700c09c0 2023-11-28T16:57:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff06cff9640 1 -- 172.21.15.26:0/1320256483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600bfb20 con 0x7ff0700c09c0 2023-11-28T16:57:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff070154b30 con 0x7ff0700c09c0 2023-11-28T16:57:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0701f4650 con 0x7ff0700c09c0 2023-11-28T16:57:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0701f4e50 con 0x7ff0700c09c0 2023-11-28T16:57:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff06cff9640 1 -- 172.21.15.26:0/1320256483 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0600bfc80 con 0x7ff0700c09c0 2023-11-28T16:57:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff06cff9640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff05c066900 0x7ff05c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff06cff9640 1 -- 172.21.15.26:0/1320256483 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6651+0+0 (secure 0 0 0) 0x7ff0600a8050 con 0x7ff0700c09c0 2023-11-28T16:57:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.781+0000 7ff06f7fe640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff05c066900 0x7ff05c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.785+0000 7ff06f7fe640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff05c066900 0x7ff05c068dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0700c50f0 tx=0x7ff064009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.785+0000 7ff06cff9640 1 -- 172.21.15.26:0/1320256483 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0701f4e50 con 0x7ff0700c09c0 2023-11-28T16:57:37.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:37.977+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff0701f4e50 con 0x7ff0700c09c0 2023-11-28T16:57:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.597+0000 7ff06cff9640 1 -- 172.21.15.26:0/1320256483 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff0600ec130 con 0x7ff0700c09c0 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.597+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff05c066900 msgr2=0x7ff05c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.597+0000 7ff076565640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff05c066900 0x7ff05c068dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0700c50f0 tx=0x7ff064009040 comp rx=0 tx=0).stop 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.597+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0700c09c0 msgr2=0x7ff0701f5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.597+0000 7ff076565640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0700c09c0 0x7ff0701f5130 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff06001a020 tx=0x7ff06001ac30 comp rx=0 tx=0).stop 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 shutdown_connections 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff070151ee0 0x7ff070149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff05c066900 0x7ff05c068dc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0700c1ae0 0x7ff0701f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 --2- 172.21.15.26:0/1320256483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0700c09c0 0x7ff0701f5130 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 >> 172.21.15.26:0/1320256483 conn(0x7ff0700c3b70 msgr2=0x7ff070066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 shutdown_connections 2023-11-28T16:57:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.601+0000 7ff076565640 1 -- 172.21.15.26:0/1320256483 wait complete. 2023-11-28T16:57:38.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T16:57:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc9ce32640 1 Processor -- start 2023-11-28T16:57:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc9ce32640 1 -- start start 2023-11-28T16:57:38.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc9ce32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc98070970 0x7fdc98155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:38.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc9ce32640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc981559d0 con 0x7fdc9806b0c0 2023-11-28T16:57:38.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc9ce32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9806d910 con 0x7fdc98154ea0 2023-11-28T16:57:38.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc9ce32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc981557c0 con 0x7fdc98070970 2023-11-28T16:57:38.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc8ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdc9806b0c0 0x7fdc98070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49612/0 (socket says 172.21.15.26:49612) 2023-11-28T16:57:38.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc8ffff640 1 -- 172.21.15.26:0/3430321621 learned_addr learned my addr 172.21.15.26:0/3430321621 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:38.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc96d9d640 1 --2- 172.21.15.26:0/3430321621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc98070970 0x7fdc98155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc95d9b640 1 -- 172.21.15.26:0/3430321621 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110232178 0 0) 0x7fdc981559d0 con 0x7fdc9806b0c0 2023-11-28T16:57:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.809+0000 7fdc95d9b640 1 -- 172.21.15.26:0/3430321621 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc84003530 con 0x7fdc9806b0c0 2023-11-28T16:57:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc95d9b640 1 -- 172.21.15.26:0/3430321621 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394225133 0 0) 0x7fdc9806d910 con 0x7fdc98154ea0 2023-11-28T16:57:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc95d9b640 1 -- 172.21.15.26:0/3430321621 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc981559d0 con 0x7fdc98154ea0 2023-11-28T16:57:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc96d9d640 1 -- 172.21.15.26:0/3430321621 >> v1:172.21.15.79:6789/0 conn(0x7fdc98154ea0 legacy=0x7fdc9814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc96d9d640 1 -- 172.21.15.26:0/3430321621 >> v1:172.21.15.26:6789/0 conn(0x7fdc9806b0c0 legacy=0x7fdc98070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc96d9d640 1 -- 172.21.15.26:0/3430321621 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980c1230 con 0x7fdc98070970 2023-11-28T16:57:38.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc96d9d640 1 --2- 172.21.15.26:0/3430321621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc98070970 0x7fdc98155280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009dc0 tx=0x7fdc9001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6568b09b62a40e11 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:38.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc95d9b640 1 -- 172.21.15.26:0/3430321621 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc900a5890 con 0x7fdc98070970 2023-11-28T16:57:38.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc95d9b640 1 -- 172.21.15.26:0/3430321621 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc900a59f0 con 0x7fdc98070970 2023-11-28T16:57:38.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.813+0000 7fdc95d9b640 1 -- 172.21.15.26:0/3430321621 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc900a5d80 con 0x7fdc98070970 2023-11-28T16:57:38.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- 172.21.15.26:0/3430321621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc98070970 msgr2=0x7fdc98155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:38.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/3430321621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc98070970 0x7fdc98155280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009dc0 tx=0x7fdc9001c8e0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- 172.21.15.26:0/3430321621 shutdown_connections 2023-11-28T16:57:38.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/3430321621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc98070970 0x7fdc98155280 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- 172.21.15.26:0/3430321621 >> 172.21.15.26:0/3430321621 conn(0x7fdc9806a5a0 msgr2=0x7fdc9806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:38.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- 172.21.15.26:0/3430321621 shutdown_connections 2023-11-28T16:57:38.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- 172.21.15.26:0/3430321621 wait complete. 2023-11-28T16:57:38.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 Processor -- start 2023-11-28T16:57:38.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- start start 2023-11-28T16:57:38.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc9806b0c0 0x7fdc9813b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:38.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc98070970 0x7fdc980bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:38.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc98154ea0 0x7fdc981ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:38.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc981f12f0 con 0x7fdc98070970 2023-11-28T16:57:38.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9813bff0 con 0x7fdc98154ea0 2023-11-28T16:57:38.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9ce32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc98148f30 con 0x7fdc9806b0c0 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc98070970 0x7fdc980bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc98070970 0x7fdc980bf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35196/0 (socket says 172.21.15.26:35196) 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 -- 172.21.15.26:0/1290701651 learned_addr learned my addr 172.21.15.26:0/1290701651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc96d9d640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc98154ea0 0x7fdc981ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc9659c640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc9806b0c0 0x7fdc9813b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 -- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc9806b0c0 msgr2=0x7fdc9813b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc9806b0c0 0x7fdc9813b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 -- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc98154ea0 msgr2=0x7fdc981ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc98154ea0 0x7fdc981ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.817+0000 7fdc8ffff640 1 -- 172.21.15.26:0/1290701651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc90009a70 con 0x7fdc98070970 2023-11-28T16:57:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc8ffff640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc98070970 0x7fdc980bf5a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005890 tx=0x7fdc8000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc8effd640 1 -- 172.21.15.26:0/1290701651 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80005cf0 con 0x7fdc98070970 2023-11-28T16:57:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc8effd640 1 -- 172.21.15.26:0/1290701651 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc80005e50 con 0x7fdc98070970 2023-11-28T16:57:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc8effd640 1 -- 172.21.15.26:0/1290701651 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80007290 con 0x7fdc98070970 2023-11-28T16:57:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc981ecf10 con 0x7fdc98070970 2023-11-28T16:57:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc98149210 con 0x7fdc98070970 2023-11-28T16:57:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc98067a40 con 0x7fdc98070970 2023-11-28T16:57:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc8effd640 1 -- 172.21.15.26:0/1290701651 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc800073f0 con 0x7fdc98070970 2023-11-28T16:57:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc8effd640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc780668d0 0x7fdc78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.821+0000 7fdc8effd640 1 -- 172.21.15.26:0/1290701651 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fdc80083e00 con 0x7fdc98070970 2023-11-28T16:57:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.825+0000 7fdc9659c640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc780668d0 0x7fdc78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.825+0000 7fdc9659c640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc780668d0 0x7fdc78068d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdc880011f0 tx=0x7fdc88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.825+0000 7fdc8effd640 1 -- 172.21.15.26:0/1290701651 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc80050c80 con 0x7fdc98070970 2023-11-28T16:57:38.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:38.989+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc981ecd70 con 0x7fdc98070970 2023-11-28T16:57:39.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc8effd640 1 -- 172.21.15.26:0/1290701651 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdc981ecd70 con 0x7fdc98070970 2023-11-28T16:57:39.603 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-11-28T16:57:39.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc780668d0 msgr2=0x7fdc78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc780668d0 0x7fdc78068d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdc880011f0 tx=0x7fdc88009040 comp rx=0 tx=0).stop 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc98070970 msgr2=0x7fdc980bf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc98070970 0x7fdc980bf5a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005890 tx=0x7fdc8000c980 comp rx=0 tx=0).stop 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 shutdown_connections 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc98154ea0 0x7fdc981ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc98070970 0x7fdc980bf5a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc780668d0 0x7fdc78068d90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 --2- 172.21.15.26:0/1290701651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc9806b0c0 0x7fdc9813b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 >> 172.21.15.26:0/1290701651 conn(0x7fdc9806a5a0 msgr2=0x7fdc9806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:39.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 shutdown_connections 2023-11-28T16:57:39.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.601+0000 7fdc9ce32640 1 -- 172.21.15.26:0/1290701651 wait complete. 2023-11-28T16:57:39.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T16:57:39.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f1438c46640 1 Processor -- start 2023-11-28T16:57:39.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f1438c46640 1 -- start start 2023-11-28T16:57:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f1438c46640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c2000 0x7f1434070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f1438c46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14340c0330 0x7f1434154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f1438c46640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1434071510 con 0x7f14341588c0 2023-11-28T16:57:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f1438c46640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143406b3e0 con 0x7f14340c0330 2023-11-28T16:57:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f1438c46640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1434071d70 con 0x7f14340c2000 2023-11-28T16:57:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f142bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14340c0330 0x7f1434154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f142bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14340c0330 0x7f1434154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35204/0 (socket says 172.21.15.26:35204) 2023-11-28T16:57:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f142bfff640 1 -- 172.21.15.26:0/2313246957 learned_addr learned my addr 172.21.15.26:0/2313246957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f143259c640 1 --2- 172.21.15.26:0/2313246957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c2000 0x7f1434070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f142bfff640 1 -- 172.21.15.26:0/2313246957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c2000 msgr2=0x7f1434070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f142bfff640 1 --2- 172.21.15.26:0/2313246957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c2000 0x7f1434070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f142bfff640 1 -- 172.21.15.26:0/2313246957 >> v1:172.21.15.79:6789/0 conn(0x7f14341588c0 legacy=0x7f1434151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f142bfff640 1 -- 172.21.15.26:0/2313246957 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340717b0 con 0x7f14340c0330 2023-11-28T16:57:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.777+0000 7f143259c640 1 --2- 172.21.15.26:0/2313246957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c2000 0x7f1434070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:39.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f142bfff640 1 --2- 172.21.15.26:0/2313246957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14340c0330 0x7f1434154930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f141c009870 tx=0x7f141c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bbdc55081100d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:39.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1431d9b640 1 -- 172.21.15.26:0/2313246957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0aa5f0 con 0x7f14340c0330 2023-11-28T16:57:39.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1431d9b640 1 -- 172.21.15.26:0/2313246957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0aa750 con 0x7f14340c0330 2023-11-28T16:57:39.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1431d9b640 1 -- 172.21.15.26:0/2313246957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0aaae0 con 0x7f14340c0330 2023-11-28T16:57:39.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 -- 172.21.15.26:0/2313246957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14340c0330 msgr2=0x7f1434154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:39.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 --2- 172.21.15.26:0/2313246957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14340c0330 0x7f1434154930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f141c009870 tx=0x7f141c01c4d0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 -- 172.21.15.26:0/2313246957 shutdown_connections 2023-11-28T16:57:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 --2- 172.21.15.26:0/2313246957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14340c0330 0x7f1434154930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 --2- 172.21.15.26:0/2313246957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c2000 0x7f1434070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 -- 172.21.15.26:0/2313246957 >> 172.21.15.26:0/2313246957 conn(0x7f143406a5a0 msgr2=0x7f143406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 -- 172.21.15.26:0/2313246957 shutdown_connections 2023-11-28T16:57:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.781+0000 7f1438c46640 1 -- 172.21.15.26:0/2313246957 wait complete. 2023-11-28T16:57:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 Processor -- start 2023-11-28T16:57:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 -- start start 2023-11-28T16:57:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c0330 0x7f14341f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14340c2000 0x7f14340c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14341588c0 0x7f14341ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341545b0 con 0x7f14341588c0 2023-11-28T16:57:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341ed2a0 con 0x7f14340c2000 2023-11-28T16:57:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14341537a0 con 0x7f14340c0330 2023-11-28T16:57:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14341588c0 0x7f14341ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14341588c0 0x7f14341ed730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35218/0 (socket says 172.21.15.26:35218) 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 -- 172.21.15.26:0/3580848521 learned_addr learned my addr 172.21.15.26:0/3580848521 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 -- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c0330 msgr2=0x7f14341f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c0330 0x7f14341f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 -- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14340c2000 msgr2=0x7f14340c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14340c2000 0x7f14340c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 -- 172.21.15.26:0/3580848521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0094d0 con 0x7f14341588c0 2023-11-28T16:57:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1432d9d640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14341588c0 0x7f14341ed730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b970 tx=0x7f142c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f142affd640 1 -- 172.21.15.26:0/3580848521 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00cb40 con 0x7f14341588c0 2023-11-28T16:57:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f142affd640 1 -- 172.21.15.26:0/3580848521 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c00cca0 con 0x7f14341588c0 2023-11-28T16:57:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f142affd640 1 -- 172.21.15.26:0/3580848521 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c014680 con 0x7f14341588c0 2023-11-28T16:57:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1434153a80 con 0x7f14341588c0 2023-11-28T16:57:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.785+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14340c54e0 con 0x7f14341588c0 2023-11-28T16:57:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.789+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143404e890 con 0x7f14341588c0 2023-11-28T16:57:39.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.789+0000 7f142affd640 1 -- 172.21.15.26:0/3580848521 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f142c01d3b0 con 0x7f14341588c0 2023-11-28T16:57:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.789+0000 7f142affd640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1414066900 0x7f1414068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.789+0000 7f142affd640 1 -- 172.21.15.26:0/3580848521 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f142c084360 con 0x7f14341588c0 2023-11-28T16:57:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.789+0000 7f143259c640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1414066900 0x7f1414068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:39.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.789+0000 7f143259c640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1414066900 0x7f1414068dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f142400a8d0 tx=0x7f1424008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:39.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.793+0000 7f142affd640 1 -- 172.21.15.26:0/3580848521 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f142c051430 con 0x7f14341588c0 2023-11-28T16:57:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:39.953+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f14341ed410 con 0x7f14341588c0 2023-11-28T16:57:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.605+0000 7f142affd640 1 -- 172.21.15.26:0/3580848521 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f142c054a50 con 0x7f14341588c0 2023-11-28T16:57:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-11-28T16:57:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1414066900 msgr2=0x7f1414068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1414066900 0x7f1414068dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f142400a8d0 tx=0x7f1424008040 comp rx=0 tx=0).stop 2023-11-28T16:57:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14341588c0 msgr2=0x7f14341ed730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14341588c0 0x7f14341ed730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b970 tx=0x7f142c00be30 comp rx=0 tx=0).stop 2023-11-28T16:57:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 shutdown_connections 2023-11-28T16:57:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14341588c0 0x7f14341ed730 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14340c2000 0x7f14340c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1414066900 0x7f1414068dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 --2- 172.21.15.26:0/3580848521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14340c0330 0x7f14341f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 >> 172.21.15.26:0/3580848521 conn(0x7f143406a5a0 msgr2=0x7f143414f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 shutdown_connections 2023-11-28T16:57:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.609+0000 7f1438c46640 1 -- 172.21.15.26:0/3580848521 wait complete. 2023-11-28T16:57:40.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:40.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f8117b1d640 1 Processor -- start 2023-11-28T16:57:40.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f8117b1d640 1 -- start start 2023-11-28T16:57:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f8117b1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8110151f40 0x7f81100c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f8117b1d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f811006ec90 0x7f8110071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f8117b1d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8110157d00 con 0x7f81100c0700 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f8117b1d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100c0be0 con 0x7f811006ec90 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f8117b1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811006cf30 con 0x7f8110151f40 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81160ba640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f811006ec90 0x7f8110071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81150b8640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f81100c0700 0x7f8110071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49628/0 (socket says 172.21.15.26:49628) 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81150b8640 1 -- 172.21.15.26:0/2768755354 learned_addr learned my addr 172.21.15.26:0/2768755354 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81158b9640 1 --2- 172.21.15.26:0/2768755354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8110151f40 0x7f81100c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81160ba640 1 -- 172.21.15.26:0/2768755354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8110151f40 msgr2=0x7f81100c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81160ba640 1 --2- 172.21.15.26:0/2768755354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8110151f40 0x7f81100c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81160ba640 1 -- 172.21.15.26:0/2768755354 >> v1:172.21.15.26:6789/0 conn(0x7f81100c0700 legacy=0x7f8110071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81160ba640 1 -- 172.21.15.26:0/2768755354 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811006d1f0 con 0x7f811006ec90 2023-11-28T16:57:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.793+0000 7f81148b7640 1 -- 172.21.15.26:0/2768755354 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821654878 0 0) 0x7f8110157d00 con 0x7f81100c0700 2023-11-28T16:57:40.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f81160ba640 1 --2- 172.21.15.26:0/2768755354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006ec90 0x7f8110071b70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8108009d90 tx=0x7f810801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b47cc8200a2aa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:40.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f81148b7640 1 -- 172.21.15.26:0/2768755354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080a58c0 con 0x7f811006ec90 2023-11-28T16:57:40.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f81148b7640 1 -- 172.21.15.26:0/2768755354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080a5a20 con 0x7f811006ec90 2023-11-28T16:57:40.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f81148b7640 1 -- 172.21.15.26:0/2768755354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080a5db0 con 0x7f811006ec90 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 -- 172.21.15.26:0/2768755354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006ec90 msgr2=0x7f8110071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 --2- 172.21.15.26:0/2768755354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006ec90 0x7f8110071b70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8108009d90 tx=0x7f810801c800 comp rx=0 tx=0).stop 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 -- 172.21.15.26:0/2768755354 shutdown_connections 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 --2- 172.21.15.26:0/2768755354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f811006ec90 0x7f8110071b70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 --2- 172.21.15.26:0/2768755354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8110151f40 0x7f81100c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 -- 172.21.15.26:0/2768755354 >> 172.21.15.26:0/2768755354 conn(0x7f81100c2ce0 msgr2=0x7f81100c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 -- 172.21.15.26:0/2768755354 shutdown_connections 2023-11-28T16:57:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.797+0000 7f8117b1d640 1 -- 172.21.15.26:0/2768755354 wait complete. 2023-11-28T16:57:40.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 Processor -- start 2023-11-28T16:57:40.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 -- start start 2023-11-28T16:57:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811006ec90 0x7f81100ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c0700 0x7f81100abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8110151f40 0x7f8110145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100a97e0 con 0x7f8110151f40 2023-11-28T16:57:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100a9d10 con 0x7f81100c0700 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100a9a30 con 0x7f811006ec90 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8110151f40 0x7f8110145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8110151f40 0x7f8110145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35236/0 (socket says 172.21.15.26:35236) 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 -- 172.21.15.26:0/153711120 learned_addr learned my addr 172.21.15.26:0/153711120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81158b9640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811006ec90 0x7f81100ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81150b8640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c0700 0x7f81100abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 -- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811006ec90 msgr2=0x7f81100ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811006ec90 0x7f81100ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 -- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c0700 msgr2=0x7f81100abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c0700 0x7f81100abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 -- 172.21.15.26:0/153711120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108009a70 con 0x7f8110151f40 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81160ba640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8110151f40 0x7f8110145a80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f810801a430 tx=0x7f81080195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81067fc640 1 -- 172.21.15.26:0/153711120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108003ba0 con 0x7f8110151f40 2023-11-28T16:57:40.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81067fc640 1 -- 172.21.15.26:0/153711120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108003d00 con 0x7f8110151f40 2023-11-28T16:57:40.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811014f7c0 con 0x7f8110151f40 2023-11-28T16:57:40.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f81067fc640 1 -- 172.21.15.26:0/153711120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080ad850 con 0x7f8110151f40 2023-11-28T16:57:40.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.801+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811014fd80 con 0x7f8110151f40 2023-11-28T16:57:40.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.805+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811014ff70 con 0x7f8110151f40 2023-11-28T16:57:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.805+0000 7f81067fc640 1 -- 172.21.15.26:0/153711120 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f81080b4070 con 0x7f8110151f40 2023-11-28T16:57:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.805+0000 7f81067fc640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80f40668d0 0x7f80f4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.805+0000 7f81067fc640 1 -- 172.21.15.26:0/153711120 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f810811efe0 con 0x7f8110151f40 2023-11-28T16:57:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.805+0000 7f81158b9640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80f40668d0 0x7f80f4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.805+0000 7f81158b9640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80f40668d0 0x7f80f4068d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f810c009b60 tx=0x7f810c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.809+0000 7f81067fc640 1 -- 172.21.15.26:0/153711120 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81080ec2a0 con 0x7f8110151f40 2023-11-28T16:57:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.965+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f811004e890 con 0x7f8110151f40 2023-11-28T16:57:40.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f81067fc640 1 -- 172.21.15.26:0/153711120 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16572 (secure 0 0 0) 0x7f81080ef8c0 con 0x7f8110151f40 2023-11-28T16:57:40.971 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:40.971 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:40.602213+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/756252810":"2023-11-29T16:57:37.594896+0000","172.21.15.26:6834/756252810":"2023-11-29T16:57:37.594896+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80f40668d0 msgr2=0x7f80f4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80f40668d0 0x7f80f4068d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f810c009b60 tx=0x7f810c009190 comp rx=0 tx=0).stop 2023-11-28T16:57:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8110151f40 msgr2=0x7f8110145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8110151f40 0x7f8110145a80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f810801a430 tx=0x7f81080195a0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 shutdown_connections 2023-11-28T16:57:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8110151f40 0x7f8110145a80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100c0700 0x7f81100abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80f40668d0 0x7f80f4068d90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 --2- 172.21.15.26:0/153711120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f811006ec90 0x7f81100ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:40.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 >> 172.21.15.26:0/153711120 conn(0x7f81100c2ce0 msgr2=0x7f81100712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:40.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 shutdown_connections 2023-11-28T16:57:40.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:40.969+0000 7f8117b1d640 1 -- 172.21.15.26:0/153711120 wait complete. 2023-11-28T16:57:40.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:57:14.412799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:57:15.689901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:40.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:41.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3852609640 1 Processor -- start 2023-11-28T16:57:41.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3852609640 1 -- start start 2023-11-28T16:57:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3852609640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f384c14eaf0 0x7f384c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3852609640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f384c0c0370 0x7f384c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3852609640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c06de00 con 0x7f384c151f90 2023-11-28T16:57:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3852609640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c070390 con 0x7f384c0c0370 2023-11-28T16:57:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3852609640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c14eed0 con 0x7f384c14eaf0 2023-11-28T16:57:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3850ba6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f384c0c0370 0x7f384c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3850ba6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f384c0c0370 0x7f384c06d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35248/0 (socket says 172.21.15.26:35248) 2023-11-28T16:57:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3850ba6640 1 -- 172.21.15.26:0/2065135595 learned_addr learned my addr 172.21.15.26:0/2065135595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f384bfff640 1 --2- 172.21.15.26:0/2065135595 >> v2:172.21.15.79:3300/0 conn(0x7f384c14eaf0 0x7f384c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3850ba6640 1 -- 172.21.15.26:0/2065135595 >> v2:172.21.15.79:3300/0 conn(0x7f384c14eaf0 msgr2=0x7f384c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3850ba6640 1 --2- 172.21.15.26:0/2065135595 >> v2:172.21.15.79:3300/0 conn(0x7f384c14eaf0 0x7f384c151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3850ba6640 1 -- 172.21.15.26:0/2065135595 >> v1:172.21.15.79:6789/0 conn(0x7f384c151f90 legacy=0x7f384c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.137+0000 7f3850ba6640 1 -- 172.21.15.26:0/2065135595 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c151270 con 0x7f384c0c0370 2023-11-28T16:57:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3850ba6640 1 --2- 172.21.15.26:0/2065135595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c0c0370 0x7f384c06d820 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f384c0c3b00 tx=0x7f384401ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8d4c8065009bce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f384affd640 1 -- 172.21.15.26:0/2065135595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400b2d0 con 0x7f384c0c0370 2023-11-28T16:57:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f384affd640 1 -- 172.21.15.26:0/2065135595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400b430 con 0x7f384c0c0370 2023-11-28T16:57:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f384affd640 1 -- 172.21.15.26:0/2065135595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38440a7a70 con 0x7f384c0c0370 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 -- 172.21.15.26:0/2065135595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c0c0370 msgr2=0x7f384c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 --2- 172.21.15.26:0/2065135595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c0c0370 0x7f384c06d820 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f384c0c3b00 tx=0x7f384401ea80 comp rx=0 tx=0).stop 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 -- 172.21.15.26:0/2065135595 shutdown_connections 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 --2- 172.21.15.26:0/2065135595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c0c0370 0x7f384c06d820 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 --2- 172.21.15.26:0/2065135595 >> v2:172.21.15.79:3300/0 conn(0x7f384c14eaf0 0x7f384c151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 -- 172.21.15.26:0/2065135595 >> 172.21.15.26:0/2065135595 conn(0x7f384c0c2a60 msgr2=0x7f384c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 -- 172.21.15.26:0/2065135595 shutdown_connections 2023-11-28T16:57:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.141+0000 7f3852609640 1 -- 172.21.15.26:0/2065135595 wait complete. 2023-11-28T16:57:41.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 Processor -- start 2023-11-28T16:57:41.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 -- start start 2023-11-28T16:57:41.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f384c0c0370 0x7f384c0c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c14eaf0 0x7f384c0c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c071750 0x7f384c0c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c1542e0 con 0x7f384c071750 2023-11-28T16:57:41.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0c58b0 con 0x7f384c14eaf0 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0c5b50 con 0x7f384c0c0370 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c071750 0x7f384c0c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c071750 0x7f384c0c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35258/0 (socket says 172.21.15.26:35258) 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 -- 172.21.15.26:0/268856388 learned_addr learned my addr 172.21.15.26:0/268856388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f384bfff640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f384c0c0370 0x7f384c0c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f384b7fe640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c14eaf0 0x7f384c0c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 -- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f384c0c0370 msgr2=0x7f384c0c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f384c0c0370 0x7f384c0c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 -- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c14eaf0 msgr2=0x7f384c0c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c14eaf0 0x7f384c0c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 -- 172.21.15.26:0/268856388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384400bd40 con 0x7f384c071750 2023-11-28T16:57:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3850ba6640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c071750 0x7f384c0c42b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f384401b690 tx=0x7f384401b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3848ff9640 1 -- 172.21.15.26:0/268856388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844009800 con 0x7f384c071750 2023-11-28T16:57:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3848ff9640 1 -- 172.21.15.26:0/268856388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38440099a0 con 0x7f384c071750 2023-11-28T16:57:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3848ff9640 1 -- 172.21.15.26:0/268856388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844009d50 con 0x7f384c071750 2023-11-28T16:57:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c152660 con 0x7f384c071750 2023-11-28T16:57:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c152c20 con 0x7f384c071750 2023-11-28T16:57:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.145+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c04e890 con 0x7f384c071750 2023-11-28T16:57:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.149+0000 7f3848ff9640 1 -- 172.21.15.26:0/268856388 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f38440c3460 con 0x7f384c071750 2023-11-28T16:57:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.149+0000 7f3848ff9640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38380668d0 0x7f3838068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.149+0000 7f3848ff9640 1 -- 172.21.15.26:0/268856388 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f384411f880 con 0x7f384c071750 2023-11-28T16:57:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.149+0000 7f384bfff640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38380668d0 0x7f3838068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.149+0000 7f384bfff640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38380668d0 0x7f3838068d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f384c0c5f30 tx=0x7f383c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.153+0000 7f3848ff9640 1 -- 172.21.15.26:0/268856388 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38440ecbd0 con 0x7f384c071750 2023-11-28T16:57:41.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.313+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f384c13e860 con 0x7f384c071750 2023-11-28T16:57:41.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.313+0000 7f3848ff9640 1 -- 172.21.15.26:0/268856388 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f384411f020 con 0x7f384c071750 2023-11-28T16:57:41.316 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:41.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.313+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38380668d0 msgr2=0x7f3838068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.313+0000 7f3852609640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38380668d0 0x7f3838068d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f384c0c5f30 tx=0x7f383c009190 comp rx=0 tx=0).stop 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.313+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c071750 msgr2=0x7f384c0c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.313+0000 7f3852609640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c071750 0x7f384c0c42b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f384401b690 tx=0x7f384401b820 comp rx=0 tx=0).stop 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.313+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 shutdown_connections 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.317+0000 7f3852609640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f384c071750 0x7f384c0c42b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.317+0000 7f3852609640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c14eaf0 0x7f384c0c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.317+0000 7f3852609640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38380668d0 0x7f3838068d90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.317+0000 7f3852609640 1 --2- 172.21.15.26:0/268856388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f384c0c0370 0x7f384c0c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.317+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 >> 172.21.15.26:0/268856388 conn(0x7f384c0c2a60 msgr2=0x7f384c14dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.317+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 shutdown_connections 2023-11-28T16:57:41.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.317+0000 7f3852609640 1 -- 172.21.15.26:0/268856388 wait complete. 2023-11-28T16:57:41.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:57:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f27b57640 1 Processor -- start 2023-11-28T16:57:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f27b57640 1 -- start start 2023-11-28T16:57:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f27b57640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f20151bf0 0x7f5f20152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f27b57640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f20158580 con 0x7f5f20158a10 2023-11-28T16:57:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f27b57640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f20158e60 con 0x7f5f200c6220 2023-11-28T16:57:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f27b57640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f200c2fd0 con 0x7f5f20151bf0 2023-11-28T16:57:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f250f2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5f20158a10 0x7f5f200c28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52884/0 (socket says 172.21.15.26:52884) 2023-11-28T16:57:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f250f2640 1 -- 172.21.15.26:0/1691199955 learned_addr learned my addr 172.21.15.26:0/1691199955 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f260f4640 1 --2- 172.21.15.26:0/1691199955 >> v2:172.21.15.79:3300/0 conn(0x7f5f20151bf0 0x7f5f20152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f248f1640 1 -- 172.21.15.26:0/1691199955 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446551149 0 0) 0x7f5f20158580 con 0x7f5f20158a10 2023-11-28T16:57:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f248f1640 1 -- 172.21.15.26:0/1691199955 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f0c003530 con 0x7f5f20158a10 2023-11-28T16:57:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f260f4640 1 -- 172.21.15.26:0/1691199955 >> v1:172.21.15.79:6789/0 conn(0x7f5f200c6220 legacy=0x7f5f200c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f260f4640 1 -- 172.21.15.26:0/1691199955 >> v1:172.21.15.26:6789/0 conn(0x7f5f20158a10 legacy=0x7f5f200c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.481+0000 7f5f260f4640 1 -- 172.21.15.26:0/1691199955 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20157f50 con 0x7f5f20151bf0 2023-11-28T16:57:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f260f4640 1 --2- 172.21.15.26:0/1691199955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 0x7f5f20152020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009d90 tx=0x7f5f1801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad245f01a923f9b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f248f1640 1 -- 172.21.15.26:0/1691199955 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180a59e0 con 0x7f5f20151bf0 2023-11-28T16:57:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f248f1640 1 -- 172.21.15.26:0/1691199955 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f180a5b40 con 0x7f5f20151bf0 2023-11-28T16:57:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f248f1640 1 -- 172.21.15.26:0/1691199955 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180ad440 con 0x7f5f20151bf0 2023-11-28T16:57:41.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f27b57640 1 -- 172.21.15.26:0/1691199955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 msgr2=0x7f5f20152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f27b57640 1 --2- 172.21.15.26:0/1691199955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 0x7f5f20152020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009d90 tx=0x7f5f1801c920 comp rx=0 tx=0).stop 2023-11-28T16:57:41.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f27b57640 1 -- 172.21.15.26:0/1691199955 shutdown_connections 2023-11-28T16:57:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f27b57640 1 --2- 172.21.15.26:0/1691199955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 0x7f5f20152020 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.485+0000 7f5f27b57640 1 -- 172.21.15.26:0/1691199955 >> 172.21.15.26:0/1691199955 conn(0x7f5f2006a5a0 msgr2=0x7f5f2006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 -- 172.21.15.26:0/1691199955 shutdown_connections 2023-11-28T16:57:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 -- 172.21.15.26:0/1691199955 wait complete. 2023-11-28T16:57:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 Processor -- start 2023-11-28T16:57:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 -- start start 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f200c6220 0x7f5f2006c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 0x7f5f201ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f20158a10 0x7f5f200a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20145130 con 0x7f5f20158a10 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20155d50 con 0x7f5f20151bf0 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f27b57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20156030 con 0x7f5f200c6220 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f20158a10 0x7f5f200a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f20158a10 0x7f5f200a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58022/0 (socket says 172.21.15.26:58022) 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 -- 172.21.15.26:0/2874692895 learned_addr learned my addr 172.21.15.26:0/2874692895 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f258f3640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f200c6220 0x7f5f2006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f250f2640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 0x7f5f201ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 -- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f200c6220 msgr2=0x7f5f2006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f200c6220 0x7f5f2006c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 -- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 msgr2=0x7f5f201ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 0x7f5f201ee040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 -- 172.21.15.26:0/2874692895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f18009a70 con 0x7f5f20158a10 2023-11-28T16:57:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.489+0000 7f5f260f4640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f20158a10 0x7f5f200a9fd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5f18019530 tx=0x7f5f180196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f167fc640 1 -- 172.21.15.26:0/2874692895 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180add70 con 0x7f5f20158a10 2023-11-28T16:57:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f167fc640 1 -- 172.21.15.26:0/2874692895 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f18009450 con 0x7f5f20158a10 2023-11-28T16:57:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f167fc640 1 -- 172.21.15.26:0/2874692895 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180b9690 con 0x7f5f20158a10 2023-11-28T16:57:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f20156310 con 0x7f5f20158a10 2023-11-28T16:57:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2006cea0 con 0x7f5f20158a10 2023-11-28T16:57:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2004e890 con 0x7f5f20158a10 2023-11-28T16:57:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f167fc640 1 -- 172.21.15.26:0/2874692895 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5f180b97f0 con 0x7f5f20158a10 2023-11-28T16:57:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f167fc640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5f04066900 0x7f5f04068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f167fc640 1 -- 172.21.15.26:0/2874692895 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5f1811fa70 con 0x7f5f20158a10 2023-11-28T16:57:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.493+0000 7f5f258f3640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5f04066900 0x7f5f04068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.497+0000 7f5f258f3640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5f04066900 0x7f5f04068dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c007fd0 tx=0x7f5f1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.497+0000 7f5f167fc640 1 -- 172.21.15.26:0/2874692895 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f180ece10 con 0x7f5f20158a10 2023-11-28T16:57:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f2006f2e0 con 0x7f5f20158a10 2023-11-28T16:57:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f167fc640 1 -- 172.21.15.26:0/2874692895 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5f180bd020 con 0x7f5f20158a10 2023-11-28T16:57:41.659 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5f04066900 msgr2=0x7f5f04068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5f04066900 0x7f5f04068dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c007fd0 tx=0x7f5f1c009040 comp rx=0 tx=0).stop 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f20158a10 msgr2=0x7f5f200a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f20158a10 0x7f5f200a9fd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5f18019530 tx=0x7f5f180196c0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 shutdown_connections 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f20158a10 0x7f5f200a9fd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f20151bf0 0x7f5f201ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5f04066900 0x7f5f04068dc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 --2- 172.21.15.26:0/2874692895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f200c6220 0x7f5f2006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 >> 172.21.15.26:0/2874692895 conn(0x7f5f2006a5a0 msgr2=0x7f5f200c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:41.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 shutdown_connections 2023-11-28T16:57:41.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.657+0000 7f5f27b57640 1 -- 172.21.15.26:0/2874692895 wait complete. 2023-11-28T16:57:41.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:57:41.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.825+0000 7f97bc2d6640 1 Processor -- start 2023-11-28T16:57:41.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.825+0000 7f97bc2d6640 1 -- start start 2023-11-28T16:57:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.825+0000 7f97bc2d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b40a86d0 0x7f97b40a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.825+0000 7f97bc2d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97b4156600 0x7f97b414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.825+0000 7f97bc2d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b4152d90 con 0x7f97b414fb30 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.825+0000 7f97bc2d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b4152480 con 0x7f97b4156600 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.825+0000 7f97bc2d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40a9760 con 0x7f97b40a86d0 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97b4156600 0x7f97b414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97b4156600 0x7f97b414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58034/0 (socket says 172.21.15.26:58034) 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 -- 172.21.15.26:0/3743268092 learned_addr learned my addr 172.21.15.26:0/3743268092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97ba072640 1 --2- 172.21.15.26:0/3743268092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b40a86d0 0x7f97b40a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 -- 172.21.15.26:0/3743268092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b40a86d0 msgr2=0x7f97b40a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 --2- 172.21.15.26:0/3743268092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b40a86d0 0x7f97b40a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 -- 172.21.15.26:0/3743268092 >> v1:172.21.15.79:6789/0 conn(0x7f97b414fb30 legacy=0x7f97b40aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 -- 172.21.15.26:0/3743268092 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4152740 con 0x7f97b4156600 2023-11-28T16:57:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9871640 1 --2- 172.21.15.26:0/3743268092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b4156600 0x7f97b414f5f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009870 tx=0x7f97a401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358c418bc01650b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9070640 1 -- 172.21.15.26:0/3743268092 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40ab600 con 0x7f97b4156600 2023-11-28T16:57:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9070640 1 -- 172.21.15.26:0/3743268092 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a40a7050 con 0x7f97b4156600 2023-11-28T16:57:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.829+0000 7f97b9070640 1 -- 172.21.15.26:0/3743268092 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40ab980 con 0x7f97b4156600 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3743268092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b4156600 msgr2=0x7f97b414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3743268092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b4156600 0x7f97b414f5f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009870 tx=0x7f97a401c540 comp rx=0 tx=0).stop 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3743268092 shutdown_connections 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3743268092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b4156600 0x7f97b414f5f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3743268092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b40a86d0 0x7f97b40a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3743268092 >> 172.21.15.26:0/3743268092 conn(0x7f97b40c2a60 msgr2=0x7f97b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3743268092 shutdown_connections 2023-11-28T16:57:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3743268092 wait complete. 2023-11-28T16:57:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 Processor -- start 2023-11-28T16:57:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- start start 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b40a86d0 0x7f97b415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b414fb30 0x7f97b40bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b4156600 0x7f97b41f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b41ecf60 con 0x7f97b40a86d0 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40be6e0 con 0x7f97b414fb30 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97bc2d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b41ed7a0 con 0x7f97b4156600 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b40a86d0 0x7f97b415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b40a86d0 0x7f97b415b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58036/0 (socket says 172.21.15.26:58036) 2023-11-28T16:57:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 -- 172.21.15.26:0/3545030401 learned_addr learned my addr 172.21.15.26:0/3545030401 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97b9871640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b414fb30 0x7f97b40bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba873640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b4156600 0x7f97b41f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 -- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b4156600 msgr2=0x7f97b41f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b4156600 0x7f97b41f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 -- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b414fb30 msgr2=0x7f97b40bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b414fb30 0x7f97b40bf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba072640 1 -- 172.21.15.26:0/3545030401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a40094d0 con 0x7f97b40a86d0 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.833+0000 7f97ba873640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b4156600 0x7f97b41f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97ba072640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b40a86d0 0x7f97b415b360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f97b000d830 tx=0x7f97b000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97aaffd640 1 -- 172.21.15.26:0/3545030401 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000b6c0 con 0x7f97b40a86d0 2023-11-28T16:57:41.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97aaffd640 1 -- 172.21.15.26:0/3545030401 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b000b820 con 0x7f97b40a86d0 2023-11-28T16:57:41.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97aaffd640 1 -- 172.21.15.26:0/3545030401 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000bb90 con 0x7f97b40a86d0 2023-11-28T16:57:41.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b41414b0 con 0x7f97b40a86d0 2023-11-28T16:57:41.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b41ed150 con 0x7f97b40a86d0 2023-11-28T16:57:41.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b404e890 con 0x7f97b40a86d0 2023-11-28T16:57:41.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97aaffd640 1 -- 172.21.15.26:0/3545030401 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f97b001e460 con 0x7f97b40a86d0 2023-11-28T16:57:41.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97aaffd640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9798066900 0x7f9798068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.837+0000 7f97aaffd640 1 -- 172.21.15.26:0/3545030401 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f97b0084c40 con 0x7f97b40a86d0 2023-11-28T16:57:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.841+0000 7f97b9871640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9798066900 0x7f9798068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.841+0000 7f97b9871640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9798066900 0x7f9798068dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f97b4074300 tx=0x7f97a40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:41.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.841+0000 7f97aaffd640 1 -- 172.21.15.26:0/3545030401 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97b0051e10 con 0x7f97b40a86d0 2023-11-28T16:57:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.997+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f97b4072a30 con 0x7f97b40a86d0 2023-11-28T16:57:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:41.997+0000 7f97aaffd640 1 -- 172.21.15.26:0/3545030401 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7f97b0055430 con 0x7f97b40a86d0 2023-11-28T16:57:42.003 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:57:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9798066900 msgr2=0x7f9798068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9798066900 0x7f9798068dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f97b4074300 tx=0x7f97a40a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b40a86d0 msgr2=0x7f97b415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b40a86d0 0x7f97b415b360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f97b000d830 tx=0x7f97b000dcf0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 shutdown_connections 2023-11-28T16:57:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9798066900 0x7f9798068dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f97b4156600 0x7f97b41f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b414fb30 0x7f97b40bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 --2- 172.21.15.26:0/3545030401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97b40a86d0 0x7f97b415b360 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 >> 172.21.15.26:0/3545030401 conn(0x7f97b40c2a60 msgr2=0x7f97b40c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 shutdown_connections 2023-11-28T16:57:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.001+0000 7f97bc2d6640 1 -- 172.21.15.26:0/3545030401 wait complete. 2023-11-28T16:57:42.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:42.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 Processor -- start 2023-11-28T16:57:42.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 -- start start 2023-11-28T16:57:42.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f414fcc0 0x7f65f4156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65f406d980 0x7f65f40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f40ab3b0 0x7f65f40c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40aa340 con 0x7f65f40ab3b0 2023-11-28T16:57:42.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f4152fe0 con 0x7f65f406d980 2023-11-28T16:57:42.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f9e6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f41532c0 con 0x7f65f414fcc0 2023-11-28T16:57:42.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f40ab3b0 0x7f65f40c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f40ab3b0 0x7f65f40c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58038/0 (socket says 172.21.15.26:58038) 2023-11-28T16:57:42.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 -- 172.21.15.26:0/3131130534 learned_addr learned my addr 172.21.15.26:0/3131130534 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:42.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f2ffd640 1 --2- 172.21.15.26:0/3131130534 >> v2:172.21.15.79:3300/0 conn(0x7f65f406d980 0x7f65f40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f37fe640 1 --2- 172.21.15.26:0/3131130534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f414fcc0 0x7f65f4156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 -- 172.21.15.26:0/3131130534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f414fcc0 msgr2=0x7f65f4156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:42.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 --2- 172.21.15.26:0/3131130534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f414fcc0 0x7f65f4156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 -- 172.21.15.26:0/3131130534 >> v2:172.21.15.79:3300/0 conn(0x7f65f406d980 msgr2=0x7f65f40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:42.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 --2- 172.21.15.26:0/3131130534 >> v2:172.21.15.79:3300/0 conn(0x7f65f406d980 0x7f65f40aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.165+0000 7f65f3fff640 1 -- 172.21.15.26:0/3131130534 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4155a20 con 0x7f65f40ab3b0 2023-11-28T16:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f3fff640 1 --2- 172.21.15.26:0/3131130534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f40ab3b0 0x7f65f40c19e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f65f406b3f0 tx=0x7f65ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c649ef6aa6e6102b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f27fc640 1 -- 172.21.15.26:0/3131130534 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0a5820 con 0x7f65f40ab3b0 2023-11-28T16:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f27fc640 1 -- 172.21.15.26:0/3131130534 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec0a5980 con 0x7f65f40ab3b0 2023-11-28T16:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f27fc640 1 -- 172.21.15.26:0/3131130534 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0a5d10 con 0x7f65f40ab3b0 2023-11-28T16:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 -- 172.21.15.26:0/3131130534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f40ab3b0 msgr2=0x7f65f40c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/3131130534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f40ab3b0 0x7f65f40c19e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f65f406b3f0 tx=0x7f65ec01c9a0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 -- 172.21.15.26:0/3131130534 shutdown_connections 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/3131130534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f40ab3b0 0x7f65f40c19e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/3131130534 >> v2:172.21.15.79:3300/0 conn(0x7f65f406d980 0x7f65f40aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/3131130534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f414fcc0 0x7f65f4156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 -- 172.21.15.26:0/3131130534 >> 172.21.15.26:0/3131130534 conn(0x7f65f40c2ad0 msgr2=0x7f65f40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 -- 172.21.15.26:0/3131130534 shutdown_connections 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.169+0000 7f65f9e6b640 1 -- 172.21.15.26:0/3131130534 wait complete. 2023-11-28T16:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 Processor -- start 2023-11-28T16:57:42.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 -- start start 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f406d980 0x7f65f40bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f40ab3b0 0x7f65f41f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f4071aa0 0x7f65f41f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f41f1070 con 0x7f65f406d980 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40701f0 con 0x7f65f4071aa0 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40c5910 con 0x7f65f40ab3b0 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f406d980 0x7f65f40bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f406d980 0x7f65f40bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58046/0 (socket says 172.21.15.26:58046) 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 -- 172.21.15.26:0/955632891 learned_addr learned my addr 172.21.15.26:0/955632891 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f2ffd640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f40ab3b0 0x7f65f41f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f3fff640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f4071aa0 0x7f65f41f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 -- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f40ab3b0 msgr2=0x7f65f41f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f40ab3b0 0x7f65f41f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 -- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f4071aa0 msgr2=0x7f65f41f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f4071aa0 0x7f65f41f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 -- 172.21.15.26:0/955632891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec009b30 con 0x7f65f406d980 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f2ffd640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f40ab3b0 0x7f65f41f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f37fe640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f406d980 0x7f65f40bfe20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f65e400e870 tx=0x7f65e400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65dbfff640 1 -- 172.21.15.26:0/955632891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4009510 con 0x7f65f406d980 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65dbfff640 1 -- 172.21.15.26:0/955632891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e400eec0 con 0x7f65f406d980 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f40c4d90 con 0x7f65f406d980 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65dbfff640 1 -- 172.21.15.26:0/955632891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400cb40 con 0x7f65f406d980 2023-11-28T16:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.173+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f40c5350 con 0x7f65f406d980 2023-11-28T16:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.177+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f404e890 con 0x7f65f406d980 2023-11-28T16:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.177+0000 7f65dbfff640 1 -- 172.21.15.26:0/955632891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f65e400cca0 con 0x7f65f406d980 2023-11-28T16:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.177+0000 7f65dbfff640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65e00668d0 0x7f65e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.177+0000 7f65dbfff640 1 -- 172.21.15.26:0/955632891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f65e4084540 con 0x7f65f406d980 2023-11-28T16:57:42.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.177+0000 7f65f2ffd640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65e00668d0 0x7f65e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.177+0000 7f65f2ffd640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65e00668d0 0x7f65e0068d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f65f40c4710 tx=0x7f65e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.181+0000 7f65dbfff640 1 -- 172.21.15.26:0/955632891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65e40517b0 con 0x7f65f406d980 2023-11-28T16:57:42.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65f406ce10 con 0x7f65f406d980 2023-11-28T16:57:42.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65dbfff640 1 -- 172.21.15.26:0/955632891 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f65e4054dd0 con 0x7f65f406d980 2023-11-28T16:57:42.376 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:42.376 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2342692077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2342692077},{"type":"v1","addr":"172.21.15.26:6835","nonce":2342692077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-11-28T16:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65e00668d0 msgr2=0x7f65e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65e00668d0 0x7f65e0068d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f65f40c4710 tx=0x7f65e8008040 comp rx=0 tx=0).stop 2023-11-28T16:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f406d980 msgr2=0x7f65f40bfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f406d980 0x7f65f40bfe20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f65e400e870 tx=0x7f65e400ec70 comp rx=0 tx=0).stop 2023-11-28T16:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 shutdown_connections 2023-11-28T16:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f4071aa0 0x7f65f41f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65e00668d0 0x7f65e0068d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f40ab3b0 0x7f65f41f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 --2- 172.21.15.26:0/955632891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f406d980 0x7f65f40bfe20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 >> 172.21.15.26:0/955632891 conn(0x7f65f40c2ad0 msgr2=0x7f65f40a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 shutdown_connections 2023-11-28T16:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.373+0000 7f65f9e6b640 1 -- 172.21.15.26:0/955632891 wait complete. 2023-11-28T16:57:42.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:42.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.537+0000 7f5f0edd8640 1 Processor -- start 2023-11-28T16:57:42.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.537+0000 7f5f0edd8640 1 -- start start 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.537+0000 7f5f0edd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0814e9d0 0x7f5f08151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.537+0000 7f5f0edd8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f080a8470 0x7f5f0806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.537+0000 7f5f0edd8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0806d320 con 0x7f5f08070b80 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.537+0000 7f5f0edd8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f080721b0 con 0x7f5f080a8470 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0edd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080c2830 con 0x7f5f0814e9d0 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f07fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5f08070b80 0x7f5f080c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52888/0 (socket says 172.21.15.26:52888) 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f07fff640 1 -- 172.21.15.26:0/1396142478 learned_addr learned my addr 172.21.15.26:0/1396142478 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0d375640 1 --2- 172.21.15.26:0/1396142478 >> v2:172.21.15.79:3300/0 conn(0x7f5f080a8470 0x7f5f0806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0cb74640 1 --2- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0814e9d0 0x7f5f08151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f077fe640 1 -- 172.21.15.26:0/1396142478 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598057619 0 0) 0x7f5f0806d320 con 0x7f5f08070b80 2023-11-28T16:57:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f077fe640 1 -- 172.21.15.26:0/1396142478 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ef8003530 con 0x7f5f08070b80 2023-11-28T16:57:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0d375640 1 -- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0814e9d0 msgr2=0x7f5f08151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0d375640 1 --2- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0814e9d0 0x7f5f08151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0d375640 1 -- 172.21.15.26:0/1396142478 >> v1:172.21.15.26:6789/0 conn(0x7f5f08070b80 legacy=0x7f5f080c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0d375640 1 -- 172.21.15.26:0/1396142478 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08072450 con 0x7f5f080a8470 2023-11-28T16:57:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.541+0000 7f5f0d375640 1 --2- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 0x7f5f0806d7b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009d90 tx=0x7f5f0001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d1f9cfcf87a2dd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f077fe640 1 -- 172.21.15.26:0/1396142478 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000a5890 con 0x7f5f080a8470 2023-11-28T16:57:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f077fe640 1 -- 172.21.15.26:0/1396142478 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f000a59f0 con 0x7f5f080a8470 2023-11-28T16:57:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f077fe640 1 -- 172.21.15.26:0/1396142478 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000a5d80 con 0x7f5f080a8470 2023-11-28T16:57:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 msgr2=0x7f5f0806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 0x7f5f0806d7b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009d90 tx=0x7f5f0001c8c0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- 172.21.15.26:0/1396142478 shutdown_connections 2023-11-28T16:57:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 0x7f5f0806d7b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/1396142478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0814e9d0 0x7f5f08151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- 172.21.15.26:0/1396142478 >> 172.21.15.26:0/1396142478 conn(0x7f5f080c2ad0 msgr2=0x7f5f080c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- 172.21.15.26:0/1396142478 shutdown_connections 2023-11-28T16:57:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- 172.21.15.26:0/1396142478 wait complete. 2023-11-28T16:57:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 Processor -- start 2023-11-28T16:57:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- start start 2023-11-28T16:57:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f08070b80 0x7f5f080c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 0x7f5f081ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0814e9d0 0x7f5f080ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080c43b0 con 0x7f5f0814e9d0 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080c5ab0 con 0x7f5f080a8470 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0edd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080c3d60 con 0x7f5f08070b80 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0d375640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0814e9d0 0x7f5f080ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0d375640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0814e9d0 0x7f5f080ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58050/0 (socket says 172.21.15.26:58050) 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.545+0000 7f5f0d375640 1 -- 172.21.15.26:0/3548815789 learned_addr learned my addr 172.21.15.26:0/3548815789 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f07fff640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 0x7f5f081ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0cb74640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f08070b80 0x7f5f080c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0d375640 1 -- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f08070b80 msgr2=0x7f5f080c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0d375640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f08070b80 0x7f5f080c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0d375640 1 -- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 msgr2=0x7f5f081ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0d375640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 0x7f5f081ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0d375640 1 -- 172.21.15.26:0/3548815789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f00009a70 con 0x7f5f0814e9d0 2023-11-28T16:57:42.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0d375640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0814e9d0 0x7f5f080ab110 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5f0001af70 tx=0x7f5f00019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f057fa640 1 -- 172.21.15.26:0/3548815789 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000b9650 con 0x7f5f0814e9d0 2023-11-28T16:57:42.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f057fa640 1 -- 172.21.15.26:0/3548815789 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f000b97b0 con 0x7f5f0814e9d0 2023-11-28T16:57:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f057fa640 1 -- 172.21.15.26:0/3548815789 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000b9b20 con 0x7f5f0814e9d0 2023-11-28T16:57:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f080c4040 con 0x7f5f0814e9d0 2023-11-28T16:57:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f080abb70 con 0x7f5f0814e9d0 2023-11-28T16:57:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f080abd00 con 0x7f5f0814e9d0 2023-11-28T16:57:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.549+0000 7f5f057fa640 1 -- 172.21.15.26:0/3548815789 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5f000b9c80 con 0x7f5f0814e9d0 2023-11-28T16:57:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.553+0000 7f5f057fa640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5eec0668d0 0x7f5eec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.553+0000 7f5f057fa640 1 -- 172.21.15.26:0/3548815789 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5f0011f670 con 0x7f5f0814e9d0 2023-11-28T16:57:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.553+0000 7f5f0cb74640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5eec0668d0 0x7f5eec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.553+0000 7f5f0cb74640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5eec0668d0 0x7f5eec068d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5f081ea730 tx=0x7f5efc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.557+0000 7f5f057fa640 1 -- 172.21.15.26:0/3548815789 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f000ec840 con 0x7f5f0814e9d0 2023-11-28T16:57:42.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.717+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f080c3bc0 con 0x7f5f0814e9d0 2023-11-28T16:57:42.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.717+0000 7f5f057fa640 1 -- 172.21.15.26:0/3548815789 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16572 (secure 0 0 0) 0x7f5f080c3bc0 con 0x7f5f0814e9d0 2023-11-28T16:57:42.721 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:42.721 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:40.602213+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/756252810":"2023-11-29T16:57:37.594896+0000","172.21.15.26:6834/756252810":"2023-11-29T16:57:37.594896+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:42.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5eec0668d0 msgr2=0x7f5eec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5eec0668d0 0x7f5eec068d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5f081ea730 tx=0x7f5efc008040 comp rx=0 tx=0).stop 2023-11-28T16:57:42.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0814e9d0 msgr2=0x7f5f080ab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0814e9d0 0x7f5f080ab110 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5f0001af70 tx=0x7f5f00019660 comp rx=0 tx=0).stop 2023-11-28T16:57:42.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 shutdown_connections 2023-11-28T16:57:42.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0814e9d0 0x7f5f080ab110 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f080a8470 0x7f5f081ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5eec0668d0 0x7f5eec068d90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 --2- 172.21.15.26:0/3548815789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f08070b80 0x7f5f080c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 >> 172.21.15.26:0/3548815789 conn(0x7f5f080c2ad0 msgr2=0x7f5f0814c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:42.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 shutdown_connections 2023-11-28T16:57:42.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.721+0000 7f5f0edd8640 1 -- 172.21.15.26:0/3548815789 wait complete. 2023-11-28T16:57:42.743 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-28T16:57:42.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:42.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7199b8640 1 Processor -- start 2023-11-28T16:57:42.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7199b8640 1 -- start start 2023-11-28T16:57:42.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7199b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe71406d980 0x7fe7140c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7199b8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe714156980 con 0x7fe71414fcc0 2023-11-28T16:57:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7199b8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140ab580 con 0x7fe714156500 2023-11-28T16:57:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7199b8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7140aa340 con 0x7fe71406d980 2023-11-28T16:57:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe712ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe71414fcc0 0x7fe7140aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52896/0 (socket says 172.21.15.26:52896) 2023-11-28T16:57:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe712ffd640 1 -- 172.21.15.26:0/4130949359 learned_addr learned my addr 172.21.15.26:0/4130949359 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7137fe640 1 --2- 172.21.15.26:0/4130949359 >> v2:172.21.15.79:3300/0 conn(0x7fe71406d980 0x7fe7140c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe711ffb640 1 -- 172.21.15.26:0/4130949359 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013498497 0 0) 0x7fe704001120 con 0x7fe71414fcc0 2023-11-28T16:57:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe711ffb640 1 -- 172.21.15.26:0/4130949359 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6fc003530 con 0x7fe71414fcc0 2023-11-28T16:57:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe711ffb640 1 -- 172.21.15.26:0/4130949359 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244412618 0 0) 0x7fe7140ab580 con 0x7fe714156500 2023-11-28T16:57:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe711ffb640 1 -- 172.21.15.26:0/4130949359 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe704001120 con 0x7fe714156500 2023-11-28T16:57:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7137fe640 1 -- 172.21.15.26:0/4130949359 >> v1:172.21.15.79:6789/0 conn(0x7fe714156500 legacy=0x7fe7140c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7137fe640 1 -- 172.21.15.26:0/4130949359 >> v1:172.21.15.26:6789/0 conn(0x7fe71414fcc0 legacy=0x7fe7140aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.885+0000 7fe7137fe640 1 -- 172.21.15.26:0/4130949359 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714152fe0 con 0x7fe71406d980 2023-11-28T16:57:42.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7137fe640 1 --2- 172.21.15.26:0/4130949359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71406d980 0x7fe7140c20f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009d90 tx=0x7fe70c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae6930793e38ae11 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe711ffb640 1 -- 172.21.15.26:0/4130949359 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0a59e0 con 0x7fe71406d980 2023-11-28T16:57:42.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe711ffb640 1 -- 172.21.15.26:0/4130949359 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c0a5b40 con 0x7fe71406d980 2023-11-28T16:57:42.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe711ffb640 1 -- 172.21.15.26:0/4130949359 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0ad440 con 0x7fe71406d980 2023-11-28T16:57:42.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7199b8640 1 -- 172.21.15.26:0/4130949359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71406d980 msgr2=0x7fe7140c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7199b8640 1 --2- 172.21.15.26:0/4130949359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71406d980 0x7fe7140c20f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009d90 tx=0x7fe70c01c920 comp rx=0 tx=0).stop 2023-11-28T16:57:42.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7199b8640 1 -- 172.21.15.26:0/4130949359 shutdown_connections 2023-11-28T16:57:42.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7199b8640 1 --2- 172.21.15.26:0/4130949359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71406d980 0x7fe7140c20f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7199b8640 1 -- 172.21.15.26:0/4130949359 >> 172.21.15.26:0/4130949359 conn(0x7fe7140c2ad0 msgr2=0x7fe7140c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:42.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7199b8640 1 -- 172.21.15.26:0/4130949359 shutdown_connections 2023-11-28T16:57:42.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.889+0000 7fe7199b8640 1 -- 172.21.15.26:0/4130949359 wait complete. 2023-11-28T16:57:42.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 Processor -- start 2023-11-28T16:57:42.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 -- start start 2023-11-28T16:57:42.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71406d980 0x7fe71415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe714156500 0x7fe7141467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71415ba00 0x7fe714146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71415b310 con 0x7fe71415ba00 2023-11-28T16:57:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe714147220 con 0x7fe714156500 2023-11-28T16:57:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7141ed530 con 0x7fe71406d980 2023-11-28T16:57:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71415ba00 0x7fe714146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71415ba00 0x7fe714146ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58052/0 (socket says 172.21.15.26:58052) 2023-11-28T16:57:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 -- 172.21.15.26:0/716654828 learned_addr learned my addr 172.21.15.26:0/716654828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe712ffd640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71406d980 0x7fe71415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7127fc640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe714156500 0x7fe7141467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 -- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71406d980 msgr2=0x7fe71415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71406d980 0x7fe71415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 -- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe714156500 msgr2=0x7fe7141467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe714156500 0x7fe7141467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 -- 172.21.15.26:0/716654828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c009a70 con 0x7fe71415ba00 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7127fc640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe714156500 0x7fe7141467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7137fe640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71415ba00 0x7fe714146ce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe70c01a550 tx=0x7fe70c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe6fbfff640 1 -- 172.21.15.26:0/716654828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0adce0 con 0x7fe71415ba00 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe6fbfff640 1 -- 172.21.15.26:0/716654828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c0ade40 con 0x7fe71415ba00 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7141ed810 con 0x7fe71415ba00 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe6fbfff640 1 -- 172.21.15.26:0/716654828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0b9670 con 0x7fe71415ba00 2023-11-28T16:57:42.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.893+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7140c5320 con 0x7fe71415ba00 2023-11-28T16:57:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.897+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71415b7a0 con 0x7fe71415ba00 2023-11-28T16:57:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.897+0000 7fe6fbfff640 1 -- 172.21.15.26:0/716654828 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe70c0b97d0 con 0x7fe71415ba00 2023-11-28T16:57:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.897+0000 7fe6fbfff640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7000668d0 0x7fe700068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.897+0000 7fe6fbfff640 1 -- 172.21.15.26:0/716654828 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe70c11fbc0 con 0x7fe71415ba00 2023-11-28T16:57:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.897+0000 7fe712ffd640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7000668d0 0x7fe700068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.897+0000 7fe712ffd640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7000668d0 0x7fe700068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe704000f70 tx=0x7fe704009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:42.901+0000 7fe6fbfff640 1 -- 172.21.15.26:0/716654828 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe70c0ecd90 con 0x7fe71415ba00 2023-11-28T16:57:43.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe71404e890 con 0x7fe71415ba00 2023-11-28T16:57:43.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe6fbfff640 1 -- 172.21.15.26:0/716654828 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4915 (secure 0 0 0) 0x7fe70c009450 con 0x7fe71415ba00 2023-11-28T16:57:43.096 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:43.096 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2342692077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2342692077},{"type":"v1","addr":"172.21.15.26:6835","nonce":2342692077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:43.096 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-11-28T16:57:43.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7000668d0 msgr2=0x7fe700068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7000668d0 0x7fe700068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe704000f70 tx=0x7fe704009040 comp rx=0 tx=0).stop 2023-11-28T16:57:43.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71415ba00 msgr2=0x7fe714146ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71415ba00 0x7fe714146ce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe70c01a550 tx=0x7fe70c0196c0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 shutdown_connections 2023-11-28T16:57:43.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71415ba00 0x7fe714146ce0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe714156500 0x7fe7141467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7000668d0 0x7fe700068d90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 --2- 172.21.15.26:0/716654828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71406d980 0x7fe71415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 >> 172.21.15.26:0/716654828 conn(0x7fe7140c2ad0 msgr2=0x7fe7141506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:43.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 shutdown_connections 2023-11-28T16:57:43.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.093+0000 7fe7199b8640 1 -- 172.21.15.26:0/716654828 wait complete. 2023-11-28T16:57:43.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.257+0000 7fb3ef965640 1 Processor -- start 2023-11-28T16:57:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.257+0000 7fb3ef965640 1 -- start start 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.257+0000 7fb3ef965640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3e814ea60 0x7fb3e8155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ef965640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3e80bf400 0x7fb3e80c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ef965640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e806c440 con 0x7fb3e806bd00 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ef965640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e8154790 con 0x7fb3e814ea60 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ef965640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e806c6e0 con 0x7fb3e80bf400 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3e814ea60 0x7fb3e8155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3e814ea60 0x7fb3e8155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58060/0 (socket says 172.21.15.26:58060) 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 -- 172.21.15.26:0/1427167404 learned_addr learned my addr 172.21.15.26:0/1427167404 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3edf02640 1 --2- 172.21.15.26:0/1427167404 >> v2:172.21.15.79:3300/0 conn(0x7fb3e80bf400 0x7fb3e80c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 -- 172.21.15.26:0/1427167404 >> v2:172.21.15.79:3300/0 conn(0x7fb3e80bf400 msgr2=0x7fb3e80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 --2- 172.21.15.26:0/1427167404 >> v2:172.21.15.79:3300/0 conn(0x7fb3e80bf400 0x7fb3e80c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 -- 172.21.15.26:0/1427167404 >> v1:172.21.15.79:6789/0 conn(0x7fb3e806bd00 legacy=0x7fb3e80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 -- 172.21.15.26:0/1427167404 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8154a50 con 0x7fb3e814ea60 2023-11-28T16:57:43.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.261+0000 7fb3ed701640 1 --2- 172.21.15.26:0/1427167404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e8155250 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb3e806b8d0 tx=0x7fb3e401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340bdfa61ee150ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3dffff640 1 -- 172.21.15.26:0/1427167404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40ac630 con 0x7fb3e814ea60 2023-11-28T16:57:43.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3dffff640 1 -- 172.21.15.26:0/1427167404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e40ac790 con 0x7fb3e814ea60 2023-11-28T16:57:43.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3dffff640 1 -- 172.21.15.26:0/1427167404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40acb20 con 0x7fb3e814ea60 2023-11-28T16:57:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- 172.21.15.26:0/1427167404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 msgr2=0x7fb3e8155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 --2- 172.21.15.26:0/1427167404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e8155250 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb3e806b8d0 tx=0x7fb3e401c3b0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- 172.21.15.26:0/1427167404 shutdown_connections 2023-11-28T16:57:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 --2- 172.21.15.26:0/1427167404 >> v2:172.21.15.79:3300/0 conn(0x7fb3e80bf400 0x7fb3e80c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 --2- 172.21.15.26:0/1427167404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e8155250 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- 172.21.15.26:0/1427167404 >> 172.21.15.26:0/1427167404 conn(0x7fb3e80c2ad0 msgr2=0x7fb3e80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- 172.21.15.26:0/1427167404 shutdown_connections 2023-11-28T16:57:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- 172.21.15.26:0/1427167404 wait complete. 2023-11-28T16:57:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 Processor -- start 2023-11-28T16:57:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- start start 2023-11-28T16:57:43.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3e806bd00 0x7fb3e8147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3e80bf400 0x7fb3e814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e806d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8144760 con 0x7fb3e814ea60 2023-11-28T16:57:43.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8147c50 con 0x7fb3e806bd00 2023-11-28T16:57:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ef965640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e81f1310 con 0x7fb3e80bf400 2023-11-28T16:57:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3edf02640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e806d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3edf02640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e806d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58068/0 (socket says 172.21.15.26:58068) 2023-11-28T16:57:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3edf02640 1 -- 172.21.15.26:0/3058889814 learned_addr learned my addr 172.21.15.26:0/3058889814 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ed701640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3e806bd00 0x7fb3e8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.265+0000 7fb3ecf00640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3e80bf400 0x7fb3e814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3edf02640 1 -- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3e80bf400 msgr2=0x7fb3e814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3edf02640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3e80bf400 0x7fb3e814f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3edf02640 1 -- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3e806bd00 msgr2=0x7fb3e8147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3edf02640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3e806bd00 0x7fb3e8147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3edf02640 1 -- 172.21.15.26:0/3058889814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e40094d0 con 0x7fb3e814ea60 2023-11-28T16:57:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ecf00640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3e80bf400 0x7fb3e814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3edf02640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e806d5a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009dd0 tx=0x7fb3e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ddffb640 1 -- 172.21.15.26:0/3058889814 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0014480 con 0x7fb3e814ea60 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ddffb640 1 -- 172.21.15.26:0/3058889814 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000f040 con 0x7fb3e814ea60 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ddffb640 1 -- 172.21.15.26:0/3058889814 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0014840 con 0x7fb3e814ea60 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e81f17a0 con 0x7fb3e814ea60 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e81f09e0 con 0x7fb3e814ea60 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e81f14a0 con 0x7fb3e814ea60 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ddffb640 1 -- 172.21.15.26:0/3058889814 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb3e00149a0 con 0x7fb3e814ea60 2023-11-28T16:57:43.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.269+0000 7fb3ddffb640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb3cc0668d0 0x7fb3cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.273+0000 7fb3ddffb640 1 -- 172.21.15.26:0/3058889814 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb3e0085290 con 0x7fb3e814ea60 2023-11-28T16:57:43.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.273+0000 7fb3ed701640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb3cc0668d0 0x7fb3cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.273+0000 7fb3ed701640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb3cc0668d0 0x7fb3cc068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ae000 tx=0x7fb3e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.273+0000 7fb3ddffb640 1 -- 172.21.15.26:0/3058889814 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3e0052470 con 0x7fb3e814ea60 2023-11-28T16:57:43.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.465+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3e804e890 con 0x7fb3e814ea60 2023-11-28T16:57:43.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.465+0000 7fb3ddffb640 1 -- 172.21.15.26:0/3058889814 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4915 (secure 0 0 0) 0x7fb3e0055a90 con 0x7fb3e814ea60 2023-11-28T16:57:43.470 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:43.470 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2342692077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2342692077},{"type":"v1","addr":"172.21.15.26:6835","nonce":2342692077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:16.699781+0000","modified":"2023-11-28T16:57:19.712365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6833/1849708598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1849708598},{"type":"v1","addr":"172.21.15.26:6833","nonce":1849708598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T16:57:43.470 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb3cc0668d0 msgr2=0x7fb3cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb3cc0668d0 0x7fb3cc068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ae000 tx=0x7fb3e4008040 comp rx=0 tx=0).stop 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 msgr2=0x7fb3e806d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e806d5a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009dd0 tx=0x7fb3e000c490 comp rx=0 tx=0).stop 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 shutdown_connections 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e814ea60 0x7fb3e806d5a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb3cc0668d0 0x7fb3cc068d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb3e80bf400 0x7fb3e814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 --2- 172.21.15.26:0/3058889814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3e806bd00 0x7fb3e8147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 >> 172.21.15.26:0/3058889814 conn(0x7fb3e80c2ad0 msgr2=0x7fb3e814dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:43.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 shutdown_connections 2023-11-28T16:57:43.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.469+0000 7fb3ef965640 1 -- 172.21.15.26:0/3058889814 wait complete. 2023-11-28T16:57:43.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:43.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49bb432640 1 Processor -- start 2023-11-28T16:57:43.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49bb432640 1 -- start start 2023-11-28T16:57:43.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49bb432640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49b40bd720 0x7f49b4158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49bb432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b406cd90 0x7f49b4158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49bb432640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b4155790 con 0x7f49b40ca610 2023-11-28T16:57:43.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49bb432640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40c4b00 con 0x7f49b40bd720 2023-11-28T16:57:43.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49bb432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c4de0 con 0x7f49b406cd90 2023-11-28T16:57:43.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b89cd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49b40bd720 0x7f49b4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b91ce640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f49b40ca610 0x7f49b40c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52912/0 (socket says 172.21.15.26:52912) 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b91ce640 1 -- 172.21.15.26:0/2188961388 learned_addr learned my addr 172.21.15.26:0/2188961388 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b99cf640 1 --2- 172.21.15.26:0/2188961388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b406cd90 0x7f49b4158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b89cd640 1 -- 172.21.15.26:0/2188961388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b406cd90 msgr2=0x7f49b4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b89cd640 1 --2- 172.21.15.26:0/2188961388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b406cd90 0x7f49b4158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49abfff640 1 -- 172.21.15.26:0/2188961388 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973018858 0 0) 0x7f49b4155790 con 0x7f49b40ca610 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b89cd640 1 -- 172.21.15.26:0/2188961388 >> v1:172.21.15.26:6789/0 conn(0x7f49b40ca610 legacy=0x7f49b40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.633+0000 7f49b89cd640 1 -- 172.21.15.26:0/2188961388 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4157e30 con 0x7f49b40bd720 2023-11-28T16:57:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49b89cd640 1 --2- 172.21.15.26:0/2188961388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40bd720 0x7f49b4158350 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f49a40097c0 tx=0x7f49a401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2725f3d03cbc9594 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49abfff640 1 -- 172.21.15.26:0/2188961388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40c52d0 con 0x7f49b40bd720 2023-11-28T16:57:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49abfff640 1 -- 172.21.15.26:0/2188961388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a40a7050 con 0x7f49b40bd720 2023-11-28T16:57:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49abfff640 1 -- 172.21.15.26:0/2188961388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40ab820 con 0x7f49b40bd720 2023-11-28T16:57:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 -- 172.21.15.26:0/2188961388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40bd720 msgr2=0x7f49b4158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 --2- 172.21.15.26:0/2188961388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40bd720 0x7f49b4158350 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f49a40097c0 tx=0x7f49a401c360 comp rx=0 tx=0).stop 2023-11-28T16:57:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 -- 172.21.15.26:0/2188961388 shutdown_connections 2023-11-28T16:57:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 --2- 172.21.15.26:0/2188961388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b406cd90 0x7f49b4158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 --2- 172.21.15.26:0/2188961388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40bd720 0x7f49b4158350 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 -- 172.21.15.26:0/2188961388 >> 172.21.15.26:0/2188961388 conn(0x7f49b4071ea0 msgr2=0x7f49b40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:43.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 -- 172.21.15.26:0/2188961388 shutdown_connections 2023-11-28T16:57:43.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.637+0000 7f49bb432640 1 -- 172.21.15.26:0/2188961388 wait complete. 2023-11-28T16:57:43.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 Processor -- start 2023-11-28T16:57:43.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 -- start start 2023-11-28T16:57:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b406cd90 0x7f49b414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b40bd720 0x7f49b40ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40ca610 0x7f49b40ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4150330 con 0x7f49b40ca610 2023-11-28T16:57:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c11c0 con 0x7f49b406cd90 2023-11-28T16:57:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b41ed9d0 con 0x7f49b40bd720 2023-11-28T16:57:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40ca610 0x7f49b40ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40ca610 0x7f49b40ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58082/0 (socket says 172.21.15.26:58082) 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 -- 172.21.15.26:0/904376215 learned_addr learned my addr 172.21.15.26:0/904376215 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b91ce640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b406cd90 0x7f49b414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b89cd640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b40bd720 0x7f49b40ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 -- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b40bd720 msgr2=0x7f49b40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b40bd720 0x7f49b40ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 -- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b406cd90 msgr2=0x7f49b414c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b406cd90 0x7f49b414c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 -- 172.21.15.26:0/904376215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a4009420 con 0x7f49b40ca610 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49b99cf640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40ca610 0x7f49b40ac710 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00efc0 tx=0x7f49ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49a9ffb640 1 -- 172.21.15.26:0/904376215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac014480 con 0x7f49b40ca610 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49a9ffb640 1 -- 172.21.15.26:0/904376215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00f040 con 0x7f49b40ca610 2023-11-28T16:57:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49a9ffb640 1 -- 172.21.15.26:0/904376215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac014820 con 0x7f49b40ca610 2023-11-28T16:57:43.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b41edcb0 con 0x7f49b40ca610 2023-11-28T16:57:43.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.641+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b40c14a0 con 0x7f49b40ca610 2023-11-28T16:57:43.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.645+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b404e890 con 0x7f49b40ca610 2023-11-28T16:57:43.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.645+0000 7f49a9ffb640 1 -- 172.21.15.26:0/904376215 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f49ac014980 con 0x7f49b40ca610 2023-11-28T16:57:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.645+0000 7f49a9ffb640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49980668d0 0x7f4998068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.645+0000 7f49a9ffb640 1 -- 172.21.15.26:0/904376215 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f49ac084e10 con 0x7f49b40ca610 2023-11-28T16:57:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.645+0000 7f49b91ce640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49980668d0 0x7f4998068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.645+0000 7f49b91ce640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49980668d0 0x7f4998068d90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49b0000f70 tx=0x7f49b0007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.649+0000 7f49a9ffb640 1 -- 172.21.15.26:0/904376215 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49ac052130 con 0x7f49b40ca610 2023-11-28T16:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49b406cb70 con 0x7f49b40ca610 2023-11-28T16:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49a9ffb640 1 -- 172.21.15.26:0/904376215 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16572 (secure 0 0 0) 0x7f49ac055750 con 0x7f49b40ca610 2023-11-28T16:57:43.812 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:43.812 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:40.602213+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:57:14.412799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:57:15.689901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/756252810":"2023-11-29T16:57:37.594896+0000","172.21.15.26:6834/756252810":"2023-11-29T16:57:37.594896+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49980668d0 msgr2=0x7f4998068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49980668d0 0x7f4998068d90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49b0000f70 tx=0x7f49b0007df0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40ca610 msgr2=0x7f49b40ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40ca610 0x7f49b40ac710 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00efc0 tx=0x7f49ac00c490 comp rx=0 tx=0).stop 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 shutdown_connections 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49b40ca610 0x7f49b40ac710 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49980668d0 0x7f4998068d90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49b40bd720 0x7f49b40ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.809+0000 7f49bb432640 1 --2- 172.21.15.26:0/904376215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b406cd90 0x7f49b414c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.813+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 >> 172.21.15.26:0/904376215 conn(0x7f49b4071ea0 msgr2=0x7f49b4072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.813+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 shutdown_connections 2023-11-28T16:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.813+0000 7f49bb432640 1 -- 172.21.15.26:0/904376215 wait complete. 2023-11-28T16:57:43.834 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-28T16:57:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78c0c9640 1 Processor -- start 2023-11-28T16:57:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78c0c9640 1 -- start start 2023-11-28T16:57:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78c0c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc784070b80 0x7fc784151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78c0c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7840a8470 0x7fc78406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78c0c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78406d320 con 0x7fc78414e9d0 2023-11-28T16:57:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78c0c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7840721b0 con 0x7fc784070b80 2023-11-28T16:57:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78c0c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840c2830 con 0x7fc7840a8470 2023-11-28T16:57:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789664640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc784070b80 0x7fc784151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789664640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc784070b80 0x7fc784151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58086/0 (socket says 172.21.15.26:58086) 2023-11-28T16:57:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789e65640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc78414e9d0 0x7fc7840c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52926/0 (socket says 172.21.15.26:52926) 2023-11-28T16:57:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789664640 1 -- 172.21.15.26:0/3369725059 learned_addr learned my addr 172.21.15.26:0/3369725059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78a666640 1 --2- 172.21.15.26:0/3369725059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7840a8470 0x7fc78406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789664640 1 -- 172.21.15.26:0/3369725059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7840a8470 msgr2=0x7fc78406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789664640 1 --2- 172.21.15.26:0/3369725059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7840a8470 0x7fc78406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789664640 1 -- 172.21.15.26:0/3369725059 >> v1:172.21.15.26:6789/0 conn(0x7fc78414e9d0 legacy=0x7fc7840c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc789664640 1 -- 172.21.15.26:0/3369725059 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784072450 con 0x7fc784070b80 2023-11-28T16:57:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.977+0000 7fc78a666640 1 --2- 172.21.15.26:0/3369725059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7840a8470 0x7fc78406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:43.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc789664640 1 --2- 172.21.15.26:0/3369725059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc784070b80 0x7fc784151e60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc774009870 tx=0x7fc77401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27dad02e7e056bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc788e63640 1 -- 172.21.15.26:0/3369725059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7740ac620 con 0x7fc784070b80 2023-11-28T16:57:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc788e63640 1 -- 172.21.15.26:0/3369725059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7740ac780 con 0x7fc784070b80 2023-11-28T16:57:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc788e63640 1 -- 172.21.15.26:0/3369725059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7740acb10 con 0x7fc784070b80 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3369725059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc784070b80 msgr2=0x7fc784151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3369725059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc784070b80 0x7fc784151e60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc774009870 tx=0x7fc77401c4b0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3369725059 shutdown_connections 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3369725059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7840a8470 0x7fc78406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3369725059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc784070b80 0x7fc784151e60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3369725059 >> 172.21.15.26:0/3369725059 conn(0x7fc7840c2ad0 msgr2=0x7fc7840c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3369725059 shutdown_connections 2023-11-28T16:57:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.981+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3369725059 wait complete. 2023-11-28T16:57:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 Processor -- start 2023-11-28T16:57:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 -- start start 2023-11-28T16:57:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc784070b80 0x7fc78414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840a8470 0x7fc78414a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc78414e9d0 0x7fc784147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc784153b60 con 0x7fc78414e9d0 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc784152560 con 0x7fc7840a8470 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841527b0 con 0x7fc784070b80 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc78414e9d0 0x7fc784147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc78414e9d0 0x7fc784147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58102/0 (socket says 172.21.15.26:58102) 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 -- 172.21.15.26:0/3393652343 learned_addr learned my addr 172.21.15.26:0/3393652343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc789e65640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc784070b80 0x7fc78414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 -- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc784070b80 msgr2=0x7fc78414dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc784070b80 0x7fc78414dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 -- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840a8470 msgr2=0x7fc78414a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840a8470 0x7fc78414a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 -- 172.21.15.26:0/3393652343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7740094d0 con 0x7fc78414e9d0 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc789e65640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc784070b80 0x7fc78414dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78a666640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc78414e9d0 0x7fc784147820 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00cea0 tx=0x7fc77c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc77a7fc640 1 -- 172.21.15.26:0/3393652343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c003ba0 con 0x7fc78414e9d0 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc77a7fc640 1 -- 172.21.15.26:0/3393652343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c003d20 con 0x7fc78414e9d0 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc77a7fc640 1 -- 172.21.15.26:0/3393652343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00d880 con 0x7fc78414e9d0 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7841552b0 con 0x7fc78414e9d0 2023-11-28T16:57:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78414a610 con 0x7fc78414e9d0 2023-11-28T16:57:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.985+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78404e890 con 0x7fc78414e9d0 2023-11-28T16:57:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.989+0000 7fc77a7fc640 1 -- 172.21.15.26:0/3393652343 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc77c00d9e0 con 0x7fc78414e9d0 2023-11-28T16:57:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.989+0000 7fc77a7fc640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7680668d0 0x7fc768068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.989+0000 7fc77a7fc640 1 -- 172.21.15.26:0/3393652343 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc77c084de0 con 0x7fc78414e9d0 2023-11-28T16:57:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.989+0000 7fc789e65640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7680668d0 0x7fc768068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.989+0000 7fc789e65640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7680668d0 0x7fc768068d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc780000f70 tx=0x7fc780009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:43.993+0000 7fc77a7fc640 1 -- 172.21.15.26:0/3393652343 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc77c051fb0 con 0x7fc78414e9d0 2023-11-28T16:57:44.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.185+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fc784155760 con 0x7fc78414e9d0 2023-11-28T16:57:44.188 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-11-28T16:57:44.185+0000 7fcd77275640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T16:57:44.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc77a7fc640 1 -- 172.21.15.26:0/3393652343 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc77c0555d0 con 0x7fc78414e9d0 2023-11-28T16:57:44.190 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T16:57:44.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7680668d0 msgr2=0x7fc768068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:44.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7680668d0 0x7fc768068d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc780000f70 tx=0x7fc780009040 comp rx=0 tx=0).stop 2023-11-28T16:57:44.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc78414e9d0 msgr2=0x7fc784147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:44.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc78414e9d0 0x7fc784147820 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00cea0 tx=0x7fc77c00cf90 comp rx=0 tx=0).stop 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 shutdown_connections 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc78414e9d0 0x7fc784147820 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840a8470 0x7fc78414a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7680668d0 0x7fc768068d90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 --2- 172.21.15.26:0/3393652343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc784070b80 0x7fc78414dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 >> 172.21.15.26:0/3393652343 conn(0x7fc7840c2ad0 msgr2=0x7fc78414ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 shutdown_connections 2023-11-28T16:57:44.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.189+0000 7fc78c0c9640 1 -- 172.21.15.26:0/3393652343 wait complete. 2023-11-28T16:57:44.200 INFO:tasks.ceph.mds.a.smithi026.stderr: -1924> 2023-11-28T16:57:21.841+0000 7f2ac441b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:57:44.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-28T16:57:44.245 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-11-28T16:57:44.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 Processor -- start 2023-11-28T16:57:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 -- start start 2023-11-28T16:57:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc381561d0 0x7fbc380701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc38070760 0x7fbc3806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc38158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38071020 con 0x7fbc38070760 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38071300 con 0x7fbc381561d0 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.361+0000 7fbc3f757640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380715e0 con 0x7fbc3806df20 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc38070760 0x7fbc3806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc38070760 0x7fbc3806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58130/0 (socket says 172.21.15.26:58130) 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/1429740457 learned_addr learned my addr 172.21.15.26:0/1429740457 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3d4f3640 1 --2- 172.21.15.26:0/1429740457 >> v2:172.21.15.79:3300/0 conn(0x7fbc381561d0 0x7fbc380701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3dcf4640 1 --2- 172.21.15.26:0/1429740457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc38158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/1429740457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 msgr2=0x7fbc38158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 --2- 172.21.15.26:0/1429740457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc38158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/1429740457 >> v2:172.21.15.79:3300/0 conn(0x7fbc381561d0 msgr2=0x7fbc380701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 --2- 172.21.15.26:0/1429740457 >> v2:172.21.15.79:3300/0 conn(0x7fbc381561d0 0x7fbc380701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/1429740457 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380718c0 con 0x7fbc38070760 2023-11-28T16:57:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3dcf4640 1 --2- 172.21.15.26:0/1429740457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc38158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3d4f3640 1 --2- 172.21.15.26:0/1429740457 >> v2:172.21.15.79:3300/0 conn(0x7fbc381561d0 0x7fbc380701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc3ccf2640 1 --2- 172.21.15.26:0/1429740457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc3806d9e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbc380c6f00 tx=0x7fbc2801ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b95d6a90629dbfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc2ffff640 1 -- 172.21.15.26:0/1429740457 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280ab600 con 0x7fbc38070760 2023-11-28T16:57:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc2ffff640 1 -- 172.21.15.26:0/1429740457 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280a7050 con 0x7fbc38070760 2023-11-28T16:57:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.365+0000 7fbc2ffff640 1 -- 172.21.15.26:0/1429740457 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280ab980 con 0x7fbc38070760 2023-11-28T16:57:44.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- 172.21.15.26:0/1429740457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 msgr2=0x7fbc3806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 --2- 172.21.15.26:0/1429740457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc3806d9e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbc380c6f00 tx=0x7fbc2801ced0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- 172.21.15.26:0/1429740457 shutdown_connections 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 --2- 172.21.15.26:0/1429740457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc38158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 --2- 172.21.15.26:0/1429740457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc3806d9e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 --2- 172.21.15.26:0/1429740457 >> v2:172.21.15.79:3300/0 conn(0x7fbc381561d0 0x7fbc380701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- 172.21.15.26:0/1429740457 >> 172.21.15.26:0/1429740457 conn(0x7fbc380c2a60 msgr2=0x7fbc380c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- 172.21.15.26:0/1429740457 shutdown_connections 2023-11-28T16:57:44.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- 172.21.15.26:0/1429740457 wait complete. 2023-11-28T16:57:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 Processor -- start 2023-11-28T16:57:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- start start 2023-11-28T16:57:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc380c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc380c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:44.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc381561d0 0x7fbc38141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:44.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380c4e20 con 0x7fbc38070760 2023-11-28T16:57:44.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381f5430 con 0x7fbc381561d0 2023-11-28T16:57:44.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3f757640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38143590 con 0x7fbc3806df20 2023-11-28T16:57:44.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc380c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:44.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc380c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58140/0 (socket says 172.21.15.26:58140) 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/2385222615 learned_addr learned my addr 172.21.15.26:0/2385222615 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3d4f3640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc380c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3dcf4640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc381561d0 0x7fbc38141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 msgr2=0x7fbc380c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc380c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc381561d0 msgr2=0x7fbc38141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc381561d0 0x7fbc38141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 -- 172.21.15.26:0/2385222615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280094d0 con 0x7fbc38070760 2023-11-28T16:57:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.369+0000 7fbc3ccf2640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc380c3db0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbc2801cd10 tx=0x7fbc28019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc2dffb640 1 -- 172.21.15.26:0/2385222615 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280ac220 con 0x7fbc38070760 2023-11-28T16:57:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc2dffb640 1 -- 172.21.15.26:0/2385222615 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280aa5b0 con 0x7fbc38070760 2023-11-28T16:57:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc2dffb640 1 -- 172.21.15.26:0/2385222615 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280aa960 con 0x7fbc38070760 2023-11-28T16:57:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc38143a20 con 0x7fbc38070760 2023-11-28T16:57:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc381f5620 con 0x7fbc38070760 2023-11-28T16:57:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3804e890 con 0x7fbc38070760 2023-11-28T16:57:44.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc2dffb640 1 -- 172.21.15.26:0/2385222615 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbc280b2070 con 0x7fbc38070760 2023-11-28T16:57:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc2dffb640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc1c0668d0 0x7fbc1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.373+0000 7fbc2dffb640 1 -- 172.21.15.26:0/2385222615 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fbc2811e120 con 0x7fbc38070760 2023-11-28T16:57:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.377+0000 7fbc3d4f3640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc1c0668d0 0x7fbc1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.377+0000 7fbc3d4f3640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc1c0668d0 0x7fbc1c068d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006e90 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.377+0000 7fbc2dffb640 1 -- 172.21.15.26:0/2385222615 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc280eb3f0 con 0x7fbc38070760 2023-11-28T16:57:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:44.569+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbc380c2770 con 0x7fbc38070760 2023-11-28T16:57:45.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.189+0000 7fbc2dffb640 1 -- 172.21.15.26:0/2385222615 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 105+0+0 (secure 0 0 0) 0x7fbc280eea10 con 0x7fbc38070760 2023-11-28T16:57:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc1c0668d0 msgr2=0x7fbc1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc1c0668d0 0x7fbc1c068d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006e90 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 msgr2=0x7fbc380c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc380c3db0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbc2801cd10 tx=0x7fbc28019210 comp rx=0 tx=0).stop 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 shutdown_connections 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc381561d0 0x7fbc38141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc38070760 0x7fbc380c3db0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbc1c0668d0 0x7fbc1c068d90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 --2- 172.21.15.26:0/2385222615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc3806df20 0x7fbc380c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 >> 172.21.15.26:0/2385222615 conn(0x7fbc380c2a60 msgr2=0x7fbc38146a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 shutdown_connections 2023-11-28T16:57:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.193+0000 7fbc3f757640 1 -- 172.21.15.26:0/2385222615 wait complete. 2023-11-28T16:57:45.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-28T16:57:45.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.405+0000 7f0dc9de6640 1 Processor -- start 2023-11-28T16:57:45.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.405+0000 7f0dc9de6640 1 -- start start 2023-11-28T16:57:45.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc9de6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 0x7f0dc4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc9de6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc414e770 con 0x7f0dc414e390 2023-11-28T16:57:45.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc9de6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc406b2e0 con 0x7f0dc40abde0 2023-11-28T16:57:45.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc9de6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40c2a80 con 0x7f0dc40c2610 2023-11-28T16:57:45.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0dc414e390 0x7f0dc40c1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52930/0 (socket says 172.21.15.26:52930) 2023-11-28T16:57:45.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 -- 172.21.15.26:0/3145231575 learned_addr learned my addr 172.21.15.26:0/3145231575 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:45.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc3fff640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 0x7f0dc4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052762272 0 0) 0x7f0dc414e770 con 0x7f0dc414e390 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dac003450 con 0x7f0dc414e390 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521637495 0 0) 0x7f0dc406b2e0 con 0x7f0dc40abde0 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc414e770 con 0x7f0dc40abde0 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726104580 0 0) 0x7f0dac003450 con 0x7f0dc414e390 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 msgr2=0x7f0dc4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 0x7f0dc4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 >> v1:172.21.15.79:6789/0 conn(0x7f0dc40abde0 legacy=0x7f0dc41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc41518d0 con 0x7f0dc414e390 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f0db4001680 con 0x7f0dc414e390 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 >> v1:172.21.15.26:6789/0 conn(0x7f0dc414e390 legacy=0x7f0dc40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dac003c30 0x7f0dac008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac004110 0x7f0dac00adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 0x7f0dac00d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40c2a80 con 0x7f0dac003c30 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac00dcb0 con 0x7f0dac004110 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac00de70 con 0x7f0dc40c2610 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dac003c30 0x7f0dac008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc2ffd640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac004110 0x7f0dac00adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc3fff640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 0x7f0dac00d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 -- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 msgr2=0x7f0dac00d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c2610 0x7f0dac00d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 -- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac004110 msgr2=0x7f0dac00adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac004110 0x7f0dac00adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.409+0000 7f0dc37fe640 1 -- 172.21.15.26:0/3145231575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac003450 con 0x7f0dac003c30 2023-11-28T16:57:45.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc37fe640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dac003c30 0x7f0dac008860 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c160 tx=0x7f0db401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1724a35bf02fa5fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:45.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40058e0 con 0x7f0dac003c30 2023-11-28T16:57:45.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4005a60 con 0x7f0dac003c30 2023-11-28T16:57:45.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc27fc640 1 -- 172.21.15.26:0/3145231575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4005e10 con 0x7f0dac003c30 2023-11-28T16:57:45.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc9de6640 1 -- 172.21.15.26:0/3145231575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dac003c30 msgr2=0x7f0dac008860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:45.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc9de6640 1 --2- 172.21.15.26:0/3145231575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dac003c30 0x7f0dac008860 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c160 tx=0x7f0db401cb90 comp rx=0 tx=0).stop 2023-11-28T16:57:45.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc3fff640 1 -- 172.21.15.26:0/3145231575 reap_dead start 2023-11-28T16:57:45.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc9de6640 1 -- 172.21.15.26:0/3145231575 shutdown_connections 2023-11-28T16:57:45.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc9de6640 1 -- 172.21.15.26:0/3145231575 >> 172.21.15.26:0/3145231575 conn(0x7f0dc406a5a0 msgr2=0x7f0dc406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:45.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc9de6640 1 -- 172.21.15.26:0/3145231575 shutdown_connections 2023-11-28T16:57:45.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.413+0000 7f0dc9de6640 1 -- 172.21.15.26:0/3145231575 wait complete. 2023-11-28T16:57:45.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 Processor -- start 2023-11-28T16:57:45.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 -- start start 2023-11-28T16:57:45.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac003c30 0x7f0dc41f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c3d60 0x7f0dc40bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc41534e0 0x7f0dc4153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc41461e0 con 0x7f0dc41534e0 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40c5b30 con 0x7f0dac003c30 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40c5e10 con 0x7f0dc40c3d60 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc41534e0 0x7f0dc4153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc41534e0 0x7f0dc4153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58158/0 (socket says 172.21.15.26:58158) 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 -- 172.21.15.26:0/1084275799 learned_addr learned my addr 172.21.15.26:0/1084275799 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc37fe640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac003c30 0x7f0dc41f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc2ffd640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c3d60 0x7f0dc40bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 -- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c3d60 msgr2=0x7f0dc40bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:45.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c3d60 0x7f0dc40bf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 -- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac003c30 msgr2=0x7f0dc41f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:45.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac003c30 0x7f0dc41f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:45.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 -- 172.21.15.26:0/1084275799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc41459e0 con 0x7f0dc41534e0 2023-11-28T16:57:45.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc3fff640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc41534e0 0x7f0dc4153960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4151800 tx=0x7f0dbc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:45.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dabfff640 1 -- 172.21.15.26:0/1084275799 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00e040 con 0x7f0dc41534e0 2023-11-28T16:57:45.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dabfff640 1 -- 172.21.15.26:0/1084275799 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00f040 con 0x7f0dc41534e0 2023-11-28T16:57:45.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dabfff640 1 -- 172.21.15.26:0/1084275799 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc015670 con 0x7f0dc41534e0 2023-11-28T16:57:45.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc4145cc0 con 0x7f0dc41534e0 2023-11-28T16:57:45.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.417+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc40bfd40 con 0x7f0dc41534e0 2023-11-28T16:57:45.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.421+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc404e890 con 0x7f0dc41534e0 2023-11-28T16:57:45.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.421+0000 7f0dabfff640 1 -- 172.21.15.26:0/1084275799 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0dbc0157d0 con 0x7f0dc41534e0 2023-11-28T16:57:45.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.421+0000 7f0dabfff640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0db00668d0 0x7f0db0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:45.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.421+0000 7f0dabfff640 1 -- 172.21.15.26:0/1084275799 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f0dbc084e60 con 0x7f0dc41534e0 2023-11-28T16:57:45.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.421+0000 7f0dc37fe640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0db00668d0 0x7f0db0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:45.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.421+0000 7f0dc37fe640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0db00668d0 0x7f0db0068d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0db40aa000 tx=0x7f0db4001a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:45.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.425+0000 7f0dabfff640 1 -- 172.21.15.26:0/1084275799 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0dbc051fe0 con 0x7f0dc41534e0 2023-11-28T16:57:45.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:45.585+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0dc40c23f0 con 0x7f0dc41534e0 2023-11-28T16:57:46.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.197+0000 7f0dabfff640 1 -- 172.21.15.26:0/1084275799 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0dbc055600 con 0x7f0dc41534e0 2023-11-28T16:57:46.202 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_metadata' removed 2023-11-28T16:57:46.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0db00668d0 msgr2=0x7f0db0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:46.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0db00668d0 0x7f0db0068d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0db40aa000 tx=0x7f0db4001a00 comp rx=0 tx=0).stop 2023-11-28T16:57:46.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc41534e0 msgr2=0x7f0dc4153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:46.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc41534e0 0x7f0dc4153960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4151800 tx=0x7f0dbc00f580 comp rx=0 tx=0).stop 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 shutdown_connections 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc41534e0 0x7f0dc4153960 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0db00668d0 0x7f0db0068d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0dc40c3d60 0x7f0dc40bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 --2- 172.21.15.26:0/1084275799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dac003c30 0x7f0dc41f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 >> 172.21.15.26:0/1084275799 conn(0x7f0dc406a5a0 msgr2=0x7f0dc414bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 shutdown_connections 2023-11-28T16:57:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.201+0000 7f0dc9de6640 1 -- 172.21.15.26:0/1084275799 wait complete. 2023-11-28T16:57:46.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-28T16:57:46.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f759b879640 1 Processor -- start 2023-11-28T16:57:46.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f759b879640 1 -- start start 2023-11-28T16:57:46.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f759b879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75940a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f759b879640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7594156740 0x7f75940c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f759b879640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75940abb60 con 0x7f75941562e0 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f759b879640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759406d620 con 0x7f7594156740 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f759b879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759406c7a0 con 0x7f7594155f00 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f7599e16640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7594156740 0x7f75940c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f7599e16640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7594156740 0x7f75940c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58174/0 (socket says 172.21.15.26:58174) 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.377+0000 7f7599e16640 1 -- 172.21.15.26:0/3415558378 learned_addr learned my addr 172.21.15.26:0/3415558378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f7599615640 1 --2- 172.21.15.26:0/3415558378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75940a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f7599e16640 1 -- 172.21.15.26:0/3415558378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 msgr2=0x7f75940a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f7599e16640 1 --2- 172.21.15.26:0/3415558378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75940a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f7599e16640 1 -- 172.21.15.26:0/3415558378 >> v1:172.21.15.79:6789/0 conn(0x7f75941562e0 legacy=0x7f759406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f7599e16640 1 -- 172.21.15.26:0/3415558378 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940abdb0 con 0x7f7594156740 2023-11-28T16:57:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f7599615640 1 --2- 172.21.15.26:0/3415558378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75940a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:46.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f7599e16640 1 --2- 172.21.15.26:0/3415558378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7594156740 0x7f75940c2070 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f758c009e50 tx=0x7f758c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d54f74cb54a094 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:46.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f758bfff640 1 -- 172.21.15.26:0/3415558378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0a55c0 con 0x7f7594156740 2023-11-28T16:57:46.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f758bfff640 1 -- 172.21.15.26:0/3415558378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0a5720 con 0x7f7594156740 2023-11-28T16:57:46.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f758bfff640 1 -- 172.21.15.26:0/3415558378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0a5ab0 con 0x7f7594156740 2023-11-28T16:57:46.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f759b879640 1 -- 172.21.15.26:0/3415558378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7594156740 msgr2=0x7f75940c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.381+0000 7f759b879640 1 --2- 172.21.15.26:0/3415558378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7594156740 0x7f75940c2070 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f758c009e50 tx=0x7f758c01c940 comp rx=0 tx=0).stop 2023-11-28T16:57:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- 172.21.15.26:0/3415558378 shutdown_connections 2023-11-28T16:57:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 --2- 172.21.15.26:0/3415558378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7594156740 0x7f75940c2070 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 --2- 172.21.15.26:0/3415558378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75940a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- 172.21.15.26:0/3415558378 >> 172.21.15.26:0/3415558378 conn(0x7f759406a5a0 msgr2=0x7f759406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- 172.21.15.26:0/3415558378 shutdown_connections 2023-11-28T16:57:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- 172.21.15.26:0/3415558378 wait complete. 2023-11-28T16:57:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 Processor -- start 2023-11-28T16:57:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- start start 2023-11-28T16:57:46.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75941f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:46.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75941562e0 0x7f75941ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7594156740 0x7f75940bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75941484a0 con 0x7f75941562e0 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75941f0b80 con 0x7f7594156740 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f759b879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75941f0530 con 0x7f7594155f00 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75941562e0 0x7f75941ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75941562e0 0x7f75941ecf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58178/0 (socket says 172.21.15.26:58178) 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 -- 172.21.15.26:0/227978121 learned_addr learned my addr 172.21.15.26:0/227978121 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7599615640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75941f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7599e16640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7594156740 0x7f75940bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 -- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 msgr2=0x7f75941f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75941f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 -- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7594156740 msgr2=0x7f75940bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7594156740 0x7f75940bf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 -- 172.21.15.26:0/227978121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009b30 con 0x7f75941562e0 2023-11-28T16:57:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7598e14640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75941562e0 0x7f75941ecf20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f758400b410 tx=0x7f758400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7589ffb640 1 -- 172.21.15.26:0/227978121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584004020 con 0x7f75941562e0 2023-11-28T16:57:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.385+0000 7f7589ffb640 1 -- 172.21.15.26:0/227978121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584004180 con 0x7f75941562e0 2023-11-28T16:57:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f7589ffb640 1 -- 172.21.15.26:0/227978121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584011630 con 0x7f75941562e0 2023-11-28T16:57:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75941f0810 con 0x7f75941562e0 2023-11-28T16:57:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75941554c0 con 0x7f75941562e0 2023-11-28T16:57:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75941f09a0 con 0x7f75941562e0 2023-11-28T16:57:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f7589ffb640 1 -- 172.21.15.26:0/227978121 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7584011790 con 0x7f75941562e0 2023-11-28T16:57:46.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f7589ffb640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7578066900 0x7f7578068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:46.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f7589ffb640 1 -- 172.21.15.26:0/227978121 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f7584083f50 con 0x7f75941562e0 2023-11-28T16:57:46.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f7599615640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7578066900 0x7f7578068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:46.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.389+0000 7f7599615640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7578066900 0x7f7578068dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7594148430 tx=0x7f7590008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:46.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.393+0000 7f7589ffb640 1 -- 172.21.15.26:0/227978121 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7584051330 con 0x7f75941562e0 2023-11-28T16:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:46.561+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75941f0cf0 con 0x7f75941562e0 2023-11-28T16:57:47.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.201+0000 7f7589ffb640 1 -- 172.21.15.26:0/227978121 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v42) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7584054950 con 0x7f75941562e0 2023-11-28T16:57:47.204 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_data' removed 2023-11-28T16:57:47.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7578066900 msgr2=0x7f7578068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7578066900 0x7f7578068dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7594148430 tx=0x7f7590008040 comp rx=0 tx=0).stop 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75941562e0 msgr2=0x7f75941ecf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75941562e0 0x7f75941ecf20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f758400b410 tx=0x7f758400b8d0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 shutdown_connections 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7594156740 0x7f75940bf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75941562e0 0x7f75941ecf20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7578066900 0x7f7578068dc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 --2- 172.21.15.26:0/227978121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7594155f00 0x7f75941f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.205+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 >> 172.21.15.26:0/227978121 conn(0x7f759406a5a0 msgr2=0x7f759415c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.209+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 shutdown_connections 2023-11-28T16:57:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.209+0000 7f759b879640 1 -- 172.21.15.26:0/227978121 wait complete. 2023-11-28T16:57:47.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T16:57:47.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 Processor -- start 2023-11-28T16:57:47.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 -- start start 2023-11-28T16:57:47.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6b00c4b30 0x7fb6b0155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b014e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6b014e750 0x7fb6b00c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b00abda0 con 0x7fb6b014e750 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b00c8360 con 0x7fb6b00c4b30 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.389+0000 7fb6b530f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00abff0 con 0x7fb6b00c7e50 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6b014e750 0x7fb6b00c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6b014e750 0x7fb6b00c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58190/0 (socket says 172.21.15.26:58190) 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4205501729 learned_addr learned my addr 172.21.15.26:0/4205501729 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6aeffd640 1 --2- 172.21.15.26:0/4205501729 >> v2:172.21.15.79:3300/0 conn(0x7fb6b00c4b30 0x7fb6b0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6a7fff640 1 --2- 172.21.15.26:0/4205501729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4205501729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 msgr2=0x7fb6b014e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 --2- 172.21.15.26:0/4205501729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b014e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4205501729 >> v2:172.21.15.79:3300/0 conn(0x7fb6b00c4b30 msgr2=0x7fb6b0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 --2- 172.21.15.26:0/4205501729 >> v2:172.21.15.79:3300/0 conn(0x7fb6b00c4b30 0x7fb6b0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4205501729 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00ac2d0 con 0x7fb6b014e750 2023-11-28T16:57:47.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6af7fe640 1 --2- 172.21.15.26:0/4205501729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00c6cf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00c7a70 tx=0x7fb6a801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbebb09d2d85181a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:47.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6ae7fc640 1 -- 172.21.15.26:0/4205501729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a57b0 con 0x7fb6b014e750 2023-11-28T16:57:47.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6ae7fc640 1 -- 172.21.15.26:0/4205501729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a80a5910 con 0x7fb6b014e750 2023-11-28T16:57:47.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.393+0000 7fb6ae7fc640 1 -- 172.21.15.26:0/4205501729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a5ca0 con 0x7fb6b014e750 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- 172.21.15.26:0/4205501729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 msgr2=0x7fb6b00c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4205501729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00c6cf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00c7a70 tx=0x7fb6a801c910 comp rx=0 tx=0).stop 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- 172.21.15.26:0/4205501729 shutdown_connections 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4205501729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00c6cf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4205501729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b014e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4205501729 >> v2:172.21.15.79:3300/0 conn(0x7fb6b00c4b30 0x7fb6b0155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- 172.21.15.26:0/4205501729 >> 172.21.15.26:0/4205501729 conn(0x7fb6b0071ea0 msgr2=0x7fb6b00722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- 172.21.15.26:0/4205501729 shutdown_connections 2023-11-28T16:57:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- 172.21.15.26:0/4205501729 wait complete. 2023-11-28T16:57:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 Processor -- start 2023-11-28T16:57:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- start start 2023-11-28T16:57:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b00c4b30 0x7fb6b014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b00c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00be4c0 con 0x7fb6b014e750 2023-11-28T16:57:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b01edf80 con 0x7fb6b00c4b30 2023-11-28T16:57:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6b530f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00c40e0 con 0x7fb6b00c7e50 2023-11-28T16:57:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6aeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b00c4b30 0x7fb6b014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58198/0 (socket says 172.21.15.26:58198) 2023-11-28T16:57:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4102537785 learned_addr learned my addr 172.21.15.26:0/4102537785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6a7fff640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b00c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 msgr2=0x7fb6b00c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b00c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b00c4b30 msgr2=0x7fb6b014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b00c4b30 0x7fb6b014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.397+0000 7fb6af7fe640 1 -- 172.21.15.26:0/4102537785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8009b30 con 0x7fb6b014e750 2023-11-28T16:57:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6af7fe640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00bfcf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80af040 tx=0x7fb6a80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6a77fe640 1 -- 172.21.15.26:0/4102537785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80b8670 con 0x7fb6b014e750 2023-11-28T16:57:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6a77fe640 1 -- 172.21.15.26:0/4102537785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a80b87d0 con 0x7fb6b014e750 2023-11-28T16:57:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6a77fe640 1 -- 172.21.15.26:0/4102537785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80b8b80 con 0x7fb6b014e750 2023-11-28T16:57:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b00bf5a0 con 0x7fb6b014e750 2023-11-28T16:57:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b00be100 con 0x7fb6b014e750 2023-11-28T16:57:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b0074970 con 0x7fb6b014e750 2023-11-28T16:57:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6a77fe640 1 -- 172.21.15.26:0/4102537785 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb6a80b8ce0 con 0x7fb6b014e750 2023-11-28T16:57:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6a77fe640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6900668d0 0x7fb690068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6a77fe640 1 -- 172.21.15.26:0/4102537785 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb6a811f4a0 con 0x7fb6b014e750 2023-11-28T16:57:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.401+0000 7fb6aeffd640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6900668d0 0x7fb690068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.405+0000 7fb6aeffd640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6900668d0 0x7fb690068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009a40 tx=0x7fb6a0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.405+0000 7fb6a77fe640 1 -- 172.21.15.26:0/4102537785 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6a80ecb80 con 0x7fb6b014e750 2023-11-28T16:57:47.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.573+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb6b006ca40 con 0x7fb6b014e750 2023-11-28T16:57:47.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.577+0000 7fb6a77fe640 1 -- 172.21.15.26:0/4102537785 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb6a8009510 con 0x7fb6b014e750 2023-11-28T16:57:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6900668d0 msgr2=0x7fb690068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6900668d0 0x7fb690068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009a40 tx=0x7fb6a0009190 comp rx=0 tx=0).stop 2023-11-28T16:57:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 msgr2=0x7fb6b00bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00bfcf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80af040 tx=0x7fb6a80196b0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 shutdown_connections 2023-11-28T16:57:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6b014e750 0x7fb6b00bfcf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6900668d0 0x7fb690068d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6b00c7e50 0x7fb6b00c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 --2- 172.21.15.26:0/4102537785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b00c4b30 0x7fb6b014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 >> 172.21.15.26:0/4102537785 conn(0x7fb6b0071ea0 msgr2=0x7fb6b00c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 shutdown_connections 2023-11-28T16:57:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.581+0000 7fb6b530f640 1 -- 172.21.15.26:0/4102537785 wait complete. 2023-11-28T16:57:47.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-28T16:57:47.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b48c6b640 1 Processor -- start 2023-11-28T16:57:47.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b48c6b640 1 -- start start 2023-11-28T16:57:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b48c6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b4414e9d0 0x7f6b44151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b48c6b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4406d320 con 0x7f6b44070b80 2023-11-28T16:57:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b48c6b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b440721b0 con 0x7f6b440a8470 2023-11-28T16:57:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b48c6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b440c2830 con 0x7f6b4414e9d0 2023-11-28T16:57:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b4259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b4414e9d0 0x7f6b44151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b3bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b44070b80 0x7f6b440c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52932/0 (socket says 172.21.15.26:52932) 2023-11-28T16:57:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b3bfff640 1 -- 172.21.15.26:0/1103709079 learned_addr learned my addr 172.21.15.26:0/1103709079 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b41d9b640 1 -- 172.21.15.26:0/1103709079 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166447117 0 0) 0x7f6b4406d320 con 0x7f6b44070b80 2023-11-28T16:57:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b41d9b640 1 -- 172.21.15.26:0/1103709079 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b30003530 con 0x7f6b44070b80 2023-11-28T16:57:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b4259c640 1 -- 172.21.15.26:0/1103709079 >> v1:172.21.15.79:6789/0 conn(0x7f6b440a8470 legacy=0x7f6b4406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b4259c640 1 -- 172.21.15.26:0/1103709079 >> v1:172.21.15.26:6789/0 conn(0x7f6b44070b80 legacy=0x7f6b440c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.745+0000 7f6b4259c640 1 -- 172.21.15.26:0/1103709079 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44072450 con 0x7f6b4414e9d0 2023-11-28T16:57:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b4259c640 1 --2- 172.21.15.26:0/1103709079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4414e9d0 0x7f6b44151e60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097c0 tx=0x7f6b3401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf10d7d01985147 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b41d9b640 1 -- 172.21.15.26:0/1103709079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340ab600 con 0x7f6b4414e9d0 2023-11-28T16:57:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b41d9b640 1 -- 172.21.15.26:0/1103709079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b340a7050 con 0x7f6b4414e9d0 2023-11-28T16:57:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b41d9b640 1 -- 172.21.15.26:0/1103709079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340ab980 con 0x7f6b4414e9d0 2023-11-28T16:57:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 -- 172.21.15.26:0/1103709079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4414e9d0 msgr2=0x7f6b44151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/1103709079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4414e9d0 0x7f6b44151e60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097c0 tx=0x7f6b3401c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 -- 172.21.15.26:0/1103709079 shutdown_connections 2023-11-28T16:57:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/1103709079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4414e9d0 0x7f6b44151e60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 -- 172.21.15.26:0/1103709079 >> 172.21.15.26:0/1103709079 conn(0x7f6b440c2ad0 msgr2=0x7f6b440c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 -- 172.21.15.26:0/1103709079 shutdown_connections 2023-11-28T16:57:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 -- 172.21.15.26:0/1103709079 wait complete. 2023-11-28T16:57:47.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.749+0000 7f6b48c6b640 1 Processor -- start 2023-11-28T16:57:47.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 -- start start 2023-11-28T16:57:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b44070b80 0x7f6b441ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b440a8470 0x7f6b440c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b4414e9d0 0x7f6b441527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b441edf50 con 0x7f6b44070b80 2023-11-28T16:57:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4414b890 con 0x7f6b4414e9d0 2023-11-28T16:57:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b441ee1f0 con 0x7f6b440a8470 2023-11-28T16:57:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b44070b80 0x7f6b441ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b44070b80 0x7f6b441ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58224/0 (socket says 172.21.15.26:58224) 2023-11-28T16:57:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 -- 172.21.15.26:0/4294077271 learned_addr learned my addr 172.21.15.26:0/4294077271 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 -- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b440a8470 msgr2=0x7f6b440c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b440a8470 0x7f6b440c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 -- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b4414e9d0 msgr2=0x7f6b441527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b4414e9d0 0x7f6b441527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 -- 172.21.15.26:0/4294077271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009420 con 0x7f6b44070b80 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b4259c640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b44070b80 0x7f6b441ee680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b34019000 tx=0x7f6b3401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b3affd640 1 -- 172.21.15.26:0/4294077271 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34006e20 con 0x7f6b44070b80 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b3affd640 1 -- 172.21.15.26:0/4294077271 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34004030 con 0x7f6b44070b80 2023-11-28T16:57:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b3affd640 1 -- 172.21.15.26:0/4294077271 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340043a0 con 0x7f6b44070b80 2023-11-28T16:57:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b441485e0 con 0x7f6b44070b80 2023-11-28T16:57:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4414bae0 con 0x7f6b44070b80 2023-11-28T16:57:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.753+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4414bd00 con 0x7f6b44070b80 2023-11-28T16:57:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.757+0000 7f6b3affd640 1 -- 172.21.15.26:0/4294077271 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6b34003620 con 0x7f6b44070b80 2023-11-28T16:57:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.757+0000 7f6b3affd640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6b240668d0 0x7f6b24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.757+0000 7f6b3affd640 1 -- 172.21.15.26:0/4294077271 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6b3411e740 con 0x7f6b44070b80 2023-11-28T16:57:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.757+0000 7f6b3bfff640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6b240668d0 0x7f6b24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.757+0000 7f6b3bfff640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6b240668d0 0x7f6b24068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c007fd0 tx=0x7f6b2c007940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:47.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.761+0000 7f6b3affd640 1 -- 172.21.15.26:0/4294077271 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b340ebc10 con 0x7f6b44070b80 2023-11-28T16:57:47.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:57:47.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:57:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:47.973+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f6b4404e890 con 0x7f6b44070b80 2023-11-28T16:57:48.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b3affd640 1 -- 172.21.15.26:0/4294077271 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v108) v1 ==== 159+0+0 (secure 0 0 0) 0x7f6b340c40e0 con 0x7f6b44070b80 2023-11-28T16:57:48.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6b240668d0 msgr2=0x7f6b24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6b240668d0 0x7f6b24068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c007fd0 tx=0x7f6b2c007940 comp rx=0 tx=0).stop 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b44070b80 msgr2=0x7f6b441ee680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b44070b80 0x7f6b441ee680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b34019000 tx=0x7f6b3401ac30 comp rx=0 tx=0).stop 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 shutdown_connections 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b4414e9d0 0x7f6b441527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6b240668d0 0x7f6b24068d90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b440a8470 0x7f6b440c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 --2- 172.21.15.26:0/4294077271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b44070b80 0x7f6b441ee680 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 >> 172.21.15.26:0/4294077271 conn(0x7f6b440c2ad0 msgr2=0x7f6b440c1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 shutdown_connections 2023-11-28T16:57:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.217+0000 7f6b48c6b640 1 -- 172.21.15.26:0/4294077271 wait complete. 2023-11-28T16:57:48.242 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-28T16:57:48.242 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-28T16:57:48.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41ff479640 1 Processor -- start 2023-11-28T16:57:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41ff479640 1 -- start start 2023-11-28T16:57:48.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41ff479640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41f806db80 0x7f41f806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41ff479640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f806bea0 con 0x7f41f806d100 2023-11-28T16:57:48.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41ff479640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f8159550 con 0x7f41f8152ce0 2023-11-28T16:57:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41ff479640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f8159b10 con 0x7f41f806db80 2023-11-28T16:57:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41fda16640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f41f806d100 0x7f41f80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52940/0 (socket says 172.21.15.26:52940) 2023-11-28T16:57:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41fda16640 1 -- 172.21.15.26:0/1728220420 learned_addr learned my addr 172.21.15.26:0/1728220420 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41fca14640 1 --2- 172.21.15.26:0/1728220420 >> v2:172.21.15.79:3300/0 conn(0x7f41f806db80 0x7f41f806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41effff640 1 -- 172.21.15.26:0/1728220420 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550250159 0 0) 0x7f41f806bea0 con 0x7f41f806d100 2023-11-28T16:57:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41effff640 1 -- 172.21.15.26:0/1728220420 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e4003530 con 0x7f41f806d100 2023-11-28T16:57:48.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41effff640 1 -- 172.21.15.26:0/1728220420 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3920383042 0 0) 0x7f41e4003530 con 0x7f41f806d100 2023-11-28T16:57:48.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41fca14640 1 -- 172.21.15.26:0/1728220420 >> v1:172.21.15.79:6789/0 conn(0x7f41f8152ce0 legacy=0x7f41f80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41fca14640 1 -- 172.21.15.26:0/1728220420 >> v1:172.21.15.26:6789/0 conn(0x7f41f806d100 legacy=0x7f41f80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.385+0000 7f41fca14640 1 -- 172.21.15.26:0/1728220420 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8159830 con 0x7f41f806db80 2023-11-28T16:57:48.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41fca14640 1 --2- 172.21.15.26:0/1728220420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 0x7f41f806c940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097c0 tx=0x7f41e801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3489fd0fcc9f119 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:48.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41effff640 1 -- 172.21.15.26:0/1728220420 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0001a00 con 0x7f41f806db80 2023-11-28T16:57:48.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41effff640 1 -- 172.21.15.26:0/1728220420 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e80a7050 con 0x7f41f806db80 2023-11-28T16:57:48.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41effff640 1 -- 172.21.15.26:0/1728220420 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80ab620 con 0x7f41f806db80 2023-11-28T16:57:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41ff479640 1 -- 172.21.15.26:0/1728220420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 msgr2=0x7f41f806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41ff479640 1 --2- 172.21.15.26:0/1728220420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 0x7f41f806c940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097c0 tx=0x7f41e801c310 comp rx=0 tx=0).stop 2023-11-28T16:57:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41ff479640 1 -- 172.21.15.26:0/1728220420 shutdown_connections 2023-11-28T16:57:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41ff479640 1 --2- 172.21.15.26:0/1728220420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 0x7f41f806c940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41ff479640 1 -- 172.21.15.26:0/1728220420 >> 172.21.15.26:0/1728220420 conn(0x7f41f80c2ad0 msgr2=0x7f41f80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41ff479640 1 -- 172.21.15.26:0/1728220420 shutdown_connections 2023-11-28T16:57:48.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.389+0000 7f41ff479640 1 -- 172.21.15.26:0/1728220420 wait complete. 2023-11-28T16:57:48.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 Processor -- start 2023-11-28T16:57:48.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 -- start start 2023-11-28T16:57:48.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41f806d100 0x7f41f815cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 0x7f41f814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8152ce0 0x7f41f8149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f814b470 con 0x7f41f8152ce0 2023-11-28T16:57:48.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f814bcd0 con 0x7f41f806db80 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81f1750 con 0x7f41f806d100 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8152ce0 0x7f41f8149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8152ce0 0x7f41f8149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58230/0 (socket says 172.21.15.26:58230) 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 -- 172.21.15.26:0/2123643125 learned_addr learned my addr 172.21.15.26:0/2123643125 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fca14640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 0x7f41f814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fd215640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41f806d100 0x7f41f815cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 -- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41f806d100 msgr2=0x7f41f815cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41f806d100 0x7f41f815cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 -- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 msgr2=0x7f41f814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 0x7f41f814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 -- 172.21.15.26:0/2123643125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8009420 con 0x7f41f8152ce0 2023-11-28T16:57:48.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fd215640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41f806d100 0x7f41f815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:48.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41fda16640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8152ce0 0x7f41f8149270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f41f00018a0 tx=0x7f41f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:48.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41edffb640 1 -- 172.21.15.26:0/2123643125 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0012400 con 0x7f41f8152ce0 2023-11-28T16:57:48.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41edffb640 1 -- 172.21.15.26:0/2123643125 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0012560 con 0x7f41f8152ce0 2023-11-28T16:57:48.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41edffb640 1 -- 172.21.15.26:0/2123643125 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0012910 con 0x7f41f8152ce0 2023-11-28T16:57:48.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f81f1a30 con 0x7f41f8152ce0 2023-11-28T16:57:48.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.393+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f814b960 con 0x7f41f8152ce0 2023-11-28T16:57:48.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.397+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8148f90 con 0x7f41f8152ce0 2023-11-28T16:57:48.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.397+0000 7f41edffb640 1 -- 172.21.15.26:0/2123643125 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41f0012a70 con 0x7f41f8152ce0 2023-11-28T16:57:48.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.397+0000 7f41edffb640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41dc066900 0x7f41dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.397+0000 7f41edffb640 1 -- 172.21.15.26:0/2123643125 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f41f0084a00 con 0x7f41f8152ce0 2023-11-28T16:57:48.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.397+0000 7f41fd215640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41dc066900 0x7f41dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.397+0000 7f41fd215640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41dc066900 0x7f41dc068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41f81563d0 tx=0x7f41f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:48.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.401+0000 7f41edffb640 1 -- 172.21.15.26:0/2123643125 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41f8148f90 con 0x7f41f8152ce0 2023-11-28T16:57:48.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.557+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41f8148f90 con 0x7f41f8152ce0 2023-11-28T16:57:48.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41edffb640 1 -- 172.21.15.26:0/2123643125 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13042 (secure 0 0 0) 0x7f41f8148f90 con 0x7f41f8152ce0 2023-11-28T16:57:48.563 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:48.563 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:47.200843+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6833/1849708598":"2023-11-29T16:57:44.187590+0000","172.21.15.26:6832/1849708598":"2023-11-29T16:57:44.187590+0000","172.21.15.26:6835/756252810":"2023-11-29T16:57:37.594896+0000","172.21.15.26:6834/756252810":"2023-11-29T16:57:37.594896+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41dc066900 msgr2=0x7f41dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41dc066900 0x7f41dc068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41f81563d0 tx=0x7f41f4009040 comp rx=0 tx=0).stop 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8152ce0 msgr2=0x7f41f8149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8152ce0 0x7f41f8149270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f41f00018a0 tx=0x7f41f000a430 comp rx=0 tx=0).stop 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 shutdown_connections 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8152ce0 0x7f41f8149270 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f806db80 0x7f41f814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41dc066900 0x7f41dc068dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 --2- 172.21.15.26:0/2123643125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41f806d100 0x7f41f815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 >> 172.21.15.26:0/2123643125 conn(0x7f41f80c2ad0 msgr2=0x7f41f814da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 shutdown_connections 2023-11-28T16:57:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.561+0000 7f41ff479640 1 -- 172.21.15.26:0/2123643125 wait complete. 2023-11-28T16:57:48.584 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:48.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.725+0000 7f8a0d817640 1 Processor -- start 2023-11-28T16:57:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a0d817640 1 -- start start 2023-11-28T16:57:48.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a0d817640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a08156600 0x7f8a0814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a0d817640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a0814fb30 0x7f8a080aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a0d817640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a08152d90 con 0x7f8a080a86d0 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a0d817640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0814ffa0 con 0x7f8a0814fb30 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a0d817640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a08152480 con 0x7f8a08156600 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a077fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a0814fb30 0x7f8a080aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a06ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8a080a86d0 0x7f8a080a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52950/0 (socket says 172.21.15.26:52950) 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a06ffd640 1 -- 172.21.15.26:0/3753322412 learned_addr learned my addr 172.21.15.26:0/3753322412 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f89fffff640 1 --2- 172.21.15.26:0/3753322412 >> v2:172.21.15.79:3300/0 conn(0x7f8a08156600 0x7f8a0814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a077fe640 1 -- 172.21.15.26:0/3753322412 >> v2:172.21.15.79:3300/0 conn(0x7f8a08156600 msgr2=0x7f8a0814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:48.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a077fe640 1 --2- 172.21.15.26:0/3753322412 >> v2:172.21.15.79:3300/0 conn(0x7f8a08156600 0x7f8a0814f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a077fe640 1 -- 172.21.15.26:0/3753322412 >> v1:172.21.15.26:6789/0 conn(0x7f8a080a86d0 legacy=0x7f8a080a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a077fe640 1 -- 172.21.15.26:0/3753322412 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080a9760 con 0x7f8a0814fb30 2023-11-28T16:57:48.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.729+0000 7f8a067fc640 1 -- 172.21.15.26:0/3753322412 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577608024 0 0) 0x7f8a08152d90 con 0x7f8a080a86d0 2023-11-28T16:57:48.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a077fe640 1 --2- 172.21.15.26:0/3753322412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a080aae40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009d90 tx=0x7f8a0001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7fba052d1f0437 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:48.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a067fc640 1 -- 172.21.15.26:0/3753322412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000a58c0 con 0x7f8a0814fb30 2023-11-28T16:57:48.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a067fc640 1 -- 172.21.15.26:0/3753322412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a000a5a20 con 0x7f8a0814fb30 2023-11-28T16:57:48.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a067fc640 1 -- 172.21.15.26:0/3753322412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000a5db0 con 0x7f8a0814fb30 2023-11-28T16:57:48.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 -- 172.21.15.26:0/3753322412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 msgr2=0x7f8a080aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3753322412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a080aae40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009d90 tx=0x7f8a0001c910 comp rx=0 tx=0).stop 2023-11-28T16:57:48.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 -- 172.21.15.26:0/3753322412 shutdown_connections 2023-11-28T16:57:48.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3753322412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a080aae40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3753322412 >> v2:172.21.15.79:3300/0 conn(0x7f8a08156600 0x7f8a0814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 -- 172.21.15.26:0/3753322412 >> 172.21.15.26:0/3753322412 conn(0x7f8a080c2a60 msgr2=0x7f8a080c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:48.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 -- 172.21.15.26:0/3753322412 shutdown_connections 2023-11-28T16:57:48.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 -- 172.21.15.26:0/3753322412 wait complete. 2023-11-28T16:57:48.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 Processor -- start 2023-11-28T16:57:48.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.733+0000 7f8a0d817640 1 -- start start 2023-11-28T16:57:48.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a080a86d0 0x7f8a080c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a081ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a08156600 0x7f8a081ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a081ecd70 con 0x7f8a0814fb30 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0814a280 con 0x7f8a08156600 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a081f0d00 con 0x7f8a080a86d0 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a081ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a081ed200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58252/0 (socket says 172.21.15.26:58252) 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 -- 172.21.15.26:0/3927852732 learned_addr learned my addr 172.21.15.26:0/3927852732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a06ffd640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a080a86d0 0x7f8a080c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a077fe640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a08156600 0x7f8a081ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 -- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a080a86d0 msgr2=0x7f8a080c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a080a86d0 0x7f8a080c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 -- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a08156600 msgr2=0x7f8a081ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a08156600 0x7f8a081ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 -- 172.21.15.26:0/3927852732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00009a70 con 0x7f8a0814fb30 2023-11-28T16:57:48.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a06ffd640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a080a86d0 0x7f8a080c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:48.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f89fffff640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a081ed200 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f89f000e900 tx=0x7f89f000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:48.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a04ff9640 1 -- 172.21.15.26:0/3927852732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0009690 con 0x7f8a0814fb30 2023-11-28T16:57:48.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a04ff9640 1 -- 172.21.15.26:0/3927852732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f000ca00 con 0x7f8a0814fb30 2023-11-28T16:57:48.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a081533a0 con 0x7f8a0814fb30 2023-11-28T16:57:48.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a04ff9640 1 -- 172.21.15.26:0/3927852732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f000cd90 con 0x7f8a0814fb30 2023-11-28T16:57:48.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0814a560 con 0x7f8a0814fb30 2023-11-28T16:57:48.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a08153200 con 0x7f8a0814fb30 2023-11-28T16:57:48.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.737+0000 7f8a04ff9640 1 -- 172.21.15.26:0/3927852732 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f89f0013470 con 0x7f8a0814fb30 2023-11-28T16:57:48.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.741+0000 7f8a04ff9640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89e80668d0 0x7f89e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:48.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.741+0000 7f8a04ff9640 1 -- 172.21.15.26:0/3927852732 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f89f0084300 con 0x7f8a0814fb30 2023-11-28T16:57:48.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.741+0000 7f8a06ffd640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89e80668d0 0x7f89e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:48.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.741+0000 7f8a06ffd640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89e80668d0 0x7f89e8068d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f89f8000f70 tx=0x7f89f8007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.745+0000 7f8a04ff9640 1 -- 172.21.15.26:0/3927852732 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a08153200 con 0x7f8a0814fb30 2023-11-28T16:57:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a08153200 con 0x7f8a0814fb30 2023-11-28T16:57:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a04ff9640 1 -- 172.21.15.26:0/3927852732 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a08153200 con 0x7f8a0814fb30 2023-11-28T16:57:48.905 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89e80668d0 msgr2=0x7f89e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89e80668d0 0x7f89e8068d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f89f8000f70 tx=0x7f89f8007cb0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 msgr2=0x7f8a081ed200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a081ed200 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f89f000e900 tx=0x7f89f000edc0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 shutdown_connections 2023-11-28T16:57:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a08156600 0x7f8a081ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0814fb30 0x7f8a081ed200 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f89e80668d0 0x7f89e8068d90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 --2- 172.21.15.26:0/3927852732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a080a86d0 0x7f8a080c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 >> 172.21.15.26:0/3927852732 conn(0x7f8a080c2a60 msgr2=0x7f8a08148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 shutdown_connections 2023-11-28T16:57:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:48.901+0000 7f8a0d817640 1 -- 172.21.15.26:0/3927852732 wait complete. 2023-11-28T16:57:48.926 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-28T16:57:49.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe308580640 1 Processor -- start 2023-11-28T16:57:49.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe308580640 1 -- start start 2023-11-28T16:57:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe308580640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe308580640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe300070b80 0x7fe3000c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe308580640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30006d320 con 0x7fe3000c1f20 2023-11-28T16:57:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe308580640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3000721b0 con 0x7fe300070b80 2023-11-28T16:57:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe308580640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3000c2830 con 0x7fe30014e9d0 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe305b1b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe300070b80 0x7fe3000c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe306b1d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3000c1f20 0x7fe30006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52952/0 (socket says 172.21.15.26:52952) 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe306b1d640 1 -- 172.21.15.26:0/958798242 learned_addr learned my addr 172.21.15.26:0/958798242 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.065+0000 7fe30631c640 1 --2- 172.21.15.26:0/958798242 >> v2:172.21.15.79:3300/0 conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe305b1b640 1 -- 172.21.15.26:0/958798242 >> v2:172.21.15.79:3300/0 conn(0x7fe30014e9d0 msgr2=0x7fe300151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe305b1b640 1 --2- 172.21.15.26:0/958798242 >> v2:172.21.15.79:3300/0 conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe305b1b640 1 -- 172.21.15.26:0/958798242 >> v1:172.21.15.26:6789/0 conn(0x7fe3000c1f20 legacy=0x7fe30006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe305b1b640 1 -- 172.21.15.26:0/958798242 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300072450 con 0x7fe300070b80 2023-11-28T16:57:49.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe305b1b640 1 --2- 172.21.15.26:0/958798242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300070b80 0x7fe3000c19e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe3000c3980 tx=0x7fe2f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b6b2d62e54e576 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:49.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe30531a640 1 -- 172.21.15.26:0/958798242 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00ab600 con 0x7fe300070b80 2023-11-28T16:57:49.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe30531a640 1 -- 172.21.15.26:0/958798242 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f00a7050 con 0x7fe300070b80 2023-11-28T16:57:49.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe30531a640 1 -- 172.21.15.26:0/958798242 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00ab980 con 0x7fe300070b80 2023-11-28T16:57:49.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe308580640 1 -- 172.21.15.26:0/958798242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300070b80 msgr2=0x7fe3000c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:49.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.069+0000 7fe308580640 1 --2- 172.21.15.26:0/958798242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300070b80 0x7fe3000c19e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe3000c3980 tx=0x7fe2f001c3d0 comp rx=0 tx=0).stop 2023-11-28T16:57:49.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- 172.21.15.26:0/958798242 shutdown_connections 2023-11-28T16:57:49.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 --2- 172.21.15.26:0/958798242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300070b80 0x7fe3000c19e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:49.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 --2- 172.21.15.26:0/958798242 >> v2:172.21.15.79:3300/0 conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:49.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- 172.21.15.26:0/958798242 >> 172.21.15.26:0/958798242 conn(0x7fe3000c2ad0 msgr2=0x7fe3000c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:49.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- 172.21.15.26:0/958798242 shutdown_connections 2023-11-28T16:57:49.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- 172.21.15.26:0/958798242 wait complete. 2023-11-28T16:57:49.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 Processor -- start 2023-11-28T16:57:49.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- start start 2023-11-28T16:57:49.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe300070b80 0x7fe30015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:49.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3000c1f20 0x7fe300148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:49.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30014e9d0 0x7fe3001f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:49.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001512d0 con 0x7fe3000c1f20 2023-11-28T16:57:49.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30013f570 con 0x7fe300070b80 2023-11-28T16:57:49.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001f07d0 con 0x7fe30014e9d0 2023-11-28T16:57:49.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3000c1f20 0x7fe300148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:49.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3000c1f20 0x7fe300148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58260/0 (socket says 172.21.15.26:58260) 2023-11-28T16:57:49.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 -- 172.21.15.26:0/3069572441 learned_addr learned my addr 172.21.15.26:0/3069572441 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:49.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe30631c640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe300070b80 0x7fe30015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:49.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe306b1d640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30014e9d0 0x7fe3001f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:49.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 -- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30014e9d0 msgr2=0x7fe3001f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:49.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30014e9d0 0x7fe3001f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:49.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 -- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe300070b80 msgr2=0x7fe30015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:49.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe300070b80 0x7fe30015a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:49.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 -- 172.21.15.26:0/3069572441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009420 con 0x7fe3000c1f20 2023-11-28T16:57:49.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe306b1d640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30014e9d0 0x7fe3001f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:49.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe30631c640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe300070b80 0x7fe30015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:49.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe305b1b640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3000c1f20 0x7fe300148650 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe2f001a000 tx=0x7fe2f001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:49.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe2f6ffd640 1 -- 172.21.15.26:0/3069572441 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00b7450 con 0x7fe3000c1f20 2023-11-28T16:57:49.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe2f6ffd640 1 -- 172.21.15.26:0/3069572441 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f00b75d0 con 0x7fe3000c1f20 2023-11-28T16:57:49.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe2f6ffd640 1 -- 172.21.15.26:0/3069572441 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00b7980 con 0x7fe3000c1f20 2023-11-28T16:57:49.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.073+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30014f4a0 con 0x7fe3000c1f20 2023-11-28T16:57:49.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.077+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30014fa60 con 0x7fe3000c1f20 2023-11-28T16:57:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.077+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3001f0960 con 0x7fe3000c1f20 2023-11-28T16:57:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.077+0000 7fe2f6ffd640 1 -- 172.21.15.26:0/3069572441 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe2f00b7ae0 con 0x7fe3000c1f20 2023-11-28T16:57:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.077+0000 7fe2f6ffd640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe2e40668d0 0x7fe2e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.077+0000 7fe2f6ffd640 1 -- 172.21.15.26:0/3069572441 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe2f011e980 con 0x7fe3000c1f20 2023-11-28T16:57:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.077+0000 7fe30631c640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe2e40668d0 0x7fe2e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:49.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.077+0000 7fe30631c640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe2e40668d0 0x7fe2e4068d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe300071a80 tx=0x7fe2fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:49.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.081+0000 7fe2f6ffd640 1 -- 172.21.15.26:0/3069572441 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2f00ebe50 con 0x7fe3000c1f20 2023-11-28T16:57:49.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:49.293+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fe30004e890 con 0x7fe3000c1f20 2023-11-28T16:57:50.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.221+0000 7fe2f6ffd640 1 -- 172.21.15.26:0/3069572441 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v110) v1 ==== 187+0+0 (secure 0 0 0) 0x7fe2f00bb100 con 0x7fe3000c1f20 2023-11-28T16:57:50.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe2e40668d0 msgr2=0x7fe2e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe2e40668d0 0x7fe2e4068d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe300071a80 tx=0x7fe2fc008040 comp rx=0 tx=0).stop 2023-11-28T16:57:50.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3000c1f20 msgr2=0x7fe300148650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3000c1f20 0x7fe300148650 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe2f001a000 tx=0x7fe2f001ac10 comp rx=0 tx=0).stop 2023-11-28T16:57:50.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 shutdown_connections 2023-11-28T16:57:50.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe2e40668d0 0x7fe2e4068d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30014e9d0 0x7fe3001f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3000c1f20 0x7fe300148650 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 --2- 172.21.15.26:0/3069572441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe300070b80 0x7fe30015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 >> 172.21.15.26:0/3069572441 conn(0x7fe3000c2ad0 msgr2=0x7fe3000c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:50.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 shutdown_connections 2023-11-28T16:57:50.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.225+0000 7fe308580640 1 -- 172.21.15.26:0/3069572441 wait complete. 2023-11-28T16:57:50.252 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T16:57:50.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.397+0000 7fcb7c09c640 1 Processor -- start 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.397+0000 7fcb7c09c640 1 -- start start 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb7c09c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb74151ee0 0x7fcb74072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb7c09c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb741522c0 con 0x7fcb740c1ae0 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb7c09c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb74155040 con 0x7fcb740c09c0 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb7c09c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb74072870 con 0x7fcb74151ee0 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79637640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb740c1ae0 0x7fcb7406a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52956/0 (socket says 172.21.15.26:52956) 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79637640 1 -- 172.21.15.26:0/3146492865 learned_addr learned my addr 172.21.15.26:0/3146492865 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79e38640 1 --2- 172.21.15.26:0/3146492865 >> v2:172.21.15.79:3300/0 conn(0x7fcb74151ee0 0x7fcb74072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199241427 0 0) 0x7fcb741522c0 con 0x7fcb740c1ae0 2023-11-28T16:57:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb60003530 con 0x7fcb740c1ae0 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633840446 0 0) 0x7fcb74155040 con 0x7fcb740c09c0 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb741522c0 con 0x7fcb740c09c0 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058410676 0 0) 0x7fcb60003530 con 0x7fcb740c1ae0 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 >> v2:172.21.15.79:3300/0 conn(0x7fcb74151ee0 msgr2=0x7fcb74072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 --2- 172.21.15.26:0/3146492865 >> v2:172.21.15.79:3300/0 conn(0x7fcb74151ee0 0x7fcb74072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 >> v1:172.21.15.79:6789/0 conn(0x7fcb740c09c0 legacy=0x7fcb740c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb741555c0 con 0x7fcb740c1ae0 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fcb64001680 con 0x7fcb740c1ae0 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 >> v1:172.21.15.26:6789/0 conn(0x7fcb740c1ae0 legacy=0x7fcb7406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb60003b40 0x7fcb60003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb600047d0 0x7fcb60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60005190 0x7fcb6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0015c0 con 0x7fcb60005190 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74072870 con 0x7fcb60003b40 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6000c110 con 0x7fcb600047d0 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79e38640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb60003b40 0x7fcb60003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79637640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb600047d0 0x7fcb60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb7a639640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60005190 0x7fcb6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79e38640 1 -- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb600047d0 msgr2=0x7fcb60004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79e38640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb600047d0 0x7fcb60004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79e38640 1 -- 172.21.15.26:0/3146492865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60005190 msgr2=0x7fcb6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79e38640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60005190 0x7fcb6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb7a639640 1 -- 172.21.15.26:0/3146492865 reap_dead start 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.401+0000 7fcb79e38640 1 -- 172.21.15.26:0/3146492865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60003530 con 0x7fcb60003b40 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb79e38640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb60003b40 0x7fcb60003f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009ae0 tx=0x7fcb7001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14eda221a6d36e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700a6430 con 0x7fcb60003b40 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb700a6590 con 0x7fcb60003b40 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb78e36640 1 -- 172.21.15.26:0/3146492865 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700a6940 con 0x7fcb60003b40 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 -- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb60003b40 msgr2=0x7fcb60003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb60003b40 0x7fcb60003f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009ae0 tx=0x7fcb7001ca50 comp rx=0 tx=0).stop 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 -- 172.21.15.26:0/3146492865 shutdown_connections 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/3146492865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb60003b40 0x7fcb60003f20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 -- 172.21.15.26:0/3146492865 >> 172.21.15.26:0/3146492865 conn(0x7fcb740c3b70 msgr2=0x7fcb740c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 -- 172.21.15.26:0/3146492865 shutdown_connections 2023-11-28T16:57:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 -- 172.21.15.26:0/3146492865 wait complete. 2023-11-28T16:57:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.405+0000 7fcb7c09c640 1 Processor -- start 2023-11-28T16:57:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 -- start start 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60003b40 0x7fcb7406df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb741569f0 0x7fcb741576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb740c68b0 0x7fcb74157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741565d0 con 0x7fcb60003b40 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741ddc70 con 0x7fcb740c68b0 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74156260 con 0x7fcb741569f0 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60003b40 0x7fcb7406df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60003b40 0x7fcb7406df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58276/0 (socket says 172.21.15.26:58276) 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 -- 172.21.15.26:0/2644933117 learned_addr learned my addr 172.21.15.26:0/2644933117 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79637640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb741569f0 0x7fcb741576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7a639640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb740c68b0 0x7fcb74157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 -- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb741569f0 msgr2=0x7fcb741576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb741569f0 0x7fcb741576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 -- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb740c68b0 msgr2=0x7fcb74157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb740c68b0 0x7fcb74157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 -- 172.21.15.26:0/2644933117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb741df170 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb79e38640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60003b40 0x7fcb7406df60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcb7001c880 tx=0x7fcb700197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb6a7fc640 1 -- 172.21.15.26:0/2644933117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700a6430 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb6a7fc640 1 -- 172.21.15.26:0/2644933117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb700b9640 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb741ddec0 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb6a7fc640 1 -- 172.21.15.26:0/2644933117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700b99d0 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb740c5cb0 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.409+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb74156840 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.413+0000 7fcb6a7fc640 1 -- 172.21.15.26:0/2644933117 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb700b9b30 con 0x7fcb60003b40 2023-11-28T16:57:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.413+0000 7fcb6a7fc640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcb580668d0 0x7fcb58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.413+0000 7fcb6a7fc640 1 -- 172.21.15.26:0/2644933117 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcb7011e4c0 con 0x7fcb60003b40 2023-11-28T16:57:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.413+0000 7fcb79637640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcb580668d0 0x7fcb58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.413+0000 7fcb79637640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcb580668d0 0x7fcb58068d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001210 tx=0x7fcb64001e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.417+0000 7fcb6a7fc640 1 -- 172.21.15.26:0/2644933117 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb700eb990 con 0x7fcb60003b40 2023-11-28T16:57:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.577+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcb741515a0 con 0x7fcb60003b40 2023-11-28T16:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb6a7fc640 1 -- 172.21.15.26:0/2644933117 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb700be0c0 con 0x7fcb60003b40 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcb580668d0 msgr2=0x7fcb58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcb580668d0 0x7fcb58068d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001210 tx=0x7fcb64001e20 comp rx=0 tx=0).stop 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60003b40 msgr2=0x7fcb7406df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60003b40 0x7fcb7406df60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcb7001c880 tx=0x7fcb700197f0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 shutdown_connections 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb740c68b0 0x7fcb74157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcb580668d0 0x7fcb58068d90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb741569f0 0x7fcb741576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 --2- 172.21.15.26:0/2644933117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb60003b40 0x7fcb7406df60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 >> 172.21.15.26:0/2644933117 conn(0x7fcb740c3b70 msgr2=0x7fcb741531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 shutdown_connections 2023-11-28T16:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.581+0000 7fcb7c09c640 1 -- 172.21.15.26:0/2644933117 wait complete. 2023-11-28T16:57:50.605 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T16:57:50.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:57:50.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:57:50.774 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T16:57:50.774 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:57:50.775 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:50.783 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:57:50.784 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:57:50.784 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:57:50.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:57:50.793 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-28T16:57:50.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:57:50.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.965+0000 7f4b091aa640 1 Processor -- start 2023-11-28T16:57:50.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.965+0000 7f4b091aa640 1 -- start start 2023-11-28T16:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.965+0000 7f4b091aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b040bd720 0x7f4b04158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.965+0000 7f4b091aa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b04155790 con 0x7f4b0406cd90 2023-11-28T16:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.965+0000 7f4b091aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b040c4b00 con 0x7f4b040ca610 2023-11-28T16:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.965+0000 7f4b091aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b040c4de0 con 0x7f4b040bd720 2023-11-28T16:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4afbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b040bd720 0x7f4b04158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4afbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b040bd720 0x7f4b04158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58292/0 (socket says 172.21.15.26:58292) 2023-11-28T16:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4b0359e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b0406cd90 0x7f4b040c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52960/0 (socket says 172.21.15.26:52960) 2023-11-28T16:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4afbfff640 1 -- 172.21.15.26:0/3593947729 learned_addr learned my addr 172.21.15.26:0/3593947729 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4b02d9d640 1 --1- 172.21.15.26:0/3593947729 >> v1:172.21.15.79:6789/0 conn(0x7f4b040ca610 0x7f4b040c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:34734/0 (socket says 172.21.15.26:34734) 2023-11-28T16:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4afbfff640 1 -- 172.21.15.26:0/3593947729 >> v1:172.21.15.79:6789/0 conn(0x7f4b040ca610 legacy=0x7f4b040c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4afbfff640 1 -- 172.21.15.26:0/3593947729 >> v1:172.21.15.26:6789/0 conn(0x7f4b0406cd90 legacy=0x7f4b040c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4afbfff640 1 -- 172.21.15.26:0/3593947729 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04157e30 con 0x7f4b040bd720 2023-11-28T16:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4afbfff640 1 --2- 172.21.15.26:0/3593947729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b04158350 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009870 tx=0x7f4aec01c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c13a22c49ab1bd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4b0259c640 1 -- 172.21.15.26:0/3593947729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040c52d0 con 0x7f4b040bd720 2023-11-28T16:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4b0259c640 1 -- 172.21.15.26:0/3593947729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec0a4900 con 0x7f4b040bd720 2023-11-28T16:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.969+0000 7f4b0259c640 1 -- 172.21.15.26:0/3593947729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0a4c90 con 0x7f4b040bd720 2023-11-28T16:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- 172.21.15.26:0/3593947729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 msgr2=0x7f4b04158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 --2- 172.21.15.26:0/3593947729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b04158350 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009870 tx=0x7f4aec01c100 comp rx=0 tx=0).stop 2023-11-28T16:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- 172.21.15.26:0/3593947729 shutdown_connections 2023-11-28T16:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 --2- 172.21.15.26:0/3593947729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b04158350 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- 172.21.15.26:0/3593947729 >> 172.21.15.26:0/3593947729 conn(0x7f4b04071ea0 msgr2=0x7f4b040722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- 172.21.15.26:0/3593947729 shutdown_connections 2023-11-28T16:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- 172.21.15.26:0/3593947729 wait complete. 2023-11-28T16:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 Processor -- start 2023-11-28T16:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- start start 2023-11-28T16:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b0406cd90 0x7f4b040ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b040aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040ca610 0x7f4b040aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040aa440 con 0x7f4b040bd720 2023-11-28T16:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040acd30 con 0x7f4b0406cd90 2023-11-28T16:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b091aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040acf80 con 0x7f4b040ca610 2023-11-28T16:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b040aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b02d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b0406cd90 0x7f4b040ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b040aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58306/0 (socket says 172.21.15.26:58306) 2023-11-28T16:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 -- 172.21.15.26:0/883677543 learned_addr learned my addr 172.21.15.26:0/883677543 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b0359e640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040ca610 0x7f4b040aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 -- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040ca610 msgr2=0x7f4b040aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040ca610 0x7f4b040aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 -- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b0406cd90 msgr2=0x7f4b040ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b0406cd90 0x7f4b040ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4afbfff640 1 -- 172.21.15.26:0/883677543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0094d0 con 0x7f4b040bd720 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.973+0000 7f4b0359e640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040ca610 0x7f4b040aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4afbfff640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b040aaa80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0af040 tx=0x7f4aec0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4afb7fe640 1 -- 172.21.15.26:0/883677543 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0ac840 con 0x7f4b040bd720 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4afb7fe640 1 -- 172.21.15.26:0/883677543 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec0ac9c0 con 0x7f4b040bd720 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4afb7fe640 1 -- 172.21.15.26:0/883677543 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0acd70 con 0x7f4b040bd720 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b040ad260 con 0x7f4b040bd720 2023-11-28T16:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b040ad820 con 0x7f4b040bd720 2023-11-28T16:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0404e890 con 0x7f4b040bd720 2023-11-28T16:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4afb7fe640 1 -- 172.21.15.26:0/883677543 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4aec0b7460 con 0x7f4b040bd720 2023-11-28T16:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4afb7fe640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ae40668d0 0x7f4ae4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4afb7fe640 1 -- 172.21.15.26:0/883677543 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4aec11d480 con 0x7f4b040bd720 2023-11-28T16:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.977+0000 7f4b02d9d640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ae40668d0 0x7f4ae4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.981+0000 7f4b02d9d640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ae40668d0 0x7f4ae4068d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4af4000f70 tx=0x7f4af4007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:50.981+0000 7f4afb7fe640 1 -- 172.21.15.26:0/883677543 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4aec0eaaa0 con 0x7f4b040bd720 2023-11-28T16:57:51.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.169+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b040c62b0 con 0x7f4b040bd720 2023-11-28T16:57:51.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4afb7fe640 1 -- 172.21.15.26:0/883677543 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f4aec0b1e90 con 0x7f4b040bd720 2023-11-28T16:57:51.178 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:51.178 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3858519413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3858519413},{"type":"v1","addr":"172.21.15.79:6835","nonce":3858519413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3968519652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3968519652},{"type":"v1","addr":"172.21.15.79:6837","nonce":3968519652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2342692077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2342692077},{"type":"v1","addr":"172.21.15.26:6835","nonce":2342692077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1949543811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1949543811},{"type":"v1","addr":"172.21.15.26:6833","nonce":1949543811}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2023-11-28T16:57:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 25 2023-11-28T16:57:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ae40668d0 msgr2=0x7f4ae4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ae40668d0 0x7f4ae4068d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4af4000f70 tx=0x7f4af4007e50 comp rx=0 tx=0).stop 2023-11-28T16:57:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 msgr2=0x7f4b040aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b040aaa80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0af040 tx=0x7f4aec0191c0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 shutdown_connections 2023-11-28T16:57:51.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ae40668d0 0x7f4ae4068d90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040ca610 0x7f4b040aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040bd720 0x7f4b040aaa80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 --2- 172.21.15.26:0/883677543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b0406cd90 0x7f4b040ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 >> 172.21.15.26:0/883677543 conn(0x7f4b04071ea0 msgr2=0x7f4b0414e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:51.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 shutdown_connections 2023-11-28T16:57:51.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.173+0000 7f4b091aa640 1 -- 172.21.15.26:0/883677543 wait complete. 2023-11-28T16:57:51.196 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T16:57:51.197 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T16:57:51.197 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T16:57:51.197 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:57:51.197 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T16:57:51.197 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T16:57:51.197 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T16:57:51.197 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:57:51.198 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T16:57:51.198 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T16:57:51.199 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T16:57:51.199 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:57:51.199 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T16:57:51.199 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T16:57:51.199 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T16:57:51.199 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:57:51.210 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T16:57:51.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T16:57:51.211 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T16:57:51.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T16:57:51.212 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T16:57:51.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T16:57:51.213 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T16:57:51.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T16:57:51.257 INFO:tasks.ceph.mds.c:Started 2023-11-28T16:57:51.258 DEBUG:teuthology.parallel:result is None 2023-11-28T16:57:51.258 INFO:tasks.ceph.mds.b:Started 2023-11-28T16:57:51.258 DEBUG:teuthology.parallel:result is None 2023-11-28T16:57:51.259 INFO:tasks.ceph.mds.d:Started 2023-11-28T16:57:51.260 INFO:tasks.ceph.mds.a:Started 2023-11-28T16:57:51.260 DEBUG:teuthology.parallel:result is None 2023-11-28T16:57:51.260 DEBUG:teuthology.parallel:result is None 2023-11-28T16:57:51.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T16:57:51.342 INFO:tasks.ceph.mds.d.smithi079.stdout:starting mds.d at 2023-11-28T16:57:51.342 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-11-28T16:57:51.347 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-11-28T16:57:51.349 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-11-28T16:57:51.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.405+0000 7fdb78db5640 1 Processor -- start 2023-11-28T16:57:51.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.405+0000 7fdb78db5640 1 -- start start 2023-11-28T16:57:51.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.405+0000 7fdb78db5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740c4890 0x7fdb740caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:51.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.405+0000 7fdb78db5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb740bd5a0 0x7fdb740c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:51.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.405+0000 7fdb78db5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7406b7d0 con 0x7fdb740ca620 2023-11-28T16:57:51.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.405+0000 7fdb78db5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb74155160 con 0x7fdb740bd5a0 2023-11-28T16:57:51.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.405+0000 7fdb78db5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7406b180 con 0x7fdb740c4890 2023-11-28T16:57:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb72ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740c4890 0x7fdb740caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb73fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb740bd5a0 0x7fdb740c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb737fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdb740ca620 0x7fdb740c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:40014/0 (socket says 172.21.15.26:40014) 2023-11-28T16:57:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb72ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740c4890 0x7fdb740caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:53786/0 (socket says 172.21.15.26:53786) 2023-11-28T16:57:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb737fe640 1 -- 172.21.15.26:0/1809450746 learned_addr learned my addr 172.21.15.26:0/1809450746 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb72ffd640 1 -- 172.21.15.26:0/1809450746 >> v2:172.21.15.79:3300/0 conn(0x7fdb740bd5a0 msgr2=0x7fdb740c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb72ffd640 1 --2- 172.21.15.26:0/1809450746 >> v2:172.21.15.79:3300/0 conn(0x7fdb740bd5a0 0x7fdb740c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb72ffd640 1 -- 172.21.15.26:0/1809450746 >> v1:172.21.15.79:6789/0 conn(0x7fdb740ca620 legacy=0x7fdb740c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb72ffd640 1 -- 172.21.15.26:0/1809450746 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7406b460 con 0x7fdb740c4890 2023-11-28T16:57:51.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb72ffd640 1 --2- 172.21.15.26:0/1809450746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740c4890 0x7fdb740caa00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb680097c0 tx=0x7fdb6801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63bad723701ac7a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb727fc640 1 -- 172.21.15.26:0/1809450746 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680ab600 con 0x7fdb740c4890 2023-11-28T16:57:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb727fc640 1 -- 172.21.15.26:0/1809450746 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb680a7050 con 0x7fdb740c4890 2023-11-28T16:57:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.409+0000 7fdb727fc640 1 -- 172.21.15.26:0/1809450746 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680ab980 con 0x7fdb740c4890 2023-11-28T16:57:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- 172.21.15.26:0/1809450746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740c4890 msgr2=0x7fdb740caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 --2- 172.21.15.26:0/1809450746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740c4890 0x7fdb740caa00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb680097c0 tx=0x7fdb6801c3f0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- 172.21.15.26:0/1809450746 shutdown_connections 2023-11-28T16:57:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 --2- 172.21.15.26:0/1809450746 >> v2:172.21.15.79:3300/0 conn(0x7fdb740bd5a0 0x7fdb740c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 --2- 172.21.15.26:0/1809450746 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740c4890 0x7fdb740caa00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- 172.21.15.26:0/1809450746 >> 172.21.15.26:0/1809450746 conn(0x7fdb740ac0a0 msgr2=0x7fdb740c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:51.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- 172.21.15.26:0/1809450746 shutdown_connections 2023-11-28T16:57:51.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- 172.21.15.26:0/1809450746 wait complete. 2023-11-28T16:57:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 Processor -- start 2023-11-28T16:57:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- start start 2023-11-28T16:57:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb740bd5a0 0x7fdb741f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb740c4890 0x7fdb7414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740ca620 0x7fdb7414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb741f0d70 con 0x7fdb740bd5a0 2023-11-28T16:57:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7414e990 con 0x7fdb740c4890 2023-11-28T16:57:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb78db5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7414e6b0 con 0x7fdb740ca620 2023-11-28T16:57:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb740bd5a0 0x7fdb741f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb740bd5a0 0x7fdb741f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37870/0 (socket says 172.21.15.26:37870) 2023-11-28T16:57:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 -- 172.21.15.26:0/2551855136 learned_addr learned my addr 172.21.15.26:0/2551855136 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb72ffd640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb740c4890 0x7fdb7414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb73fff640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740ca620 0x7fdb7414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 -- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740ca620 msgr2=0x7fdb7414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740ca620 0x7fdb7414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 -- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb740c4890 msgr2=0x7fdb7414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb740c4890 0x7fdb7414b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 -- 172.21.15.26:0/2551855136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68009420 con 0x7fdb740bd5a0 2023-11-28T16:57:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb72ffd640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb740c4890 0x7fdb7414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.413+0000 7fdb737fe640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb740bd5a0 0x7fdb741f1200 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c500 tx=0x7fdb6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb5bfff640 1 -- 172.21.15.26:0/2551855136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64005cf0 con 0x7fdb740bd5a0 2023-11-28T16:57:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb5bfff640 1 -- 172.21.15.26:0/2551855136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64005e50 con 0x7fdb740bd5a0 2023-11-28T16:57:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb5bfff640 1 -- 172.21.15.26:0/2551855136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb640072f0 con 0x7fdb740bd5a0 2023-11-28T16:57:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb741f0720 con 0x7fdb740bd5a0 2023-11-28T16:57:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb74151b50 con 0x7fdb740bd5a0 2023-11-28T16:57:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7404e890 con 0x7fdb740bd5a0 2023-11-28T16:57:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb5bfff640 1 -- 172.21.15.26:0/2551855136 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdb64007450 con 0x7fdb740bd5a0 2023-11-28T16:57:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb5bfff640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdb600668d0 0x7fdb60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb5bfff640 1 -- 172.21.15.26:0/2551855136 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdb64083700 con 0x7fdb740bd5a0 2023-11-28T16:57:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.417+0000 7fdb72ffd640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdb600668d0 0x7fdb60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.421+0000 7fdb72ffd640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdb600668d0 0x7fdb60068d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb740ac950 tx=0x7fdb680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.421+0000 7fdb5bfff640 1 -- 172.21.15.26:0/2551855136 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb64050c80 con 0x7fdb740bd5a0 2023-11-28T16:57:51.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:51.593+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdb740c98e0 con 0x7fdb740bd5a0 2023-11-28T16:57:52.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb5bfff640 1 -- 172.21.15.26:0/2551855136 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdb64017080 con 0x7fdb740bd5a0 2023-11-28T16:57:52.247 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-11-28T16:57:52.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdb600668d0 msgr2=0x7fdb60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdb600668d0 0x7fdb60068d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb740ac950 tx=0x7fdb680a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:52.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb740bd5a0 msgr2=0x7fdb741f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb740bd5a0 0x7fdb741f1200 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c500 tx=0x7fdb6400c9c0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 shutdown_connections 2023-11-28T16:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdb600668d0 0x7fdb60068d90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb740ca620 0x7fdb7414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb740c4890 0x7fdb7414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 --2- 172.21.15.26:0/2551855136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb740bd5a0 0x7fdb741f1200 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 >> 172.21.15.26:0/2551855136 conn(0x7fdb740ac0a0 msgr2=0x7fdb740c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.245+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 shutdown_connections 2023-11-28T16:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.249+0000 7fdb78db5640 1 -- 172.21.15.26:0/2551855136 wait complete. 2023-11-28T16:57:52.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T16:57:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 Processor -- start 2023-11-28T16:57:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 -- start start 2023-11-28T16:57:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe2c06bd00 0x7efe2c0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe2c0bf400 0x7efe2c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c06c440 con 0x7efe2c0bf400 2023-11-28T16:57:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c154790 con 0x7efe2c06bd00 2023-11-28T16:57:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.421+0000 7efe30e5a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c06c6e0 con 0x7efe2c14ea60 2023-11-28T16:57:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe2c0bf400 0x7efe2c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe2c0bf400 0x7efe2c0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37886/0 (socket says 172.21.15.26:37886) 2023-11-28T16:57:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 -- 172.21.15.26:0/679046885 learned_addr learned my addr 172.21.15.26:0/679046885 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe23fff640 1 --2- 172.21.15.26:0/679046885 >> v2:172.21.15.79:3300/0 conn(0x7efe2c06bd00 0x7efe2c0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2a59c640 1 --2- 172.21.15.26:0/679046885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 -- 172.21.15.26:0/679046885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 msgr2=0x7efe2c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 --2- 172.21.15.26:0/679046885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 -- 172.21.15.26:0/679046885 >> v2:172.21.15.79:3300/0 conn(0x7efe2c06bd00 msgr2=0x7efe2c0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 --2- 172.21.15.26:0/679046885 >> v2:172.21.15.79:3300/0 conn(0x7efe2c06bd00 0x7efe2c0700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 -- 172.21.15.26:0/679046885 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c154a50 con 0x7efe2c0bf400 2023-11-28T16:57:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe2ad9d640 1 --2- 172.21.15.26:0/679046885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c0bf400 0x7efe2c0c19e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe2c06b4e0 tx=0x7efe2401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc727b0e0e128a89 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe29d9b640 1 -- 172.21.15.26:0/679046885 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe240a56e0 con 0x7efe2c0bf400 2023-11-28T16:57:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe29d9b640 1 -- 172.21.15.26:0/679046885 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe240a5840 con 0x7efe2c0bf400 2023-11-28T16:57:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.425+0000 7efe29d9b640 1 -- 172.21.15.26:0/679046885 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe240a5bd0 con 0x7efe2c0bf400 2023-11-28T16:57:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- 172.21.15.26:0/679046885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c0bf400 msgr2=0x7efe2c0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 --2- 172.21.15.26:0/679046885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c0bf400 0x7efe2c0c19e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe2c06b4e0 tx=0x7efe2401c880 comp rx=0 tx=0).stop 2023-11-28T16:57:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- 172.21.15.26:0/679046885 shutdown_connections 2023-11-28T16:57:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 --2- 172.21.15.26:0/679046885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c0bf400 0x7efe2c0c19e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 --2- 172.21.15.26:0/679046885 >> v2:172.21.15.79:3300/0 conn(0x7efe2c06bd00 0x7efe2c0700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 --2- 172.21.15.26:0/679046885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- 172.21.15.26:0/679046885 >> 172.21.15.26:0/679046885 conn(0x7efe2c0c2ad0 msgr2=0x7efe2c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:52.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- 172.21.15.26:0/679046885 shutdown_connections 2023-11-28T16:57:52.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- 172.21.15.26:0/679046885 wait complete. 2023-11-28T16:57:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 Processor -- start 2023-11-28T16:57:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- start start 2023-11-28T16:57:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c06bd00 0x7efe2c1f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe2c0bf400 0x7efe2c13ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c13e3b0 con 0x7efe2c06bd00 2023-11-28T16:57:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c1f0a30 con 0x7efe2c0bf400 2023-11-28T16:57:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe30e5a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c142f50 con 0x7efe2c14ea60 2023-11-28T16:57:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c06bd00 0x7efe2c1f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c06bd00 0x7efe2c1f04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37894/0 (socket says 172.21.15.26:37894) 2023-11-28T16:57:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 -- 172.21.15.26:0/1653359385 learned_addr learned my addr 172.21.15.26:0/1653359385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe23fff640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe2c0bf400 0x7efe2c13ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2ad9d640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 -- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 msgr2=0x7efe2c1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 -- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe2c0bf400 msgr2=0x7efe2c13ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe2c0bf400 0x7efe2c13ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.429+0000 7efe2a59c640 1 -- 172.21.15.26:0/1653359385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe24009b30 con 0x7efe2c06bd00 2023-11-28T16:57:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe2a59c640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c06bd00 0x7efe2c1f04f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e8a0 tx=0x7efe1c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:52.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653359385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c009510 con 0x7efe2c06bd00 2023-11-28T16:57:52.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653359385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c00c940 con 0x7efe2c06bd00 2023-11-28T16:57:52.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c13de80 con 0x7efe2c06bd00 2023-11-28T16:57:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653359385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00ccb0 con 0x7efe2c06bd00 2023-11-28T16:57:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c13f810 con 0x7efe2c06bd00 2023-11-28T16:57:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c04e890 con 0x7efe2c06bd00 2023-11-28T16:57:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653359385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efe1c013470 con 0x7efe2c06bd00 2023-11-28T16:57:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe22ffd640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe0c066900 0x7efe0c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653359385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe1c084000 con 0x7efe2c06bd00 2023-11-28T16:57:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.433+0000 7efe23fff640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe0c066900 0x7efe0c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.437+0000 7efe23fff640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe0c066900 0x7efe0c068dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efe2c14e480 tx=0x7efe14009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.437+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653359385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe1c0516d0 con 0x7efe2c06bd00 2023-11-28T16:57:52.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efe2c1542e0 con 0x7efe2c06bd00 2023-11-28T16:57:52.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe22ffd640 1 -- 172.21.15.26:0/1653359385 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5021 (secure 0 0 0) 0x7efe1c05b070 con 0x7efe2c06bd00 2023-11-28T16:57:52.651 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:52.651 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:57:52.651 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-11-28T16:57:52.651 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlAikwBRAAQ6/impgMsMbDuSaqtxHLAg==", 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlGkK2ERAAvgQCl4mK38H2G8IG10WC8g==", 2023-11-28T16:57:52.652 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlN8GNDBAA3+w1QxhoXQo54UQV/ogQ5Q==", 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:57:52.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlCZg+GRAADDsRVkfdQ4/R/d3auYuQLQ==", 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.654 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB5G2Zlm75jMhAAfBhoHD0wXNlVoDshO3cpeg==", 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-11-28T16:57:52.655 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB8G2ZlFdNYORAAN6gs23w6ngpwiGxRH9wdqA==", 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCAG2ZlPWo/BBAAhIuajQHDwNtFJhJECKL0HA==", 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.656 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCDG2ZltllfCxAAqpT3R2HyGu+P4MKWVo9haA==", 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.657 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCJG2Zl86hXEhAAVn3jysp8SF3VujHFQXdJZA==", 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCMG2Zldu2MGBAAK/nOy8WbKhJ/e91PhwY4Jg==", 2023-11-28T16:57:52.658 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCPG2ZlMzrZHxAAgwVfHNVLyId5CNs6/llC2w==", 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.659 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCSG2ZlzlL/JRAAXY00dUMMj9nNXUjTVsMBQQ==", 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.660 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw==", 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg==", 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB3G2ZlBP0bIRAA91R862EjTamLWS36tcdt9g==", 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.662 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.testuser", 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQD2G2ZlyL6NDhAAeORl3eJBkAIlPygrNBLnaQ==", 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow rw fsname=cephfs", 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r fsname=cephfs", 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T16:57:52.663 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZldwN4ABAAk2OXnh0lwdB6ER6KsTUp+w==", 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:52.664 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB3G2ZlahcsOBAA/pu4L5dOusqC3KpdoJVbiQ==", 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-11-28T16:57:52.665 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:57:52.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe0c066900 msgr2=0x7efe0c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe0c066900 0x7efe0c068dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efe2c14e480 tx=0x7efe14009190 comp rx=0 tx=0).stop 2023-11-28T16:57:52.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c06bd00 msgr2=0x7efe2c1f04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c06bd00 0x7efe2c1f04f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e8a0 tx=0x7efe1c00eca0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 shutdown_connections 2023-11-28T16:57:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe0c066900 0x7efe0c068dc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe2c14ea60 0x7efe2c1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe2c0bf400 0x7efe2c13ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 --2- 172.21.15.26:0/1653359385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe2c06bd00 0x7efe2c1f04f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 >> 172.21.15.26:0/1653359385 conn(0x7efe2c0c2ad0 msgr2=0x7efe2c155150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 shutdown_connections 2023-11-28T16:57:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.649+0000 7efe30e5a640 1 -- 172.21.15.26:0/1653359385 wait complete. 2023-11-28T16:57:52.672 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-28T16:57:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba757aa640 1 Processor -- start 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba757aa640 1 -- start start 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba757aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba700c2ac0 0x7fba70070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba757aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c1290 0x7fba700c1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba757aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba70158b20 con 0x7fba700c5f20 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba757aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba70070ba0 con 0x7fba700c2ac0 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba757aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba70157f10 con 0x7fba700c1290 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6f7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c1290 0x7fba700c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba700c2ac0 0x7fba70070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba667fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fba700c5f20 0x7fba70151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:40020/0 (socket says 172.21.15.26:40020) 2023-11-28T16:57:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba667fc640 1 -- 172.21.15.26:0/3092749408 learned_addr learned my addr 172.21.15.26:0/3092749408 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6f7fe640 1 --2- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c1290 0x7fba700c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:53822/0 (socket says 172.21.15.26:53822) 2023-11-28T16:57:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6e7fc640 1 -- 172.21.15.26:0/3092749408 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556813320 0 0) 0x7fba70158b20 con 0x7fba700c5f20 2023-11-28T16:57:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6e7fc640 1 -- 172.21.15.26:0/3092749408 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c003530 con 0x7fba700c5f20 2023-11-28T16:57:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6effd640 1 -- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c1290 msgr2=0x7fba700c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6effd640 1 --2- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c1290 0x7fba700c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.813+0000 7fba6effd640 1 -- 172.21.15.26:0/3092749408 >> v1:172.21.15.79:6789/0 conn(0x7fba700c5f20 legacy=0x7fba70151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.817+0000 7fba6effd640 1 -- 172.21.15.26:0/3092749408 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba701581f0 con 0x7fba700c2ac0 2023-11-28T16:57:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.817+0000 7fba6effd640 1 --2- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c2ac0 0x7fba70070660 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba600097c0 tx=0x7fba6001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acea151744779c34 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.817+0000 7fba6e7fc640 1 -- 172.21.15.26:0/3092749408 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600ac620 con 0x7fba700c2ac0 2023-11-28T16:57:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.817+0000 7fba6e7fc640 1 -- 172.21.15.26:0/3092749408 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba600ac780 con 0x7fba700c2ac0 2023-11-28T16:57:52.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.817+0000 7fba6e7fc640 1 -- 172.21.15.26:0/3092749408 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600acb10 con 0x7fba700c2ac0 2023-11-28T16:57:52.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.817+0000 7fba757aa640 1 -- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c2ac0 msgr2=0x7fba70070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.817+0000 7fba757aa640 1 --2- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c2ac0 0x7fba70070660 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba600097c0 tx=0x7fba6001c3c0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- 172.21.15.26:0/3092749408 shutdown_connections 2023-11-28T16:57:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 --2- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c1290 0x7fba700c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 --2- 172.21.15.26:0/3092749408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c2ac0 0x7fba70070660 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- 172.21.15.26:0/3092749408 >> 172.21.15.26:0/3092749408 conn(0x7fba700a9c10 msgr2=0x7fba700aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- 172.21.15.26:0/3092749408 shutdown_connections 2023-11-28T16:57:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- 172.21.15.26:0/3092749408 wait complete. 2023-11-28T16:57:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 Processor -- start 2023-11-28T16:57:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- start start 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba700c1290 0x7fba701ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c2ac0 0x7fba7006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c5f20 0x7fba7006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700ab7b0 con 0x7fba700c1290 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba701eda30 con 0x7fba700c5f20 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba757aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba70143d70 con 0x7fba700c2ac0 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba700c1290 0x7fba701ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba700c1290 0x7fba701ecd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37904/0 (socket says 172.21.15.26:37904) 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 -- 172.21.15.26:0/835645227 learned_addr learned my addr 172.21.15.26:0/835645227 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba667fc640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c2ac0 0x7fba7006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6f7fe640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c5f20 0x7fba7006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 -- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c2ac0 msgr2=0x7fba7006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c2ac0 0x7fba7006f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 -- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c5f20 msgr2=0x7fba7006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c5f20 0x7fba7006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 -- 172.21.15.26:0/835645227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60009420 con 0x7fba700c1290 2023-11-28T16:57:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.821+0000 7fba6effd640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba700c1290 0x7fba701ecd50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba600097c0 tx=0x7fba6001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba67fff640 1 -- 172.21.15.26:0/835645227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600ac620 con 0x7fba700c1290 2023-11-28T16:57:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba67fff640 1 -- 172.21.15.26:0/835645227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba600b8450 con 0x7fba700c1290 2023-11-28T16:57:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba67fff640 1 -- 172.21.15.26:0/835645227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600b8800 con 0x7fba700c1290 2023-11-28T16:57:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba701484b0 con 0x7fba700c1290 2023-11-28T16:57:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba701ed750 con 0x7fba700c1290 2023-11-28T16:57:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7004e890 con 0x7fba700c1290 2023-11-28T16:57:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba67fff640 1 -- 172.21.15.26:0/835645227 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fba600aa070 con 0x7fba700c1290 2023-11-28T16:57:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba67fff640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fba500668d0 0x7fba50068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba67fff640 1 -- 172.21.15.26:0/835645227 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba6011e7c0 con 0x7fba700c1290 2023-11-28T16:57:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.825+0000 7fba667fc640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fba500668d0 0x7fba50068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.829+0000 7fba667fc640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fba500668d0 0x7fba50068d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fba701579c0 tx=0x7fba58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:52.829+0000 7fba67fff640 1 -- 172.21.15.26:0/835645227 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba600ebc30 con 0x7fba700c1290 2023-11-28T16:57:53.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.045+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fba700c8a90 con 0x7fba700c1290 2023-11-28T16:57:53.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba67fff640 1 -- 172.21.15.26:0/835645227 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v16) v1 ==== 85+0+0 (secure 0 0 0) 0x7fba600ef250 con 0x7fba700c1290 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fba500668d0 msgr2=0x7fba50068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fba500668d0 0x7fba50068d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fba701579c0 tx=0x7fba58009040 comp rx=0 tx=0).stop 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba700c1290 msgr2=0x7fba701ecd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba700c1290 0x7fba701ecd50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba600097c0 tx=0x7fba6001ac00 comp rx=0 tx=0).stop 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 shutdown_connections 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba700c5f20 0x7fba7006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fba500668d0 0x7fba50068d90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba700c2ac0 0x7fba7006f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 --2- 172.21.15.26:0/835645227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba700c1290 0x7fba701ecd50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 >> 172.21.15.26:0/835645227 conn(0x7fba700a9c10 msgr2=0x7fba7014f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:53.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 shutdown_connections 2023-11-28T16:57:53.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.049+0000 7fba757aa640 1 -- 172.21.15.26:0/835645227 wait complete. 2023-11-28T16:57:53.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:53.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a8769c640 1 Processor -- start 2023-11-28T16:57:53.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a8769c640 1 -- start start 2023-11-28T16:57:53.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a8769c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8014fcc0 0x7f3a80156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a8769c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a800ab580 con 0x7f3a800c19e0 2023-11-28T16:57:53.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a8769c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a80152fe0 con 0x7f3a8006d980 2023-11-28T16:57:53.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a8769c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800aa340 con 0x7f3a8014fcc0 2023-11-28T16:57:53.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a85c39640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a800c19e0 0x7f3a800c1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37932/0 (socket says 172.21.15.26:37932) 2023-11-28T16:57:53.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a85c39640 1 -- 172.21.15.26:0/601227360 learned_addr learned my addr 172.21.15.26:0/601227360 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:53.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a85438640 1 --2- 172.21.15.26:0/601227360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8014fcc0 0x7f3a80156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925193226 0 0) 0x7f3a800ab580 con 0x7f3a800c19e0 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a6c003530 con 0x7f3a800c19e0 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318443736 0 0) 0x7f3a80152fe0 con 0x7f3a8006d980 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a800ab580 con 0x7f3a8006d980 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a85438640 1 -- 172.21.15.26:0/601227360 >> v1:172.21.15.79:6789/0 conn(0x7f3a8006d980 legacy=0x7f3a800aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a85438640 1 -- 172.21.15.26:0/601227360 >> v1:172.21.15.26:6789/0 conn(0x7f3a800c19e0 legacy=0x7f3a800c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1710819019 0 0) 0x7f3a6c003530 con 0x7f3a800c19e0 2023-11-28T16:57:53.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.213+0000 7f3a85438640 1 -- 172.21.15.26:0/601227360 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a801532c0 con 0x7f3a8014fcc0 2023-11-28T16:57:53.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a85438640 1 --2- 172.21.15.26:0/601227360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8014fcc0 0x7f3a80156500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0097f0 tx=0x7f3a7c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b90551eeb479c710 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78001a00 con 0x7f3a8014fcc0 2023-11-28T16:57:53.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c0a7050 con 0x7f3a8014fcc0 2023-11-28T16:57:53.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a77fff640 1 -- 172.21.15.26:0/601227360 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0ab620 con 0x7f3a8014fcc0 2023-11-28T16:57:53.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a8769c640 1 -- 172.21.15.26:0/601227360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8014fcc0 msgr2=0x7f3a80156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a8769c640 1 --2- 172.21.15.26:0/601227360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8014fcc0 0x7f3a80156500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0097f0 tx=0x7f3a7c01c3b0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a8769c640 1 -- 172.21.15.26:0/601227360 shutdown_connections 2023-11-28T16:57:53.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a8769c640 1 --2- 172.21.15.26:0/601227360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8014fcc0 0x7f3a80156500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a8769c640 1 -- 172.21.15.26:0/601227360 >> 172.21.15.26:0/601227360 conn(0x7f3a800c2ad0 msgr2=0x7f3a800c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:53.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a8769c640 1 -- 172.21.15.26:0/601227360 shutdown_connections 2023-11-28T16:57:53.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.217+0000 7f3a8769c640 1 -- 172.21.15.26:0/601227360 wait complete. 2023-11-28T16:57:53.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 Processor -- start 2023-11-28T16:57:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 -- start start 2023-11-28T16:57:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8006d980 0x7f3a801ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a800c19e0 0x7f3a8015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a801509b0 0x7f3a800c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800c3f90 con 0x7f3a800c19e0 2023-11-28T16:57:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80152600 con 0x7f3a801509b0 2023-11-28T16:57:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a801ed9d0 con 0x7f3a8006d980 2023-11-28T16:57:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a800c19e0 0x7f3a8015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a800c19e0 0x7f3a8015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37910/0 (socket says 172.21.15.26:37910) 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 -- 172.21.15.26:0/2716183132 learned_addr learned my addr 172.21.15.26:0/2716183132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a85c39640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a801509b0 0x7f3a800c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a85438640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8006d980 0x7f3a801ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 -- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8006d980 msgr2=0x7f3a801ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8006d980 0x7f3a801ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 -- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a801509b0 msgr2=0x7f3a800c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a801509b0 0x7f3a800c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 -- 172.21.15.26:0/2716183132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009420 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a84c37640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a800c19e0 0x7f3a8015d250 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c4c0 tx=0x7f3a7000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a75ffb640 1 -- 172.21.15.26:0/2716183132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700052d0 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a75ffb640 1 -- 172.21.15.26:0/2716183132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70005430 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a800c3c60 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.221+0000 7f3a75ffb640 1 -- 172.21.15.26:0/2716183132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70012870 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.225+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a80151150 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.225+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a800c4140 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.225+0000 7f3a75ffb640 1 -- 172.21.15.26:0/2716183132 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a700129d0 con 0x7f3a800c19e0 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.225+0000 7f3a75ffb640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a640668d0 0x7f3a64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.225+0000 7f3a75ffb640 1 -- 172.21.15.26:0/2716183132 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3a70083b50 con 0x7f3a800c19e0 2023-11-28T16:57:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.225+0000 7f3a85438640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a640668d0 0x7f3a64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.225+0000 7f3a85438640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a640668d0 0x7f3a64068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0ad000 tx=0x7f3a7c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.229+0000 7f3a75ffb640 1 -- 172.21.15.26:0/2716183132 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a800c4140 con 0x7f3a800c19e0 2023-11-28T16:57:53.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.389+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a800c4140 con 0x7f3a800c19e0 2023-11-28T16:57:53.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a75ffb640 1 -- 172.21.15.26:0/2716183132 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+12785 (secure 0 0 0) 0x7f3a800c4140 con 0x7f3a800c19e0 2023-11-28T16:57:53.394 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:53.395 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":46,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:52.254279+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:53.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a640668d0 msgr2=0x7f3a64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a640668d0 0x7f3a64068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0ad000 tx=0x7f3a7c0a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:53.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a800c19e0 msgr2=0x7f3a8015d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a800c19e0 0x7f3a8015d250 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c4c0 tx=0x7f3a7000c980 comp rx=0 tx=0).stop 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 shutdown_connections 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a801509b0 0x7f3a800c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a800c19e0 0x7f3a8015d250 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a640668d0 0x7f3a64068d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 --2- 172.21.15.26:0/2716183132 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a8006d980 0x7f3a801ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 >> 172.21.15.26:0/2716183132 conn(0x7f3a800c2ad0 msgr2=0x7f3a80155290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 shutdown_connections 2023-11-28T16:57:53.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.393+0000 7f3a8769c640 1 -- 172.21.15.26:0/2716183132 wait complete. 2023-11-28T16:57:53.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:57:53.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f4270701640 1 Processor -- start 2023-11-28T16:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f4270701640 1 -- start start 2023-11-28T16:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f4270701640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4268151d80 0x7f42680c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f4270701640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42680c7f20 0x7f426806be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f4270701640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426806cf70 con 0x7f42680c8430 2023-11-28T16:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f4270701640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4268152160 con 0x7f4268151d80 2023-11-28T16:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f4270701640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42680c6a30 con 0x7f42680c7f20 2023-11-28T16:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426ec9e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42680c7f20 0x7f426806be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426dc9c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42680c8430 0x7f426806b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:40034/0 (socket says 172.21.15.26:40034) 2023-11-28T16:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426e49d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4268151d80 0x7f42680c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426dc9c640 1 -- 172.21.15.26:0/904297686 learned_addr learned my addr 172.21.15.26:0/904297686 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426d49b640 1 -- 172.21.15.26:0/904297686 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191373662 0 0) 0x7f426806cf70 con 0x7f42680c8430 2023-11-28T16:57:53.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426d49b640 1 -- 172.21.15.26:0/904297686 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4254003530 con 0x7f42680c8430 2023-11-28T16:57:53.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426e49d640 1 -- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42680c7f20 msgr2=0x7f426806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:53.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426e49d640 1 --2- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42680c7f20 0x7f426806be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426e49d640 1 -- 172.21.15.26:0/904297686 >> v1:172.21.15.79:6789/0 conn(0x7f42680c8430 legacy=0x7f426806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426e49d640 1 -- 172.21.15.26:0/904297686 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42680c72d0 con 0x7f4268151d80 2023-11-28T16:57:53.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.561+0000 7f426ec9e640 1 --2- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42680c7f20 0x7f426806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f426e49d640 1 --2- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4268151d80 0x7f42680c49a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42640097c0 tx=0x7f426401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb4c21d559804cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f426d49b640 1 -- 172.21.15.26:0/904297686 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640ac620 con 0x7f4268151d80 2023-11-28T16:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f426d49b640 1 -- 172.21.15.26:0/904297686 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42640ac780 con 0x7f4268151d80 2023-11-28T16:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f426d49b640 1 -- 172.21.15.26:0/904297686 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640acb10 con 0x7f4268151d80 2023-11-28T16:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 -- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4268151d80 msgr2=0x7f42680c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 --2- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4268151d80 0x7f42680c49a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42640097c0 tx=0x7f426401c3c0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 -- 172.21.15.26:0/904297686 shutdown_connections 2023-11-28T16:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 --2- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42680c7f20 0x7f426806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 --2- 172.21.15.26:0/904297686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4268151d80 0x7f42680c49a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 -- 172.21.15.26:0/904297686 >> 172.21.15.26:0/904297686 conn(0x7f42680abd00 msgr2=0x7f42680ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:53.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 -- 172.21.15.26:0/904297686 shutdown_connections 2023-11-28T16:57:53.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.565+0000 7f4270701640 1 -- 172.21.15.26:0/904297686 wait complete. 2023-11-28T16:57:53.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 Processor -- start 2023-11-28T16:57:53.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 -- start start 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42680c7f20 0x7f42680aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42680c8430 0x7f426814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4268151d80 0x7f4268144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680ab830 con 0x7f42680c8430 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680ab270 con 0x7f42680c7f20 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42680ab550 con 0x7f4268151d80 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42680c8430 0x7f426814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42680c8430 0x7f426814ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37912/0 (socket says 172.21.15.26:37912) 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 -- 172.21.15.26:0/1266596789 learned_addr learned my addr 172.21.15.26:0/1266596789 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426e49d640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42680c7f20 0x7f42680aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426ec9e640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4268151d80 0x7f4268144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 -- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4268151d80 msgr2=0x7f4268144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4268151d80 0x7f4268144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 -- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42680c7f20 msgr2=0x7f42680aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42680c7f20 0x7f42680aa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 -- 172.21.15.26:0/1266596789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260009a70 con 0x7f42680c8430 2023-11-28T16:57:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426ec9e640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4268151d80 0x7f4268144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f426dc9c640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42680c8430 0x7f426814ad80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f425800c420 tx=0x7f425800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f425effd640 1 -- 172.21.15.26:0/1266596789 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258005cf0 con 0x7f42680c8430 2023-11-28T16:57:53.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f425effd640 1 -- 172.21.15.26:0/1266596789 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258005e50 con 0x7f42680c8430 2023-11-28T16:57:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f425effd640 1 -- 172.21.15.26:0/1266596789 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42580072d0 con 0x7f42680c8430 2023-11-28T16:57:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4264009420 con 0x7f42680c8430 2023-11-28T16:57:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.569+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42681eed10 con 0x7f42680c8430 2023-11-28T16:57:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.573+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426804e890 con 0x7f42680c8430 2023-11-28T16:57:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.573+0000 7f425effd640 1 -- 172.21.15.26:0/1266596789 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4258007430 con 0x7f42680c8430 2023-11-28T16:57:53.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.573+0000 7f425effd640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f424c0668d0 0x7f424c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.573+0000 7f425effd640 1 -- 172.21.15.26:0/1266596789 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4258083610 con 0x7f42680c8430 2023-11-28T16:57:53.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.573+0000 7f426e49d640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f424c0668d0 0x7f424c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.573+0000 7f426e49d640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f424c0668d0 0x7f424c068d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42640ae000 tx=0x7f42640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.577+0000 7f425effd640 1 -- 172.21.15.26:0/1266596789 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4258050c40 con 0x7f42680c8430 2023-11-28T16:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.737+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42680aff40 con 0x7f42680c8430 2023-11-28T16:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.737+0000 7f425effd640 1 -- 172.21.15.26:0/1266596789 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42580170a0 con 0x7f42680c8430 2023-11-28T16:57:53.743 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f424c0668d0 msgr2=0x7f424c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f424c0668d0 0x7f424c068d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42640ae000 tx=0x7f42640a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42680c8430 msgr2=0x7f426814ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42680c8430 0x7f426814ad80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f425800c420 tx=0x7f425800c8e0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 shutdown_connections 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f424c0668d0 0x7f424c068d90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4268151d80 0x7f4268144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42680c8430 0x7f426814ad80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 --2- 172.21.15.26:0/1266596789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42680c7f20 0x7f42680aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 >> 172.21.15.26:0/1266596789 conn(0x7f42680abd00 msgr2=0x7f42680ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 shutdown_connections 2023-11-28T16:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.741+0000 7f4270701640 1 -- 172.21.15.26:0/1266596789 wait complete. 2023-11-28T16:57:53.763 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T16:57:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa313efe640 1 Processor -- start 2023-11-28T16:57:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa313efe640 1 -- start start 2023-11-28T16:57:53.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa313efe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa30c0c1ae0 0x7fa30c0c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa313efe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa30c0c3490 0x7fa30c06a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa313efe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c1551d0 con 0x7fa30c06a5a0 2023-11-28T16:57:53.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa313efe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c06e9c0 con 0x7fa30c0c1ae0 2023-11-28T16:57:53.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa313efe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0a86e0 con 0x7fa30c0c3490 2023-11-28T16:57:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa311499640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa30c0c1ae0 0x7fa30c0c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa311499640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa30c0c1ae0 0x7fa30c0c0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37920/0 (socket says 172.21.15.26:37920) 2023-11-28T16:57:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa311499640 1 -- 172.21.15.26:0/1790011837 learned_addr learned my addr 172.21.15.26:0/1790011837 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa31249b640 1 --2- 172.21.15.26:0/1790011837 >> v2:172.21.15.79:3300/0 conn(0x7fa30c0c3490 0x7fa30c06a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa311499640 1 -- 172.21.15.26:0/1790011837 >> v2:172.21.15.79:3300/0 conn(0x7fa30c0c3490 msgr2=0x7fa30c06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:53.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa311499640 1 --2- 172.21.15.26:0/1790011837 >> v2:172.21.15.79:3300/0 conn(0x7fa30c0c3490 0x7fa30c06a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa311499640 1 -- 172.21.15.26:0/1790011837 >> v1:172.21.15.79:6789/0 conn(0x7fa30c06a5a0 legacy=0x7fa30c0c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.905+0000 7fa311499640 1 -- 172.21.15.26:0/1790011837 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0c3940 con 0x7fa30c0c1ae0 2023-11-28T16:57:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa311499640 1 --2- 172.21.15.26:0/1790011837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0c20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa30c152290 tx=0x7fa2fc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f59f6c7795a272 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa310c98640 1 -- 172.21.15.26:0/1790011837 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0ab600 con 0x7fa30c0c1ae0 2023-11-28T16:57:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa310c98640 1 -- 172.21.15.26:0/1790011837 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0a7050 con 0x7fa30c0c1ae0 2023-11-28T16:57:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa310c98640 1 -- 172.21.15.26:0/1790011837 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0ab980 con 0x7fa30c0c1ae0 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 -- 172.21.15.26:0/1790011837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c0c1ae0 msgr2=0x7fa30c0c0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 --2- 172.21.15.26:0/1790011837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0c20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa30c152290 tx=0x7fa2fc01c500 comp rx=0 tx=0).stop 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 -- 172.21.15.26:0/1790011837 shutdown_connections 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 --2- 172.21.15.26:0/1790011837 >> v2:172.21.15.79:3300/0 conn(0x7fa30c0c3490 0x7fa30c06a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 --2- 172.21.15.26:0/1790011837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0c20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 -- 172.21.15.26:0/1790011837 >> 172.21.15.26:0/1790011837 conn(0x7fa30c0c3be0 msgr2=0x7fa30c0c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 -- 172.21.15.26:0/1790011837 shutdown_connections 2023-11-28T16:57:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 -- 172.21.15.26:0/1790011837 wait complete. 2023-11-28T16:57:53.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.909+0000 7fa313efe640 1 Processor -- start 2023-11-28T16:57:53.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 -- start start 2023-11-28T16:57:53.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c06a5a0 0x7fa30c1484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa30c0c3490 0x7fa30c1ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c1f0be0 con 0x7fa30c06a5a0 2023-11-28T16:57:53.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c14f530 con 0x7fa30c0c1ae0 2023-11-28T16:57:53.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0acf00 con 0x7fa30c0c3490 2023-11-28T16:57:53.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c06a5a0 0x7fa30c1484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c06a5a0 0x7fa30c1484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37924/0 (socket says 172.21.15.26:37924) 2023-11-28T16:57:53.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 -- 172.21.15.26:0/1063495039 learned_addr learned my addr 172.21.15.26:0/1063495039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:53.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 -- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa30c0c3490 msgr2=0x7fa30c1ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa30c0c3490 0x7fa30c1ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 -- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa30c0c1ae0 msgr2=0x7fa30c0c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:53.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311499640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 -- 172.21.15.26:0/1063495039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc0094d0 con 0x7fa30c06a5a0 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311499640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa311c9a640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c06a5a0 0x7fa30c1484e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c480 tx=0x7fa30800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa3027fc640 1 -- 172.21.15.26:0/1063495039 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308005220 con 0x7fa30c06a5a0 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa3027fc640 1 -- 172.21.15.26:0/1063495039 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308005380 con 0x7fa30c06a5a0 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa3027fc640 1 -- 172.21.15.26:0/1063495039 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308007270 con 0x7fa30c06a5a0 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c0acbd0 con 0x7fa30c06a5a0 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c152030 con 0x7fa30c06a5a0 2023-11-28T16:57:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.913+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c04e890 con 0x7fa30c06a5a0 2023-11-28T16:57:53.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.917+0000 7fa3027fc640 1 -- 172.21.15.26:0/1063495039 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3080073d0 con 0x7fa30c06a5a0 2023-11-28T16:57:53.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.917+0000 7fa3027fc640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa2f0066900 0x7fa2f0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:53.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.917+0000 7fa3027fc640 1 -- 172.21.15.26:0/1063495039 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3080839a0 con 0x7fa30c06a5a0 2023-11-28T16:57:53.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.917+0000 7fa311499640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa2f0066900 0x7fa2f0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:53.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.917+0000 7fa311499640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa2f0066900 0x7fa2f0068dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0ad000 tx=0x7fa2fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:53.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:53.921+0000 7fa3027fc640 1 -- 172.21.15.26:0/1063495039 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa308050f20 con 0x7fa30c06a5a0 2023-11-28T16:57:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.077+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa30c0721a0 con 0x7fa30c06a5a0 2023-11-28T16:57:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.077+0000 7fa3027fc640 1 -- 172.21.15.26:0/1063495039 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa308054540 con 0x7fa30c06a5a0 2023-11-28T16:57:54.083 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:54.083 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-11-28T16:57:54.083 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:57:54.083 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-11-28T16:57:54.084 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-11-28T16:57:54.084 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:57:54.084 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-11-28T16:57:54.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa2f0066900 msgr2=0x7fa2f0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:54.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa2f0066900 0x7fa2f0068dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0ad000 tx=0x7fa2fc008040 comp rx=0 tx=0).stop 2023-11-28T16:57:54.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c06a5a0 msgr2=0x7fa30c1484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c06a5a0 0x7fa30c1484e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c480 tx=0x7fa30800c940 comp rx=0 tx=0).stop 2023-11-28T16:57:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 shutdown_connections 2023-11-28T16:57:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa2f0066900 0x7fa2f0068dc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa30c0c3490 0x7fa30c1ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa30c0c1ae0 0x7fa30c0c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 --2- 172.21.15.26:0/1063495039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa30c06a5a0 0x7fa30c1484e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 >> 172.21.15.26:0/1063495039 conn(0x7fa30c0c3be0 msgr2=0x7fa30c06db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 shutdown_connections 2023-11-28T16:57:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.081+0000 7fa313efe640 1 -- 172.21.15.26:0/1063495039 wait complete. 2023-11-28T16:57:54.103 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T16:57:54.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T16:57:54.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f7581e9a640 1 Processor -- start 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f7581e9a640 1 -- start start 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f7581e9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f757c151e10 0x7f757c0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f7581e9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f757c0bd720 0x7f757c06c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f7581e9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c06bd20 con 0x7f757c0c4f50 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f7581e9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c1521f0 con 0x7f757c0bd720 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f7581e9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c155330 con 0x7f757c151e10 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f757c0bd720 0x7f757c06c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f757c0bd720 0x7f757c06c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37938/0 (socket says 172.21.15.26:37938) 2023-11-28T16:57:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757affd640 1 -- 172.21.15.26:0/2619882376 learned_addr learned my addr 172.21.15.26:0/2619882376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757b7fe640 1 --2- 172.21.15.26:0/2619882376 >> v2:172.21.15.79:3300/0 conn(0x7f757c151e10 0x7f757c0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757affd640 1 -- 172.21.15.26:0/2619882376 >> v2:172.21.15.79:3300/0 conn(0x7f757c151e10 msgr2=0x7f757c0c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757affd640 1 --2- 172.21.15.26:0/2619882376 >> v2:172.21.15.79:3300/0 conn(0x7f757c151e10 0x7f757c0c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757affd640 1 -- 172.21.15.26:0/2619882376 >> v1:172.21.15.79:6789/0 conn(0x7f757c0c4f50 legacy=0x7f757c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.249+0000 7f757affd640 1 -- 172.21.15.26:0/2619882376 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c155610 con 0x7f757c0bd720 2023-11-28T16:57:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f757affd640 1 --2- 172.21.15.26:0/2619882376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c06c1b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f757c0c7be0 tx=0x7f757001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d4224fdce446f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f757a7fc640 1 -- 172.21.15.26:0/2619882376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700ad680 con 0x7f757c0bd720 2023-11-28T16:57:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f757a7fc640 1 -- 172.21.15.26:0/2619882376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75700ad7e0 con 0x7f757c0bd720 2023-11-28T16:57:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f757a7fc640 1 -- 172.21.15.26:0/2619882376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700adb70 con 0x7f757c0bd720 2023-11-28T16:57:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 -- 172.21.15.26:0/2619882376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 msgr2=0x7f757c06c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 --2- 172.21.15.26:0/2619882376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c06c1b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f757c0c7be0 tx=0x7f757001c470 comp rx=0 tx=0).stop 2023-11-28T16:57:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 -- 172.21.15.26:0/2619882376 shutdown_connections 2023-11-28T16:57:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 --2- 172.21.15.26:0/2619882376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c06c1b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 --2- 172.21.15.26:0/2619882376 >> v2:172.21.15.79:3300/0 conn(0x7f757c151e10 0x7f757c0c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 -- 172.21.15.26:0/2619882376 >> 172.21.15.26:0/2619882376 conn(0x7f757c0ca090 msgr2=0x7f757c0ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:54.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 -- 172.21.15.26:0/2619882376 shutdown_connections 2023-11-28T16:57:54.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.253+0000 7f7581e9a640 1 -- 172.21.15.26:0/2619882376 wait complete. 2023-11-28T16:57:54.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 Processor -- start 2023-11-28T16:57:54.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 -- start start 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c0bde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c4f50 0x7f757c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c151e10 0x7f757c145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0adc60 con 0x7f757c0bd720 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c1ecf00 con 0x7f757c151e10 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f7581e9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c1f0510 con 0x7f757c0c4f50 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c0bde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c0bde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37952/0 (socket says 172.21.15.26:37952) 2023-11-28T16:57:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 -- 172.21.15.26:0/3261835770 learned_addr learned my addr 172.21.15.26:0/3261835770 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757bfff640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c151e10 0x7f757c145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757affd640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c4f50 0x7f757c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 -- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c4f50 msgr2=0x7f757c0be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c4f50 0x7f757c0be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 -- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c151e10 msgr2=0x7f757c145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c151e10 0x7f757c145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 -- 172.21.15.26:0/3261835770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700094d0 con 0x7f757c0bd720 2023-11-28T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.257+0000 7f757b7fe640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c0bde10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f756c00e870 tx=0x7f756c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7563fff640 1 -- 172.21.15.26:0/3261835770 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c009510 con 0x7f757c0bd720 2023-11-28T16:57:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7563fff640 1 -- 172.21.15.26:0/3261835770 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00eec0 con 0x7f757c0bd720 2023-11-28T16:57:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c1ed110 con 0x7f757c0bd720 2023-11-28T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7563fff640 1 -- 172.21.15.26:0/3261835770 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00cb40 con 0x7f757c0bd720 2023-11-28T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c1ed6d0 con 0x7f757c0bd720 2023-11-28T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c04e890 con 0x7f757c0bd720 2023-11-28T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7563fff640 1 -- 172.21.15.26:0/3261835770 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f756c00cca0 con 0x7f757c0bd720 2023-11-28T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7563fff640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f75680668d0 0x7f7568068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f7563fff640 1 -- 172.21.15.26:0/3261835770 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f756c084170 con 0x7f757c0bd720 2023-11-28T16:57:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.261+0000 7f757affd640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f75680668d0 0x7f7568068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.265+0000 7f757affd640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f75680668d0 0x7f7568068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f75700af000 tx=0x7f75700a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.265+0000 7f7563fff640 1 -- 172.21.15.26:0/3261835770 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f756c0517b0 con 0x7f757c0bd720 2023-11-28T16:57:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:54.425+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f757c06d060 con 0x7f757c0bd720 2023-11-28T16:57:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7563fff640 1 -- 172.21.15.26:0/3261835770 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f756c054dd0 con 0x7f757c0bd720 2023-11-28T16:57:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-11-28T16:57:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f75680668d0 msgr2=0x7f7568068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f75680668d0 0x7f7568068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f75700af000 tx=0x7f75700a7000 comp rx=0 tx=0).stop 2023-11-28T16:57:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 msgr2=0x7f757c0bde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c0bde10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f756c00e870 tx=0x7f756c00ec70 comp rx=0 tx=0).stop 2023-11-28T16:57:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 shutdown_connections 2023-11-28T16:57:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c151e10 0x7f757c145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f75680668d0 0x7f7568068d90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c4f50 0x7f757c0be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 --2- 172.21.15.26:0/3261835770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0bd720 0x7f757c0bde10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 >> 172.21.15.26:0/3261835770 conn(0x7f757c0ca090 msgr2=0x7f757c0aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 shutdown_connections 2023-11-28T16:57:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.257+0000 7f7581e9a640 1 -- 172.21.15.26:0/3261835770 wait complete. 2023-11-28T16:57:55.289 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T16:57:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0cafe640 1 Processor -- start 2023-11-28T16:57:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0cafe640 1 -- start start 2023-11-28T16:57:55.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0cafe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080c0370 0x7f3f0806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0cafe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3f080a8470 0x7f3f0806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0cafe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0806de00 con 0x7f3f0814eaf0 2023-11-28T16:57:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0cafe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f08070390 con 0x7f3f080a8470 2023-11-28T16:57:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0cafe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0806db90 con 0x7f3f080c0370 2023-11-28T16:57:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3efffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080c0370 0x7f3f0806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3f0814eaf0 0x7f3f08151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:40060/0 (socket says 172.21.15.26:40060) 2023-11-28T16:57:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3efffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080c0370 0x7f3f0806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:53878/0 (socket says 172.21.15.26:53878) 2023-11-28T16:57:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f0659c640 1 -- 172.21.15.26:0/1354710940 learned_addr learned my addr 172.21.15.26:0/1354710940 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.437+0000 7f3f06d9d640 1 --2- 172.21.15.26:0/1354710940 >> v2:172.21.15.79:3300/0 conn(0x7f3f080a8470 0x7f3f0806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3efffff640 1 -- 172.21.15.26:0/1354710940 >> v2:172.21.15.79:3300/0 conn(0x7f3f080a8470 msgr2=0x7f3f0806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3efffff640 1 --2- 172.21.15.26:0/1354710940 >> v2:172.21.15.79:3300/0 conn(0x7f3f080a8470 0x7f3f0806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3f05d9b640 1 -- 172.21.15.26:0/1354710940 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787866166 0 0) 0x7f3f0806de00 con 0x7f3f0814eaf0 2023-11-28T16:57:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3efffff640 1 -- 172.21.15.26:0/1354710940 >> v1:172.21.15.79:6789/0 conn(0x7f3f0814eaf0 legacy=0x7f3f08151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3efffff640 1 -- 172.21.15.26:0/1354710940 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0814eed0 con 0x7f3f080c0370 2023-11-28T16:57:55.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3efffff640 1 --2- 172.21.15.26:0/1354710940 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080c0370 0x7f3f0806d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000ba60 tx=0x7f3ef001ea30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6ebd0680bd3457a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:55.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3f05d9b640 1 -- 172.21.15.26:0/1354710940 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00a7b20 con 0x7f3f080c0370 2023-11-28T16:57:55.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3f05d9b640 1 -- 172.21.15.26:0/1354710940 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef00a7c80 con 0x7f3f080c0370 2023-11-28T16:57:55.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3f05d9b640 1 -- 172.21.15.26:0/1354710940 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00af440 con 0x7f3f080c0370 2023-11-28T16:57:55.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3f0cafe640 1 -- 172.21.15.26:0/1354710940 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080c0370 msgr2=0x7f3f0806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:55.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.441+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/1354710940 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080c0370 0x7f3f0806d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000ba60 tx=0x7f3ef001ea30 comp rx=0 tx=0).stop 2023-11-28T16:57:55.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- 172.21.15.26:0/1354710940 shutdown_connections 2023-11-28T16:57:55.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/1354710940 >> v2:172.21.15.79:3300/0 conn(0x7f3f080a8470 0x7f3f0806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/1354710940 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080c0370 0x7f3f0806d110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- 172.21.15.26:0/1354710940 >> 172.21.15.26:0/1354710940 conn(0x7f3f080c2a60 msgr2=0x7f3f080c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:55.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- 172.21.15.26:0/1354710940 shutdown_connections 2023-11-28T16:57:55.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- 172.21.15.26:0/1354710940 wait complete. 2023-11-28T16:57:55.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 Processor -- start 2023-11-28T16:57:55.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- start start 2023-11-28T16:57:55.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080a8470 0x7f3f08071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:55.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f080c0370 0x7f3f081ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:55.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0814eaf0 0x7f3f081ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:55.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080abc40 con 0x7f3f080c0370 2023-11-28T16:57:55.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080c53e0 con 0x7f3f0814eaf0 2023-11-28T16:57:55.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0cafe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f081ed7b0 con 0x7f3f080a8470 2023-11-28T16:57:55.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080a8470 0x7f3f08071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:55.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f080c0370 0x7f3f081ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:55.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f06d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0814eaf0 0x7f3f081ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:55.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f080c0370 0x7f3f081ecd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37956/0 (socket says 172.21.15.26:37956) 2023-11-28T16:57:55.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3f0659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080a8470 0x7f3f08071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:53888/0 (socket says 172.21.15.26:53888) 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 -- 172.21.15.26:0/4269579286 learned_addr learned my addr 172.21.15.26:0/4269579286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 -- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080a8470 msgr2=0x7f3f08071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080a8470 0x7f3f08071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 -- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0814eaf0 msgr2=0x7f3f081ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0814eaf0 0x7f3f081ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 -- 172.21.15.26:0/4269579286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef000b6c0 con 0x7f3f080c0370 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.445+0000 7f3efffff640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f080c0370 0x7f3f081ecd30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00b2040 tx=0x7f3ef001b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3efeffd640 1 -- 172.21.15.26:0/4269579286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00b8660 con 0x7f3f080c0370 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3efeffd640 1 -- 172.21.15.26:0/4269579286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef00b87e0 con 0x7f3f080c0370 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f081f11b0 con 0x7f3f080c0370 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3efeffd640 1 -- 172.21.15.26:0/4269579286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00b8b90 con 0x7f3f080c0370 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f080ab960 con 0x7f3f080c0370 2023-11-28T16:57:55.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0804e890 con 0x7f3f080c0370 2023-11-28T16:57:55.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3efeffd640 1 -- 172.21.15.26:0/4269579286 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3ef00b6070 con 0x7f3f080c0370 2023-11-28T16:57:55.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3efeffd640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3ee80668d0 0x7f3ee8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:55.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3efeffd640 1 -- 172.21.15.26:0/4269579286 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3ef011fac0 con 0x7f3f080c0370 2023-11-28T16:57:55.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.449+0000 7f3f0659c640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3ee80668d0 0x7f3ee8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:55.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.453+0000 7f3f0659c640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3ee80668d0 0x7f3ee8068d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000f70 tx=0x7f3ef8007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:55.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.453+0000 7f3efeffd640 1 -- 172.21.15.26:0/4269579286 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ef00ed100 con 0x7f3f080c0370 2023-11-28T16:57:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:55.613+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3f08150f70 con 0x7f3f080c0370 2023-11-28T16:57:56.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.265+0000 7f3efeffd640 1 -- 172.21.15.26:0/4269579286 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3ef00f0720 con 0x7f3f080c0370 2023-11-28T16:57:56.268 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-11-28T16:57:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3ee80668d0 msgr2=0x7f3ee8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3ee80668d0 0x7f3ee8068d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000f70 tx=0x7f3ef8007df0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f080c0370 msgr2=0x7f3f081ecd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f080c0370 0x7f3f081ecd30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00b2040 tx=0x7f3ef001b7d0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 shutdown_connections 2023-11-28T16:57:56.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0814eaf0 0x7f3f081ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f080c0370 0x7f3f081ecd30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3ee80668d0 0x7f3ee8068d90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 --2- 172.21.15.26:0/4269579286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f080a8470 0x7f3f08071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 >> 172.21.15.26:0/4269579286 conn(0x7f3f080c2a60 msgr2=0x7f3f08070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 shutdown_connections 2023-11-28T16:57:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.269+0000 7f3f0cafe640 1 -- 172.21.15.26:0/4269579286 wait complete. 2023-11-28T16:57:56.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T16:57:56.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f244e679640 1 Processor -- start 2023-11-28T16:57:56.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f244e679640 1 -- start start 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f244e679640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f24480c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f244e679640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24480c8430 0x7f244806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f244e679640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244806cf70 con 0x7f24480c7f20 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f244e679640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448152160 con 0x7f24480c8430 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f244e679640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480c6a30 con 0x7f2448151d80 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f24477fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24480c8430 0x7f244806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f24477fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24480c8430 0x7f244806b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37966/0 (socket says 172.21.15.26:37966) 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f24477fe640 1 -- 172.21.15.26:0/4129752869 learned_addr learned my addr 172.21.15.26:0/4129752869 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f2447fff640 1 --2- 172.21.15.26:0/4129752869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f24480c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:56.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f24477fe640 1 -- 172.21.15.26:0/4129752869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 msgr2=0x7f24480c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:56.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f24477fe640 1 --2- 172.21.15.26:0/4129752869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f24480c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f24477fe640 1 -- 172.21.15.26:0/4129752869 >> v1:172.21.15.79:6789/0 conn(0x7f24480c7f20 legacy=0x7f244806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:56.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.457+0000 7f24477fe640 1 -- 172.21.15.26:0/4129752869 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480c72d0 con 0x7f24480c8430 2023-11-28T16:57:56.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f24477fe640 1 --2- 172.21.15.26:0/4129752869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c8430 0x7f244806b720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f243c009870 tx=0x7f243c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7683eaf5c39bd25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f2446ffd640 1 -- 172.21.15.26:0/4129752869 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0ab680 con 0x7f24480c8430 2023-11-28T16:57:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f2446ffd640 1 -- 172.21.15.26:0/4129752869 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c0ab7e0 con 0x7f24480c8430 2023-11-28T16:57:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f2446ffd640 1 -- 172.21.15.26:0/4129752869 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0abb70 con 0x7f24480c8430 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 -- 172.21.15.26:0/4129752869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c8430 msgr2=0x7f244806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 --2- 172.21.15.26:0/4129752869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c8430 0x7f244806b720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f243c009870 tx=0x7f243c01c480 comp rx=0 tx=0).stop 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 -- 172.21.15.26:0/4129752869 shutdown_connections 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 --2- 172.21.15.26:0/4129752869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c8430 0x7f244806b720 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 --2- 172.21.15.26:0/4129752869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f24480c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 -- 172.21.15.26:0/4129752869 >> 172.21.15.26:0/4129752869 conn(0x7f24480abd00 msgr2=0x7f24480ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 -- 172.21.15.26:0/4129752869 shutdown_connections 2023-11-28T16:57:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.461+0000 7f244e679640 1 -- 172.21.15.26:0/4129752869 wait complete. 2023-11-28T16:57:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 Processor -- start 2023-11-28T16:57:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 -- start start 2023-11-28T16:57:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c7f20 0x7f24481ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24480c8430 0x7f24480c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f2448149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480bffd0 con 0x7f24480c7f20 2023-11-28T16:57:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480bdb50 con 0x7f24480c8430 2023-11-28T16:57:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24481ed4e0 con 0x7f2448151d80 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c7f20 0x7f24481ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f24477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24480c8430 0x7f24480c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c7f20 0x7f24481ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37980/0 (socket says 172.21.15.26:37980) 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 -- 172.21.15.26:0/1787840299 learned_addr learned my addr 172.21.15.26:0/1787840299 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244cc16640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f2448149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 -- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 msgr2=0x7f2448149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f2448149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 -- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24480c8430 msgr2=0x7f24480c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24480c8430 0x7f24480c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 -- 172.21.15.26:0/1787840299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0094d0 con 0x7f24480c7f20 2023-11-28T16:57:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2447fff640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c7f20 0x7f24481ece90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f243800d800 tx=0x7f243800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2444ff9640 1 -- 172.21.15.26:0/1787840299 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243800b6c0 con 0x7f24480c7f20 2023-11-28T16:57:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2444ff9640 1 -- 172.21.15.26:0/1787840299 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243800b820 con 0x7f24480c7f20 2023-11-28T16:57:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f2444ff9640 1 -- 172.21.15.26:0/1787840299 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243800bb90 con 0x7f24480c7f20 2023-11-28T16:57:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24481ed7c0 con 0x7f24480c7f20 2023-11-28T16:57:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.465+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24481edd80 con 0x7f24480c7f20 2023-11-28T16:57:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.469+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244804e890 con 0x7f24480c7f20 2023-11-28T16:57:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.469+0000 7f2444ff9640 1 -- 172.21.15.26:0/1787840299 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f243800bcf0 con 0x7f24480c7f20 2023-11-28T16:57:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.469+0000 7f2444ff9640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24340668d0 0x7f2434068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.469+0000 7f2444ff9640 1 -- 172.21.15.26:0/1787840299 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f24380852d0 con 0x7f24480c7f20 2023-11-28T16:57:56.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.469+0000 7f24477fe640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24340668d0 0x7f2434068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:56.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.473+0000 7f24477fe640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24340668d0 0x7f2434068d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f243c0af000 tx=0x7f243c0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:56.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.473+0000 7f2444ff9640 1 -- 172.21.15.26:0/1787840299 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2438052690 con 0x7f24480c7f20 2023-11-28T16:57:56.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:56.665+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f244806cb20 con 0x7f24480c7f20 2023-11-28T16:57:57.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.281+0000 7f2444ff9640 1 -- 172.21.15.26:0/1787840299 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2438055cb0 con 0x7f24480c7f20 2023-11-28T16:57:57.286 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 8 and data pool 9 2023-11-28T16:57:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24340668d0 msgr2=0x7f2434068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24340668d0 0x7f2434068d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f243c0af000 tx=0x7f243c0b6040 comp rx=0 tx=0).stop 2023-11-28T16:57:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c7f20 msgr2=0x7f24481ece90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c7f20 0x7f24481ece90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f243800d800 tx=0x7f243800dcc0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 shutdown_connections 2023-11-28T16:57:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24340668d0 0x7f2434068d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2448151d80 0x7f2448149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24480c8430 0x7f24480c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 --2- 172.21.15.26:0/1787840299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480c7f20 0x7f24481ece90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 >> 172.21.15.26:0/1787840299 conn(0x7f24480abd00 msgr2=0x7f24480aac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:57.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 shutdown_connections 2023-11-28T16:57:57.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.293+0000 7f244e679640 1 -- 172.21.15.26:0/1787840299 wait complete. 2023-11-28T16:57:57.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.481+0000 7fbb9f9c4640 1 Processor -- start 2023-11-28T16:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.481+0000 7fbb9f9c4640 1 -- start start 2023-11-28T16:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9f9c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb980c78e0 0x7fbb98160350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9f9c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980c70a0 con 0x7fbb981555d0 2023-11-28T16:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9f9c4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980c7380 con 0x7fbb980a6e50 2023-11-28T16:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9f9c4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9806c470 con 0x7fbb980c78e0 2023-11-28T16:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9d760640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbb981555d0 0x7fbb980c3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37934/0 (socket says 172.21.15.26:37934) 2023-11-28T16:57:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9d760640 1 -- 172.21.15.26:0/3617740504 learned_addr learned my addr 172.21.15.26:0/3617740504 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9df61640 1 --2- 172.21.15.26:0/3617740504 >> v2:172.21.15.79:3300/0 conn(0x7fbb980c78e0 0x7fbb98160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596700571 0 0) 0x7fbb980c70a0 con 0x7fbb981555d0 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb84003530 con 0x7fbb981555d0 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269887508 0 0) 0x7fbb980c7380 con 0x7fbb980a6e50 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb980c70a0 con 0x7fbb980a6e50 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9df61640 1 -- 172.21.15.26:0/3617740504 >> v1:172.21.15.79:6789/0 conn(0x7fbb980a6e50 legacy=0x7fbb98158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256054607 0 0) 0x7fbb84003530 con 0x7fbb981555d0 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9df61640 1 -- 172.21.15.26:0/3617740504 >> v1:172.21.15.26:6789/0 conn(0x7fbb981555d0 legacy=0x7fbb980c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.485+0000 7fbb9df61640 1 -- 172.21.15.26:0/3617740504 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9806c750 con 0x7fbb980c78e0 2023-11-28T16:57:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9df61640 1 --2- 172.21.15.26:0/3617740504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98160350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009d90 tx=0x7fbb9001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa729c500b21f228 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94001680 con 0x7fbb980c78e0 2023-11-28T16:57:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb900a6510 con 0x7fbb980c78e0 2023-11-28T16:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb8ffff640 1 -- 172.21.15.26:0/3617740504 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900a6880 con 0x7fbb980c78e0 2023-11-28T16:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/3617740504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 msgr2=0x7fbb98160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/3617740504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98160350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009d90 tx=0x7fbb9001c870 comp rx=0 tx=0).stop 2023-11-28T16:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/3617740504 shutdown_connections 2023-11-28T16:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/3617740504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98160350 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/3617740504 >> 172.21.15.26:0/3617740504 conn(0x7fbb980c4960 msgr2=0x7fbb980c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/3617740504 shutdown_connections 2023-11-28T16:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/3617740504 wait complete. 2023-11-28T16:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 Processor -- start 2023-11-28T16:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.489+0000 7fbb9f9c4640 1 -- start start 2023-11-28T16:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb980a6e50 0x7fbb9814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb981555d0 0x7fbb9814a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9814b820 con 0x7fbb980a6e50 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9813fd10 con 0x7fbb980c78e0 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb981430e0 con 0x7fbb981555d0 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9d760640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb980a6e50 0x7fbb9814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9d760640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb980a6e50 0x7fbb9814ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37982/0 (socket says 172.21.15.26:37982) 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9d760640 1 -- 172.21.15.26:0/114367981 learned_addr learned my addr 172.21.15.26:0/114367981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9cf5f640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9df61640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb981555d0 0x7fbb9814a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9cf5f640 1 -- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb981555d0 msgr2=0x7fbb9814a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9cf5f640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb981555d0 0x7fbb9814a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9cf5f640 1 -- 172.21.15.26:0/114367981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb980a6e50 msgr2=0x7fbb9814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9cf5f640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb980a6e50 0x7fbb9814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9cf5f640 1 -- 172.21.15.26:0/114367981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90009a70 con 0x7fbb980c78e0 2023-11-28T16:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9d760640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb980a6e50 0x7fbb9814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9cf5f640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98146de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c430 tx=0x7fbb8800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb8dffb640 1 -- 172.21.15.26:0/114367981 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880052d0 con 0x7fbb980c78e0 2023-11-28T16:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb8dffb640 1 -- 172.21.15.26:0/114367981 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88005430 con 0x7fbb980c78e0 2023-11-28T16:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb8dffb640 1 -- 172.21.15.26:0/114367981 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88003840 con 0x7fbb980c78e0 2023-11-28T16:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9814b1d0 con 0x7fbb980c78e0 2023-11-28T16:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9814f260 con 0x7fbb980c78e0 2023-11-28T16:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98067a40 con 0x7fbb980c78e0 2023-11-28T16:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.493+0000 7fbb8dffb640 1 -- 172.21.15.26:0/114367981 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbb880039a0 con 0x7fbb980c78e0 2023-11-28T16:57:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.497+0000 7fbb8dffb640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbb7c0668d0 0x7fbb7c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.497+0000 7fbb8dffb640 1 -- 172.21.15.26:0/114367981 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb88083960 con 0x7fbb980c78e0 2023-11-28T16:57:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.497+0000 7fbb9d760640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbb7c0668d0 0x7fbb7c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.497+0000 7fbb9d760640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbb7c0668d0 0x7fbb7c068d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb94001ec0 tx=0x7fbb94001720 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:57.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.501+0000 7fbb8dffb640 1 -- 172.21.15.26:0/114367981 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb88050ce0 con 0x7fbb980c78e0 2023-11-28T16:57:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb9814b990 con 0x7fbb980c78e0 2023-11-28T16:57:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb8dffb640 1 -- 172.21.15.26:0/114367981 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16506 (secure 0 0 0) 0x7fbb88017090 con 0x7fbb980c78e0 2023-11-28T16:57:57.664 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:57.664 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":49,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:56.667955+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbb7c0668d0 msgr2=0x7fbb7c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbb7c0668d0 0x7fbb7c068d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb94001ec0 tx=0x7fbb94001720 comp rx=0 tx=0).stop 2023-11-28T16:57:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 msgr2=0x7fbb98146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98146de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c430 tx=0x7fbb8800c8f0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 shutdown_connections 2023-11-28T16:57:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbb7c0668d0 0x7fbb7c068d90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb981555d0 0x7fbb9814a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980c78e0 0x7fbb98146de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 --2- 172.21.15.26:0/114367981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb980a6e50 0x7fbb9814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 >> 172.21.15.26:0/114367981 conn(0x7fbb980c4960 msgr2=0x7fbb980a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 shutdown_connections 2023-11-28T16:57:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.661+0000 7fbb9f9c4640 1 -- 172.21.15.26:0/114367981 wait complete. 2023-11-28T16:57:57.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:57:57.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.825+0000 7fc769980640 1 Processor -- start 2023-11-28T16:57:57.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.825+0000 7fc769980640 1 -- start start 2023-11-28T16:57:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.825+0000 7fc769980640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7640c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.825+0000 7fc769980640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7640c1ae0 0x7fc76406a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.825+0000 7fc769980640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7641551d0 con 0x7fc7640c0510 2023-11-28T16:57:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.825+0000 7fc769980640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76406e9c0 con 0x7fc7640c1ae0 2023-11-28T16:57:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.825+0000 7fc769980640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640a86e0 con 0x7fc76406a5a0 2023-11-28T16:57:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc7637fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc7640c0510 0x7fc7640c09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37946/0 (socket says 172.21.15.26:37946) 2023-11-28T16:57:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc7637fe640 1 -- 172.21.15.26:0/4151267482 learned_addr learned my addr 172.21.15.26:0/4151267482 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc762ffd640 1 --2- 172.21.15.26:0/4151267482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7640c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc75bfff640 1 --2- 172.21.15.26:0/4151267482 >> v2:172.21.15.79:3300/0 conn(0x7fc7640c1ae0 0x7fc76406a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc7627fc640 1 -- 172.21.15.26:0/4151267482 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61705892 0 0) 0x7fc7641551d0 con 0x7fc7640c0510 2023-11-28T16:57:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc7627fc640 1 -- 172.21.15.26:0/4151267482 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc750003530 con 0x7fc7640c0510 2023-11-28T16:57:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc762ffd640 1 -- 172.21.15.26:0/4151267482 >> v2:172.21.15.79:3300/0 conn(0x7fc7640c1ae0 msgr2=0x7fc76406a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:57.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc762ffd640 1 --2- 172.21.15.26:0/4151267482 >> v2:172.21.15.79:3300/0 conn(0x7fc7640c1ae0 0x7fc76406a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc762ffd640 1 -- 172.21.15.26:0/4151267482 >> v1:172.21.15.26:6789/0 conn(0x7fc7640c0510 legacy=0x7fc7640c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc762ffd640 1 -- 172.21.15.26:0/4151267482 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764072840 con 0x7fc76406a5a0 2023-11-28T16:57:57.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.829+0000 7fc762ffd640 1 --2- 172.21.15.26:0/4151267482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7640c3490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7540097c0 tx=0x7fc75401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5656c5935c69a2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:57.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc7627fc640 1 -- 172.21.15.26:0/4151267482 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540ab600 con 0x7fc76406a5a0 2023-11-28T16:57:57.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc7627fc640 1 -- 172.21.15.26:0/4151267482 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7540a7050 con 0x7fc76406a5a0 2023-11-28T16:57:57.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc7627fc640 1 -- 172.21.15.26:0/4151267482 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540ab980 con 0x7fc76406a5a0 2023-11-28T16:57:57.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- 172.21.15.26:0/4151267482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 msgr2=0x7fc7640c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 --2- 172.21.15.26:0/4151267482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7640c3490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7540097c0 tx=0x7fc75401c480 comp rx=0 tx=0).stop 2023-11-28T16:57:57.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- 172.21.15.26:0/4151267482 shutdown_connections 2023-11-28T16:57:57.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 --2- 172.21.15.26:0/4151267482 >> v2:172.21.15.79:3300/0 conn(0x7fc7640c1ae0 0x7fc76406a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 --2- 172.21.15.26:0/4151267482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7640c3490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- 172.21.15.26:0/4151267482 >> 172.21.15.26:0/4151267482 conn(0x7fc7640c3be0 msgr2=0x7fc7640c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- 172.21.15.26:0/4151267482 shutdown_connections 2023-11-28T16:57:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- 172.21.15.26:0/4151267482 wait complete. 2023-11-28T16:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 Processor -- start 2023-11-28T16:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- start start 2023-11-28T16:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7641f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7640c0510 0x7fc7641ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7640c1ae0 0x7fc76414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76414db00 con 0x7fc7640c0510 2023-11-28T16:57:57.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc764148eb0 con 0x7fc7640c1ae0 2023-11-28T16:57:57.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc769980640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7641f11c0 con 0x7fc76406a5a0 2023-11-28T16:57:57.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc75bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7640c0510 0x7fc7641ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc75bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7640c0510 0x7fc7641ece20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37992/0 (socket says 172.21.15.26:37992) 2023-11-28T16:57:57.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc75bfff640 1 -- 172.21.15.26:0/3319602149 learned_addr learned my addr 172.21.15.26:0/3319602149 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc7637fe640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7640c1ae0 0x7fc76414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc762ffd640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7641f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.833+0000 7fc75bfff640 1 -- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 msgr2=0x7fc7641f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc75bfff640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7641f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc75bfff640 1 -- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7640c1ae0 msgr2=0x7fc76414a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc75bfff640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7640c1ae0 0x7fc76414a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc75bfff640 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc754009420 con 0x7fc7640c0510 2023-11-28T16:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc7637fe640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7640c1ae0 0x7fc76414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc75bfff640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7640c0510 0x7fc7641ece20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00e930 tx=0x7fc74c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc760ff9640 1 -- 172.21.15.26:0/3319602149 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c009690 con 0x7fc7640c0510 2023-11-28T16:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc760ff9640 1 -- 172.21.15.26:0/3319602149 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00ca00 con 0x7fc7640c0510 2023-11-28T16:57:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc760ff9640 1 -- 172.21.15.26:0/3319602149 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00cd70 con 0x7fc7640c0510 2023-11-28T16:57:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7641f04c0 con 0x7fc7640c0510 2023-11-28T16:57:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76414d820 con 0x7fc7640c0510 2023-11-28T16:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc764155640 con 0x7fc7640c0510 2023-11-28T16:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc760ff9640 1 -- 172.21.15.26:0/3319602149 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc74c013470 con 0x7fc7640c0510 2023-11-28T16:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc760ff9640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7440668d0 0x7fc744068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.837+0000 7fc760ff9640 1 -- 172.21.15.26:0/3319602149 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc74c084970 con 0x7fc7640c0510 2023-11-28T16:57:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.841+0000 7fc762ffd640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7440668d0 0x7fc744068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.841+0000 7fc762ffd640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7440668d0 0x7fc744068d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc7540ad000 tx=0x7fc7540a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:57.841+0000 7fc760ff9640 1 -- 172.21.15.26:0/3319602149 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc764155640 con 0x7fc7640c0510 2023-11-28T16:57:58.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc764155640 con 0x7fc7640c0510 2023-11-28T16:57:58.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc760ff9640 1 -- 172.21.15.26:0/3319602149 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16506 (secure 0 0 0) 0x7fc764155640 con 0x7fc7640c0510 2023-11-28T16:57:58.004 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:57:58.004 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":49,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:56.667955+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:57:58.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7440668d0 msgr2=0x7fc744068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:58.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7440668d0 0x7fc744068d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc7540ad000 tx=0x7fc7540a6000 comp rx=0 tx=0).stop 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7640c0510 msgr2=0x7fc7641ece20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7640c0510 0x7fc7641ece20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00e930 tx=0x7fc74c00edf0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 shutdown_connections 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7640c1ae0 0x7fc76414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7640c0510 0x7fc7641ece20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc7440668d0 0x7fc744068d90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc76406a5a0 0x7fc7641f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.001+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 >> 172.21.15.26:0/3319602149 conn(0x7fc7640c3be0 msgr2=0x7fc7640a90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.005+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 shutdown_connections 2023-11-28T16:57:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.005+0000 7fc769980640 1 -- 172.21.15.26:0/3319602149 wait complete. 2023-11-28T16:57:58.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T16:57:58.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.169+0000 7ff0711f5640 1 Processor -- start 2023-11-28T16:57:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.169+0000 7ff0711f5640 1 -- start start 2023-11-28T16:57:58.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff0711f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:58.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff0711f5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff06c156600 0x7ff06c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:58.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff0711f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c152d90 con 0x7ff06c14fb30 2023-11-28T16:57:58.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff0711f5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c152480 con 0x7ff06c156600 2023-11-28T16:57:58.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff0711f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0a9760 con 0x7ff06c0a86d0 2023-11-28T16:57:58.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:58.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff063fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff06c156600 0x7ff06c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:58.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff06b59e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff06c14fb30 0x7ff06c0aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:40086/0 (socket says 172.21.15.26:40086) 2023-11-28T16:57:58.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c0a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:53950/0 (socket says 172.21.15.26:53950) 2023-11-28T16:57:58.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff06b59e640 1 -- 172.21.15.26:0/3326623929 learned_addr learned my addr 172.21.15.26:0/3326623929 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:57:58.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff063fff640 1 -- 172.21.15.26:0/3326623929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 msgr2=0x7ff06c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:58.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff06a59c640 1 -- 172.21.15.26:0/3326623929 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014007955 0 0) 0x7ff06c152d90 con 0x7ff06c14fb30 2023-11-28T16:57:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff063fff640 1 --2- 172.21.15.26:0/3326623929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff063fff640 1 -- 172.21.15.26:0/3326623929 >> v1:172.21.15.79:6789/0 conn(0x7ff06c14fb30 legacy=0x7ff06c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff063fff640 1 -- 172.21.15.26:0/3326623929 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c152740 con 0x7ff06c156600 2023-11-28T16:57:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.173+0000 7ff06ad9d640 1 --2- 172.21.15.26:0/3326623929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:58.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff063fff640 1 --2- 172.21.15.26:0/3326623929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c156600 0x7ff06c14f5f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff0540097c0 tx=0x7ff05401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a20f5c18b6361d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:58.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff06a59c640 1 -- 172.21.15.26:0/3326623929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540ab600 con 0x7ff06c156600 2023-11-28T16:57:58.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff06a59c640 1 -- 172.21.15.26:0/3326623929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0540a7050 con 0x7ff06c156600 2023-11-28T16:57:58.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff06a59c640 1 -- 172.21.15.26:0/3326623929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540ab980 con 0x7ff06c156600 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 -- 172.21.15.26:0/3326623929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c156600 msgr2=0x7ff06c14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 --2- 172.21.15.26:0/3326623929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c156600 0x7ff06c14f5f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff0540097c0 tx=0x7ff05401c480 comp rx=0 tx=0).stop 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 -- 172.21.15.26:0/3326623929 shutdown_connections 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 --2- 172.21.15.26:0/3326623929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c156600 0x7ff06c14f5f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 --2- 172.21.15.26:0/3326623929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 -- 172.21.15.26:0/3326623929 >> 172.21.15.26:0/3326623929 conn(0x7ff06c0c2a60 msgr2=0x7ff06c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 -- 172.21.15.26:0/3326623929 shutdown_connections 2023-11-28T16:57:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 -- 172.21.15.26:0/3326623929 wait complete. 2023-11-28T16:57:58.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 Processor -- start 2023-11-28T16:57:58.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 -- start start 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.177+0000 7ff0711f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c14fb30 0x7ff06c144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff06c156600 0x7ff06c144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c1493e0 con 0x7ff06c14fb30 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c06d5f0 con 0x7ff06c156600 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c1edb50 con 0x7ff06c0a86d0 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c14fb30 0x7ff06c144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c14fb30 0x7ff06c144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38006/0 (socket says 172.21.15.26:38006) 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 -- 172.21.15.26:0/695917208 learned_addr learned my addr 172.21.15.26:0/695917208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff06ad9d640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff06b59e640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff06c156600 0x7ff06c144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 -- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 msgr2=0x7ff06c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 -- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff06c156600 msgr2=0x7ff06c144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff06c156600 0x7ff06c144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 -- 172.21.15.26:0/695917208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c009420 con 0x7ff06c14fb30 2023-11-28T16:57:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff063fff640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c14fb30 0x7ff06c144a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff05401a0b0 tx=0x7ff054019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0637fe640 1 -- 172.21.15.26:0/695917208 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540b4400 con 0x7ff06c14fb30 2023-11-28T16:57:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0637fe640 1 -- 172.21.15.26:0/695917208 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0540b4580 con 0x7ff06c14fb30 2023-11-28T16:57:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0637fe640 1 -- 172.21.15.26:0/695917208 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540b4930 con 0x7ff06c14fb30 2023-11-28T16:57:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff054009420 con 0x7ff06c14fb30 2023-11-28T16:57:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c06d280 con 0x7ff06c14fb30 2023-11-28T16:57:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c04e890 con 0x7ff06c14fb30 2023-11-28T16:57:58.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.181+0000 7ff0637fe640 1 -- 172.21.15.26:0/695917208 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0540b2040 con 0x7ff06c14fb30 2023-11-28T16:57:58.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.185+0000 7ff0637fe640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff04c0668d0 0x7ff04c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:58.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.185+0000 7ff0637fe640 1 -- 172.21.15.26:0/695917208 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff05411e310 con 0x7ff06c14fb30 2023-11-28T16:57:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.185+0000 7ff06ad9d640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff04c0668d0 0x7ff04c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.185+0000 7ff06ad9d640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff04c0668d0 0x7ff04c068d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009cf0 tx=0x7ff05c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.189+0000 7ff0637fe640 1 -- 172.21.15.26:0/695917208 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0540eb5f0 con 0x7ff06c14fb30 2023-11-28T16:57:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:58.381+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff06c15c810 con 0x7ff06c14fb30 2023-11-28T16:57:59.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.293+0000 7ff0637fe640 1 -- 172.21.15.26:0/695917208 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0540b80b0 con 0x7ff06c14fb30 2023-11-28T16:57:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff04c0668d0 msgr2=0x7ff04c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff04c0668d0 0x7ff04c068d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009cf0 tx=0x7ff05c009190 comp rx=0 tx=0).stop 2023-11-28T16:57:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c14fb30 msgr2=0x7ff06c144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c14fb30 0x7ff06c144a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff05401a0b0 tx=0x7ff054019220 comp rx=0 tx=0).stop 2023-11-28T16:57:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 shutdown_connections 2023-11-28T16:57:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff06c156600 0x7ff06c144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff06c14fb30 0x7ff06c144a20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff04c0668d0 0x7ff04c068d90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 --2- 172.21.15.26:0/695917208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff06c0a86d0 0x7ff06c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 >> 172.21.15.26:0/695917208 conn(0x7ff06c0c2a60 msgr2=0x7ff06c14eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 shutdown_connections 2023-11-28T16:57:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.297+0000 7ff0711f5640 1 -- 172.21.15.26:0/695917208 wait complete. 2023-11-28T16:57:59.325 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T16:57:59.325 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T16:57:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.473+0000 7feddfd3e640 1 Processor -- start 2023-11-28T16:57:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.473+0000 7feddfd3e640 1 -- start start 2023-11-28T16:57:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddfd3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd806b5b0 0x7fedd806b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddfd3e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fedd80c09d0 0x7fedd80c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddfd3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedd80a5e70 0x7fedd80c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddfd3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd8151880 con 0x7fedd80a5e70 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddfd3e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd80c2f80 con 0x7fedd80c09d0 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddfd3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8150ee0 con 0x7fedd806b5b0 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedd80a5e70 0x7fedd80c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddd2d9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fedd80c09d0 0x7fedd80c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedd80a5e70 0x7fedd80c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38008/0 (socket says 172.21.15.26:38008) 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 -- 172.21.15.26:0/2678835873 learned_addr learned my addr 172.21.15.26:0/2678835873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedddada640 1 --2- 172.21.15.26:0/2678835873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd806b5b0 0x7fedd806b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 -- 172.21.15.26:0/2678835873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd806b5b0 msgr2=0x7fedd806b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 --2- 172.21.15.26:0/2678835873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd806b5b0 0x7fedd806b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 -- 172.21.15.26:0/2678835873 >> v2:172.21.15.79:3300/0 conn(0x7fedd80c09d0 msgr2=0x7fedd80c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:57:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 --2- 172.21.15.26:0/2678835873 >> v2:172.21.15.79:3300/0 conn(0x7fedd80c09d0 0x7fedd80c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 -- 172.21.15.26:0/2678835873 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd81511c0 con 0x7fedd80a5e70 2023-11-28T16:57:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7feddd2d9640 1 --2- 172.21.15.26:0/2678835873 >> v2:172.21.15.79:3300/0 conn(0x7fedd80c09d0 0x7fedd80c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:57:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.477+0000 7fedde2db640 1 --2- 172.21.15.26:0/2678835873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80a5e70 0x7fedd80c4b80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fedd80670a0 tx=0x7fedd001d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4536103d2bf13639 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddcad8640 1 -- 172.21.15.26:0/2678835873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd000a2d0 con 0x7fedd80a5e70 2023-11-28T16:57:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddcad8640 1 -- 172.21.15.26:0/2678835873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd00a67f0 con 0x7fedd80a5e70 2023-11-28T16:57:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddcad8640 1 -- 172.21.15.26:0/2678835873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00a6b80 con 0x7fedd80a5e70 2023-11-28T16:57:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- 172.21.15.26:0/2678835873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80a5e70 msgr2=0x7fedd80c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 --2- 172.21.15.26:0/2678835873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80a5e70 0x7fedd80c4b80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fedd80670a0 tx=0x7fedd001d9b0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- 172.21.15.26:0/2678835873 shutdown_connections 2023-11-28T16:57:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 --2- 172.21.15.26:0/2678835873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80a5e70 0x7fedd80c4b80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 --2- 172.21.15.26:0/2678835873 >> v2:172.21.15.79:3300/0 conn(0x7fedd80c09d0 0x7fedd80c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 --2- 172.21.15.26:0/2678835873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd806b5b0 0x7fedd806b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- 172.21.15.26:0/2678835873 >> 172.21.15.26:0/2678835873 conn(0x7fedd80c3240 msgr2=0x7fedd80c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:57:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- 172.21.15.26:0/2678835873 shutdown_connections 2023-11-28T16:57:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- 172.21.15.26:0/2678835873 wait complete. 2023-11-28T16:57:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 Processor -- start 2023-11-28T16:57:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- start start 2023-11-28T16:57:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd806b5b0 0x7fedd81538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd80a5e70 0x7fedd80bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80c09d0 0x7fedd8147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd814bad0 con 0x7fedd80c09d0 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8071ff0 con 0x7fedd806b5b0 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7feddfd3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80722d0 con 0x7fedd80a5e70 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.481+0000 7fedde2db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80c09d0 0x7fedd8147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80c09d0 0x7fedd8147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38010/0 (socket says 172.21.15.26:38010) 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 -- 172.21.15.26:0/3562594084 learned_addr learned my addr 172.21.15.26:0/3562594084 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7feddd2d9640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd80a5e70 0x7fedd80bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedddada640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd806b5b0 0x7fedd81538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 -- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd80a5e70 msgr2=0x7fedd80bfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:59.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd80a5e70 0x7fedd80bfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 -- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd806b5b0 msgr2=0x7fedd81538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:57:59.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd806b5b0 0x7fedd81538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:57:59.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 -- 172.21.15.26:0/3562594084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8009420 con 0x7fedd80c09d0 2023-11-28T16:57:59.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedde2db640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80c09d0 0x7fedd8147900 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fedd00b0040 tx=0x7fedd001a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedce7fc640 1 -- 172.21.15.26:0/3562594084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00a6e70 con 0x7fedd80c09d0 2023-11-28T16:57:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedce7fc640 1 -- 172.21.15.26:0/3562594084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0008500 con 0x7fedd80c09d0 2023-11-28T16:57:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd000ac40 con 0x7fedd80c09d0 2023-11-28T16:57:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedce7fc640 1 -- 172.21.15.26:0/3562594084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00088b0 con 0x7fedd80c09d0 2023-11-28T16:57:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd8072890 con 0x7fedd80c09d0 2023-11-28T16:57:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd814bc80 con 0x7fedd80c09d0 2023-11-28T16:57:59.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.485+0000 7fedce7fc640 1 -- 172.21.15.26:0/3562594084 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fedd0008a10 con 0x7fedd80c09d0 2023-11-28T16:57:59.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.489+0000 7fedce7fc640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedbc066900 0x7fedbc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:57:59.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.489+0000 7fedce7fc640 1 -- 172.21.15.26:0/3562594084 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedd011f5b0 con 0x7fedd80c09d0 2023-11-28T16:57:59.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.489+0000 7fedddada640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedbc066900 0x7fedbc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:57:59.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.489+0000 7fedddada640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedbc066900 0x7fedbc068dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009ae0 tx=0x7fedd4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:57:59.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.489+0000 7fedce7fc640 1 -- 172.21.15.26:0/3562594084 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fedd814bc80 con 0x7fedd80c09d0 2023-11-28T16:57:59.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:57:59.685+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fedd814bc80 con 0x7fedd80c09d0 2023-11-28T16:58:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.301+0000 7fedce7fc640 1 -- 172.21.15.26:0/3562594084 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fedd814bc80 con 0x7fedd80c09d0 2023-11-28T16:58:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedbc066900 msgr2=0x7fedbc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedbc066900 0x7fedbc068dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009ae0 tx=0x7fedd4009190 comp rx=0 tx=0).stop 2023-11-28T16:58:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80c09d0 msgr2=0x7fedd8147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80c09d0 0x7fedd8147900 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fedd00b0040 tx=0x7fedd001a750 comp rx=0 tx=0).stop 2023-11-28T16:58:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 shutdown_connections 2023-11-28T16:58:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd80c09d0 0x7fedd8147900 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedbc066900 0x7fedbc068dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd80a5e70 0x7fedd80bfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 --2- 172.21.15.26:0/3562594084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd806b5b0 0x7fedd81538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 >> 172.21.15.26:0/3562594084 conn(0x7fedd80c3240 msgr2=0x7fedd814ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 shutdown_connections 2023-11-28T16:58:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.305+0000 7feddfd3e640 1 -- 172.21.15.26:0/3562594084 wait complete. 2023-11-28T16:58:00.326 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T16:58:00.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.465+0000 7f785e2fe640 1 Processor -- start 2023-11-28T16:58:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.465+0000 7f785e2fe640 1 -- start start 2023-11-28T16:58:00.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785e2fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f785814e9d0 0x7f7858151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785e2fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78580a8470 0x7f785806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785e2fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785806d320 con 0x7f7858070b80 2023-11-28T16:58:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785e2fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78580721b0 con 0x7f78580a8470 2023-11-28T16:58:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785e2fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78580c2830 con 0x7f785814e9d0 2023-11-28T16:58:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f78577fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7858070b80 0x7f78580c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37954/0 (socket says 172.21.15.26:37954) 2023-11-28T16:58:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f78577fe640 1 -- 172.21.15.26:0/293371951 learned_addr learned my addr 172.21.15.26:0/293371951 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785c89b640 1 --2- 172.21.15.26:0/293371951 >> v2:172.21.15.26:3300/0 conn(0x7f78580a8470 0x7f785806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f7857fff640 1 --2- 172.21.15.26:0/293371951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f785814e9d0 0x7f7858151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f7856ffd640 1 -- 172.21.15.26:0/293371951 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274675922 0 0) 0x7f785806d320 con 0x7f7858070b80 2023-11-28T16:58:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f7856ffd640 1 -- 172.21.15.26:0/293371951 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7840003530 con 0x7f7858070b80 2023-11-28T16:58:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785c89b640 1 -- 172.21.15.26:0/293371951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f785814e9d0 msgr2=0x7f7858151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785c89b640 1 --2- 172.21.15.26:0/293371951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f785814e9d0 0x7f7858151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785c89b640 1 -- 172.21.15.26:0/293371951 >> v1:172.21.15.26:6789/0 conn(0x7f7858070b80 legacy=0x7f78580c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.469+0000 7f785c89b640 1 -- 172.21.15.26:0/293371951 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858072450 con 0x7f78580a8470 2023-11-28T16:58:00.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785c89b640 1 --2- 172.21.15.26:0/293371951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f785806d7b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb0f660cd3c325b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:00.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f7856ffd640 1 -- 172.21.15.26:0/293371951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500a5890 con 0x7f78580a8470 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f7856ffd640 1 -- 172.21.15.26:0/293371951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78500a59f0 con 0x7f78580a8470 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f7856ffd640 1 -- 172.21.15.26:0/293371951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500a5d80 con 0x7f78580a8470 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- 172.21.15.26:0/293371951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 msgr2=0x7f785806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 --2- 172.21.15.26:0/293371951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f785806d7b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785001c8c0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- 172.21.15.26:0/293371951 shutdown_connections 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 --2- 172.21.15.26:0/293371951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f785806d7b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 --2- 172.21.15.26:0/293371951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f785814e9d0 0x7f7858151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- 172.21.15.26:0/293371951 >> 172.21.15.26:0/293371951 conn(0x7f78580c2ad0 msgr2=0x7f78580c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- 172.21.15.26:0/293371951 shutdown_connections 2023-11-28T16:58:00.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- 172.21.15.26:0/293371951 wait complete. 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 Processor -- start 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- start start 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7858070b80 0x7f78580c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f78580ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f785814e9d0 0x7f78581ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78581ece20 con 0x7f78580a8470 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580c02e0 con 0x7f785814e9d0 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.473+0000 7f785e2fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785814aeb0 con 0x7f7858070b80 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f78580ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f78580ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38030/0 (socket says 172.21.15.26:38030) 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 -- 172.21.15.26:0/3027408531 learned_addr learned my addr 172.21.15.26:0/3027408531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f785c89b640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f785814e9d0 0x7f78581ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f7857fff640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7858070b80 0x7f78580c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 -- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7858070b80 msgr2=0x7f78580c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7858070b80 0x7f78580c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 -- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f785814e9d0 msgr2=0x7f78581ed2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f785814e9d0 0x7f78581ed2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 -- 172.21.15.26:0/3027408531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850009a70 con 0x7f78580a8470 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f7857fff640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7858070b80 0x7f78580c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f78577fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f78580ab2c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f784c001ec0 tx=0x7f784c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f7854ff9640 1 -- 172.21.15.26:0/3027408531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c005d50 con 0x7f78580a8470 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f7854ff9640 1 -- 172.21.15.26:0/3027408531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c007070 con 0x7f78580a8470 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f7854ff9640 1 -- 172.21.15.26:0/3027408531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c007420 con 0x7f78580a8470 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785814b190 con 0x7f78580a8470 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78580c1d60 con 0x7f78580a8470 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78581ecf90 con 0x7f78580a8470 2023-11-28T16:58:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.477+0000 7f7854ff9640 1 -- 172.21.15.26:0/3027408531 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f784c007580 con 0x7f78580a8470 2023-11-28T16:58:00.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.481+0000 7f7854ff9640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7844066900 0x7f7844068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.481+0000 7f7854ff9640 1 -- 172.21.15.26:0/3027408531 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f784c0835f0 con 0x7f78580a8470 2023-11-28T16:58:00.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.481+0000 7f7857fff640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7844066900 0x7f7844068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.481+0000 7f7857fff640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7844066900 0x7f7844068dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f784800b9f0 tx=0x7f7848008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:00.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.481+0000 7f7854ff9640 1 -- 172.21.15.26:0/3027408531 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f784c050910 con 0x7f78580a8470 2023-11-28T16:58:00.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.673+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f785804e890 con 0x7f78580a8470 2023-11-28T16:58:00.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.673+0000 7f7854ff9640 1 -- 172.21.15.26:0/3027408531 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f784c053f30 con 0x7f78580a8470 2023-11-28T16:58:00.678 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:00.678 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:56.668279+0000","modified":"2023-11-28T16:57:59.688325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3225309020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3225309020},{"type":"v1","addr":"172.21.15.26:6835","nonce":3225309020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T16:58:00.678 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7844066900 msgr2=0x7f7844068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7844066900 0x7f7844068dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f784800b9f0 tx=0x7f7848008040 comp rx=0 tx=0).stop 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 msgr2=0x7f78580ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f78580ab2c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f784c001ec0 tx=0x7f784c00c960 comp rx=0 tx=0).stop 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 shutdown_connections 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f785814e9d0 0x7f78581ed2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78580a8470 0x7f78580ab2c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7844066900 0x7f7844068dc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 --2- 172.21.15.26:0/3027408531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7858070b80 0x7f78580c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 >> 172.21.15.26:0/3027408531 conn(0x7f78580c2ad0 msgr2=0x7f785813fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 shutdown_connections 2023-11-28T16:58:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.677+0000 7f785e2fe640 1 -- 172.21.15.26:0/3027408531 wait complete. 2023-11-28T16:58:00.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:00.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c5df0f640 1 Processor -- start 2023-11-28T16:58:00.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c5df0f640 1 -- start start 2023-11-28T16:58:00.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c5df0f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c5806bd00 0x7f4c58155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c5df0f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 0x7f4c580c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c5df0f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5806c440 con 0x7f4c5814ea60 2023-11-28T16:58:00.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c5df0f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c58154790 con 0x7f4c5806bd00 2023-11-28T16:58:00.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c5df0f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5806c6e0 con 0x7f4c580bf400 2023-11-28T16:58:00.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c577fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4c5814ea60 0x7f4c580700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37966/0 (socket says 172.21.15.26:37966) 2023-11-28T16:58:00.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.841+0000 7f4c577fe640 1 -- 172.21.15.26:0/1663396399 learned_addr learned my addr 172.21.15.26:0/1663396399 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c57fff640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 0x7f4c580c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c56ffd640 1 --2- 172.21.15.26:0/1663396399 >> v2:172.21.15.79:3300/0 conn(0x7f4c5806bd00 0x7f4c58155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376028481 0 0) 0x7f4c5806c440 con 0x7f4c5814ea60 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c40003530 con 0x7f4c5814ea60 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1427040334 0 0) 0x7f4c40003530 con 0x7f4c5814ea60 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 msgr2=0x7f4c580c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 0x7f4c580c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 >> v2:172.21.15.79:3300/0 conn(0x7f4c5806bd00 msgr2=0x7f4c58155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 --2- 172.21.15.26:0/1663396399 >> v2:172.21.15.79:3300/0 conn(0x7f4c5806bd00 0x7f4c58155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58154a50 con 0x7f4c5814ea60 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f4c48001680 con 0x7f4c5814ea60 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c56ffd640 1 --2- 172.21.15.26:0/1663396399 >> v2:172.21.15.79:3300/0 conn(0x7f4c5806bd00 0x7f4c58155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 >> v1:172.21.15.26:6789/0 conn(0x7f4c5814ea60 legacy=0x7f4c580700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c40003980 0x7f4c40003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 0x7f4c400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58154790 con 0x7f4c40004d10 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5806c6e0 con 0x7f4c40003980 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4000ba60 con 0x7f4c580bf400 2023-11-28T16:58:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c57fff640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c577fe640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c40003980 0x7f4c40003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c56ffd640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 0x7f4c400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c57fff640 1 -- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 msgr2=0x7f4c400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c57fff640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c580bf400 0x7f4c400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c57fff640 1 -- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c40003980 msgr2=0x7f4c40003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c57fff640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c40003980 0x7f4c40003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c57fff640 1 -- 172.21.15.26:0/1663396399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40003530 con 0x7f4c40004d10 2023-11-28T16:58:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.845+0000 7f4c577fe640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c40003980 0x7f4c40003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c57fff640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c40005190 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009fc0 tx=0x7f4c5001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f41d65db9e7536 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500a5a40 con 0x7f4c40004d10 2023-11-28T16:58:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000f040 con 0x7f4c40004d10 2023-11-28T16:58:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c567fc640 1 -- 172.21.15.26:0/1663396399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500a5de0 con 0x7f4c40004d10 2023-11-28T16:58:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 -- 172.21.15.26:0/1663396399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 msgr2=0x7f4c40005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 --2- 172.21.15.26:0/1663396399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c40005190 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009fc0 tx=0x7f4c5001cc30 comp rx=0 tx=0).stop 2023-11-28T16:58:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c57fff640 1 -- 172.21.15.26:0/1663396399 reap_dead start 2023-11-28T16:58:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 -- 172.21.15.26:0/1663396399 shutdown_connections 2023-11-28T16:58:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 -- 172.21.15.26:0/1663396399 >> 172.21.15.26:0/1663396399 conn(0x7f4c580c2ad0 msgr2=0x7f4c580c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 -- 172.21.15.26:0/1663396399 shutdown_connections 2023-11-28T16:58:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 -- 172.21.15.26:0/1663396399 wait complete. 2023-11-28T16:58:00.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 Processor -- start 2023-11-28T16:58:00.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 -- start start 2023-11-28T16:58:00.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c581587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.849+0000 7f4c5df0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5814d8a0 0x7f4c58142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c5df0f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c581430b0 0x7f4c58151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c5df0f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58152290 con 0x7f4c40004d10 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c5df0f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58147450 con 0x7f4c5814d8a0 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c5df0f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58150370 con 0x7f4c581430b0 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c581587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c581587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38042/0 (socket says 172.21.15.26:38042) 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 -- 172.21.15.26:0/3158564303 learned_addr learned my addr 172.21.15.26:0/3158564303 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c57fff640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c581430b0 0x7f4c58151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c56ffd640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5814d8a0 0x7f4c58142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 -- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c581430b0 msgr2=0x7f4c58151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c581430b0 0x7f4c58151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 -- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5814d8a0 msgr2=0x7f4c58142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5814d8a0 0x7f4c58142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 -- 172.21.15.26:0/3158564303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58150650 con 0x7f4c40004d10 2023-11-28T16:58:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c56ffd640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5814d8a0 0x7f4c58142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c577fe640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c581587c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4c480017b0 tx=0x7f4c480077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c3ffff640 1 -- 172.21.15.26:0/3158564303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800fa20 con 0x7f4c40004d10 2023-11-28T16:58:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c3ffff640 1 -- 172.21.15.26:0/3158564303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4800fb80 con 0x7f4c40004d10 2023-11-28T16:58:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c3ffff640 1 -- 172.21.15.26:0/3158564303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480133f0 con 0x7f4c40004d10 2023-11-28T16:58:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c58150930 con 0x7f4c40004d10 2023-11-28T16:58:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c58147120 con 0x7f4c40004d10 2023-11-28T16:58:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c581504b0 con 0x7f4c40004d10 2023-11-28T16:58:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.853+0000 7f4c3ffff640 1 -- 172.21.15.26:0/3158564303 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4c48013550 con 0x7f4c40004d10 2023-11-28T16:58:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.857+0000 7f4c3ffff640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c44066900 0x7f4c44068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:00.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.857+0000 7f4c3ffff640 1 -- 172.21.15.26:0/3158564303 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c48084670 con 0x7f4c40004d10 2023-11-28T16:58:00.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.857+0000 7f4c56ffd640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c44066900 0x7f4c44068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:00.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.857+0000 7f4c56ffd640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c44066900 0x7f4c44068dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4c58153950 tx=0x7f4c4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:00.861+0000 7f4c3ffff640 1 -- 172.21.15.26:0/3158564303 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c581504b0 con 0x7f4c40004d10 2023-11-28T16:58:01.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c581504b0 con 0x7f4c40004d10 2023-11-28T16:58:01.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c3ffff640 1 -- 172.21.15.26:0/3158564303 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f4c581504b0 con 0x7f4c40004d10 2023-11-28T16:58:01.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:01.020 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":50,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:58.282420+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:01.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c44066900 msgr2=0x7f4c44068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c44066900 0x7f4c44068dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4c58153950 tx=0x7f4c4c008040 comp rx=0 tx=0).stop 2023-11-28T16:58:01.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 msgr2=0x7f4c581587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c581587c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4c480017b0 tx=0x7f4c480077a0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 shutdown_connections 2023-11-28T16:58:01.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c44066900 0x7f4c44068dc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c581430b0 0x7f4c58151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5814d8a0 0x7f4c58142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 --2- 172.21.15.26:0/3158564303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c40004d10 0x7f4c581587c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 >> 172.21.15.26:0/3158564303 conn(0x7f4c580c2ad0 msgr2=0x7f4c5814caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:01.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.017+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 shutdown_connections 2023-11-28T16:58:01.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.021+0000 7f4c5df0f640 1 -- 172.21.15.26:0/3158564303 wait complete. 2023-11-28T16:58:01.042 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T16:58:01.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:58:01.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.181+0000 7fad61279640 1 Processor -- start 2023-11-28T16:58:01.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad61279640 1 -- start start 2023-11-28T16:58:01.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad61279640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad5c14e9d0 0x7fad5c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad61279640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad61279640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c06d320 con 0x7fad5c070b80 2023-11-28T16:58:01.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad61279640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c0721b0 con 0x7fad5c14e9d0 2023-11-28T16:58:01.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad61279640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0c2830 con 0x7fad5c0a8470 2023-11-28T16:58:01.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad53fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fad5c070b80 0x7fad5c0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37974/0 (socket says 172.21.15.26:37974) 2023-11-28T16:58:01.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad53fff640 1 -- 172.21.15.26:0/3427690219 learned_addr learned my addr 172.21.15.26:0/3427690219 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5affd640 1 --2- 172.21.15.26:0/3427690219 >> v2:172.21.15.79:3300/0 conn(0x7fad5c14e9d0 0x7fad5c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5b7fe640 1 --2- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5a7fc640 1 -- 172.21.15.26:0/3427690219 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924663721 0 0) 0x7fad5c06d320 con 0x7fad5c070b80 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5a7fc640 1 -- 172.21.15.26:0/3427690219 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad48003530 con 0x7fad5c070b80 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5affd640 1 -- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 msgr2=0x7fad5c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5affd640 1 --2- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5affd640 1 -- 172.21.15.26:0/3427690219 >> v1:172.21.15.26:6789/0 conn(0x7fad5c070b80 legacy=0x7fad5c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5affd640 1 -- 172.21.15.26:0/3427690219 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c072450 con 0x7fad5c14e9d0 2023-11-28T16:58:01.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.185+0000 7fad5a7fc640 1 -- 172.21.15.26:0/3427690219 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896734167 0 0) 0x7fad48003530 con 0x7fad5c070b80 2023-11-28T16:58:01.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad5affd640 1 --2- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c14e9d0 0x7fad5c151e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0097c0 tx=0x7fad4c01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b60bb7daa0ee3f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad5a7fc640 1 -- 172.21.15.26:0/3427690219 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44001680 con 0x7fad5c14e9d0 2023-11-28T16:58:01.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad5a7fc640 1 -- 172.21.15.26:0/3427690219 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c0a7050 con 0x7fad5c14e9d0 2023-11-28T16:58:01.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad5a7fc640 1 -- 172.21.15.26:0/3427690219 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0ab620 con 0x7fad5c14e9d0 2023-11-28T16:58:01.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 -- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c14e9d0 msgr2=0x7fad5c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 --2- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c14e9d0 0x7fad5c151e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0097c0 tx=0x7fad4c01c310 comp rx=0 tx=0).stop 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 -- 172.21.15.26:0/3427690219 shutdown_connections 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 --2- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 --2- 172.21.15.26:0/3427690219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c14e9d0 0x7fad5c151e60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 -- 172.21.15.26:0/3427690219 >> 172.21.15.26:0/3427690219 conn(0x7fad5c0c2ad0 msgr2=0x7fad5c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 -- 172.21.15.26:0/3427690219 shutdown_connections 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 -- 172.21.15.26:0/3427690219 wait complete. 2023-11-28T16:58:01.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 Processor -- start 2023-11-28T16:58:01.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.189+0000 7fad61279640 1 -- start start 2023-11-28T16:58:01.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c070b80 0x7fad5c1ede70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c0aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5c14e9d0 0x7fad5c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1ee3b0 con 0x7fad5c14e9d0 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c143350 con 0x7fad5c070b80 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c145630 con 0x7fad5c0a8470 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5c14e9d0 0x7fad5c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c070b80 0x7fad5c1ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5c14e9d0 0x7fad5c1415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38052/0 (socket says 172.21.15.26:38052) 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad53fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c0aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 -- 172.21.15.26:0/478034128 learned_addr learned my addr 172.21.15.26:0/478034128 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:01.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 -- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 msgr2=0x7fad5c0aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c0aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 -- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c070b80 msgr2=0x7fad5c1ede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c070b80 0x7fad5c1ede70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 -- 172.21.15.26:0/478034128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c009420 con 0x7fad5c14e9d0 2023-11-28T16:58:01.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad5b7fe640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5c14e9d0 0x7fad5c1415a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fad54009e30 tx=0x7fad5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad537fe640 1 -- 172.21.15.26:0/478034128 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54009ca0 con 0x7fad5c14e9d0 2023-11-28T16:58:01.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad537fe640 1 -- 172.21.15.26:0/478034128 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400f040 con 0x7fad5c14e9d0 2023-11-28T16:58:01.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c1435a0 con 0x7fad5c14e9d0 2023-11-28T16:58:01.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad537fe640 1 -- 172.21.15.26:0/478034128 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540146c0 con 0x7fad5c14e9d0 2023-11-28T16:58:01.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c144fe0 con 0x7fad5c14e9d0 2023-11-28T16:58:01.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.193+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c04e890 con 0x7fad5c14e9d0 2023-11-28T16:58:01.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.197+0000 7fad537fe640 1 -- 172.21.15.26:0/478034128 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fad54014820 con 0x7fad5c14e9d0 2023-11-28T16:58:01.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.197+0000 7fad537fe640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fad3c0668d0 0x7fad3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.197+0000 7fad537fe640 1 -- 172.21.15.26:0/478034128 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad54085260 con 0x7fad5c14e9d0 2023-11-28T16:58:01.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.197+0000 7fad5affd640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fad3c0668d0 0x7fad3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.197+0000 7fad5affd640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fad3c0668d0 0x7fad3c068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0ad000 tx=0x7fad4c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.201+0000 7fad537fe640 1 -- 172.21.15.26:0/478034128 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad54052540 con 0x7fad5c14e9d0 2023-11-28T16:58:01.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.353+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad5c15c570 con 0x7fad3c0668d0 2023-11-28T16:58:01.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.361+0000 7fad537fe640 1 -- 172.21.15.26:0/478034128 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274481 (secure 0 0 0) 0x7fad4c0ab500 con 0x7fad3c0668d0 2023-11-28T16:58:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:01.370 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:58:01.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fad3c0668d0 msgr2=0x7fad3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fad3c0668d0 0x7fad3c068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0ad000 tx=0x7fad4c0a6000 comp rx=0 tx=0).stop 2023-11-28T16:58:01.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5c14e9d0 msgr2=0x7fad5c1415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5c14e9d0 0x7fad5c1415a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fad54009e30 tx=0x7fad5400c490 comp rx=0 tx=0).stop 2023-11-28T16:58:01.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 shutdown_connections 2023-11-28T16:58:01.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad5c14e9d0 0x7fad5c1415a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fad3c0668d0 0x7fad3c068d90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad5c0a8470 0x7fad5c0aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 --2- 172.21.15.26:0/478034128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad5c070b80 0x7fad5c1ede70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 >> 172.21.15.26:0/478034128 conn(0x7fad5c0c2ad0 msgr2=0x7fad5c142590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:01.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 shutdown_connections 2023-11-28T16:58:01.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.365+0000 7fad61279640 1 -- 172.21.15.26:0/478034128 wait complete. 2023-11-28T16:58:01.389 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-11-28T16:57:59.598196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238284,"kb_used_data":5448,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736436,"statfs":{"total":773094113280,"available":772850110464,"internally_reserved":0,"allocated":5578752,"data_stored":2994128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.336357"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:56.259498+0000","last_change":"2023-11-28T16:57:56.259498+0000","last_active":"2023-11-28T16:57:56.259498+0000","last_peered":"2023-11-28T16:57:56.259498+0000","last_clean":"2023-11-28T16:57:56.259498+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:56.259498+0000","last_undegraded":"2023-11-28T16:57:56.259498+0000","last_fullsized":"2023-11-28T16:57:56.259498+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:57:55.251739+0000","last_change":"2023-11-28T16:57:55.251739+0000","last_active":"2023-11-28T16:57:55.251739+0000","last_peered":"2023-11-28T16:57:55.251739+0000","last_clean":"2023-11-28T16:57:55.251739+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:57:55.251739+0000","last_undegraded":"2023-11-28T16:57:55.251739+0000","last_fullsized":"2023-11-28T16:57:55.251739+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T16:57:52.250243+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:57:52.250243+0000","last_peered":"2023-11-28T16:57:52.250243+0000","last_clean":"2023-11-28T16:57:52.250243+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:57:52.250243+0000","last_undegraded":"2023-11-28T16:57:52.250243+0000","last_fullsized":"2023-11-28T16:57:52.250243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":817042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67600000000000005}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.44}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.84799999999999998}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.66100000000000003}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77600000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.79500000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.81000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":226674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.65600000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.501},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.40300000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.621},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64000000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.67000000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.52200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":226674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.73599999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.82199999999999995}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.878},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.92100000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":226674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.55000000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.63},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.751},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.72399999999999998}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.79700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":226674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.60199999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82299999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.0289999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.069}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":548864,"data_stored":226674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.497},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.45400000000000001}]},{"osd":1,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.40999999999999998}]},{"osd":3,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.54300000000000004}]},{"osd":4,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.91500000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.748},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":226674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.499}]},{"osd":3,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.76600000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.873},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.89400000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.69799999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1142784,"data_stored":817042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.2869999999999999,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.52000000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:58:01.394 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:58:01.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 Processor -- start 2023-11-28T16:58:01.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 -- start start 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2bec06a5a0 0x7f2bec0c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec06a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2bec0c0510 0x7f2bec0c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bec06e9c0 con 0x7f2bec06a5a0 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bec0a86e0 con 0x7f2bec0c0510 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf471d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0c39d0 con 0x7f2bec0c1ae0 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf24b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2bec06a5a0 0x7f2bec0c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf24b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2bec06a5a0 0x7f2bec0c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37328/0 (socket says 172.21.15.26:37328) 2023-11-28T16:58:01.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.569+0000 7f2bf24b9640 1 -- 172.21.15.26:0/1788271478 learned_addr learned my addr 172.21.15.26:0/1788271478 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:01.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf1cb8640 1 --2- 172.21.15.26:0/1788271478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec06a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf2cba640 1 --2- 172.21.15.26:0/1788271478 >> v2:172.21.15.79:3300/0 conn(0x7f2bec0c0510 0x7f2bec0c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf24b9640 1 -- 172.21.15.26:0/1788271478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 msgr2=0x7f2bec06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:01.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf24b9640 1 --2- 172.21.15.26:0/1788271478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec06a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf24b9640 1 -- 172.21.15.26:0/1788271478 >> v2:172.21.15.79:3300/0 conn(0x7f2bec0c0510 msgr2=0x7f2bec0c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:01.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf24b9640 1 --2- 172.21.15.26:0/1788271478 >> v2:172.21.15.79:3300/0 conn(0x7f2bec0c0510 0x7f2bec0c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf24b9640 1 -- 172.21.15.26:0/1788271478 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec1551d0 con 0x7f2bec06a5a0 2023-11-28T16:58:01.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf2cba640 1 --2- 172.21.15.26:0/1788271478 >> v2:172.21.15.79:3300/0 conn(0x7f2bec0c0510 0x7f2bec0c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:01.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf1cb8640 1 --2- 172.21.15.26:0/1788271478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec06a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:01.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf24b9640 1 --2- 172.21.15.26:0/1788271478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec06a5a0 0x7f2bec0c3490 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2bec070db0 tx=0x7f2be801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b407ca0486a378a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf14b7640 1 -- 172.21.15.26:0/1788271478 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80ab600 con 0x7f2bec06a5a0 2023-11-28T16:58:01.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf14b7640 1 -- 172.21.15.26:0/1788271478 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be80a7050 con 0x7f2bec06a5a0 2023-11-28T16:58:01.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf14b7640 1 -- 172.21.15.26:0/1788271478 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80ab980 con 0x7f2bec06a5a0 2023-11-28T16:58:01.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf471d640 1 -- 172.21.15.26:0/1788271478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec06a5a0 msgr2=0x7f2bec0c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.573+0000 7f2bf471d640 1 --2- 172.21.15.26:0/1788271478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec06a5a0 0x7f2bec0c3490 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2bec070db0 tx=0x7f2be801c500 comp rx=0 tx=0).stop 2023-11-28T16:58:01.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- 172.21.15.26:0/1788271478 shutdown_connections 2023-11-28T16:58:01.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 --2- 172.21.15.26:0/1788271478 >> v2:172.21.15.79:3300/0 conn(0x7f2bec0c0510 0x7f2bec0c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 --2- 172.21.15.26:0/1788271478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec06a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 --2- 172.21.15.26:0/1788271478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec06a5a0 0x7f2bec0c3490 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- 172.21.15.26:0/1788271478 >> 172.21.15.26:0/1788271478 conn(0x7f2bec0c3be0 msgr2=0x7f2bec0c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:01.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- 172.21.15.26:0/1788271478 shutdown_connections 2023-11-28T16:58:01.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- 172.21.15.26:0/1788271478 wait complete. 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 Processor -- start 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- start start 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bec06a5a0 0x7f2bec1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec0c0510 0x7f2bec136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec136d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0c6dd0 con 0x7f2bec0c0510 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec137290 con 0x7f2bec06a5a0 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf471d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0c61c0 con 0x7f2bec0c1ae0 2023-11-28T16:58:01.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec0c0510 0x7f2bec136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec0c0510 0x7f2bec136810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37336/0 (socket says 172.21.15.26:37336) 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 -- 172.21.15.26:0/24700951 learned_addr learned my addr 172.21.15.26:0/24700951 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf24b9640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bec06a5a0 0x7f2bec1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf2cba640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 -- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 msgr2=0x7f2bec136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec136d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 -- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bec06a5a0 msgr2=0x7f2bec1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bec06a5a0 0x7f2bec1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 -- 172.21.15.26:0/24700951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be80094d0 con 0x7f2bec0c0510 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2bf1cb8640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec0c0510 0x7f2bec136810 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00c7f0 tx=0x7f2bdc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2be2ffd640 1 -- 172.21.15.26:0/24700951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc00cea0 con 0x7f2bec0c0510 2023-11-28T16:58:01.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2be2ffd640 1 -- 172.21.15.26:0/24700951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc007a30 con 0x7f2bec0c0510 2023-11-28T16:58:01.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.577+0000 7f2be2ffd640 1 -- 172.21.15.26:0/24700951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc007de0 con 0x7f2bec0c0510 2023-11-28T16:58:01.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.581+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec0c5a90 con 0x7f2bec0c0510 2023-11-28T16:58:01.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.581+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec0c6710 con 0x7f2bec0c0510 2023-11-28T16:58:01.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.581+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec0c6f10 con 0x7f2bec0c0510 2023-11-28T16:58:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.581+0000 7f2be2ffd640 1 -- 172.21.15.26:0/24700951 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2bdc0113f0 con 0x7f2bec0c0510 2023-11-28T16:58:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.581+0000 7f2be2ffd640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2bd00668d0 0x7f2bd0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.581+0000 7f2be2ffd640 1 -- 172.21.15.26:0/24700951 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bdc0844f0 con 0x7f2bec0c0510 2023-11-28T16:58:01.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.581+0000 7f2bf24b9640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2bd00668d0 0x7f2bd0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.585+0000 7f2bf24b9640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2bd00668d0 0x7f2bd0068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2be80ad000 tx=0x7f2be80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.585+0000 7f2be2ffd640 1 -- 172.21.15.26:0/24700951 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2bec0c6f10 con 0x7f2bec0c0510 2023-11-28T16:58:01.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.741+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bec06b3c0 con 0x7f2bd00668d0 2023-11-28T16:58:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.749+0000 7f2be2ffd640 1 -- 172.21.15.26:0/24700951 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289281 (secure 0 0 0) 0x7f2be80ab760 con 0x7f2bd00668d0 2023-11-28T16:58:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:01.755 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:58:01.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2bd00668d0 msgr2=0x7f2bd0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2bd00668d0 0x7f2bd0068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2be80ad000 tx=0x7f2be80a6000 comp rx=0 tx=0).stop 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec0c0510 msgr2=0x7f2bec136810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec0c0510 0x7f2bec136810 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00c7f0 tx=0x7f2bdc00ccb0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 shutdown_connections 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2bd00668d0 0x7f2bd0068d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2bec0c1ae0 0x7f2bec136d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bec0c0510 0x7f2bec136810 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 --2- 172.21.15.26:0/24700951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bec06a5a0 0x7f2bec1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 >> 172.21.15.26:0/24700951 conn(0x7f2bec0c3be0 msgr2=0x7f2bec0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 shutdown_connections 2023-11-28T16:58:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.753+0000 7f2bf471d640 1 -- 172.21.15.26:0/24700951 wait complete. 2023-11-28T16:58:01.774 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-11-28T16:58:01.598523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238684,"kb_used_data":5860,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736036,"statfs":{"total":773094113280,"available":772849700864,"internally_reserved":0,"allocated":6000640,"data_stored":3181320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.719996+0000","last_change":"2023-11-28T16:57:57.311201+0000","last_active":"2023-11-28T16:57:58.719996+0000","last_peered":"2023-11-28T16:57:58.719996+0000","last_clean":"2023-11-28T16:57:58.719996+0000","last_became_active":"2023-11-28T16:57:57.310858+0000","last_became_peered":"2023-11-28T16:57:57.310858+0000","last_unstale":"2023-11-28T16:57:58.719996+0000","last_undegraded":"2023-11-28T16:57:58.719996+0000","last_fullsized":"2023-11-28T16:57:58.719996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:38.198969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291504+0000","last_change":"2023-11-28T16:57:57.307903+0000","last_active":"2023-11-28T16:57:58.291504+0000","last_peered":"2023-11-28T16:57:58.291504+0000","last_clean":"2023-11-28T16:57:58.291504+0000","last_became_active":"2023-11-28T16:57:57.305651+0000","last_became_peered":"2023-11-28T16:57:57.305651+0000","last_unstale":"2023-11-28T16:57:58.291504+0000","last_undegraded":"2023-11-28T16:57:58.291504+0000","last_fullsized":"2023-11-28T16:57:58.291504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:58.350824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421917+0000","last_change":"2023-11-28T16:57:57.295922+0000","last_active":"2023-11-28T16:57:59.421917+0000","last_peered":"2023-11-28T16:57:59.421917+0000","last_clean":"2023-11-28T16:57:59.421917+0000","last_became_active":"2023-11-28T16:57:57.295614+0000","last_became_peered":"2023-11-28T16:57:57.295614+0000","last_unstale":"2023-11-28T16:57:59.421917+0000","last_undegraded":"2023-11-28T16:57:59.421917+0000","last_fullsized":"2023-11-28T16:57:59.421917+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421269+0000","last_change":"2023-11-28T16:57:57.307103+0000","last_active":"2023-11-28T16:57:59.421269+0000","last_peered":"2023-11-28T16:57:59.421269+0000","last_clean":"2023-11-28T16:57:59.421269+0000","last_became_active":"2023-11-28T16:57:57.306791+0000","last_became_peered":"2023-11-28T16:57:57.306791+0000","last_unstale":"2023-11-28T16:57:59.421269+0000","last_undegraded":"2023-11-28T16:57:59.421269+0000","last_fullsized":"2023-11-28T16:57:59.421269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.719809+0000","last_change":"2023-11-28T16:57:57.294572+0000","last_active":"2023-11-28T16:57:58.719809+0000","last_peered":"2023-11-28T16:57:58.719809+0000","last_clean":"2023-11-28T16:57:58.719809+0000","last_became_active":"2023-11-28T16:57:57.294253+0000","last_became_peered":"2023-11-28T16:57:57.294253+0000","last_unstale":"2023-11-28T16:57:58.719809+0000","last_undegraded":"2023-11-28T16:57:58.719809+0000","last_fullsized":"2023-11-28T16:57:58.719809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:08.044829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.292825+0000","last_change":"2023-11-28T16:57:57.303700+0000","last_active":"2023-11-28T16:57:58.292825+0000","last_peered":"2023-11-28T16:57:58.292825+0000","last_clean":"2023-11-28T16:57:58.292825+0000","last_became_active":"2023-11-28T16:57:57.303377+0000","last_became_peered":"2023-11-28T16:57:57.303377+0000","last_unstale":"2023-11-28T16:57:58.292825+0000","last_undegraded":"2023-11-28T16:57:58.292825+0000","last_fullsized":"2023-11-28T16:57:58.292825+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295560+0000","last_change":"2023-11-28T16:57:57.290167+0000","last_active":"2023-11-28T16:57:58.295560+0000","last_peered":"2023-11-28T16:57:58.295560+0000","last_clean":"2023-11-28T16:57:58.295560+0000","last_became_active":"2023-11-28T16:57:57.289873+0000","last_became_peered":"2023-11-28T16:57:57.289873+0000","last_unstale":"2023-11-28T16:57:58.295560+0000","last_undegraded":"2023-11-28T16:57:58.295560+0000","last_fullsized":"2023-11-28T16:57:58.295560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:53.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290699+0000","last_change":"2023-11-28T16:57:57.294040+0000","last_active":"2023-11-28T16:57:58.290699+0000","last_peered":"2023-11-28T16:57:58.290699+0000","last_clean":"2023-11-28T16:57:58.290699+0000","last_became_active":"2023-11-28T16:57:57.293696+0000","last_became_peered":"2023-11-28T16:57:57.293696+0000","last_unstale":"2023-11-28T16:57:58.290699+0000","last_undegraded":"2023-11-28T16:57:58.290699+0000","last_fullsized":"2023-11-28T16:57:58.290699+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:45.988064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.296013+0000","last_change":"2023-11-28T16:57:57.291252+0000","last_active":"2023-11-28T16:57:58.296013+0000","last_peered":"2023-11-28T16:57:58.296013+0000","last_clean":"2023-11-28T16:57:58.296013+0000","last_became_active":"2023-11-28T16:57:57.290870+0000","last_became_peered":"2023-11-28T16:57:57.290870+0000","last_unstale":"2023-11-28T16:57:58.296013+0000","last_undegraded":"2023-11-28T16:57:58.296013+0000","last_fullsized":"2023-11-28T16:57:58.296013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:24.268675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418893+0000","last_change":"2023-11-28T16:57:57.293326+0000","last_active":"2023-11-28T16:57:59.418893+0000","last_peered":"2023-11-28T16:57:59.418893+0000","last_clean":"2023-11-28T16:57:59.418893+0000","last_became_active":"2023-11-28T16:57:57.292663+0000","last_became_peered":"2023-11-28T16:57:57.292663+0000","last_unstale":"2023-11-28T16:57:59.418893+0000","last_undegraded":"2023-11-28T16:57:59.418893+0000","last_fullsized":"2023-11-28T16:57:59.418893+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:07.257033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418964+0000","last_change":"2023-11-28T16:57:57.285037+0000","last_active":"2023-11-28T16:57:59.418964+0000","last_peered":"2023-11-28T16:57:59.418964+0000","last_clean":"2023-11-28T16:57:59.418964+0000","last_became_active":"2023-11-28T16:57:57.284722+0000","last_became_peered":"2023-11-28T16:57:57.284722+0000","last_unstale":"2023-11-28T16:57:59.418964+0000","last_undegraded":"2023-11-28T16:57:59.418964+0000","last_fullsized":"2023-11-28T16:57:59.418964+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:29.116162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.422184+0000","last_change":"2023-11-28T16:57:57.303913+0000","last_active":"2023-11-28T16:57:59.422184+0000","last_peered":"2023-11-28T16:57:59.422184+0000","last_clean":"2023-11-28T16:57:59.422184+0000","last_became_active":"2023-11-28T16:57:57.303625+0000","last_became_peered":"2023-11-28T16:57:57.303625+0000","last_unstale":"2023-11-28T16:57:59.422184+0000","last_undegraded":"2023-11-28T16:57:59.422184+0000","last_fullsized":"2023-11-28T16:57:59.422184+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421609+0000","last_change":"2023-11-28T16:57:57.305618+0000","last_active":"2023-11-28T16:57:59.421609+0000","last_peered":"2023-11-28T16:57:59.421609+0000","last_clean":"2023-11-28T16:57:59.421609+0000","last_became_active":"2023-11-28T16:57:57.305369+0000","last_became_peered":"2023-11-28T16:57:57.305369+0000","last_unstale":"2023-11-28T16:57:59.421609+0000","last_undegraded":"2023-11-28T16:57:59.421609+0000","last_fullsized":"2023-11-28T16:57:59.421609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:26.927795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295496+0000","last_change":"2023-11-28T16:57:57.286182+0000","last_active":"2023-11-28T16:57:58.295496+0000","last_peered":"2023-11-28T16:57:58.295496+0000","last_clean":"2023-11-28T16:57:58.295496+0000","last_became_active":"2023-11-28T16:57:57.285885+0000","last_became_peered":"2023-11-28T16:57:57.285885+0000","last_unstale":"2023-11-28T16:57:58.295496+0000","last_undegraded":"2023-11-28T16:57:58.295496+0000","last_fullsized":"2023-11-28T16:57:58.295496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:34.325761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295450+0000","last_change":"2023-11-28T16:57:57.288466+0000","last_active":"2023-11-28T16:57:58.295450+0000","last_peered":"2023-11-28T16:57:58.295450+0000","last_clean":"2023-11-28T16:57:58.295450+0000","last_became_active":"2023-11-28T16:57:57.288071+0000","last_became_peered":"2023-11-28T16:57:57.288071+0000","last_unstale":"2023-11-28T16:57:58.295450+0000","last_undegraded":"2023-11-28T16:57:58.295450+0000","last_fullsized":"2023-11-28T16:57:58.295450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:54.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.292897+0000","last_change":"2023-11-28T16:57:57.298522+0000","last_active":"2023-11-28T16:57:58.292897+0000","last_peered":"2023-11-28T16:57:58.292897+0000","last_clean":"2023-11-28T16:57:58.292897+0000","last_became_active":"2023-11-28T16:57:57.298241+0000","last_became_peered":"2023-11-28T16:57:57.298241+0000","last_unstale":"2023-11-28T16:57:58.292897+0000","last_undegraded":"2023-11-28T16:57:58.292897+0000","last_fullsized":"2023-11-28T16:57:58.292897+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291168+0000","last_change":"2023-11-28T16:57:57.306762+0000","last_active":"2023-11-28T16:57:58.291168+0000","last_peered":"2023-11-28T16:57:58.291168+0000","last_clean":"2023-11-28T16:57:58.291168+0000","last_became_active":"2023-11-28T16:57:57.306428+0000","last_became_peered":"2023-11-28T16:57:57.306428+0000","last_unstale":"2023-11-28T16:57:58.291168+0000","last_undegraded":"2023-11-28T16:57:58.291168+0000","last_fullsized":"2023-11-28T16:57:58.291168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:34.023526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421999+0000","last_change":"2023-11-28T16:57:57.301733+0000","last_active":"2023-11-28T16:57:59.421999+0000","last_peered":"2023-11-28T16:57:59.421999+0000","last_clean":"2023-11-28T16:57:59.421999+0000","last_became_active":"2023-11-28T16:57:57.301402+0000","last_became_peered":"2023-11-28T16:57:57.301402+0000","last_unstale":"2023-11-28T16:57:59.421999+0000","last_undegraded":"2023-11-28T16:57:59.421999+0000","last_fullsized":"2023-11-28T16:57:59.421999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:35.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.719912+0000","last_change":"2023-11-28T16:57:57.299228+0000","last_active":"2023-11-28T16:57:58.719912+0000","last_peered":"2023-11-28T16:57:58.719912+0000","last_clean":"2023-11-28T16:57:58.719912+0000","last_became_active":"2023-11-28T16:57:57.298919+0000","last_became_peered":"2023-11-28T16:57:57.298919+0000","last_unstale":"2023-11-28T16:57:58.719912+0000","last_undegraded":"2023-11-28T16:57:58.719912+0000","last_fullsized":"2023-11-28T16:57:58.719912+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:09.019656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290970+0000","last_change":"2023-11-28T16:57:57.299427+0000","last_active":"2023-11-28T16:57:58.290970+0000","last_peered":"2023-11-28T16:57:58.290970+0000","last_clean":"2023-11-28T16:57:58.290970+0000","last_became_active":"2023-11-28T16:57:57.299152+0000","last_became_peered":"2023-11-28T16:57:57.299152+0000","last_unstale":"2023-11-28T16:57:58.290970+0000","last_undegraded":"2023-11-28T16:57:58.290970+0000","last_fullsized":"2023-11-28T16:57:58.290970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:15.293843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420605+0000","last_change":"2023-11-28T16:57:57.293718+0000","last_active":"2023-11-28T16:57:59.420605+0000","last_peered":"2023-11-28T16:57:59.420605+0000","last_clean":"2023-11-28T16:57:59.420605+0000","last_became_active":"2023-11-28T16:57:57.293317+0000","last_became_peered":"2023-11-28T16:57:57.293317+0000","last_unstale":"2023-11-28T16:57:59.420605+0000","last_undegraded":"2023-11-28T16:57:59.420605+0000","last_fullsized":"2023-11-28T16:57:59.420605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290781+0000","last_change":"2023-11-28T16:57:57.307374+0000","last_active":"2023-11-28T16:57:58.290781+0000","last_peered":"2023-11-28T16:57:58.290781+0000","last_clean":"2023-11-28T16:57:58.290781+0000","last_became_active":"2023-11-28T16:57:57.305540+0000","last_became_peered":"2023-11-28T16:57:57.305540+0000","last_unstale":"2023-11-28T16:57:58.290781+0000","last_undegraded":"2023-11-28T16:57:58.290781+0000","last_fullsized":"2023-11-28T16:57:58.290781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:34.222003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420891+0000","last_change":"2023-11-28T16:57:57.300922+0000","last_active":"2023-11-28T16:57:59.420891+0000","last_peered":"2023-11-28T16:57:59.420891+0000","last_clean":"2023-11-28T16:57:59.420891+0000","last_became_active":"2023-11-28T16:57:57.300127+0000","last_became_peered":"2023-11-28T16:57:57.300127+0000","last_unstale":"2023-11-28T16:57:59.420891+0000","last_undegraded":"2023-11-28T16:57:59.420891+0000","last_fullsized":"2023-11-28T16:57:59.420891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420510+0000","last_change":"2023-11-28T16:57:57.307862+0000","last_active":"2023-11-28T16:57:59.420510+0000","last_peered":"2023-11-28T16:57:59.420510+0000","last_clean":"2023-11-28T16:57:59.420510+0000","last_became_active":"2023-11-28T16:57:57.307540+0000","last_became_peered":"2023-11-28T16:57:57.307540+0000","last_unstale":"2023-11-28T16:57:59.420510+0000","last_undegraded":"2023-11-28T16:57:59.420510+0000","last_fullsized":"2023-11-28T16:57:59.420510+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:36.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.720048+0000","last_change":"2023-11-28T16:57:57.284808+0000","last_active":"2023-11-28T16:57:58.720048+0000","last_peered":"2023-11-28T16:57:58.720048+0000","last_clean":"2023-11-28T16:57:58.720048+0000","last_became_active":"2023-11-28T16:57:57.284304+0000","last_became_peered":"2023-11-28T16:57:57.284304+0000","last_unstale":"2023-11-28T16:57:58.720048+0000","last_undegraded":"2023-11-28T16:57:58.720048+0000","last_fullsized":"2023-11-28T16:57:58.720048+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:56.940553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421279+0000","last_change":"2023-11-28T16:57:57.291693+0000","last_active":"2023-11-28T16:57:59.421279+0000","last_peered":"2023-11-28T16:57:59.421279+0000","last_clean":"2023-11-28T16:57:59.421279+0000","last_became_active":"2023-11-28T16:57:57.291320+0000","last_became_peered":"2023-11-28T16:57:57.291320+0000","last_unstale":"2023-11-28T16:57:59.421279+0000","last_undegraded":"2023-11-28T16:57:59.421279+0000","last_fullsized":"2023-11-28T16:57:59.421279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:21.959226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293022+0000","last_change":"2023-11-28T16:57:57.299843+0000","last_active":"2023-11-28T16:57:58.293022+0000","last_peered":"2023-11-28T16:57:58.293022+0000","last_clean":"2023-11-28T16:57:58.293022+0000","last_became_active":"2023-11-28T16:57:57.299266+0000","last_became_peered":"2023-11-28T16:57:57.299266+0000","last_unstale":"2023-11-28T16:57:58.293022+0000","last_undegraded":"2023-11-28T16:57:58.293022+0000","last_fullsized":"2023-11-28T16:57:58.293022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.719872+0000","last_change":"2023-11-28T16:57:57.294587+0000","last_active":"2023-11-28T16:57:58.719872+0000","last_peered":"2023-11-28T16:57:58.719872+0000","last_clean":"2023-11-28T16:57:58.719872+0000","last_became_active":"2023-11-28T16:57:57.294283+0000","last_became_peered":"2023-11-28T16:57:57.294283+0000","last_unstale":"2023-11-28T16:57:58.719872+0000","last_undegraded":"2023-11-28T16:57:58.719872+0000","last_fullsized":"2023-11-28T16:57:58.719872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:35.632692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291378+0000","last_change":"2023-11-28T16:57:57.298034+0000","last_active":"2023-11-28T16:57:58.291378+0000","last_peered":"2023-11-28T16:57:58.291378+0000","last_clean":"2023-11-28T16:57:58.291378+0000","last_became_active":"2023-11-28T16:57:57.297743+0000","last_became_peered":"2023-11-28T16:57:57.297743+0000","last_unstale":"2023-11-28T16:57:58.291378+0000","last_undegraded":"2023-11-28T16:57:58.291378+0000","last_fullsized":"2023-11-28T16:57:58.291378+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:26.295837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420959+0000","last_change":"2023-11-28T16:57:57.296838+0000","last_active":"2023-11-28T16:57:59.420959+0000","last_peered":"2023-11-28T16:57:59.420959+0000","last_clean":"2023-11-28T16:57:59.420959+0000","last_became_active":"2023-11-28T16:57:57.295762+0000","last_became_peered":"2023-11-28T16:57:57.295762+0000","last_unstale":"2023-11-28T16:57:59.420959+0000","last_undegraded":"2023-11-28T16:57:59.420959+0000","last_fullsized":"2023-11-28T16:57:59.420959+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.719682+0000","last_change":"2023-11-28T16:57:57.291516+0000","last_active":"2023-11-28T16:57:58.719682+0000","last_peered":"2023-11-28T16:57:58.719682+0000","last_clean":"2023-11-28T16:57:58.719682+0000","last_became_active":"2023-11-28T16:57:57.291201+0000","last_became_peered":"2023-11-28T16:57:57.291201+0000","last_unstale":"2023-11-28T16:57:58.719682+0000","last_undegraded":"2023-11-28T16:57:58.719682+0000","last_fullsized":"2023-11-28T16:57:58.719682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:23.828578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.292812+0000","last_change":"2023-11-28T16:57:57.308867+0000","last_active":"2023-11-28T16:57:58.292812+0000","last_peered":"2023-11-28T16:57:58.292812+0000","last_clean":"2023-11-28T16:57:58.292812+0000","last_became_active":"2023-11-28T16:57:57.307693+0000","last_became_peered":"2023-11-28T16:57:57.307693+0000","last_unstale":"2023-11-28T16:57:58.292812+0000","last_undegraded":"2023-11-28T16:57:58.292812+0000","last_fullsized":"2023-11-28T16:57:58.292812+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:24.984986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293069+0000","last_change":"2023-11-28T16:57:57.292539+0000","last_active":"2023-11-28T16:57:58.293069+0000","last_peered":"2023-11-28T16:57:58.293069+0000","last_clean":"2023-11-28T16:57:58.293069+0000","last_became_active":"2023-11-28T16:57:57.292189+0000","last_became_peered":"2023-11-28T16:57:57.292189+0000","last_unstale":"2023-11-28T16:57:58.293069+0000","last_undegraded":"2023-11-28T16:57:58.293069+0000","last_fullsized":"2023-11-28T16:57:58.293069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293368+0000","last_change":"2023-11-28T16:57:56.296007+0000","last_active":"2023-11-28T16:57:58.293368+0000","last_peered":"2023-11-28T16:57:58.293368+0000","last_clean":"2023-11-28T16:57:58.293368+0000","last_became_active":"2023-11-28T16:57:56.295636+0000","last_became_peered":"2023-11-28T16:57:56.295636+0000","last_unstale":"2023-11-28T16:57:58.293368+0000","last_undegraded":"2023-11-28T16:57:58.293368+0000","last_fullsized":"2023-11-28T16:57:58.293368+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:38.988857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.419113+0000","last_change":"2023-11-28T16:57:57.281906+0000","last_active":"2023-11-28T16:57:59.419113+0000","last_peered":"2023-11-28T16:57:59.419113+0000","last_clean":"2023-11-28T16:57:59.419113+0000","last_became_active":"2023-11-28T16:57:57.281593+0000","last_became_peered":"2023-11-28T16:57:57.281593+0000","last_unstale":"2023-11-28T16:57:59.419113+0000","last_undegraded":"2023-11-28T16:57:59.419113+0000","last_fullsized":"2023-11-28T16:57:59.419113+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291565+0000","last_change":"2023-11-28T16:57:56.301479+0000","last_active":"2023-11-28T16:57:58.291565+0000","last_peered":"2023-11-28T16:57:58.291565+0000","last_clean":"2023-11-28T16:57:58.291565+0000","last_became_active":"2023-11-28T16:57:56.301262+0000","last_became_peered":"2023-11-28T16:57:56.301262+0000","last_unstale":"2023-11-28T16:57:58.291565+0000","last_undegraded":"2023-11-28T16:57:58.291565+0000","last_fullsized":"2023-11-28T16:57:58.291565+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:34.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293336+0000","last_change":"2023-11-28T16:57:57.296485+0000","last_active":"2023-11-28T16:57:58.293336+0000","last_peered":"2023-11-28T16:57:58.293336+0000","last_clean":"2023-11-28T16:57:58.293336+0000","last_became_active":"2023-11-28T16:57:57.296210+0000","last_became_peered":"2023-11-28T16:57:57.296210+0000","last_unstale":"2023-11-28T16:57:58.293336+0000","last_undegraded":"2023-11-28T16:57:58.293336+0000","last_fullsized":"2023-11-28T16:57:58.293336+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293180+0000","last_change":"2023-11-28T16:57:56.284952+0000","last_active":"2023-11-28T16:57:58.293180+0000","last_peered":"2023-11-28T16:57:58.293180+0000","last_clean":"2023-11-28T16:57:58.293180+0000","last_became_active":"2023-11-28T16:57:56.284663+0000","last_became_peered":"2023-11-28T16:57:56.284663+0000","last_unstale":"2023-11-28T16:57:58.293180+0000","last_undegraded":"2023-11-28T16:57:58.293180+0000","last_fullsized":"2023-11-28T16:57:58.293180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293067+0000","last_change":"2023-11-28T16:57:57.299545+0000","last_active":"2023-11-28T16:57:58.293067+0000","last_peered":"2023-11-28T16:57:58.293067+0000","last_clean":"2023-11-28T16:57:58.293067+0000","last_became_active":"2023-11-28T16:57:57.298953+0000","last_became_peered":"2023-11-28T16:57:57.298953+0000","last_unstale":"2023-11-28T16:57:58.293067+0000","last_undegraded":"2023-11-28T16:57:58.293067+0000","last_fullsized":"2023-11-28T16:57:58.293067+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421655+0000","last_change":"2023-11-28T16:57:56.293038+0000","last_active":"2023-11-28T16:57:59.421655+0000","last_peered":"2023-11-28T16:57:59.421655+0000","last_clean":"2023-11-28T16:57:59.421655+0000","last_became_active":"2023-11-28T16:57:56.292443+0000","last_became_peered":"2023-11-28T16:57:56.292443+0000","last_unstale":"2023-11-28T16:57:59.421655+0000","last_undegraded":"2023-11-28T16:57:59.421655+0000","last_fullsized":"2023-11-28T16:57:59.421655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290919+0000","last_change":"2023-11-28T16:57:57.307182+0000","last_active":"2023-11-28T16:57:58.290919+0000","last_peered":"2023-11-28T16:57:58.290919+0000","last_clean":"2023-11-28T16:57:58.290919+0000","last_became_active":"2023-11-28T16:57:57.305143+0000","last_became_peered":"2023-11-28T16:57:57.305143+0000","last_unstale":"2023-11-28T16:57:58.290919+0000","last_undegraded":"2023-11-28T16:57:58.290919+0000","last_fullsized":"2023-11-28T16:57:58.290919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:16.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295477+0000","last_change":"2023-11-28T16:57:56.298135+0000","last_active":"2023-11-28T16:57:58.295477+0000","last_peered":"2023-11-28T16:57:58.295477+0000","last_clean":"2023-11-28T16:57:58.295477+0000","last_became_active":"2023-11-28T16:57:56.297267+0000","last_became_peered":"2023-11-28T16:57:56.297267+0000","last_unstale":"2023-11-28T16:57:58.295477+0000","last_undegraded":"2023-11-28T16:57:58.295477+0000","last_fullsized":"2023-11-28T16:57:58.295477+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:46.168912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291158+0000","last_change":"2023-11-28T16:57:57.310944+0000","last_active":"2023-11-28T16:57:58.291158+0000","last_peered":"2023-11-28T16:57:58.291158+0000","last_clean":"2023-11-28T16:57:58.291158+0000","last_became_active":"2023-11-28T16:57:57.306481+0000","last_became_peered":"2023-11-28T16:57:57.306481+0000","last_unstale":"2023-11-28T16:57:58.291158+0000","last_undegraded":"2023-11-28T16:57:58.291158+0000","last_fullsized":"2023-11-28T16:57:58.291158+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.181027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.292845+0000","last_change":"2023-11-28T16:57:56.294742+0000","last_active":"2023-11-28T16:57:58.292845+0000","last_peered":"2023-11-28T16:57:58.292845+0000","last_clean":"2023-11-28T16:57:58.292845+0000","last_became_active":"2023-11-28T16:57:56.294263+0000","last_became_peered":"2023-11-28T16:57:56.294263+0000","last_unstale":"2023-11-28T16:57:58.292845+0000","last_undegraded":"2023-11-28T16:57:58.292845+0000","last_fullsized":"2023-11-28T16:57:58.292845+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420641+0000","last_change":"2023-11-28T16:57:57.303350+0000","last_active":"2023-11-28T16:57:59.420641+0000","last_peered":"2023-11-28T16:57:59.420641+0000","last_clean":"2023-11-28T16:57:59.420641+0000","last_became_active":"2023-11-28T16:57:57.302817+0000","last_became_peered":"2023-11-28T16:57:57.302817+0000","last_unstale":"2023-11-28T16:57:59.420641+0000","last_undegraded":"2023-11-28T16:57:59.420641+0000","last_fullsized":"2023-11-28T16:57:59.420641+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:18.750912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420763+0000","last_change":"2023-11-28T16:57:56.289134+0000","last_active":"2023-11-28T16:57:59.420763+0000","last_peered":"2023-11-28T16:57:59.420763+0000","last_clean":"2023-11-28T16:57:59.420763+0000","last_became_active":"2023-11-28T16:57:56.288857+0000","last_became_peered":"2023-11-28T16:57:56.288857+0000","last_unstale":"2023-11-28T16:57:59.420763+0000","last_undegraded":"2023-11-28T16:57:59.420763+0000","last_fullsized":"2023-11-28T16:57:59.420763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:02.295044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290832+0000","last_change":"2023-11-28T16:57:57.296614+0000","last_active":"2023-11-28T16:57:58.290832+0000","last_peered":"2023-11-28T16:57:58.290832+0000","last_clean":"2023-11-28T16:57:58.290832+0000","last_became_active":"2023-11-28T16:57:57.296296+0000","last_became_peered":"2023-11-28T16:57:57.296296+0000","last_unstale":"2023-11-28T16:57:58.290832+0000","last_undegraded":"2023-11-28T16:57:58.290832+0000","last_fullsized":"2023-11-28T16:57:58.290832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:24.731578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295525+0000","last_change":"2023-11-28T16:57:56.297579+0000","last_active":"2023-11-28T16:57:58.295525+0000","last_peered":"2023-11-28T16:57:58.295525+0000","last_clean":"2023-11-28T16:57:58.295525+0000","last_became_active":"2023-11-28T16:57:56.297237+0000","last_became_peered":"2023-11-28T16:57:56.297237+0000","last_unstale":"2023-11-28T16:57:58.295525+0000","last_undegraded":"2023-11-28T16:57:58.295525+0000","last_fullsized":"2023-11-28T16:57:58.295525+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:53.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.296019+0000","last_change":"2023-11-28T16:57:57.288341+0000","last_active":"2023-11-28T16:57:58.296019+0000","last_peered":"2023-11-28T16:57:58.296019+0000","last_clean":"2023-11-28T16:57:58.296019+0000","last_became_active":"2023-11-28T16:57:57.286946+0000","last_became_peered":"2023-11-28T16:57:57.286946+0000","last_unstale":"2023-11-28T16:57:58.296019+0000","last_undegraded":"2023-11-28T16:57:58.296019+0000","last_fullsized":"2023-11-28T16:57:58.296019+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:03.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.422042+0000","last_change":"2023-11-28T16:57:56.303238+0000","last_active":"2023-11-28T16:57:59.422042+0000","last_peered":"2023-11-28T16:57:59.422042+0000","last_clean":"2023-11-28T16:57:59.422042+0000","last_became_active":"2023-11-28T16:57:56.302991+0000","last_became_peered":"2023-11-28T16:57:56.302991+0000","last_unstale":"2023-11-28T16:57:59.422042+0000","last_undegraded":"2023-11-28T16:57:59.422042+0000","last_fullsized":"2023-11-28T16:57:59.422042+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421983+0000","last_change":"2023-11-28T16:57:57.292344+0000","last_active":"2023-11-28T16:57:59.421983+0000","last_peered":"2023-11-28T16:57:59.421983+0000","last_clean":"2023-11-28T16:57:59.421983+0000","last_became_active":"2023-11-28T16:57:57.291977+0000","last_became_peered":"2023-11-28T16:57:57.291977+0000","last_unstale":"2023-11-28T16:57:59.421983+0000","last_undegraded":"2023-11-28T16:57:59.421983+0000","last_fullsized":"2023-11-28T16:57:59.421983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:35.065157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291566+0000","last_change":"2023-11-28T16:57:56.300060+0000","last_active":"2023-11-28T16:57:58.291566+0000","last_peered":"2023-11-28T16:57:58.291566+0000","last_clean":"2023-11-28T16:57:58.291566+0000","last_became_active":"2023-11-28T16:57:56.299780+0000","last_became_peered":"2023-11-28T16:57:56.299780+0000","last_unstale":"2023-11-28T16:57:58.291566+0000","last_undegraded":"2023-11-28T16:57:58.291566+0000","last_fullsized":"2023-11-28T16:57:58.291566+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:18.071987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418749+0000","last_change":"2023-11-28T16:57:57.291393+0000","last_active":"2023-11-28T16:57:59.418749+0000","last_peered":"2023-11-28T16:57:59.418749+0000","last_clean":"2023-11-28T16:57:59.418749+0000","last_became_active":"2023-11-28T16:57:57.290974+0000","last_became_peered":"2023-11-28T16:57:57.290974+0000","last_unstale":"2023-11-28T16:57:59.418749+0000","last_undegraded":"2023-11-28T16:57:59.418749+0000","last_fullsized":"2023-11-28T16:57:59.418749+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:47.176671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.422045+0000","last_change":"2023-11-28T16:57:56.293494+0000","last_active":"2023-11-28T16:57:59.422045+0000","last_peered":"2023-11-28T16:57:59.422045+0000","last_clean":"2023-11-28T16:57:59.422045+0000","last_became_active":"2023-11-28T16:57:56.293071+0000","last_became_peered":"2023-11-28T16:57:56.293071+0000","last_unstale":"2023-11-28T16:57:59.422045+0000","last_undegraded":"2023-11-28T16:57:59.422045+0000","last_fullsized":"2023-11-28T16:57:59.422045+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:42.043041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421926+0000","last_change":"2023-11-28T16:57:57.293148+0000","last_active":"2023-11-28T16:57:59.421926+0000","last_peered":"2023-11-28T16:57:59.421926+0000","last_clean":"2023-11-28T16:57:59.421926+0000","last_became_active":"2023-11-28T16:57:57.292674+0000","last_became_peered":"2023-11-28T16:57:57.292674+0000","last_unstale":"2023-11-28T16:57:59.421926+0000","last_undegraded":"2023-11-28T16:57:59.421926+0000","last_fullsized":"2023-11-28T16:57:59.421926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295899+0000","last_change":"2023-11-28T16:57:56.289047+0000","last_active":"2023-11-28T16:57:58.295899+0000","last_peered":"2023-11-28T16:57:58.295899+0000","last_clean":"2023-11-28T16:57:58.295899+0000","last_became_active":"2023-11-28T16:57:56.288333+0000","last_became_peered":"2023-11-28T16:57:56.288333+0000","last_unstale":"2023-11-28T16:57:58.295899+0000","last_undegraded":"2023-11-28T16:57:58.295899+0000","last_fullsized":"2023-11-28T16:57:58.295899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:55.749727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420491+0000","last_change":"2023-11-28T16:57:57.306068+0000","last_active":"2023-11-28T16:57:59.420491+0000","last_peered":"2023-11-28T16:57:59.420491+0000","last_clean":"2023-11-28T16:57:59.420491+0000","last_became_active":"2023-11-28T16:57:57.305881+0000","last_became_peered":"2023-11-28T16:57:57.305881+0000","last_unstale":"2023-11-28T16:57:59.420491+0000","last_undegraded":"2023-11-28T16:57:59.420491+0000","last_fullsized":"2023-11-28T16:57:59.420491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:39.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291250+0000","last_change":"2023-11-28T16:57:56.297847+0000","last_active":"2023-11-28T16:57:58.291250+0000","last_peered":"2023-11-28T16:57:58.291250+0000","last_clean":"2023-11-28T16:57:58.291250+0000","last_became_active":"2023-11-28T16:57:56.297578+0000","last_became_peered":"2023-11-28T16:57:56.297578+0000","last_unstale":"2023-11-28T16:57:58.291250+0000","last_undegraded":"2023-11-28T16:57:58.291250+0000","last_fullsized":"2023-11-28T16:57:58.291250+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.329569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420773+0000","last_change":"2023-11-28T16:57:57.295241+0000","last_active":"2023-11-28T16:57:59.420773+0000","last_peered":"2023-11-28T16:57:59.420773+0000","last_clean":"2023-11-28T16:57:59.420773+0000","last_became_active":"2023-11-28T16:57:57.295059+0000","last_became_peered":"2023-11-28T16:57:57.295059+0000","last_unstale":"2023-11-28T16:57:59.420773+0000","last_undegraded":"2023-11-28T16:57:59.420773+0000","last_fullsized":"2023-11-28T16:57:59.420773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420699+0000","last_change":"2023-11-28T16:57:56.292527+0000","last_active":"2023-11-28T16:57:59.420699+0000","last_peered":"2023-11-28T16:57:59.420699+0000","last_clean":"2023-11-28T16:57:59.420699+0000","last_became_active":"2023-11-28T16:57:56.292280+0000","last_became_peered":"2023-11-28T16:57:56.292280+0000","last_unstale":"2023-11-28T16:57:59.420699+0000","last_undegraded":"2023-11-28T16:57:59.420699+0000","last_fullsized":"2023-11-28T16:57:59.420699+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:36.146016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295399+0000","last_change":"2023-11-28T16:57:57.292399+0000","last_active":"2023-11-28T16:57:58.295399+0000","last_peered":"2023-11-28T16:57:58.295399+0000","last_clean":"2023-11-28T16:57:58.295399+0000","last_became_active":"2023-11-28T16:57:57.291492+0000","last_became_peered":"2023-11-28T16:57:57.291492+0000","last_unstale":"2023-11-28T16:57:58.295399+0000","last_undegraded":"2023-11-28T16:57:58.295399+0000","last_fullsized":"2023-11-28T16:57:58.295399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420852+0000","last_change":"2023-11-28T16:57:56.288401+0000","last_active":"2023-11-28T16:57:59.420852+0000","last_peered":"2023-11-28T16:57:59.420852+0000","last_clean":"2023-11-28T16:57:59.420852+0000","last_became_active":"2023-11-28T16:57:56.288046+0000","last_became_peered":"2023-11-28T16:57:56.288046+0000","last_unstale":"2023-11-28T16:57:59.420852+0000","last_undegraded":"2023-11-28T16:57:59.420852+0000","last_fullsized":"2023-11-28T16:57:59.420852+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:23.260917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420858+0000","last_change":"2023-11-28T16:57:57.300273+0000","last_active":"2023-11-28T16:57:59.420858+0000","last_peered":"2023-11-28T16:57:59.420858+0000","last_clean":"2023-11-28T16:57:59.420858+0000","last_became_active":"2023-11-28T16:57:57.300005+0000","last_became_peered":"2023-11-28T16:57:57.300005+0000","last_unstale":"2023-11-28T16:57:59.420858+0000","last_undegraded":"2023-11-28T16:57:59.420858+0000","last_fullsized":"2023-11-28T16:57:59.420858+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421171+0000","last_change":"2023-11-28T16:57:56.297211+0000","last_active":"2023-11-28T16:57:59.421171+0000","last_peered":"2023-11-28T16:57:59.421171+0000","last_clean":"2023-11-28T16:57:59.421171+0000","last_became_active":"2023-11-28T16:57:56.296321+0000","last_became_peered":"2023-11-28T16:57:56.296321+0000","last_unstale":"2023-11-28T16:57:59.421171+0000","last_undegraded":"2023-11-28T16:57:59.421171+0000","last_fullsized":"2023-11-28T16:57:59.421171+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.422110+0000","last_change":"2023-11-28T16:57:57.294684+0000","last_active":"2023-11-28T16:57:59.422110+0000","last_peered":"2023-11-28T16:57:59.422110+0000","last_clean":"2023-11-28T16:57:59.422110+0000","last_became_active":"2023-11-28T16:57:57.294339+0000","last_became_peered":"2023-11-28T16:57:57.294339+0000","last_unstale":"2023-11-28T16:57:59.422110+0000","last_undegraded":"2023-11-28T16:57:59.422110+0000","last_fullsized":"2023-11-28T16:57:59.422110+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:19.079746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291361+0000","last_change":"2023-11-28T16:57:56.302265+0000","last_active":"2023-11-28T16:57:58.291361+0000","last_peered":"2023-11-28T16:57:58.291361+0000","last_clean":"2023-11-28T16:57:58.291361+0000","last_became_active":"2023-11-28T16:57:56.301960+0000","last_became_peered":"2023-11-28T16:57:56.301960+0000","last_unstale":"2023-11-28T16:57:58.291361+0000","last_undegraded":"2023-11-28T16:57:58.291361+0000","last_fullsized":"2023-11-28T16:57:58.291361+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:36.131374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421348+0000","last_change":"2023-11-28T16:57:57.296609+0000","last_active":"2023-11-28T16:57:59.421348+0000","last_peered":"2023-11-28T16:57:59.421348+0000","last_clean":"2023-11-28T16:57:59.421348+0000","last_became_active":"2023-11-28T16:57:57.296304+0000","last_became_peered":"2023-11-28T16:57:57.296304+0000","last_unstale":"2023-11-28T16:57:59.421348+0000","last_undegraded":"2023-11-28T16:57:59.421348+0000","last_fullsized":"2023-11-28T16:57:59.421348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:27.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293165+0000","last_change":"2023-11-28T16:57:56.296905+0000","last_active":"2023-11-28T16:57:58.293165+0000","last_peered":"2023-11-28T16:57:58.293165+0000","last_clean":"2023-11-28T16:57:58.293165+0000","last_became_active":"2023-11-28T16:57:56.295819+0000","last_became_peered":"2023-11-28T16:57:56.295819+0000","last_unstale":"2023-11-28T16:57:58.293165+0000","last_undegraded":"2023-11-28T16:57:58.293165+0000","last_fullsized":"2023-11-28T16:57:58.293165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291030+0000","last_change":"2023-11-28T16:57:57.297238+0000","last_active":"2023-11-28T16:57:58.291030+0000","last_peered":"2023-11-28T16:57:58.291030+0000","last_clean":"2023-11-28T16:57:58.291030+0000","last_became_active":"2023-11-28T16:57:57.296895+0000","last_became_peered":"2023-11-28T16:57:57.296895+0000","last_unstale":"2023-11-28T16:57:58.291030+0000","last_undegraded":"2023-11-28T16:57:58.291030+0000","last_fullsized":"2023-11-28T16:57:58.291030+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:47.232224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421369+0000","last_change":"2023-11-28T16:57:56.292453+0000","last_active":"2023-11-28T16:57:59.421369+0000","last_peered":"2023-11-28T16:57:59.421369+0000","last_clean":"2023-11-28T16:57:59.421369+0000","last_became_active":"2023-11-28T16:57:56.292147+0000","last_became_peered":"2023-11-28T16:57:56.292147+0000","last_unstale":"2023-11-28T16:57:59.421369+0000","last_undegraded":"2023-11-28T16:57:59.421369+0000","last_fullsized":"2023-11-28T16:57:59.421369+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.422208+0000","last_change":"2023-11-28T16:57:57.292951+0000","last_active":"2023-11-28T16:57:59.422208+0000","last_peered":"2023-11-28T16:57:59.422208+0000","last_clean":"2023-11-28T16:57:59.422208+0000","last_became_active":"2023-11-28T16:57:57.292254+0000","last_became_peered":"2023-11-28T16:57:57.292254+0000","last_unstale":"2023-11-28T16:57:59.422208+0000","last_undegraded":"2023-11-28T16:57:59.422208+0000","last_fullsized":"2023-11-28T16:57:59.422208+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:07.921821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293431+0000","last_change":"2023-11-28T16:57:56.301392+0000","last_active":"2023-11-28T16:57:58.293431+0000","last_peered":"2023-11-28T16:57:58.293431+0000","last_clean":"2023-11-28T16:57:58.293431+0000","last_became_active":"2023-11-28T16:57:56.300939+0000","last_became_peered":"2023-11-28T16:57:56.300939+0000","last_unstale":"2023-11-28T16:57:58.293431+0000","last_undegraded":"2023-11-28T16:57:58.293431+0000","last_fullsized":"2023-11-28T16:57:58.293431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:05.783524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420605+0000","last_change":"2023-11-28T16:57:57.304252+0000","last_active":"2023-11-28T16:57:59.420605+0000","last_peered":"2023-11-28T16:57:59.420605+0000","last_clean":"2023-11-28T16:57:59.420605+0000","last_became_active":"2023-11-28T16:57:57.303963+0000","last_became_peered":"2023-11-28T16:57:57.303963+0000","last_unstale":"2023-11-28T16:57:59.420605+0000","last_undegraded":"2023-11-28T16:57:59.420605+0000","last_fullsized":"2023-11-28T16:57:59.420605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:08.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291462+0000","last_change":"2023-11-28T16:57:56.291678+0000","last_active":"2023-11-28T16:57:58.291462+0000","last_peered":"2023-11-28T16:57:58.291462+0000","last_clean":"2023-11-28T16:57:58.291462+0000","last_became_active":"2023-11-28T16:57:56.289787+0000","last_became_peered":"2023-11-28T16:57:56.289787+0000","last_unstale":"2023-11-28T16:57:58.291462+0000","last_undegraded":"2023-11-28T16:57:58.291462+0000","last_fullsized":"2023-11-28T16:57:58.291462+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:08.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.292948+0000","last_change":"2023-11-28T16:57:57.294132+0000","last_active":"2023-11-28T16:57:58.292948+0000","last_peered":"2023-11-28T16:57:58.292948+0000","last_clean":"2023-11-28T16:57:58.292948+0000","last_became_active":"2023-11-28T16:57:57.293808+0000","last_became_peered":"2023-11-28T16:57:57.293808+0000","last_unstale":"2023-11-28T16:57:58.292948+0000","last_undegraded":"2023-11-28T16:57:58.292948+0000","last_fullsized":"2023-11-28T16:57:58.292948+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418734+0000","last_change":"2023-11-28T16:57:56.299832+0000","last_active":"2023-11-28T16:57:59.418734+0000","last_peered":"2023-11-28T16:57:59.418734+0000","last_clean":"2023-11-28T16:57:59.418734+0000","last_became_active":"2023-11-28T16:57:56.299505+0000","last_became_peered":"2023-11-28T16:57:56.299505+0000","last_unstale":"2023-11-28T16:57:59.418734+0000","last_undegraded":"2023-11-28T16:57:59.418734+0000","last_fullsized":"2023-11-28T16:57:59.418734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:26.104747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.292781+0000","last_change":"2023-11-28T16:57:57.294705+0000","last_active":"2023-11-28T16:57:58.292781+0000","last_peered":"2023-11-28T16:57:58.292781+0000","last_clean":"2023-11-28T16:57:58.292781+0000","last_became_active":"2023-11-28T16:57:57.294386+0000","last_became_peered":"2023-11-28T16:57:57.294386+0000","last_unstale":"2023-11-28T16:57:58.292781+0000","last_undegraded":"2023-11-28T16:57:58.292781+0000","last_fullsized":"2023-11-28T16:57:58.292781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421161+0000","last_change":"2023-11-28T16:57:56.303059+0000","last_active":"2023-11-28T16:57:59.421161+0000","last_peered":"2023-11-28T16:57:59.421161+0000","last_clean":"2023-11-28T16:57:59.421161+0000","last_became_active":"2023-11-28T16:57:56.302716+0000","last_became_peered":"2023-11-28T16:57:56.302716+0000","last_unstale":"2023-11-28T16:57:59.421161+0000","last_undegraded":"2023-11-28T16:57:59.421161+0000","last_fullsized":"2023-11-28T16:57:59.421161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421454+0000","last_change":"2023-11-28T16:57:57.310134+0000","last_active":"2023-11-28T16:57:59.421454+0000","last_peered":"2023-11-28T16:57:59.421454+0000","last_clean":"2023-11-28T16:57:59.421454+0000","last_became_active":"2023-11-28T16:57:57.309858+0000","last_became_peered":"2023-11-28T16:57:57.309858+0000","last_unstale":"2023-11-28T16:57:59.421454+0000","last_undegraded":"2023-11-28T16:57:59.421454+0000","last_fullsized":"2023-11-28T16:57:59.421454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:43.751157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.419067+0000","last_change":"2023-11-28T16:57:56.289398+0000","last_active":"2023-11-28T16:57:59.419067+0000","last_peered":"2023-11-28T16:57:59.419067+0000","last_clean":"2023-11-28T16:57:59.419067+0000","last_became_active":"2023-11-28T16:57:56.289082+0000","last_became_peered":"2023-11-28T16:57:56.289082+0000","last_unstale":"2023-11-28T16:57:59.419067+0000","last_undegraded":"2023-11-28T16:57:59.419067+0000","last_fullsized":"2023-11-28T16:57:59.419067+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:34.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421498+0000","last_change":"2023-11-28T16:57:57.302840+0000","last_active":"2023-11-28T16:57:59.421498+0000","last_peered":"2023-11-28T16:57:59.421498+0000","last_clean":"2023-11-28T16:57:59.421498+0000","last_became_active":"2023-11-28T16:57:57.302446+0000","last_became_peered":"2023-11-28T16:57:57.302446+0000","last_unstale":"2023-11-28T16:57:59.421498+0000","last_undegraded":"2023-11-28T16:57:59.421498+0000","last_fullsized":"2023-11-28T16:57:59.421498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:06.791283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293254+0000","last_change":"2023-11-28T16:57:56.295304+0000","last_active":"2023-11-28T16:57:58.293254+0000","last_peered":"2023-11-28T16:57:58.293254+0000","last_clean":"2023-11-28T16:57:58.293254+0000","last_became_active":"2023-11-28T16:57:56.295041+0000","last_became_peered":"2023-11-28T16:57:56.295041+0000","last_unstale":"2023-11-28T16:57:58.293254+0000","last_undegraded":"2023-11-28T16:57:58.293254+0000","last_fullsized":"2023-11-28T16:57:58.293254+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418842+0000","last_change":"2023-11-28T16:57:57.285348+0000","last_active":"2023-11-28T16:57:59.418842+0000","last_peered":"2023-11-28T16:57:59.418842+0000","last_clean":"2023-11-28T16:57:59.418842+0000","last_became_active":"2023-11-28T16:57:57.285004+0000","last_became_peered":"2023-11-28T16:57:57.285004+0000","last_unstale":"2023-11-28T16:57:59.418842+0000","last_undegraded":"2023-11-28T16:57:59.418842+0000","last_fullsized":"2023-11-28T16:57:59.418842+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:56.757486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421614+0000","last_change":"2023-11-28T16:57:56.291833+0000","last_active":"2023-11-28T16:57:59.421614+0000","last_peered":"2023-11-28T16:57:59.421614+0000","last_clean":"2023-11-28T16:57:59.421614+0000","last_became_active":"2023-11-28T16:57:56.291493+0000","last_became_peered":"2023-11-28T16:57:56.291493+0000","last_unstale":"2023-11-28T16:57:59.421614+0000","last_undegraded":"2023-11-28T16:57:59.421614+0000","last_fullsized":"2023-11-28T16:57:59.421614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:36.485569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.293151+0000","last_change":"2023-11-28T16:57:57.294725+0000","last_active":"2023-11-28T16:57:58.293151+0000","last_peered":"2023-11-28T16:57:58.293151+0000","last_clean":"2023-11-28T16:57:58.293151+0000","last_became_active":"2023-11-28T16:57:57.294368+0000","last_became_peered":"2023-11-28T16:57:57.294368+0000","last_unstale":"2023-11-28T16:57:58.293151+0000","last_undegraded":"2023-11-28T16:57:58.293151+0000","last_fullsized":"2023-11-28T16:57:58.293151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421745+0000","last_change":"2023-11-28T16:57:56.295240+0000","last_active":"2023-11-28T16:57:59.421745+0000","last_peered":"2023-11-28T16:57:59.421745+0000","last_clean":"2023-11-28T16:57:59.421745+0000","last_became_active":"2023-11-28T16:57:56.292758+0000","last_became_peered":"2023-11-28T16:57:56.292758+0000","last_unstale":"2023-11-28T16:57:59.421745+0000","last_undegraded":"2023-11-28T16:57:59.421745+0000","last_fullsized":"2023-11-28T16:57:59.421745+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.291085+0000","last_change":"2023-11-28T16:57:57.306973+0000","last_active":"2023-11-28T16:57:58.291085+0000","last_peered":"2023-11-28T16:57:58.291085+0000","last_clean":"2023-11-28T16:57:58.291085+0000","last_became_active":"2023-11-28T16:57:57.304696+0000","last_became_peered":"2023-11-28T16:57:57.304696+0000","last_unstale":"2023-11-28T16:57:58.291085+0000","last_undegraded":"2023-11-28T16:57:58.291085+0000","last_fullsized":"2023-11-28T16:57:58.291085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.596110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418593+0000","last_change":"2023-11-28T16:57:56.293462+0000","last_active":"2023-11-28T16:57:59.418593+0000","last_peered":"2023-11-28T16:57:59.418593+0000","last_clean":"2023-11-28T16:57:59.418593+0000","last_became_active":"2023-11-28T16:57:56.293039+0000","last_became_peered":"2023-11-28T16:57:56.293039+0000","last_unstale":"2023-11-28T16:57:59.418593+0000","last_undegraded":"2023-11-28T16:57:59.418593+0000","last_fullsized":"2023-11-28T16:57:59.418593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:40.083816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.421068+0000","last_change":"2023-11-28T16:57:57.307851+0000","last_active":"2023-11-28T16:57:59.421068+0000","last_peered":"2023-11-28T16:57:59.421068+0000","last_clean":"2023-11-28T16:57:59.421068+0000","last_became_active":"2023-11-28T16:57:57.307208+0000","last_became_peered":"2023-11-28T16:57:57.307208+0000","last_unstale":"2023-11-28T16:57:59.421068+0000","last_undegraded":"2023-11-28T16:57:59.421068+0000","last_fullsized":"2023-11-28T16:57:59.421068+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.295386+0000","last_change":"2023-11-28T16:57:56.286826+0000","last_active":"2023-11-28T16:57:58.295386+0000","last_peered":"2023-11-28T16:57:58.295386+0000","last_clean":"2023-11-28T16:57:58.295386+0000","last_became_active":"2023-11-28T16:57:56.286506+0000","last_became_peered":"2023-11-28T16:57:56.286506+0000","last_unstale":"2023-11-28T16:57:58.295386+0000","last_undegraded":"2023-11-28T16:57:58.295386+0000","last_fullsized":"2023-11-28T16:57:58.295386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:28.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418534+0000","last_change":"2023-11-28T16:57:57.293525+0000","last_active":"2023-11-28T16:57:59.418534+0000","last_peered":"2023-11-28T16:57:59.418534+0000","last_clean":"2023-11-28T16:57:59.418534+0000","last_became_active":"2023-11-28T16:57:57.293155+0000","last_became_peered":"2023-11-28T16:57:57.293155+0000","last_unstale":"2023-11-28T16:57:59.418534+0000","last_undegraded":"2023-11-28T16:57:59.418534+0000","last_fullsized":"2023-11-28T16:57:59.418534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:54.496874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.418590+0000","last_change":"2023-11-28T16:57:56.289797+0000","last_active":"2023-11-28T16:57:59.418590+0000","last_peered":"2023-11-28T16:57:59.418590+0000","last_clean":"2023-11-28T16:57:59.418590+0000","last_became_active":"2023-11-28T16:57:56.286507+0000","last_became_peered":"2023-11-28T16:57:56.286507+0000","last_unstale":"2023-11-28T16:57:59.418590+0000","last_undegraded":"2023-11-28T16:57:59.418590+0000","last_fullsized":"2023-11-28T16:57:59.418590+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:55.952116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290844+0000","last_change":"2023-11-28T16:57:57.295933+0000","last_active":"2023-11-28T16:57:58.290844+0000","last_peered":"2023-11-28T16:57:58.290844+0000","last_clean":"2023-11-28T16:57:58.290844+0000","last_became_active":"2023-11-28T16:57:57.295567+0000","last_became_peered":"2023-11-28T16:57:57.295567+0000","last_unstale":"2023-11-28T16:57:58.290844+0000","last_undegraded":"2023-11-28T16:57:58.290844+0000","last_fullsized":"2023-11-28T16:57:58.290844+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:13.997222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290938+0000","last_change":"2023-11-28T16:57:56.296292+0000","last_active":"2023-11-28T16:57:58.290938+0000","last_peered":"2023-11-28T16:57:58.290938+0000","last_clean":"2023-11-28T16:57:58.290938+0000","last_became_active":"2023-11-28T16:57:56.295958+0000","last_became_peered":"2023-11-28T16:57:56.295958+0000","last_unstale":"2023-11-28T16:57:58.290938+0000","last_undegraded":"2023-11-28T16:57:58.290938+0000","last_fullsized":"2023-11-28T16:57:58.290938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.008383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:58.290848+0000","last_change":"2023-11-28T16:57:57.308508+0000","last_active":"2023-11-28T16:57:58.290848+0000","last_peered":"2023-11-28T16:57:58.290848+0000","last_clean":"2023-11-28T16:57:58.290848+0000","last_became_active":"2023-11-28T16:57:57.308197+0000","last_became_peered":"2023-11-28T16:57:57.308197+0000","last_unstale":"2023-11-28T16:57:58.290848+0000","last_undegraded":"2023-11-28T16:57:58.290848+0000","last_fullsized":"2023-11-28T16:57:58.290848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:41.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T16:57:59.420500+0000","last_change":"2023-11-28T16:57:56.296886+0000","last_active":"2023-11-28T16:57:59.420500+0000","last_peered":"2023-11-28T16:57:59.420500+0000","last_clean":"2023-11-28T16:57:59.420500+0000","last_became_active":"2023-11-28T16:57:56.296594+0000","last_became_peered":"2023-11-28T16:57:56.296594+0000","last_unstale":"2023-11-28T16:57:59.420500+0000","last_undegraded":"2023-11-28T16:57:59.420500+0000","last_fullsized":"2023-11-28T16:57:59.420500+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:40.306391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-28T16:57:57.278591+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:57:57.278591+0000","last_peered":"2023-11-28T16:57:57.278591+0000","last_clean":"2023-11-28T16:57:57.278591+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:57:57.278591+0000","last_undegraded":"2023-11-28T16:57:57.278591+0000","last_fullsized":"2023-11-28T16:57:57.278591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1200128,"data_stored":842361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67300000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65200000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.627},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.77700000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":245533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.65000000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.501}]},{"osd":2,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.629}]},{"osd":4,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.45700000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":246185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.45500000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.38500000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.498}]},{"osd":7,"last update":"Tue Nov 28 16:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.47499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":253445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.64400000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.76500000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.87}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":251889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.441}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.752}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":606208,"data_stored":251889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.64600000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58499999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60999999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.83299999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.876}]},{"osd":6,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":245623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.40799999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.53000000000000003}]},{"osd":3,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.86399999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.79500000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.755},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.69799999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.88900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":844395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.2869999999999999,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.52000000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.84099999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.72399999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:58:01.780 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T16:58:01.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T16:58:01.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f649c640 1 Processor -- start 2023-11-28T16:58:01.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f649c640 1 -- start start 2023-11-28T16:58:01.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f649c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66f0158a10 0x7f66f00c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f649c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66f0151bf0 0x7f66f0152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f649c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f0158580 con 0x7f66f00c6220 2023-11-28T16:58:01.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f649c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f0158e60 con 0x7f66f0151bf0 2023-11-28T16:58:01.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f649c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f0157f50 con 0x7f66f0158a10 2023-11-28T16:58:01.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66effff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f66f00c6220 0x7f66f00c13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53968/0 (socket says 172.21.15.26:53968) 2023-11-28T16:58:01.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66effff640 1 -- 172.21.15.26:0/1705005411 learned_addr learned my addr 172.21.15.26:0/1705005411 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:01.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f4a39640 1 --2- 172.21.15.26:0/1705005411 >> v2:172.21.15.26:3300/0 conn(0x7f66f0151bf0 0x7f66f0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66ef7fe640 1 --2- 172.21.15.26:0/1705005411 >> v2:172.21.15.79:3300/0 conn(0x7f66f0158a10 0x7f66f00c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f4a39640 1 -- 172.21.15.26:0/1705005411 >> v2:172.21.15.79:3300/0 conn(0x7f66f0158a10 msgr2=0x7f66f00c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:01.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f4a39640 1 --2- 172.21.15.26:0/1705005411 >> v2:172.21.15.79:3300/0 conn(0x7f66f0158a10 0x7f66f00c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f4a39640 1 -- 172.21.15.26:0/1705005411 >> v1:172.21.15.26:6789/0 conn(0x7f66f00c6220 legacy=0x7f66f00c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66eeffd640 1 -- 172.21.15.26:0/1705005411 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918960298 0 0) 0x7f66f0158580 con 0x7f66f00c6220 2023-11-28T16:58:01.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.965+0000 7f66f4a39640 1 -- 172.21.15.26:0/1705005411 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00c1f60 con 0x7f66f0151bf0 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f4a39640 1 --2- 172.21.15.26:0/1705005411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0151bf0 0x7f66f0152020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f66f0071980 tx=0x7f66e801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a7c736c57116de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66eeffd640 1 -- 172.21.15.26:0/1705005411 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80a59a0 con 0x7f66f0151bf0 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66eeffd640 1 -- 172.21.15.26:0/1705005411 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e80a5b00 con 0x7f66f0151bf0 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66eeffd640 1 -- 172.21.15.26:0/1705005411 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80a5e90 con 0x7f66f0151bf0 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 -- 172.21.15.26:0/1705005411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0151bf0 msgr2=0x7f66f0152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 --2- 172.21.15.26:0/1705005411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0151bf0 0x7f66f0152020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f66f0071980 tx=0x7f66e801c8e0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 -- 172.21.15.26:0/1705005411 shutdown_connections 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 --2- 172.21.15.26:0/1705005411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0151bf0 0x7f66f0152020 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 --2- 172.21.15.26:0/1705005411 >> v2:172.21.15.79:3300/0 conn(0x7f66f0158a10 0x7f66f00c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 -- 172.21.15.26:0/1705005411 >> 172.21.15.26:0/1705005411 conn(0x7f66f006a5a0 msgr2=0x7f66f006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:01.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 -- 172.21.15.26:0/1705005411 shutdown_connections 2023-11-28T16:58:01.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 -- 172.21.15.26:0/1705005411 wait complete. 2023-11-28T16:58:01.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.969+0000 7f66f649c640 1 Processor -- start 2023-11-28T16:58:01.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 -- start start 2023-11-28T16:58:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66f00c6220 0x7f66f00aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66f0151bf0 0x7f66f0147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0158a10 0x7f66f0156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01ecdb0 con 0x7f66f0158a10 2023-11-28T16:58:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01ed090 con 0x7f66f00c6220 2023-11-28T16:58:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01ed370 con 0x7f66f0151bf0 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0158a10 0x7f66f0156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0158a10 0x7f66f0156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37356/0 (socket says 172.21.15.26:37356) 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 -- 172.21.15.26:0/1408994270 learned_addr learned my addr 172.21.15.26:0/1408994270 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66effff640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66f00c6220 0x7f66f00aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66ef7fe640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66f0151bf0 0x7f66f0147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 -- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66f0151bf0 msgr2=0x7f66f0147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66f0151bf0 0x7f66f0147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 -- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66f00c6220 msgr2=0x7f66f00aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66f00c6220 0x7f66f00aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 -- 172.21.15.26:0/1408994270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009a70 con 0x7f66f0158a10 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f4a39640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0158a10 0x7f66f0156f10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f66e80194f0 tx=0x7f66e8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66ecff9640 1 -- 172.21.15.26:0/1408994270 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80add70 con 0x7f66f0158a10 2023-11-28T16:58:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66ecff9640 1 -- 172.21.15.26:0/1408994270 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8009450 con 0x7f66f0158a10 2023-11-28T16:58:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66ecff9640 1 -- 172.21.15.26:0/1408994270 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80b9690 con 0x7f66f0158a10 2023-11-28T16:58:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f01ed650 con 0x7f66f0158a10 2023-11-28T16:58:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f01eca60 con 0x7f66f0158a10 2023-11-28T16:58:01.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.973+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f004e890 con 0x7f66f0158a10 2023-11-28T16:58:01.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.977+0000 7f66ecff9640 1 -- 172.21.15.26:0/1408994270 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f66e80b97f0 con 0x7f66f0158a10 2023-11-28T16:58:01.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.977+0000 7f66ecff9640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66dc066900 0x7f66dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:01.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.977+0000 7f66ecff9640 1 -- 172.21.15.26:0/1408994270 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66e811fb80 con 0x7f66f0158a10 2023-11-28T16:58:01.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.977+0000 7f66effff640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66dc066900 0x7f66dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:01.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.977+0000 7f66effff640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66dc066900 0x7f66dc068dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f66e0007fd0 tx=0x7f66e0007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:01.981+0000 7f66ecff9640 1 -- 172.21.15.26:0/1408994270 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66e80ecdd0 con 0x7f66f0158a10 2023-11-28T16:58:02.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.193+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f66f006f2e0 con 0x7f66f0158a10 2023-11-28T16:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66ecff9640 1 -- 172.21.15.26:0/1408994270 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f66e811fe60 con 0x7f66f0158a10 2023-11-28T16:58:02.199 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-11-28T16:58:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw== 2023-11-28T16:58:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-11-28T16:58:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-11-28T16:58:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T16:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66dc066900 msgr2=0x7f66dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66dc066900 0x7f66dc068dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f66e0007fd0 tx=0x7f66e0007d60 comp rx=0 tx=0).stop 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0158a10 msgr2=0x7f66f0156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0158a10 0x7f66f0156f10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f66e80194f0 tx=0x7f66e8019680 comp rx=0 tx=0).stop 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 shutdown_connections 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f0158a10 0x7f66f0156f10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66dc066900 0x7f66dc068dc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66f0151bf0 0x7f66f0147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 --2- 172.21.15.26:0/1408994270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66f00c6220 0x7f66f00aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 >> 172.21.15.26:0/1408994270 conn(0x7f66f006a5a0 msgr2=0x7f66f0066480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:02.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 shutdown_connections 2023-11-28T16:58:02.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.197+0000 7f66f649c640 1 -- 172.21.15.26:0/1408994270 wait complete. 2023-11-28T16:58:02.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21fc8d6640 1 Processor -- start 2023-11-28T16:58:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21fc8d6640 1 -- start start 2023-11-28T16:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21fc8d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f80a8470 0x7f21f8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21fc8d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f806d320 con 0x7f21f814e9d0 2023-11-28T16:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21fc8d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80721b0 con 0x7f21f8070b80 2023-11-28T16:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21fc8d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c2830 con 0x7f21f80a8470 2023-11-28T16:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21f659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f21f814e9d0 0x7f21f80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53980/0 (socket says 172.21.15.26:53980) 2023-11-28T16:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.361+0000 7f21f659c640 1 -- 172.21.15.26:0/3246733821 learned_addr learned my addr 172.21.15.26:0/3246733821 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f6d9d640 1 --2- 172.21.15.26:0/3246733821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f80a8470 0x7f21f8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719946444 0 0) 0x7f21f806d320 con 0x7f21f814e9d0 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e4003530 con 0x7f21f814e9d0 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906591873 0 0) 0x7f21f80721b0 con 0x7f21f8070b80 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f806d320 con 0x7f21f8070b80 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f6d9d640 1 -- 172.21.15.26:0/3246733821 >> v1:172.21.15.79:6789/0 conn(0x7f21f8070b80 legacy=0x7f21f806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f6d9d640 1 -- 172.21.15.26:0/3246733821 >> v1:172.21.15.26:6789/0 conn(0x7f21f814e9d0 legacy=0x7f21f80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284419963 0 0) 0x7f21e4003530 con 0x7f21f814e9d0 2023-11-28T16:58:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f6d9d640 1 -- 172.21.15.26:0/3246733821 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8072450 con 0x7f21f80a8470 2023-11-28T16:58:02.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f6d9d640 1 --2- 172.21.15.26:0/3246733821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f80a8470 0x7f21f8151e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009dc0 tx=0x7f21f001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7609bd821acc0ee6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:02.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8001680 con 0x7f21f80a8470 2023-11-28T16:58:02.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f00a5550 con 0x7f21f80a8470 2023-11-28T16:58:02.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.365+0000 7f21f5d9b640 1 -- 172.21.15.26:0/3246733821 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a58e0 con 0x7f21f80a8470 2023-11-28T16:58:02.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- 172.21.15.26:0/3246733821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f80a8470 msgr2=0x7f21f8151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/3246733821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f80a8470 0x7f21f8151e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009dc0 tx=0x7f21f001c800 comp rx=0 tx=0).stop 2023-11-28T16:58:02.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- 172.21.15.26:0/3246733821 shutdown_connections 2023-11-28T16:58:02.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/3246733821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f80a8470 0x7f21f8151e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- 172.21.15.26:0/3246733821 >> 172.21.15.26:0/3246733821 conn(0x7f21f80c2ad0 msgr2=0x7f21f80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:02.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- 172.21.15.26:0/3246733821 shutdown_connections 2023-11-28T16:58:02.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- 172.21.15.26:0/3246733821 wait complete. 2023-11-28T16:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 Processor -- start 2023-11-28T16:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- start start 2023-11-28T16:58:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f8070b80 0x7f21f8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80a8470 0x7f21f81f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f814e9d0 0x7f21f8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f81f1090 con 0x7f21f80a8470 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8154ba0 con 0x7f21f814e9d0 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21fc8d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f814b180 con 0x7f21f8070b80 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80a8470 0x7f21f81f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21f659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f8070b80 0x7f21f8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80a8470 0x7f21f81f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37362/0 (socket says 172.21.15.26:37362) 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21f659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f8070b80 0x7f21f8152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:45696/0 (socket says 172.21.15.26:45696) 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 -- 172.21.15.26:0/1355921984 learned_addr learned my addr 172.21.15.26:0/1355921984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21f6d9d640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f814e9d0 0x7f21f8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 -- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f8070b80 msgr2=0x7f21f8152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f8070b80 0x7f21f8152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 -- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f814e9d0 msgr2=0x7f21f8155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f814e9d0 0x7f21f8155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.369+0000 7f21effff640 1 -- 172.21.15.26:0/1355921984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009a70 con 0x7f21f80a8470 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21effff640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80a8470 0x7f21f81f0b50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c500 tx=0x7f21e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21eeffd640 1 -- 172.21.15.26:0/1355921984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00052d0 con 0x7f21f80a8470 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21eeffd640 1 -- 172.21.15.26:0/1355921984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0005430 con 0x7f21f80a8470 2023-11-28T16:58:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21eeffd640 1 -- 172.21.15.26:0/1355921984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0012870 con 0x7f21f80a8470 2023-11-28T16:58:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f8155570 con 0x7f21f80a8470 2023-11-28T16:58:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8152e20 con 0x7f21f80a8470 2023-11-28T16:58:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804e890 con 0x7f21f80a8470 2023-11-28T16:58:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21eeffd640 1 -- 172.21.15.26:0/1355921984 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f21e00129d0 con 0x7f21f80a8470 2023-11-28T16:58:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21eeffd640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f21d80668d0 0x7f21d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21eeffd640 1 -- 172.21.15.26:0/1355921984 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21e0083ff0 con 0x7f21f80a8470 2023-11-28T16:58:02.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.373+0000 7f21f659c640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f21d80668d0 0x7f21d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:02.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.377+0000 7f21f659c640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f21d80668d0 0x7f21d8068d90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21e8001ec0 tx=0x7f21e80019c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.377+0000 7f21eeffd640 1 -- 172.21.15.26:0/1355921984 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21e0051250 con 0x7f21f80a8470 2023-11-28T16:58:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.569+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21f80ac260 con 0x7f21f80a8470 2023-11-28T16:58:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.569+0000 7f21eeffd640 1 -- 172.21.15.26:0/1355921984 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f21e0054870 con 0x7f21f80a8470 2023-11-28T16:58:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:02.574 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:56.668279+0000","modified":"2023-11-28T16:57:59.688325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3225309020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3225309020},{"type":"v1","addr":"172.21.15.26:6835","nonce":3225309020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T16:58:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f21d80668d0 msgr2=0x7f21d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f21d80668d0 0x7f21d8068d90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21e8001ec0 tx=0x7f21e80019c0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80a8470 msgr2=0x7f21f81f0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80a8470 0x7f21f81f0b50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c500 tx=0x7f21e000c9c0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 shutdown_connections 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f814e9d0 0x7f21f8155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80a8470 0x7f21f81f0b50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f21d80668d0 0x7f21d8068d90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 --2- 172.21.15.26:0/1355921984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21f8070b80 0x7f21f8152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 >> 172.21.15.26:0/1355921984 conn(0x7f21f80c2ad0 msgr2=0x7f21f806d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 shutdown_connections 2023-11-28T16:58:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:02.573+0000 7f21fc8d6640 1 -- 172.21.15.26:0/1355921984 wait complete. 2023-11-28T16:58:02.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T16:57:56.668279+0000', 'modified': '2023-11-28T16:57:59.688325+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5718}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5718': {'gid': 5718, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/3225309020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 3225309020}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 3225309020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T16:58:02.998 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T16:58:02.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T16:58:03.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.141+0000 7f546b79d640 1 Processor -- start 2023-11-28T16:58:03.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.141+0000 7f546b79d640 1 -- start start 2023-11-28T16:58:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f546b79d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f546414e9d0 0x7f5464151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f546b79d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546406d320 con 0x7f54640a8470 2023-11-28T16:58:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f546b79d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640721b0 con 0x7f5464070b80 2023-11-28T16:58:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f546b79d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54640c2830 con 0x7f546414e9d0 2023-11-28T16:58:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f5469539640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f546414e9d0 0x7f5464151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f5469539640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f546414e9d0 0x7f5464151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37374/0 (socket says 172.21.15.26:37374) 2023-11-28T16:58:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f5469539640 1 -- 172.21.15.26:0/762306163 learned_addr learned my addr 172.21.15.26:0/762306163 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f5469539640 1 -- 172.21.15.26:0/762306163 >> v1:172.21.15.79:6789/0 conn(0x7f5464070b80 legacy=0x7f54640c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f5469539640 1 -- 172.21.15.26:0/762306163 >> v1:172.21.15.26:6789/0 conn(0x7f54640a8470 legacy=0x7f546406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f5469539640 1 -- 172.21.15.26:0/762306163 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464072450 con 0x7f546414e9d0 2023-11-28T16:58:03.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.145+0000 7f5469539640 1 --2- 172.21.15.26:0/762306163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f5464151e60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5460009870 tx=0x7f546001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2356c3cf1d482e62 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f545bfff640 1 -- 172.21.15.26:0/762306163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600a8040 con 0x7f546414e9d0 2023-11-28T16:58:03.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f545bfff640 1 -- 172.21.15.26:0/762306163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54600ac600 con 0x7f546414e9d0 2023-11-28T16:58:03.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f545bfff640 1 -- 172.21.15.26:0/762306163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600ac990 con 0x7f546414e9d0 2023-11-28T16:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- 172.21.15.26:0/762306163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 msgr2=0x7f5464151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 --2- 172.21.15.26:0/762306163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f5464151e60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5460009870 tx=0x7f546001e680 comp rx=0 tx=0).stop 2023-11-28T16:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- 172.21.15.26:0/762306163 shutdown_connections 2023-11-28T16:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 --2- 172.21.15.26:0/762306163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f5464151e60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- 172.21.15.26:0/762306163 >> 172.21.15.26:0/762306163 conn(0x7f54640c2ad0 msgr2=0x7f54640c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- 172.21.15.26:0/762306163 shutdown_connections 2023-11-28T16:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- 172.21.15.26:0/762306163 wait complete. 2023-11-28T16:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 Processor -- start 2023-11-28T16:58:03.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- start start 2023-11-28T16:58:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464070b80 0x7f5464141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54640a8470 0x7f5464150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f54640c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640c55c0 con 0x7f546414e9d0 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640abab0 con 0x7f5464070b80 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f546b79d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54640c00c0 con 0x7f54640a8470 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f5469d3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f54640c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f5469d3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f54640c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37376/0 (socket says 172.21.15.26:37376) 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.149+0000 7f5469d3a640 1 -- 172.21.15.26:0/1370220305 learned_addr learned my addr 172.21.15.26:0/1370220305 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469539640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464070b80 0x7f5464141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5468d38640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54640a8470 0x7f5464150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469d3a640 1 -- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54640a8470 msgr2=0x7f5464150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469d3a640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54640a8470 0x7f5464150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469d3a640 1 -- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464070b80 msgr2=0x7f5464141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469d3a640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464070b80 0x7f5464141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469d3a640 1 -- 172.21.15.26:0/1370220305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600094d0 con 0x7f546414e9d0 2023-11-28T16:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469539640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464070b80 0x7f5464141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5469d3a640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f54640c45d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c7a0 tx=0x7f545c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5459ffb640 1 -- 172.21.15.26:0/1370220305 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c003b80 con 0x7f546414e9d0 2023-11-28T16:58:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5459ffb640 1 -- 172.21.15.26:0/1370220305 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c003ce0 con 0x7f546414e9d0 2023-11-28T16:58:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5459ffb640 1 -- 172.21.15.26:0/1370220305 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00aa30 con 0x7f546414e9d0 2023-11-28T16:58:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54640ab740 con 0x7f546414e9d0 2023-11-28T16:58:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54640c5810 con 0x7f546414e9d0 2023-11-28T16:58:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.153+0000 7f5459ffb640 1 -- 172.21.15.26:0/1370220305 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f545c00ab90 con 0x7f546414e9d0 2023-11-28T16:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5459ffb640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54480668d0 0x7f5448068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5459ffb640 1 -- 172.21.15.26:0/1370220305 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f545c084140 con 0x7f546414e9d0 2023-11-28T16:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54480668d0 0x7f5448068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 Processor -- start 2023-11-28T16:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- start start 2023-11-28T16:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54480668d0 0x7f5448068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54600b0000 tx=0x7f54600a9000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca01e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca01ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9ee7110 con 0x5631ca01dfc0 2023-11-28T16:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9e779a0 con 0x5631ca01f200 2023-11-28T16:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631c9e74ed0 con 0x5631ca01e8e0 2023-11-28T16:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca01e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca01e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37388/0 (socket says 172.21.15.26:37388) 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 -- 172.21.15.26:0/3424530176 learned_addr learned my addr 172.21.15.26:0/3424530176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5468d38640 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca01ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469d3a640 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 -- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 msgr2=0x5631ca01ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca01ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 -- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 msgr2=0x5631ca068ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca068ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 -- 172.21.15.26:0/3424530176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631c9b68890 con 0x5631ca01dfc0 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5469539640 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca01e3a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5460006db0 tx=0x7f5460004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d25420cdd941b15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5446ffd640 1 -- 172.21.15.26:0/3424530176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600c9400 con 0x5631ca01dfc0 2023-11-28T16:58:03.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5446ffd640 1 -- 172.21.15.26:0/3424530176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54600c3070 con 0x5631ca01dfc0 2023-11-28T16:58:03.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f5446ffd640 1 -- 172.21.15.26:0/3424530176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600c9760 con 0x5631ca01dfc0 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- 172.21.15.26:0/3424530176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 msgr2=0x5631ca01e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca01e3a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5460006db0 tx=0x7f5460004740 comp rx=0 tx=0).stop 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- 172.21.15.26:0/3424530176 shutdown_connections 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca068ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca01ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 --2- 172.21.15.26:0/3424530176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca01e3a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- 172.21.15.26:0/3424530176 >> 172.21.15.26:0/3424530176 conn(0x5631ca05c830 msgr2=0x5631ca05ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- 172.21.15.26:0/3424530176 shutdown_connections 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.157+0000 7f546eb00000 1 -- 172.21.15.26:0/3424530176 wait complete. 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 -- start start 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 Processor -- start 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca025250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca025790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca025cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9e707c0 con 0x5631ca01e8e0 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9e28bf0 con 0x5631ca01f200 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631c9e2ea90 con 0x5631ca01dfc0 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 10 client.0 _ll_register_callbacks cb 0x5631ca00be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:58:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca025790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca025790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37402/0 (socket says 172.21.15.26:37402) 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 -- 172.21.15.26:0/3632329657 learned_addr learned my addr 172.21.15.26:0/3632329657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5469d3a640 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca025cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5469539640 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca025250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 -- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 msgr2=0x5631ca025250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca025250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 -- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 msgr2=0x5631ca025cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca025cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 -- 172.21.15.26:0/3632329657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5464072450 con 0x5631ca01e8e0 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5468d38640 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca025790 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5454011280 tx=0x7f5454011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9102fccc74cfa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f543ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f543ffff640 1 -- 172.21.15.26:0/3632329657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454015640 con 0x5631ca01e8e0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631c9e32470 con 0x5631ca01e8e0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f543ffff640 1 -- 172.21.15.26:0/3632329657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54540157a0 con 0x5631ca01e8e0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f543ffff640 1 -- 172.21.15.26:0/3632329657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54540159a0 con 0x5631ca01e8e0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 10 client.5841 fetch_fsmap learned FSMap version 32 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5631c9e31190 con 0x5631ca01e8e0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f543ffff640 1 -- 172.21.15.26:0/3632329657 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631c9e32470 con 0x5631ca01e8e0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f543ffff640 1 -- 172.21.15.26:0/3632329657 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5454015b00 con 0x5631ca01e8e0 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 10 client.5841 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 10 client.5841 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 20 client.5841 populate_metadata read hostname 'smithi026' 2023-11-28T16:58:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca072310 0x5631ca074700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 4 client.5841 mds_command: new command op to 5718 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T16:58:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 --> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631c9e35b50 con 0x5631ca072310 2023-11-28T16:58:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.161+0000 7f5469539640 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca072310 0x5631ca074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f5469539640 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca072310 0x5631ca074700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8a85f5189750ca9 server_cookie=879122a9f4b359be in_seq=0 out_seq=0 2023-11-28T16:58:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f543ffff640 10 client.5841 ms_handle_connect on v2:172.21.15.26:6834/3225309020 2023-11-28T16:58:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f543ffff640 1 -- 172.21.15.26:0/3632329657 <== mds.0 v2:172.21.15.26:6834/3225309020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5631c9e35b50 con 0x5631ca072310 2023-11-28T16:58:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f543ffff640 10 client.5841 handle_command_reply: tid=0 2023-11-28T16:58:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 client.5841 shutdown 2023-11-28T16:58:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 msgr2=0x5631ca025790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca025790 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5454011280 tx=0x7f5454011740 comp rx=0 tx=0).stop 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 shutdown_connections 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca072310 0x5631ca074700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca025cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca025790 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 --2- 172.21.15.26:0/3632329657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca025250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f543ffff640 0 client.5841 ms_handle_reset on v2:172.21.15.26:6834/3225309020 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 >> 172.21.15.26:0/3632329657 conn(0x5631ca05c830 msgr2=0x5631ca05ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 shutdown_connections 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 1 -- 172.21.15.26:0/3632329657 wait complete. 2023-11-28T16:58:03.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.165+0000 7f546eb00000 20 client.5841 trim_cache size 0 max 16384 2023-11-28T16:58:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 Processor -- start 2023-11-28T16:58:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 -- start start 2023-11-28T16:58:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca05bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca01c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9b29940 con 0x5631ca01dfc0 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9e6dbc0 con 0x5631ca01f200 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631c9df7a00 con 0x5631ca01e8e0 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca05bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca05bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37412/0 (socket says 172.21.15.26:37412) 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 -- 172.21.15.26:0/1040243197 learned_addr learned my addr 172.21.15.26:0/1040243197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5468d38640 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469d3a640 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca01c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 -- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 msgr2=0x5631ca05c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca05c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 -- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 msgr2=0x5631ca01c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca01c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 -- 172.21.15.26:0/1040243197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631c9e17490 con 0x5631ca01dfc0 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f5469539640 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca05bcb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f54600ae010 tx=0x7f5460008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603fa4056355a36a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f54477fe640 1 -- 172.21.15.26:0/1040243197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600d7370 con 0x5631ca01dfc0 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f54477fe640 1 -- 172.21.15.26:0/1040243197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54600c3040 con 0x5631ca01dfc0 2023-11-28T16:58:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.181+0000 7f54477fe640 1 -- 172.21.15.26:0/1040243197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600d76d0 con 0x5631ca01dfc0 2023-11-28T16:58:03.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- 172.21.15.26:0/1040243197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 msgr2=0x5631ca05bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca05bcb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f54600ae010 tx=0x7f5460008040 comp rx=0 tx=0).stop 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- 172.21.15.26:0/1040243197 shutdown_connections 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca01c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01e8e0 0x5631ca05c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 --2- 172.21.15.26:0/1040243197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01dfc0 0x5631ca05bcb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- 172.21.15.26:0/1040243197 >> 172.21.15.26:0/1040243197 conn(0x5631ca05c830 msgr2=0x5631ca076940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- 172.21.15.26:0/1040243197 shutdown_connections 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- 172.21.15.26:0/1040243197 wait complete. 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- start start 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 Processor -- start 2023-11-28T16:58:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca0765e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca0c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca0c1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9e29d60 con 0x5631ca01e8e0 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ca021820 con 0x5631ca01f200 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631c9b691b0 con 0x5631ca01dfc0 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 10 client.0 _ll_register_callbacks cb 0x5631c9e7b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca0c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca0c0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37426/0 (socket says 172.21.15.26:37426) 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 -- 172.21.15.26:0/1639733605 learned_addr learned my addr 172.21.15.26:0/1639733605 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5469539640 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca0765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5469d3a640 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca0c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 -- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 msgr2=0x5631ca0765e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca0765e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 -- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 msgr2=0x5631ca0c1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca0c1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 -- 172.21.15.26:0/1639733605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631c9b68890 con 0x5631ca01e8e0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f5468d38640 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca0c0bd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5454003b80 tx=0x7f5454014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6235680d37b067bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f543ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f543ffff640 1 -- 172.21.15.26:0/1639733605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454015840 con 0x5631ca01e8e0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f543ffff640 1 -- 172.21.15.26:0/1639733605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5454007b00 con 0x5631ca01e8e0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631c9e6f110 con 0x5631ca01e8e0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f543ffff640 1 -- 172.21.15.26:0/1639733605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54540159a0 con 0x5631ca01e8e0 2023-11-28T16:58:03.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 10 client.5847 fetch_fsmap learned FSMap version 32 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5631c9b68cc0 con 0x5631ca01e8e0 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f543ffff640 1 -- 172.21.15.26:0/1639733605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631c9e6f110 con 0x5631ca01e8e0 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f543ffff640 1 -- 172.21.15.26:0/1639733605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5454015b00 con 0x5631ca01e8e0 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 10 client.5847 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.185+0000 7f546eb00000 10 client.5847 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 20 client.5847 populate_metadata read hostname 'smithi026' 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca0c1650 0x5631ca0bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 4 client.5847 mds_command: new command op to 5718 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 --> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5631c9e9d650 con 0x5631ca0c1650 2023-11-28T16:58:03.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f5469539640 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca0c1650 0x5631ca0bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f5469539640 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca0c1650 0x5631ca0bf7a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcf57e7dbeb4e008 server_cookie=edc8d99d836e4612 in_seq=0 out_seq=0 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f543ffff640 10 client.5847 ms_handle_connect on v2:172.21.15.26:6834/3225309020 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f543ffff640 1 -- 172.21.15.26:0/1639733605 <== mds.0 v2:172.21.15.26:6834/3225309020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x5631c9e9d650 con 0x5631ca0c1650 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f543ffff640 10 client.5847 handle_command_reply: tid=0 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 client.5847 shutdown 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 msgr2=0x5631ca0c0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca0c0bd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5454003b80 tx=0x7f5454014000 comp rx=0 tx=0).stop 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 shutdown_connections 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:6834/3225309020,v1:172.21.15.26:6835/3225309020] conn(0x5631ca0c1650 0x5631ca0bf7a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631ca01f200 0x5631ca0c1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5631ca01e8e0 0x5631ca0c0bd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f543ffff640 0 client.5847 ms_handle_reset on v2:172.21.15.26:6834/3225309020 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 --2- 172.21.15.26:0/1639733605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5631ca01dfc0 0x5631ca0765e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 >> 172.21.15.26:0/1639733605 conn(0x5631ca05c830 msgr2=0x5631ca05b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 shutdown_connections 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 1 -- 172.21.15.26:0/1639733605 wait complete. 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546eb00000 20 client.5847 trim_cache size 0 max 16384 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee", 2023-11-28T16:58:03.197 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5718, 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.90070856, 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 32, 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 50, 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 50, 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 11.836723679 2023-11-28T16:58:03.198 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:58:03.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54480668d0 msgr2=0x7f5448068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54480668d0 0x7f5448068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54600b0000 tx=0x7f54600a9000 comp rx=0 tx=0).stop 2023-11-28T16:58:03.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 msgr2=0x7f54640c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f54640c45d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c7a0 tx=0x7f545c00cc60 comp rx=0 tx=0).stop 2023-11-28T16:58:03.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 shutdown_connections 2023-11-28T16:58:03.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546414e9d0 0x7f54640c45d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54480668d0 0x7f5448068d90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54640a8470 0x7f5464150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 --2- 172.21.15.26:0/1370220305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464070b80 0x7f5464141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 >> 172.21.15.26:0/1370220305 conn(0x7f54640c2ad0 msgr2=0x7f54640c1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 shutdown_connections 2023-11-28T16:58:03.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.189+0000 7f546b79d640 1 -- 172.21.15.26:0/1370220305 wait complete. 2023-11-28T16:58:03.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:58:03.248 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-11-28T16:58:03.245+0000 7fa6af101640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:58:03.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f447669c640 1 Processor -- start 2023-11-28T16:58:03.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f447669c640 1 -- start start 2023-11-28T16:58:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f447669c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44700bd720 0x7f4470158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f447669c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4470155790 con 0x7f447006cd90 2023-11-28T16:58:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f447669c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700c4b00 con 0x7f44700ca610 2023-11-28T16:58:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f447669c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44700c4de0 con 0x7f44700bd720 2023-11-28T16:58:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f446f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44700bd720 0x7f4470158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f4474c39640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f447006cd90 0x7f44700c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54006/0 (socket says 172.21.15.26:54006) 2023-11-28T16:58:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f4474c39640 1 -- 172.21.15.26:0/4120808363 learned_addr learned my addr 172.21.15.26:0/4120808363 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f446f7fe640 1 -- 172.21.15.26:0/4120808363 >> v1:172.21.15.79:6789/0 conn(0x7f44700ca610 legacy=0x7f44700c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f446f7fe640 1 -- 172.21.15.26:0/4120808363 >> v1:172.21.15.26:6789/0 conn(0x7f447006cd90 legacy=0x7f44700c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f446f7fe640 1 -- 172.21.15.26:0/4120808363 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470157e30 con 0x7f44700bd720 2023-11-28T16:58:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.353+0000 7f446effd640 1 -- 172.21.15.26:0/4120808363 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889799141 0 0) 0x7f4470155790 con 0x7f447006cd90 2023-11-28T16:58:03.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f446f7fe640 1 --2- 172.21.15.26:0/4120808363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f4470158350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f44640097c0 tx=0x7f446401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c921a2465a3358 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f446effd640 1 -- 172.21.15.26:0/4120808363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700c52d0 con 0x7f44700bd720 2023-11-28T16:58:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f446effd640 1 -- 172.21.15.26:0/4120808363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640a4840 con 0x7f44700bd720 2023-11-28T16:58:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f446effd640 1 -- 172.21.15.26:0/4120808363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640a4bd0 con 0x7f44700bd720 2023-11-28T16:58:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f447669c640 1 -- 172.21.15.26:0/4120808363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 msgr2=0x7f4470158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f447669c640 1 --2- 172.21.15.26:0/4120808363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f4470158350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f44640097c0 tx=0x7f446401c040 comp rx=0 tx=0).stop 2023-11-28T16:58:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f447669c640 1 -- 172.21.15.26:0/4120808363 shutdown_connections 2023-11-28T16:58:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f447669c640 1 --2- 172.21.15.26:0/4120808363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f4470158350 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f447669c640 1 -- 172.21.15.26:0/4120808363 >> 172.21.15.26:0/4120808363 conn(0x7f4470071ea0 msgr2=0x7f44700722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f447669c640 1 -- 172.21.15.26:0/4120808363 shutdown_connections 2023-11-28T16:58:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.357+0000 7f447669c640 1 -- 172.21.15.26:0/4120808363 wait complete. 2023-11-28T16:58:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 Processor -- start 2023-11-28T16:58:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 -- start start 2023-11-28T16:58:03.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f447006cd90 0x7f447014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f44700aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44700ca610 0x7f44701538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447014ace0 con 0x7f44700bd720 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4470150970 con 0x7f44700ca610 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44700aaec0 con 0x7f447006cd90 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f44700aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f44700aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37438/0 (socket says 172.21.15.26:37438) 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 -- 172.21.15.26:0/3734296443 learned_addr learned my addr 172.21.15.26:0/3734296443 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446ffff640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f447006cd90 0x7f447014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f4474c39640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44700ca610 0x7f44701538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 -- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f447006cd90 msgr2=0x7f447014a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f447006cd90 0x7f447014a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 -- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44700ca610 msgr2=0x7f44701538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44700ca610 0x7f44701538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 -- 172.21.15.26:0/3734296443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009420 con 0x7f44700bd720 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446ffff640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f447006cd90 0x7f447014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f4474c39640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44700ca610 0x7f44701538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446f7fe640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f44700aa980 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f44640af040 tx=0x7f4464019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446cff9640 1 -- 172.21.15.26:0/3734296443 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640ac780 con 0x7f44700bd720 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446cff9640 1 -- 172.21.15.26:0/3734296443 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640ac900 con 0x7f44700bd720 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f446cff9640 1 -- 172.21.15.26:0/3734296443 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640accb0 con 0x7f44700bd720 2023-11-28T16:58:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44701511d0 con 0x7f44700bd720 2023-11-28T16:58:03.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.361+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4470150b80 con 0x7f44700bd720 2023-11-28T16:58:03.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.365+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4470151e00 con 0x7f44700bd720 2023-11-28T16:58:03.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.365+0000 7f446cff9640 1 -- 172.21.15.26:0/3734296443 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f44640b3040 con 0x7f44700bd720 2023-11-28T16:58:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.365+0000 7f446cff9640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f445c0668d0 0x7f445c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.365+0000 7f446cff9640 1 -- 172.21.15.26:0/3734296443 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f446411db80 con 0x7f44700bd720 2023-11-28T16:58:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.365+0000 7f446ffff640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f445c0668d0 0x7f445c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.365+0000 7f446ffff640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f445c0668d0 0x7f445c068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:03.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.369+0000 7f446cff9640 1 -- 172.21.15.26:0/3734296443 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44640ead20 con 0x7f44700bd720 2023-11-28T16:58:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.561+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4470151360 con 0x7f44700bd720 2023-11-28T16:58:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.561+0000 7f446cff9640 1 -- 172.21.15.26:0/3734296443 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f44640ee340 con 0x7f44700bd720 2023-11-28T16:58:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:58:03.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f445c0668d0 msgr2=0x7f445c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f445c0668d0 0x7f445c068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460009040 comp rx=0 tx=0).stop 2023-11-28T16:58:03.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 msgr2=0x7f44700aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:03.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f44700aa980 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f44640af040 tx=0x7f4464019100 comp rx=0 tx=0).stop 2023-11-28T16:58:03.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 shutdown_connections 2023-11-28T16:58:03.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44700ca610 0x7f44701538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44700bd720 0x7f44700aa980 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f445c0668d0 0x7f445c068d90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 --2- 172.21.15.26:0/3734296443 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f447006cd90 0x7f447014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:03.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 >> 172.21.15.26:0/3734296443 conn(0x7f4470071ea0 msgr2=0x7f44700c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:03.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 shutdown_connections 2023-11-28T16:58:03.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:03.565+0000 7f447669c640 1 -- 172.21.15.26:0/3734296443 wait complete. 2023-11-28T16:58:03.586 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:58:03.587 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:58:03.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:03.587 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-11-28T16:58:03.639 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:58:03.639 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:58:03.639 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:58:03.639 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:03.639 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-11-28T16:58:03.640 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:58:03.641 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:03.641 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-11-28T16:58:03.641 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T16:58:03.641 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42291sec preferred_lft 42291sec 2023-11-28T16:58:03.641 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-11-28T16:58:03.641 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:03.641 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:03.642 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:03.642 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-11-28T16:58:03.642 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:58:03.642 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:1b:cd:da:6f brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:03.642 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:58:03.642 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:03.642 INFO:teuthology.orchestra.run.smithi026.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:58:03.643 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:03.643 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:58:03.643 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:03.643 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:58:03.643 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:03.643 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:58:03.643 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:58:03.644 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:58:03.644 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:03.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:03.645 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:58:03.706 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-11-28T16:58:03.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:03.708 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-11-28T16:58:03.760 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-11-28T16:58:03.760 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:58:03.760 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T16:58:03.760 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:58:03.760 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T16:58:03.761 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:58:03.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:03.761 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:58:03.761 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:58:03.761 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T16:58:03.761 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T16:58:03.761 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T16:58:03.761 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:58:03.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:03.855 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:58:03.864 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T16:58:03.865 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:58:03.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:03.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-11-28T16:58:03.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:03.927 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:03.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:03.979 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:04.030 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T16:58:04.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:04.130 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:04.130 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:04.143 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:04.144 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:04.144 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:58:04.144 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:58:04.144 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:58:04.147 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:58:04.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:04.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.169 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:58:04.231 INFO:teuthology.orchestra.run.smithi026.stdout:client5785 2023-11-28T16:58:04.231 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:04.232 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:04.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:58:04.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.469+0000 7f4593565640 1 Processor -- start 2023-11-28T16:58:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.469+0000 7f4593565640 1 -- start start 2023-11-28T16:58:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4593565640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f458c0a8470 0x7f458c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4593565640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c06d320 con 0x7f458c070b80 2023-11-28T16:58:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4593565640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c0721b0 con 0x7f458c14e9d0 2023-11-28T16:58:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4593565640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c0c2830 con 0x7f458c0a8470 2023-11-28T16:58:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4590b00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f458c070b80 0x7f458c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54016/0 (socket says 172.21.15.26:54016) 2023-11-28T16:58:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4590b00640 1 -- 172.21.15.26:0/3884615188 learned_addr learned my addr 172.21.15.26:0/3884615188 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4591b02640 1 --2- 172.21.15.26:0/3884615188 >> v2:172.21.15.79:3300/0 conn(0x7f458c0a8470 0x7f458c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4583fff640 1 -- 172.21.15.26:0/3884615188 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782843197 0 0) 0x7f458c06d320 con 0x7f458c070b80 2023-11-28T16:58:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4583fff640 1 -- 172.21.15.26:0/3884615188 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4578003530 con 0x7f458c070b80 2023-11-28T16:58:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4591b02640 1 -- 172.21.15.26:0/3884615188 >> v1:172.21.15.79:6789/0 conn(0x7f458c14e9d0 legacy=0x7f458c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4583fff640 1 -- 172.21.15.26:0/3884615188 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394275618 0 0) 0x7f4578003530 con 0x7f458c070b80 2023-11-28T16:58:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4591b02640 1 -- 172.21.15.26:0/3884615188 >> v1:172.21.15.26:6789/0 conn(0x7f458c070b80 legacy=0x7f458c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:04.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.473+0000 7f4591b02640 1 -- 172.21.15.26:0/3884615188 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c072450 con 0x7f458c0a8470 2023-11-28T16:58:04.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4591b02640 1 --2- 172.21.15.26:0/3884615188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 0x7f458c151e60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4584009d90 tx=0x7f458401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8ab9875d0cb5d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4583fff640 1 -- 172.21.15.26:0/3884615188 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840a5890 con 0x7f458c0a8470 2023-11-28T16:58:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4583fff640 1 -- 172.21.15.26:0/3884615188 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45840a59f0 con 0x7f458c0a8470 2023-11-28T16:58:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4583fff640 1 -- 172.21.15.26:0/3884615188 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840a5d60 con 0x7f458c0a8470 2023-11-28T16:58:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- 172.21.15.26:0/3884615188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 msgr2=0x7f458c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 --2- 172.21.15.26:0/3884615188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 0x7f458c151e60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4584009d90 tx=0x7f458401c8c0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- 172.21.15.26:0/3884615188 shutdown_connections 2023-11-28T16:58:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 --2- 172.21.15.26:0/3884615188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 0x7f458c151e60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- 172.21.15.26:0/3884615188 >> 172.21.15.26:0/3884615188 conn(0x7f458c0c2ad0 msgr2=0x7f458c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- 172.21.15.26:0/3884615188 shutdown_connections 2023-11-28T16:58:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- 172.21.15.26:0/3884615188 wait complete. 2023-11-28T16:58:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 Processor -- start 2023-11-28T16:58:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- start start 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f458c070b80 0x7f458c1eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 0x7f458c141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f458c14e9d0 0x7f458c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c14f4d0 con 0x7f458c070b80 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c14f1c0 con 0x7f458c0a8470 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.477+0000 7f4593565640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0a9e60 con 0x7f458c14e9d0 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f458c070b80 0x7f458c1eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f458c070b80 0x7f458c1eea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37442/0 (socket says 172.21.15.26:37442) 2023-11-28T16:58:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 -- 172.21.15.26:0/3051146977 learned_addr learned my addr 172.21.15.26:0/3051146977 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4590b00640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 0x7f458c141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591b02640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f458c14e9d0 0x7f458c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 -- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f458c14e9d0 msgr2=0x7f458c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f458c14e9d0 0x7f458c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 -- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 msgr2=0x7f458c141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 0x7f458c141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 -- 172.21.15.26:0/3051146977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584009a70 con 0x7f458c070b80 2023-11-28T16:58:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4591301640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f458c070b80 0x7f458c1eea60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f458800c3c0 tx=0x7f458800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4581ffb640 1 -- 172.21.15.26:0/3051146977 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880052d0 con 0x7f458c070b80 2023-11-28T16:58:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4581ffb640 1 -- 172.21.15.26:0/3051146977 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588005430 con 0x7f458c070b80 2023-11-28T16:58:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4581ffb640 1 -- 172.21.15.26:0/3051146977 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588003840 con 0x7f458c070b80 2023-11-28T16:58:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458c1eefa0 con 0x7f458c070b80 2023-11-28T16:58:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c150d80 con 0x7f458c070b80 2023-11-28T16:58:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c04e890 con 0x7f458c070b80 2023-11-28T16:58:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.481+0000 7f4581ffb640 1 -- 172.21.15.26:0/3051146977 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f45880039a0 con 0x7f458c070b80 2023-11-28T16:58:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.485+0000 7f4581ffb640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45700668d0 0x7f4570068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.485+0000 7f4581ffb640 1 -- 172.21.15.26:0/3051146977 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4588083970 con 0x7f458c070b80 2023-11-28T16:58:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.485+0000 7f4590b00640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45700668d0 0x7f4570068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.485+0000 7f4590b00640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45700668d0 0x7f4570068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f458c144600 tx=0x7f457c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.485+0000 7f4581ffb640 1 -- 172.21.15.26:0/3051146977 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4588050ba0 con 0x7f458c070b80 2023-11-28T16:58:04.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f458c14c300 con 0x7f458c070b80 2023-11-28T16:58:04.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4581ffb640 1 -- 172.21.15.26:0/3051146977 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4588017070 con 0x7f458c070b80 2023-11-28T16:58:04.680 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:58:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45700668d0 msgr2=0x7f4570068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45700668d0 0x7f4570068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f458c144600 tx=0x7f457c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f458c070b80 msgr2=0x7f458c1eea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f458c070b80 0x7f458c1eea60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f458800c3c0 tx=0x7f458800c880 comp rx=0 tx=0).stop 2023-11-28T16:58:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 shutdown_connections 2023-11-28T16:58:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f45700668d0 0x7f4570068d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f458c14e9d0 0x7f458c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c0a8470 0x7f458c141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 --2- 172.21.15.26:0/3051146977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f458c070b80 0x7f458c1eea60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.677+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 >> 172.21.15.26:0/3051146977 conn(0x7f458c0c2ad0 msgr2=0x7f458c14d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.681+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 shutdown_connections 2023-11-28T16:58:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:04.681+0000 7f4593565640 1 -- 172.21.15.26:0/3051146977 wait complete. 2023-11-28T16:58:04.701 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T16:58:04.701 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:58:04.702 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:58:04.702 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T16:58:04.702 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:04.702 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T16:58:04.702 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:58:04.702 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:58:04.702 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:58:04.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.702 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:58:04.713 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42282sec preferred_lft 42282sec 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:58:04.714 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:58:04.715 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:58:04.717 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:04.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.719 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:58:04.782 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:58:04.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.785 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:58:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:58:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:58:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:58:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:58:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:58:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:58:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:58:04.839 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:58:04.839 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:58:04.839 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:58:04.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.839 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:58:04.839 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:58:04.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:58:04.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:58:04.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:58:04.839 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:58:04.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.934 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:58:04.944 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:58:04.944 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:58:04.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:04.945 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:58:05.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:05.008 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:05.059 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:58:05.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:05.059 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:05.110 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T16:58:05.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:05.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:05.204 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:05.204 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:05.217 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:05.217 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:05.217 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:58:05.217 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:58:05.218 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:58:05.221 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:58:05.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:05.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:05.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:05.241 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:58:05.293 INFO:teuthology.orchestra.run.smithi079.stdout:client5333 2023-11-28T16:58:05.294 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:05.294 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:05.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-28T16:58:05.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 Processor -- start 2023-11-28T16:58:05.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 -- start start 2023-11-28T16:58:05.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80901555d0 0x7f80900c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f80900a6e50 0x7f80900c3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80900c3940 0x7f8090158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80900c70a0 con 0x7f80901555d0 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80900c7380 con 0x7f80900a6e50 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8097e09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809006c470 con 0x7f80900c3940 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8095ba5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80901555d0 0x7f80900c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8095ba5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80901555d0 0x7f80900c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37448/0 (socket says 172.21.15.26:37448) 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.485+0000 7f8095ba5640 1 -- 172.21.15.26:0/580337146 learned_addr learned my addr 172.21.15.26:0/580337146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f80953a4640 1 --2- 172.21.15.26:0/580337146 >> v2:172.21.15.79:3300/0 conn(0x7f80900a6e50 0x7f80900c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f80963a6640 1 --2- 172.21.15.26:0/580337146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80900c3940 0x7f8090158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8095ba5640 1 -- 172.21.15.26:0/580337146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80900c3940 msgr2=0x7f8090158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8095ba5640 1 --2- 172.21.15.26:0/580337146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80900c3940 0x7f8090158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8095ba5640 1 -- 172.21.15.26:0/580337146 >> v2:172.21.15.79:3300/0 conn(0x7f80900a6e50 msgr2=0x7f80900c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8095ba5640 1 --2- 172.21.15.26:0/580337146 >> v2:172.21.15.79:3300/0 conn(0x7f80900a6e50 0x7f80900c3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8095ba5640 1 -- 172.21.15.26:0/580337146 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809006c750 con 0x7f80901555d0 2023-11-28T16:58:05.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8095ba5640 1 --2- 172.21.15.26:0/580337146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80901555d0 0x7f80900c78e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f80900c58f0 tx=0x7f808c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fc93c2e8a034ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:05.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8094ba3640 1 -- 172.21.15.26:0/580337146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0aa640 con 0x7f80901555d0 2023-11-28T16:58:05.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8094ba3640 1 -- 172.21.15.26:0/580337146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c0aa7a0 con 0x7f80901555d0 2023-11-28T16:58:05.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8094ba3640 1 -- 172.21.15.26:0/580337146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0aab30 con 0x7f80901555d0 2023-11-28T16:58:05.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8097e09640 1 -- 172.21.15.26:0/580337146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80901555d0 msgr2=0x7f80900c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.489+0000 7f8097e09640 1 --2- 172.21.15.26:0/580337146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80901555d0 0x7f80900c78e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f80900c58f0 tx=0x7f808c01c4c0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- 172.21.15.26:0/580337146 shutdown_connections 2023-11-28T16:58:05.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 --2- 172.21.15.26:0/580337146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80900c3940 0x7f8090158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 --2- 172.21.15.26:0/580337146 >> v2:172.21.15.79:3300/0 conn(0x7f80900a6e50 0x7f80900c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 --2- 172.21.15.26:0/580337146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80901555d0 0x7f80900c78e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- 172.21.15.26:0/580337146 >> 172.21.15.26:0/580337146 conn(0x7f80900c4960 msgr2=0x7f80900c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:05.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- 172.21.15.26:0/580337146 shutdown_connections 2023-11-28T16:58:05.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- 172.21.15.26:0/580337146 wait complete. 2023-11-28T16:58:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 Processor -- start 2023-11-28T16:58:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- start start 2023-11-28T16:58:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80900a6e50 0x7f80901ee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80900c3940 0x7f8090070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80901555d0 0x7f80901eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80901ee5d0 con 0x7f80900a6e50 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80900705d0 con 0x7f80900c3940 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8097e09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8090150a70 con 0x7f80901555d0 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80900a6e50 0x7f80901ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80900a6e50 0x7f80901ee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37464/0 (socket says 172.21.15.26:37464) 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 -- 172.21.15.26:0/1875649788 learned_addr learned my addr 172.21.15.26:0/1875649788 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f80953a4640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80900c3940 0x7f8090070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f80963a6640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80901555d0 0x7f80901eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 -- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80901555d0 msgr2=0x7f80901eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80901555d0 0x7f80901eea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 -- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80900c3940 msgr2=0x7f8090070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80900c3940 0x7f8090070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 -- 172.21.15.26:0/1875649788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0094d0 con 0x7f80900a6e50 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f80953a4640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80900c3940 0x7f8090070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.493+0000 7f8095ba5640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80900a6e50 0x7f80901ee090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f808c01ab70 tx=0x7f808c01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f80867fc640 1 -- 172.21.15.26:0/1875649788 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0bd5f0 con 0x7f80900a6e50 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f80867fc640 1 -- 172.21.15.26:0/1875649788 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c0bd770 con 0x7f80900a6e50 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f80867fc640 1 -- 172.21.15.26:0/1875649788 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0bdb20 con 0x7f80900a6e50 2023-11-28T16:58:05.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8090158960 con 0x7f80900a6e50 2023-11-28T16:58:05.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80900abb10 con 0x7f80900a6e50 2023-11-28T16:58:05.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809004e890 con 0x7f80900a6e50 2023-11-28T16:58:05.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f80867fc640 1 -- 172.21.15.26:0/1875649788 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f808c0a8050 con 0x7f80900a6e50 2023-11-28T16:58:05.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f80867fc640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80740668d0 0x7f8074068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f80867fc640 1 -- 172.21.15.26:0/1875649788 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f808c11ec20 con 0x7f80900a6e50 2023-11-28T16:58:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.497+0000 7f80953a4640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80740668d0 0x7f8074068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.501+0000 7f80953a4640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80740668d0 0x7f8074068d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f809015a2b0 tx=0x7f8080008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.501+0000 7f80867fc640 1 -- 172.21.15.26:0/1875649788 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f808c0ec020 con 0x7f80900a6e50 2023-11-28T16:58:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.717+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f809006d370 con 0x7f80900a6e50 2023-11-28T16:58:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.717+0000 7f80867fc640 1 -- 172.21.15.26:0/1875649788 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v17) v1 ==== 84+0+0 (secure 0 0 0) 0x7f808c0ef640 con 0x7f80900a6e50 2023-11-28T16:58:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80740668d0 msgr2=0x7f8074068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80740668d0 0x7f8074068d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f809015a2b0 tx=0x7f8080008040 comp rx=0 tx=0).stop 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80900a6e50 msgr2=0x7f80901ee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80900a6e50 0x7f80901ee090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f808c01ab70 tx=0x7f808c01ad00 comp rx=0 tx=0).stop 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 shutdown_connections 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f80740668d0 0x7f8074068d90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80901555d0 0x7f80901eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80900c3940 0x7f8090070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 --2- 172.21.15.26:0/1875649788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80900a6e50 0x7f80901ee090 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 >> 172.21.15.26:0/1875649788 conn(0x7f80900c4960 msgr2=0x7f80900a8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 shutdown_connections 2023-11-28T16:58:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.721+0000 7f8097e09640 1 -- 172.21.15.26:0/1875649788 wait complete. 2023-11-28T16:58:05.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.881+0000 7f1c9e2aa640 1 Processor -- start 2023-11-28T16:58:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.881+0000 7f1c9e2aa640 1 -- start start 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9e2aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c9814e9d0 0x7f1c98151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9e2aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c980a8470 0x7f1c9806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9e2aa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9806d320 con 0x7f1c98070b80 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9e2aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c980721b0 con 0x7f1c980a8470 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9e2aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c980c2830 con 0x7f1c9814e9d0 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9c847640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c980a8470 0x7f1c9806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c977fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1c98070b80 0x7f1c980c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54020/0 (socket says 172.21.15.26:54020) 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c977fe640 1 -- 172.21.15.26:0/4123128458 learned_addr learned my addr 172.21.15.26:0/4123128458 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c97fff640 1 --2- 172.21.15.26:0/4123128458 >> v2:172.21.15.79:3300/0 conn(0x7f1c9814e9d0 0x7f1c98151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c96ffd640 1 -- 172.21.15.26:0/4123128458 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313295783 0 0) 0x7f1c9806d320 con 0x7f1c98070b80 2023-11-28T16:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c96ffd640 1 -- 172.21.15.26:0/4123128458 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c80003530 con 0x7f1c98070b80 2023-11-28T16:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9c847640 1 -- 172.21.15.26:0/4123128458 >> v2:172.21.15.79:3300/0 conn(0x7f1c9814e9d0 msgr2=0x7f1c98151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9c847640 1 --2- 172.21.15.26:0/4123128458 >> v2:172.21.15.79:3300/0 conn(0x7f1c9814e9d0 0x7f1c98151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9c847640 1 -- 172.21.15.26:0/4123128458 >> v1:172.21.15.26:6789/0 conn(0x7f1c98070b80 legacy=0x7f1c980c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.885+0000 7f1c9c847640 1 -- 172.21.15.26:0/4123128458 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98072450 con 0x7f1c980a8470 2023-11-28T16:58:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9c847640 1 --2- 172.21.15.26:0/4123128458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9806d7b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1c980c3980 tx=0x7f1c9001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d80432ba985c56 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c96ffd640 1 -- 172.21.15.26:0/4123128458 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900a5850 con 0x7f1c980a8470 2023-11-28T16:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c96ffd640 1 -- 172.21.15.26:0/4123128458 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900a59b0 con 0x7f1c980a8470 2023-11-28T16:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c96ffd640 1 -- 172.21.15.26:0/4123128458 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900a5d40 con 0x7f1c980a8470 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/4123128458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 msgr2=0x7f1c9806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/4123128458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9806d7b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1c980c3980 tx=0x7f1c9001c880 comp rx=0 tx=0).stop 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/4123128458 shutdown_connections 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/4123128458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9806d7b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/4123128458 >> v2:172.21.15.79:3300/0 conn(0x7f1c9814e9d0 0x7f1c98151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/4123128458 >> 172.21.15.26:0/4123128458 conn(0x7f1c980c2ad0 msgr2=0x7f1c980c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/4123128458 shutdown_connections 2023-11-28T16:58:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/4123128458 wait complete. 2023-11-28T16:58:05.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 Processor -- start 2023-11-28T16:58:05.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.889+0000 7f1c9e2aa640 1 -- start start 2023-11-28T16:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98070b80 0x7f1c981f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814e9d0 0x7f1c981ede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9814a720 con 0x7f1c980a8470 2023-11-28T16:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9814a460 con 0x7f1c9814e9d0 2023-11-28T16:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9814ab30 con 0x7f1c98070b80 2023-11-28T16:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9814f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37484/0 (socket says 172.21.15.26:37484) 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 -- 172.21.15.26:0/718948601 learned_addr learned my addr 172.21.15.26:0/718948601 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9c847640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814e9d0 0x7f1c981ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c97fff640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98070b80 0x7f1c981f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 -- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98070b80 msgr2=0x7f1c981f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98070b80 0x7f1c981f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 -- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814e9d0 msgr2=0x7f1c981ede20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814e9d0 0x7f1c981ede20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 -- 172.21.15.26:0/718948601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90009a70 con 0x7f1c980a8470 2023-11-28T16:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c977fe640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9814f6b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c001ec0 tx=0x7f1c8c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c94ff9640 1 -- 172.21.15.26:0/718948601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c005d50 con 0x7f1c980a8470 2023-11-28T16:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c94ff9640 1 -- 172.21.15.26:0/718948601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c007070 con 0x7f1c980a8470 2023-11-28T16:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c981f4350 con 0x7f1c980a8470 2023-11-28T16:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c94ff9640 1 -- 172.21.15.26:0/718948601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c007420 con 0x7f1c980a8470 2023-11-28T16:58:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c981f5090 con 0x7f1c980a8470 2023-11-28T16:58:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c981f41b0 con 0x7f1c980a8470 2023-11-28T16:58:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.893+0000 7f1c94ff9640 1 -- 172.21.15.26:0/718948601 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c8c007580 con 0x7f1c980a8470 2023-11-28T16:58:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.897+0000 7f1c94ff9640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c840668d0 0x7f1c84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.897+0000 7f1c94ff9640 1 -- 172.21.15.26:0/718948601 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c8c083970 con 0x7f1c980a8470 2023-11-28T16:58:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.897+0000 7f1c97fff640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c840668d0 0x7f1c84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.897+0000 7f1c97fff640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c840668d0 0x7f1c84068d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c880079c0 tx=0x7f1c88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:05.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:05.901+0000 7f1c94ff9640 1 -- 172.21.15.26:0/718948601 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c981f41b0 con 0x7f1c980a8470 2023-11-28T16:58:06.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.057+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c981f41b0 con 0x7f1c980a8470 2023-11-28T16:58:06.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c94ff9640 1 -- 172.21.15.26:0/718948601 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f1c981f41b0 con 0x7f1c980a8470 2023-11-28T16:58:06.063 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":50,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:57:58.282420+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:06.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c840668d0 msgr2=0x7f1c84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c840668d0 0x7f1c84068d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c880079c0 tx=0x7f1c88008040 comp rx=0 tx=0).stop 2023-11-28T16:58:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 msgr2=0x7f1c9814f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9814f6b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c001ec0 tx=0x7f1c8c00c960 comp rx=0 tx=0).stop 2023-11-28T16:58:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 shutdown_connections 2023-11-28T16:58:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c9814e9d0 0x7f1c981ede20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c980a8470 0x7f1c9814f6b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1c840668d0 0x7f1c84068d90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 --2- 172.21.15.26:0/718948601 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c98070b80 0x7f1c981f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 >> 172.21.15.26:0/718948601 conn(0x7f1c980c2ad0 msgr2=0x7f1c9814b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 shutdown_connections 2023-11-28T16:58:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.061+0000 7f1c9e2aa640 1 -- 172.21.15.26:0/718948601 wait complete. 2023-11-28T16:58:06.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:54.472607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:55.658818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:06.086 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:06.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.229+0000 7fb03f009640 1 Processor -- start 2023-11-28T16:58:06.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.229+0000 7fb03f009640 1 -- start start 2023-11-28T16:58:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03f009640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb03814eaf0 0x7fb038151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03f009640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb038151f90 0x7fb03806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03f009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb03806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03f009640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03806de00 con 0x7fb03814eaf0 2023-11-28T16:58:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03f009640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb038070390 con 0x7fb038151f90 2023-11-28T16:58:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03f009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03806db90 con 0x7fb0380c0370 2023-11-28T16:58:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb03814eaf0 0x7fb038151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb03814eaf0 0x7fb038151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37490/0 (socket says 172.21.15.26:37490) 2023-11-28T16:58:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 -- 172.21.15.26:0/1175839322 learned_addr learned my addr 172.21.15.26:0/1175839322 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03d5a6640 1 --2- 172.21.15.26:0/1175839322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb03806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 -- 172.21.15.26:0/1175839322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 msgr2=0x7fb03806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb037fff640 1 --2- 172.21.15.26:0/1175839322 >> v2:172.21.15.79:3300/0 conn(0x7fb038151f90 0x7fb03806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 --2- 172.21.15.26:0/1175839322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb03806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 -- 172.21.15.26:0/1175839322 >> v2:172.21.15.79:3300/0 conn(0x7fb038151f90 msgr2=0x7fb03806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 --2- 172.21.15.26:0/1175839322 >> v2:172.21.15.79:3300/0 conn(0x7fb038151f90 0x7fb03806d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 -- 172.21.15.26:0/1175839322 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03814eed0 con 0x7fb03814eaf0 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03d5a6640 1 --2- 172.21.15.26:0/1175839322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb03806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb037fff640 1 --2- 172.21.15.26:0/1175839322 >> v2:172.21.15.79:3300/0 conn(0x7fb038151f90 0x7fb03806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:06.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.233+0000 7fb03cda5640 1 --2- 172.21.15.26:0/1175839322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb038151a50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb03806e2d0 tx=0x7fb02c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892106a009f22274 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb0377fe640 1 -- 172.21.15.26:0/1175839322 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0ac600 con 0x7fb03814eaf0 2023-11-28T16:58:06.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb0377fe640 1 -- 172.21.15.26:0/1175839322 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c0a8050 con 0x7fb03814eaf0 2023-11-28T16:58:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb0377fe640 1 -- 172.21.15.26:0/1175839322 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0ac980 con 0x7fb03814eaf0 2023-11-28T16:58:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- 172.21.15.26:0/1175839322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 msgr2=0x7fb038151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 --2- 172.21.15.26:0/1175839322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb038151a50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb03806e2d0 tx=0x7fb02c01c3e0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- 172.21.15.26:0/1175839322 shutdown_connections 2023-11-28T16:58:06.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 --2- 172.21.15.26:0/1175839322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb03806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 --2- 172.21.15.26:0/1175839322 >> v2:172.21.15.79:3300/0 conn(0x7fb038151f90 0x7fb03806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 --2- 172.21.15.26:0/1175839322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb038151a50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- 172.21.15.26:0/1175839322 >> 172.21.15.26:0/1175839322 conn(0x7fb0380c2a60 msgr2=0x7fb0380c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:06.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- 172.21.15.26:0/1175839322 shutdown_connections 2023-11-28T16:58:06.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- 172.21.15.26:0/1175839322 wait complete. 2023-11-28T16:58:06.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 Processor -- start 2023-11-28T16:58:06.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- start start 2023-11-28T16:58:06.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb038154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb0380a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb03813ae50 0x7fb0380aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0381ed950 con 0x7fb03814eaf0 2023-11-28T16:58:06.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380ab750 con 0x7fb03813ae50 2023-11-28T16:58:06.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb03f009640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380aba30 con 0x7fb0380c0370 2023-11-28T16:58:06.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.237+0000 7fb037fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb0380a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb0380a9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37498/0 (socket says 172.21.15.26:37498) 2023-11-28T16:58:06.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 -- 172.21.15.26:0/3087525026 learned_addr learned my addr 172.21.15.26:0/3087525026 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:06.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb03d5a6640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb03813ae50 0x7fb0380aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb03cda5640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb038154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 -- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 msgr2=0x7fb038154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb038154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 -- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb03813ae50 msgr2=0x7fb0380aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb03813ae50 0x7fb0380aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 -- 172.21.15.26:0/3087525026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0094d0 con 0x7fb03814eaf0 2023-11-28T16:58:06.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb037fff640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb0380a9d50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c7f0 tx=0x7fb02400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb0357fa640 1 -- 172.21.15.26:0/3087525026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024007820 con 0x7fb03814eaf0 2023-11-28T16:58:06.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb0357fa640 1 -- 172.21.15.26:0/3087525026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024007980 con 0x7fb03814eaf0 2023-11-28T16:58:06.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0381ed5e0 con 0x7fb03814eaf0 2023-11-28T16:58:06.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb0357fa640 1 -- 172.21.15.26:0/3087525026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024007d30 con 0x7fb03814eaf0 2023-11-28T16:58:06.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0380abd10 con 0x7fb03814eaf0 2023-11-28T16:58:06.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0381edb00 con 0x7fb03814eaf0 2023-11-28T16:58:06.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb0357fa640 1 -- 172.21.15.26:0/3087525026 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb0240113f0 con 0x7fb03814eaf0 2023-11-28T16:58:06.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.241+0000 7fb0357fa640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb01c066900 0x7fb01c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.245+0000 7fb0357fa640 1 -- 172.21.15.26:0/3087525026 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0240846b0 con 0x7fb03814eaf0 2023-11-28T16:58:06.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.245+0000 7fb03cda5640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb01c066900 0x7fb01c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.245+0000 7fb03cda5640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb01c066900 0x7fb01c068dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0ae000 tx=0x7fb02c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.245+0000 7fb0357fa640 1 -- 172.21.15.26:0/3087525026 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0381edb00 con 0x7fb03814eaf0 2023-11-28T16:58:06.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb03804e890 con 0x7fb03814eaf0 2023-11-28T16:58:06.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb0357fa640 1 -- 172.21.15.26:0/3087525026 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb024051990 con 0x7fb03814eaf0 2023-11-28T16:58:06.408 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:06.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb01c066900 msgr2=0x7fb01c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb01c066900 0x7fb01c068dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0ae000 tx=0x7fb02c0a7000 comp rx=0 tx=0).stop 2023-11-28T16:58:06.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 msgr2=0x7fb0380a9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb0380a9d50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c7f0 tx=0x7fb02400ccb0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 shutdown_connections 2023-11-28T16:58:06.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb03813ae50 0x7fb0380aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb03814eaf0 0x7fb0380a9d50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb01c066900 0x7fb01c068dc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 --2- 172.21.15.26:0/3087525026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0380c0370 0x7fb038154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 >> 172.21.15.26:0/3087525026 conn(0x7fb0380c2a60 msgr2=0x7fb03813dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:06.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 shutdown_connections 2023-11-28T16:58:06.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.405+0000 7fb03f009640 1 -- 172.21.15.26:0/3087525026 wait complete. 2023-11-28T16:58:06.430 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:58:06.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.573+0000 7f3cf569a640 1 Processor -- start 2023-11-28T16:58:06.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.573+0000 7f3cf569a640 1 -- start start 2023-11-28T16:58:06.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.573+0000 7f3cf569a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3cf0158a10 0x7f3cf00c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.573+0000 7f3cf569a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0158580 con 0x7f3cf0151bf0 2023-11-28T16:58:06.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.573+0000 7f3cf569a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0158e60 con 0x7f3cf00c6220 2023-11-28T16:58:06.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.573+0000 7f3cf569a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf0157f50 con 0x7f3cf0158a10 2023-11-28T16:58:06.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cef7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3cf0151bf0 0x7f3cf015f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54022/0 (socket says 172.21.15.26:54022) 2023-11-28T16:58:06.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cef7fe640 1 -- 172.21.15.26:0/3893241934 learned_addr learned my addr 172.21.15.26:0/3893241934 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:06.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cee7fc640 1 --2- 172.21.15.26:0/3893241934 >> v2:172.21.15.79:3300/0 conn(0x7f3cf0158a10 0x7f3cf00c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cedffb640 1 -- 172.21.15.26:0/3893241934 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994609108 0 0) 0x7f3cf0158580 con 0x7f3cf0151bf0 2023-11-28T16:58:06.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cedffb640 1 -- 172.21.15.26:0/3893241934 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd8003530 con 0x7f3cf0151bf0 2023-11-28T16:58:06.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cee7fc640 1 -- 172.21.15.26:0/3893241934 >> v1:172.21.15.79:6789/0 conn(0x7f3cf00c6220 legacy=0x7f3cf00c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cee7fc640 1 -- 172.21.15.26:0/3893241934 >> v1:172.21.15.26:6789/0 conn(0x7f3cf0151bf0 legacy=0x7f3cf015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cee7fc640 1 -- 172.21.15.26:0/3893241934 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00c1f60 con 0x7f3cf0158a10 2023-11-28T16:58:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.577+0000 7f3cee7fc640 1 --2- 172.21.15.26:0/3893241934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0158a10 0x7f3cf00c28c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097a0 tx=0x7f3ce401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e382d5fab754c56a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cedffb640 1 -- 172.21.15.26:0/3893241934 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40a7070 con 0x7f3cf0158a10 2023-11-28T16:58:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cedffb640 1 -- 172.21.15.26:0/3893241934 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40ab430 con 0x7f3cf0158a10 2023-11-28T16:58:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cedffb640 1 -- 172.21.15.26:0/3893241934 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40ab7c0 con 0x7f3cf0158a10 2023-11-28T16:58:06.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- 172.21.15.26:0/3893241934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0158a10 msgr2=0x7f3cf00c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 --2- 172.21.15.26:0/3893241934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0158a10 0x7f3cf00c28c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097a0 tx=0x7f3ce401c430 comp rx=0 tx=0).stop 2023-11-28T16:58:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- 172.21.15.26:0/3893241934 shutdown_connections 2023-11-28T16:58:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 --2- 172.21.15.26:0/3893241934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0158a10 0x7f3cf00c28c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- 172.21.15.26:0/3893241934 >> 172.21.15.26:0/3893241934 conn(0x7f3cf006a5a0 msgr2=0x7f3cf006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- 172.21.15.26:0/3893241934 shutdown_connections 2023-11-28T16:58:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- 172.21.15.26:0/3893241934 wait complete. 2023-11-28T16:58:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 Processor -- start 2023-11-28T16:58:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- start start 2023-11-28T16:58:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cf00c6220 0x7f3cf00a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0151bf0 0x7f3cf00a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cf0158a10 0x7f3cf014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf01570e0 con 0x7f3cf00c6220 2023-11-28T16:58:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0157c70 con 0x7f3cf0151bf0 2023-11-28T16:58:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cf569a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf01574b0 con 0x7f3cf0158a10 2023-11-28T16:58:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3ceeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cf00c6220 0x7f3cf00a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3ceeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cf00c6220 0x7f3cf00a1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37514/0 (socket says 172.21.15.26:37514) 2023-11-28T16:58:06.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3ceeffd640 1 -- 172.21.15.26:0/788622720 learned_addr learned my addr 172.21.15.26:0/788622720 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:06.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cee7fc640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0151bf0 0x7f3cf00a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.581+0000 7f3cef7fe640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cf0158a10 0x7f3cf014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3ceeffd640 1 -- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cf0158a10 msgr2=0x7f3cf014da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3ceeffd640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cf0158a10 0x7f3cf014da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3ceeffd640 1 -- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0151bf0 msgr2=0x7f3cf00a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3ceeffd640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0151bf0 0x7f3cf00a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3ceeffd640 1 -- 172.21.15.26:0/788622720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40093b0 con 0x7f3cf00c6220 2023-11-28T16:58:06.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3ceeffd640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cf00c6220 0x7f3cf00a1ac0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c500 tx=0x7f3ce000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cd77fe640 1 -- 172.21.15.26:0/788622720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0005220 con 0x7f3cf00c6220 2023-11-28T16:58:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cd77fe640 1 -- 172.21.15.26:0/788622720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce0005380 con 0x7f3cf00c6220 2023-11-28T16:58:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf00a24a0 con 0x7f3cf00c6220 2023-11-28T16:58:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cd77fe640 1 -- 172.21.15.26:0/788622720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0007270 con 0x7f3cf00c6220 2023-11-28T16:58:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf0157990 con 0x7f3cf00c6220 2023-11-28T16:58:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf00a2630 con 0x7f3cf00c6220 2023-11-28T16:58:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cd77fe640 1 -- 172.21.15.26:0/788622720 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3ce00073d0 con 0x7f3cf00c6220 2023-11-28T16:58:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cd77fe640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3cdc0668d0 0x7f3cdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.585+0000 7f3cd77fe640 1 -- 172.21.15.26:0/788622720 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ce0083950 con 0x7f3cf00c6220 2023-11-28T16:58:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.589+0000 7f3cee7fc640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3cdc0668d0 0x7f3cdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.589+0000 7f3cee7fc640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3cdc0668d0 0x7f3cdc068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40af000 tx=0x7f3ce40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.589+0000 7f3cd77fe640 1 -- 172.21.15.26:0/788622720 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ce0050ba0 con 0x7f3cf00c6220 2023-11-28T16:58:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.749+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cf004e890 con 0x7f3cf00c6220 2023-11-28T16:58:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.749+0000 7f3cd77fe640 1 -- 172.21.15.26:0/788622720 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ce00541c0 con 0x7f3cf00c6220 2023-11-28T16:58:06.754 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:06.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3cdc0668d0 msgr2=0x7f3cdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3cdc0668d0 0x7f3cdc068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40af000 tx=0x7f3ce40a7000 comp rx=0 tx=0).stop 2023-11-28T16:58:06.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cf00c6220 msgr2=0x7f3cf00a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cf00c6220 0x7f3cf00a1ac0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c500 tx=0x7f3ce000c9c0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 shutdown_connections 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3cdc0668d0 0x7f3cdc068d90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cf0158a10 0x7f3cf014da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf0151bf0 0x7f3cf00a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 --2- 172.21.15.26:0/788622720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cf00c6220 0x7f3cf00a1ac0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 >> 172.21.15.26:0/788622720 conn(0x7f3cf006a5a0 msgr2=0x7f3cf006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 shutdown_connections 2023-11-28T16:58:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.753+0000 7f3cf569a640 1 -- 172.21.15.26:0/788622720 wait complete. 2023-11-28T16:58:06.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:58:06.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.917+0000 7fa82b59e640 1 Processor -- start 2023-11-28T16:58:06.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.917+0000 7fa82b59e640 1 -- start start 2023-11-28T16:58:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82b59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 0x7fa82c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82b59e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c151e90 con 0x7fa82c151ab0 2023-11-28T16:58:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82b59e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c0c71a0 con 0x7fa82c0c4ca0 2023-11-28T16:58:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82b59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0c6900 con 0x7fa82c0c7ce0 2023-11-28T16:58:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa82c151ab0 0x7fa82c154e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54024/0 (socket says 172.21.15.26:54024) 2023-11-28T16:58:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 -- 172.21.15.26:0/3433666145 learned_addr learned my addr 172.21.15.26:0/3433666145 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa823fff640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 0x7fa82c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190174296 0 0) 0x7fa82c151e90 con 0x7fa82c151ab0 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa818003530 con 0x7fa82c151ab0 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698069400 0 0) 0x7fa818003530 con 0x7fa82c151ab0 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 msgr2=0x7fa82c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 0x7fa82c0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 >> v1:172.21.15.79:6789/0 conn(0x7fa82c0c4ca0 legacy=0x7fa82c06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0c6be0 con 0x7fa82c151ab0 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fa81c001680 con 0x7fa82c151ab0 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 >> v1:172.21.15.26:6789/0 conn(0x7fa82c151ab0 legacy=0x7fa82c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8180039b0 0x7fa818003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 0x7fa8180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa818004d10 0x7fa818005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0c6900 con 0x7fa8180039b0 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81800ba40 con 0x7fa818004d10 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81800bc00 con 0x7fa82c0c7ce0 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8180039b0 0x7fa818003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa823fff640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 0x7fa8180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82ad9d640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa818004d10 0x7fa818005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 -- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 msgr2=0x7fa8180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c0c7ce0 0x7fa8180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 -- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa818004d10 msgr2=0x7fa818005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:06.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa818004d10 0x7fa818005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.921+0000 7fa82a59c640 1 -- 172.21.15.26:0/3433666145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818003530 con 0x7fa8180039b0 2023-11-28T16:58:06.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82a59c640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8180039b0 0x7fa818003d90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c210 tx=0x7fa81c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f0a664feb81a0d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c005ae0 con 0x7fa8180039b0 2023-11-28T16:58:06.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c005c60 con 0x7fa8180039b0 2023-11-28T16:58:06.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa829d9b640 1 -- 172.21.15.26:0/3433666145 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c007070 con 0x7fa8180039b0 2023-11-28T16:58:06.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82b59e640 1 -- 172.21.15.26:0/3433666145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8180039b0 msgr2=0x7fa818003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82b59e640 1 --2- 172.21.15.26:0/3433666145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8180039b0 0x7fa818003d90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c210 tx=0x7fa81c01cc60 comp rx=0 tx=0).stop 2023-11-28T16:58:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82ad9d640 1 -- 172.21.15.26:0/3433666145 reap_dead start 2023-11-28T16:58:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82b59e640 1 -- 172.21.15.26:0/3433666145 shutdown_connections 2023-11-28T16:58:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82b59e640 1 -- 172.21.15.26:0/3433666145 >> 172.21.15.26:0/3433666145 conn(0x7fa82c0abba0 msgr2=0x7fa82c0abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82b59e640 1 -- 172.21.15.26:0/3433666145 shutdown_connections 2023-11-28T16:58:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.925+0000 7fa82b59e640 1 -- 172.21.15.26:0/3433666145 wait complete. 2023-11-28T16:58:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 Processor -- start 2023-11-28T16:58:06.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 -- start start 2023-11-28T16:58:06.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8180039b0 0x7fa82c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa82c14ff00 0x7fa82c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c150eb0 0x7fa82c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0ab5c0 con 0x7fa82c14ff00 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c150710 con 0x7fa8180039b0 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0aaf40 con 0x7fa82c150eb0 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa82c14ff00 0x7fa82c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa82c14ff00 0x7fa82c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37520/0 (socket says 172.21.15.26:37520) 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 -- 172.21.15.26:0/3298721112 learned_addr learned my addr 172.21.15.26:0/3298721112 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82a59c640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8180039b0 0x7fa82c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82ad9d640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c150eb0 0x7fa82c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 -- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c150eb0 msgr2=0x7fa82c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c150eb0 0x7fa82c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 -- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8180039b0 msgr2=0x7fa82c150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8180039b0 0x7fa82c150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 -- 172.21.15.26:0/3298721112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c150430 con 0x7fa82c14ff00 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa823fff640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa82c14ff00 0x7fa82c146b70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa814011940 tx=0x7fa814011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa822ffd640 1 -- 172.21.15.26:0/3298721112 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814004240 con 0x7fa82c14ff00 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa822ffd640 1 -- 172.21.15.26:0/3298721112 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140043a0 con 0x7fa82c14ff00 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa822ffd640 1 -- 172.21.15.26:0/3298721112 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81400fb00 con 0x7fa82c14ff00 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c0ab1e0 con 0x7fa82c14ff00 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.929+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c0a9bc0 con 0x7fa82c14ff00 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.933+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c067a10 con 0x7fa82c14ff00 2023-11-28T16:58:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.933+0000 7fa822ffd640 1 -- 172.21.15.26:0/3298721112 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa81400fc60 con 0x7fa82c14ff00 2023-11-28T16:58:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.933+0000 7fa822ffd640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa80c0668d0 0x7fa80c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.933+0000 7fa822ffd640 1 -- 172.21.15.26:0/3298721112 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa814084a70 con 0x7fa82c14ff00 2023-11-28T16:58:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.933+0000 7fa82a59c640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa80c0668d0 0x7fa80c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:06.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.933+0000 7fa82a59c640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa80c0668d0 0x7fa80c068d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0ab000 tx=0x7fa81c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:06.937+0000 7fa822ffd640 1 -- 172.21.15.26:0/3298721112 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa814051ca0 con 0x7fa82c14ff00 2023-11-28T16:58:07.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa82c0ab370 con 0x7fa82c14ff00 2023-11-28T16:58:07.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa822ffd640 1 -- 172.21.15.26:0/3298721112 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8140230a0 con 0x7fa82c14ff00 2023-11-28T16:58:07.095 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa80c0668d0 msgr2=0x7fa80c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa80c0668d0 0x7fa80c068d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0ab000 tx=0x7fa81c0a7070 comp rx=0 tx=0).stop 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa82c14ff00 msgr2=0x7fa82c146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa82c14ff00 0x7fa82c146b70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa814011940 tx=0x7fa814011e00 comp rx=0 tx=0).stop 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 shutdown_connections 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa80c0668d0 0x7fa80c068d90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82c150eb0 0x7fa82c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa82c14ff00 0x7fa82c146b70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 --2- 172.21.15.26:0/3298721112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8180039b0 0x7fa82c150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 >> 172.21.15.26:0/3298721112 conn(0x7fa82c0abba0 msgr2=0x7fa82c14bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 shutdown_connections 2023-11-28T16:58:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.093+0000 7fa82b59e640 1 -- 172.21.15.26:0/3298721112 wait complete. 2023-11-28T16:58:07.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T16:58:07.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2b901640 1 Processor -- start 2023-11-28T16:58:07.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2b901640 1 -- start start 2023-11-28T16:58:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2b901640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c241555d0 0x7f0c240c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2b901640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c24158010 0x7f0c241584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2b901640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c240c70a0 con 0x7f0c240a6e50 2023-11-28T16:58:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2b901640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240c7380 con 0x7f0c241555d0 2023-11-28T16:58:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2b901640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2406c470 con 0x7f0c24158010 2023-11-28T16:58:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c29e9e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c24158010 0x7f0c241584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2969d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c241555d0 0x7f0c240c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c28e9c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0c240a6e50 0x7f0c240c3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:43586/0 (socket says 172.21.15.26:43586) 2023-11-28T16:58:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c28e9c640 1 -- 172.21.15.26:0/84206060 learned_addr learned my addr 172.21.15.26:0/84206060 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2969d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c241555d0 0x7f0c240c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:37200/0 (socket says 172.21.15.26:37200) 2023-11-28T16:58:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c29e9e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c24158010 0x7f0c241584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:45862/0 (socket says 172.21.15.26:45862) 2023-11-28T16:58:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2969d640 1 -- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c24158010 msgr2=0x7f0c241584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2969d640 1 --2- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c24158010 0x7f0c241584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2969d640 1 -- 172.21.15.26:0/84206060 >> v1:172.21.15.79:6789/0 conn(0x7f0c240a6e50 legacy=0x7f0c240c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c2969d640 1 -- 172.21.15.26:0/84206060 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2406c750 con 0x7f0c241555d0 2023-11-28T16:58:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.257+0000 7f0c29e9e640 1 --2- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c24158010 0x7f0c241584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:07.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2969d640 1 --2- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c241555d0 0x7f0c240c78e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097c0 tx=0x7f0c2001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=761e6503b27c0090 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c1bfff640 1 -- 172.21.15.26:0/84206060 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200ab600 con 0x7f0c241555d0 2023-11-28T16:58:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c1bfff640 1 -- 172.21.15.26:0/84206060 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c200a7050 con 0x7f0c241555d0 2023-11-28T16:58:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c1bfff640 1 -- 172.21.15.26:0/84206060 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200ab980 con 0x7f0c241555d0 2023-11-28T16:58:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 -- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c241555d0 msgr2=0x7f0c240c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 --2- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c241555d0 0x7f0c240c78e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097c0 tx=0x7f0c2001c480 comp rx=0 tx=0).stop 2023-11-28T16:58:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 -- 172.21.15.26:0/84206060 shutdown_connections 2023-11-28T16:58:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 --2- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c24158010 0x7f0c241584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 --2- 172.21.15.26:0/84206060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c241555d0 0x7f0c240c78e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 -- 172.21.15.26:0/84206060 >> 172.21.15.26:0/84206060 conn(0x7f0c240c4960 msgr2=0x7f0c240c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 -- 172.21.15.26:0/84206060 shutdown_connections 2023-11-28T16:58:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.261+0000 7f0c2b901640 1 -- 172.21.15.26:0/84206060 wait complete. 2023-11-28T16:58:07.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 Processor -- start 2023-11-28T16:58:07.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 -- start start 2023-11-28T16:58:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c240a6e50 0x7f0c2415e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c241555d0 0x7f0c24149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c24158010 0x7f0c241495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240abf00 con 0x7f0c24158010 2023-11-28T16:58:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2406ffa0 con 0x7f0c240a6e50 2023-11-28T16:58:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240ab920 con 0x7f0c241555d0 2023-11-28T16:58:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c24158010 0x7f0c241495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c24158010 0x7f0c241495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37536/0 (socket says 172.21.15.26:37536) 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 -- 172.21.15.26:0/3309317570 learned_addr learned my addr 172.21.15.26:0/3309317570 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2969d640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c240a6e50 0x7f0c2415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c28e9c640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c241555d0 0x7f0c24149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 -- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c241555d0 msgr2=0x7f0c24149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c241555d0 0x7f0c24149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 -- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c240a6e50 msgr2=0x7f0c2415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c240a6e50 0x7f0c2415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 -- 172.21.15.26:0/3309317570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c009a70 con 0x7f0c24158010 2023-11-28T16:58:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2969d640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c240a6e50 0x7f0c2415e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:07.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c29e9e640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c24158010 0x7f0c241495c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00efc0 tx=0x7f0c1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:07.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c19ffb640 1 -- 172.21.15.26:0/3309317570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c009cd0 con 0x7f0c24158010 2023-11-28T16:58:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c19ffb640 1 -- 172.21.15.26:0/3309317570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00f040 con 0x7f0c24158010 2023-11-28T16:58:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c19ffb640 1 -- 172.21.15.26:0/3309317570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0039a0 con 0x7f0c24158010 2023-11-28T16:58:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c20009420 con 0x7f0c24158010 2023-11-28T16:58:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.265+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c241f0ce0 con 0x7f0c24158010 2023-11-28T16:58:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.269+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2404e890 con 0x7f0c24158010 2023-11-28T16:58:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.269+0000 7f0c19ffb640 1 -- 172.21.15.26:0/3309317570 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c1c014480 con 0x7f0c24158010 2023-11-28T16:58:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.269+0000 7f0c19ffb640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0c080668d0 0x7f0c08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.269+0000 7f0c19ffb640 1 -- 172.21.15.26:0/3309317570 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c1c0857f0 con 0x7f0c24158010 2023-11-28T16:58:07.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.269+0000 7f0c2969d640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0c080668d0 0x7f0c08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.273+0000 7f0c2969d640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0c080668d0 0x7f0c08068d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c200ad000 tx=0x7f0c200a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:07.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.273+0000 7f0c19ffb640 1 -- 172.21.15.26:0/3309317570 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c1c052aa0 con 0x7f0c24158010 2023-11-28T16:58:07.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.437+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0c2406d370 con 0x7f0c24158010 2023-11-28T16:58:07.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.437+0000 7f0c19ffb640 1 -- 172.21.15.26:0/3309317570 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+207 (secure 0 0 0) 0x7f0c1c0180e0 con 0x7f0c24158010 2023-11-28T16:58:07.442 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:07.442 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-11-28T16:58:07.442 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 8, 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "cephfs_metadata" 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 9, 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "cephfs_data" 2023-11-28T16:58:07.443 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:07.444 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-11-28T16:58:07.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0c080668d0 msgr2=0x7f0c08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0c080668d0 0x7f0c08068d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c200ad000 tx=0x7f0c200a6000 comp rx=0 tx=0).stop 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c24158010 msgr2=0x7f0c241495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c24158010 0x7f0c241495c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00efc0 tx=0x7f0c1c00c490 comp rx=0 tx=0).stop 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 shutdown_connections 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c24158010 0x7f0c241495c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0c080668d0 0x7f0c08068d90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c241555d0 0x7f0c24149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 --2- 172.21.15.26:0/3309317570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c240a6e50 0x7f0c2415e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 >> 172.21.15.26:0/3309317570 conn(0x7f0c240c4960 msgr2=0x7f0c24156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 shutdown_connections 2023-11-28T16:58:07.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.441+0000 7f0c2b901640 1 -- 172.21.15.26:0/3309317570 wait complete. 2023-11-28T16:58:07.463 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-28T16:58:07.464 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-28T16:58:07.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f7580d48640 1 Processor -- start 2023-11-28T16:58:07.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f7580d48640 1 -- start start 2023-11-28T16:58:07.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f7580d48640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f757c0c7f20 0x7f757c0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f7580d48640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f757c06bdd0 0x7f757c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f7580d48640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c152220 con 0x7f757c0c3d10 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f7580d48640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0c58f0 con 0x7f757c0c7f20 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f7580d48640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c155370 con 0x7f757c06bdd0 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f757c0c3d10 0x7f757c0c6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54028/0 (socket says 172.21.15.26:54028) 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f757c0c7f20 0x7f757c0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757b7fe640 1 -- 172.21.15.26:0/2697948746 learned_addr learned my addr 172.21.15.26:0/2697948746 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757bfff640 1 --2- 172.21.15.26:0/2697948746 >> v2:172.21.15.79:3300/0 conn(0x7f757c06bdd0 0x7f757c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757affd640 1 -- 172.21.15.26:0/2697948746 >> v2:172.21.15.79:3300/0 conn(0x7f757c06bdd0 msgr2=0x7f757c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:07.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757affd640 1 --2- 172.21.15.26:0/2697948746 >> v2:172.21.15.79:3300/0 conn(0x7f757c06bdd0 0x7f757c06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757affd640 1 -- 172.21.15.26:0/2697948746 >> v1:172.21.15.26:6789/0 conn(0x7f757c0c3d10 legacy=0x7f757c0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757affd640 1 -- 172.21.15.26:0/2697948746 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c155650 con 0x7f757c0c7f20 2023-11-28T16:58:07.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.609+0000 7f757a7fc640 1 -- 172.21.15.26:0/2697948746 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348523973 0 0) 0x7f757c152220 con 0x7f757c0c3d10 2023-11-28T16:58:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f757affd640 1 --2- 172.21.15.26:0/2697948746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c0c7220 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f757c0aff50 tx=0x7f757001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f45c23bbc914843 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:07.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f757a7fc640 1 -- 172.21.15.26:0/2697948746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700ac640 con 0x7f757c0c7f20 2023-11-28T16:58:07.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f757a7fc640 1 -- 172.21.15.26:0/2697948746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75700ac7a0 con 0x7f757c0c7f20 2023-11-28T16:58:07.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f757a7fc640 1 -- 172.21.15.26:0/2697948746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700acb30 con 0x7f757c0c7f20 2023-11-28T16:58:07.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 -- 172.21.15.26:0/2697948746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 msgr2=0x7f757c0c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 --2- 172.21.15.26:0/2697948746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c0c7220 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f757c0aff50 tx=0x7f757001c310 comp rx=0 tx=0).stop 2023-11-28T16:58:07.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 -- 172.21.15.26:0/2697948746 shutdown_connections 2023-11-28T16:58:07.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 --2- 172.21.15.26:0/2697948746 >> v2:172.21.15.79:3300/0 conn(0x7f757c06bdd0 0x7f757c06c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 --2- 172.21.15.26:0/2697948746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c0c7220 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 -- 172.21.15.26:0/2697948746 >> 172.21.15.26:0/2697948746 conn(0x7f757c0abb70 msgr2=0x7f757c0abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:07.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 -- 172.21.15.26:0/2697948746 shutdown_connections 2023-11-28T16:58:07.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.613+0000 7f7580d48640 1 -- 172.21.15.26:0/2697948746 wait complete. 2023-11-28T16:58:07.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 Processor -- start 2023-11-28T16:58:07.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 -- start start 2023-11-28T16:58:07.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c06bdd0 0x7f757c0ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c3d10 0x7f757c14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0aed40 con 0x7f757c0c7f20 2023-11-28T16:58:07.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0ad500 con 0x7f757c06bdd0 2023-11-28T16:58:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0af550 con 0x7f757c0c3d10 2023-11-28T16:58:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c14f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37552/0 (socket says 172.21.15.26:37552) 2023-11-28T16:58:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 -- 172.21.15.26:0/2620359333 learned_addr learned my addr 172.21.15.26:0/2620359333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757affd640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c3d10 0x7f757c14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757b7fe640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c06bdd0 0x7f757c0ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 -- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c3d10 msgr2=0x7f757c14ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c3d10 0x7f757c14ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 -- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c06bdd0 msgr2=0x7f757c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c06bdd0 0x7f757c0ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 -- 172.21.15.26:0/2620359333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009420 con 0x7f757c0c7f20 2023-11-28T16:58:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757b7fe640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c06bdd0 0x7f757c0ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757affd640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c3d10 0x7f757c14ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f757bfff640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c14f1c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7574007e40 tx=0x7f757400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7563fff640 1 -- 172.21.15.26:0/2620359333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574014620 con 0x7f757c0c7f20 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7563fff640 1 -- 172.21.15.26:0/2620359333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400ee90 con 0x7f757c0c7f20 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c151cb0 con 0x7f757c0c7f20 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7563fff640 1 -- 172.21.15.26:0/2620359333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740149e0 con 0x7f757c0c7f20 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.617+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c0af270 con 0x7f757c0c7f20 2023-11-28T16:58:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.621+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c0ad670 con 0x7f757c0c7f20 2023-11-28T16:58:07.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.621+0000 7f7563fff640 1 -- 172.21.15.26:0/2620359333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7574014b40 con 0x7f757c0c7f20 2023-11-28T16:58:07.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.621+0000 7f7563fff640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7568066900 0x7f7568068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:07.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.621+0000 7f7563fff640 1 -- 172.21.15.26:0/2620359333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7574084df0 con 0x7f757c0c7f20 2023-11-28T16:58:07.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.621+0000 7f757b7fe640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7568066900 0x7f7568068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.621+0000 7f757b7fe640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7568066900 0x7f7568068dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f756c000f70 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:07.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.625+0000 7f7563fff640 1 -- 172.21.15.26:0/2620359333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7574052020 con 0x7f757c0c7f20 2023-11-28T16:58:07.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:07.781+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f757c04e890 con 0x7f757c0c7f20 2023-11-28T16:58:08.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7563fff640 1 -- 172.21.15.26:0/2620359333 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v51) v1 ==== 140+0+0 (secure 0 0 0) 0x7f7574055640 con 0x7f757c0c7f20 2023-11-28T16:58:08.339 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_metadata' created 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7568066900 msgr2=0x7f7568068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7568066900 0x7f7568068dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f756c000f70 tx=0x7f756c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 msgr2=0x7f757c14f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c14f1c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7574007e40 tx=0x7f757400e4b0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 shutdown_connections 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f757c0c7f20 0x7f757c14f1c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7568066900 0x7f7568068dc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f757c0c3d10 0x7f757c14ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 --2- 172.21.15.26:0/2620359333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757c06bdd0 0x7f757c0ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.337+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 >> 172.21.15.26:0/2620359333 conn(0x7f757c0abb70 msgr2=0x7f757c154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.341+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 shutdown_connections 2023-11-28T16:58:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.341+0000 7f7580d48640 1 -- 172.21.15.26:0/2620359333 wait complete. 2023-11-28T16:58:08.370 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T16:58:08.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e7a85f640 1 Processor -- start 2023-11-28T16:58:08.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e7a85f640 1 -- start start 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e7a85f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e740a86d0 0x7f0e740a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e7a85f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e7414fd00 0x7f0e740aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e7a85f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e74152d90 con 0x7f0e74156600 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e7a85f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e74152480 con 0x7f0e740a86d0 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e7a85f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e740a9760 con 0x7f0e7414fd00 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e73fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e740a86d0 0x7f0e740a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e73fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e740a86d0 0x7f0e740a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37558/0 (socket says 172.21.15.26:37558) 2023-11-28T16:58:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e73fff640 1 -- 172.21.15.26:0/4027289052 learned_addr learned my addr 172.21.15.26:0/4027289052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e78dfc640 1 --2- 172.21.15.26:0/4027289052 >> v2:172.21.15.79:3300/0 conn(0x7f0e7414fd00 0x7f0e740aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e73fff640 1 -- 172.21.15.26:0/4027289052 >> v2:172.21.15.79:3300/0 conn(0x7f0e7414fd00 msgr2=0x7f0e740aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e73fff640 1 --2- 172.21.15.26:0/4027289052 >> v2:172.21.15.79:3300/0 conn(0x7f0e7414fd00 0x7f0e740aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e73fff640 1 -- 172.21.15.26:0/4027289052 >> v1:172.21.15.26:6789/0 conn(0x7f0e74156600 legacy=0x7f0e7414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e73fff640 1 -- 172.21.15.26:0/4027289052 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74152740 con 0x7f0e740a86d0 2023-11-28T16:58:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.521+0000 7f0e78dfc640 1 --2- 172.21.15.26:0/4027289052 >> v2:172.21.15.79:3300/0 conn(0x7f0e7414fd00 0x7f0e740aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e73fff640 1 --2- 172.21.15.26:0/4027289052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e740a86d0 0x7f0e740a8f30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009870 tx=0x7f0e6401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c05236dba9de631 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e72ffd640 1 -- 172.21.15.26:0/4027289052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e640ab5f0 con 0x7f0e740a86d0 2023-11-28T16:58:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e72ffd640 1 -- 172.21.15.26:0/4027289052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e640ab750 con 0x7f0e740a86d0 2023-11-28T16:58:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e72ffd640 1 -- 172.21.15.26:0/4027289052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e640abae0 con 0x7f0e740a86d0 2023-11-28T16:58:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4027289052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e740a86d0 msgr2=0x7f0e740a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4027289052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e740a86d0 0x7f0e740a8f30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009870 tx=0x7f0e6401c500 comp rx=0 tx=0).stop 2023-11-28T16:58:08.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4027289052 shutdown_connections 2023-11-28T16:58:08.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4027289052 >> v2:172.21.15.79:3300/0 conn(0x7f0e7414fd00 0x7f0e740aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4027289052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e740a86d0 0x7f0e740a8f30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4027289052 >> 172.21.15.26:0/4027289052 conn(0x7f0e740c2a60 msgr2=0x7f0e740c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:08.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4027289052 shutdown_connections 2023-11-28T16:58:08.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4027289052 wait complete. 2023-11-28T16:58:08.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.525+0000 7f0e7a85f640 1 Processor -- start 2023-11-28T16:58:08.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 -- start start 2023-11-28T16:58:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e740a86d0 0x7f0e741f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e7414fd00 0x7f0e74070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e74156600 0x7f0e7415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e741f0460 con 0x7f0e7414fd00 2023-11-28T16:58:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e741f09e0 con 0x7f0e74156600 2023-11-28T16:58:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e741f13b0 con 0x7f0e740a86d0 2023-11-28T16:58:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e7414fd00 0x7f0e74070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e7414fd00 0x7f0e74070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37566/0 (socket says 172.21.15.26:37566) 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 -- 172.21.15.26:0/4071655212 learned_addr learned my addr 172.21.15.26:0/4071655212 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e73fff640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e740a86d0 0x7f0e741f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e78dfc640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e74156600 0x7f0e7415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 -- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e740a86d0 msgr2=0x7f0e741f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e740a86d0 0x7f0e741f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 -- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e74156600 msgr2=0x7f0e7415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e74156600 0x7f0e7415b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 -- 172.21.15.26:0/4071655212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640094d0 con 0x7f0e7414fd00 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e78dfc640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e74156600 0x7f0e7415b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e737fe640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e7414fd00 0x7f0e74070970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800c4d0 tx=0x7f0e6800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e70ff9640 1 -- 172.21.15.26:0/4071655212 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e680052d0 con 0x7f0e7414fd00 2023-11-28T16:58:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e70ff9640 1 -- 172.21.15.26:0/4071655212 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e68005430 con 0x7f0e7414fd00 2023-11-28T16:58:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e70ff9640 1 -- 172.21.15.26:0/4071655212 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68012830 con 0x7f0e7414fd00 2023-11-28T16:58:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e741533a0 con 0x7f0e7414fd00 2023-11-28T16:58:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e74149970 con 0x7f0e7414fd00 2023-11-28T16:58:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.529+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7414a350 con 0x7f0e7414fd00 2023-11-28T16:58:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.533+0000 7f0e70ff9640 1 -- 172.21.15.26:0/4071655212 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0e68012990 con 0x7f0e7414fd00 2023-11-28T16:58:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.533+0000 7f0e70ff9640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e600668d0 0x7f0e60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.533+0000 7f0e70ff9640 1 -- 172.21.15.26:0/4071655212 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f0e68084150 con 0x7f0e7414fd00 2023-11-28T16:58:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.533+0000 7f0e73fff640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e600668d0 0x7f0e60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.533+0000 7f0e73fff640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e600668d0 0x7f0e60068d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e640af000 tx=0x7f0e640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.537+0000 7f0e70ff9640 1 -- 172.21.15.26:0/4071655212 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e680511a0 con 0x7f0e7414fd00 2023-11-28T16:58:08.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:08.697+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0e74153200 con 0x7f0e7414fd00 2023-11-28T16:58:09.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e70ff9640 1 -- 172.21.15.26:0/4071655212 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v52) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0e74153200 con 0x7f0e7414fd00 2023-11-28T16:58:09.343 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_data' created 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e600668d0 msgr2=0x7f0e60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e600668d0 0x7f0e60068d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e640af000 tx=0x7f0e640a7000 comp rx=0 tx=0).stop 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e7414fd00 msgr2=0x7f0e74070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e7414fd00 0x7f0e74070970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800c4d0 tx=0x7f0e6800c990 comp rx=0 tx=0).stop 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 shutdown_connections 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e74156600 0x7f0e7415b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e7414fd00 0x7f0e74070970 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e600668d0 0x7f0e60068d90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 --2- 172.21.15.26:0/4071655212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e740a86d0 0x7f0e741f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 >> 172.21.15.26:0/4071655212 conn(0x7f0e740c2a60 msgr2=0x7f0e740c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:09.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 shutdown_connections 2023-11-28T16:58:09.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.341+0000 7f0e7a85f640 1 -- 172.21.15.26:0/4071655212 wait complete. 2023-11-28T16:58:09.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-28T16:58:09.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4db0c79640 1 Processor -- start 2023-11-28T16:58:09.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4db0c79640 1 -- start start 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4db0c79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4dac06b810 0x7f4dac0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4db0c79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dac06f0d0 0x7f4dac0bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4db0c79640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac073710 con 0x7f4dac0c2a60 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4db0c79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac1589f0 con 0x7f4dac06f0d0 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4db0c79640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac1586e0 con 0x7f4dac06b810 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4da3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dac06f0d0 0x7f4dac0bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4da3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dac06f0d0 0x7f4dac0bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37578/0 (socket says 172.21.15.26:37578) 2023-11-28T16:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4da3fff640 1 -- 172.21.15.26:0/2946420905 learned_addr learned my addr 172.21.15.26:0/2946420905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:09.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4da3fff640 1 -- 172.21.15.26:0/2946420905 >> v2:172.21.15.79:3300/0 conn(0x7f4dac06b810 msgr2=0x7f4dac0c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:09.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4daa59c640 1 --2- 172.21.15.26:0/2946420905 >> v2:172.21.15.79:3300/0 conn(0x7f4dac06b810 0x7f4dac0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:09.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4da3fff640 1 --2- 172.21.15.26:0/2946420905 >> v2:172.21.15.79:3300/0 conn(0x7f4dac06b810 0x7f4dac0c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4da3fff640 1 -- 172.21.15.26:0/2946420905 >> v1:172.21.15.79:6789/0 conn(0x7f4dac0c2a60 legacy=0x7f4dac06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:09.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4da3fff640 1 -- 172.21.15.26:0/2946420905 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0c00b0 con 0x7f4dac06f0d0 2023-11-28T16:58:09.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.533+0000 7f4daa59c640 1 --2- 172.21.15.26:0/2946420905 >> v2:172.21.15.79:3300/0 conn(0x7f4dac06b810 0x7f4dac0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:09.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4da3fff640 1 --2- 172.21.15.26:0/2946420905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06f0d0 0x7f4dac0bfb70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0aca70 tx=0x7f4d9401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca7638c30578169 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:09.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4da9d9b640 1 -- 172.21.15.26:0/2946420905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940ac410 con 0x7f4dac06f0d0 2023-11-28T16:58:09.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4da9d9b640 1 -- 172.21.15.26:0/2946420905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d940ac570 con 0x7f4dac06f0d0 2023-11-28T16:58:09.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4da9d9b640 1 -- 172.21.15.26:0/2946420905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940ac900 con 0x7f4dac06f0d0 2023-11-28T16:58:09.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 -- 172.21.15.26:0/2946420905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06f0d0 msgr2=0x7f4dac0bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:09.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 --2- 172.21.15.26:0/2946420905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06f0d0 0x7f4dac0bfb70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0aca70 tx=0x7f4d9401c4c0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 -- 172.21.15.26:0/2946420905 shutdown_connections 2023-11-28T16:58:09.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 --2- 172.21.15.26:0/2946420905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06f0d0 0x7f4dac0bfb70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 --2- 172.21.15.26:0/2946420905 >> v2:172.21.15.79:3300/0 conn(0x7f4dac06b810 0x7f4dac0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 -- 172.21.15.26:0/2946420905 >> 172.21.15.26:0/2946420905 conn(0x7f4dac0c3240 msgr2=0x7f4dac0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:09.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 -- 172.21.15.26:0/2946420905 shutdown_connections 2023-11-28T16:58:09.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.537+0000 7f4db0c79640 1 -- 172.21.15.26:0/2946420905 wait complete. 2023-11-28T16:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 Processor -- start 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 -- start start 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06b810 0x7f4dac147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dac06f0d0 0x7f4dac14be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4dac0c2a60 0x7f4dac149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0a9d50 con 0x7f4dac06b810 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac14c3d0 con 0x7f4dac06f0d0 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac14a780 con 0x7f4dac0c2a60 2023-11-28T16:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06b810 0x7f4dac147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06b810 0x7f4dac147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37594/0 (socket says 172.21.15.26:37594) 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 -- 172.21.15.26:0/455291846 learned_addr learned my addr 172.21.15.26:0/455291846 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daad9d640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4dac0c2a60 0x7f4dac149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4da3fff640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dac06f0d0 0x7f4dac14be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 -- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4dac0c2a60 msgr2=0x7f4dac149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4dac0c2a60 0x7f4dac149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 -- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dac06f0d0 msgr2=0x7f4dac14be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dac06f0d0 0x7f4dac14be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 -- 172.21.15.26:0/455291846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d940094d0 con 0x7f4dac06b810 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daad9d640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4dac0c2a60 0x7f4dac149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:09.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4daa59c640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06b810 0x7f4dac147c20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c7f0 tx=0x7f4d9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4da2ffd640 1 -- 172.21.15.26:0/455291846 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00cea0 con 0x7f4dac06b810 2023-11-28T16:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4da2ffd640 1 -- 172.21.15.26:0/455291846 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c007a30 con 0x7f4dac06b810 2023-11-28T16:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4da2ffd640 1 -- 172.21.15.26:0/455291846 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c007de0 con 0x7f4dac06b810 2023-11-28T16:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac1f02d0 con 0x7f4dac06b810 2023-11-28T16:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.541+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac14a4a0 con 0x7f4dac06b810 2023-11-28T16:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.545+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac04e890 con 0x7f4dac06b810 2023-11-28T16:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.545+0000 7f4da2ffd640 1 -- 172.21.15.26:0/455291846 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4d9c023480 con 0x7f4dac06b810 2023-11-28T16:58:09.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.545+0000 7f4da2ffd640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d8c0668d0 0x7f4d8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:09.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.545+0000 7f4da2ffd640 1 -- 172.21.15.26:0/455291846 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4d9c084c30 con 0x7f4dac06b810 2023-11-28T16:58:09.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.545+0000 7f4da3fff640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d8c0668d0 0x7f4d8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:09.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.549+0000 7f4da3fff640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d8c0668d0 0x7f4d8c068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4d940ae000 tx=0x7f4d940a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:09.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.549+0000 7f4da2ffd640 1 -- 172.21.15.26:0/455291846 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d9c051ca0 con 0x7f4dac06b810 2023-11-28T16:58:09.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:09.745+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f4dac0734f0 con 0x7f4dac06b810 2023-11-28T16:58:10.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4da2ffd640 1 -- 172.21.15.26:0/455291846 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v33) v1 ==== 177+0+0 (secure 0 0 0) 0x7f4d9c0552c0 con 0x7f4dac06b810 2023-11-28T16:58:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 10 and data pool 11 2023-11-28T16:58:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d8c0668d0 msgr2=0x7f4d8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d8c0668d0 0x7f4d8c068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4d940ae000 tx=0x7f4d940a6040 comp rx=0 tx=0).stop 2023-11-28T16:58:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06b810 msgr2=0x7f4dac147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06b810 0x7f4dac147c20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c7f0 tx=0x7f4d9c00ccb0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 shutdown_connections 2023-11-28T16:58:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d8c0668d0 0x7f4d8c068d90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4dac0c2a60 0x7f4dac149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dac06f0d0 0x7f4dac14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 --2- 172.21.15.26:0/455291846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac06b810 0x7f4dac147c20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.353+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 >> 172.21.15.26:0/455291846 conn(0x7f4dac0c3240 msgr2=0x7f4dac070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:10.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.357+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 shutdown_connections 2023-11-28T16:58:10.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.357+0000 7f4db0c79640 1 -- 172.21.15.26:0/455291846 wait complete. 2023-11-28T16:58:10.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6885a640 1 Processor -- start 2023-11-28T16:58:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6885a640 1 -- start start 2023-11-28T16:58:10.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6885a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee64155360 0x7fee6406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6885a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee6406baf0 0x7fee6406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6885a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6406e280 con 0x7fee6406ed00 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6885a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640c2150 con 0x7fee64155360 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6885a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee64157c60 con 0x7fee6406baf0 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee64155360 0x7fee6406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee64155360 0x7fee6406b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37610/0 (socket says 172.21.15.26:37610) 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6259c640 1 -- 172.21.15.26:0/339500036 learned_addr learned my addr 172.21.15.26:0/339500036 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee61d9b640 1 --2- 172.21.15.26:0/339500036 >> v2:172.21.15.79:3300/0 conn(0x7fee6406baf0 0x7fee6406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6259c640 1 -- 172.21.15.26:0/339500036 >> v2:172.21.15.79:3300/0 conn(0x7fee6406baf0 msgr2=0x7fee6406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6259c640 1 --2- 172.21.15.26:0/339500036 >> v2:172.21.15.79:3300/0 conn(0x7fee6406baf0 0x7fee6406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6259c640 1 -- 172.21.15.26:0/339500036 >> v1:172.21.15.79:6789/0 conn(0x7fee6406ed00 legacy=0x7fee641580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.553+0000 7fee6259c640 1 -- 172.21.15.26:0/339500036 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640c1bd0 con 0x7fee64155360 2023-11-28T16:58:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6259c640 1 --2- 172.21.15.26:0/339500036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64155360 0x7fee6406b5b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fee640c0d80 tx=0x7fee5401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f579536f8ac7faa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6159a640 1 -- 172.21.15.26:0/339500036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab600 con 0x7fee64155360 2023-11-28T16:58:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6159a640 1 -- 172.21.15.26:0/339500036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540a7050 con 0x7fee64155360 2023-11-28T16:58:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6159a640 1 -- 172.21.15.26:0/339500036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab980 con 0x7fee64155360 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 -- 172.21.15.26:0/339500036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64155360 msgr2=0x7fee6406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 --2- 172.21.15.26:0/339500036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64155360 0x7fee6406b5b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fee640c0d80 tx=0x7fee5401c500 comp rx=0 tx=0).stop 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 -- 172.21.15.26:0/339500036 shutdown_connections 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 --2- 172.21.15.26:0/339500036 >> v2:172.21.15.79:3300/0 conn(0x7fee6406baf0 0x7fee6406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 --2- 172.21.15.26:0/339500036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee64155360 0x7fee6406b5b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 -- 172.21.15.26:0/339500036 >> 172.21.15.26:0/339500036 conn(0x7fee640c3240 msgr2=0x7fee640c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 -- 172.21.15.26:0/339500036 shutdown_connections 2023-11-28T16:58:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.557+0000 7fee6885a640 1 -- 172.21.15.26:0/339500036 wait complete. 2023-11-28T16:58:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 Processor -- start 2023-11-28T16:58:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 -- start start 2023-11-28T16:58:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6406baf0 0x7fee64070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee6406ed00 0x7fee640715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee64155360 0x7fee6414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640a7a10 con 0x7fee6406ed00 2023-11-28T16:58:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640a6a50 con 0x7fee6406baf0 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee640a5d80 con 0x7fee64155360 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee6406ed00 0x7fee640715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee6406ed00 0x7fee640715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37612/0 (socket says 172.21.15.26:37612) 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 -- 172.21.15.26:0/3383993428 learned_addr learned my addr 172.21.15.26:0/3383993428 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee62d9d640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee64155360 0x7fee6414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6259c640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6406baf0 0x7fee64070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 -- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee64155360 msgr2=0x7fee6414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee64155360 0x7fee6414daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 -- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6406baf0 msgr2=0x7fee64070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6406baf0 0x7fee64070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 -- 172.21.15.26:0/3383993428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540094d0 con 0x7fee6406ed00 2023-11-28T16:58:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee61d9b640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee6406ed00 0x7fee640715f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fee5800e930 tx=0x7fee5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee52ffd640 1 -- 172.21.15.26:0/3383993428 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58009690 con 0x7fee6406ed00 2023-11-28T16:58:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee52ffd640 1 -- 172.21.15.26:0/3383993428 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5800ca00 con 0x7fee6406ed00 2023-11-28T16:58:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640a6cf0 con 0x7fee6406ed00 2023-11-28T16:58:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee52ffd640 1 -- 172.21.15.26:0/3383993428 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5800cd70 con 0x7fee6406ed00 2023-11-28T16:58:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640a64b0 con 0x7fee6406ed00 2023-11-28T16:58:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.561+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee640a7bc0 con 0x7fee6406ed00 2023-11-28T16:58:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.565+0000 7fee52ffd640 1 -- 172.21.15.26:0/3383993428 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fee58013470 con 0x7fee6406ed00 2023-11-28T16:58:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.565+0000 7fee52ffd640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee440668d0 0x7fee44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.565+0000 7fee52ffd640 1 -- 172.21.15.26:0/3383993428 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fee580849c0 con 0x7fee6406ed00 2023-11-28T16:58:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.565+0000 7fee6259c640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee440668d0 0x7fee44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.565+0000 7fee6259c640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee440668d0 0x7fee44068d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee540ad000 tx=0x7fee540a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:10.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.569+0000 7fee52ffd640 1 -- 172.21.15.26:0/3383993428 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee58051970 con 0x7fee6406ed00 2023-11-28T16:58:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.729+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee6404e890 con 0x7fee6406ed00 2023-11-28T16:58:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.729+0000 7fee52ffd640 1 -- 172.21.15.26:0/3383993428 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20221 (secure 0 0 0) 0x7fee58054f90 con 0x7fee6406ed00 2023-11-28T16:58:10.734 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:10.735 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":53,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:09.747245+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee440668d0 msgr2=0x7fee44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee440668d0 0x7fee44068d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee540ad000 tx=0x7fee540a4f90 comp rx=0 tx=0).stop 2023-11-28T16:58:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee6406ed00 msgr2=0x7fee640715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee6406ed00 0x7fee640715f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fee5800e930 tx=0x7fee5800edf0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 shutdown_connections 2023-11-28T16:58:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee440668d0 0x7fee44068d90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee64155360 0x7fee6414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee6406ed00 0x7fee640715f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 --2- 172.21.15.26:0/3383993428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6406baf0 0x7fee64070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 >> 172.21.15.26:0/3383993428 conn(0x7fee640c3240 msgr2=0x7fee641580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 shutdown_connections 2023-11-28T16:58:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.733+0000 7fee6885a640 1 -- 172.21.15.26:0/3383993428 wait complete. 2023-11-28T16:58:10.756 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e5dcbb640 1 Processor -- start 2023-11-28T16:58:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e5dcbb640 1 -- start start 2023-11-28T16:58:10.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e5dcbb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e5806cd90 0x7f4e58160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e5dcbb640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e58155790 con 0x7f4e580ca610 2023-11-28T16:58:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e5dcbb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580c4b00 con 0x7f4e580bd720 2023-11-28T16:58:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e5dcbb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580c4de0 con 0x7f4e5806cd90 2023-11-28T16:58:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e577fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4e580ca610 0x7f4e580c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54038/0 (socket says 172.21.15.26:54038) 2023-11-28T16:58:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e577fe640 1 -- 172.21.15.26:0/3681190009 learned_addr learned my addr 172.21.15.26:0/3681190009 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e57fff640 1 --2- 172.21.15.26:0/3681190009 >> v2:172.21.15.79:3300/0 conn(0x7f4e5806cd90 0x7f4e58160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e567fc640 1 -- 172.21.15.26:0/3681190009 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988333384 0 0) 0x7f4e58155790 con 0x7f4e580ca610 2023-11-28T16:58:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e567fc640 1 -- 172.21.15.26:0/3681190009 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e40003530 con 0x7f4e580ca610 2023-11-28T16:58:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e57fff640 1 -- 172.21.15.26:0/3681190009 >> v1:172.21.15.79:6789/0 conn(0x7f4e580bd720 legacy=0x7f4e58158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e57fff640 1 -- 172.21.15.26:0/3681190009 >> v1:172.21.15.26:6789/0 conn(0x7f4e580ca610 legacy=0x7f4e580c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.897+0000 7f4e57fff640 1 -- 172.21.15.26:0/3681190009 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58157e30 con 0x7f4e5806cd90 2023-11-28T16:58:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e57fff640 1 --2- 172.21.15.26:0/3681190009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 0x7f4e58160130 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e5001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d2d7511320f80a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e567fc640 1 -- 172.21.15.26:0/3681190009 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580c52d0 con 0x7f4e5806cd90 2023-11-28T16:58:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e567fc640 1 -- 172.21.15.26:0/3681190009 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500a4e60 con 0x7f4e5806cd90 2023-11-28T16:58:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e567fc640 1 -- 172.21.15.26:0/3681190009 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500ac660 con 0x7f4e5806cd90 2023-11-28T16:58:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/3681190009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 msgr2=0x7f4e58160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/3681190009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 0x7f4e58160130 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e5001c510 comp rx=0 tx=0).stop 2023-11-28T16:58:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/3681190009 shutdown_connections 2023-11-28T16:58:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/3681190009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 0x7f4e58160130 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/3681190009 >> 172.21.15.26:0/3681190009 conn(0x7f4e58071ea0 msgr2=0x7f4e580722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/3681190009 shutdown_connections 2023-11-28T16:58:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.901+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/3681190009 wait complete. 2023-11-28T16:58:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 Processor -- start 2023-11-28T16:58:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 -- start start 2023-11-28T16:58:10.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 0x7f4e580c2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e580bd720 0x7f4e580ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e580ca610 0x7f4e580ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581ee180 con 0x7f4e580ca610 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580ab300 con 0x7f4e5806cd90 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580c2ad0 con 0x7f4e580bd720 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e580ca610 0x7f4e580ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e580ca610 0x7f4e580ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37628/0 (socket says 172.21.15.26:37628) 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 -- 172.21.15.26:0/1025428675 learned_addr learned my addr 172.21.15.26:0/1025428675 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e577fe640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 0x7f4e580c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e56ffd640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e580bd720 0x7f4e580ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 -- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e580bd720 msgr2=0x7f4e580ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e580bd720 0x7f4e580ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 -- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 msgr2=0x7f4e580c2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:10.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 0x7f4e580c2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:10.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 -- 172.21.15.26:0/1025428675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50009a70 con 0x7f4e580ca610 2023-11-28T16:58:10.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e57fff640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e580ca610 0x7f4e580ab4d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4e500af040 tx=0x7f4e500195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:10.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e3ffff640 1 -- 172.21.15.26:0/1025428675 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50009450 con 0x7f4e580ca610 2023-11-28T16:58:10.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e3ffff640 1 -- 172.21.15.26:0/1025428675 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500a4c60 con 0x7f4e580ca610 2023-11-28T16:58:10.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e3ffff640 1 -- 172.21.15.26:0/1025428675 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500acdb0 con 0x7f4e580ca610 2023-11-28T16:58:10.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e58072570 con 0x7f4e580ca610 2023-11-28T16:58:10.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.905+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e581ee390 con 0x7f4e580ca610 2023-11-28T16:58:10.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.909+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5804e890 con 0x7f4e580ca610 2023-11-28T16:58:10.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.909+0000 7f4e3ffff640 1 -- 172.21.15.26:0/1025428675 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e500b3040 con 0x7f4e580ca610 2023-11-28T16:58:10.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.909+0000 7f4e3ffff640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e44066900 0x7f4e44068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:10.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.909+0000 7f4e3ffff640 1 -- 172.21.15.26:0/1025428675 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e580cac00 con 0x7f4e580ca610 2023-11-28T16:58:10.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.909+0000 7f4e577fe640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e44066900 0x7f4e44068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:10.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.913+0000 7f4e577fe640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e44066900 0x7f4e44068dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e480011f0 tx=0x7f4e48007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:10.913+0000 7f4e3ffff640 1 -- 172.21.15.26:0/1025428675 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e500eaab0 con 0x7f4e580ca610 2023-11-28T16:58:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.069+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e5806cb70 con 0x7f4e580ca610 2023-11-28T16:58:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e3ffff640 1 -- 172.21.15.26:0/1025428675 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20221 (secure 0 0 0) 0x7f4e500ee0d0 con 0x7f4e580ca610 2023-11-28T16:58:11.075 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:11.075 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":53,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:09.747245+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e44066900 msgr2=0x7f4e44068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e44066900 0x7f4e44068dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e480011f0 tx=0x7f4e48007d40 comp rx=0 tx=0).stop 2023-11-28T16:58:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e580ca610 msgr2=0x7f4e580ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e580ca610 0x7f4e580ab4d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4e500af040 tx=0x7f4e500195d0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 shutdown_connections 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e580ca610 0x7f4e580ab4d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e44066900 0x7f4e44068dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e580bd720 0x7f4e580ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 --2- 172.21.15.26:0/1025428675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e5806cd90 0x7f4e580c2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 >> 172.21.15.26:0/1025428675 conn(0x7f4e58071ea0 msgr2=0x7f4e580c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 shutdown_connections 2023-11-28T16:58:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.073+0000 7f4e5dcbb640 1 -- 172.21.15.26:0/1025428675 wait complete. 2023-11-28T16:58:11.097 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-28T16:58:11.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075f4e3640 1 Processor -- start 2023-11-28T16:58:11.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075f4e3640 1 -- start start 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075f4e3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07580a86d0 0x7f07580a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075f4e3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f075814fd00 0x7f07580aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075f4e3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0758152d90 con 0x7f0758156600 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075f4e3640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0758152480 con 0x7f07580a86d0 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075f4e3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580a9760 con 0x7f075814fd00 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075d27f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07580a86d0 0x7f07580a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075ca7e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0758156600 0x7f075814f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54054/0 (socket says 172.21.15.26:54054) 2023-11-28T16:58:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075ca7e640 1 -- 172.21.15.26:0/1690943037 learned_addr learned my addr 172.21.15.26:0/1690943037 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:11.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075da80640 1 --2- 172.21.15.26:0/1690943037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f075814fd00 0x7f07580aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:11.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075d27f640 1 -- 172.21.15.26:0/1690943037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f075814fd00 msgr2=0x7f07580aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:11.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075d27f640 1 --2- 172.21.15.26:0/1690943037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f075814fd00 0x7f07580aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075d27f640 1 -- 172.21.15.26:0/1690943037 >> v1:172.21.15.26:6789/0 conn(0x7f0758156600 legacy=0x7f075814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:11.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.241+0000 7f075d27f640 1 -- 172.21.15.26:0/1690943037 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758152740 con 0x7f07580a86d0 2023-11-28T16:58:11.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075d27f640 1 --2- 172.21.15.26:0/1690943037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580a86d0 0x7f07580a8f30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f07540097f0 tx=0x7f075401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a34c622b4a59c10 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f074ffff640 1 -- 172.21.15.26:0/1690943037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540ab600 con 0x7f07580a86d0 2023-11-28T16:58:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f074ffff640 1 -- 172.21.15.26:0/1690943037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540a7050 con 0x7f07580a86d0 2023-11-28T16:58:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f074ffff640 1 -- 172.21.15.26:0/1690943037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540ab980 con 0x7f07580a86d0 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 -- 172.21.15.26:0/1690943037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580a86d0 msgr2=0x7f07580a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 --2- 172.21.15.26:0/1690943037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580a86d0 0x7f07580a8f30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f07540097f0 tx=0x7f075401c480 comp rx=0 tx=0).stop 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 -- 172.21.15.26:0/1690943037 shutdown_connections 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 --2- 172.21.15.26:0/1690943037 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f075814fd00 0x7f07580aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 --2- 172.21.15.26:0/1690943037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580a86d0 0x7f07580a8f30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 -- 172.21.15.26:0/1690943037 >> 172.21.15.26:0/1690943037 conn(0x7f07580c2a60 msgr2=0x7f07580c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 -- 172.21.15.26:0/1690943037 shutdown_connections 2023-11-28T16:58:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.245+0000 7f075f4e3640 1 -- 172.21.15.26:0/1690943037 wait complete. 2023-11-28T16:58:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 Processor -- start 2023-11-28T16:58:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 -- start start 2023-11-28T16:58:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07580a86d0 0x7f07581eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075814fd00 0x7f07581537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0758156600 0x7f075815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075814ce20 con 0x7f0758156600 2023-11-28T16:58:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07581ed5e0 con 0x7f075814fd00 2023-11-28T16:58:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07581557c0 con 0x7f07580a86d0 2023-11-28T16:58:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0758156600 0x7f075815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0758156600 0x7f075815b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37650/0 (socket says 172.21.15.26:37650) 2023-11-28T16:58:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 -- 172.21.15.26:0/2092023698 learned_addr learned my addr 172.21.15.26:0/2092023698 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075ca7e640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075814fd00 0x7f07581537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075d27f640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07580a86d0 0x7f07581eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 -- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07580a86d0 msgr2=0x7f07581eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07580a86d0 0x7f07581eda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 -- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075814fd00 msgr2=0x7f07581537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075814fd00 0x7f07581537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 -- 172.21.15.26:0/2092023698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754009420 con 0x7f0758156600 2023-11-28T16:58:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075ca7e640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075814fd00 0x7f07581537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075d27f640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07580a86d0 0x7f07581eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075da80640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0758156600 0x7f075815b360 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0750007de0 tx=0x7f075000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f074dffb640 1 -- 172.21.15.26:0/2092023698 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750014620 con 0x7f0758156600 2023-11-28T16:58:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f074dffb640 1 -- 172.21.15.26:0/2092023698 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000ee90 con 0x7f0758156600 2023-11-28T16:58:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f074dffb640 1 -- 172.21.15.26:0/2092023698 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500149e0 con 0x7f0758156600 2023-11-28T16:58:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07581533a0 con 0x7f0758156600 2023-11-28T16:58:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.249+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07581ecf90 con 0x7f0758156600 2023-11-28T16:58:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.253+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758153200 con 0x7f0758156600 2023-11-28T16:58:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.253+0000 7f074dffb640 1 -- 172.21.15.26:0/2092023698 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0750014b40 con 0x7f0758156600 2023-11-28T16:58:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.253+0000 7f074dffb640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f073c066900 0x7f073c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.253+0000 7f074dffb640 1 -- 172.21.15.26:0/2092023698 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f07500850e0 con 0x7f0758156600 2023-11-28T16:58:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.253+0000 7f075d27f640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f073c066900 0x7f073c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.253+0000 7f075d27f640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f073c066900 0x7f073c068dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f07540ad000 tx=0x7f0754008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.257+0000 7f074dffb640 1 -- 172.21.15.26:0/2092023698 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0758153200 con 0x7f0758156600 2023-11-28T16:58:11.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:11.457+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0758153200 con 0x7f0758156600 2023-11-28T16:58:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.385+0000 7f074dffb640 1 -- 172.21.15.26:0/2092023698 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 119+0+0 (secure 0 0 0) 0x7f0758153200 con 0x7f0758156600 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f073c066900 msgr2=0x7f073c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f073c066900 0x7f073c068dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f07540ad000 tx=0x7f0754008040 comp rx=0 tx=0).stop 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0758156600 msgr2=0x7f075815b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0758156600 0x7f075815b360 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0750007de0 tx=0x7f075000e4b0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 shutdown_connections 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0758156600 0x7f075815b360 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075814fd00 0x7f07581537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f073c066900 0x7f073c068dc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 --2- 172.21.15.26:0/2092023698 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07580a86d0 0x7f07581eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 >> 172.21.15.26:0/2092023698 conn(0x7f07580c2a60 msgr2=0x7f0758151280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 shutdown_connections 2023-11-28T16:58:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.389+0000 7f075f4e3640 1 -- 172.21.15.26:0/2092023698 wait complete. 2023-11-28T16:58:12.414 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T16:58:12.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-28T16:58:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.561+0000 7f69385f8640 1 Processor -- start 2023-11-28T16:58:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.561+0000 7f69385f8640 1 -- start start 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f69385f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f693006b5b0 0x7f693006b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f69385f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69300a5e70 0x7f69300c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f69385f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69300c5290 con 0x7f69300c09d0 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f69385f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6930151880 con 0x7f69300a5e70 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f69385f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69300c2f80 con 0x7f693006b5b0 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69300a5e70 0x7f69300c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69300a5e70 0x7f69300c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37028/0 (socket says 172.21.15.26:37028) 2023-11-28T16:58:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 -- 172.21.15.26:0/1885791756 learned_addr learned my addr 172.21.15.26:0/1885791756 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936394640 1 --2- 172.21.15.26:0/1885791756 >> v2:172.21.15.79:3300/0 conn(0x7f693006b5b0 0x7f693006b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 -- 172.21.15.26:0/1885791756 >> v2:172.21.15.79:3300/0 conn(0x7f693006b5b0 msgr2=0x7f693006b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 --2- 172.21.15.26:0/1885791756 >> v2:172.21.15.79:3300/0 conn(0x7f693006b5b0 0x7f693006b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 -- 172.21.15.26:0/1885791756 >> v1:172.21.15.26:6789/0 conn(0x7f69300c09d0 legacy=0x7f69300c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 -- 172.21.15.26:0/1885791756 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6930150ee0 con 0x7f69300a5e70 2023-11-28T16:58:12.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6936b95640 1 --2- 172.21.15.26:0/1885791756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300a5e70 0x7f69300c4d50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f69300aca40 tx=0x7f692801eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957510689b3e9c8e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:12.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6935392640 1 -- 172.21.15.26:0/1885791756 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692800b2d0 con 0x7f69300a5e70 2023-11-28T16:58:12.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6935392640 1 -- 172.21.15.26:0/1885791756 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692800b430 con 0x7f69300a5e70 2023-11-28T16:58:12.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.565+0000 7f6935392640 1 -- 172.21.15.26:0/1885791756 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69280a7b20 con 0x7f69300a5e70 2023-11-28T16:58:12.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- 172.21.15.26:0/1885791756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300a5e70 msgr2=0x7f69300c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:12.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 --2- 172.21.15.26:0/1885791756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300a5e70 0x7f69300c4d50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f69300aca40 tx=0x7f692801eab0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- 172.21.15.26:0/1885791756 shutdown_connections 2023-11-28T16:58:12.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 --2- 172.21.15.26:0/1885791756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300a5e70 0x7f69300c4d50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 --2- 172.21.15.26:0/1885791756 >> v2:172.21.15.79:3300/0 conn(0x7f693006b5b0 0x7f693006b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- 172.21.15.26:0/1885791756 >> 172.21.15.26:0/1885791756 conn(0x7f69300c3240 msgr2=0x7f69300c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:12.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- 172.21.15.26:0/1885791756 shutdown_connections 2023-11-28T16:58:12.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- 172.21.15.26:0/1885791756 wait complete. 2023-11-28T16:58:12.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 Processor -- start 2023-11-28T16:58:12.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- start start 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693006b5b0 0x7f69300ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69300a5e70 0x7f693015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300c09d0 0x7f69301ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930154320 con 0x7f69300c09d0 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930152e00 con 0x7f693006b5b0 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f69385f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6930153e90 con 0x7f69300a5e70 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f6936b95640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300c09d0 0x7f69301ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f6936394640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693006b5b0 0x7f69300ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:12.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f6936394640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693006b5b0 0x7f69300ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:58330/0 (socket says 172.21.15.26:58330) 2023-11-28T16:58:12.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f6935b93640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69300a5e70 0x7f693015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:12.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f6936b95640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300c09d0 0x7f69301ec4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37032/0 (socket says 172.21.15.26:37032) 2023-11-28T16:58:12.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.569+0000 7f6936394640 1 -- 172.21.15.26:0/2257086178 learned_addr learned my addr 172.21.15.26:0/2257086178 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:12.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6936b95640 1 -- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69300a5e70 msgr2=0x7f693015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:12.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6936b95640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69300a5e70 0x7f693015a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6936b95640 1 -- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693006b5b0 msgr2=0x7f69300ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:12.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6936b95640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693006b5b0 0x7f69300ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:12.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6936b95640 1 -- 172.21.15.26:0/2257086178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692800bd40 con 0x7f69300c09d0 2023-11-28T16:58:12.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6936394640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693006b5b0 0x7f69300ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6936b95640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300c09d0 0x7f69301ec4a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69280ad000 tx=0x7f692801b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6926ffd640 1 -- 172.21.15.26:0/2257086178 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928009600 con 0x7f69300c09d0 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6926ffd640 1 -- 172.21.15.26:0/2257086178 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6928009760 con 0x7f69300c09d0 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69300a9a80 con 0x7f69300c09d0 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6926ffd640 1 -- 172.21.15.26:0/2257086178 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928009b10 con 0x7f69300c09d0 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6930153840 con 0x7f69300c09d0 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693004e890 con 0x7f69300c09d0 2023-11-28T16:58:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.573+0000 7f6926ffd640 1 -- 172.21.15.26:0/2257086178 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6928009c70 con 0x7f69300c09d0 2023-11-28T16:58:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.577+0000 7f6926ffd640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6914066900 0x7f6914068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.577+0000 7f6926ffd640 1 -- 172.21.15.26:0/2257086178 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6928121840 con 0x7f69300c09d0 2023-11-28T16:58:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.577+0000 7f6936394640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6914066900 0x7f6914068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:12.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.577+0000 7f6936394640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6914066900 0x7f6914068dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f692c007e60 tx=0x7f692c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:12.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.581+0000 7f6926ffd640 1 -- 172.21.15.26:0/2257086178 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69280ee730 con 0x7f69300c09d0 2023-11-28T16:58:12.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:12.769+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6930153fd0 con 0x7f69300c09d0 2023-11-28T16:58:13.248 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-11-28T16:58:13.245+0000 7f4ef69ec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:58:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f6926ffd640 1 -- 172.21.15.26:0/2257086178 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 123+0+0 (secure 0 0 0) 0x7f69280f1d50 con 0x7f69300c09d0 2023-11-28T16:58:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6914066900 msgr2=0x7f6914068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6914066900 0x7f6914068dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f692c007e60 tx=0x7f692c008040 comp rx=0 tx=0).stop 2023-11-28T16:58:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300c09d0 msgr2=0x7f69301ec4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300c09d0 0x7f69301ec4a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69280ad000 tx=0x7f692801b850 comp rx=0 tx=0).stop 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 shutdown_connections 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69300c09d0 0x7f69301ec4a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6914066900 0x7f6914068dc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69300a5e70 0x7f693015a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 --2- 172.21.15.26:0/2257086178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693006b5b0 0x7f69300ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 >> 172.21.15.26:0/2257086178 conn(0x7f69300c3240 msgr2=0x7f69300a79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 shutdown_connections 2023-11-28T16:58:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.389+0000 7f69385f8640 1 -- 172.21.15.26:0/2257086178 wait complete. 2023-11-28T16:58:13.415 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-28T16:58:13.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:13.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.557+0000 7f53e8c5a640 1 Processor -- start 2023-11-28T16:58:13.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.557+0000 7f53e8c5a640 1 -- start start 2023-11-28T16:58:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e8c5a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e8c5a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53e41580b0 0x7f53e4158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e8c5a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e406e280 con 0x7f53e4155360 2023-11-28T16:58:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e8c5a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40c2150 con 0x7f53e41580b0 2023-11-28T16:58:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e8c5a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4157c60 con 0x7f53e406e7c0 2023-11-28T16:58:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53e41580b0 0x7f53e4158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53dbfff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e259c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f53e4155360 0x7f53e406b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39544/0 (socket says 172.21.15.26:39544) 2023-11-28T16:58:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e259c640 1 -- 172.21.15.26:0/2695796673 learned_addr learned my addr 172.21.15.26:0/2695796673 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e1d9b640 1 -- 172.21.15.26:0/2695796673 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799029591 0 0) 0x7f53e406e280 con 0x7f53e4155360 2023-11-28T16:58:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e1d9b640 1 -- 172.21.15.26:0/2695796673 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d0003530 con 0x7f53e4155360 2023-11-28T16:58:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e2d9d640 1 -- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 msgr2=0x7f53e406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e2d9d640 1 --2- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e406ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e2d9d640 1 -- 172.21.15.26:0/2695796673 >> v1:172.21.15.79:6789/0 conn(0x7f53e4155360 legacy=0x7f53e406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53e2d9d640 1 -- 172.21.15.26:0/2695796673 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e40c1bd0 con 0x7f53e41580b0 2023-11-28T16:58:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.561+0000 7f53dbfff640 1 --2- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e406ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e2d9d640 1 --2- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e41580b0 0x7f53e4158540 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009d90 tx=0x7f53dc01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fef5d4477ed522 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e1d9b640 1 -- 172.21.15.26:0/2695796673 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0a5920 con 0x7f53e41580b0 2023-11-28T16:58:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e1d9b640 1 -- 172.21.15.26:0/2695796673 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc0a5a80 con 0x7f53e41580b0 2023-11-28T16:58:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e1d9b640 1 -- 172.21.15.26:0/2695796673 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0a5e10 con 0x7f53e41580b0 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 -- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e41580b0 msgr2=0x7f53e4158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e41580b0 0x7f53e4158540 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009d90 tx=0x7f53dc01c950 comp rx=0 tx=0).stop 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 -- 172.21.15.26:0/2695796673 shutdown_connections 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e41580b0 0x7f53e4158540 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/2695796673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e406ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 -- 172.21.15.26:0/2695796673 >> 172.21.15.26:0/2695796673 conn(0x7f53e40c3240 msgr2=0x7f53e40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 -- 172.21.15.26:0/2695796673 shutdown_connections 2023-11-28T16:58:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 -- 172.21.15.26:0/2695796673 wait complete. 2023-11-28T16:58:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 Processor -- start 2023-11-28T16:58:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.565+0000 7f53e8c5a640 1 -- start start 2023-11-28T16:58:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e41ede60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e4155360 0x7f53e40a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e41580b0 0x7f53e4072530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40ab6b0 con 0x7f53e41580b0 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4150570 con 0x7f53e4155360 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40720a0 con 0x7f53e406e7c0 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e41580b0 0x7f53e4072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e41580b0 0x7f53e4072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37046/0 (socket says 172.21.15.26:37046) 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 -- 172.21.15.26:0/3451435222 learned_addr learned my addr 172.21.15.26:0/3451435222 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e259c640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e41ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53dbfff640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e4155360 0x7f53e40a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 -- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 msgr2=0x7f53e41ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e41ede60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 -- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e4155360 msgr2=0x7f53e40a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e4155360 0x7f53e40a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 -- 172.21.15.26:0/3451435222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009420 con 0x7f53e41580b0 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e2d9d640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e41580b0 0x7f53e4072530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f53dc01b000 tx=0x7f53dc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53daffd640 1 -- 172.21.15.26:0/3451435222 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0a5920 con 0x7f53e41580b0 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53daffd640 1 -- 172.21.15.26:0/3451435222 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc009450 con 0x7f53e41580b0 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53daffd640 1 -- 172.21.15.26:0/3451435222 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0b7650 con 0x7f53e41580b0 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc009a70 con 0x7f53e41580b0 2023-11-28T16:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e4071a50 con 0x7f53e41580b0 2023-11-28T16:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.569+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e4072230 con 0x7f53e41580b0 2023-11-28T16:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.573+0000 7f53daffd640 1 -- 172.21.15.26:0/3451435222 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53dc0b4050 con 0x7f53e41580b0 2023-11-28T16:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.573+0000 7f53daffd640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53c40668d0 0x7f53c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.573+0000 7f53daffd640 1 -- 172.21.15.26:0/3451435222 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f53dc11fae0 con 0x7f53e41580b0 2023-11-28T16:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.573+0000 7f53e259c640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53c40668d0 0x7f53c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.573+0000 7f53e259c640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53c40668d0 0x7f53c4068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53d40011f0 tx=0x7f53d4007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.577+0000 7f53daffd640 1 -- 172.21.15.26:0/3451435222 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53dc0eca60 con 0x7f53e41580b0 2023-11-28T16:58:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.765+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53e404e890 con 0x7f53e41580b0 2023-11-28T16:58:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53daffd640 1 -- 172.21.15.26:0/3451435222 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7f53dc0c7090 con 0x7f53e41580b0 2023-11-28T16:58:13.770 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:13.770 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:56.668279+0000","modified":"2023-11-28T16:57:59.688325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3225309020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3225309020},{"type":"v1","addr":"172.21.15.26:6835","nonce":3225309020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 37 2023-11-28T16:58:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53c40668d0 msgr2=0x7f53c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53c40668d0 0x7f53c4068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53d40011f0 tx=0x7f53d4007d40 comp rx=0 tx=0).stop 2023-11-28T16:58:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e41580b0 msgr2=0x7f53e4072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e41580b0 0x7f53e4072530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f53dc01b000 tx=0x7f53dc0196f0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 shutdown_connections 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e41580b0 0x7f53e4072530 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e4155360 0x7f53e40a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53c40668d0 0x7f53c4068d90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 --2- 172.21.15.26:0/3451435222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e406e7c0 0x7f53e41ede60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 >> 172.21.15.26:0/3451435222 conn(0x7f53e40c3240 msgr2=0x7f53e406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 shutdown_connections 2023-11-28T16:58:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.769+0000 7f53e8c5a640 1 -- 172.21.15.26:0/3451435222 wait complete. 2023-11-28T16:58:13.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:13.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 Processor -- start 2023-11-28T16:58:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 -- start start 2023-11-28T16:58:13.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499006b100 0x7f499006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49900bd5e0 0x7f49900c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49900c91f0 0x7f4990157af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4990157930 con 0x7f49900c91f0 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4990151f20 con 0x7f49900bd5e0 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498f59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49901559f0 con 0x7f499006b100 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49900c91f0 0x7f4990157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49900c91f0 0x7f4990157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37052/0 (socket says 172.21.15.26:37052) 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 -- 172.21.15.26:0/22237801 learned_addr learned my addr 172.21.15.26:0/22237801 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498dd9b640 1 --2- 172.21.15.26:0/22237801 >> v2:172.21.15.79:3300/0 conn(0x7f49900bd5e0 0x7f49900c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498e59c640 1 --2- 172.21.15.26:0/22237801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499006b100 0x7f499006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 -- 172.21.15.26:0/22237801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499006b100 msgr2=0x7f499006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 --2- 172.21.15.26:0/22237801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499006b100 0x7f499006b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 -- 172.21.15.26:0/22237801 >> v2:172.21.15.79:3300/0 conn(0x7f49900bd5e0 msgr2=0x7f49900c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 --2- 172.21.15.26:0/22237801 >> v2:172.21.15.79:3300/0 conn(0x7f49900bd5e0 0x7f49900c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.933+0000 7f498ed9d640 1 -- 172.21.15.26:0/22237801 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900aff20 con 0x7f49900c91f0 2023-11-28T16:58:13.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498ed9d640 1 --2- 172.21.15.26:0/22237801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49900c91f0 0x7f4990157af0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49900c7ad0 tx=0x7f498801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17acfb7bdcb17fc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:13.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498d59a640 1 -- 172.21.15.26:0/22237801 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880a6490 con 0x7f49900c91f0 2023-11-28T16:58:13.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498d59a640 1 -- 172.21.15.26:0/22237801 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49880a65f0 con 0x7f49900c91f0 2023-11-28T16:58:13.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498d59a640 1 -- 172.21.15.26:0/22237801 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880a6980 con 0x7f49900c91f0 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 -- 172.21.15.26:0/22237801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49900c91f0 msgr2=0x7f4990157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 --2- 172.21.15.26:0/22237801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49900c91f0 0x7f4990157af0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49900c7ad0 tx=0x7f498801c710 comp rx=0 tx=0).stop 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 -- 172.21.15.26:0/22237801 shutdown_connections 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 --2- 172.21.15.26:0/22237801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49900c91f0 0x7f4990157af0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 --2- 172.21.15.26:0/22237801 >> v2:172.21.15.79:3300/0 conn(0x7f49900bd5e0 0x7f49900c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 --2- 172.21.15.26:0/22237801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499006b100 0x7f499006b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 -- 172.21.15.26:0/22237801 >> 172.21.15.26:0/22237801 conn(0x7f49900ca550 msgr2=0x7f49900abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 -- 172.21.15.26:0/22237801 shutdown_connections 2023-11-28T16:58:13.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.937+0000 7f498f59e640 1 -- 172.21.15.26:0/22237801 wait complete. 2023-11-28T16:58:13.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 Processor -- start 2023-11-28T16:58:13.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 -- start start 2023-11-28T16:58:13.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f499006b100 0x7f49901f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900bd5e0 0x7f49900ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49900c91f0 0x7f49900ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900ad460 con 0x7f499006b100 2023-11-28T16:58:13.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900c47d0 con 0x7f49900bd5e0 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900c4ab0 con 0x7f49900c91f0 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f499006b100 0x7f49901f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f499006b100 0x7f49901f0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37056/0 (socket says 172.21.15.26:37056) 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 -- 172.21.15.26:0/597651987 learned_addr learned my addr 172.21.15.26:0/597651987 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498dd9b640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900bd5e0 0x7f49900ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498ed9d640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49900c91f0 0x7f49900ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 -- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49900c91f0 msgr2=0x7f49900ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49900c91f0 0x7f49900ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 -- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900bd5e0 msgr2=0x7f49900ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900bd5e0 0x7f49900ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 -- 172.21.15.26:0/597651987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988009b30 con 0x7f499006b100 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498dd9b640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900bd5e0 0x7f49900ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:13.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498e59c640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f499006b100 0x7f49901f0550 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f498000d800 tx=0x7f498000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:13.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f497effd640 1 -- 172.21.15.26:0/597651987 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800096a0 con 0x7f499006b100 2023-11-28T16:58:13.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f497effd640 1 -- 172.21.15.26:0/597651987 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980009800 con 0x7f499006b100 2023-11-28T16:58:13.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f497effd640 1 -- 172.21.15.26:0/597651987 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980009990 con 0x7f499006b100 2023-11-28T16:58:13.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49901f0fe0 con 0x7f499006b100 2023-11-28T16:58:13.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49900c22f0 con 0x7f499006b100 2023-11-28T16:58:13.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.941+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49901f1200 con 0x7f499006b100 2023-11-28T16:58:13.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.945+0000 7f497effd640 1 -- 172.21.15.26:0/597651987 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4980009af0 con 0x7f499006b100 2023-11-28T16:58:13.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.945+0000 7f497effd640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49700668d0 0x7f4970068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:13.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.945+0000 7f497effd640 1 -- 172.21.15.26:0/597651987 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4980084c40 con 0x7f499006b100 2023-11-28T16:58:13.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.945+0000 7f498dd9b640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49700668d0 0x7f4970068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:13.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.945+0000 7f498dd9b640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49700668d0 0x7f4970068d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f49900ae910 tx=0x7f4984008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:13.949+0000 7f497effd640 1 -- 172.21.15.26:0/597651987 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4980051a80 con 0x7f499006b100 2023-11-28T16:58:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.105+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49900ad250 con 0x7f499006b100 2023-11-28T16:58:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f497effd640 1 -- 172.21.15.26:0/597651987 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20208 (secure 0 0 0) 0x7f498000b3a0 con 0x7f499006b100 2023-11-28T16:58:14.111 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:14.111 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:11.370310+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49700668d0 msgr2=0x7f4970068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49700668d0 0x7f4970068d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f49900ae910 tx=0x7f4984008040 comp rx=0 tx=0).stop 2023-11-28T16:58:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f499006b100 msgr2=0x7f49901f0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f499006b100 0x7f49901f0550 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f498000d800 tx=0x7f498000dcc0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 shutdown_connections 2023-11-28T16:58:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f49700668d0 0x7f4970068d90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49900c91f0 0x7f49900ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900bd5e0 0x7f49900ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 --2- 172.21.15.26:0/597651987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f499006b100 0x7f49901f0550 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 >> 172.21.15.26:0/597651987 conn(0x7f49900ca550 msgr2=0x7f4990066480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 shutdown_connections 2023-11-28T16:58:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.109+0000 7f498f59e640 1 -- 172.21.15.26:0/597651987 wait complete. 2023-11-28T16:58:14.132 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T16:58:14.133 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:58:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 Processor -- start 2023-11-28T16:58:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 -- start start 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd0c0ca610 0x7fbd0c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd0c06cd90 0x7fbd0c158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c155790 con 0x7fbd0c06cd90 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c4b00 con 0x7fbd0c0ca610 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd1093e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c4de0 con 0x7fbd0c0bd720 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd0c06cd90 0x7fbd0c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd0c06cd90 0x7fbd0c158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37068/0 (socket says 172.21.15.26:37068) 2023-11-28T16:58:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 -- 172.21.15.26:0/2493347203 learned_addr learned my addr 172.21.15.26:0/2493347203 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd03fff640 1 --2- 172.21.15.26:0/2493347203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0a59c640 1 --2- 172.21.15.26:0/2493347203 >> v2:172.21.15.79:3300/0 conn(0x7fbd0c0ca610 0x7fbd0c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 -- 172.21.15.26:0/2493347203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 msgr2=0x7fbd0c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 --2- 172.21.15.26:0/2493347203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 -- 172.21.15.26:0/2493347203 >> v2:172.21.15.79:3300/0 conn(0x7fbd0c0ca610 msgr2=0x7fbd0c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 --2- 172.21.15.26:0/2493347203 >> v2:172.21.15.79:3300/0 conn(0x7fbd0c0ca610 0x7fbd0c0c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.273+0000 7fbd0ad9d640 1 -- 172.21.15.26:0/2493347203 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c157e30 con 0x7fbd0c06cd90 2023-11-28T16:58:14.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd0ad9d640 1 --2- 172.21.15.26:0/2493347203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c158350 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0acc80 tx=0x7fbd0401c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cee87caec71879a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:14.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd09d9b640 1 -- 172.21.15.26:0/2493347203 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0c52d0 con 0x7fbd0c06cd90 2023-11-28T16:58:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd09d9b640 1 -- 172.21.15.26:0/2493347203 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd040a4c60 con 0x7fbd0c06cd90 2023-11-28T16:58:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd09d9b640 1 -- 172.21.15.26:0/2493347203 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040ac3f0 con 0x7fbd0c06cd90 2023-11-28T16:58:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 -- 172.21.15.26:0/2493347203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 msgr2=0x7fbd0c158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2493347203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c158350 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0acc80 tx=0x7fbd0401c590 comp rx=0 tx=0).stop 2023-11-28T16:58:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 -- 172.21.15.26:0/2493347203 shutdown_connections 2023-11-28T16:58:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2493347203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c158350 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2493347203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2493347203 >> v2:172.21.15.79:3300/0 conn(0x7fbd0c0ca610 0x7fbd0c0c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 -- 172.21.15.26:0/2493347203 >> 172.21.15.26:0/2493347203 conn(0x7fbd0c071ea0 msgr2=0x7fbd0c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 -- 172.21.15.26:0/2493347203 shutdown_connections 2023-11-28T16:58:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.277+0000 7fbd1093e640 1 -- 172.21.15.26:0/2493347203 wait complete. 2023-11-28T16:58:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 Processor -- start 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 -- start start 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c0c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd0c0ca610 0x7fbd0c14d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0bddc0 con 0x7fbd0c06cd90 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c4250 con 0x7fbd0c0ca610 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0bed00 con 0x7fbd0c0bd720 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c0c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c0c1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37070/0 (socket says 172.21.15.26:37070) 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 -- 172.21.15.26:0/2958508041 learned_addr learned my addr 172.21.15.26:0/2958508041 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd03fff640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0ad9d640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd0c0ca610 0x7fbd0c14d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 -- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 msgr2=0x7fbd0c14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 -- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd0c0ca610 msgr2=0x7fbd0c14d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd0c0ca610 0x7fbd0c14d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 -- 172.21.15.26:0/2958508041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd04009b30 con 0x7fbd0c06cd90 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd0a59c640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c0c1430 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00d650 tx=0x7fbcfc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd02ffd640 1 -- 172.21.15.26:0/2958508041 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00b6c0 con 0x7fbd0c06cd90 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd02ffd640 1 -- 172.21.15.26:0/2958508041 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc00b820 con 0x7fbd0c06cd90 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c14d8c0 con 0x7fbd0c06cd90 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd02ffd640 1 -- 172.21.15.26:0/2958508041 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00bbb0 con 0x7fbd0c06cd90 2023-11-28T16:58:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.281+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c150a00 con 0x7fbd0c06cd90 2023-11-28T16:58:14.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.285+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c04e890 con 0x7fbd0c06cd90 2023-11-28T16:58:14.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.285+0000 7fbd02ffd640 1 -- 172.21.15.26:0/2958508041 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbcfc00bd10 con 0x7fbd0c06cd90 2023-11-28T16:58:14.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.285+0000 7fbd02ffd640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbcec0668d0 0x7fbcec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.285+0000 7fbd02ffd640 1 -- 172.21.15.26:0/2958508041 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbcfc084b60 con 0x7fbd0c06cd90 2023-11-28T16:58:14.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.285+0000 7fbd03fff640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbcec0668d0 0x7fbcec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.285+0000 7fbd03fff640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbcec0668d0 0x7fbcec068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0c1d70 tx=0x7fbcf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:14.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.289+0000 7fbd02ffd640 1 -- 172.21.15.26:0/2958508041 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcfc051ae0 con 0x7fbd0c06cd90 2023-11-28T16:58:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.449+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd0c0c67b0 con 0x7fbcec0668d0 2023-11-28T16:58:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.461+0000 7fbd02ffd640 1 -- 172.21.15.26:0/2958508041 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522207 (secure 0 0 0) 0x7fbd0c0c67b0 con 0x7fbcec0668d0 2023-11-28T16:58:14.471 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:58:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbcec0668d0 msgr2=0x7fbcec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbcec0668d0 0x7fbcec068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0c1d70 tx=0x7fbcf4008040 comp rx=0 tx=0).stop 2023-11-28T16:58:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 msgr2=0x7fbd0c0c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c0c1430 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00d650 tx=0x7fbcfc00db10 comp rx=0 tx=0).stop 2023-11-28T16:58:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 shutdown_connections 2023-11-28T16:58:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd0c0ca610 0x7fbd0c14d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbcec0668d0 0x7fbcec068d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd0c0bd720 0x7fbd0c14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 --2- 172.21.15.26:0/2958508041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c06cd90 0x7fbd0c0c1430 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 >> 172.21.15.26:0/2958508041 conn(0x7fbd0c071ea0 msgr2=0x7fbd0c072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 shutdown_connections 2023-11-28T16:58:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.469+0000 7fbd1093e640 1 -- 172.21.15.26:0/2958508041 wait complete. 2023-11-28T16:58:14.492 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-28T16:58:13.601461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238820,"kb_used_data":6016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735900,"statfs":{"total":773094113280,"available":772849561600,"internally_reserved":0,"allocated":6160384,"data_stored":3270838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.260570"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356934+0000","last_change":"2023-11-28T16:58:09.356934+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356934+0000","last_undegraded":"2023-11-28T16:58:09.356934+0000","last_fullsized":"2023-11-28T16:58:09.356934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341292+0000","last_change":"2023-11-28T16:57:57.311201+0000","last_active":"2023-11-28T16:58:08.341292+0000","last_peered":"2023-11-28T16:58:08.341292+0000","last_clean":"2023-11-28T16:58:08.341292+0000","last_became_active":"2023-11-28T16:57:57.310858+0000","last_became_peered":"2023-11-28T16:57:57.310858+0000","last_unstale":"2023-11-28T16:58:08.341292+0000","last_undegraded":"2023-11-28T16:58:08.341292+0000","last_fullsized":"2023-11-28T16:58:08.341292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:38.198969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352892+0000","last_change":"2023-11-28T16:58:09.352892+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352892+0000","last_undegraded":"2023-11-28T16:58:09.352892+0000","last_fullsized":"2023-11-28T16:58:09.352892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348156+0000","last_change":"2023-11-28T16:57:57.307903+0000","last_active":"2023-11-28T16:58:08.348156+0000","last_peered":"2023-11-28T16:58:08.348156+0000","last_clean":"2023-11-28T16:58:08.348156+0000","last_became_active":"2023-11-28T16:57:57.305651+0000","last_became_peered":"2023-11-28T16:57:57.305651+0000","last_unstale":"2023-11-28T16:58:08.348156+0000","last_undegraded":"2023-11-28T16:58:08.348156+0000","last_fullsized":"2023-11-28T16:58:08.348156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:58.350824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355797+0000","last_change":"2023-11-28T16:58:09.355797+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355797+0000","last_undegraded":"2023-11-28T16:58:09.355797+0000","last_fullsized":"2023-11-28T16:58:09.355797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349667+0000","last_change":"2023-11-28T16:57:57.295922+0000","last_active":"2023-11-28T16:58:08.349667+0000","last_peered":"2023-11-28T16:58:08.349667+0000","last_clean":"2023-11-28T16:58:08.349667+0000","last_became_active":"2023-11-28T16:57:57.295614+0000","last_became_peered":"2023-11-28T16:57:57.295614+0000","last_unstale":"2023-11-28T16:58:08.349667+0000","last_undegraded":"2023-11-28T16:58:08.349667+0000","last_fullsized":"2023-11-28T16:58:08.349667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.365573+0000","last_change":"2023-11-28T16:58:09.365573+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.365573+0000","last_undegraded":"2023-11-28T16:58:09.365573+0000","last_fullsized":"2023-11-28T16:58:09.365573+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352081+0000","last_change":"2023-11-28T16:57:57.307103+0000","last_active":"2023-11-28T16:58:08.352081+0000","last_peered":"2023-11-28T16:58:08.352081+0000","last_clean":"2023-11-28T16:58:08.352081+0000","last_became_active":"2023-11-28T16:57:57.306791+0000","last_became_peered":"2023-11-28T16:57:57.306791+0000","last_unstale":"2023-11-28T16:58:08.352081+0000","last_undegraded":"2023-11-28T16:58:08.352081+0000","last_fullsized":"2023-11-28T16:58:08.352081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354028+0000","last_change":"2023-11-28T16:58:09.354028+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354028+0000","last_undegraded":"2023-11-28T16:58:09.354028+0000","last_fullsized":"2023-11-28T16:58:09.354028+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341241+0000","last_change":"2023-11-28T16:57:57.294572+0000","last_active":"2023-11-28T16:58:08.341241+0000","last_peered":"2023-11-28T16:58:08.341241+0000","last_clean":"2023-11-28T16:58:08.341241+0000","last_became_active":"2023-11-28T16:57:57.294253+0000","last_became_peered":"2023-11-28T16:57:57.294253+0000","last_unstale":"2023-11-28T16:58:08.341241+0000","last_undegraded":"2023-11-28T16:58:08.341241+0000","last_fullsized":"2023-11-28T16:58:08.341241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:08.044829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362280+0000","last_change":"2023-11-28T16:58:09.362280+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362280+0000","last_undegraded":"2023-11-28T16:58:09.362280+0000","last_fullsized":"2023-11-28T16:58:09.362280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343666+0000","last_change":"2023-11-28T16:57:57.303700+0000","last_active":"2023-11-28T16:58:08.343666+0000","last_peered":"2023-11-28T16:58:08.343666+0000","last_clean":"2023-11-28T16:58:08.343666+0000","last_became_active":"2023-11-28T16:57:57.303377+0000","last_became_peered":"2023-11-28T16:57:57.303377+0000","last_unstale":"2023-11-28T16:58:08.343666+0000","last_undegraded":"2023-11-28T16:58:08.343666+0000","last_fullsized":"2023-11-28T16:58:08.343666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353798+0000","last_change":"2023-11-28T16:58:09.353798+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353798+0000","last_undegraded":"2023-11-28T16:58:09.353798+0000","last_fullsized":"2023-11-28T16:58:09.353798+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345302+0000","last_change":"2023-11-28T16:57:57.290167+0000","last_active":"2023-11-28T16:58:08.345302+0000","last_peered":"2023-11-28T16:58:08.345302+0000","last_clean":"2023-11-28T16:58:08.345302+0000","last_became_active":"2023-11-28T16:57:57.289873+0000","last_became_peered":"2023-11-28T16:57:57.289873+0000","last_unstale":"2023-11-28T16:58:08.345302+0000","last_undegraded":"2023-11-28T16:58:08.345302+0000","last_fullsized":"2023-11-28T16:58:08.345302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:53.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.364239+0000","last_change":"2023-11-28T16:58:09.364239+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.364239+0000","last_undegraded":"2023-11-28T16:58:09.364239+0000","last_fullsized":"2023-11-28T16:58:09.364239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347226+0000","last_change":"2023-11-28T16:57:57.294040+0000","last_active":"2023-11-28T16:58:08.347226+0000","last_peered":"2023-11-28T16:58:08.347226+0000","last_clean":"2023-11-28T16:58:08.347226+0000","last_became_active":"2023-11-28T16:57:57.293696+0000","last_became_peered":"2023-11-28T16:57:57.293696+0000","last_unstale":"2023-11-28T16:58:08.347226+0000","last_undegraded":"2023-11-28T16:58:08.347226+0000","last_fullsized":"2023-11-28T16:58:08.347226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:45.988064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354554+0000","last_change":"2023-11-28T16:58:09.354554+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354554+0000","last_undegraded":"2023-11-28T16:58:09.354554+0000","last_fullsized":"2023-11-28T16:58:09.354554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345945+0000","last_change":"2023-11-28T16:57:57.291252+0000","last_active":"2023-11-28T16:58:08.345945+0000","last_peered":"2023-11-28T16:58:08.345945+0000","last_clean":"2023-11-28T16:58:08.345945+0000","last_became_active":"2023-11-28T16:57:57.290870+0000","last_became_peered":"2023-11-28T16:57:57.290870+0000","last_unstale":"2023-11-28T16:58:08.345945+0000","last_undegraded":"2023-11-28T16:58:08.345945+0000","last_fullsized":"2023-11-28T16:58:08.345945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:24.268675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356219+0000","last_change":"2023-11-28T16:58:09.356219+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356219+0000","last_undegraded":"2023-11-28T16:58:09.356219+0000","last_fullsized":"2023-11-28T16:58:09.356219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351003+0000","last_change":"2023-11-28T16:57:57.293326+0000","last_active":"2023-11-28T16:58:08.351003+0000","last_peered":"2023-11-28T16:58:08.351003+0000","last_clean":"2023-11-28T16:58:08.351003+0000","last_became_active":"2023-11-28T16:57:57.292663+0000","last_became_peered":"2023-11-28T16:57:57.292663+0000","last_unstale":"2023-11-28T16:58:08.351003+0000","last_undegraded":"2023-11-28T16:58:08.351003+0000","last_fullsized":"2023-11-28T16:58:08.351003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:07.257033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359820+0000","last_change":"2023-11-28T16:58:09.359820+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359820+0000","last_undegraded":"2023-11-28T16:58:09.359820+0000","last_fullsized":"2023-11-28T16:58:09.359820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351512+0000","last_change":"2023-11-28T16:57:57.285037+0000","last_active":"2023-11-28T16:58:08.351512+0000","last_peered":"2023-11-28T16:58:08.351512+0000","last_clean":"2023-11-28T16:58:08.351512+0000","last_became_active":"2023-11-28T16:57:57.284722+0000","last_became_peered":"2023-11-28T16:57:57.284722+0000","last_unstale":"2023-11-28T16:58:08.351512+0000","last_undegraded":"2023-11-28T16:58:08.351512+0000","last_fullsized":"2023-11-28T16:58:08.351512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:29.116162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351087+0000","last_change":"2023-11-28T16:58:09.351087+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351087+0000","last_undegraded":"2023-11-28T16:58:09.351087+0000","last_fullsized":"2023-11-28T16:58:09.351087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352165+0000","last_change":"2023-11-28T16:57:57.303913+0000","last_active":"2023-11-28T16:58:08.352165+0000","last_peered":"2023-11-28T16:58:08.352165+0000","last_clean":"2023-11-28T16:58:08.352165+0000","last_became_active":"2023-11-28T16:57:57.303625+0000","last_became_peered":"2023-11-28T16:57:57.303625+0000","last_unstale":"2023-11-28T16:58:08.352165+0000","last_undegraded":"2023-11-28T16:58:08.352165+0000","last_fullsized":"2023-11-28T16:58:08.352165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.347055+0000","last_change":"2023-11-28T16:58:09.347055+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.347055+0000","last_undegraded":"2023-11-28T16:58:09.347055+0000","last_fullsized":"2023-11-28T16:58:09.347055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352767+0000","last_change":"2023-11-28T16:57:57.305618+0000","last_active":"2023-11-28T16:58:08.352767+0000","last_peered":"2023-11-28T16:58:08.352767+0000","last_clean":"2023-11-28T16:58:08.352767+0000","last_became_active":"2023-11-28T16:57:57.305369+0000","last_became_peered":"2023-11-28T16:57:57.305369+0000","last_unstale":"2023-11-28T16:58:08.352767+0000","last_undegraded":"2023-11-28T16:58:08.352767+0000","last_fullsized":"2023-11-28T16:58:08.352767+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:26.927795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349211+0000","last_change":"2023-11-28T16:58:09.349211+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349211+0000","last_undegraded":"2023-11-28T16:58:09.349211+0000","last_fullsized":"2023-11-28T16:58:09.349211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345514+0000","last_change":"2023-11-28T16:57:57.286182+0000","last_active":"2023-11-28T16:58:08.345514+0000","last_peered":"2023-11-28T16:58:08.345514+0000","last_clean":"2023-11-28T16:58:08.345514+0000","last_became_active":"2023-11-28T16:57:57.285885+0000","last_became_peered":"2023-11-28T16:57:57.285885+0000","last_unstale":"2023-11-28T16:58:08.345514+0000","last_undegraded":"2023-11-28T16:58:08.345514+0000","last_fullsized":"2023-11-28T16:58:08.345514+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:34.325761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346377+0000","last_change":"2023-11-28T16:58:09.346377+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346377+0000","last_undegraded":"2023-11-28T16:58:09.346377+0000","last_fullsized":"2023-11-28T16:58:09.346377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345416+0000","last_change":"2023-11-28T16:57:57.288466+0000","last_active":"2023-11-28T16:58:08.345416+0000","last_peered":"2023-11-28T16:58:08.345416+0000","last_clean":"2023-11-28T16:58:08.345416+0000","last_became_active":"2023-11-28T16:57:57.288071+0000","last_became_peered":"2023-11-28T16:57:57.288071+0000","last_unstale":"2023-11-28T16:58:08.345416+0000","last_undegraded":"2023-11-28T16:58:08.345416+0000","last_fullsized":"2023-11-28T16:58:08.345416+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:54.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362056+0000","last_change":"2023-11-28T16:58:09.362056+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362056+0000","last_undegraded":"2023-11-28T16:58:09.362056+0000","last_fullsized":"2023-11-28T16:58:09.362056+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343291+0000","last_change":"2023-11-28T16:57:57.298522+0000","last_active":"2023-11-28T16:58:08.343291+0000","last_peered":"2023-11-28T16:58:08.343291+0000","last_clean":"2023-11-28T16:58:08.343291+0000","last_became_active":"2023-11-28T16:57:57.298241+0000","last_became_peered":"2023-11-28T16:57:57.298241+0000","last_unstale":"2023-11-28T16:58:08.343291+0000","last_undegraded":"2023-11-28T16:58:08.343291+0000","last_fullsized":"2023-11-28T16:58:08.343291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.366415+0000","last_change":"2023-11-28T16:58:09.366415+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.366415+0000","last_undegraded":"2023-11-28T16:58:09.366415+0000","last_fullsized":"2023-11-28T16:58:09.366415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348552+0000","last_change":"2023-11-28T16:57:57.306762+0000","last_active":"2023-11-28T16:58:08.348552+0000","last_peered":"2023-11-28T16:58:08.348552+0000","last_clean":"2023-11-28T16:58:08.348552+0000","last_became_active":"2023-11-28T16:57:57.306428+0000","last_became_peered":"2023-11-28T16:57:57.306428+0000","last_unstale":"2023-11-28T16:58:08.348552+0000","last_undegraded":"2023-11-28T16:58:08.348552+0000","last_fullsized":"2023-11-28T16:58:08.348552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:34.023526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346855+0000","last_change":"2023-11-28T16:58:09.346855+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346855+0000","last_undegraded":"2023-11-28T16:58:09.346855+0000","last_fullsized":"2023-11-28T16:58:09.346855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350719+0000","last_change":"2023-11-28T16:57:57.301733+0000","last_active":"2023-11-28T16:58:08.350719+0000","last_peered":"2023-11-28T16:58:08.350719+0000","last_clean":"2023-11-28T16:58:08.350719+0000","last_became_active":"2023-11-28T16:57:57.301402+0000","last_became_peered":"2023-11-28T16:57:57.301402+0000","last_unstale":"2023-11-28T16:58:08.350719+0000","last_undegraded":"2023-11-28T16:58:08.350719+0000","last_fullsized":"2023-11-28T16:58:08.350719+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:35.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359147+0000","last_change":"2023-11-28T16:58:09.359147+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359147+0000","last_undegraded":"2023-11-28T16:58:09.359147+0000","last_fullsized":"2023-11-28T16:58:09.359147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341178+0000","last_change":"2023-11-28T16:57:57.299228+0000","last_active":"2023-11-28T16:58:08.341178+0000","last_peered":"2023-11-28T16:58:08.341178+0000","last_clean":"2023-11-28T16:58:08.341178+0000","last_became_active":"2023-11-28T16:57:57.298919+0000","last_became_peered":"2023-11-28T16:57:57.298919+0000","last_unstale":"2023-11-28T16:58:08.341178+0000","last_undegraded":"2023-11-28T16:58:08.341178+0000","last_fullsized":"2023-11-28T16:58:08.341178+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:09.019656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354562+0000","last_change":"2023-11-28T16:58:09.354562+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354562+0000","last_undegraded":"2023-11-28T16:58:09.354562+0000","last_fullsized":"2023-11-28T16:58:09.354562+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347776+0000","last_change":"2023-11-28T16:57:57.299427+0000","last_active":"2023-11-28T16:58:08.347776+0000","last_peered":"2023-11-28T16:58:08.347776+0000","last_clean":"2023-11-28T16:58:08.347776+0000","last_became_active":"2023-11-28T16:57:57.299152+0000","last_became_peered":"2023-11-28T16:57:57.299152+0000","last_unstale":"2023-11-28T16:58:08.347776+0000","last_undegraded":"2023-11-28T16:58:08.347776+0000","last_fullsized":"2023-11-28T16:58:08.347776+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:15.293843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355577+0000","last_change":"2023-11-28T16:58:09.355577+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355577+0000","last_undegraded":"2023-11-28T16:58:09.355577+0000","last_fullsized":"2023-11-28T16:58:09.355577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350284+0000","last_change":"2023-11-28T16:57:57.293718+0000","last_active":"2023-11-28T16:58:08.350284+0000","last_peered":"2023-11-28T16:58:08.350284+0000","last_clean":"2023-11-28T16:58:08.350284+0000","last_became_active":"2023-11-28T16:57:57.293317+0000","last_became_peered":"2023-11-28T16:57:57.293317+0000","last_unstale":"2023-11-28T16:58:08.350284+0000","last_undegraded":"2023-11-28T16:58:08.350284+0000","last_fullsized":"2023-11-28T16:58:08.350284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354170+0000","last_change":"2023-11-28T16:58:09.354170+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354170+0000","last_undegraded":"2023-11-28T16:58:09.354170+0000","last_fullsized":"2023-11-28T16:58:09.354170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347531+0000","last_change":"2023-11-28T16:57:57.307374+0000","last_active":"2023-11-28T16:58:08.347531+0000","last_peered":"2023-11-28T16:58:08.347531+0000","last_clean":"2023-11-28T16:58:08.347531+0000","last_became_active":"2023-11-28T16:57:57.305540+0000","last_became_peered":"2023-11-28T16:57:57.305540+0000","last_unstale":"2023-11-28T16:58:08.347531+0000","last_undegraded":"2023-11-28T16:58:08.347531+0000","last_fullsized":"2023-11-28T16:58:08.347531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:34.222003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349265+0000","last_change":"2023-11-28T16:58:09.349265+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349265+0000","last_undegraded":"2023-11-28T16:58:09.349265+0000","last_fullsized":"2023-11-28T16:58:09.349265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349325+0000","last_change":"2023-11-28T16:57:57.300922+0000","last_active":"2023-11-28T16:58:08.349325+0000","last_peered":"2023-11-28T16:58:08.349325+0000","last_clean":"2023-11-28T16:58:08.349325+0000","last_became_active":"2023-11-28T16:57:57.300127+0000","last_became_peered":"2023-11-28T16:57:57.300127+0000","last_unstale":"2023-11-28T16:58:08.349325+0000","last_undegraded":"2023-11-28T16:58:08.349325+0000","last_fullsized":"2023-11-28T16:58:08.349325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.348943+0000","last_change":"2023-11-28T16:58:09.348943+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.348943+0000","last_undegraded":"2023-11-28T16:58:09.348943+0000","last_fullsized":"2023-11-28T16:58:09.348943+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351833+0000","last_change":"2023-11-28T16:57:57.307862+0000","last_active":"2023-11-28T16:58:08.351833+0000","last_peered":"2023-11-28T16:58:08.351833+0000","last_clean":"2023-11-28T16:58:08.351833+0000","last_became_active":"2023-11-28T16:57:57.307540+0000","last_became_peered":"2023-11-28T16:57:57.307540+0000","last_unstale":"2023-11-28T16:58:08.351833+0000","last_undegraded":"2023-11-28T16:58:08.351833+0000","last_fullsized":"2023-11-28T16:58:08.351833+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:36.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356410+0000","last_change":"2023-11-28T16:58:09.356410+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356410+0000","last_undegraded":"2023-11-28T16:58:09.356410+0000","last_fullsized":"2023-11-28T16:58:09.356410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341372+0000","last_change":"2023-11-28T16:57:57.284808+0000","last_active":"2023-11-28T16:58:08.341372+0000","last_peered":"2023-11-28T16:58:08.341372+0000","last_clean":"2023-11-28T16:58:08.341372+0000","last_became_active":"2023-11-28T16:57:57.284304+0000","last_became_peered":"2023-11-28T16:57:57.284304+0000","last_unstale":"2023-11-28T16:58:08.341372+0000","last_undegraded":"2023-11-28T16:58:08.341372+0000","last_fullsized":"2023-11-28T16:58:08.341372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:56.940553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349986+0000","last_change":"2023-11-28T16:58:09.349986+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349986+0000","last_undegraded":"2023-11-28T16:58:09.349986+0000","last_fullsized":"2023-11-28T16:58:09.349986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354167+0000","last_change":"2023-11-28T16:57:57.291693+0000","last_active":"2023-11-28T16:58:08.354167+0000","last_peered":"2023-11-28T16:58:08.354167+0000","last_clean":"2023-11-28T16:58:08.354167+0000","last_became_active":"2023-11-28T16:57:57.291320+0000","last_became_peered":"2023-11-28T16:57:57.291320+0000","last_unstale":"2023-11-28T16:58:08.354167+0000","last_undegraded":"2023-11-28T16:58:08.354167+0000","last_fullsized":"2023-11-28T16:58:08.354167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:21.959226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349811+0000","last_change":"2023-11-28T16:58:09.349811+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349811+0000","last_undegraded":"2023-11-28T16:58:09.349811+0000","last_fullsized":"2023-11-28T16:58:09.349811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344446+0000","last_change":"2023-11-28T16:57:57.299843+0000","last_active":"2023-11-28T16:58:08.344446+0000","last_peered":"2023-11-28T16:58:08.344446+0000","last_clean":"2023-11-28T16:58:08.344446+0000","last_became_active":"2023-11-28T16:57:57.299266+0000","last_became_peered":"2023-11-28T16:57:57.299266+0000","last_unstale":"2023-11-28T16:58:08.344446+0000","last_undegraded":"2023-11-28T16:58:08.344446+0000","last_fullsized":"2023-11-28T16:58:08.344446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355951+0000","last_change":"2023-11-28T16:58:09.355951+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355951+0000","last_undegraded":"2023-11-28T16:58:09.355951+0000","last_fullsized":"2023-11-28T16:58:09.355951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341349+0000","last_change":"2023-11-28T16:57:57.294587+0000","last_active":"2023-11-28T16:58:08.341349+0000","last_peered":"2023-11-28T16:58:08.341349+0000","last_clean":"2023-11-28T16:58:08.341349+0000","last_became_active":"2023-11-28T16:57:57.294283+0000","last_became_peered":"2023-11-28T16:57:57.294283+0000","last_unstale":"2023-11-28T16:58:08.341349+0000","last_undegraded":"2023-11-28T16:58:08.341349+0000","last_fullsized":"2023-11-28T16:58:08.341349+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:35.632692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353445+0000","last_change":"2023-11-28T16:58:09.353445+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353445+0000","last_undegraded":"2023-11-28T16:58:09.353445+0000","last_fullsized":"2023-11-28T16:58:09.353445+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347771+0000","last_change":"2023-11-28T16:57:57.298034+0000","last_active":"2023-11-28T16:58:08.347771+0000","last_peered":"2023-11-28T16:58:08.347771+0000","last_clean":"2023-11-28T16:58:08.347771+0000","last_became_active":"2023-11-28T16:57:57.297743+0000","last_became_peered":"2023-11-28T16:57:57.297743+0000","last_unstale":"2023-11-28T16:58:08.347771+0000","last_undegraded":"2023-11-28T16:58:08.347771+0000","last_fullsized":"2023-11-28T16:58:08.347771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:26.295837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359339+0000","last_change":"2023-11-28T16:58:09.359339+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359339+0000","last_undegraded":"2023-11-28T16:58:09.359339+0000","last_fullsized":"2023-11-28T16:58:09.359339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349435+0000","last_change":"2023-11-28T16:57:57.296838+0000","last_active":"2023-11-28T16:58:08.349435+0000","last_peered":"2023-11-28T16:58:08.349435+0000","last_clean":"2023-11-28T16:58:08.349435+0000","last_became_active":"2023-11-28T16:57:57.295762+0000","last_became_peered":"2023-11-28T16:57:57.295762+0000","last_unstale":"2023-11-28T16:58:08.349435+0000","last_undegraded":"2023-11-28T16:58:08.349435+0000","last_fullsized":"2023-11-28T16:58:08.349435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.358941+0000","last_change":"2023-11-28T16:58:09.358941+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.358941+0000","last_undegraded":"2023-11-28T16:58:09.358941+0000","last_fullsized":"2023-11-28T16:58:09.358941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.340954+0000","last_change":"2023-11-28T16:57:57.291516+0000","last_active":"2023-11-28T16:58:08.340954+0000","last_peered":"2023-11-28T16:58:08.340954+0000","last_clean":"2023-11-28T16:58:08.340954+0000","last_became_active":"2023-11-28T16:57:57.291201+0000","last_became_peered":"2023-11-28T16:57:57.291201+0000","last_unstale":"2023-11-28T16:58:08.340954+0000","last_undegraded":"2023-11-28T16:58:08.340954+0000","last_fullsized":"2023-11-28T16:58:08.340954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:23.828578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353541+0000","last_change":"2023-11-28T16:58:09.353541+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353541+0000","last_undegraded":"2023-11-28T16:58:09.353541+0000","last_fullsized":"2023-11-28T16:58:09.353541+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343376+0000","last_change":"2023-11-28T16:57:57.308867+0000","last_active":"2023-11-28T16:58:08.343376+0000","last_peered":"2023-11-28T16:58:08.343376+0000","last_clean":"2023-11-28T16:58:08.343376+0000","last_became_active":"2023-11-28T16:57:57.307693+0000","last_became_peered":"2023-11-28T16:57:57.307693+0000","last_unstale":"2023-11-28T16:58:08.343376+0000","last_undegraded":"2023-11-28T16:58:08.343376+0000","last_fullsized":"2023-11-28T16:58:08.343376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:24.984986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362611+0000","last_change":"2023-11-28T16:58:09.362611+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362611+0000","last_undegraded":"2023-11-28T16:58:09.362611+0000","last_fullsized":"2023-11-28T16:58:09.362611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382146+0000","last_change":"2023-11-28T16:58:09.374084+0000","last_active":"2023-11-28T16:58:09.382146+0000","last_peered":"2023-11-28T16:58:09.382146+0000","last_clean":"2023-11-28T16:58:09.382146+0000","last_became_active":"2023-11-28T16:58:09.373766+0000","last_became_peered":"2023-11-28T16:58:09.373766+0000","last_unstale":"2023-11-28T16:58:09.382146+0000","last_undegraded":"2023-11-28T16:58:09.382146+0000","last_fullsized":"2023-11-28T16:58:09.382146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:55.123226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344211+0000","last_change":"2023-11-28T16:57:57.292539+0000","last_active":"2023-11-28T16:58:08.344211+0000","last_peered":"2023-11-28T16:58:08.344211+0000","last_clean":"2023-11-28T16:58:08.344211+0000","last_became_active":"2023-11-28T16:57:57.292189+0000","last_became_peered":"2023-11-28T16:57:57.292189+0000","last_unstale":"2023-11-28T16:58:08.344211+0000","last_undegraded":"2023-11-28T16:58:08.344211+0000","last_fullsized":"2023-11-28T16:58:08.344211+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344321+0000","last_change":"2023-11-28T16:57:56.296007+0000","last_active":"2023-11-28T16:58:08.344321+0000","last_peered":"2023-11-28T16:58:08.344321+0000","last_clean":"2023-11-28T16:58:08.344321+0000","last_became_active":"2023-11-28T16:57:56.295636+0000","last_became_peered":"2023-11-28T16:57:56.295636+0000","last_unstale":"2023-11-28T16:58:08.344321+0000","last_undegraded":"2023-11-28T16:58:08.344321+0000","last_fullsized":"2023-11-28T16:58:08.344321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:38.988857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353750+0000","last_change":"2023-11-28T16:58:09.353750+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353750+0000","last_undegraded":"2023-11-28T16:58:09.353750+0000","last_fullsized":"2023-11-28T16:58:09.353750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382148+0000","last_change":"2023-11-28T16:58:09.372867+0000","last_active":"2023-11-28T16:58:09.382148+0000","last_peered":"2023-11-28T16:58:09.382148+0000","last_clean":"2023-11-28T16:58:09.382148+0000","last_became_active":"2023-11-28T16:58:09.372597+0000","last_became_peered":"2023-11-28T16:58:09.372597+0000","last_unstale":"2023-11-28T16:58:09.382148+0000","last_undegraded":"2023-11-28T16:58:09.382148+0000","last_fullsized":"2023-11-28T16:58:09.382148+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:08.829912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351512+0000","last_change":"2023-11-28T16:57:57.281906+0000","last_active":"2023-11-28T16:58:08.351512+0000","last_peered":"2023-11-28T16:58:08.351512+0000","last_clean":"2023-11-28T16:58:08.351512+0000","last_became_active":"2023-11-28T16:57:57.281593+0000","last_became_peered":"2023-11-28T16:57:57.281593+0000","last_unstale":"2023-11-28T16:58:08.351512+0000","last_undegraded":"2023-11-28T16:58:08.351512+0000","last_fullsized":"2023-11-28T16:58:08.351512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348193+0000","last_change":"2023-11-28T16:57:56.301479+0000","last_active":"2023-11-28T16:58:08.348193+0000","last_peered":"2023-11-28T16:58:08.348193+0000","last_clean":"2023-11-28T16:58:08.348193+0000","last_became_active":"2023-11-28T16:57:56.301262+0000","last_became_peered":"2023-11-28T16:57:56.301262+0000","last_unstale":"2023-11-28T16:58:08.348193+0000","last_undegraded":"2023-11-28T16:58:08.348193+0000","last_fullsized":"2023-11-28T16:58:08.348193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:34.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353707+0000","last_change":"2023-11-28T16:58:09.353707+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353707+0000","last_undegraded":"2023-11-28T16:58:09.353707+0000","last_fullsized":"2023-11-28T16:58:09.353707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377040+0000","last_change":"2023-11-28T16:58:09.371624+0000","last_active":"2023-11-28T16:58:09.377040+0000","last_peered":"2023-11-28T16:58:09.377040+0000","last_clean":"2023-11-28T16:58:09.377040+0000","last_became_active":"2023-11-28T16:58:09.371252+0000","last_became_peered":"2023-11-28T16:58:09.371252+0000","last_unstale":"2023-11-28T16:58:09.377040+0000","last_undegraded":"2023-11-28T16:58:09.377040+0000","last_fullsized":"2023-11-28T16:58:09.377040+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:26.069648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344166+0000","last_change":"2023-11-28T16:57:57.296485+0000","last_active":"2023-11-28T16:58:08.344166+0000","last_peered":"2023-11-28T16:58:08.344166+0000","last_clean":"2023-11-28T16:58:08.344166+0000","last_became_active":"2023-11-28T16:57:57.296210+0000","last_became_peered":"2023-11-28T16:57:57.296210+0000","last_unstale":"2023-11-28T16:58:08.344166+0000","last_undegraded":"2023-11-28T16:58:08.344166+0000","last_fullsized":"2023-11-28T16:58:08.344166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344356+0000","last_change":"2023-11-28T16:57:56.284952+0000","last_active":"2023-11-28T16:58:08.344356+0000","last_peered":"2023-11-28T16:58:08.344356+0000","last_clean":"2023-11-28T16:58:08.344356+0000","last_became_active":"2023-11-28T16:57:56.284663+0000","last_became_peered":"2023-11-28T16:57:56.284663+0000","last_unstale":"2023-11-28T16:58:08.344356+0000","last_undegraded":"2023-11-28T16:58:08.344356+0000","last_fullsized":"2023-11-28T16:58:08.344356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354275+0000","last_change":"2023-11-28T16:58:09.354275+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354275+0000","last_undegraded":"2023-11-28T16:58:09.354275+0000","last_fullsized":"2023-11-28T16:58:09.354275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382241+0000","last_change":"2023-11-28T16:58:09.379004+0000","last_active":"2023-11-28T16:58:09.382241+0000","last_peered":"2023-11-28T16:58:09.382241+0000","last_clean":"2023-11-28T16:58:09.382241+0000","last_became_active":"2023-11-28T16:58:09.378364+0000","last_became_peered":"2023-11-28T16:58:09.378364+0000","last_unstale":"2023-11-28T16:58:09.382241+0000","last_undegraded":"2023-11-28T16:58:09.382241+0000","last_fullsized":"2023-11-28T16:58:09.382241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:46.294429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344175+0000","last_change":"2023-11-28T16:57:57.299545+0000","last_active":"2023-11-28T16:58:08.344175+0000","last_peered":"2023-11-28T16:58:08.344175+0000","last_clean":"2023-11-28T16:58:08.344175+0000","last_became_active":"2023-11-28T16:57:57.298953+0000","last_became_peered":"2023-11-28T16:57:57.298953+0000","last_unstale":"2023-11-28T16:58:08.344175+0000","last_undegraded":"2023-11-28T16:58:08.344175+0000","last_fullsized":"2023-11-28T16:58:08.344175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352218+0000","last_change":"2023-11-28T16:57:56.293038+0000","last_active":"2023-11-28T16:58:08.352218+0000","last_peered":"2023-11-28T16:58:08.352218+0000","last_clean":"2023-11-28T16:58:08.352218+0000","last_became_active":"2023-11-28T16:57:56.292443+0000","last_became_peered":"2023-11-28T16:57:56.292443+0000","last_unstale":"2023-11-28T16:58:08.352218+0000","last_undegraded":"2023-11-28T16:58:08.352218+0000","last_fullsized":"2023-11-28T16:58:08.352218+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354538+0000","last_change":"2023-11-28T16:58:09.354538+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354538+0000","last_undegraded":"2023-11-28T16:58:09.354538+0000","last_fullsized":"2023-11-28T16:58:09.354538+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.369520+0000","last_change":"2023-11-28T16:58:09.366910+0000","last_active":"2023-11-28T16:58:09.369520+0000","last_peered":"2023-11-28T16:58:09.369520+0000","last_clean":"2023-11-28T16:58:09.369520+0000","last_became_active":"2023-11-28T16:58:09.366580+0000","last_became_peered":"2023-11-28T16:58:09.366580+0000","last_unstale":"2023-11-28T16:58:09.369520+0000","last_undegraded":"2023-11-28T16:58:09.369520+0000","last_fullsized":"2023-11-28T16:58:09.369520+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:36.341102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347393+0000","last_change":"2023-11-28T16:57:57.307182+0000","last_active":"2023-11-28T16:58:08.347393+0000","last_peered":"2023-11-28T16:58:08.347393+0000","last_clean":"2023-11-28T16:58:08.347393+0000","last_became_active":"2023-11-28T16:57:57.305143+0000","last_became_peered":"2023-11-28T16:57:57.305143+0000","last_unstale":"2023-11-28T16:58:08.347393+0000","last_undegraded":"2023-11-28T16:58:08.347393+0000","last_fullsized":"2023-11-28T16:58:08.347393+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:16.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345811+0000","last_change":"2023-11-28T16:57:56.298135+0000","last_active":"2023-11-28T16:58:08.345811+0000","last_peered":"2023-11-28T16:58:08.345811+0000","last_clean":"2023-11-28T16:58:08.345811+0000","last_became_active":"2023-11-28T16:57:56.297267+0000","last_became_peered":"2023-11-28T16:57:56.297267+0000","last_unstale":"2023-11-28T16:58:08.345811+0000","last_undegraded":"2023-11-28T16:58:08.345811+0000","last_fullsized":"2023-11-28T16:58:08.345811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:46.168912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346285+0000","last_change":"2023-11-28T16:58:09.346285+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346285+0000","last_undegraded":"2023-11-28T16:58:09.346285+0000","last_fullsized":"2023-11-28T16:58:09.346285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382585+0000","last_change":"2023-11-28T16:58:09.379828+0000","last_active":"2023-11-28T16:58:09.382585+0000","last_peered":"2023-11-28T16:58:09.382585+0000","last_clean":"2023-11-28T16:58:09.382585+0000","last_became_active":"2023-11-28T16:58:09.378437+0000","last_became_peered":"2023-11-28T16:58:09.378437+0000","last_unstale":"2023-11-28T16:58:09.382585+0000","last_undegraded":"2023-11-28T16:58:09.382585+0000","last_fullsized":"2023-11-28T16:58:09.382585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:58.274818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347680+0000","last_change":"2023-11-28T16:57:57.310944+0000","last_active":"2023-11-28T16:58:08.347680+0000","last_peered":"2023-11-28T16:58:08.347680+0000","last_clean":"2023-11-28T16:58:08.347680+0000","last_became_active":"2023-11-28T16:57:57.306481+0000","last_became_peered":"2023-11-28T16:57:57.306481+0000","last_unstale":"2023-11-28T16:58:08.347680+0000","last_undegraded":"2023-11-28T16:58:08.347680+0000","last_fullsized":"2023-11-28T16:58:08.347680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.181027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343825+0000","last_change":"2023-11-28T16:57:56.294742+0000","last_active":"2023-11-28T16:58:08.343825+0000","last_peered":"2023-11-28T16:58:08.343825+0000","last_clean":"2023-11-28T16:58:08.343825+0000","last_became_active":"2023-11-28T16:57:56.294263+0000","last_became_peered":"2023-11-28T16:57:56.294263+0000","last_unstale":"2023-11-28T16:58:08.343825+0000","last_undegraded":"2023-11-28T16:58:08.343825+0000","last_fullsized":"2023-11-28T16:58:08.343825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352949+0000","last_change":"2023-11-28T16:58:09.352949+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352949+0000","last_undegraded":"2023-11-28T16:58:09.352949+0000","last_fullsized":"2023-11-28T16:58:09.352949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373030+0000","last_change":"2023-11-28T16:58:09.370886+0000","last_active":"2023-11-28T16:58:09.373030+0000","last_peered":"2023-11-28T16:58:09.373030+0000","last_clean":"2023-11-28T16:58:09.373030+0000","last_became_active":"2023-11-28T16:58:09.370548+0000","last_became_peered":"2023-11-28T16:58:09.370548+0000","last_unstale":"2023-11-28T16:58:09.373030+0000","last_undegraded":"2023-11-28T16:58:09.373030+0000","last_fullsized":"2023-11-28T16:58:09.373030+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:44.486464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351909+0000","last_change":"2023-11-28T16:57:57.303350+0000","last_active":"2023-11-28T16:58:08.351909+0000","last_peered":"2023-11-28T16:58:08.351909+0000","last_clean":"2023-11-28T16:58:08.351909+0000","last_became_active":"2023-11-28T16:57:57.302817+0000","last_became_peered":"2023-11-28T16:57:57.302817+0000","last_unstale":"2023-11-28T16:58:08.351909+0000","last_undegraded":"2023-11-28T16:58:08.351909+0000","last_fullsized":"2023-11-28T16:58:08.351909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:18.750912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350712+0000","last_change":"2023-11-28T16:57:56.289134+0000","last_active":"2023-11-28T16:58:08.350712+0000","last_peered":"2023-11-28T16:58:08.350712+0000","last_clean":"2023-11-28T16:58:08.350712+0000","last_became_active":"2023-11-28T16:57:56.288857+0000","last_became_peered":"2023-11-28T16:57:56.288857+0000","last_unstale":"2023-11-28T16:58:08.350712+0000","last_undegraded":"2023-11-28T16:58:08.350712+0000","last_fullsized":"2023-11-28T16:58:08.350712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:02.295044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.350692+0000","last_change":"2023-11-28T16:58:09.350692+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.350692+0000","last_undegraded":"2023-11-28T16:58:09.350692+0000","last_fullsized":"2023-11-28T16:58:09.350692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377079+0000","last_change":"2023-11-28T16:58:09.370650+0000","last_active":"2023-11-28T16:58:09.377079+0000","last_peered":"2023-11-28T16:58:09.377079+0000","last_clean":"2023-11-28T16:58:09.377079+0000","last_became_active":"2023-11-28T16:58:09.370449+0000","last_became_peered":"2023-11-28T16:58:09.370449+0000","last_unstale":"2023-11-28T16:58:09.377079+0000","last_undegraded":"2023-11-28T16:58:09.377079+0000","last_fullsized":"2023-11-28T16:58:09.377079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:44:06.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347398+0000","last_change":"2023-11-28T16:57:57.296614+0000","last_active":"2023-11-28T16:58:08.347398+0000","last_peered":"2023-11-28T16:58:08.347398+0000","last_clean":"2023-11-28T16:58:08.347398+0000","last_became_active":"2023-11-28T16:57:57.296296+0000","last_became_peered":"2023-11-28T16:57:57.296296+0000","last_unstale":"2023-11-28T16:58:08.347398+0000","last_undegraded":"2023-11-28T16:58:08.347398+0000","last_fullsized":"2023-11-28T16:58:08.347398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:24.731578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345160+0000","last_change":"2023-11-28T16:57:56.297579+0000","last_active":"2023-11-28T16:58:08.345160+0000","last_peered":"2023-11-28T16:58:08.345160+0000","last_clean":"2023-11-28T16:58:08.345160+0000","last_became_active":"2023-11-28T16:57:56.297237+0000","last_became_peered":"2023-11-28T16:57:56.297237+0000","last_unstale":"2023-11-28T16:58:08.345160+0000","last_undegraded":"2023-11-28T16:58:08.345160+0000","last_fullsized":"2023-11-28T16:58:08.345160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:53.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362168+0000","last_change":"2023-11-28T16:58:09.362168+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362168+0000","last_undegraded":"2023-11-28T16:58:09.362168+0000","last_fullsized":"2023-11-28T16:58:09.362168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373165+0000","last_change":"2023-11-28T16:58:09.371255+0000","last_active":"2023-11-28T16:58:09.373165+0000","last_peered":"2023-11-28T16:58:09.373165+0000","last_clean":"2023-11-28T16:58:09.373165+0000","last_became_active":"2023-11-28T16:58:09.368332+0000","last_became_peered":"2023-11-28T16:58:09.368332+0000","last_unstale":"2023-11-28T16:58:09.373165+0000","last_undegraded":"2023-11-28T16:58:09.373165+0000","last_fullsized":"2023-11-28T16:58:09.373165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:02.313058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345981+0000","last_change":"2023-11-28T16:57:57.288341+0000","last_active":"2023-11-28T16:58:08.345981+0000","last_peered":"2023-11-28T16:58:08.345981+0000","last_clean":"2023-11-28T16:58:08.345981+0000","last_became_active":"2023-11-28T16:57:57.286946+0000","last_became_peered":"2023-11-28T16:57:57.286946+0000","last_unstale":"2023-11-28T16:58:08.345981+0000","last_undegraded":"2023-11-28T16:58:08.345981+0000","last_fullsized":"2023-11-28T16:58:08.345981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:03.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354723+0000","last_change":"2023-11-28T16:57:56.303238+0000","last_active":"2023-11-28T16:58:08.354723+0000","last_peered":"2023-11-28T16:58:08.354723+0000","last_clean":"2023-11-28T16:58:08.354723+0000","last_became_active":"2023-11-28T16:57:56.302991+0000","last_became_peered":"2023-11-28T16:57:56.302991+0000","last_unstale":"2023-11-28T16:58:08.354723+0000","last_undegraded":"2023-11-28T16:58:08.354723+0000","last_fullsized":"2023-11-28T16:58:08.354723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362301+0000","last_change":"2023-11-28T16:58:09.362301+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362301+0000","last_undegraded":"2023-11-28T16:58:09.362301+0000","last_fullsized":"2023-11-28T16:58:09.362301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381945+0000","last_change":"2023-11-28T16:58:09.380840+0000","last_active":"2023-11-28T16:58:09.381945+0000","last_peered":"2023-11-28T16:58:09.381945+0000","last_clean":"2023-11-28T16:58:09.381945+0000","last_became_active":"2023-11-28T16:58:09.380365+0000","last_became_peered":"2023-11-28T16:58:09.380365+0000","last_unstale":"2023-11-28T16:58:09.381945+0000","last_undegraded":"2023-11-28T16:58:09.381945+0000","last_fullsized":"2023-11-28T16:58:09.381945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:15.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354639+0000","last_change":"2023-11-28T16:57:57.292344+0000","last_active":"2023-11-28T16:58:08.354639+0000","last_peered":"2023-11-28T16:58:08.354639+0000","last_clean":"2023-11-28T16:58:08.354639+0000","last_became_active":"2023-11-28T16:57:57.291977+0000","last_became_peered":"2023-11-28T16:57:57.291977+0000","last_unstale":"2023-11-28T16:58:08.354639+0000","last_undegraded":"2023-11-28T16:58:08.354639+0000","last_fullsized":"2023-11-28T16:58:08.354639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:35.065157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348241+0000","last_change":"2023-11-28T16:57:56.300060+0000","last_active":"2023-11-28T16:58:08.348241+0000","last_peered":"2023-11-28T16:58:08.348241+0000","last_clean":"2023-11-28T16:58:08.348241+0000","last_became_active":"2023-11-28T16:57:56.299780+0000","last_became_peered":"2023-11-28T16:57:56.299780+0000","last_unstale":"2023-11-28T16:58:08.348241+0000","last_undegraded":"2023-11-28T16:58:08.348241+0000","last_fullsized":"2023-11-28T16:58:08.348241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:18.071987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355503+0000","last_change":"2023-11-28T16:58:09.355503+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355503+0000","last_undegraded":"2023-11-28T16:58:09.355503+0000","last_fullsized":"2023-11-28T16:58:09.355503+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382214+0000","last_change":"2023-11-28T16:58:09.374674+0000","last_active":"2023-11-28T16:58:09.382214+0000","last_peered":"2023-11-28T16:58:09.382214+0000","last_clean":"2023-11-28T16:58:09.382214+0000","last_became_active":"2023-11-28T16:58:09.374379+0000","last_became_peered":"2023-11-28T16:58:09.374379+0000","last_unstale":"2023-11-28T16:58:09.382214+0000","last_undegraded":"2023-11-28T16:58:09.382214+0000","last_fullsized":"2023-11-28T16:58:09.382214+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:34.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351116+0000","last_change":"2023-11-28T16:57:57.291393+0000","last_active":"2023-11-28T16:58:08.351116+0000","last_peered":"2023-11-28T16:58:08.351116+0000","last_clean":"2023-11-28T16:58:08.351116+0000","last_became_active":"2023-11-28T16:57:57.290974+0000","last_became_peered":"2023-11-28T16:57:57.290974+0000","last_unstale":"2023-11-28T16:58:08.351116+0000","last_undegraded":"2023-11-28T16:58:08.351116+0000","last_fullsized":"2023-11-28T16:58:08.351116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:47.176671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349926+0000","last_change":"2023-11-28T16:57:56.293494+0000","last_active":"2023-11-28T16:58:08.349926+0000","last_peered":"2023-11-28T16:58:08.349926+0000","last_clean":"2023-11-28T16:58:08.349926+0000","last_became_active":"2023-11-28T16:57:56.293071+0000","last_became_peered":"2023-11-28T16:57:56.293071+0000","last_unstale":"2023-11-28T16:58:08.349926+0000","last_undegraded":"2023-11-28T16:58:08.349926+0000","last_fullsized":"2023-11-28T16:58:08.349926+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:42.043041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354734+0000","last_change":"2023-11-28T16:58:09.354734+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354734+0000","last_undegraded":"2023-11-28T16:58:09.354734+0000","last_fullsized":"2023-11-28T16:58:09.354734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382996+0000","last_change":"2023-11-28T16:58:09.377961+0000","last_active":"2023-11-28T16:58:09.382996+0000","last_peered":"2023-11-28T16:58:09.382996+0000","last_clean":"2023-11-28T16:58:09.382996+0000","last_became_active":"2023-11-28T16:58:09.377333+0000","last_became_peered":"2023-11-28T16:58:09.377333+0000","last_unstale":"2023-11-28T16:58:09.382996+0000","last_undegraded":"2023-11-28T16:58:09.382996+0000","last_fullsized":"2023-11-28T16:58:09.382996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:36.341102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349756+0000","last_change":"2023-11-28T16:57:57.293148+0000","last_active":"2023-11-28T16:58:08.349756+0000","last_peered":"2023-11-28T16:58:08.349756+0000","last_clean":"2023-11-28T16:58:08.349756+0000","last_became_active":"2023-11-28T16:57:57.292674+0000","last_became_peered":"2023-11-28T16:57:57.292674+0000","last_unstale":"2023-11-28T16:58:08.349756+0000","last_undegraded":"2023-11-28T16:58:08.349756+0000","last_fullsized":"2023-11-28T16:58:08.349756+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345673+0000","last_change":"2023-11-28T16:57:56.289047+0000","last_active":"2023-11-28T16:58:08.345673+0000","last_peered":"2023-11-28T16:58:08.345673+0000","last_clean":"2023-11-28T16:58:08.345673+0000","last_became_active":"2023-11-28T16:57:56.288333+0000","last_became_peered":"2023-11-28T16:57:56.288333+0000","last_unstale":"2023-11-28T16:58:08.345673+0000","last_undegraded":"2023-11-28T16:58:08.345673+0000","last_fullsized":"2023-11-28T16:58:08.345673+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:55.749727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346336+0000","last_change":"2023-11-28T16:58:09.346336+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346336+0000","last_undegraded":"2023-11-28T16:58:09.346336+0000","last_fullsized":"2023-11-28T16:58:09.346336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.376700+0000","last_change":"2023-11-28T16:58:09.369628+0000","last_active":"2023-11-28T16:58:09.376700+0000","last_peered":"2023-11-28T16:58:09.376700+0000","last_clean":"2023-11-28T16:58:09.376700+0000","last_became_active":"2023-11-28T16:58:09.369340+0000","last_became_peered":"2023-11-28T16:58:09.369340+0000","last_unstale":"2023-11-28T16:58:09.376700+0000","last_undegraded":"2023-11-28T16:58:09.376700+0000","last_fullsized":"2023-11-28T16:58:09.376700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:21.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351274+0000","last_change":"2023-11-28T16:57:57.306068+0000","last_active":"2023-11-28T16:58:08.351274+0000","last_peered":"2023-11-28T16:58:08.351274+0000","last_clean":"2023-11-28T16:58:08.351274+0000","last_became_active":"2023-11-28T16:57:57.305881+0000","last_became_peered":"2023-11-28T16:57:57.305881+0000","last_unstale":"2023-11-28T16:58:08.351274+0000","last_undegraded":"2023-11-28T16:58:08.351274+0000","last_fullsized":"2023-11-28T16:58:08.351274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:39.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347714+0000","last_change":"2023-11-28T16:57:56.297847+0000","last_active":"2023-11-28T16:58:08.347714+0000","last_peered":"2023-11-28T16:58:08.347714+0000","last_clean":"2023-11-28T16:58:08.347714+0000","last_became_active":"2023-11-28T16:57:56.297578+0000","last_became_peered":"2023-11-28T16:57:56.297578+0000","last_unstale":"2023-11-28T16:58:08.347714+0000","last_undegraded":"2023-11-28T16:58:08.347714+0000","last_fullsized":"2023-11-28T16:58:08.347714+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.329569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.363329+0000","last_change":"2023-11-28T16:58:09.363329+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.363329+0000","last_undegraded":"2023-11-28T16:58:09.363329+0000","last_fullsized":"2023-11-28T16:58:09.363329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.368283+0000","last_change":"2023-11-28T16:58:09.362708+0000","last_active":"2023-11-28T16:58:09.368283+0000","last_peered":"2023-11-28T16:58:09.368283+0000","last_clean":"2023-11-28T16:58:09.368283+0000","last_became_active":"2023-11-28T16:58:09.362441+0000","last_became_peered":"2023-11-28T16:58:09.362441+0000","last_unstale":"2023-11-28T16:58:09.368283+0000","last_undegraded":"2023-11-28T16:58:09.368283+0000","last_fullsized":"2023-11-28T16:58:09.368283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:52.069042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350367+0000","last_change":"2023-11-28T16:57:57.295241+0000","last_active":"2023-11-28T16:58:08.350367+0000","last_peered":"2023-11-28T16:58:08.350367+0000","last_clean":"2023-11-28T16:58:08.350367+0000","last_became_active":"2023-11-28T16:57:57.295059+0000","last_became_peered":"2023-11-28T16:57:57.295059+0000","last_unstale":"2023-11-28T16:58:08.350367+0000","last_undegraded":"2023-11-28T16:58:08.350367+0000","last_fullsized":"2023-11-28T16:58:08.350367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.353743+0000","last_change":"2023-11-28T16:57:56.292527+0000","last_active":"2023-11-28T16:58:08.353743+0000","last_peered":"2023-11-28T16:58:08.353743+0000","last_clean":"2023-11-28T16:58:08.353743+0000","last_became_active":"2023-11-28T16:57:56.292280+0000","last_became_peered":"2023-11-28T16:57:56.292280+0000","last_unstale":"2023-11-28T16:58:08.353743+0000","last_undegraded":"2023-11-28T16:58:08.353743+0000","last_fullsized":"2023-11-28T16:58:08.353743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:36.146016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352850+0000","last_change":"2023-11-28T16:58:09.352850+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352850+0000","last_undegraded":"2023-11-28T16:58:09.352850+0000","last_fullsized":"2023-11-28T16:58:09.352850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373223+0000","last_change":"2023-11-28T16:58:09.370461+0000","last_active":"2023-11-28T16:58:09.373223+0000","last_peered":"2023-11-28T16:58:09.373223+0000","last_clean":"2023-11-28T16:58:09.373223+0000","last_became_active":"2023-11-28T16:58:09.370211+0000","last_became_peered":"2023-11-28T16:58:09.370211+0000","last_unstale":"2023-11-28T16:58:09.373223+0000","last_undegraded":"2023-11-28T16:58:09.373223+0000","last_fullsized":"2023-11-28T16:58:09.373223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:15.375230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345121+0000","last_change":"2023-11-28T16:57:57.292399+0000","last_active":"2023-11-28T16:58:08.345121+0000","last_peered":"2023-11-28T16:58:08.345121+0000","last_clean":"2023-11-28T16:58:08.345121+0000","last_became_active":"2023-11-28T16:57:57.291492+0000","last_became_peered":"2023-11-28T16:57:57.291492+0000","last_unstale":"2023-11-28T16:58:08.345121+0000","last_undegraded":"2023-11-28T16:58:08.345121+0000","last_fullsized":"2023-11-28T16:58:08.345121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350796+0000","last_change":"2023-11-28T16:57:56.288401+0000","last_active":"2023-11-28T16:58:08.350796+0000","last_peered":"2023-11-28T16:58:08.350796+0000","last_clean":"2023-11-28T16:58:08.350796+0000","last_became_active":"2023-11-28T16:57:56.288046+0000","last_became_peered":"2023-11-28T16:57:56.288046+0000","last_unstale":"2023-11-28T16:58:08.350796+0000","last_undegraded":"2023-11-28T16:58:08.350796+0000","last_fullsized":"2023-11-28T16:58:08.350796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:23.260917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354576+0000","last_change":"2023-11-28T16:58:09.354576+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354576+0000","last_undegraded":"2023-11-28T16:58:09.354576+0000","last_fullsized":"2023-11-28T16:58:09.354576+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.383025+0000","last_change":"2023-11-28T16:58:09.381709+0000","last_active":"2023-11-28T16:58:09.383025+0000","last_peered":"2023-11-28T16:58:09.383025+0000","last_clean":"2023-11-28T16:58:09.383025+0000","last_became_active":"2023-11-28T16:58:09.381442+0000","last_became_peered":"2023-11-28T16:58:09.381442+0000","last_unstale":"2023-11-28T16:58:09.383025+0000","last_undegraded":"2023-11-28T16:58:09.383025+0000","last_fullsized":"2023-11-28T16:58:09.383025+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:41.188588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349420+0000","last_change":"2023-11-28T16:57:57.300273+0000","last_active":"2023-11-28T16:58:08.349420+0000","last_peered":"2023-11-28T16:58:08.349420+0000","last_clean":"2023-11-28T16:58:08.349420+0000","last_became_active":"2023-11-28T16:57:57.300005+0000","last_became_peered":"2023-11-28T16:57:57.300005+0000","last_unstale":"2023-11-28T16:58:08.349420+0000","last_undegraded":"2023-11-28T16:58:08.349420+0000","last_fullsized":"2023-11-28T16:58:08.349420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348406+0000","last_change":"2023-11-28T16:57:56.297211+0000","last_active":"2023-11-28T16:58:08.348406+0000","last_peered":"2023-11-28T16:58:08.348406+0000","last_clean":"2023-11-28T16:58:08.348406+0000","last_became_active":"2023-11-28T16:57:56.296321+0000","last_became_peered":"2023-11-28T16:57:56.296321+0000","last_unstale":"2023-11-28T16:58:08.348406+0000","last_undegraded":"2023-11-28T16:58:08.348406+0000","last_fullsized":"2023-11-28T16:58:08.348406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355743+0000","last_change":"2023-11-28T16:58:09.355743+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355743+0000","last_undegraded":"2023-11-28T16:58:09.355743+0000","last_fullsized":"2023-11-28T16:58:09.355743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382085+0000","last_change":"2023-11-28T16:58:09.372355+0000","last_active":"2023-11-28T16:58:09.382085+0000","last_peered":"2023-11-28T16:58:09.382085+0000","last_clean":"2023-11-28T16:58:09.382085+0000","last_became_active":"2023-11-28T16:58:09.372007+0000","last_became_peered":"2023-11-28T16:58:09.372007+0000","last_unstale":"2023-11-28T16:58:09.382085+0000","last_undegraded":"2023-11-28T16:58:09.382085+0000","last_fullsized":"2023-11-28T16:58:09.382085+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:15.375230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350796+0000","last_change":"2023-11-28T16:57:57.294684+0000","last_active":"2023-11-28T16:58:08.350796+0000","last_peered":"2023-11-28T16:58:08.350796+0000","last_clean":"2023-11-28T16:58:08.350796+0000","last_became_active":"2023-11-28T16:57:57.294339+0000","last_became_peered":"2023-11-28T16:57:57.294339+0000","last_unstale":"2023-11-28T16:58:08.350796+0000","last_undegraded":"2023-11-28T16:58:08.350796+0000","last_fullsized":"2023-11-28T16:58:08.350796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:19.079746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348704+0000","last_change":"2023-11-28T16:57:56.302265+0000","last_active":"2023-11-28T16:58:08.348704+0000","last_peered":"2023-11-28T16:58:08.348704+0000","last_clean":"2023-11-28T16:58:08.348704+0000","last_became_active":"2023-11-28T16:57:56.301960+0000","last_became_peered":"2023-11-28T16:57:56.301960+0000","last_unstale":"2023-11-28T16:58:08.348704+0000","last_undegraded":"2023-11-28T16:58:08.348704+0000","last_fullsized":"2023-11-28T16:58:08.348704+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:36.131374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355335+0000","last_change":"2023-11-28T16:58:09.355335+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355335+0000","last_undegraded":"2023-11-28T16:58:09.355335+0000","last_fullsized":"2023-11-28T16:58:09.355335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.365065+0000","last_change":"2023-11-28T16:58:09.358618+0000","last_active":"2023-11-28T16:58:09.365065+0000","last_peered":"2023-11-28T16:58:09.365065+0000","last_clean":"2023-11-28T16:58:09.365065+0000","last_became_active":"2023-11-28T16:58:09.358326+0000","last_became_peered":"2023-11-28T16:58:09.358326+0000","last_unstale":"2023-11-28T16:58:09.365065+0000","last_undegraded":"2023-11-28T16:58:09.365065+0000","last_fullsized":"2023-11-28T16:58:09.365065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354317+0000","last_change":"2023-11-28T16:57:57.296609+0000","last_active":"2023-11-28T16:58:08.354317+0000","last_peered":"2023-11-28T16:58:08.354317+0000","last_clean":"2023-11-28T16:58:08.354317+0000","last_became_active":"2023-11-28T16:57:57.296304+0000","last_became_peered":"2023-11-28T16:57:57.296304+0000","last_unstale":"2023-11-28T16:58:08.354317+0000","last_undegraded":"2023-11-28T16:58:08.354317+0000","last_fullsized":"2023-11-28T16:58:08.354317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:27.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344293+0000","last_change":"2023-11-28T16:57:56.296905+0000","last_active":"2023-11-28T16:58:08.344293+0000","last_peered":"2023-11-28T16:58:08.344293+0000","last_clean":"2023-11-28T16:58:08.344293+0000","last_became_active":"2023-11-28T16:57:56.295819+0000","last_became_peered":"2023-11-28T16:57:56.295819+0000","last_unstale":"2023-11-28T16:58:08.344293+0000","last_undegraded":"2023-11-28T16:58:08.344293+0000","last_fullsized":"2023-11-28T16:58:08.344293+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.350168+0000","last_change":"2023-11-28T16:58:09.350168+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.350168+0000","last_undegraded":"2023-11-28T16:58:09.350168+0000","last_fullsized":"2023-11-28T16:58:09.350168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382384+0000","last_change":"2023-11-28T16:58:09.375035+0000","last_active":"2023-11-28T16:58:09.382384+0000","last_peered":"2023-11-28T16:58:09.382384+0000","last_clean":"2023-11-28T16:58:09.382384+0000","last_became_active":"2023-11-28T16:58:09.374689+0000","last_became_peered":"2023-11-28T16:58:09.374689+0000","last_unstale":"2023-11-28T16:58:09.382384+0000","last_undegraded":"2023-11-28T16:58:09.382384+0000","last_fullsized":"2023-11-28T16:58:09.382384+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:05.414794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347855+0000","last_change":"2023-11-28T16:57:57.297238+0000","last_active":"2023-11-28T16:58:08.347855+0000","last_peered":"2023-11-28T16:58:08.347855+0000","last_clean":"2023-11-28T16:58:08.347855+0000","last_became_active":"2023-11-28T16:57:57.296895+0000","last_became_peered":"2023-11-28T16:57:57.296895+0000","last_unstale":"2023-11-28T16:58:08.347855+0000","last_undegraded":"2023-11-28T16:58:08.347855+0000","last_fullsized":"2023-11-28T16:58:08.347855+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:47.232224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351979+0000","last_change":"2023-11-28T16:57:56.292453+0000","last_active":"2023-11-28T16:58:08.351979+0000","last_peered":"2023-11-28T16:58:08.351979+0000","last_clean":"2023-11-28T16:58:08.351979+0000","last_became_active":"2023-11-28T16:57:56.292147+0000","last_became_peered":"2023-11-28T16:57:56.292147+0000","last_unstale":"2023-11-28T16:58:08.351979+0000","last_undegraded":"2023-11-28T16:58:08.351979+0000","last_fullsized":"2023-11-28T16:58:08.351979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351588+0000","last_change":"2023-11-28T16:58:09.351588+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351588+0000","last_undegraded":"2023-11-28T16:58:09.351588+0000","last_fullsized":"2023-11-28T16:58:09.351588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382180+0000","last_change":"2023-11-28T16:58:09.374106+0000","last_active":"2023-11-28T16:58:09.382180+0000","last_peered":"2023-11-28T16:58:09.382180+0000","last_clean":"2023-11-28T16:58:09.382180+0000","last_became_active":"2023-11-28T16:58:09.373822+0000","last_became_peered":"2023-11-28T16:58:09.373822+0000","last_unstale":"2023-11-28T16:58:09.382180+0000","last_undegraded":"2023-11-28T16:58:09.382180+0000","last_fullsized":"2023-11-28T16:58:09.382180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:39.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349836+0000","last_change":"2023-11-28T16:57:57.292951+0000","last_active":"2023-11-28T16:58:08.349836+0000","last_peered":"2023-11-28T16:58:08.349836+0000","last_clean":"2023-11-28T16:58:08.349836+0000","last_became_active":"2023-11-28T16:57:57.292254+0000","last_became_peered":"2023-11-28T16:57:57.292254+0000","last_unstale":"2023-11-28T16:58:08.349836+0000","last_undegraded":"2023-11-28T16:58:08.349836+0000","last_fullsized":"2023-11-28T16:58:08.349836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:07.921821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344263+0000","last_change":"2023-11-28T16:57:56.301392+0000","last_active":"2023-11-28T16:58:08.344263+0000","last_peered":"2023-11-28T16:58:08.344263+0000","last_clean":"2023-11-28T16:58:08.344263+0000","last_became_active":"2023-11-28T16:57:56.300939+0000","last_became_peered":"2023-11-28T16:57:56.300939+0000","last_unstale":"2023-11-28T16:58:08.344263+0000","last_undegraded":"2023-11-28T16:58:08.344263+0000","last_fullsized":"2023-11-28T16:58:08.344263+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:05.783524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352898+0000","last_change":"2023-11-28T16:58:09.352898+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352898+0000","last_undegraded":"2023-11-28T16:58:09.352898+0000","last_fullsized":"2023-11-28T16:58:09.352898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382829+0000","last_change":"2023-11-28T16:58:09.381243+0000","last_active":"2023-11-28T16:58:09.382829+0000","last_peered":"2023-11-28T16:58:09.382829+0000","last_clean":"2023-11-28T16:58:09.382829+0000","last_became_active":"2023-11-28T16:58:09.381035+0000","last_became_peered":"2023-11-28T16:58:09.381035+0000","last_unstale":"2023-11-28T16:58:09.382829+0000","last_undegraded":"2023-11-28T16:58:09.382829+0000","last_fullsized":"2023-11-28T16:58:09.382829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351364+0000","last_change":"2023-11-28T16:57:57.304252+0000","last_active":"2023-11-28T16:58:08.351364+0000","last_peered":"2023-11-28T16:58:08.351364+0000","last_clean":"2023-11-28T16:58:08.351364+0000","last_became_active":"2023-11-28T16:57:57.303963+0000","last_became_peered":"2023-11-28T16:57:57.303963+0000","last_unstale":"2023-11-28T16:58:08.351364+0000","last_undegraded":"2023-11-28T16:58:08.351364+0000","last_fullsized":"2023-11-28T16:58:08.351364+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:08.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347804+0000","last_change":"2023-11-28T16:57:56.291678+0000","last_active":"2023-11-28T16:58:08.347804+0000","last_peered":"2023-11-28T16:58:08.347804+0000","last_clean":"2023-11-28T16:58:08.347804+0000","last_became_active":"2023-11-28T16:57:56.289787+0000","last_became_peered":"2023-11-28T16:57:56.289787+0000","last_unstale":"2023-11-28T16:58:08.347804+0000","last_undegraded":"2023-11-28T16:58:08.347804+0000","last_fullsized":"2023-11-28T16:58:08.347804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:08.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353794+0000","last_change":"2023-11-28T16:58:09.353794+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353794+0000","last_undegraded":"2023-11-28T16:58:09.353794+0000","last_fullsized":"2023-11-28T16:58:09.353794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.378897+0000","last_change":"2023-11-28T16:58:09.376563+0000","last_active":"2023-11-28T16:58:09.378897+0000","last_peered":"2023-11-28T16:58:09.378897+0000","last_clean":"2023-11-28T16:58:09.378897+0000","last_became_active":"2023-11-28T16:58:09.376234+0000","last_became_peered":"2023-11-28T16:58:09.376234+0000","last_unstale":"2023-11-28T16:58:09.378897+0000","last_undegraded":"2023-11-28T16:58:09.378897+0000","last_fullsized":"2023-11-28T16:58:09.378897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343599+0000","last_change":"2023-11-28T16:57:57.294132+0000","last_active":"2023-11-28T16:58:08.343599+0000","last_peered":"2023-11-28T16:58:08.343599+0000","last_clean":"2023-11-28T16:58:08.343599+0000","last_became_active":"2023-11-28T16:57:57.293808+0000","last_became_peered":"2023-11-28T16:57:57.293808+0000","last_unstale":"2023-11-28T16:58:08.343599+0000","last_undegraded":"2023-11-28T16:58:08.343599+0000","last_fullsized":"2023-11-28T16:58:08.343599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351032+0000","last_change":"2023-11-28T16:57:56.299832+0000","last_active":"2023-11-28T16:58:08.351032+0000","last_peered":"2023-11-28T16:58:08.351032+0000","last_clean":"2023-11-28T16:58:08.351032+0000","last_became_active":"2023-11-28T16:57:56.299505+0000","last_became_peered":"2023-11-28T16:57:56.299505+0000","last_unstale":"2023-11-28T16:58:08.351032+0000","last_undegraded":"2023-11-28T16:58:08.351032+0000","last_fullsized":"2023-11-28T16:58:08.351032+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:26.104747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359572+0000","last_change":"2023-11-28T16:58:09.359572+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359572+0000","last_undegraded":"2023-11-28T16:58:09.359572+0000","last_fullsized":"2023-11-28T16:58:09.359572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377101+0000","last_change":"2023-11-28T16:58:09.370643+0000","last_active":"2023-11-28T16:58:09.377101+0000","last_peered":"2023-11-28T16:58:09.377101+0000","last_clean":"2023-11-28T16:58:09.377101+0000","last_became_active":"2023-11-28T16:58:09.370427+0000","last_became_peered":"2023-11-28T16:58:09.370427+0000","last_unstale":"2023-11-28T16:58:09.377101+0000","last_undegraded":"2023-11-28T16:58:09.377101+0000","last_fullsized":"2023-11-28T16:58:09.377101+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:19.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343630+0000","last_change":"2023-11-28T16:57:57.294705+0000","last_active":"2023-11-28T16:58:08.343630+0000","last_peered":"2023-11-28T16:58:08.343630+0000","last_clean":"2023-11-28T16:58:08.343630+0000","last_became_active":"2023-11-28T16:57:57.294386+0000","last_became_peered":"2023-11-28T16:57:57.294386+0000","last_unstale":"2023-11-28T16:58:08.343630+0000","last_undegraded":"2023-11-28T16:58:08.343630+0000","last_fullsized":"2023-11-28T16:58:08.343630+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350509+0000","last_change":"2023-11-28T16:57:56.303059+0000","last_active":"2023-11-28T16:58:08.350509+0000","last_peered":"2023-11-28T16:58:08.350509+0000","last_clean":"2023-11-28T16:58:08.350509+0000","last_became_active":"2023-11-28T16:57:56.302716+0000","last_became_peered":"2023-11-28T16:57:56.302716+0000","last_unstale":"2023-11-28T16:58:08.350509+0000","last_undegraded":"2023-11-28T16:58:08.350509+0000","last_fullsized":"2023-11-28T16:58:08.350509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351550+0000","last_change":"2023-11-28T16:58:09.351550+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351550+0000","last_undegraded":"2023-11-28T16:58:09.351550+0000","last_fullsized":"2023-11-28T16:58:09.351550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381585+0000","last_change":"2023-11-28T16:58:09.379068+0000","last_active":"2023-11-28T16:58:09.381585+0000","last_peered":"2023-11-28T16:58:09.381585+0000","last_clean":"2023-11-28T16:58:09.381585+0000","last_became_active":"2023-11-28T16:58:09.378744+0000","last_became_peered":"2023-11-28T16:58:09.378744+0000","last_unstale":"2023-11-28T16:58:09.381585+0000","last_undegraded":"2023-11-28T16:58:09.381585+0000","last_fullsized":"2023-11-28T16:58:09.381585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:16.766683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354622+0000","last_change":"2023-11-28T16:57:57.310134+0000","last_active":"2023-11-28T16:58:08.354622+0000","last_peered":"2023-11-28T16:58:08.354622+0000","last_clean":"2023-11-28T16:58:08.354622+0000","last_became_active":"2023-11-28T16:57:57.309858+0000","last_became_peered":"2023-11-28T16:57:57.309858+0000","last_unstale":"2023-11-28T16:58:08.354622+0000","last_undegraded":"2023-11-28T16:58:08.354622+0000","last_fullsized":"2023-11-28T16:58:08.354622+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:43.751157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351569+0000","last_change":"2023-11-28T16:57:56.289398+0000","last_active":"2023-11-28T16:58:08.351569+0000","last_peered":"2023-11-28T16:58:08.351569+0000","last_clean":"2023-11-28T16:58:08.351569+0000","last_became_active":"2023-11-28T16:57:56.289082+0000","last_became_peered":"2023-11-28T16:57:56.289082+0000","last_unstale":"2023-11-28T16:58:08.351569+0000","last_undegraded":"2023-11-28T16:58:08.351569+0000","last_fullsized":"2023-11-28T16:58:08.351569+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:34.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352786+0000","last_change":"2023-11-28T16:58:09.352786+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352786+0000","last_undegraded":"2023-11-28T16:58:09.352786+0000","last_fullsized":"2023-11-28T16:58:09.352786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.364251+0000","last_change":"2023-11-28T16:58:09.358558+0000","last_active":"2023-11-28T16:58:09.364251+0000","last_peered":"2023-11-28T16:58:09.364251+0000","last_clean":"2023-11-28T16:58:09.364251+0000","last_became_active":"2023-11-28T16:58:09.358275+0000","last_became_peered":"2023-11-28T16:58:09.358275+0000","last_unstale":"2023-11-28T16:58:09.364251+0000","last_undegraded":"2023-11-28T16:58:09.364251+0000","last_fullsized":"2023-11-28T16:58:09.364251+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:58.060491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354414+0000","last_change":"2023-11-28T16:57:57.302840+0000","last_active":"2023-11-28T16:58:08.354414+0000","last_peered":"2023-11-28T16:58:08.354414+0000","last_clean":"2023-11-28T16:58:08.354414+0000","last_became_active":"2023-11-28T16:57:57.302446+0000","last_became_peered":"2023-11-28T16:57:57.302446+0000","last_unstale":"2023-11-28T16:58:08.354414+0000","last_undegraded":"2023-11-28T16:58:08.354414+0000","last_fullsized":"2023-11-28T16:58:08.354414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:06.791283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344352+0000","last_change":"2023-11-28T16:57:56.295304+0000","last_active":"2023-11-28T16:58:08.344352+0000","last_peered":"2023-11-28T16:58:08.344352+0000","last_clean":"2023-11-28T16:58:08.344352+0000","last_became_active":"2023-11-28T16:57:56.295041+0000","last_became_peered":"2023-11-28T16:57:56.295041+0000","last_unstale":"2023-11-28T16:58:08.344352+0000","last_undegraded":"2023-11-28T16:58:08.344352+0000","last_fullsized":"2023-11-28T16:58:08.344352+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346442+0000","last_change":"2023-11-28T16:58:09.346442+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346442+0000","last_undegraded":"2023-11-28T16:58:09.346442+0000","last_fullsized":"2023-11-28T16:58:09.346442+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.383002+0000","last_change":"2023-11-28T16:58:09.378133+0000","last_active":"2023-11-28T16:58:09.383002+0000","last_peered":"2023-11-28T16:58:09.383002+0000","last_clean":"2023-11-28T16:58:09.383002+0000","last_became_active":"2023-11-28T16:58:09.377825+0000","last_became_peered":"2023-11-28T16:58:09.377825+0000","last_unstale":"2023-11-28T16:58:09.383002+0000","last_undegraded":"2023-11-28T16:58:09.383002+0000","last_fullsized":"2023-11-28T16:58:09.383002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:46.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351143+0000","last_change":"2023-11-28T16:57:57.285348+0000","last_active":"2023-11-28T16:58:08.351143+0000","last_peered":"2023-11-28T16:58:08.351143+0000","last_clean":"2023-11-28T16:58:08.351143+0000","last_became_active":"2023-11-28T16:57:57.285004+0000","last_became_peered":"2023-11-28T16:57:57.285004+0000","last_unstale":"2023-11-28T16:58:08.351143+0000","last_undegraded":"2023-11-28T16:58:08.351143+0000","last_fullsized":"2023-11-28T16:58:08.351143+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:56.757486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.355091+0000","last_change":"2023-11-28T16:57:56.291833+0000","last_active":"2023-11-28T16:58:08.355091+0000","last_peered":"2023-11-28T16:58:08.355091+0000","last_clean":"2023-11-28T16:58:08.355091+0000","last_became_active":"2023-11-28T16:57:56.291493+0000","last_became_peered":"2023-11-28T16:57:56.291493+0000","last_unstale":"2023-11-28T16:58:08.355091+0000","last_undegraded":"2023-11-28T16:58:08.355091+0000","last_fullsized":"2023-11-28T16:58:08.355091+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:36.485569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355205+0000","last_change":"2023-11-28T16:58:09.355205+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355205+0000","last_undegraded":"2023-11-28T16:58:09.355205+0000","last_fullsized":"2023-11-28T16:58:09.355205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.376688+0000","last_change":"2023-11-28T16:58:09.366789+0000","last_active":"2023-11-28T16:58:09.376688+0000","last_peered":"2023-11-28T16:58:09.376688+0000","last_clean":"2023-11-28T16:58:09.376688+0000","last_became_active":"2023-11-28T16:58:09.366058+0000","last_became_peered":"2023-11-28T16:58:09.366058+0000","last_unstale":"2023-11-28T16:58:09.376688+0000","last_undegraded":"2023-11-28T16:58:09.376688+0000","last_fullsized":"2023-11-28T16:58:09.376688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:47.534548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344265+0000","last_change":"2023-11-28T16:57:57.294725+0000","last_active":"2023-11-28T16:58:08.344265+0000","last_peered":"2023-11-28T16:58:08.344265+0000","last_clean":"2023-11-28T16:58:08.344265+0000","last_became_active":"2023-11-28T16:57:57.294368+0000","last_became_peered":"2023-11-28T16:57:57.294368+0000","last_unstale":"2023-11-28T16:58:08.344265+0000","last_undegraded":"2023-11-28T16:58:08.344265+0000","last_fullsized":"2023-11-28T16:58:08.344265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352261+0000","last_change":"2023-11-28T16:57:56.295240+0000","last_active":"2023-11-28T16:58:08.352261+0000","last_peered":"2023-11-28T16:58:08.352261+0000","last_clean":"2023-11-28T16:58:08.352261+0000","last_became_active":"2023-11-28T16:57:56.292758+0000","last_became_peered":"2023-11-28T16:57:56.292758+0000","last_unstale":"2023-11-28T16:58:08.352261+0000","last_undegraded":"2023-11-28T16:58:08.352261+0000","last_fullsized":"2023-11-28T16:58:08.352261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352661+0000","last_change":"2023-11-28T16:58:09.352661+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352661+0000","last_undegraded":"2023-11-28T16:58:09.352661+0000","last_fullsized":"2023-11-28T16:58:09.352661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.365162+0000","last_change":"2023-11-28T16:58:09.356981+0000","last_active":"2023-11-28T16:58:09.365162+0000","last_peered":"2023-11-28T16:58:09.365162+0000","last_clean":"2023-11-28T16:58:09.365162+0000","last_became_active":"2023-11-28T16:58:09.356658+0000","last_became_peered":"2023-11-28T16:58:09.356658+0000","last_unstale":"2023-11-28T16:58:09.365162+0000","last_undegraded":"2023-11-28T16:58:09.365162+0000","last_fullsized":"2023-11-28T16:58:09.365162+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:20.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347589+0000","last_change":"2023-11-28T16:57:57.306973+0000","last_active":"2023-11-28T16:58:08.347589+0000","last_peered":"2023-11-28T16:58:08.347589+0000","last_clean":"2023-11-28T16:58:08.347589+0000","last_became_active":"2023-11-28T16:57:57.304696+0000","last_became_peered":"2023-11-28T16:57:57.304696+0000","last_unstale":"2023-11-28T16:58:08.347589+0000","last_undegraded":"2023-11-28T16:58:08.347589+0000","last_fullsized":"2023-11-28T16:58:08.347589+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.596110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350902+0000","last_change":"2023-11-28T16:57:56.293462+0000","last_active":"2023-11-28T16:58:08.350902+0000","last_peered":"2023-11-28T16:58:08.350902+0000","last_clean":"2023-11-28T16:58:08.350902+0000","last_became_active":"2023-11-28T16:57:56.293039+0000","last_became_peered":"2023-11-28T16:57:56.293039+0000","last_unstale":"2023-11-28T16:58:08.350902+0000","last_undegraded":"2023-11-28T16:58:08.350902+0000","last_fullsized":"2023-11-28T16:58:08.350902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:40.083816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359972+0000","last_change":"2023-11-28T16:58:09.359972+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359972+0000","last_undegraded":"2023-11-28T16:58:09.359972+0000","last_fullsized":"2023-11-28T16:58:09.359972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382416+0000","last_change":"2023-11-28T16:58:09.375351+0000","last_active":"2023-11-28T16:58:09.382416+0000","last_peered":"2023-11-28T16:58:09.382416+0000","last_clean":"2023-11-28T16:58:09.382416+0000","last_became_active":"2023-11-28T16:58:09.375020+0000","last_became_peered":"2023-11-28T16:58:09.375020+0000","last_unstale":"2023-11-28T16:58:09.382416+0000","last_undegraded":"2023-11-28T16:58:09.382416+0000","last_fullsized":"2023-11-28T16:58:09.382416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:12:09.510947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350448+0000","last_change":"2023-11-28T16:57:57.307851+0000","last_active":"2023-11-28T16:58:08.350448+0000","last_peered":"2023-11-28T16:58:08.350448+0000","last_clean":"2023-11-28T16:58:08.350448+0000","last_became_active":"2023-11-28T16:57:57.307208+0000","last_became_peered":"2023-11-28T16:57:57.307208+0000","last_unstale":"2023-11-28T16:58:08.350448+0000","last_undegraded":"2023-11-28T16:58:08.350448+0000","last_fullsized":"2023-11-28T16:58:08.350448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345623+0000","last_change":"2023-11-28T16:57:56.286826+0000","last_active":"2023-11-28T16:58:08.345623+0000","last_peered":"2023-11-28T16:58:08.345623+0000","last_clean":"2023-11-28T16:58:08.345623+0000","last_became_active":"2023-11-28T16:57:56.286506+0000","last_became_peered":"2023-11-28T16:57:56.286506+0000","last_unstale":"2023-11-28T16:58:08.345623+0000","last_undegraded":"2023-11-28T16:58:08.345623+0000","last_fullsized":"2023-11-28T16:58:08.345623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:28.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354653+0000","last_change":"2023-11-28T16:58:09.354653+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354653+0000","last_undegraded":"2023-11-28T16:58:09.354653+0000","last_fullsized":"2023-11-28T16:58:09.354653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381105+0000","last_change":"2023-11-28T16:58:09.376587+0000","last_active":"2023-11-28T16:58:09.381105+0000","last_peered":"2023-11-28T16:58:09.381105+0000","last_clean":"2023-11-28T16:58:09.381105+0000","last_became_active":"2023-11-28T16:58:09.376044+0000","last_became_peered":"2023-11-28T16:58:09.376044+0000","last_unstale":"2023-11-28T16:58:09.381105+0000","last_undegraded":"2023-11-28T16:58:09.381105+0000","last_fullsized":"2023-11-28T16:58:09.381105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:51:04.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350673+0000","last_change":"2023-11-28T16:57:57.293525+0000","last_active":"2023-11-28T16:58:08.350673+0000","last_peered":"2023-11-28T16:58:08.350673+0000","last_clean":"2023-11-28T16:58:08.350673+0000","last_became_active":"2023-11-28T16:57:57.293155+0000","last_became_peered":"2023-11-28T16:57:57.293155+0000","last_unstale":"2023-11-28T16:58:08.350673+0000","last_undegraded":"2023-11-28T16:58:08.350673+0000","last_fullsized":"2023-11-28T16:58:08.350673+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:54.496874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350841+0000","last_change":"2023-11-28T16:57:56.289797+0000","last_active":"2023-11-28T16:58:08.350841+0000","last_peered":"2023-11-28T16:58:08.350841+0000","last_clean":"2023-11-28T16:58:08.350841+0000","last_became_active":"2023-11-28T16:57:56.286507+0000","last_became_peered":"2023-11-28T16:57:56.286507+0000","last_unstale":"2023-11-28T16:58:08.350841+0000","last_undegraded":"2023-11-28T16:58:08.350841+0000","last_fullsized":"2023-11-28T16:58:08.350841+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:55.952116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.360939+0000","last_change":"2023-11-28T16:58:09.360939+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.360939+0000","last_undegraded":"2023-11-28T16:58:09.360939+0000","last_fullsized":"2023-11-28T16:58:09.360939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.371695+0000","last_change":"2023-11-28T16:58:09.366936+0000","last_active":"2023-11-28T16:58:09.371695+0000","last_peered":"2023-11-28T16:58:09.371695+0000","last_clean":"2023-11-28T16:58:09.371695+0000","last_became_active":"2023-11-28T16:58:09.366532+0000","last_became_peered":"2023-11-28T16:58:09.366532+0000","last_unstale":"2023-11-28T16:58:09.371695+0000","last_undegraded":"2023-11-28T16:58:09.371695+0000","last_fullsized":"2023-11-28T16:58:09.371695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:05.414794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347366+0000","last_change":"2023-11-28T16:57:57.295933+0000","last_active":"2023-11-28T16:58:08.347366+0000","last_peered":"2023-11-28T16:58:08.347366+0000","last_clean":"2023-11-28T16:58:08.347366+0000","last_became_active":"2023-11-28T16:57:57.295567+0000","last_became_peered":"2023-11-28T16:57:57.295567+0000","last_unstale":"2023-11-28T16:58:08.347366+0000","last_undegraded":"2023-11-28T16:58:08.347366+0000","last_fullsized":"2023-11-28T16:58:08.347366+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:13.997222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347522+0000","last_change":"2023-11-28T16:57:56.296292+0000","last_active":"2023-11-28T16:58:08.347522+0000","last_peered":"2023-11-28T16:58:08.347522+0000","last_clean":"2023-11-28T16:58:08.347522+0000","last_became_active":"2023-11-28T16:57:56.295958+0000","last_became_peered":"2023-11-28T16:57:56.295958+0000","last_unstale":"2023-11-28T16:58:08.347522+0000","last_undegraded":"2023-11-28T16:58:08.347522+0000","last_fullsized":"2023-11-28T16:58:08.347522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.008383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355572+0000","last_change":"2023-11-28T16:58:09.355572+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355572+0000","last_undegraded":"2023-11-28T16:58:09.355572+0000","last_fullsized":"2023-11-28T16:58:09.355572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382246+0000","last_change":"2023-11-28T16:58:09.373511+0000","last_active":"2023-11-28T16:58:09.382246+0000","last_peered":"2023-11-28T16:58:09.382246+0000","last_clean":"2023-11-28T16:58:09.382246+0000","last_became_active":"2023-11-28T16:58:09.373187+0000","last_became_peered":"2023-11-28T16:58:09.373187+0000","last_unstale":"2023-11-28T16:58:09.382246+0000","last_undegraded":"2023-11-28T16:58:09.382246+0000","last_fullsized":"2023-11-28T16:58:09.382246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:59.249097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347438+0000","last_change":"2023-11-28T16:57:57.308508+0000","last_active":"2023-11-28T16:58:08.347438+0000","last_peered":"2023-11-28T16:58:08.347438+0000","last_clean":"2023-11-28T16:58:08.347438+0000","last_became_active":"2023-11-28T16:57:57.308197+0000","last_became_peered":"2023-11-28T16:57:57.308197+0000","last_unstale":"2023-11-28T16:58:08.347438+0000","last_undegraded":"2023-11-28T16:58:08.347438+0000","last_fullsized":"2023-11-28T16:58:08.347438+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:41.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352073+0000","last_change":"2023-11-28T16:57:56.296886+0000","last_active":"2023-11-28T16:58:08.352073+0000","last_peered":"2023-11-28T16:58:08.352073+0000","last_clean":"2023-11-28T16:58:08.352073+0000","last_became_active":"2023-11-28T16:57:56.296594+0000","last_became_peered":"2023-11-28T16:57:56.296594+0000","last_unstale":"2023-11-28T16:58:08.352073+0000","last_undegraded":"2023-11-28T16:58:08.352073+0000","last_fullsized":"2023-11-28T16:58:08.352073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:40.306391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.347446+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:09.347446+0000","last_peered":"2023-11-28T16:58:09.347446+0000","last_clean":"2023-11-28T16:58:09.347446+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:09.347446+0000","last_undegraded":"2023-11-28T16:58:09.347446+0000","last_fullsized":"2023-11-28T16:58:09.347446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1212416,"data_stored":849032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64500000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.628}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.70699999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":258504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.82299999999999995,"5min":1.474,"15min":1.474},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.73399999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.72799999999999998,"15min":0.753},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.879}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.749}]},{"osd":3,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92300000000000004,"5min":1.071,"15min":1.071},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.92500000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.52900000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.341,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4019999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":259156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69099999999999995}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.52100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76400000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.749},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89200000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54700000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96199999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":261611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.234,"15min":1.234},"last":0.66500000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.871,"5min":1.964,"15min":1.964},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.704,"15min":1.704},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88400000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.254,"15min":1.254},"last":0.497},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88,"5min":1.548,"15min":1.548},"last":0.61599999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90800000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.754}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.218,"15min":1.218},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.593,"15min":1.593},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":630784,"data_stored":265690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.56100000000000005,"5min":0.745,"15min":0.745},"last":0.434}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.874,"15min":0.874},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.47899999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.089,"5min":1.21,"15min":1.21},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91900000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0049999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.629},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0309999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.022,"5min":1.25,"15min":1.25},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.423,"15min":1.423},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":265690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.443},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68700000000000006}]},{"osd":5,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.627},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":258594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52700000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45800000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.56000000000000005,"5min":0.746,"15min":0.746},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.55600000000000005,"5min":1.04,"15min":1.04},"last":0.42799999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.625,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.60399999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.98699999999999999,"5min":1.446,"15min":1.446},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.034,"5min":1.47,"15min":1.47},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1180000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0820000000000001,"5min":1.327,"15min":1.327},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94599999999999995,"5min":1.3,"15min":1.3},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.167,"5min":1.526,"15min":1.526},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1459999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1220608,"data_stored":852561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.63}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:58:14.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:58:14.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.673+0000 7fb6dbf1d640 1 Processor -- start 2023-11-28T16:58:14.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.673+0000 7fb6dbf1d640 1 -- start start 2023-11-28T16:58:14.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.673+0000 7fb6dbf1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6d406e9a0 0x7fb6d4154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.673+0000 7fb6dbf1d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d40c2100 con 0x7fb6d406eed0 2023-11-28T16:58:14.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.673+0000 7fb6dbf1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d406d6a0 con 0x7fb6d4151dc0 2023-11-28T16:58:14.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.673+0000 7fb6dbf1d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40c1930 con 0x7fb6d406e9a0 2023-11-28T16:58:14.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6da4ba640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb6d406eed0 0x7fb6d4155220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49208/0 (socket says 172.21.15.26:49208) 2023-11-28T16:58:14.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6da4ba640 1 -- 172.21.15.26:0/2596772574 learned_addr learned my addr 172.21.15.26:0/2596772574 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d94b8640 1 --2- 172.21.15.26:0/2596772574 >> v2:172.21.15.79:3300/0 conn(0x7fb6d406e9a0 0x7fb6d4154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900402183 0 0) 0x7fb6d40c2100 con 0x7fb6d406eed0 2023-11-28T16:58:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6c0003530 con 0x7fb6d406eed0 2023-11-28T16:58:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770788144 0 0) 0x7fb6c0003530 con 0x7fb6d406eed0 2023-11-28T16:58:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 >> v2:172.21.15.79:3300/0 conn(0x7fb6d406e9a0 msgr2=0x7fb6d4154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 --2- 172.21.15.26:0/2596772574 >> v2:172.21.15.79:3300/0 conn(0x7fb6d406e9a0 0x7fb6d4154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 >> v1:172.21.15.79:6789/0 conn(0x7fb6d4151dc0 legacy=0x7fb6d406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4158b60 con 0x7fb6d406eed0 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fb6cc001a00 con 0x7fb6d406eed0 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 >> v1:172.21.15.26:6789/0 conn(0x7fb6d406eed0 legacy=0x7fb6d4155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6c0003980 0x7fb6c0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c00047d0 0x7fb6c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0005190 0x7fb6c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c1930 con 0x7fb6c0003980 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c000bfe0 con 0x7fb6c00047d0 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c000c1a0 con 0x7fb6c0005190 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d9cb9640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6c0003980 0x7fb6c0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d94b8640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c00047d0 0x7fb6c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6da4ba640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0005190 0x7fb6c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d9cb9640 1 -- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0005190 msgr2=0x7fb6c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:14.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d9cb9640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0005190 0x7fb6c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d9cb9640 1 -- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c00047d0 msgr2=0x7fb6c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:14.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d9cb9640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c00047d0 0x7fb6c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6d9cb9640 1 -- 172.21.15.26:0/2596772574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0003530 con 0x7fb6c0003980 2023-11-28T16:58:14.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.677+0000 7fb6da4ba640 1 -- 172.21.15.26:0/2596772574 reap_dead start 2023-11-28T16:58:14.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6d9cb9640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6c0003980 0x7fb6c0003d60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0001860 tx=0x7fb6d001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409266df14f7224b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:14.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00ab400 con 0x7fb6c0003980 2023-11-28T16:58:14.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d00a7050 con 0x7fb6c0003980 2023-11-28T16:58:14.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6d8cb7640 1 -- 172.21.15.26:0/2596772574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00ab7e0 con 0x7fb6c0003980 2023-11-28T16:58:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2596772574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6c0003980 msgr2=0x7fb6c0003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6c0003980 0x7fb6c0003d60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0001860 tx=0x7fb6d001c500 comp rx=0 tx=0).stop 2023-11-28T16:58:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2596772574 shutdown_connections 2023-11-28T16:58:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2596772574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6c0003980 0x7fb6c0003d60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2596772574 >> 172.21.15.26:0/2596772574 conn(0x7fb6d40c3240 msgr2=0x7fb6d40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2596772574 shutdown_connections 2023-11-28T16:58:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2596772574 wait complete. 2023-11-28T16:58:14.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 Processor -- start 2023-11-28T16:58:14.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.681+0000 7fb6dbf1d640 1 -- start start 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0003980 0x7fb6d41569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6d40ab2e0 0x7fb6d414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d40a9700 0x7fb6d40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4155c00 con 0x7fb6d40a9700 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4156180 con 0x7fb6d40ab2e0 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d41f09b0 con 0x7fb6c0003980 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d40a9700 0x7fb6d40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d40a9700 0x7fb6d40718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37086/0 (socket says 172.21.15.26:37086) 2023-11-28T16:58:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 -- 172.21.15.26:0/2529048115 learned_addr learned my addr 172.21.15.26:0/2529048115 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6d94b8640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6d40ab2e0 0x7fb6d414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6d9cb9640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0003980 0x7fb6d41569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 -- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0003980 msgr2=0x7fb6d41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0003980 0x7fb6d41569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 -- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6d40ab2e0 msgr2=0x7fb6d414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6d40ab2e0 0x7fb6d414fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 -- 172.21.15.26:0/2529048115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d41f0c90 con 0x7fb6d40a9700 2023-11-28T16:58:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6da4ba640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d40a9700 0x7fb6d40718b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40c0c60 tx=0x7fb6cc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6ca7fc640 1 -- 172.21.15.26:0/2529048115 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc00ab30 con 0x7fb6d40a9700 2023-11-28T16:58:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6ca7fc640 1 -- 172.21.15.26:0/2529048115 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc00ac90 con 0x7fb6d40a9700 2023-11-28T16:58:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6ca7fc640 1 -- 172.21.15.26:0/2529048115 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0133f0 con 0x7fb6d40a9700 2023-11-28T16:58:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d4155e10 con 0x7fb6d40a9700 2023-11-28T16:58:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d414ff40 con 0x7fb6d40a9700 2023-11-28T16:58:14.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d41f0e80 con 0x7fb6d40a9700 2023-11-28T16:58:14.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.685+0000 7fb6ca7fc640 1 -- 172.21.15.26:0/2529048115 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb6cc013550 con 0x7fb6d40a9700 2023-11-28T16:58:14.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.689+0000 7fb6ca7fc640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6b8066900 0x7fb6b8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:14.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.689+0000 7fb6ca7fc640 1 -- 172.21.15.26:0/2529048115 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb6cc084ec0 con 0x7fb6d40a9700 2023-11-28T16:58:14.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.689+0000 7fb6d9cb9640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6b8066900 0x7fb6b8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:14.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.689+0000 7fb6d9cb9640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6b8066900 0x7fb6b8068dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00ad000 tx=0x7fb6d0005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.693+0000 7fb6ca7fc640 1 -- 172.21.15.26:0/2529048115 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6cc051d00 con 0x7fb6d40a9700 2023-11-28T16:58:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.845+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6d4154ce0 con 0x7fb6b8066900 2023-11-28T16:58:14.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.861+0000 7fb6ca7fc640 1 -- 172.21.15.26:0/2529048115 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522207 (secure 0 0 0) 0x7fb6d0005350 con 0x7fb6b8066900 2023-11-28T16:58:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:14.871 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6b8066900 msgr2=0x7fb6b8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6b8066900 0x7fb6b8068dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00ad000 tx=0x7fb6d0005040 comp rx=0 tx=0).stop 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d40a9700 msgr2=0x7fb6d40718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d40a9700 0x7fb6d40718b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40c0c60 tx=0x7fb6cc007bd0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 shutdown_connections 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d40a9700 0x7fb6d40718b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6d40ab2e0 0x7fb6d414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6b8066900 0x7fb6b8068dc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 --2- 172.21.15.26:0/2529048115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c0003980 0x7fb6d41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:14.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 >> 172.21.15.26:0/2529048115 conn(0x7fb6d40c3240 msgr2=0x7fb6d4150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:14.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 shutdown_connections 2023-11-28T16:58:14.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:14.865+0000 7fb6dbf1d640 1 -- 172.21.15.26:0/2529048115 wait complete. 2023-11-28T16:58:14.887 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-28T16:58:13.601461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238820,"kb_used_data":6016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735900,"statfs":{"total":773094113280,"available":772849561600,"internally_reserved":0,"allocated":6160384,"data_stored":3270838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.260570"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356934+0000","last_change":"2023-11-28T16:58:09.356934+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356934+0000","last_undegraded":"2023-11-28T16:58:09.356934+0000","last_fullsized":"2023-11-28T16:58:09.356934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341292+0000","last_change":"2023-11-28T16:57:57.311201+0000","last_active":"2023-11-28T16:58:08.341292+0000","last_peered":"2023-11-28T16:58:08.341292+0000","last_clean":"2023-11-28T16:58:08.341292+0000","last_became_active":"2023-11-28T16:57:57.310858+0000","last_became_peered":"2023-11-28T16:57:57.310858+0000","last_unstale":"2023-11-28T16:58:08.341292+0000","last_undegraded":"2023-11-28T16:58:08.341292+0000","last_fullsized":"2023-11-28T16:58:08.341292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:38.198969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352892+0000","last_change":"2023-11-28T16:58:09.352892+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352892+0000","last_undegraded":"2023-11-28T16:58:09.352892+0000","last_fullsized":"2023-11-28T16:58:09.352892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348156+0000","last_change":"2023-11-28T16:57:57.307903+0000","last_active":"2023-11-28T16:58:08.348156+0000","last_peered":"2023-11-28T16:58:08.348156+0000","last_clean":"2023-11-28T16:58:08.348156+0000","last_became_active":"2023-11-28T16:57:57.305651+0000","last_became_peered":"2023-11-28T16:57:57.305651+0000","last_unstale":"2023-11-28T16:58:08.348156+0000","last_undegraded":"2023-11-28T16:58:08.348156+0000","last_fullsized":"2023-11-28T16:58:08.348156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:58.350824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355797+0000","last_change":"2023-11-28T16:58:09.355797+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355797+0000","last_undegraded":"2023-11-28T16:58:09.355797+0000","last_fullsized":"2023-11-28T16:58:09.355797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349667+0000","last_change":"2023-11-28T16:57:57.295922+0000","last_active":"2023-11-28T16:58:08.349667+0000","last_peered":"2023-11-28T16:58:08.349667+0000","last_clean":"2023-11-28T16:58:08.349667+0000","last_became_active":"2023-11-28T16:57:57.295614+0000","last_became_peered":"2023-11-28T16:57:57.295614+0000","last_unstale":"2023-11-28T16:58:08.349667+0000","last_undegraded":"2023-11-28T16:58:08.349667+0000","last_fullsized":"2023-11-28T16:58:08.349667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.365573+0000","last_change":"2023-11-28T16:58:09.365573+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.365573+0000","last_undegraded":"2023-11-28T16:58:09.365573+0000","last_fullsized":"2023-11-28T16:58:09.365573+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352081+0000","last_change":"2023-11-28T16:57:57.307103+0000","last_active":"2023-11-28T16:58:08.352081+0000","last_peered":"2023-11-28T16:58:08.352081+0000","last_clean":"2023-11-28T16:58:08.352081+0000","last_became_active":"2023-11-28T16:57:57.306791+0000","last_became_peered":"2023-11-28T16:57:57.306791+0000","last_unstale":"2023-11-28T16:58:08.352081+0000","last_undegraded":"2023-11-28T16:58:08.352081+0000","last_fullsized":"2023-11-28T16:58:08.352081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354028+0000","last_change":"2023-11-28T16:58:09.354028+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354028+0000","last_undegraded":"2023-11-28T16:58:09.354028+0000","last_fullsized":"2023-11-28T16:58:09.354028+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341241+0000","last_change":"2023-11-28T16:57:57.294572+0000","last_active":"2023-11-28T16:58:08.341241+0000","last_peered":"2023-11-28T16:58:08.341241+0000","last_clean":"2023-11-28T16:58:08.341241+0000","last_became_active":"2023-11-28T16:57:57.294253+0000","last_became_peered":"2023-11-28T16:57:57.294253+0000","last_unstale":"2023-11-28T16:58:08.341241+0000","last_undegraded":"2023-11-28T16:58:08.341241+0000","last_fullsized":"2023-11-28T16:58:08.341241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:08.044829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362280+0000","last_change":"2023-11-28T16:58:09.362280+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362280+0000","last_undegraded":"2023-11-28T16:58:09.362280+0000","last_fullsized":"2023-11-28T16:58:09.362280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343666+0000","last_change":"2023-11-28T16:57:57.303700+0000","last_active":"2023-11-28T16:58:08.343666+0000","last_peered":"2023-11-28T16:58:08.343666+0000","last_clean":"2023-11-28T16:58:08.343666+0000","last_became_active":"2023-11-28T16:57:57.303377+0000","last_became_peered":"2023-11-28T16:57:57.303377+0000","last_unstale":"2023-11-28T16:58:08.343666+0000","last_undegraded":"2023-11-28T16:58:08.343666+0000","last_fullsized":"2023-11-28T16:58:08.343666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353798+0000","last_change":"2023-11-28T16:58:09.353798+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353798+0000","last_undegraded":"2023-11-28T16:58:09.353798+0000","last_fullsized":"2023-11-28T16:58:09.353798+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345302+0000","last_change":"2023-11-28T16:57:57.290167+0000","last_active":"2023-11-28T16:58:08.345302+0000","last_peered":"2023-11-28T16:58:08.345302+0000","last_clean":"2023-11-28T16:58:08.345302+0000","last_became_active":"2023-11-28T16:57:57.289873+0000","last_became_peered":"2023-11-28T16:57:57.289873+0000","last_unstale":"2023-11-28T16:58:08.345302+0000","last_undegraded":"2023-11-28T16:58:08.345302+0000","last_fullsized":"2023-11-28T16:58:08.345302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:53.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.364239+0000","last_change":"2023-11-28T16:58:09.364239+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.364239+0000","last_undegraded":"2023-11-28T16:58:09.364239+0000","last_fullsized":"2023-11-28T16:58:09.364239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347226+0000","last_change":"2023-11-28T16:57:57.294040+0000","last_active":"2023-11-28T16:58:08.347226+0000","last_peered":"2023-11-28T16:58:08.347226+0000","last_clean":"2023-11-28T16:58:08.347226+0000","last_became_active":"2023-11-28T16:57:57.293696+0000","last_became_peered":"2023-11-28T16:57:57.293696+0000","last_unstale":"2023-11-28T16:58:08.347226+0000","last_undegraded":"2023-11-28T16:58:08.347226+0000","last_fullsized":"2023-11-28T16:58:08.347226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:45.988064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354554+0000","last_change":"2023-11-28T16:58:09.354554+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354554+0000","last_undegraded":"2023-11-28T16:58:09.354554+0000","last_fullsized":"2023-11-28T16:58:09.354554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345945+0000","last_change":"2023-11-28T16:57:57.291252+0000","last_active":"2023-11-28T16:58:08.345945+0000","last_peered":"2023-11-28T16:58:08.345945+0000","last_clean":"2023-11-28T16:58:08.345945+0000","last_became_active":"2023-11-28T16:57:57.290870+0000","last_became_peered":"2023-11-28T16:57:57.290870+0000","last_unstale":"2023-11-28T16:58:08.345945+0000","last_undegraded":"2023-11-28T16:58:08.345945+0000","last_fullsized":"2023-11-28T16:58:08.345945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:24.268675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356219+0000","last_change":"2023-11-28T16:58:09.356219+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356219+0000","last_undegraded":"2023-11-28T16:58:09.356219+0000","last_fullsized":"2023-11-28T16:58:09.356219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351003+0000","last_change":"2023-11-28T16:57:57.293326+0000","last_active":"2023-11-28T16:58:08.351003+0000","last_peered":"2023-11-28T16:58:08.351003+0000","last_clean":"2023-11-28T16:58:08.351003+0000","last_became_active":"2023-11-28T16:57:57.292663+0000","last_became_peered":"2023-11-28T16:57:57.292663+0000","last_unstale":"2023-11-28T16:58:08.351003+0000","last_undegraded":"2023-11-28T16:58:08.351003+0000","last_fullsized":"2023-11-28T16:58:08.351003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:07.257033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359820+0000","last_change":"2023-11-28T16:58:09.359820+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359820+0000","last_undegraded":"2023-11-28T16:58:09.359820+0000","last_fullsized":"2023-11-28T16:58:09.359820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351512+0000","last_change":"2023-11-28T16:57:57.285037+0000","last_active":"2023-11-28T16:58:08.351512+0000","last_peered":"2023-11-28T16:58:08.351512+0000","last_clean":"2023-11-28T16:58:08.351512+0000","last_became_active":"2023-11-28T16:57:57.284722+0000","last_became_peered":"2023-11-28T16:57:57.284722+0000","last_unstale":"2023-11-28T16:58:08.351512+0000","last_undegraded":"2023-11-28T16:58:08.351512+0000","last_fullsized":"2023-11-28T16:58:08.351512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:29.116162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351087+0000","last_change":"2023-11-28T16:58:09.351087+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351087+0000","last_undegraded":"2023-11-28T16:58:09.351087+0000","last_fullsized":"2023-11-28T16:58:09.351087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352165+0000","last_change":"2023-11-28T16:57:57.303913+0000","last_active":"2023-11-28T16:58:08.352165+0000","last_peered":"2023-11-28T16:58:08.352165+0000","last_clean":"2023-11-28T16:58:08.352165+0000","last_became_active":"2023-11-28T16:57:57.303625+0000","last_became_peered":"2023-11-28T16:57:57.303625+0000","last_unstale":"2023-11-28T16:58:08.352165+0000","last_undegraded":"2023-11-28T16:58:08.352165+0000","last_fullsized":"2023-11-28T16:58:08.352165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.347055+0000","last_change":"2023-11-28T16:58:09.347055+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.347055+0000","last_undegraded":"2023-11-28T16:58:09.347055+0000","last_fullsized":"2023-11-28T16:58:09.347055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352767+0000","last_change":"2023-11-28T16:57:57.305618+0000","last_active":"2023-11-28T16:58:08.352767+0000","last_peered":"2023-11-28T16:58:08.352767+0000","last_clean":"2023-11-28T16:58:08.352767+0000","last_became_active":"2023-11-28T16:57:57.305369+0000","last_became_peered":"2023-11-28T16:57:57.305369+0000","last_unstale":"2023-11-28T16:58:08.352767+0000","last_undegraded":"2023-11-28T16:58:08.352767+0000","last_fullsized":"2023-11-28T16:58:08.352767+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:26.927795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349211+0000","last_change":"2023-11-28T16:58:09.349211+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349211+0000","last_undegraded":"2023-11-28T16:58:09.349211+0000","last_fullsized":"2023-11-28T16:58:09.349211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345514+0000","last_change":"2023-11-28T16:57:57.286182+0000","last_active":"2023-11-28T16:58:08.345514+0000","last_peered":"2023-11-28T16:58:08.345514+0000","last_clean":"2023-11-28T16:58:08.345514+0000","last_became_active":"2023-11-28T16:57:57.285885+0000","last_became_peered":"2023-11-28T16:57:57.285885+0000","last_unstale":"2023-11-28T16:58:08.345514+0000","last_undegraded":"2023-11-28T16:58:08.345514+0000","last_fullsized":"2023-11-28T16:58:08.345514+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:34.325761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346377+0000","last_change":"2023-11-28T16:58:09.346377+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346377+0000","last_undegraded":"2023-11-28T16:58:09.346377+0000","last_fullsized":"2023-11-28T16:58:09.346377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345416+0000","last_change":"2023-11-28T16:57:57.288466+0000","last_active":"2023-11-28T16:58:08.345416+0000","last_peered":"2023-11-28T16:58:08.345416+0000","last_clean":"2023-11-28T16:58:08.345416+0000","last_became_active":"2023-11-28T16:57:57.288071+0000","last_became_peered":"2023-11-28T16:57:57.288071+0000","last_unstale":"2023-11-28T16:58:08.345416+0000","last_undegraded":"2023-11-28T16:58:08.345416+0000","last_fullsized":"2023-11-28T16:58:08.345416+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:54.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362056+0000","last_change":"2023-11-28T16:58:09.362056+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362056+0000","last_undegraded":"2023-11-28T16:58:09.362056+0000","last_fullsized":"2023-11-28T16:58:09.362056+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343291+0000","last_change":"2023-11-28T16:57:57.298522+0000","last_active":"2023-11-28T16:58:08.343291+0000","last_peered":"2023-11-28T16:58:08.343291+0000","last_clean":"2023-11-28T16:58:08.343291+0000","last_became_active":"2023-11-28T16:57:57.298241+0000","last_became_peered":"2023-11-28T16:57:57.298241+0000","last_unstale":"2023-11-28T16:58:08.343291+0000","last_undegraded":"2023-11-28T16:58:08.343291+0000","last_fullsized":"2023-11-28T16:58:08.343291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.366415+0000","last_change":"2023-11-28T16:58:09.366415+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.366415+0000","last_undegraded":"2023-11-28T16:58:09.366415+0000","last_fullsized":"2023-11-28T16:58:09.366415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348552+0000","last_change":"2023-11-28T16:57:57.306762+0000","last_active":"2023-11-28T16:58:08.348552+0000","last_peered":"2023-11-28T16:58:08.348552+0000","last_clean":"2023-11-28T16:58:08.348552+0000","last_became_active":"2023-11-28T16:57:57.306428+0000","last_became_peered":"2023-11-28T16:57:57.306428+0000","last_unstale":"2023-11-28T16:58:08.348552+0000","last_undegraded":"2023-11-28T16:58:08.348552+0000","last_fullsized":"2023-11-28T16:58:08.348552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:34.023526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346855+0000","last_change":"2023-11-28T16:58:09.346855+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346855+0000","last_undegraded":"2023-11-28T16:58:09.346855+0000","last_fullsized":"2023-11-28T16:58:09.346855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350719+0000","last_change":"2023-11-28T16:57:57.301733+0000","last_active":"2023-11-28T16:58:08.350719+0000","last_peered":"2023-11-28T16:58:08.350719+0000","last_clean":"2023-11-28T16:58:08.350719+0000","last_became_active":"2023-11-28T16:57:57.301402+0000","last_became_peered":"2023-11-28T16:57:57.301402+0000","last_unstale":"2023-11-28T16:58:08.350719+0000","last_undegraded":"2023-11-28T16:58:08.350719+0000","last_fullsized":"2023-11-28T16:58:08.350719+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:35.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359147+0000","last_change":"2023-11-28T16:58:09.359147+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359147+0000","last_undegraded":"2023-11-28T16:58:09.359147+0000","last_fullsized":"2023-11-28T16:58:09.359147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341178+0000","last_change":"2023-11-28T16:57:57.299228+0000","last_active":"2023-11-28T16:58:08.341178+0000","last_peered":"2023-11-28T16:58:08.341178+0000","last_clean":"2023-11-28T16:58:08.341178+0000","last_became_active":"2023-11-28T16:57:57.298919+0000","last_became_peered":"2023-11-28T16:57:57.298919+0000","last_unstale":"2023-11-28T16:58:08.341178+0000","last_undegraded":"2023-11-28T16:58:08.341178+0000","last_fullsized":"2023-11-28T16:58:08.341178+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:09.019656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354562+0000","last_change":"2023-11-28T16:58:09.354562+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354562+0000","last_undegraded":"2023-11-28T16:58:09.354562+0000","last_fullsized":"2023-11-28T16:58:09.354562+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347776+0000","last_change":"2023-11-28T16:57:57.299427+0000","last_active":"2023-11-28T16:58:08.347776+0000","last_peered":"2023-11-28T16:58:08.347776+0000","last_clean":"2023-11-28T16:58:08.347776+0000","last_became_active":"2023-11-28T16:57:57.299152+0000","last_became_peered":"2023-11-28T16:57:57.299152+0000","last_unstale":"2023-11-28T16:58:08.347776+0000","last_undegraded":"2023-11-28T16:58:08.347776+0000","last_fullsized":"2023-11-28T16:58:08.347776+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:15.293843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355577+0000","last_change":"2023-11-28T16:58:09.355577+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355577+0000","last_undegraded":"2023-11-28T16:58:09.355577+0000","last_fullsized":"2023-11-28T16:58:09.355577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350284+0000","last_change":"2023-11-28T16:57:57.293718+0000","last_active":"2023-11-28T16:58:08.350284+0000","last_peered":"2023-11-28T16:58:08.350284+0000","last_clean":"2023-11-28T16:58:08.350284+0000","last_became_active":"2023-11-28T16:57:57.293317+0000","last_became_peered":"2023-11-28T16:57:57.293317+0000","last_unstale":"2023-11-28T16:58:08.350284+0000","last_undegraded":"2023-11-28T16:58:08.350284+0000","last_fullsized":"2023-11-28T16:58:08.350284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354170+0000","last_change":"2023-11-28T16:58:09.354170+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354170+0000","last_undegraded":"2023-11-28T16:58:09.354170+0000","last_fullsized":"2023-11-28T16:58:09.354170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347531+0000","last_change":"2023-11-28T16:57:57.307374+0000","last_active":"2023-11-28T16:58:08.347531+0000","last_peered":"2023-11-28T16:58:08.347531+0000","last_clean":"2023-11-28T16:58:08.347531+0000","last_became_active":"2023-11-28T16:57:57.305540+0000","last_became_peered":"2023-11-28T16:57:57.305540+0000","last_unstale":"2023-11-28T16:58:08.347531+0000","last_undegraded":"2023-11-28T16:58:08.347531+0000","last_fullsized":"2023-11-28T16:58:08.347531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:34.222003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349265+0000","last_change":"2023-11-28T16:58:09.349265+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349265+0000","last_undegraded":"2023-11-28T16:58:09.349265+0000","last_fullsized":"2023-11-28T16:58:09.349265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349325+0000","last_change":"2023-11-28T16:57:57.300922+0000","last_active":"2023-11-28T16:58:08.349325+0000","last_peered":"2023-11-28T16:58:08.349325+0000","last_clean":"2023-11-28T16:58:08.349325+0000","last_became_active":"2023-11-28T16:57:57.300127+0000","last_became_peered":"2023-11-28T16:57:57.300127+0000","last_unstale":"2023-11-28T16:58:08.349325+0000","last_undegraded":"2023-11-28T16:58:08.349325+0000","last_fullsized":"2023-11-28T16:58:08.349325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.348943+0000","last_change":"2023-11-28T16:58:09.348943+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.348943+0000","last_undegraded":"2023-11-28T16:58:09.348943+0000","last_fullsized":"2023-11-28T16:58:09.348943+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351833+0000","last_change":"2023-11-28T16:57:57.307862+0000","last_active":"2023-11-28T16:58:08.351833+0000","last_peered":"2023-11-28T16:58:08.351833+0000","last_clean":"2023-11-28T16:58:08.351833+0000","last_became_active":"2023-11-28T16:57:57.307540+0000","last_became_peered":"2023-11-28T16:57:57.307540+0000","last_unstale":"2023-11-28T16:58:08.351833+0000","last_undegraded":"2023-11-28T16:58:08.351833+0000","last_fullsized":"2023-11-28T16:58:08.351833+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:36.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356410+0000","last_change":"2023-11-28T16:58:09.356410+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356410+0000","last_undegraded":"2023-11-28T16:58:09.356410+0000","last_fullsized":"2023-11-28T16:58:09.356410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341372+0000","last_change":"2023-11-28T16:57:57.284808+0000","last_active":"2023-11-28T16:58:08.341372+0000","last_peered":"2023-11-28T16:58:08.341372+0000","last_clean":"2023-11-28T16:58:08.341372+0000","last_became_active":"2023-11-28T16:57:57.284304+0000","last_became_peered":"2023-11-28T16:57:57.284304+0000","last_unstale":"2023-11-28T16:58:08.341372+0000","last_undegraded":"2023-11-28T16:58:08.341372+0000","last_fullsized":"2023-11-28T16:58:08.341372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:56.940553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349986+0000","last_change":"2023-11-28T16:58:09.349986+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349986+0000","last_undegraded":"2023-11-28T16:58:09.349986+0000","last_fullsized":"2023-11-28T16:58:09.349986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354167+0000","last_change":"2023-11-28T16:57:57.291693+0000","last_active":"2023-11-28T16:58:08.354167+0000","last_peered":"2023-11-28T16:58:08.354167+0000","last_clean":"2023-11-28T16:58:08.354167+0000","last_became_active":"2023-11-28T16:57:57.291320+0000","last_became_peered":"2023-11-28T16:57:57.291320+0000","last_unstale":"2023-11-28T16:58:08.354167+0000","last_undegraded":"2023-11-28T16:58:08.354167+0000","last_fullsized":"2023-11-28T16:58:08.354167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:21.959226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349811+0000","last_change":"2023-11-28T16:58:09.349811+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349811+0000","last_undegraded":"2023-11-28T16:58:09.349811+0000","last_fullsized":"2023-11-28T16:58:09.349811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344446+0000","last_change":"2023-11-28T16:57:57.299843+0000","last_active":"2023-11-28T16:58:08.344446+0000","last_peered":"2023-11-28T16:58:08.344446+0000","last_clean":"2023-11-28T16:58:08.344446+0000","last_became_active":"2023-11-28T16:57:57.299266+0000","last_became_peered":"2023-11-28T16:57:57.299266+0000","last_unstale":"2023-11-28T16:58:08.344446+0000","last_undegraded":"2023-11-28T16:58:08.344446+0000","last_fullsized":"2023-11-28T16:58:08.344446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355951+0000","last_change":"2023-11-28T16:58:09.355951+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355951+0000","last_undegraded":"2023-11-28T16:58:09.355951+0000","last_fullsized":"2023-11-28T16:58:09.355951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341349+0000","last_change":"2023-11-28T16:57:57.294587+0000","last_active":"2023-11-28T16:58:08.341349+0000","last_peered":"2023-11-28T16:58:08.341349+0000","last_clean":"2023-11-28T16:58:08.341349+0000","last_became_active":"2023-11-28T16:57:57.294283+0000","last_became_peered":"2023-11-28T16:57:57.294283+0000","last_unstale":"2023-11-28T16:58:08.341349+0000","last_undegraded":"2023-11-28T16:58:08.341349+0000","last_fullsized":"2023-11-28T16:58:08.341349+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:35.632692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353445+0000","last_change":"2023-11-28T16:58:09.353445+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353445+0000","last_undegraded":"2023-11-28T16:58:09.353445+0000","last_fullsized":"2023-11-28T16:58:09.353445+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347771+0000","last_change":"2023-11-28T16:57:57.298034+0000","last_active":"2023-11-28T16:58:08.347771+0000","last_peered":"2023-11-28T16:58:08.347771+0000","last_clean":"2023-11-28T16:58:08.347771+0000","last_became_active":"2023-11-28T16:57:57.297743+0000","last_became_peered":"2023-11-28T16:57:57.297743+0000","last_unstale":"2023-11-28T16:58:08.347771+0000","last_undegraded":"2023-11-28T16:58:08.347771+0000","last_fullsized":"2023-11-28T16:58:08.347771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:26.295837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359339+0000","last_change":"2023-11-28T16:58:09.359339+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359339+0000","last_undegraded":"2023-11-28T16:58:09.359339+0000","last_fullsized":"2023-11-28T16:58:09.359339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349435+0000","last_change":"2023-11-28T16:57:57.296838+0000","last_active":"2023-11-28T16:58:08.349435+0000","last_peered":"2023-11-28T16:58:08.349435+0000","last_clean":"2023-11-28T16:58:08.349435+0000","last_became_active":"2023-11-28T16:57:57.295762+0000","last_became_peered":"2023-11-28T16:57:57.295762+0000","last_unstale":"2023-11-28T16:58:08.349435+0000","last_undegraded":"2023-11-28T16:58:08.349435+0000","last_fullsized":"2023-11-28T16:58:08.349435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.358941+0000","last_change":"2023-11-28T16:58:09.358941+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.358941+0000","last_undegraded":"2023-11-28T16:58:09.358941+0000","last_fullsized":"2023-11-28T16:58:09.358941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.340954+0000","last_change":"2023-11-28T16:57:57.291516+0000","last_active":"2023-11-28T16:58:08.340954+0000","last_peered":"2023-11-28T16:58:08.340954+0000","last_clean":"2023-11-28T16:58:08.340954+0000","last_became_active":"2023-11-28T16:57:57.291201+0000","last_became_peered":"2023-11-28T16:57:57.291201+0000","last_unstale":"2023-11-28T16:58:08.340954+0000","last_undegraded":"2023-11-28T16:58:08.340954+0000","last_fullsized":"2023-11-28T16:58:08.340954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:23.828578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353541+0000","last_change":"2023-11-28T16:58:09.353541+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353541+0000","last_undegraded":"2023-11-28T16:58:09.353541+0000","last_fullsized":"2023-11-28T16:58:09.353541+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343376+0000","last_change":"2023-11-28T16:57:57.308867+0000","last_active":"2023-11-28T16:58:08.343376+0000","last_peered":"2023-11-28T16:58:08.343376+0000","last_clean":"2023-11-28T16:58:08.343376+0000","last_became_active":"2023-11-28T16:57:57.307693+0000","last_became_peered":"2023-11-28T16:57:57.307693+0000","last_unstale":"2023-11-28T16:58:08.343376+0000","last_undegraded":"2023-11-28T16:58:08.343376+0000","last_fullsized":"2023-11-28T16:58:08.343376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:24.984986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362611+0000","last_change":"2023-11-28T16:58:09.362611+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362611+0000","last_undegraded":"2023-11-28T16:58:09.362611+0000","last_fullsized":"2023-11-28T16:58:09.362611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382146+0000","last_change":"2023-11-28T16:58:09.374084+0000","last_active":"2023-11-28T16:58:09.382146+0000","last_peered":"2023-11-28T16:58:09.382146+0000","last_clean":"2023-11-28T16:58:09.382146+0000","last_became_active":"2023-11-28T16:58:09.373766+0000","last_became_peered":"2023-11-28T16:58:09.373766+0000","last_unstale":"2023-11-28T16:58:09.382146+0000","last_undegraded":"2023-11-28T16:58:09.382146+0000","last_fullsized":"2023-11-28T16:58:09.382146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:55.123226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344211+0000","last_change":"2023-11-28T16:57:57.292539+0000","last_active":"2023-11-28T16:58:08.344211+0000","last_peered":"2023-11-28T16:58:08.344211+0000","last_clean":"2023-11-28T16:58:08.344211+0000","last_became_active":"2023-11-28T16:57:57.292189+0000","last_became_peered":"2023-11-28T16:57:57.292189+0000","last_unstale":"2023-11-28T16:58:08.344211+0000","last_undegraded":"2023-11-28T16:58:08.344211+0000","last_fullsized":"2023-11-28T16:58:08.344211+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344321+0000","last_change":"2023-11-28T16:57:56.296007+0000","last_active":"2023-11-28T16:58:08.344321+0000","last_peered":"2023-11-28T16:58:08.344321+0000","last_clean":"2023-11-28T16:58:08.344321+0000","last_became_active":"2023-11-28T16:57:56.295636+0000","last_became_peered":"2023-11-28T16:57:56.295636+0000","last_unstale":"2023-11-28T16:58:08.344321+0000","last_undegraded":"2023-11-28T16:58:08.344321+0000","last_fullsized":"2023-11-28T16:58:08.344321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:38.988857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353750+0000","last_change":"2023-11-28T16:58:09.353750+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353750+0000","last_undegraded":"2023-11-28T16:58:09.353750+0000","last_fullsized":"2023-11-28T16:58:09.353750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382148+0000","last_change":"2023-11-28T16:58:09.372867+0000","last_active":"2023-11-28T16:58:09.382148+0000","last_peered":"2023-11-28T16:58:09.382148+0000","last_clean":"2023-11-28T16:58:09.382148+0000","last_became_active":"2023-11-28T16:58:09.372597+0000","last_became_peered":"2023-11-28T16:58:09.372597+0000","last_unstale":"2023-11-28T16:58:09.382148+0000","last_undegraded":"2023-11-28T16:58:09.382148+0000","last_fullsized":"2023-11-28T16:58:09.382148+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:08.829912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351512+0000","last_change":"2023-11-28T16:57:57.281906+0000","last_active":"2023-11-28T16:58:08.351512+0000","last_peered":"2023-11-28T16:58:08.351512+0000","last_clean":"2023-11-28T16:58:08.351512+0000","last_became_active":"2023-11-28T16:57:57.281593+0000","last_became_peered":"2023-11-28T16:57:57.281593+0000","last_unstale":"2023-11-28T16:58:08.351512+0000","last_undegraded":"2023-11-28T16:58:08.351512+0000","last_fullsized":"2023-11-28T16:58:08.351512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348193+0000","last_change":"2023-11-28T16:57:56.301479+0000","last_active":"2023-11-28T16:58:08.348193+0000","last_peered":"2023-11-28T16:58:08.348193+0000","last_clean":"2023-11-28T16:58:08.348193+0000","last_became_active":"2023-11-28T16:57:56.301262+0000","last_became_peered":"2023-11-28T16:57:56.301262+0000","last_unstale":"2023-11-28T16:58:08.348193+0000","last_undegraded":"2023-11-28T16:58:08.348193+0000","last_fullsized":"2023-11-28T16:58:08.348193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:34.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353707+0000","last_change":"2023-11-28T16:58:09.353707+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353707+0000","last_undegraded":"2023-11-28T16:58:09.353707+0000","last_fullsized":"2023-11-28T16:58:09.353707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377040+0000","last_change":"2023-11-28T16:58:09.371624+0000","last_active":"2023-11-28T16:58:09.377040+0000","last_peered":"2023-11-28T16:58:09.377040+0000","last_clean":"2023-11-28T16:58:09.377040+0000","last_became_active":"2023-11-28T16:58:09.371252+0000","last_became_peered":"2023-11-28T16:58:09.371252+0000","last_unstale":"2023-11-28T16:58:09.377040+0000","last_undegraded":"2023-11-28T16:58:09.377040+0000","last_fullsized":"2023-11-28T16:58:09.377040+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:26.069648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344166+0000","last_change":"2023-11-28T16:57:57.296485+0000","last_active":"2023-11-28T16:58:08.344166+0000","last_peered":"2023-11-28T16:58:08.344166+0000","last_clean":"2023-11-28T16:58:08.344166+0000","last_became_active":"2023-11-28T16:57:57.296210+0000","last_became_peered":"2023-11-28T16:57:57.296210+0000","last_unstale":"2023-11-28T16:58:08.344166+0000","last_undegraded":"2023-11-28T16:58:08.344166+0000","last_fullsized":"2023-11-28T16:58:08.344166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344356+0000","last_change":"2023-11-28T16:57:56.284952+0000","last_active":"2023-11-28T16:58:08.344356+0000","last_peered":"2023-11-28T16:58:08.344356+0000","last_clean":"2023-11-28T16:58:08.344356+0000","last_became_active":"2023-11-28T16:57:56.284663+0000","last_became_peered":"2023-11-28T16:57:56.284663+0000","last_unstale":"2023-11-28T16:58:08.344356+0000","last_undegraded":"2023-11-28T16:58:08.344356+0000","last_fullsized":"2023-11-28T16:58:08.344356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354275+0000","last_change":"2023-11-28T16:58:09.354275+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354275+0000","last_undegraded":"2023-11-28T16:58:09.354275+0000","last_fullsized":"2023-11-28T16:58:09.354275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382241+0000","last_change":"2023-11-28T16:58:09.379004+0000","last_active":"2023-11-28T16:58:09.382241+0000","last_peered":"2023-11-28T16:58:09.382241+0000","last_clean":"2023-11-28T16:58:09.382241+0000","last_became_active":"2023-11-28T16:58:09.378364+0000","last_became_peered":"2023-11-28T16:58:09.378364+0000","last_unstale":"2023-11-28T16:58:09.382241+0000","last_undegraded":"2023-11-28T16:58:09.382241+0000","last_fullsized":"2023-11-28T16:58:09.382241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:46.294429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344175+0000","last_change":"2023-11-28T16:57:57.299545+0000","last_active":"2023-11-28T16:58:08.344175+0000","last_peered":"2023-11-28T16:58:08.344175+0000","last_clean":"2023-11-28T16:58:08.344175+0000","last_became_active":"2023-11-28T16:57:57.298953+0000","last_became_peered":"2023-11-28T16:57:57.298953+0000","last_unstale":"2023-11-28T16:58:08.344175+0000","last_undegraded":"2023-11-28T16:58:08.344175+0000","last_fullsized":"2023-11-28T16:58:08.344175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352218+0000","last_change":"2023-11-28T16:57:56.293038+0000","last_active":"2023-11-28T16:58:08.352218+0000","last_peered":"2023-11-28T16:58:08.352218+0000","last_clean":"2023-11-28T16:58:08.352218+0000","last_became_active":"2023-11-28T16:57:56.292443+0000","last_became_peered":"2023-11-28T16:57:56.292443+0000","last_unstale":"2023-11-28T16:58:08.352218+0000","last_undegraded":"2023-11-28T16:58:08.352218+0000","last_fullsized":"2023-11-28T16:58:08.352218+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354538+0000","last_change":"2023-11-28T16:58:09.354538+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354538+0000","last_undegraded":"2023-11-28T16:58:09.354538+0000","last_fullsized":"2023-11-28T16:58:09.354538+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.369520+0000","last_change":"2023-11-28T16:58:09.366910+0000","last_active":"2023-11-28T16:58:09.369520+0000","last_peered":"2023-11-28T16:58:09.369520+0000","last_clean":"2023-11-28T16:58:09.369520+0000","last_became_active":"2023-11-28T16:58:09.366580+0000","last_became_peered":"2023-11-28T16:58:09.366580+0000","last_unstale":"2023-11-28T16:58:09.369520+0000","last_undegraded":"2023-11-28T16:58:09.369520+0000","last_fullsized":"2023-11-28T16:58:09.369520+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:36.341102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347393+0000","last_change":"2023-11-28T16:57:57.307182+0000","last_active":"2023-11-28T16:58:08.347393+0000","last_peered":"2023-11-28T16:58:08.347393+0000","last_clean":"2023-11-28T16:58:08.347393+0000","last_became_active":"2023-11-28T16:57:57.305143+0000","last_became_peered":"2023-11-28T16:57:57.305143+0000","last_unstale":"2023-11-28T16:58:08.347393+0000","last_undegraded":"2023-11-28T16:58:08.347393+0000","last_fullsized":"2023-11-28T16:58:08.347393+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:16.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345811+0000","last_change":"2023-11-28T16:57:56.298135+0000","last_active":"2023-11-28T16:58:08.345811+0000","last_peered":"2023-11-28T16:58:08.345811+0000","last_clean":"2023-11-28T16:58:08.345811+0000","last_became_active":"2023-11-28T16:57:56.297267+0000","last_became_peered":"2023-11-28T16:57:56.297267+0000","last_unstale":"2023-11-28T16:58:08.345811+0000","last_undegraded":"2023-11-28T16:58:08.345811+0000","last_fullsized":"2023-11-28T16:58:08.345811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:46.168912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346285+0000","last_change":"2023-11-28T16:58:09.346285+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346285+0000","last_undegraded":"2023-11-28T16:58:09.346285+0000","last_fullsized":"2023-11-28T16:58:09.346285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382585+0000","last_change":"2023-11-28T16:58:09.379828+0000","last_active":"2023-11-28T16:58:09.382585+0000","last_peered":"2023-11-28T16:58:09.382585+0000","last_clean":"2023-11-28T16:58:09.382585+0000","last_became_active":"2023-11-28T16:58:09.378437+0000","last_became_peered":"2023-11-28T16:58:09.378437+0000","last_unstale":"2023-11-28T16:58:09.382585+0000","last_undegraded":"2023-11-28T16:58:09.382585+0000","last_fullsized":"2023-11-28T16:58:09.382585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:58.274818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347680+0000","last_change":"2023-11-28T16:57:57.310944+0000","last_active":"2023-11-28T16:58:08.347680+0000","last_peered":"2023-11-28T16:58:08.347680+0000","last_clean":"2023-11-28T16:58:08.347680+0000","last_became_active":"2023-11-28T16:57:57.306481+0000","last_became_peered":"2023-11-28T16:57:57.306481+0000","last_unstale":"2023-11-28T16:58:08.347680+0000","last_undegraded":"2023-11-28T16:58:08.347680+0000","last_fullsized":"2023-11-28T16:58:08.347680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.181027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343825+0000","last_change":"2023-11-28T16:57:56.294742+0000","last_active":"2023-11-28T16:58:08.343825+0000","last_peered":"2023-11-28T16:58:08.343825+0000","last_clean":"2023-11-28T16:58:08.343825+0000","last_became_active":"2023-11-28T16:57:56.294263+0000","last_became_peered":"2023-11-28T16:57:56.294263+0000","last_unstale":"2023-11-28T16:58:08.343825+0000","last_undegraded":"2023-11-28T16:58:08.343825+0000","last_fullsized":"2023-11-28T16:58:08.343825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352949+0000","last_change":"2023-11-28T16:58:09.352949+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352949+0000","last_undegraded":"2023-11-28T16:58:09.352949+0000","last_fullsized":"2023-11-28T16:58:09.352949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373030+0000","last_change":"2023-11-28T16:58:09.370886+0000","last_active":"2023-11-28T16:58:09.373030+0000","last_peered":"2023-11-28T16:58:09.373030+0000","last_clean":"2023-11-28T16:58:09.373030+0000","last_became_active":"2023-11-28T16:58:09.370548+0000","last_became_peered":"2023-11-28T16:58:09.370548+0000","last_unstale":"2023-11-28T16:58:09.373030+0000","last_undegraded":"2023-11-28T16:58:09.373030+0000","last_fullsized":"2023-11-28T16:58:09.373030+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:44.486464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351909+0000","last_change":"2023-11-28T16:57:57.303350+0000","last_active":"2023-11-28T16:58:08.351909+0000","last_peered":"2023-11-28T16:58:08.351909+0000","last_clean":"2023-11-28T16:58:08.351909+0000","last_became_active":"2023-11-28T16:57:57.302817+0000","last_became_peered":"2023-11-28T16:57:57.302817+0000","last_unstale":"2023-11-28T16:58:08.351909+0000","last_undegraded":"2023-11-28T16:58:08.351909+0000","last_fullsized":"2023-11-28T16:58:08.351909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:18.750912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350712+0000","last_change":"2023-11-28T16:57:56.289134+0000","last_active":"2023-11-28T16:58:08.350712+0000","last_peered":"2023-11-28T16:58:08.350712+0000","last_clean":"2023-11-28T16:58:08.350712+0000","last_became_active":"2023-11-28T16:57:56.288857+0000","last_became_peered":"2023-11-28T16:57:56.288857+0000","last_unstale":"2023-11-28T16:58:08.350712+0000","last_undegraded":"2023-11-28T16:58:08.350712+0000","last_fullsized":"2023-11-28T16:58:08.350712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:02.295044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.350692+0000","last_change":"2023-11-28T16:58:09.350692+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.350692+0000","last_undegraded":"2023-11-28T16:58:09.350692+0000","last_fullsized":"2023-11-28T16:58:09.350692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377079+0000","last_change":"2023-11-28T16:58:09.370650+0000","last_active":"2023-11-28T16:58:09.377079+0000","last_peered":"2023-11-28T16:58:09.377079+0000","last_clean":"2023-11-28T16:58:09.377079+0000","last_became_active":"2023-11-28T16:58:09.370449+0000","last_became_peered":"2023-11-28T16:58:09.370449+0000","last_unstale":"2023-11-28T16:58:09.377079+0000","last_undegraded":"2023-11-28T16:58:09.377079+0000","last_fullsized":"2023-11-28T16:58:09.377079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:44:06.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347398+0000","last_change":"2023-11-28T16:57:57.296614+0000","last_active":"2023-11-28T16:58:08.347398+0000","last_peered":"2023-11-28T16:58:08.347398+0000","last_clean":"2023-11-28T16:58:08.347398+0000","last_became_active":"2023-11-28T16:57:57.296296+0000","last_became_peered":"2023-11-28T16:57:57.296296+0000","last_unstale":"2023-11-28T16:58:08.347398+0000","last_undegraded":"2023-11-28T16:58:08.347398+0000","last_fullsized":"2023-11-28T16:58:08.347398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:24.731578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345160+0000","last_change":"2023-11-28T16:57:56.297579+0000","last_active":"2023-11-28T16:58:08.345160+0000","last_peered":"2023-11-28T16:58:08.345160+0000","last_clean":"2023-11-28T16:58:08.345160+0000","last_became_active":"2023-11-28T16:57:56.297237+0000","last_became_peered":"2023-11-28T16:57:56.297237+0000","last_unstale":"2023-11-28T16:58:08.345160+0000","last_undegraded":"2023-11-28T16:58:08.345160+0000","last_fullsized":"2023-11-28T16:58:08.345160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:53.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362168+0000","last_change":"2023-11-28T16:58:09.362168+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362168+0000","last_undegraded":"2023-11-28T16:58:09.362168+0000","last_fullsized":"2023-11-28T16:58:09.362168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373165+0000","last_change":"2023-11-28T16:58:09.371255+0000","last_active":"2023-11-28T16:58:09.373165+0000","last_peered":"2023-11-28T16:58:09.373165+0000","last_clean":"2023-11-28T16:58:09.373165+0000","last_became_active":"2023-11-28T16:58:09.368332+0000","last_became_peered":"2023-11-28T16:58:09.368332+0000","last_unstale":"2023-11-28T16:58:09.373165+0000","last_undegraded":"2023-11-28T16:58:09.373165+0000","last_fullsized":"2023-11-28T16:58:09.373165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:02.313058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345981+0000","last_change":"2023-11-28T16:57:57.288341+0000","last_active":"2023-11-28T16:58:08.345981+0000","last_peered":"2023-11-28T16:58:08.345981+0000","last_clean":"2023-11-28T16:58:08.345981+0000","last_became_active":"2023-11-28T16:57:57.286946+0000","last_became_peered":"2023-11-28T16:57:57.286946+0000","last_unstale":"2023-11-28T16:58:08.345981+0000","last_undegraded":"2023-11-28T16:58:08.345981+0000","last_fullsized":"2023-11-28T16:58:08.345981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:03.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354723+0000","last_change":"2023-11-28T16:57:56.303238+0000","last_active":"2023-11-28T16:58:08.354723+0000","last_peered":"2023-11-28T16:58:08.354723+0000","last_clean":"2023-11-28T16:58:08.354723+0000","last_became_active":"2023-11-28T16:57:56.302991+0000","last_became_peered":"2023-11-28T16:57:56.302991+0000","last_unstale":"2023-11-28T16:58:08.354723+0000","last_undegraded":"2023-11-28T16:58:08.354723+0000","last_fullsized":"2023-11-28T16:58:08.354723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362301+0000","last_change":"2023-11-28T16:58:09.362301+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362301+0000","last_undegraded":"2023-11-28T16:58:09.362301+0000","last_fullsized":"2023-11-28T16:58:09.362301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381945+0000","last_change":"2023-11-28T16:58:09.380840+0000","last_active":"2023-11-28T16:58:09.381945+0000","last_peered":"2023-11-28T16:58:09.381945+0000","last_clean":"2023-11-28T16:58:09.381945+0000","last_became_active":"2023-11-28T16:58:09.380365+0000","last_became_peered":"2023-11-28T16:58:09.380365+0000","last_unstale":"2023-11-28T16:58:09.381945+0000","last_undegraded":"2023-11-28T16:58:09.381945+0000","last_fullsized":"2023-11-28T16:58:09.381945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:15.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354639+0000","last_change":"2023-11-28T16:57:57.292344+0000","last_active":"2023-11-28T16:58:08.354639+0000","last_peered":"2023-11-28T16:58:08.354639+0000","last_clean":"2023-11-28T16:58:08.354639+0000","last_became_active":"2023-11-28T16:57:57.291977+0000","last_became_peered":"2023-11-28T16:57:57.291977+0000","last_unstale":"2023-11-28T16:58:08.354639+0000","last_undegraded":"2023-11-28T16:58:08.354639+0000","last_fullsized":"2023-11-28T16:58:08.354639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:35.065157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348241+0000","last_change":"2023-11-28T16:57:56.300060+0000","last_active":"2023-11-28T16:58:08.348241+0000","last_peered":"2023-11-28T16:58:08.348241+0000","last_clean":"2023-11-28T16:58:08.348241+0000","last_became_active":"2023-11-28T16:57:56.299780+0000","last_became_peered":"2023-11-28T16:57:56.299780+0000","last_unstale":"2023-11-28T16:58:08.348241+0000","last_undegraded":"2023-11-28T16:58:08.348241+0000","last_fullsized":"2023-11-28T16:58:08.348241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:18.071987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355503+0000","last_change":"2023-11-28T16:58:09.355503+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355503+0000","last_undegraded":"2023-11-28T16:58:09.355503+0000","last_fullsized":"2023-11-28T16:58:09.355503+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382214+0000","last_change":"2023-11-28T16:58:09.374674+0000","last_active":"2023-11-28T16:58:09.382214+0000","last_peered":"2023-11-28T16:58:09.382214+0000","last_clean":"2023-11-28T16:58:09.382214+0000","last_became_active":"2023-11-28T16:58:09.374379+0000","last_became_peered":"2023-11-28T16:58:09.374379+0000","last_unstale":"2023-11-28T16:58:09.382214+0000","last_undegraded":"2023-11-28T16:58:09.382214+0000","last_fullsized":"2023-11-28T16:58:09.382214+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:34.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351116+0000","last_change":"2023-11-28T16:57:57.291393+0000","last_active":"2023-11-28T16:58:08.351116+0000","last_peered":"2023-11-28T16:58:08.351116+0000","last_clean":"2023-11-28T16:58:08.351116+0000","last_became_active":"2023-11-28T16:57:57.290974+0000","last_became_peered":"2023-11-28T16:57:57.290974+0000","last_unstale":"2023-11-28T16:58:08.351116+0000","last_undegraded":"2023-11-28T16:58:08.351116+0000","last_fullsized":"2023-11-28T16:58:08.351116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:47.176671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349926+0000","last_change":"2023-11-28T16:57:56.293494+0000","last_active":"2023-11-28T16:58:08.349926+0000","last_peered":"2023-11-28T16:58:08.349926+0000","last_clean":"2023-11-28T16:58:08.349926+0000","last_became_active":"2023-11-28T16:57:56.293071+0000","last_became_peered":"2023-11-28T16:57:56.293071+0000","last_unstale":"2023-11-28T16:58:08.349926+0000","last_undegraded":"2023-11-28T16:58:08.349926+0000","last_fullsized":"2023-11-28T16:58:08.349926+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:42.043041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354734+0000","last_change":"2023-11-28T16:58:09.354734+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354734+0000","last_undegraded":"2023-11-28T16:58:09.354734+0000","last_fullsized":"2023-11-28T16:58:09.354734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382996+0000","last_change":"2023-11-28T16:58:09.377961+0000","last_active":"2023-11-28T16:58:09.382996+0000","last_peered":"2023-11-28T16:58:09.382996+0000","last_clean":"2023-11-28T16:58:09.382996+0000","last_became_active":"2023-11-28T16:58:09.377333+0000","last_became_peered":"2023-11-28T16:58:09.377333+0000","last_unstale":"2023-11-28T16:58:09.382996+0000","last_undegraded":"2023-11-28T16:58:09.382996+0000","last_fullsized":"2023-11-28T16:58:09.382996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:36.341102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349756+0000","last_change":"2023-11-28T16:57:57.293148+0000","last_active":"2023-11-28T16:58:08.349756+0000","last_peered":"2023-11-28T16:58:08.349756+0000","last_clean":"2023-11-28T16:58:08.349756+0000","last_became_active":"2023-11-28T16:57:57.292674+0000","last_became_peered":"2023-11-28T16:57:57.292674+0000","last_unstale":"2023-11-28T16:58:08.349756+0000","last_undegraded":"2023-11-28T16:58:08.349756+0000","last_fullsized":"2023-11-28T16:58:08.349756+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345673+0000","last_change":"2023-11-28T16:57:56.289047+0000","last_active":"2023-11-28T16:58:08.345673+0000","last_peered":"2023-11-28T16:58:08.345673+0000","last_clean":"2023-11-28T16:58:08.345673+0000","last_became_active":"2023-11-28T16:57:56.288333+0000","last_became_peered":"2023-11-28T16:57:56.288333+0000","last_unstale":"2023-11-28T16:58:08.345673+0000","last_undegraded":"2023-11-28T16:58:08.345673+0000","last_fullsized":"2023-11-28T16:58:08.345673+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:55.749727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346336+0000","last_change":"2023-11-28T16:58:09.346336+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346336+0000","last_undegraded":"2023-11-28T16:58:09.346336+0000","last_fullsized":"2023-11-28T16:58:09.346336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.376700+0000","last_change":"2023-11-28T16:58:09.369628+0000","last_active":"2023-11-28T16:58:09.376700+0000","last_peered":"2023-11-28T16:58:09.376700+0000","last_clean":"2023-11-28T16:58:09.376700+0000","last_became_active":"2023-11-28T16:58:09.369340+0000","last_became_peered":"2023-11-28T16:58:09.369340+0000","last_unstale":"2023-11-28T16:58:09.376700+0000","last_undegraded":"2023-11-28T16:58:09.376700+0000","last_fullsized":"2023-11-28T16:58:09.376700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:21.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351274+0000","last_change":"2023-11-28T16:57:57.306068+0000","last_active":"2023-11-28T16:58:08.351274+0000","last_peered":"2023-11-28T16:58:08.351274+0000","last_clean":"2023-11-28T16:58:08.351274+0000","last_became_active":"2023-11-28T16:57:57.305881+0000","last_became_peered":"2023-11-28T16:57:57.305881+0000","last_unstale":"2023-11-28T16:58:08.351274+0000","last_undegraded":"2023-11-28T16:58:08.351274+0000","last_fullsized":"2023-11-28T16:58:08.351274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:39.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347714+0000","last_change":"2023-11-28T16:57:56.297847+0000","last_active":"2023-11-28T16:58:08.347714+0000","last_peered":"2023-11-28T16:58:08.347714+0000","last_clean":"2023-11-28T16:58:08.347714+0000","last_became_active":"2023-11-28T16:57:56.297578+0000","last_became_peered":"2023-11-28T16:57:56.297578+0000","last_unstale":"2023-11-28T16:58:08.347714+0000","last_undegraded":"2023-11-28T16:58:08.347714+0000","last_fullsized":"2023-11-28T16:58:08.347714+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.329569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.363329+0000","last_change":"2023-11-28T16:58:09.363329+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.363329+0000","last_undegraded":"2023-11-28T16:58:09.363329+0000","last_fullsized":"2023-11-28T16:58:09.363329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.368283+0000","last_change":"2023-11-28T16:58:09.362708+0000","last_active":"2023-11-28T16:58:09.368283+0000","last_peered":"2023-11-28T16:58:09.368283+0000","last_clean":"2023-11-28T16:58:09.368283+0000","last_became_active":"2023-11-28T16:58:09.362441+0000","last_became_peered":"2023-11-28T16:58:09.362441+0000","last_unstale":"2023-11-28T16:58:09.368283+0000","last_undegraded":"2023-11-28T16:58:09.368283+0000","last_fullsized":"2023-11-28T16:58:09.368283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:52.069042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350367+0000","last_change":"2023-11-28T16:57:57.295241+0000","last_active":"2023-11-28T16:58:08.350367+0000","last_peered":"2023-11-28T16:58:08.350367+0000","last_clean":"2023-11-28T16:58:08.350367+0000","last_became_active":"2023-11-28T16:57:57.295059+0000","last_became_peered":"2023-11-28T16:57:57.295059+0000","last_unstale":"2023-11-28T16:58:08.350367+0000","last_undegraded":"2023-11-28T16:58:08.350367+0000","last_fullsized":"2023-11-28T16:58:08.350367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.353743+0000","last_change":"2023-11-28T16:57:56.292527+0000","last_active":"2023-11-28T16:58:08.353743+0000","last_peered":"2023-11-28T16:58:08.353743+0000","last_clean":"2023-11-28T16:58:08.353743+0000","last_became_active":"2023-11-28T16:57:56.292280+0000","last_became_peered":"2023-11-28T16:57:56.292280+0000","last_unstale":"2023-11-28T16:58:08.353743+0000","last_undegraded":"2023-11-28T16:58:08.353743+0000","last_fullsized":"2023-11-28T16:58:08.353743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:36.146016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352850+0000","last_change":"2023-11-28T16:58:09.352850+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352850+0000","last_undegraded":"2023-11-28T16:58:09.352850+0000","last_fullsized":"2023-11-28T16:58:09.352850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373223+0000","last_change":"2023-11-28T16:58:09.370461+0000","last_active":"2023-11-28T16:58:09.373223+0000","last_peered":"2023-11-28T16:58:09.373223+0000","last_clean":"2023-11-28T16:58:09.373223+0000","last_became_active":"2023-11-28T16:58:09.370211+0000","last_became_peered":"2023-11-28T16:58:09.370211+0000","last_unstale":"2023-11-28T16:58:09.373223+0000","last_undegraded":"2023-11-28T16:58:09.373223+0000","last_fullsized":"2023-11-28T16:58:09.373223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:15.375230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345121+0000","last_change":"2023-11-28T16:57:57.292399+0000","last_active":"2023-11-28T16:58:08.345121+0000","last_peered":"2023-11-28T16:58:08.345121+0000","last_clean":"2023-11-28T16:58:08.345121+0000","last_became_active":"2023-11-28T16:57:57.291492+0000","last_became_peered":"2023-11-28T16:57:57.291492+0000","last_unstale":"2023-11-28T16:58:08.345121+0000","last_undegraded":"2023-11-28T16:58:08.345121+0000","last_fullsized":"2023-11-28T16:58:08.345121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350796+0000","last_change":"2023-11-28T16:57:56.288401+0000","last_active":"2023-11-28T16:58:08.350796+0000","last_peered":"2023-11-28T16:58:08.350796+0000","last_clean":"2023-11-28T16:58:08.350796+0000","last_became_active":"2023-11-28T16:57:56.288046+0000","last_became_peered":"2023-11-28T16:57:56.288046+0000","last_unstale":"2023-11-28T16:58:08.350796+0000","last_undegraded":"2023-11-28T16:58:08.350796+0000","last_fullsized":"2023-11-28T16:58:08.350796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:23.260917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354576+0000","last_change":"2023-11-28T16:58:09.354576+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354576+0000","last_undegraded":"2023-11-28T16:58:09.354576+0000","last_fullsized":"2023-11-28T16:58:09.354576+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.383025+0000","last_change":"2023-11-28T16:58:09.381709+0000","last_active":"2023-11-28T16:58:09.383025+0000","last_peered":"2023-11-28T16:58:09.383025+0000","last_clean":"2023-11-28T16:58:09.383025+0000","last_became_active":"2023-11-28T16:58:09.381442+0000","last_became_peered":"2023-11-28T16:58:09.381442+0000","last_unstale":"2023-11-28T16:58:09.383025+0000","last_undegraded":"2023-11-28T16:58:09.383025+0000","last_fullsized":"2023-11-28T16:58:09.383025+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:41.188588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349420+0000","last_change":"2023-11-28T16:57:57.300273+0000","last_active":"2023-11-28T16:58:08.349420+0000","last_peered":"2023-11-28T16:58:08.349420+0000","last_clean":"2023-11-28T16:58:08.349420+0000","last_became_active":"2023-11-28T16:57:57.300005+0000","last_became_peered":"2023-11-28T16:57:57.300005+0000","last_unstale":"2023-11-28T16:58:08.349420+0000","last_undegraded":"2023-11-28T16:58:08.349420+0000","last_fullsized":"2023-11-28T16:58:08.349420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348406+0000","last_change":"2023-11-28T16:57:56.297211+0000","last_active":"2023-11-28T16:58:08.348406+0000","last_peered":"2023-11-28T16:58:08.348406+0000","last_clean":"2023-11-28T16:58:08.348406+0000","last_became_active":"2023-11-28T16:57:56.296321+0000","last_became_peered":"2023-11-28T16:57:56.296321+0000","last_unstale":"2023-11-28T16:58:08.348406+0000","last_undegraded":"2023-11-28T16:58:08.348406+0000","last_fullsized":"2023-11-28T16:58:08.348406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355743+0000","last_change":"2023-11-28T16:58:09.355743+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355743+0000","last_undegraded":"2023-11-28T16:58:09.355743+0000","last_fullsized":"2023-11-28T16:58:09.355743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382085+0000","last_change":"2023-11-28T16:58:09.372355+0000","last_active":"2023-11-28T16:58:09.382085+0000","last_peered":"2023-11-28T16:58:09.382085+0000","last_clean":"2023-11-28T16:58:09.382085+0000","last_became_active":"2023-11-28T16:58:09.372007+0000","last_became_peered":"2023-11-28T16:58:09.372007+0000","last_unstale":"2023-11-28T16:58:09.382085+0000","last_undegraded":"2023-11-28T16:58:09.382085+0000","last_fullsized":"2023-11-28T16:58:09.382085+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:15.375230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350796+0000","last_change":"2023-11-28T16:57:57.294684+0000","last_active":"2023-11-28T16:58:08.350796+0000","last_peered":"2023-11-28T16:58:08.350796+0000","last_clean":"2023-11-28T16:58:08.350796+0000","last_became_active":"2023-11-28T16:57:57.294339+0000","last_became_peered":"2023-11-28T16:57:57.294339+0000","last_unstale":"2023-11-28T16:58:08.350796+0000","last_undegraded":"2023-11-28T16:58:08.350796+0000","last_fullsized":"2023-11-28T16:58:08.350796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:19.079746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348704+0000","last_change":"2023-11-28T16:57:56.302265+0000","last_active":"2023-11-28T16:58:08.348704+0000","last_peered":"2023-11-28T16:58:08.348704+0000","last_clean":"2023-11-28T16:58:08.348704+0000","last_became_active":"2023-11-28T16:57:56.301960+0000","last_became_peered":"2023-11-28T16:57:56.301960+0000","last_unstale":"2023-11-28T16:58:08.348704+0000","last_undegraded":"2023-11-28T16:58:08.348704+0000","last_fullsized":"2023-11-28T16:58:08.348704+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:36.131374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355335+0000","last_change":"2023-11-28T16:58:09.355335+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355335+0000","last_undegraded":"2023-11-28T16:58:09.355335+0000","last_fullsized":"2023-11-28T16:58:09.355335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.365065+0000","last_change":"2023-11-28T16:58:09.358618+0000","last_active":"2023-11-28T16:58:09.365065+0000","last_peered":"2023-11-28T16:58:09.365065+0000","last_clean":"2023-11-28T16:58:09.365065+0000","last_became_active":"2023-11-28T16:58:09.358326+0000","last_became_peered":"2023-11-28T16:58:09.358326+0000","last_unstale":"2023-11-28T16:58:09.365065+0000","last_undegraded":"2023-11-28T16:58:09.365065+0000","last_fullsized":"2023-11-28T16:58:09.365065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354317+0000","last_change":"2023-11-28T16:57:57.296609+0000","last_active":"2023-11-28T16:58:08.354317+0000","last_peered":"2023-11-28T16:58:08.354317+0000","last_clean":"2023-11-28T16:58:08.354317+0000","last_became_active":"2023-11-28T16:57:57.296304+0000","last_became_peered":"2023-11-28T16:57:57.296304+0000","last_unstale":"2023-11-28T16:58:08.354317+0000","last_undegraded":"2023-11-28T16:58:08.354317+0000","last_fullsized":"2023-11-28T16:58:08.354317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:27.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344293+0000","last_change":"2023-11-28T16:57:56.296905+0000","last_active":"2023-11-28T16:58:08.344293+0000","last_peered":"2023-11-28T16:58:08.344293+0000","last_clean":"2023-11-28T16:58:08.344293+0000","last_became_active":"2023-11-28T16:57:56.295819+0000","last_became_peered":"2023-11-28T16:57:56.295819+0000","last_unstale":"2023-11-28T16:58:08.344293+0000","last_undegraded":"2023-11-28T16:58:08.344293+0000","last_fullsized":"2023-11-28T16:58:08.344293+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.350168+0000","last_change":"2023-11-28T16:58:09.350168+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.350168+0000","last_undegraded":"2023-11-28T16:58:09.350168+0000","last_fullsized":"2023-11-28T16:58:09.350168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382384+0000","last_change":"2023-11-28T16:58:09.375035+0000","last_active":"2023-11-28T16:58:09.382384+0000","last_peered":"2023-11-28T16:58:09.382384+0000","last_clean":"2023-11-28T16:58:09.382384+0000","last_became_active":"2023-11-28T16:58:09.374689+0000","last_became_peered":"2023-11-28T16:58:09.374689+0000","last_unstale":"2023-11-28T16:58:09.382384+0000","last_undegraded":"2023-11-28T16:58:09.382384+0000","last_fullsized":"2023-11-28T16:58:09.382384+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:05.414794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347855+0000","last_change":"2023-11-28T16:57:57.297238+0000","last_active":"2023-11-28T16:58:08.347855+0000","last_peered":"2023-11-28T16:58:08.347855+0000","last_clean":"2023-11-28T16:58:08.347855+0000","last_became_active":"2023-11-28T16:57:57.296895+0000","last_became_peered":"2023-11-28T16:57:57.296895+0000","last_unstale":"2023-11-28T16:58:08.347855+0000","last_undegraded":"2023-11-28T16:58:08.347855+0000","last_fullsized":"2023-11-28T16:58:08.347855+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:47.232224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351979+0000","last_change":"2023-11-28T16:57:56.292453+0000","last_active":"2023-11-28T16:58:08.351979+0000","last_peered":"2023-11-28T16:58:08.351979+0000","last_clean":"2023-11-28T16:58:08.351979+0000","last_became_active":"2023-11-28T16:57:56.292147+0000","last_became_peered":"2023-11-28T16:57:56.292147+0000","last_unstale":"2023-11-28T16:58:08.351979+0000","last_undegraded":"2023-11-28T16:58:08.351979+0000","last_fullsized":"2023-11-28T16:58:08.351979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351588+0000","last_change":"2023-11-28T16:58:09.351588+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351588+0000","last_undegraded":"2023-11-28T16:58:09.351588+0000","last_fullsized":"2023-11-28T16:58:09.351588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382180+0000","last_change":"2023-11-28T16:58:09.374106+0000","last_active":"2023-11-28T16:58:09.382180+0000","last_peered":"2023-11-28T16:58:09.382180+0000","last_clean":"2023-11-28T16:58:09.382180+0000","last_became_active":"2023-11-28T16:58:09.373822+0000","last_became_peered":"2023-11-28T16:58:09.373822+0000","last_unstale":"2023-11-28T16:58:09.382180+0000","last_undegraded":"2023-11-28T16:58:09.382180+0000","last_fullsized":"2023-11-28T16:58:09.382180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:39.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349836+0000","last_change":"2023-11-28T16:57:57.292951+0000","last_active":"2023-11-28T16:58:08.349836+0000","last_peered":"2023-11-28T16:58:08.349836+0000","last_clean":"2023-11-28T16:58:08.349836+0000","last_became_active":"2023-11-28T16:57:57.292254+0000","last_became_peered":"2023-11-28T16:57:57.292254+0000","last_unstale":"2023-11-28T16:58:08.349836+0000","last_undegraded":"2023-11-28T16:58:08.349836+0000","last_fullsized":"2023-11-28T16:58:08.349836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:07.921821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344263+0000","last_change":"2023-11-28T16:57:56.301392+0000","last_active":"2023-11-28T16:58:08.344263+0000","last_peered":"2023-11-28T16:58:08.344263+0000","last_clean":"2023-11-28T16:58:08.344263+0000","last_became_active":"2023-11-28T16:57:56.300939+0000","last_became_peered":"2023-11-28T16:57:56.300939+0000","last_unstale":"2023-11-28T16:58:08.344263+0000","last_undegraded":"2023-11-28T16:58:08.344263+0000","last_fullsized":"2023-11-28T16:58:08.344263+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:05.783524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352898+0000","last_change":"2023-11-28T16:58:09.352898+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352898+0000","last_undegraded":"2023-11-28T16:58:09.352898+0000","last_fullsized":"2023-11-28T16:58:09.352898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382829+0000","last_change":"2023-11-28T16:58:09.381243+0000","last_active":"2023-11-28T16:58:09.382829+0000","last_peered":"2023-11-28T16:58:09.382829+0000","last_clean":"2023-11-28T16:58:09.382829+0000","last_became_active":"2023-11-28T16:58:09.381035+0000","last_became_peered":"2023-11-28T16:58:09.381035+0000","last_unstale":"2023-11-28T16:58:09.382829+0000","last_undegraded":"2023-11-28T16:58:09.382829+0000","last_fullsized":"2023-11-28T16:58:09.382829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351364+0000","last_change":"2023-11-28T16:57:57.304252+0000","last_active":"2023-11-28T16:58:08.351364+0000","last_peered":"2023-11-28T16:58:08.351364+0000","last_clean":"2023-11-28T16:58:08.351364+0000","last_became_active":"2023-11-28T16:57:57.303963+0000","last_became_peered":"2023-11-28T16:57:57.303963+0000","last_unstale":"2023-11-28T16:58:08.351364+0000","last_undegraded":"2023-11-28T16:58:08.351364+0000","last_fullsized":"2023-11-28T16:58:08.351364+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:08.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347804+0000","last_change":"2023-11-28T16:57:56.291678+0000","last_active":"2023-11-28T16:58:08.347804+0000","last_peered":"2023-11-28T16:58:08.347804+0000","last_clean":"2023-11-28T16:58:08.347804+0000","last_became_active":"2023-11-28T16:57:56.289787+0000","last_became_peered":"2023-11-28T16:57:56.289787+0000","last_unstale":"2023-11-28T16:58:08.347804+0000","last_undegraded":"2023-11-28T16:58:08.347804+0000","last_fullsized":"2023-11-28T16:58:08.347804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:08.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353794+0000","last_change":"2023-11-28T16:58:09.353794+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353794+0000","last_undegraded":"2023-11-28T16:58:09.353794+0000","last_fullsized":"2023-11-28T16:58:09.353794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.378897+0000","last_change":"2023-11-28T16:58:09.376563+0000","last_active":"2023-11-28T16:58:09.378897+0000","last_peered":"2023-11-28T16:58:09.378897+0000","last_clean":"2023-11-28T16:58:09.378897+0000","last_became_active":"2023-11-28T16:58:09.376234+0000","last_became_peered":"2023-11-28T16:58:09.376234+0000","last_unstale":"2023-11-28T16:58:09.378897+0000","last_undegraded":"2023-11-28T16:58:09.378897+0000","last_fullsized":"2023-11-28T16:58:09.378897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343599+0000","last_change":"2023-11-28T16:57:57.294132+0000","last_active":"2023-11-28T16:58:08.343599+0000","last_peered":"2023-11-28T16:58:08.343599+0000","last_clean":"2023-11-28T16:58:08.343599+0000","last_became_active":"2023-11-28T16:57:57.293808+0000","last_became_peered":"2023-11-28T16:57:57.293808+0000","last_unstale":"2023-11-28T16:58:08.343599+0000","last_undegraded":"2023-11-28T16:58:08.343599+0000","last_fullsized":"2023-11-28T16:58:08.343599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351032+0000","last_change":"2023-11-28T16:57:56.299832+0000","last_active":"2023-11-28T16:58:08.351032+0000","last_peered":"2023-11-28T16:58:08.351032+0000","last_clean":"2023-11-28T16:58:08.351032+0000","last_became_active":"2023-11-28T16:57:56.299505+0000","last_became_peered":"2023-11-28T16:57:56.299505+0000","last_unstale":"2023-11-28T16:58:08.351032+0000","last_undegraded":"2023-11-28T16:58:08.351032+0000","last_fullsized":"2023-11-28T16:58:08.351032+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:26.104747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359572+0000","last_change":"2023-11-28T16:58:09.359572+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359572+0000","last_undegraded":"2023-11-28T16:58:09.359572+0000","last_fullsized":"2023-11-28T16:58:09.359572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377101+0000","last_change":"2023-11-28T16:58:09.370643+0000","last_active":"2023-11-28T16:58:09.377101+0000","last_peered":"2023-11-28T16:58:09.377101+0000","last_clean":"2023-11-28T16:58:09.377101+0000","last_became_active":"2023-11-28T16:58:09.370427+0000","last_became_peered":"2023-11-28T16:58:09.370427+0000","last_unstale":"2023-11-28T16:58:09.377101+0000","last_undegraded":"2023-11-28T16:58:09.377101+0000","last_fullsized":"2023-11-28T16:58:09.377101+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:19.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343630+0000","last_change":"2023-11-28T16:57:57.294705+0000","last_active":"2023-11-28T16:58:08.343630+0000","last_peered":"2023-11-28T16:58:08.343630+0000","last_clean":"2023-11-28T16:58:08.343630+0000","last_became_active":"2023-11-28T16:57:57.294386+0000","last_became_peered":"2023-11-28T16:57:57.294386+0000","last_unstale":"2023-11-28T16:58:08.343630+0000","last_undegraded":"2023-11-28T16:58:08.343630+0000","last_fullsized":"2023-11-28T16:58:08.343630+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350509+0000","last_change":"2023-11-28T16:57:56.303059+0000","last_active":"2023-11-28T16:58:08.350509+0000","last_peered":"2023-11-28T16:58:08.350509+0000","last_clean":"2023-11-28T16:58:08.350509+0000","last_became_active":"2023-11-28T16:57:56.302716+0000","last_became_peered":"2023-11-28T16:57:56.302716+0000","last_unstale":"2023-11-28T16:58:08.350509+0000","last_undegraded":"2023-11-28T16:58:08.350509+0000","last_fullsized":"2023-11-28T16:58:08.350509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351550+0000","last_change":"2023-11-28T16:58:09.351550+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351550+0000","last_undegraded":"2023-11-28T16:58:09.351550+0000","last_fullsized":"2023-11-28T16:58:09.351550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381585+0000","last_change":"2023-11-28T16:58:09.379068+0000","last_active":"2023-11-28T16:58:09.381585+0000","last_peered":"2023-11-28T16:58:09.381585+0000","last_clean":"2023-11-28T16:58:09.381585+0000","last_became_active":"2023-11-28T16:58:09.378744+0000","last_became_peered":"2023-11-28T16:58:09.378744+0000","last_unstale":"2023-11-28T16:58:09.381585+0000","last_undegraded":"2023-11-28T16:58:09.381585+0000","last_fullsized":"2023-11-28T16:58:09.381585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:16.766683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354622+0000","last_change":"2023-11-28T16:57:57.310134+0000","last_active":"2023-11-28T16:58:08.354622+0000","last_peered":"2023-11-28T16:58:08.354622+0000","last_clean":"2023-11-28T16:58:08.354622+0000","last_became_active":"2023-11-28T16:57:57.309858+0000","last_became_peered":"2023-11-28T16:57:57.309858+0000","last_unstale":"2023-11-28T16:58:08.354622+0000","last_undegraded":"2023-11-28T16:58:08.354622+0000","last_fullsized":"2023-11-28T16:58:08.354622+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:43.751157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351569+0000","last_change":"2023-11-28T16:57:56.289398+0000","last_active":"2023-11-28T16:58:08.351569+0000","last_peered":"2023-11-28T16:58:08.351569+0000","last_clean":"2023-11-28T16:58:08.351569+0000","last_became_active":"2023-11-28T16:57:56.289082+0000","last_became_peered":"2023-11-28T16:57:56.289082+0000","last_unstale":"2023-11-28T16:58:08.351569+0000","last_undegraded":"2023-11-28T16:58:08.351569+0000","last_fullsized":"2023-11-28T16:58:08.351569+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:34.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352786+0000","last_change":"2023-11-28T16:58:09.352786+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352786+0000","last_undegraded":"2023-11-28T16:58:09.352786+0000","last_fullsized":"2023-11-28T16:58:09.352786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.364251+0000","last_change":"2023-11-28T16:58:09.358558+0000","last_active":"2023-11-28T16:58:09.364251+0000","last_peered":"2023-11-28T16:58:09.364251+0000","last_clean":"2023-11-28T16:58:09.364251+0000","last_became_active":"2023-11-28T16:58:09.358275+0000","last_became_peered":"2023-11-28T16:58:09.358275+0000","last_unstale":"2023-11-28T16:58:09.364251+0000","last_undegraded":"2023-11-28T16:58:09.364251+0000","last_fullsized":"2023-11-28T16:58:09.364251+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:58.060491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354414+0000","last_change":"2023-11-28T16:57:57.302840+0000","last_active":"2023-11-28T16:58:08.354414+0000","last_peered":"2023-11-28T16:58:08.354414+0000","last_clean":"2023-11-28T16:58:08.354414+0000","last_became_active":"2023-11-28T16:57:57.302446+0000","last_became_peered":"2023-11-28T16:57:57.302446+0000","last_unstale":"2023-11-28T16:58:08.354414+0000","last_undegraded":"2023-11-28T16:58:08.354414+0000","last_fullsized":"2023-11-28T16:58:08.354414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:06.791283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344352+0000","last_change":"2023-11-28T16:57:56.295304+0000","last_active":"2023-11-28T16:58:08.344352+0000","last_peered":"2023-11-28T16:58:08.344352+0000","last_clean":"2023-11-28T16:58:08.344352+0000","last_became_active":"2023-11-28T16:57:56.295041+0000","last_became_peered":"2023-11-28T16:57:56.295041+0000","last_unstale":"2023-11-28T16:58:08.344352+0000","last_undegraded":"2023-11-28T16:58:08.344352+0000","last_fullsized":"2023-11-28T16:58:08.344352+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346442+0000","last_change":"2023-11-28T16:58:09.346442+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346442+0000","last_undegraded":"2023-11-28T16:58:09.346442+0000","last_fullsized":"2023-11-28T16:58:09.346442+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.383002+0000","last_change":"2023-11-28T16:58:09.378133+0000","last_active":"2023-11-28T16:58:09.383002+0000","last_peered":"2023-11-28T16:58:09.383002+0000","last_clean":"2023-11-28T16:58:09.383002+0000","last_became_active":"2023-11-28T16:58:09.377825+0000","last_became_peered":"2023-11-28T16:58:09.377825+0000","last_unstale":"2023-11-28T16:58:09.383002+0000","last_undegraded":"2023-11-28T16:58:09.383002+0000","last_fullsized":"2023-11-28T16:58:09.383002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:46.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351143+0000","last_change":"2023-11-28T16:57:57.285348+0000","last_active":"2023-11-28T16:58:08.351143+0000","last_peered":"2023-11-28T16:58:08.351143+0000","last_clean":"2023-11-28T16:58:08.351143+0000","last_became_active":"2023-11-28T16:57:57.285004+0000","last_became_peered":"2023-11-28T16:57:57.285004+0000","last_unstale":"2023-11-28T16:58:08.351143+0000","last_undegraded":"2023-11-28T16:58:08.351143+0000","last_fullsized":"2023-11-28T16:58:08.351143+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:56.757486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.355091+0000","last_change":"2023-11-28T16:57:56.291833+0000","last_active":"2023-11-28T16:58:08.355091+0000","last_peered":"2023-11-28T16:58:08.355091+0000","last_clean":"2023-11-28T16:58:08.355091+0000","last_became_active":"2023-11-28T16:57:56.291493+0000","last_became_peered":"2023-11-28T16:57:56.291493+0000","last_unstale":"2023-11-28T16:58:08.355091+0000","last_undegraded":"2023-11-28T16:58:08.355091+0000","last_fullsized":"2023-11-28T16:58:08.355091+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:36.485569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355205+0000","last_change":"2023-11-28T16:58:09.355205+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355205+0000","last_undegraded":"2023-11-28T16:58:09.355205+0000","last_fullsized":"2023-11-28T16:58:09.355205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.376688+0000","last_change":"2023-11-28T16:58:09.366789+0000","last_active":"2023-11-28T16:58:09.376688+0000","last_peered":"2023-11-28T16:58:09.376688+0000","last_clean":"2023-11-28T16:58:09.376688+0000","last_became_active":"2023-11-28T16:58:09.366058+0000","last_became_peered":"2023-11-28T16:58:09.366058+0000","last_unstale":"2023-11-28T16:58:09.376688+0000","last_undegraded":"2023-11-28T16:58:09.376688+0000","last_fullsized":"2023-11-28T16:58:09.376688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:47.534548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344265+0000","last_change":"2023-11-28T16:57:57.294725+0000","last_active":"2023-11-28T16:58:08.344265+0000","last_peered":"2023-11-28T16:58:08.344265+0000","last_clean":"2023-11-28T16:58:08.344265+0000","last_became_active":"2023-11-28T16:57:57.294368+0000","last_became_peered":"2023-11-28T16:57:57.294368+0000","last_unstale":"2023-11-28T16:58:08.344265+0000","last_undegraded":"2023-11-28T16:58:08.344265+0000","last_fullsized":"2023-11-28T16:58:08.344265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352261+0000","last_change":"2023-11-28T16:57:56.295240+0000","last_active":"2023-11-28T16:58:08.352261+0000","last_peered":"2023-11-28T16:58:08.352261+0000","last_clean":"2023-11-28T16:58:08.352261+0000","last_became_active":"2023-11-28T16:57:56.292758+0000","last_became_peered":"2023-11-28T16:57:56.292758+0000","last_unstale":"2023-11-28T16:58:08.352261+0000","last_undegraded":"2023-11-28T16:58:08.352261+0000","last_fullsized":"2023-11-28T16:58:08.352261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352661+0000","last_change":"2023-11-28T16:58:09.352661+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352661+0000","last_undegraded":"2023-11-28T16:58:09.352661+0000","last_fullsized":"2023-11-28T16:58:09.352661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.365162+0000","last_change":"2023-11-28T16:58:09.356981+0000","last_active":"2023-11-28T16:58:09.365162+0000","last_peered":"2023-11-28T16:58:09.365162+0000","last_clean":"2023-11-28T16:58:09.365162+0000","last_became_active":"2023-11-28T16:58:09.356658+0000","last_became_peered":"2023-11-28T16:58:09.356658+0000","last_unstale":"2023-11-28T16:58:09.365162+0000","last_undegraded":"2023-11-28T16:58:09.365162+0000","last_fullsized":"2023-11-28T16:58:09.365162+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:20.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347589+0000","last_change":"2023-11-28T16:57:57.306973+0000","last_active":"2023-11-28T16:58:08.347589+0000","last_peered":"2023-11-28T16:58:08.347589+0000","last_clean":"2023-11-28T16:58:08.347589+0000","last_became_active":"2023-11-28T16:57:57.304696+0000","last_became_peered":"2023-11-28T16:57:57.304696+0000","last_unstale":"2023-11-28T16:58:08.347589+0000","last_undegraded":"2023-11-28T16:58:08.347589+0000","last_fullsized":"2023-11-28T16:58:08.347589+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.596110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350902+0000","last_change":"2023-11-28T16:57:56.293462+0000","last_active":"2023-11-28T16:58:08.350902+0000","last_peered":"2023-11-28T16:58:08.350902+0000","last_clean":"2023-11-28T16:58:08.350902+0000","last_became_active":"2023-11-28T16:57:56.293039+0000","last_became_peered":"2023-11-28T16:57:56.293039+0000","last_unstale":"2023-11-28T16:58:08.350902+0000","last_undegraded":"2023-11-28T16:58:08.350902+0000","last_fullsized":"2023-11-28T16:58:08.350902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:40.083816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359972+0000","last_change":"2023-11-28T16:58:09.359972+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359972+0000","last_undegraded":"2023-11-28T16:58:09.359972+0000","last_fullsized":"2023-11-28T16:58:09.359972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382416+0000","last_change":"2023-11-28T16:58:09.375351+0000","last_active":"2023-11-28T16:58:09.382416+0000","last_peered":"2023-11-28T16:58:09.382416+0000","last_clean":"2023-11-28T16:58:09.382416+0000","last_became_active":"2023-11-28T16:58:09.375020+0000","last_became_peered":"2023-11-28T16:58:09.375020+0000","last_unstale":"2023-11-28T16:58:09.382416+0000","last_undegraded":"2023-11-28T16:58:09.382416+0000","last_fullsized":"2023-11-28T16:58:09.382416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:12:09.510947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350448+0000","last_change":"2023-11-28T16:57:57.307851+0000","last_active":"2023-11-28T16:58:08.350448+0000","last_peered":"2023-11-28T16:58:08.350448+0000","last_clean":"2023-11-28T16:58:08.350448+0000","last_became_active":"2023-11-28T16:57:57.307208+0000","last_became_peered":"2023-11-28T16:57:57.307208+0000","last_unstale":"2023-11-28T16:58:08.350448+0000","last_undegraded":"2023-11-28T16:58:08.350448+0000","last_fullsized":"2023-11-28T16:58:08.350448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345623+0000","last_change":"2023-11-28T16:57:56.286826+0000","last_active":"2023-11-28T16:58:08.345623+0000","last_peered":"2023-11-28T16:58:08.345623+0000","last_clean":"2023-11-28T16:58:08.345623+0000","last_became_active":"2023-11-28T16:57:56.286506+0000","last_became_peered":"2023-11-28T16:57:56.286506+0000","last_unstale":"2023-11-28T16:58:08.345623+0000","last_undegraded":"2023-11-28T16:58:08.345623+0000","last_fullsized":"2023-11-28T16:58:08.345623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:28.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354653+0000","last_change":"2023-11-28T16:58:09.354653+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354653+0000","last_undegraded":"2023-11-28T16:58:09.354653+0000","last_fullsized":"2023-11-28T16:58:09.354653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381105+0000","last_change":"2023-11-28T16:58:09.376587+0000","last_active":"2023-11-28T16:58:09.381105+0000","last_peered":"2023-11-28T16:58:09.381105+0000","last_clean":"2023-11-28T16:58:09.381105+0000","last_became_active":"2023-11-28T16:58:09.376044+0000","last_became_peered":"2023-11-28T16:58:09.376044+0000","last_unstale":"2023-11-28T16:58:09.381105+0000","last_undegraded":"2023-11-28T16:58:09.381105+0000","last_fullsized":"2023-11-28T16:58:09.381105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:51:04.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350673+0000","last_change":"2023-11-28T16:57:57.293525+0000","last_active":"2023-11-28T16:58:08.350673+0000","last_peered":"2023-11-28T16:58:08.350673+0000","last_clean":"2023-11-28T16:58:08.350673+0000","last_became_active":"2023-11-28T16:57:57.293155+0000","last_became_peered":"2023-11-28T16:57:57.293155+0000","last_unstale":"2023-11-28T16:58:08.350673+0000","last_undegraded":"2023-11-28T16:58:08.350673+0000","last_fullsized":"2023-11-28T16:58:08.350673+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:54.496874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350841+0000","last_change":"2023-11-28T16:57:56.289797+0000","last_active":"2023-11-28T16:58:08.350841+0000","last_peered":"2023-11-28T16:58:08.350841+0000","last_clean":"2023-11-28T16:58:08.350841+0000","last_became_active":"2023-11-28T16:57:56.286507+0000","last_became_peered":"2023-11-28T16:57:56.286507+0000","last_unstale":"2023-11-28T16:58:08.350841+0000","last_undegraded":"2023-11-28T16:58:08.350841+0000","last_fullsized":"2023-11-28T16:58:08.350841+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:55.952116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.360939+0000","last_change":"2023-11-28T16:58:09.360939+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.360939+0000","last_undegraded":"2023-11-28T16:58:09.360939+0000","last_fullsized":"2023-11-28T16:58:09.360939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.371695+0000","last_change":"2023-11-28T16:58:09.366936+0000","last_active":"2023-11-28T16:58:09.371695+0000","last_peered":"2023-11-28T16:58:09.371695+0000","last_clean":"2023-11-28T16:58:09.371695+0000","last_became_active":"2023-11-28T16:58:09.366532+0000","last_became_peered":"2023-11-28T16:58:09.366532+0000","last_unstale":"2023-11-28T16:58:09.371695+0000","last_undegraded":"2023-11-28T16:58:09.371695+0000","last_fullsized":"2023-11-28T16:58:09.371695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:05.414794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347366+0000","last_change":"2023-11-28T16:57:57.295933+0000","last_active":"2023-11-28T16:58:08.347366+0000","last_peered":"2023-11-28T16:58:08.347366+0000","last_clean":"2023-11-28T16:58:08.347366+0000","last_became_active":"2023-11-28T16:57:57.295567+0000","last_became_peered":"2023-11-28T16:57:57.295567+0000","last_unstale":"2023-11-28T16:58:08.347366+0000","last_undegraded":"2023-11-28T16:58:08.347366+0000","last_fullsized":"2023-11-28T16:58:08.347366+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:13.997222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347522+0000","last_change":"2023-11-28T16:57:56.296292+0000","last_active":"2023-11-28T16:58:08.347522+0000","last_peered":"2023-11-28T16:58:08.347522+0000","last_clean":"2023-11-28T16:58:08.347522+0000","last_became_active":"2023-11-28T16:57:56.295958+0000","last_became_peered":"2023-11-28T16:57:56.295958+0000","last_unstale":"2023-11-28T16:58:08.347522+0000","last_undegraded":"2023-11-28T16:58:08.347522+0000","last_fullsized":"2023-11-28T16:58:08.347522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.008383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355572+0000","last_change":"2023-11-28T16:58:09.355572+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355572+0000","last_undegraded":"2023-11-28T16:58:09.355572+0000","last_fullsized":"2023-11-28T16:58:09.355572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382246+0000","last_change":"2023-11-28T16:58:09.373511+0000","last_active":"2023-11-28T16:58:09.382246+0000","last_peered":"2023-11-28T16:58:09.382246+0000","last_clean":"2023-11-28T16:58:09.382246+0000","last_became_active":"2023-11-28T16:58:09.373187+0000","last_became_peered":"2023-11-28T16:58:09.373187+0000","last_unstale":"2023-11-28T16:58:09.382246+0000","last_undegraded":"2023-11-28T16:58:09.382246+0000","last_fullsized":"2023-11-28T16:58:09.382246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:59.249097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347438+0000","last_change":"2023-11-28T16:57:57.308508+0000","last_active":"2023-11-28T16:58:08.347438+0000","last_peered":"2023-11-28T16:58:08.347438+0000","last_clean":"2023-11-28T16:58:08.347438+0000","last_became_active":"2023-11-28T16:57:57.308197+0000","last_became_peered":"2023-11-28T16:57:57.308197+0000","last_unstale":"2023-11-28T16:58:08.347438+0000","last_undegraded":"2023-11-28T16:58:08.347438+0000","last_fullsized":"2023-11-28T16:58:08.347438+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:41.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352073+0000","last_change":"2023-11-28T16:57:56.296886+0000","last_active":"2023-11-28T16:58:08.352073+0000","last_peered":"2023-11-28T16:58:08.352073+0000","last_clean":"2023-11-28T16:58:08.352073+0000","last_became_active":"2023-11-28T16:57:56.296594+0000","last_became_peered":"2023-11-28T16:57:56.296594+0000","last_unstale":"2023-11-28T16:58:08.352073+0000","last_undegraded":"2023-11-28T16:58:08.352073+0000","last_fullsized":"2023-11-28T16:58:08.352073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:40.306391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.347446+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:09.347446+0000","last_peered":"2023-11-28T16:58:09.347446+0000","last_clean":"2023-11-28T16:58:09.347446+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:09.347446+0000","last_undegraded":"2023-11-28T16:58:09.347446+0000","last_fullsized":"2023-11-28T16:58:09.347446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1212416,"data_stored":849032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64500000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.628}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.70699999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":258504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.82299999999999995,"5min":1.474,"15min":1.474},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.73399999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.72799999999999998,"15min":0.753},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.879}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.749}]},{"osd":3,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92300000000000004,"5min":1.071,"15min":1.071},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.92500000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.52900000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.341,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4019999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":259156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69099999999999995}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.52100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76400000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.749},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89200000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54700000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96199999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":261611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.234,"15min":1.234},"last":0.66500000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.871,"5min":1.964,"15min":1.964},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.704,"15min":1.704},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88400000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.254,"15min":1.254},"last":0.497},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88,"5min":1.548,"15min":1.548},"last":0.61599999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90800000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.754}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.218,"15min":1.218},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.593,"15min":1.593},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":630784,"data_stored":265690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.56100000000000005,"5min":0.745,"15min":0.745},"last":0.434}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.874,"15min":0.874},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.47899999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.089,"5min":1.21,"15min":1.21},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91900000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0049999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.629},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0309999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.022,"5min":1.25,"15min":1.25},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.423,"15min":1.423},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":265690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.443},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68700000000000006}]},{"osd":5,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.627},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":258594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52700000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45800000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.56000000000000005,"5min":0.746,"15min":0.746},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.55600000000000005,"5min":1.04,"15min":1.04},"last":0.42799999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.625,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.60399999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.98699999999999999,"5min":1.446,"15min":1.446},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.034,"5min":1.47,"15min":1.47},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1180000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0820000000000001,"5min":1.327,"15min":1.327},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94599999999999995,"5min":1.3,"15min":1.3},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.167,"5min":1.526,"15min":1.526},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1459999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1220608,"data_stored":852561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.63}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:58:14.899 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:58:15.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.073+0000 7fd54425a640 1 Processor -- start 2023-11-28T16:58:15.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd54425a640 1 -- start start 2023-11-28T16:58:15.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd54425a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd53c0ca610 0x7fd53c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd54425a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c0bd720 0x7fd53c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd54425a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c155790 con 0x7fd53c06cd90 2023-11-28T16:58:15.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd54425a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0c4b00 con 0x7fd53c0ca610 2023-11-28T16:58:15.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd54425a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0c4de0 con 0x7fd53c0bd720 2023-11-28T16:58:15.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd541ff6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd53c0ca610 0x7fd53c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd541ff6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd53c0ca610 0x7fd53c0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37102/0 (socket says 172.21.15.26:37102) 2023-11-28T16:58:15.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd541ff6640 1 -- 172.21.15.26:0/896512562 learned_addr learned my addr 172.21.15.26:0/896512562 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:15.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd5417f5640 1 --2- 172.21.15.26:0/896512562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c0bd720 0x7fd53c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd541ff6640 1 -- 172.21.15.26:0/896512562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c0bd720 msgr2=0x7fd53c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:15.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd541ff6640 1 --2- 172.21.15.26:0/896512562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c0bd720 0x7fd53c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd541ff6640 1 -- 172.21.15.26:0/896512562 >> v1:172.21.15.79:6789/0 conn(0x7fd53c06cd90 legacy=0x7fd53c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.077+0000 7fd541ff6640 1 -- 172.21.15.26:0/896512562 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c157e30 con 0x7fd53c0ca610 2023-11-28T16:58:15.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd541ff6640 1 --2- 172.21.15.26:0/896512562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 0x7fd53c0c94c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd538009870 tx=0x7fd53801c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f52c79a6a46f79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd540ff4640 1 -- 172.21.15.26:0/896512562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0c52d0 con 0x7fd53c0ca610 2023-11-28T16:58:15.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd540ff4640 1 -- 172.21.15.26:0/896512562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5380a4940 con 0x7fd53c0ca610 2023-11-28T16:58:15.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd540ff4640 1 -- 172.21.15.26:0/896512562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380a4cd0 con 0x7fd53c0ca610 2023-11-28T16:58:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 -- 172.21.15.26:0/896512562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 msgr2=0x7fd53c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 --2- 172.21.15.26:0/896512562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 0x7fd53c0c94c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd538009870 tx=0x7fd53801c100 comp rx=0 tx=0).stop 2023-11-28T16:58:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 -- 172.21.15.26:0/896512562 shutdown_connections 2023-11-28T16:58:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 --2- 172.21.15.26:0/896512562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c0bd720 0x7fd53c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 --2- 172.21.15.26:0/896512562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 0x7fd53c0c94c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 -- 172.21.15.26:0/896512562 >> 172.21.15.26:0/896512562 conn(0x7fd53c071ea0 msgr2=0x7fd53c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 -- 172.21.15.26:0/896512562 shutdown_connections 2023-11-28T16:58:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 -- 172.21.15.26:0/896512562 wait complete. 2023-11-28T16:58:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 Processor -- start 2023-11-28T16:58:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.081+0000 7fd54425a640 1 -- start start 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c06cd90 0x7fd53c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53c0bd720 0x7fd53c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 0x7fd53c0a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c152c50 con 0x7fd53c0ca610 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c152ef0 con 0x7fd53c0bd720 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c149720 con 0x7fd53c06cd90 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd5427f7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 0x7fd53c0a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c06cd90 0x7fd53c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c06cd90 0x7fd53c0ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:47936/0 (socket says 172.21.15.26:47936) 2023-11-28T16:58:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 -- 172.21.15.26:0/4236271099 learned_addr learned my addr 172.21.15.26:0/4236271099 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd5417f5640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53c0bd720 0x7fd53c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 -- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53c0bd720 msgr2=0x7fd53c148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53c0bd720 0x7fd53c148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 -- 172.21.15.26:0/4236271099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 msgr2=0x7fd53c0a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 0x7fd53c0a9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 -- 172.21.15.26:0/4236271099 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380094d0 con 0x7fd53c06cd90 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd541ff6640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c06cd90 0x7fd53c0ab400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd5380af040 tx=0x7fd5380191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd5327fc640 1 -- 172.21.15.26:0/4236271099 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380ac910 con 0x7fd53c06cd90 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd5327fc640 1 -- 172.21.15.26:0/4236271099 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5380aca70 con 0x7fd53c06cd90 2023-11-28T16:58:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c154b40 con 0x7fd53c06cd90 2023-11-28T16:58:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd5327fc640 1 -- 172.21.15.26:0/4236271099 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380acde0 con 0x7fd53c06cd90 2023-11-28T16:58:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c14bf00 con 0x7fd53c06cd90 2023-11-28T16:58:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.085+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c154cd0 con 0x7fd53c06cd90 2023-11-28T16:58:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.089+0000 7fd5327fc640 1 -- 172.21.15.26:0/4236271099 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd5380b3070 con 0x7fd53c06cd90 2023-11-28T16:58:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.089+0000 7fd5327fc640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.089+0000 7fd5327fc640 1 -- 172.21.15.26:0/4236271099 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd53c0cac00 con 0x7fd53c06cd90 2023-11-28T16:58:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.089+0000 7fd5417f5640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.089+0000 7fd5417f5640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0c4560 tx=0x7fd52c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.093+0000 7fd5327fc640 1 -- 172.21.15.26:0/4236271099 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5380eb940 con 0x7fd53c06cd90 2023-11-28T16:58:15.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.249+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd53c067580 con 0x7fd5200668d0 2023-11-28T16:58:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.265+0000 7fd5327fc640 1 -- 172.21.15.26:0/4236271099 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522207 (secure 0 0 0) 0x7fd53c067580 con 0x7fd5200668d0 2023-11-28T16:58:15.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:15.276 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:58:15.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 msgr2=0x7fd520068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0c4560 tx=0x7fd52c009190 comp rx=0 tx=0).stop 2023-11-28T16:58:15.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c06cd90 msgr2=0x7fd53c0ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c06cd90 0x7fd53c0ab400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd5380af040 tx=0x7fd5380191c0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 shutdown_connections 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd53c0ca610 0x7fd53c0a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53c0bd720 0x7fd53c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5200668d0 0x7fd520068d90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 --2- 172.21.15.26:0/4236271099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53c06cd90 0x7fd53c0ab400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 >> 172.21.15.26:0/4236271099 conn(0x7fd53c071ea0 msgr2=0x7fd53c158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 shutdown_connections 2023-11-28T16:58:15.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.269+0000 7fd54425a640 1 -- 172.21.15.26:0/4236271099 wait complete. 2023-11-28T16:58:15.292 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-28T16:58:13.601461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238820,"kb_used_data":6016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735900,"statfs":{"total":773094113280,"available":772849561600,"internally_reserved":0,"allocated":6160384,"data_stored":3270838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.260570"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356934+0000","last_change":"2023-11-28T16:58:09.356934+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356934+0000","last_undegraded":"2023-11-28T16:58:09.356934+0000","last_fullsized":"2023-11-28T16:58:09.356934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341292+0000","last_change":"2023-11-28T16:57:57.311201+0000","last_active":"2023-11-28T16:58:08.341292+0000","last_peered":"2023-11-28T16:58:08.341292+0000","last_clean":"2023-11-28T16:58:08.341292+0000","last_became_active":"2023-11-28T16:57:57.310858+0000","last_became_peered":"2023-11-28T16:57:57.310858+0000","last_unstale":"2023-11-28T16:58:08.341292+0000","last_undegraded":"2023-11-28T16:58:08.341292+0000","last_fullsized":"2023-11-28T16:58:08.341292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:38.198969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352892+0000","last_change":"2023-11-28T16:58:09.352892+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352892+0000","last_undegraded":"2023-11-28T16:58:09.352892+0000","last_fullsized":"2023-11-28T16:58:09.352892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348156+0000","last_change":"2023-11-28T16:57:57.307903+0000","last_active":"2023-11-28T16:58:08.348156+0000","last_peered":"2023-11-28T16:58:08.348156+0000","last_clean":"2023-11-28T16:58:08.348156+0000","last_became_active":"2023-11-28T16:57:57.305651+0000","last_became_peered":"2023-11-28T16:57:57.305651+0000","last_unstale":"2023-11-28T16:58:08.348156+0000","last_undegraded":"2023-11-28T16:58:08.348156+0000","last_fullsized":"2023-11-28T16:58:08.348156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:58.350824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355797+0000","last_change":"2023-11-28T16:58:09.355797+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355797+0000","last_undegraded":"2023-11-28T16:58:09.355797+0000","last_fullsized":"2023-11-28T16:58:09.355797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349667+0000","last_change":"2023-11-28T16:57:57.295922+0000","last_active":"2023-11-28T16:58:08.349667+0000","last_peered":"2023-11-28T16:58:08.349667+0000","last_clean":"2023-11-28T16:58:08.349667+0000","last_became_active":"2023-11-28T16:57:57.295614+0000","last_became_peered":"2023-11-28T16:57:57.295614+0000","last_unstale":"2023-11-28T16:58:08.349667+0000","last_undegraded":"2023-11-28T16:58:08.349667+0000","last_fullsized":"2023-11-28T16:58:08.349667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.365573+0000","last_change":"2023-11-28T16:58:09.365573+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.365573+0000","last_undegraded":"2023-11-28T16:58:09.365573+0000","last_fullsized":"2023-11-28T16:58:09.365573+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352081+0000","last_change":"2023-11-28T16:57:57.307103+0000","last_active":"2023-11-28T16:58:08.352081+0000","last_peered":"2023-11-28T16:58:08.352081+0000","last_clean":"2023-11-28T16:58:08.352081+0000","last_became_active":"2023-11-28T16:57:57.306791+0000","last_became_peered":"2023-11-28T16:57:57.306791+0000","last_unstale":"2023-11-28T16:58:08.352081+0000","last_undegraded":"2023-11-28T16:58:08.352081+0000","last_fullsized":"2023-11-28T16:58:08.352081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354028+0000","last_change":"2023-11-28T16:58:09.354028+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354028+0000","last_undegraded":"2023-11-28T16:58:09.354028+0000","last_fullsized":"2023-11-28T16:58:09.354028+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341241+0000","last_change":"2023-11-28T16:57:57.294572+0000","last_active":"2023-11-28T16:58:08.341241+0000","last_peered":"2023-11-28T16:58:08.341241+0000","last_clean":"2023-11-28T16:58:08.341241+0000","last_became_active":"2023-11-28T16:57:57.294253+0000","last_became_peered":"2023-11-28T16:57:57.294253+0000","last_unstale":"2023-11-28T16:58:08.341241+0000","last_undegraded":"2023-11-28T16:58:08.341241+0000","last_fullsized":"2023-11-28T16:58:08.341241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:08.044829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362280+0000","last_change":"2023-11-28T16:58:09.362280+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362280+0000","last_undegraded":"2023-11-28T16:58:09.362280+0000","last_fullsized":"2023-11-28T16:58:09.362280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343666+0000","last_change":"2023-11-28T16:57:57.303700+0000","last_active":"2023-11-28T16:58:08.343666+0000","last_peered":"2023-11-28T16:58:08.343666+0000","last_clean":"2023-11-28T16:58:08.343666+0000","last_became_active":"2023-11-28T16:57:57.303377+0000","last_became_peered":"2023-11-28T16:57:57.303377+0000","last_unstale":"2023-11-28T16:58:08.343666+0000","last_undegraded":"2023-11-28T16:58:08.343666+0000","last_fullsized":"2023-11-28T16:58:08.343666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353798+0000","last_change":"2023-11-28T16:58:09.353798+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353798+0000","last_undegraded":"2023-11-28T16:58:09.353798+0000","last_fullsized":"2023-11-28T16:58:09.353798+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345302+0000","last_change":"2023-11-28T16:57:57.290167+0000","last_active":"2023-11-28T16:58:08.345302+0000","last_peered":"2023-11-28T16:58:08.345302+0000","last_clean":"2023-11-28T16:58:08.345302+0000","last_became_active":"2023-11-28T16:57:57.289873+0000","last_became_peered":"2023-11-28T16:57:57.289873+0000","last_unstale":"2023-11-28T16:58:08.345302+0000","last_undegraded":"2023-11-28T16:58:08.345302+0000","last_fullsized":"2023-11-28T16:58:08.345302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:53.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.364239+0000","last_change":"2023-11-28T16:58:09.364239+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.364239+0000","last_undegraded":"2023-11-28T16:58:09.364239+0000","last_fullsized":"2023-11-28T16:58:09.364239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347226+0000","last_change":"2023-11-28T16:57:57.294040+0000","last_active":"2023-11-28T16:58:08.347226+0000","last_peered":"2023-11-28T16:58:08.347226+0000","last_clean":"2023-11-28T16:58:08.347226+0000","last_became_active":"2023-11-28T16:57:57.293696+0000","last_became_peered":"2023-11-28T16:57:57.293696+0000","last_unstale":"2023-11-28T16:58:08.347226+0000","last_undegraded":"2023-11-28T16:58:08.347226+0000","last_fullsized":"2023-11-28T16:58:08.347226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:45.988064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354554+0000","last_change":"2023-11-28T16:58:09.354554+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354554+0000","last_undegraded":"2023-11-28T16:58:09.354554+0000","last_fullsized":"2023-11-28T16:58:09.354554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345945+0000","last_change":"2023-11-28T16:57:57.291252+0000","last_active":"2023-11-28T16:58:08.345945+0000","last_peered":"2023-11-28T16:58:08.345945+0000","last_clean":"2023-11-28T16:58:08.345945+0000","last_became_active":"2023-11-28T16:57:57.290870+0000","last_became_peered":"2023-11-28T16:57:57.290870+0000","last_unstale":"2023-11-28T16:58:08.345945+0000","last_undegraded":"2023-11-28T16:58:08.345945+0000","last_fullsized":"2023-11-28T16:58:08.345945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:24.268675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356219+0000","last_change":"2023-11-28T16:58:09.356219+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356219+0000","last_undegraded":"2023-11-28T16:58:09.356219+0000","last_fullsized":"2023-11-28T16:58:09.356219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351003+0000","last_change":"2023-11-28T16:57:57.293326+0000","last_active":"2023-11-28T16:58:08.351003+0000","last_peered":"2023-11-28T16:58:08.351003+0000","last_clean":"2023-11-28T16:58:08.351003+0000","last_became_active":"2023-11-28T16:57:57.292663+0000","last_became_peered":"2023-11-28T16:57:57.292663+0000","last_unstale":"2023-11-28T16:58:08.351003+0000","last_undegraded":"2023-11-28T16:58:08.351003+0000","last_fullsized":"2023-11-28T16:58:08.351003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:07.257033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359820+0000","last_change":"2023-11-28T16:58:09.359820+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359820+0000","last_undegraded":"2023-11-28T16:58:09.359820+0000","last_fullsized":"2023-11-28T16:58:09.359820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351512+0000","last_change":"2023-11-28T16:57:57.285037+0000","last_active":"2023-11-28T16:58:08.351512+0000","last_peered":"2023-11-28T16:58:08.351512+0000","last_clean":"2023-11-28T16:58:08.351512+0000","last_became_active":"2023-11-28T16:57:57.284722+0000","last_became_peered":"2023-11-28T16:57:57.284722+0000","last_unstale":"2023-11-28T16:58:08.351512+0000","last_undegraded":"2023-11-28T16:58:08.351512+0000","last_fullsized":"2023-11-28T16:58:08.351512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:29.116162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351087+0000","last_change":"2023-11-28T16:58:09.351087+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351087+0000","last_undegraded":"2023-11-28T16:58:09.351087+0000","last_fullsized":"2023-11-28T16:58:09.351087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352165+0000","last_change":"2023-11-28T16:57:57.303913+0000","last_active":"2023-11-28T16:58:08.352165+0000","last_peered":"2023-11-28T16:58:08.352165+0000","last_clean":"2023-11-28T16:58:08.352165+0000","last_became_active":"2023-11-28T16:57:57.303625+0000","last_became_peered":"2023-11-28T16:57:57.303625+0000","last_unstale":"2023-11-28T16:58:08.352165+0000","last_undegraded":"2023-11-28T16:58:08.352165+0000","last_fullsized":"2023-11-28T16:58:08.352165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.347055+0000","last_change":"2023-11-28T16:58:09.347055+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.347055+0000","last_undegraded":"2023-11-28T16:58:09.347055+0000","last_fullsized":"2023-11-28T16:58:09.347055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352767+0000","last_change":"2023-11-28T16:57:57.305618+0000","last_active":"2023-11-28T16:58:08.352767+0000","last_peered":"2023-11-28T16:58:08.352767+0000","last_clean":"2023-11-28T16:58:08.352767+0000","last_became_active":"2023-11-28T16:57:57.305369+0000","last_became_peered":"2023-11-28T16:57:57.305369+0000","last_unstale":"2023-11-28T16:58:08.352767+0000","last_undegraded":"2023-11-28T16:58:08.352767+0000","last_fullsized":"2023-11-28T16:58:08.352767+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:26.927795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349211+0000","last_change":"2023-11-28T16:58:09.349211+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349211+0000","last_undegraded":"2023-11-28T16:58:09.349211+0000","last_fullsized":"2023-11-28T16:58:09.349211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345514+0000","last_change":"2023-11-28T16:57:57.286182+0000","last_active":"2023-11-28T16:58:08.345514+0000","last_peered":"2023-11-28T16:58:08.345514+0000","last_clean":"2023-11-28T16:58:08.345514+0000","last_became_active":"2023-11-28T16:57:57.285885+0000","last_became_peered":"2023-11-28T16:57:57.285885+0000","last_unstale":"2023-11-28T16:58:08.345514+0000","last_undegraded":"2023-11-28T16:58:08.345514+0000","last_fullsized":"2023-11-28T16:58:08.345514+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:34.325761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346377+0000","last_change":"2023-11-28T16:58:09.346377+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346377+0000","last_undegraded":"2023-11-28T16:58:09.346377+0000","last_fullsized":"2023-11-28T16:58:09.346377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345416+0000","last_change":"2023-11-28T16:57:57.288466+0000","last_active":"2023-11-28T16:58:08.345416+0000","last_peered":"2023-11-28T16:58:08.345416+0000","last_clean":"2023-11-28T16:58:08.345416+0000","last_became_active":"2023-11-28T16:57:57.288071+0000","last_became_peered":"2023-11-28T16:57:57.288071+0000","last_unstale":"2023-11-28T16:58:08.345416+0000","last_undegraded":"2023-11-28T16:58:08.345416+0000","last_fullsized":"2023-11-28T16:58:08.345416+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:54.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362056+0000","last_change":"2023-11-28T16:58:09.362056+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362056+0000","last_undegraded":"2023-11-28T16:58:09.362056+0000","last_fullsized":"2023-11-28T16:58:09.362056+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343291+0000","last_change":"2023-11-28T16:57:57.298522+0000","last_active":"2023-11-28T16:58:08.343291+0000","last_peered":"2023-11-28T16:58:08.343291+0000","last_clean":"2023-11-28T16:58:08.343291+0000","last_became_active":"2023-11-28T16:57:57.298241+0000","last_became_peered":"2023-11-28T16:57:57.298241+0000","last_unstale":"2023-11-28T16:58:08.343291+0000","last_undegraded":"2023-11-28T16:58:08.343291+0000","last_fullsized":"2023-11-28T16:58:08.343291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.366415+0000","last_change":"2023-11-28T16:58:09.366415+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.366415+0000","last_undegraded":"2023-11-28T16:58:09.366415+0000","last_fullsized":"2023-11-28T16:58:09.366415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348552+0000","last_change":"2023-11-28T16:57:57.306762+0000","last_active":"2023-11-28T16:58:08.348552+0000","last_peered":"2023-11-28T16:58:08.348552+0000","last_clean":"2023-11-28T16:58:08.348552+0000","last_became_active":"2023-11-28T16:57:57.306428+0000","last_became_peered":"2023-11-28T16:57:57.306428+0000","last_unstale":"2023-11-28T16:58:08.348552+0000","last_undegraded":"2023-11-28T16:58:08.348552+0000","last_fullsized":"2023-11-28T16:58:08.348552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:34.023526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346855+0000","last_change":"2023-11-28T16:58:09.346855+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346855+0000","last_undegraded":"2023-11-28T16:58:09.346855+0000","last_fullsized":"2023-11-28T16:58:09.346855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350719+0000","last_change":"2023-11-28T16:57:57.301733+0000","last_active":"2023-11-28T16:58:08.350719+0000","last_peered":"2023-11-28T16:58:08.350719+0000","last_clean":"2023-11-28T16:58:08.350719+0000","last_became_active":"2023-11-28T16:57:57.301402+0000","last_became_peered":"2023-11-28T16:57:57.301402+0000","last_unstale":"2023-11-28T16:58:08.350719+0000","last_undegraded":"2023-11-28T16:58:08.350719+0000","last_fullsized":"2023-11-28T16:58:08.350719+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:35.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359147+0000","last_change":"2023-11-28T16:58:09.359147+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359147+0000","last_undegraded":"2023-11-28T16:58:09.359147+0000","last_fullsized":"2023-11-28T16:58:09.359147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341178+0000","last_change":"2023-11-28T16:57:57.299228+0000","last_active":"2023-11-28T16:58:08.341178+0000","last_peered":"2023-11-28T16:58:08.341178+0000","last_clean":"2023-11-28T16:58:08.341178+0000","last_became_active":"2023-11-28T16:57:57.298919+0000","last_became_peered":"2023-11-28T16:57:57.298919+0000","last_unstale":"2023-11-28T16:58:08.341178+0000","last_undegraded":"2023-11-28T16:58:08.341178+0000","last_fullsized":"2023-11-28T16:58:08.341178+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:09.019656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354562+0000","last_change":"2023-11-28T16:58:09.354562+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354562+0000","last_undegraded":"2023-11-28T16:58:09.354562+0000","last_fullsized":"2023-11-28T16:58:09.354562+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347776+0000","last_change":"2023-11-28T16:57:57.299427+0000","last_active":"2023-11-28T16:58:08.347776+0000","last_peered":"2023-11-28T16:58:08.347776+0000","last_clean":"2023-11-28T16:58:08.347776+0000","last_became_active":"2023-11-28T16:57:57.299152+0000","last_became_peered":"2023-11-28T16:57:57.299152+0000","last_unstale":"2023-11-28T16:58:08.347776+0000","last_undegraded":"2023-11-28T16:58:08.347776+0000","last_fullsized":"2023-11-28T16:58:08.347776+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:15.293843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355577+0000","last_change":"2023-11-28T16:58:09.355577+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355577+0000","last_undegraded":"2023-11-28T16:58:09.355577+0000","last_fullsized":"2023-11-28T16:58:09.355577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350284+0000","last_change":"2023-11-28T16:57:57.293718+0000","last_active":"2023-11-28T16:58:08.350284+0000","last_peered":"2023-11-28T16:58:08.350284+0000","last_clean":"2023-11-28T16:58:08.350284+0000","last_became_active":"2023-11-28T16:57:57.293317+0000","last_became_peered":"2023-11-28T16:57:57.293317+0000","last_unstale":"2023-11-28T16:58:08.350284+0000","last_undegraded":"2023-11-28T16:58:08.350284+0000","last_fullsized":"2023-11-28T16:58:08.350284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354170+0000","last_change":"2023-11-28T16:58:09.354170+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354170+0000","last_undegraded":"2023-11-28T16:58:09.354170+0000","last_fullsized":"2023-11-28T16:58:09.354170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347531+0000","last_change":"2023-11-28T16:57:57.307374+0000","last_active":"2023-11-28T16:58:08.347531+0000","last_peered":"2023-11-28T16:58:08.347531+0000","last_clean":"2023-11-28T16:58:08.347531+0000","last_became_active":"2023-11-28T16:57:57.305540+0000","last_became_peered":"2023-11-28T16:57:57.305540+0000","last_unstale":"2023-11-28T16:58:08.347531+0000","last_undegraded":"2023-11-28T16:58:08.347531+0000","last_fullsized":"2023-11-28T16:58:08.347531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:34.222003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349265+0000","last_change":"2023-11-28T16:58:09.349265+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349265+0000","last_undegraded":"2023-11-28T16:58:09.349265+0000","last_fullsized":"2023-11-28T16:58:09.349265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349325+0000","last_change":"2023-11-28T16:57:57.300922+0000","last_active":"2023-11-28T16:58:08.349325+0000","last_peered":"2023-11-28T16:58:08.349325+0000","last_clean":"2023-11-28T16:58:08.349325+0000","last_became_active":"2023-11-28T16:57:57.300127+0000","last_became_peered":"2023-11-28T16:57:57.300127+0000","last_unstale":"2023-11-28T16:58:08.349325+0000","last_undegraded":"2023-11-28T16:58:08.349325+0000","last_fullsized":"2023-11-28T16:58:08.349325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.348943+0000","last_change":"2023-11-28T16:58:09.348943+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.348943+0000","last_undegraded":"2023-11-28T16:58:09.348943+0000","last_fullsized":"2023-11-28T16:58:09.348943+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351833+0000","last_change":"2023-11-28T16:57:57.307862+0000","last_active":"2023-11-28T16:58:08.351833+0000","last_peered":"2023-11-28T16:58:08.351833+0000","last_clean":"2023-11-28T16:58:08.351833+0000","last_became_active":"2023-11-28T16:57:57.307540+0000","last_became_peered":"2023-11-28T16:57:57.307540+0000","last_unstale":"2023-11-28T16:58:08.351833+0000","last_undegraded":"2023-11-28T16:58:08.351833+0000","last_fullsized":"2023-11-28T16:58:08.351833+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:36.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.356410+0000","last_change":"2023-11-28T16:58:09.356410+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.356410+0000","last_undegraded":"2023-11-28T16:58:09.356410+0000","last_fullsized":"2023-11-28T16:58:09.356410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341372+0000","last_change":"2023-11-28T16:57:57.284808+0000","last_active":"2023-11-28T16:58:08.341372+0000","last_peered":"2023-11-28T16:58:08.341372+0000","last_clean":"2023-11-28T16:58:08.341372+0000","last_became_active":"2023-11-28T16:57:57.284304+0000","last_became_peered":"2023-11-28T16:57:57.284304+0000","last_unstale":"2023-11-28T16:58:08.341372+0000","last_undegraded":"2023-11-28T16:58:08.341372+0000","last_fullsized":"2023-11-28T16:58:08.341372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:56.940553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349986+0000","last_change":"2023-11-28T16:58:09.349986+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349986+0000","last_undegraded":"2023-11-28T16:58:09.349986+0000","last_fullsized":"2023-11-28T16:58:09.349986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354167+0000","last_change":"2023-11-28T16:57:57.291693+0000","last_active":"2023-11-28T16:58:08.354167+0000","last_peered":"2023-11-28T16:58:08.354167+0000","last_clean":"2023-11-28T16:58:08.354167+0000","last_became_active":"2023-11-28T16:57:57.291320+0000","last_became_peered":"2023-11-28T16:57:57.291320+0000","last_unstale":"2023-11-28T16:58:08.354167+0000","last_undegraded":"2023-11-28T16:58:08.354167+0000","last_fullsized":"2023-11-28T16:58:08.354167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:21.959226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.349811+0000","last_change":"2023-11-28T16:58:09.349811+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.349811+0000","last_undegraded":"2023-11-28T16:58:09.349811+0000","last_fullsized":"2023-11-28T16:58:09.349811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344446+0000","last_change":"2023-11-28T16:57:57.299843+0000","last_active":"2023-11-28T16:58:08.344446+0000","last_peered":"2023-11-28T16:58:08.344446+0000","last_clean":"2023-11-28T16:58:08.344446+0000","last_became_active":"2023-11-28T16:57:57.299266+0000","last_became_peered":"2023-11-28T16:57:57.299266+0000","last_unstale":"2023-11-28T16:58:08.344446+0000","last_undegraded":"2023-11-28T16:58:08.344446+0000","last_fullsized":"2023-11-28T16:58:08.344446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355951+0000","last_change":"2023-11-28T16:58:09.355951+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355951+0000","last_undegraded":"2023-11-28T16:58:09.355951+0000","last_fullsized":"2023-11-28T16:58:09.355951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.341349+0000","last_change":"2023-11-28T16:57:57.294587+0000","last_active":"2023-11-28T16:58:08.341349+0000","last_peered":"2023-11-28T16:58:08.341349+0000","last_clean":"2023-11-28T16:58:08.341349+0000","last_became_active":"2023-11-28T16:57:57.294283+0000","last_became_peered":"2023-11-28T16:57:57.294283+0000","last_unstale":"2023-11-28T16:58:08.341349+0000","last_undegraded":"2023-11-28T16:58:08.341349+0000","last_fullsized":"2023-11-28T16:58:08.341349+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:35.632692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353445+0000","last_change":"2023-11-28T16:58:09.353445+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353445+0000","last_undegraded":"2023-11-28T16:58:09.353445+0000","last_fullsized":"2023-11-28T16:58:09.353445+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347771+0000","last_change":"2023-11-28T16:57:57.298034+0000","last_active":"2023-11-28T16:58:08.347771+0000","last_peered":"2023-11-28T16:58:08.347771+0000","last_clean":"2023-11-28T16:58:08.347771+0000","last_became_active":"2023-11-28T16:57:57.297743+0000","last_became_peered":"2023-11-28T16:57:57.297743+0000","last_unstale":"2023-11-28T16:58:08.347771+0000","last_undegraded":"2023-11-28T16:58:08.347771+0000","last_fullsized":"2023-11-28T16:58:08.347771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:26.295837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359339+0000","last_change":"2023-11-28T16:58:09.359339+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359339+0000","last_undegraded":"2023-11-28T16:58:09.359339+0000","last_fullsized":"2023-11-28T16:58:09.359339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349435+0000","last_change":"2023-11-28T16:57:57.296838+0000","last_active":"2023-11-28T16:58:08.349435+0000","last_peered":"2023-11-28T16:58:08.349435+0000","last_clean":"2023-11-28T16:58:08.349435+0000","last_became_active":"2023-11-28T16:57:57.295762+0000","last_became_peered":"2023-11-28T16:57:57.295762+0000","last_unstale":"2023-11-28T16:58:08.349435+0000","last_undegraded":"2023-11-28T16:58:08.349435+0000","last_fullsized":"2023-11-28T16:58:08.349435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.358941+0000","last_change":"2023-11-28T16:58:09.358941+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.358941+0000","last_undegraded":"2023-11-28T16:58:09.358941+0000","last_fullsized":"2023-11-28T16:58:09.358941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.340954+0000","last_change":"2023-11-28T16:57:57.291516+0000","last_active":"2023-11-28T16:58:08.340954+0000","last_peered":"2023-11-28T16:58:08.340954+0000","last_clean":"2023-11-28T16:58:08.340954+0000","last_became_active":"2023-11-28T16:57:57.291201+0000","last_became_peered":"2023-11-28T16:57:57.291201+0000","last_unstale":"2023-11-28T16:58:08.340954+0000","last_undegraded":"2023-11-28T16:58:08.340954+0000","last_fullsized":"2023-11-28T16:58:08.340954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:23.828578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353541+0000","last_change":"2023-11-28T16:58:09.353541+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353541+0000","last_undegraded":"2023-11-28T16:58:09.353541+0000","last_fullsized":"2023-11-28T16:58:09.353541+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343376+0000","last_change":"2023-11-28T16:57:57.308867+0000","last_active":"2023-11-28T16:58:08.343376+0000","last_peered":"2023-11-28T16:58:08.343376+0000","last_clean":"2023-11-28T16:58:08.343376+0000","last_became_active":"2023-11-28T16:57:57.307693+0000","last_became_peered":"2023-11-28T16:57:57.307693+0000","last_unstale":"2023-11-28T16:58:08.343376+0000","last_undegraded":"2023-11-28T16:58:08.343376+0000","last_fullsized":"2023-11-28T16:58:08.343376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:24.984986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362611+0000","last_change":"2023-11-28T16:58:09.362611+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362611+0000","last_undegraded":"2023-11-28T16:58:09.362611+0000","last_fullsized":"2023-11-28T16:58:09.362611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382146+0000","last_change":"2023-11-28T16:58:09.374084+0000","last_active":"2023-11-28T16:58:09.382146+0000","last_peered":"2023-11-28T16:58:09.382146+0000","last_clean":"2023-11-28T16:58:09.382146+0000","last_became_active":"2023-11-28T16:58:09.373766+0000","last_became_peered":"2023-11-28T16:58:09.373766+0000","last_unstale":"2023-11-28T16:58:09.382146+0000","last_undegraded":"2023-11-28T16:58:09.382146+0000","last_fullsized":"2023-11-28T16:58:09.382146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:55.123226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344211+0000","last_change":"2023-11-28T16:57:57.292539+0000","last_active":"2023-11-28T16:58:08.344211+0000","last_peered":"2023-11-28T16:58:08.344211+0000","last_clean":"2023-11-28T16:58:08.344211+0000","last_became_active":"2023-11-28T16:57:57.292189+0000","last_became_peered":"2023-11-28T16:57:57.292189+0000","last_unstale":"2023-11-28T16:58:08.344211+0000","last_undegraded":"2023-11-28T16:58:08.344211+0000","last_fullsized":"2023-11-28T16:58:08.344211+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344321+0000","last_change":"2023-11-28T16:57:56.296007+0000","last_active":"2023-11-28T16:58:08.344321+0000","last_peered":"2023-11-28T16:58:08.344321+0000","last_clean":"2023-11-28T16:58:08.344321+0000","last_became_active":"2023-11-28T16:57:56.295636+0000","last_became_peered":"2023-11-28T16:57:56.295636+0000","last_unstale":"2023-11-28T16:58:08.344321+0000","last_undegraded":"2023-11-28T16:58:08.344321+0000","last_fullsized":"2023-11-28T16:58:08.344321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:38.988857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353750+0000","last_change":"2023-11-28T16:58:09.353750+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353750+0000","last_undegraded":"2023-11-28T16:58:09.353750+0000","last_fullsized":"2023-11-28T16:58:09.353750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382148+0000","last_change":"2023-11-28T16:58:09.372867+0000","last_active":"2023-11-28T16:58:09.382148+0000","last_peered":"2023-11-28T16:58:09.382148+0000","last_clean":"2023-11-28T16:58:09.382148+0000","last_became_active":"2023-11-28T16:58:09.372597+0000","last_became_peered":"2023-11-28T16:58:09.372597+0000","last_unstale":"2023-11-28T16:58:09.382148+0000","last_undegraded":"2023-11-28T16:58:09.382148+0000","last_fullsized":"2023-11-28T16:58:09.382148+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:08.829912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351512+0000","last_change":"2023-11-28T16:57:57.281906+0000","last_active":"2023-11-28T16:58:08.351512+0000","last_peered":"2023-11-28T16:58:08.351512+0000","last_clean":"2023-11-28T16:58:08.351512+0000","last_became_active":"2023-11-28T16:57:57.281593+0000","last_became_peered":"2023-11-28T16:57:57.281593+0000","last_unstale":"2023-11-28T16:58:08.351512+0000","last_undegraded":"2023-11-28T16:58:08.351512+0000","last_fullsized":"2023-11-28T16:58:08.351512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348193+0000","last_change":"2023-11-28T16:57:56.301479+0000","last_active":"2023-11-28T16:58:08.348193+0000","last_peered":"2023-11-28T16:58:08.348193+0000","last_clean":"2023-11-28T16:58:08.348193+0000","last_became_active":"2023-11-28T16:57:56.301262+0000","last_became_peered":"2023-11-28T16:57:56.301262+0000","last_unstale":"2023-11-28T16:58:08.348193+0000","last_undegraded":"2023-11-28T16:58:08.348193+0000","last_fullsized":"2023-11-28T16:58:08.348193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:34.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353707+0000","last_change":"2023-11-28T16:58:09.353707+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353707+0000","last_undegraded":"2023-11-28T16:58:09.353707+0000","last_fullsized":"2023-11-28T16:58:09.353707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377040+0000","last_change":"2023-11-28T16:58:09.371624+0000","last_active":"2023-11-28T16:58:09.377040+0000","last_peered":"2023-11-28T16:58:09.377040+0000","last_clean":"2023-11-28T16:58:09.377040+0000","last_became_active":"2023-11-28T16:58:09.371252+0000","last_became_peered":"2023-11-28T16:58:09.371252+0000","last_unstale":"2023-11-28T16:58:09.377040+0000","last_undegraded":"2023-11-28T16:58:09.377040+0000","last_fullsized":"2023-11-28T16:58:09.377040+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:26.069648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344166+0000","last_change":"2023-11-28T16:57:57.296485+0000","last_active":"2023-11-28T16:58:08.344166+0000","last_peered":"2023-11-28T16:58:08.344166+0000","last_clean":"2023-11-28T16:58:08.344166+0000","last_became_active":"2023-11-28T16:57:57.296210+0000","last_became_peered":"2023-11-28T16:57:57.296210+0000","last_unstale":"2023-11-28T16:58:08.344166+0000","last_undegraded":"2023-11-28T16:58:08.344166+0000","last_fullsized":"2023-11-28T16:58:08.344166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344356+0000","last_change":"2023-11-28T16:57:56.284952+0000","last_active":"2023-11-28T16:58:08.344356+0000","last_peered":"2023-11-28T16:58:08.344356+0000","last_clean":"2023-11-28T16:58:08.344356+0000","last_became_active":"2023-11-28T16:57:56.284663+0000","last_became_peered":"2023-11-28T16:57:56.284663+0000","last_unstale":"2023-11-28T16:58:08.344356+0000","last_undegraded":"2023-11-28T16:58:08.344356+0000","last_fullsized":"2023-11-28T16:58:08.344356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354275+0000","last_change":"2023-11-28T16:58:09.354275+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354275+0000","last_undegraded":"2023-11-28T16:58:09.354275+0000","last_fullsized":"2023-11-28T16:58:09.354275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382241+0000","last_change":"2023-11-28T16:58:09.379004+0000","last_active":"2023-11-28T16:58:09.382241+0000","last_peered":"2023-11-28T16:58:09.382241+0000","last_clean":"2023-11-28T16:58:09.382241+0000","last_became_active":"2023-11-28T16:58:09.378364+0000","last_became_peered":"2023-11-28T16:58:09.378364+0000","last_unstale":"2023-11-28T16:58:09.382241+0000","last_undegraded":"2023-11-28T16:58:09.382241+0000","last_fullsized":"2023-11-28T16:58:09.382241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:46.294429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344175+0000","last_change":"2023-11-28T16:57:57.299545+0000","last_active":"2023-11-28T16:58:08.344175+0000","last_peered":"2023-11-28T16:58:08.344175+0000","last_clean":"2023-11-28T16:58:08.344175+0000","last_became_active":"2023-11-28T16:57:57.298953+0000","last_became_peered":"2023-11-28T16:57:57.298953+0000","last_unstale":"2023-11-28T16:58:08.344175+0000","last_undegraded":"2023-11-28T16:58:08.344175+0000","last_fullsized":"2023-11-28T16:58:08.344175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352218+0000","last_change":"2023-11-28T16:57:56.293038+0000","last_active":"2023-11-28T16:58:08.352218+0000","last_peered":"2023-11-28T16:58:08.352218+0000","last_clean":"2023-11-28T16:58:08.352218+0000","last_became_active":"2023-11-28T16:57:56.292443+0000","last_became_peered":"2023-11-28T16:57:56.292443+0000","last_unstale":"2023-11-28T16:58:08.352218+0000","last_undegraded":"2023-11-28T16:58:08.352218+0000","last_fullsized":"2023-11-28T16:58:08.352218+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354538+0000","last_change":"2023-11-28T16:58:09.354538+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354538+0000","last_undegraded":"2023-11-28T16:58:09.354538+0000","last_fullsized":"2023-11-28T16:58:09.354538+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.369520+0000","last_change":"2023-11-28T16:58:09.366910+0000","last_active":"2023-11-28T16:58:09.369520+0000","last_peered":"2023-11-28T16:58:09.369520+0000","last_clean":"2023-11-28T16:58:09.369520+0000","last_became_active":"2023-11-28T16:58:09.366580+0000","last_became_peered":"2023-11-28T16:58:09.366580+0000","last_unstale":"2023-11-28T16:58:09.369520+0000","last_undegraded":"2023-11-28T16:58:09.369520+0000","last_fullsized":"2023-11-28T16:58:09.369520+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:36.341102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347393+0000","last_change":"2023-11-28T16:57:57.307182+0000","last_active":"2023-11-28T16:58:08.347393+0000","last_peered":"2023-11-28T16:58:08.347393+0000","last_clean":"2023-11-28T16:58:08.347393+0000","last_became_active":"2023-11-28T16:57:57.305143+0000","last_became_peered":"2023-11-28T16:57:57.305143+0000","last_unstale":"2023-11-28T16:58:08.347393+0000","last_undegraded":"2023-11-28T16:58:08.347393+0000","last_fullsized":"2023-11-28T16:58:08.347393+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:16.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345811+0000","last_change":"2023-11-28T16:57:56.298135+0000","last_active":"2023-11-28T16:58:08.345811+0000","last_peered":"2023-11-28T16:58:08.345811+0000","last_clean":"2023-11-28T16:58:08.345811+0000","last_became_active":"2023-11-28T16:57:56.297267+0000","last_became_peered":"2023-11-28T16:57:56.297267+0000","last_unstale":"2023-11-28T16:58:08.345811+0000","last_undegraded":"2023-11-28T16:58:08.345811+0000","last_fullsized":"2023-11-28T16:58:08.345811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:46.168912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346285+0000","last_change":"2023-11-28T16:58:09.346285+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346285+0000","last_undegraded":"2023-11-28T16:58:09.346285+0000","last_fullsized":"2023-11-28T16:58:09.346285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382585+0000","last_change":"2023-11-28T16:58:09.379828+0000","last_active":"2023-11-28T16:58:09.382585+0000","last_peered":"2023-11-28T16:58:09.382585+0000","last_clean":"2023-11-28T16:58:09.382585+0000","last_became_active":"2023-11-28T16:58:09.378437+0000","last_became_peered":"2023-11-28T16:58:09.378437+0000","last_unstale":"2023-11-28T16:58:09.382585+0000","last_undegraded":"2023-11-28T16:58:09.382585+0000","last_fullsized":"2023-11-28T16:58:09.382585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:58.274818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347680+0000","last_change":"2023-11-28T16:57:57.310944+0000","last_active":"2023-11-28T16:58:08.347680+0000","last_peered":"2023-11-28T16:58:08.347680+0000","last_clean":"2023-11-28T16:58:08.347680+0000","last_became_active":"2023-11-28T16:57:57.306481+0000","last_became_peered":"2023-11-28T16:57:57.306481+0000","last_unstale":"2023-11-28T16:58:08.347680+0000","last_undegraded":"2023-11-28T16:58:08.347680+0000","last_fullsized":"2023-11-28T16:58:08.347680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.181027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343825+0000","last_change":"2023-11-28T16:57:56.294742+0000","last_active":"2023-11-28T16:58:08.343825+0000","last_peered":"2023-11-28T16:58:08.343825+0000","last_clean":"2023-11-28T16:58:08.343825+0000","last_became_active":"2023-11-28T16:57:56.294263+0000","last_became_peered":"2023-11-28T16:57:56.294263+0000","last_unstale":"2023-11-28T16:58:08.343825+0000","last_undegraded":"2023-11-28T16:58:08.343825+0000","last_fullsized":"2023-11-28T16:58:08.343825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352949+0000","last_change":"2023-11-28T16:58:09.352949+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352949+0000","last_undegraded":"2023-11-28T16:58:09.352949+0000","last_fullsized":"2023-11-28T16:58:09.352949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373030+0000","last_change":"2023-11-28T16:58:09.370886+0000","last_active":"2023-11-28T16:58:09.373030+0000","last_peered":"2023-11-28T16:58:09.373030+0000","last_clean":"2023-11-28T16:58:09.373030+0000","last_became_active":"2023-11-28T16:58:09.370548+0000","last_became_peered":"2023-11-28T16:58:09.370548+0000","last_unstale":"2023-11-28T16:58:09.373030+0000","last_undegraded":"2023-11-28T16:58:09.373030+0000","last_fullsized":"2023-11-28T16:58:09.373030+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:44.486464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351909+0000","last_change":"2023-11-28T16:57:57.303350+0000","last_active":"2023-11-28T16:58:08.351909+0000","last_peered":"2023-11-28T16:58:08.351909+0000","last_clean":"2023-11-28T16:58:08.351909+0000","last_became_active":"2023-11-28T16:57:57.302817+0000","last_became_peered":"2023-11-28T16:57:57.302817+0000","last_unstale":"2023-11-28T16:58:08.351909+0000","last_undegraded":"2023-11-28T16:58:08.351909+0000","last_fullsized":"2023-11-28T16:58:08.351909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:18.750912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350712+0000","last_change":"2023-11-28T16:57:56.289134+0000","last_active":"2023-11-28T16:58:08.350712+0000","last_peered":"2023-11-28T16:58:08.350712+0000","last_clean":"2023-11-28T16:58:08.350712+0000","last_became_active":"2023-11-28T16:57:56.288857+0000","last_became_peered":"2023-11-28T16:57:56.288857+0000","last_unstale":"2023-11-28T16:58:08.350712+0000","last_undegraded":"2023-11-28T16:58:08.350712+0000","last_fullsized":"2023-11-28T16:58:08.350712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:02.295044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.350692+0000","last_change":"2023-11-28T16:58:09.350692+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.350692+0000","last_undegraded":"2023-11-28T16:58:09.350692+0000","last_fullsized":"2023-11-28T16:58:09.350692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377079+0000","last_change":"2023-11-28T16:58:09.370650+0000","last_active":"2023-11-28T16:58:09.377079+0000","last_peered":"2023-11-28T16:58:09.377079+0000","last_clean":"2023-11-28T16:58:09.377079+0000","last_became_active":"2023-11-28T16:58:09.370449+0000","last_became_peered":"2023-11-28T16:58:09.370449+0000","last_unstale":"2023-11-28T16:58:09.377079+0000","last_undegraded":"2023-11-28T16:58:09.377079+0000","last_fullsized":"2023-11-28T16:58:09.377079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:44:06.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347398+0000","last_change":"2023-11-28T16:57:57.296614+0000","last_active":"2023-11-28T16:58:08.347398+0000","last_peered":"2023-11-28T16:58:08.347398+0000","last_clean":"2023-11-28T16:58:08.347398+0000","last_became_active":"2023-11-28T16:57:57.296296+0000","last_became_peered":"2023-11-28T16:57:57.296296+0000","last_unstale":"2023-11-28T16:58:08.347398+0000","last_undegraded":"2023-11-28T16:58:08.347398+0000","last_fullsized":"2023-11-28T16:58:08.347398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:24.731578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345160+0000","last_change":"2023-11-28T16:57:56.297579+0000","last_active":"2023-11-28T16:58:08.345160+0000","last_peered":"2023-11-28T16:58:08.345160+0000","last_clean":"2023-11-28T16:58:08.345160+0000","last_became_active":"2023-11-28T16:57:56.297237+0000","last_became_peered":"2023-11-28T16:57:56.297237+0000","last_unstale":"2023-11-28T16:58:08.345160+0000","last_undegraded":"2023-11-28T16:58:08.345160+0000","last_fullsized":"2023-11-28T16:58:08.345160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:53.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362168+0000","last_change":"2023-11-28T16:58:09.362168+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362168+0000","last_undegraded":"2023-11-28T16:58:09.362168+0000","last_fullsized":"2023-11-28T16:58:09.362168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373165+0000","last_change":"2023-11-28T16:58:09.371255+0000","last_active":"2023-11-28T16:58:09.373165+0000","last_peered":"2023-11-28T16:58:09.373165+0000","last_clean":"2023-11-28T16:58:09.373165+0000","last_became_active":"2023-11-28T16:58:09.368332+0000","last_became_peered":"2023-11-28T16:58:09.368332+0000","last_unstale":"2023-11-28T16:58:09.373165+0000","last_undegraded":"2023-11-28T16:58:09.373165+0000","last_fullsized":"2023-11-28T16:58:09.373165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:02.313058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345981+0000","last_change":"2023-11-28T16:57:57.288341+0000","last_active":"2023-11-28T16:58:08.345981+0000","last_peered":"2023-11-28T16:58:08.345981+0000","last_clean":"2023-11-28T16:58:08.345981+0000","last_became_active":"2023-11-28T16:57:57.286946+0000","last_became_peered":"2023-11-28T16:57:57.286946+0000","last_unstale":"2023-11-28T16:58:08.345981+0000","last_undegraded":"2023-11-28T16:58:08.345981+0000","last_fullsized":"2023-11-28T16:58:08.345981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:03.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354723+0000","last_change":"2023-11-28T16:57:56.303238+0000","last_active":"2023-11-28T16:58:08.354723+0000","last_peered":"2023-11-28T16:58:08.354723+0000","last_clean":"2023-11-28T16:58:08.354723+0000","last_became_active":"2023-11-28T16:57:56.302991+0000","last_became_peered":"2023-11-28T16:57:56.302991+0000","last_unstale":"2023-11-28T16:58:08.354723+0000","last_undegraded":"2023-11-28T16:58:08.354723+0000","last_fullsized":"2023-11-28T16:58:08.354723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.362301+0000","last_change":"2023-11-28T16:58:09.362301+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.362301+0000","last_undegraded":"2023-11-28T16:58:09.362301+0000","last_fullsized":"2023-11-28T16:58:09.362301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381945+0000","last_change":"2023-11-28T16:58:09.380840+0000","last_active":"2023-11-28T16:58:09.381945+0000","last_peered":"2023-11-28T16:58:09.381945+0000","last_clean":"2023-11-28T16:58:09.381945+0000","last_became_active":"2023-11-28T16:58:09.380365+0000","last_became_peered":"2023-11-28T16:58:09.380365+0000","last_unstale":"2023-11-28T16:58:09.381945+0000","last_undegraded":"2023-11-28T16:58:09.381945+0000","last_fullsized":"2023-11-28T16:58:09.381945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:15.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354639+0000","last_change":"2023-11-28T16:57:57.292344+0000","last_active":"2023-11-28T16:58:08.354639+0000","last_peered":"2023-11-28T16:58:08.354639+0000","last_clean":"2023-11-28T16:58:08.354639+0000","last_became_active":"2023-11-28T16:57:57.291977+0000","last_became_peered":"2023-11-28T16:57:57.291977+0000","last_unstale":"2023-11-28T16:58:08.354639+0000","last_undegraded":"2023-11-28T16:58:08.354639+0000","last_fullsized":"2023-11-28T16:58:08.354639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:35.065157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348241+0000","last_change":"2023-11-28T16:57:56.300060+0000","last_active":"2023-11-28T16:58:08.348241+0000","last_peered":"2023-11-28T16:58:08.348241+0000","last_clean":"2023-11-28T16:58:08.348241+0000","last_became_active":"2023-11-28T16:57:56.299780+0000","last_became_peered":"2023-11-28T16:57:56.299780+0000","last_unstale":"2023-11-28T16:58:08.348241+0000","last_undegraded":"2023-11-28T16:58:08.348241+0000","last_fullsized":"2023-11-28T16:58:08.348241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:18.071987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355503+0000","last_change":"2023-11-28T16:58:09.355503+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355503+0000","last_undegraded":"2023-11-28T16:58:09.355503+0000","last_fullsized":"2023-11-28T16:58:09.355503+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382214+0000","last_change":"2023-11-28T16:58:09.374674+0000","last_active":"2023-11-28T16:58:09.382214+0000","last_peered":"2023-11-28T16:58:09.382214+0000","last_clean":"2023-11-28T16:58:09.382214+0000","last_became_active":"2023-11-28T16:58:09.374379+0000","last_became_peered":"2023-11-28T16:58:09.374379+0000","last_unstale":"2023-11-28T16:58:09.382214+0000","last_undegraded":"2023-11-28T16:58:09.382214+0000","last_fullsized":"2023-11-28T16:58:09.382214+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:34.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351116+0000","last_change":"2023-11-28T16:57:57.291393+0000","last_active":"2023-11-28T16:58:08.351116+0000","last_peered":"2023-11-28T16:58:08.351116+0000","last_clean":"2023-11-28T16:58:08.351116+0000","last_became_active":"2023-11-28T16:57:57.290974+0000","last_became_peered":"2023-11-28T16:57:57.290974+0000","last_unstale":"2023-11-28T16:58:08.351116+0000","last_undegraded":"2023-11-28T16:58:08.351116+0000","last_fullsized":"2023-11-28T16:58:08.351116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:47.176671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349926+0000","last_change":"2023-11-28T16:57:56.293494+0000","last_active":"2023-11-28T16:58:08.349926+0000","last_peered":"2023-11-28T16:58:08.349926+0000","last_clean":"2023-11-28T16:58:08.349926+0000","last_became_active":"2023-11-28T16:57:56.293071+0000","last_became_peered":"2023-11-28T16:57:56.293071+0000","last_unstale":"2023-11-28T16:58:08.349926+0000","last_undegraded":"2023-11-28T16:58:08.349926+0000","last_fullsized":"2023-11-28T16:58:08.349926+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:42.043041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354734+0000","last_change":"2023-11-28T16:58:09.354734+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354734+0000","last_undegraded":"2023-11-28T16:58:09.354734+0000","last_fullsized":"2023-11-28T16:58:09.354734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382996+0000","last_change":"2023-11-28T16:58:09.377961+0000","last_active":"2023-11-28T16:58:09.382996+0000","last_peered":"2023-11-28T16:58:09.382996+0000","last_clean":"2023-11-28T16:58:09.382996+0000","last_became_active":"2023-11-28T16:58:09.377333+0000","last_became_peered":"2023-11-28T16:58:09.377333+0000","last_unstale":"2023-11-28T16:58:09.382996+0000","last_undegraded":"2023-11-28T16:58:09.382996+0000","last_fullsized":"2023-11-28T16:58:09.382996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:36.341102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349756+0000","last_change":"2023-11-28T16:57:57.293148+0000","last_active":"2023-11-28T16:58:08.349756+0000","last_peered":"2023-11-28T16:58:08.349756+0000","last_clean":"2023-11-28T16:58:08.349756+0000","last_became_active":"2023-11-28T16:57:57.292674+0000","last_became_peered":"2023-11-28T16:57:57.292674+0000","last_unstale":"2023-11-28T16:58:08.349756+0000","last_undegraded":"2023-11-28T16:58:08.349756+0000","last_fullsized":"2023-11-28T16:58:08.349756+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345673+0000","last_change":"2023-11-28T16:57:56.289047+0000","last_active":"2023-11-28T16:58:08.345673+0000","last_peered":"2023-11-28T16:58:08.345673+0000","last_clean":"2023-11-28T16:58:08.345673+0000","last_became_active":"2023-11-28T16:57:56.288333+0000","last_became_peered":"2023-11-28T16:57:56.288333+0000","last_unstale":"2023-11-28T16:58:08.345673+0000","last_undegraded":"2023-11-28T16:58:08.345673+0000","last_fullsized":"2023-11-28T16:58:08.345673+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:55.749727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346336+0000","last_change":"2023-11-28T16:58:09.346336+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346336+0000","last_undegraded":"2023-11-28T16:58:09.346336+0000","last_fullsized":"2023-11-28T16:58:09.346336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.376700+0000","last_change":"2023-11-28T16:58:09.369628+0000","last_active":"2023-11-28T16:58:09.376700+0000","last_peered":"2023-11-28T16:58:09.376700+0000","last_clean":"2023-11-28T16:58:09.376700+0000","last_became_active":"2023-11-28T16:58:09.369340+0000","last_became_peered":"2023-11-28T16:58:09.369340+0000","last_unstale":"2023-11-28T16:58:09.376700+0000","last_undegraded":"2023-11-28T16:58:09.376700+0000","last_fullsized":"2023-11-28T16:58:09.376700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:21.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351274+0000","last_change":"2023-11-28T16:57:57.306068+0000","last_active":"2023-11-28T16:58:08.351274+0000","last_peered":"2023-11-28T16:58:08.351274+0000","last_clean":"2023-11-28T16:58:08.351274+0000","last_became_active":"2023-11-28T16:57:57.305881+0000","last_became_peered":"2023-11-28T16:57:57.305881+0000","last_unstale":"2023-11-28T16:58:08.351274+0000","last_undegraded":"2023-11-28T16:58:08.351274+0000","last_fullsized":"2023-11-28T16:58:08.351274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:39.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347714+0000","last_change":"2023-11-28T16:57:56.297847+0000","last_active":"2023-11-28T16:58:08.347714+0000","last_peered":"2023-11-28T16:58:08.347714+0000","last_clean":"2023-11-28T16:58:08.347714+0000","last_became_active":"2023-11-28T16:57:56.297578+0000","last_became_peered":"2023-11-28T16:57:56.297578+0000","last_unstale":"2023-11-28T16:58:08.347714+0000","last_undegraded":"2023-11-28T16:58:08.347714+0000","last_fullsized":"2023-11-28T16:58:08.347714+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.329569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.363329+0000","last_change":"2023-11-28T16:58:09.363329+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.363329+0000","last_undegraded":"2023-11-28T16:58:09.363329+0000","last_fullsized":"2023-11-28T16:58:09.363329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.368283+0000","last_change":"2023-11-28T16:58:09.362708+0000","last_active":"2023-11-28T16:58:09.368283+0000","last_peered":"2023-11-28T16:58:09.368283+0000","last_clean":"2023-11-28T16:58:09.368283+0000","last_became_active":"2023-11-28T16:58:09.362441+0000","last_became_peered":"2023-11-28T16:58:09.362441+0000","last_unstale":"2023-11-28T16:58:09.368283+0000","last_undegraded":"2023-11-28T16:58:09.368283+0000","last_fullsized":"2023-11-28T16:58:09.368283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:52.069042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350367+0000","last_change":"2023-11-28T16:57:57.295241+0000","last_active":"2023-11-28T16:58:08.350367+0000","last_peered":"2023-11-28T16:58:08.350367+0000","last_clean":"2023-11-28T16:58:08.350367+0000","last_became_active":"2023-11-28T16:57:57.295059+0000","last_became_peered":"2023-11-28T16:57:57.295059+0000","last_unstale":"2023-11-28T16:58:08.350367+0000","last_undegraded":"2023-11-28T16:58:08.350367+0000","last_fullsized":"2023-11-28T16:58:08.350367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.353743+0000","last_change":"2023-11-28T16:57:56.292527+0000","last_active":"2023-11-28T16:58:08.353743+0000","last_peered":"2023-11-28T16:58:08.353743+0000","last_clean":"2023-11-28T16:58:08.353743+0000","last_became_active":"2023-11-28T16:57:56.292280+0000","last_became_peered":"2023-11-28T16:57:56.292280+0000","last_unstale":"2023-11-28T16:58:08.353743+0000","last_undegraded":"2023-11-28T16:58:08.353743+0000","last_fullsized":"2023-11-28T16:58:08.353743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:36.146016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352850+0000","last_change":"2023-11-28T16:58:09.352850+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352850+0000","last_undegraded":"2023-11-28T16:58:09.352850+0000","last_fullsized":"2023-11-28T16:58:09.352850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.373223+0000","last_change":"2023-11-28T16:58:09.370461+0000","last_active":"2023-11-28T16:58:09.373223+0000","last_peered":"2023-11-28T16:58:09.373223+0000","last_clean":"2023-11-28T16:58:09.373223+0000","last_became_active":"2023-11-28T16:58:09.370211+0000","last_became_peered":"2023-11-28T16:58:09.370211+0000","last_unstale":"2023-11-28T16:58:09.373223+0000","last_undegraded":"2023-11-28T16:58:09.373223+0000","last_fullsized":"2023-11-28T16:58:09.373223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:15.375230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345121+0000","last_change":"2023-11-28T16:57:57.292399+0000","last_active":"2023-11-28T16:58:08.345121+0000","last_peered":"2023-11-28T16:58:08.345121+0000","last_clean":"2023-11-28T16:58:08.345121+0000","last_became_active":"2023-11-28T16:57:57.291492+0000","last_became_peered":"2023-11-28T16:57:57.291492+0000","last_unstale":"2023-11-28T16:58:08.345121+0000","last_undegraded":"2023-11-28T16:58:08.345121+0000","last_fullsized":"2023-11-28T16:58:08.345121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350796+0000","last_change":"2023-11-28T16:57:56.288401+0000","last_active":"2023-11-28T16:58:08.350796+0000","last_peered":"2023-11-28T16:58:08.350796+0000","last_clean":"2023-11-28T16:58:08.350796+0000","last_became_active":"2023-11-28T16:57:56.288046+0000","last_became_peered":"2023-11-28T16:57:56.288046+0000","last_unstale":"2023-11-28T16:58:08.350796+0000","last_undegraded":"2023-11-28T16:58:08.350796+0000","last_fullsized":"2023-11-28T16:58:08.350796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:23.260917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354576+0000","last_change":"2023-11-28T16:58:09.354576+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354576+0000","last_undegraded":"2023-11-28T16:58:09.354576+0000","last_fullsized":"2023-11-28T16:58:09.354576+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.383025+0000","last_change":"2023-11-28T16:58:09.381709+0000","last_active":"2023-11-28T16:58:09.383025+0000","last_peered":"2023-11-28T16:58:09.383025+0000","last_clean":"2023-11-28T16:58:09.383025+0000","last_became_active":"2023-11-28T16:58:09.381442+0000","last_became_peered":"2023-11-28T16:58:09.381442+0000","last_unstale":"2023-11-28T16:58:09.383025+0000","last_undegraded":"2023-11-28T16:58:09.383025+0000","last_fullsized":"2023-11-28T16:58:09.383025+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:41.188588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349420+0000","last_change":"2023-11-28T16:57:57.300273+0000","last_active":"2023-11-28T16:58:08.349420+0000","last_peered":"2023-11-28T16:58:08.349420+0000","last_clean":"2023-11-28T16:58:08.349420+0000","last_became_active":"2023-11-28T16:57:57.300005+0000","last_became_peered":"2023-11-28T16:57:57.300005+0000","last_unstale":"2023-11-28T16:58:08.349420+0000","last_undegraded":"2023-11-28T16:58:08.349420+0000","last_fullsized":"2023-11-28T16:58:08.349420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348406+0000","last_change":"2023-11-28T16:57:56.297211+0000","last_active":"2023-11-28T16:58:08.348406+0000","last_peered":"2023-11-28T16:58:08.348406+0000","last_clean":"2023-11-28T16:58:08.348406+0000","last_became_active":"2023-11-28T16:57:56.296321+0000","last_became_peered":"2023-11-28T16:57:56.296321+0000","last_unstale":"2023-11-28T16:58:08.348406+0000","last_undegraded":"2023-11-28T16:58:08.348406+0000","last_fullsized":"2023-11-28T16:58:08.348406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355743+0000","last_change":"2023-11-28T16:58:09.355743+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355743+0000","last_undegraded":"2023-11-28T16:58:09.355743+0000","last_fullsized":"2023-11-28T16:58:09.355743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382085+0000","last_change":"2023-11-28T16:58:09.372355+0000","last_active":"2023-11-28T16:58:09.382085+0000","last_peered":"2023-11-28T16:58:09.382085+0000","last_clean":"2023-11-28T16:58:09.382085+0000","last_became_active":"2023-11-28T16:58:09.372007+0000","last_became_peered":"2023-11-28T16:58:09.372007+0000","last_unstale":"2023-11-28T16:58:09.382085+0000","last_undegraded":"2023-11-28T16:58:09.382085+0000","last_fullsized":"2023-11-28T16:58:09.382085+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:15.375230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350796+0000","last_change":"2023-11-28T16:57:57.294684+0000","last_active":"2023-11-28T16:58:08.350796+0000","last_peered":"2023-11-28T16:58:08.350796+0000","last_clean":"2023-11-28T16:58:08.350796+0000","last_became_active":"2023-11-28T16:57:57.294339+0000","last_became_peered":"2023-11-28T16:57:57.294339+0000","last_unstale":"2023-11-28T16:58:08.350796+0000","last_undegraded":"2023-11-28T16:58:08.350796+0000","last_fullsized":"2023-11-28T16:58:08.350796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:19.079746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.348704+0000","last_change":"2023-11-28T16:57:56.302265+0000","last_active":"2023-11-28T16:58:08.348704+0000","last_peered":"2023-11-28T16:58:08.348704+0000","last_clean":"2023-11-28T16:58:08.348704+0000","last_became_active":"2023-11-28T16:57:56.301960+0000","last_became_peered":"2023-11-28T16:57:56.301960+0000","last_unstale":"2023-11-28T16:58:08.348704+0000","last_undegraded":"2023-11-28T16:58:08.348704+0000","last_fullsized":"2023-11-28T16:58:08.348704+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:36.131374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355335+0000","last_change":"2023-11-28T16:58:09.355335+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355335+0000","last_undegraded":"2023-11-28T16:58:09.355335+0000","last_fullsized":"2023-11-28T16:58:09.355335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.365065+0000","last_change":"2023-11-28T16:58:09.358618+0000","last_active":"2023-11-28T16:58:09.365065+0000","last_peered":"2023-11-28T16:58:09.365065+0000","last_clean":"2023-11-28T16:58:09.365065+0000","last_became_active":"2023-11-28T16:58:09.358326+0000","last_became_peered":"2023-11-28T16:58:09.358326+0000","last_unstale":"2023-11-28T16:58:09.365065+0000","last_undegraded":"2023-11-28T16:58:09.365065+0000","last_fullsized":"2023-11-28T16:58:09.365065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354317+0000","last_change":"2023-11-28T16:57:57.296609+0000","last_active":"2023-11-28T16:58:08.354317+0000","last_peered":"2023-11-28T16:58:08.354317+0000","last_clean":"2023-11-28T16:58:08.354317+0000","last_became_active":"2023-11-28T16:57:57.296304+0000","last_became_peered":"2023-11-28T16:57:57.296304+0000","last_unstale":"2023-11-28T16:58:08.354317+0000","last_undegraded":"2023-11-28T16:58:08.354317+0000","last_fullsized":"2023-11-28T16:58:08.354317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:27.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344293+0000","last_change":"2023-11-28T16:57:56.296905+0000","last_active":"2023-11-28T16:58:08.344293+0000","last_peered":"2023-11-28T16:58:08.344293+0000","last_clean":"2023-11-28T16:58:08.344293+0000","last_became_active":"2023-11-28T16:57:56.295819+0000","last_became_peered":"2023-11-28T16:57:56.295819+0000","last_unstale":"2023-11-28T16:58:08.344293+0000","last_undegraded":"2023-11-28T16:58:08.344293+0000","last_fullsized":"2023-11-28T16:58:08.344293+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.350168+0000","last_change":"2023-11-28T16:58:09.350168+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.350168+0000","last_undegraded":"2023-11-28T16:58:09.350168+0000","last_fullsized":"2023-11-28T16:58:09.350168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382384+0000","last_change":"2023-11-28T16:58:09.375035+0000","last_active":"2023-11-28T16:58:09.382384+0000","last_peered":"2023-11-28T16:58:09.382384+0000","last_clean":"2023-11-28T16:58:09.382384+0000","last_became_active":"2023-11-28T16:58:09.374689+0000","last_became_peered":"2023-11-28T16:58:09.374689+0000","last_unstale":"2023-11-28T16:58:09.382384+0000","last_undegraded":"2023-11-28T16:58:09.382384+0000","last_fullsized":"2023-11-28T16:58:09.382384+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:05.414794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347855+0000","last_change":"2023-11-28T16:57:57.297238+0000","last_active":"2023-11-28T16:58:08.347855+0000","last_peered":"2023-11-28T16:58:08.347855+0000","last_clean":"2023-11-28T16:58:08.347855+0000","last_became_active":"2023-11-28T16:57:57.296895+0000","last_became_peered":"2023-11-28T16:57:57.296895+0000","last_unstale":"2023-11-28T16:58:08.347855+0000","last_undegraded":"2023-11-28T16:58:08.347855+0000","last_fullsized":"2023-11-28T16:58:08.347855+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:47.232224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351979+0000","last_change":"2023-11-28T16:57:56.292453+0000","last_active":"2023-11-28T16:58:08.351979+0000","last_peered":"2023-11-28T16:58:08.351979+0000","last_clean":"2023-11-28T16:58:08.351979+0000","last_became_active":"2023-11-28T16:57:56.292147+0000","last_became_peered":"2023-11-28T16:57:56.292147+0000","last_unstale":"2023-11-28T16:58:08.351979+0000","last_undegraded":"2023-11-28T16:58:08.351979+0000","last_fullsized":"2023-11-28T16:58:08.351979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351588+0000","last_change":"2023-11-28T16:58:09.351588+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351588+0000","last_undegraded":"2023-11-28T16:58:09.351588+0000","last_fullsized":"2023-11-28T16:58:09.351588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382180+0000","last_change":"2023-11-28T16:58:09.374106+0000","last_active":"2023-11-28T16:58:09.382180+0000","last_peered":"2023-11-28T16:58:09.382180+0000","last_clean":"2023-11-28T16:58:09.382180+0000","last_became_active":"2023-11-28T16:58:09.373822+0000","last_became_peered":"2023-11-28T16:58:09.373822+0000","last_unstale":"2023-11-28T16:58:09.382180+0000","last_undegraded":"2023-11-28T16:58:09.382180+0000","last_fullsized":"2023-11-28T16:58:09.382180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:39.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.349836+0000","last_change":"2023-11-28T16:57:57.292951+0000","last_active":"2023-11-28T16:58:08.349836+0000","last_peered":"2023-11-28T16:58:08.349836+0000","last_clean":"2023-11-28T16:58:08.349836+0000","last_became_active":"2023-11-28T16:57:57.292254+0000","last_became_peered":"2023-11-28T16:57:57.292254+0000","last_unstale":"2023-11-28T16:58:08.349836+0000","last_undegraded":"2023-11-28T16:58:08.349836+0000","last_fullsized":"2023-11-28T16:58:08.349836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:07.921821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344263+0000","last_change":"2023-11-28T16:57:56.301392+0000","last_active":"2023-11-28T16:58:08.344263+0000","last_peered":"2023-11-28T16:58:08.344263+0000","last_clean":"2023-11-28T16:58:08.344263+0000","last_became_active":"2023-11-28T16:57:56.300939+0000","last_became_peered":"2023-11-28T16:57:56.300939+0000","last_unstale":"2023-11-28T16:58:08.344263+0000","last_undegraded":"2023-11-28T16:58:08.344263+0000","last_fullsized":"2023-11-28T16:58:08.344263+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:05.783524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352898+0000","last_change":"2023-11-28T16:58:09.352898+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352898+0000","last_undegraded":"2023-11-28T16:58:09.352898+0000","last_fullsized":"2023-11-28T16:58:09.352898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382829+0000","last_change":"2023-11-28T16:58:09.381243+0000","last_active":"2023-11-28T16:58:09.382829+0000","last_peered":"2023-11-28T16:58:09.382829+0000","last_clean":"2023-11-28T16:58:09.382829+0000","last_became_active":"2023-11-28T16:58:09.381035+0000","last_became_peered":"2023-11-28T16:58:09.381035+0000","last_unstale":"2023-11-28T16:58:09.382829+0000","last_undegraded":"2023-11-28T16:58:09.382829+0000","last_fullsized":"2023-11-28T16:58:09.382829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351364+0000","last_change":"2023-11-28T16:57:57.304252+0000","last_active":"2023-11-28T16:58:08.351364+0000","last_peered":"2023-11-28T16:58:08.351364+0000","last_clean":"2023-11-28T16:58:08.351364+0000","last_became_active":"2023-11-28T16:57:57.303963+0000","last_became_peered":"2023-11-28T16:57:57.303963+0000","last_unstale":"2023-11-28T16:58:08.351364+0000","last_undegraded":"2023-11-28T16:58:08.351364+0000","last_fullsized":"2023-11-28T16:58:08.351364+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:08.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347804+0000","last_change":"2023-11-28T16:57:56.291678+0000","last_active":"2023-11-28T16:58:08.347804+0000","last_peered":"2023-11-28T16:58:08.347804+0000","last_clean":"2023-11-28T16:58:08.347804+0000","last_became_active":"2023-11-28T16:57:56.289787+0000","last_became_peered":"2023-11-28T16:57:56.289787+0000","last_unstale":"2023-11-28T16:58:08.347804+0000","last_undegraded":"2023-11-28T16:58:08.347804+0000","last_fullsized":"2023-11-28T16:58:08.347804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:08.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.353794+0000","last_change":"2023-11-28T16:58:09.353794+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.353794+0000","last_undegraded":"2023-11-28T16:58:09.353794+0000","last_fullsized":"2023-11-28T16:58:09.353794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.378897+0000","last_change":"2023-11-28T16:58:09.376563+0000","last_active":"2023-11-28T16:58:09.378897+0000","last_peered":"2023-11-28T16:58:09.378897+0000","last_clean":"2023-11-28T16:58:09.378897+0000","last_became_active":"2023-11-28T16:58:09.376234+0000","last_became_peered":"2023-11-28T16:58:09.376234+0000","last_unstale":"2023-11-28T16:58:09.378897+0000","last_undegraded":"2023-11-28T16:58:09.378897+0000","last_fullsized":"2023-11-28T16:58:09.378897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343599+0000","last_change":"2023-11-28T16:57:57.294132+0000","last_active":"2023-11-28T16:58:08.343599+0000","last_peered":"2023-11-28T16:58:08.343599+0000","last_clean":"2023-11-28T16:58:08.343599+0000","last_became_active":"2023-11-28T16:57:57.293808+0000","last_became_peered":"2023-11-28T16:57:57.293808+0000","last_unstale":"2023-11-28T16:58:08.343599+0000","last_undegraded":"2023-11-28T16:58:08.343599+0000","last_fullsized":"2023-11-28T16:58:08.343599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351032+0000","last_change":"2023-11-28T16:57:56.299832+0000","last_active":"2023-11-28T16:58:08.351032+0000","last_peered":"2023-11-28T16:58:08.351032+0000","last_clean":"2023-11-28T16:58:08.351032+0000","last_became_active":"2023-11-28T16:57:56.299505+0000","last_became_peered":"2023-11-28T16:57:56.299505+0000","last_unstale":"2023-11-28T16:58:08.351032+0000","last_undegraded":"2023-11-28T16:58:08.351032+0000","last_fullsized":"2023-11-28T16:58:08.351032+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:26.104747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359572+0000","last_change":"2023-11-28T16:58:09.359572+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359572+0000","last_undegraded":"2023-11-28T16:58:09.359572+0000","last_fullsized":"2023-11-28T16:58:09.359572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.377101+0000","last_change":"2023-11-28T16:58:09.370643+0000","last_active":"2023-11-28T16:58:09.377101+0000","last_peered":"2023-11-28T16:58:09.377101+0000","last_clean":"2023-11-28T16:58:09.377101+0000","last_became_active":"2023-11-28T16:58:09.370427+0000","last_became_peered":"2023-11-28T16:58:09.370427+0000","last_unstale":"2023-11-28T16:58:09.377101+0000","last_undegraded":"2023-11-28T16:58:09.377101+0000","last_fullsized":"2023-11-28T16:58:09.377101+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:19.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.343630+0000","last_change":"2023-11-28T16:57:57.294705+0000","last_active":"2023-11-28T16:58:08.343630+0000","last_peered":"2023-11-28T16:58:08.343630+0000","last_clean":"2023-11-28T16:58:08.343630+0000","last_became_active":"2023-11-28T16:57:57.294386+0000","last_became_peered":"2023-11-28T16:57:57.294386+0000","last_unstale":"2023-11-28T16:58:08.343630+0000","last_undegraded":"2023-11-28T16:58:08.343630+0000","last_fullsized":"2023-11-28T16:58:08.343630+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350509+0000","last_change":"2023-11-28T16:57:56.303059+0000","last_active":"2023-11-28T16:58:08.350509+0000","last_peered":"2023-11-28T16:58:08.350509+0000","last_clean":"2023-11-28T16:58:08.350509+0000","last_became_active":"2023-11-28T16:57:56.302716+0000","last_became_peered":"2023-11-28T16:57:56.302716+0000","last_unstale":"2023-11-28T16:58:08.350509+0000","last_undegraded":"2023-11-28T16:58:08.350509+0000","last_fullsized":"2023-11-28T16:58:08.350509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.351550+0000","last_change":"2023-11-28T16:58:09.351550+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.351550+0000","last_undegraded":"2023-11-28T16:58:09.351550+0000","last_fullsized":"2023-11-28T16:58:09.351550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381585+0000","last_change":"2023-11-28T16:58:09.379068+0000","last_active":"2023-11-28T16:58:09.381585+0000","last_peered":"2023-11-28T16:58:09.381585+0000","last_clean":"2023-11-28T16:58:09.381585+0000","last_became_active":"2023-11-28T16:58:09.378744+0000","last_became_peered":"2023-11-28T16:58:09.378744+0000","last_unstale":"2023-11-28T16:58:09.381585+0000","last_undegraded":"2023-11-28T16:58:09.381585+0000","last_fullsized":"2023-11-28T16:58:09.381585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:16.766683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354622+0000","last_change":"2023-11-28T16:57:57.310134+0000","last_active":"2023-11-28T16:58:08.354622+0000","last_peered":"2023-11-28T16:58:08.354622+0000","last_clean":"2023-11-28T16:58:08.354622+0000","last_became_active":"2023-11-28T16:57:57.309858+0000","last_became_peered":"2023-11-28T16:57:57.309858+0000","last_unstale":"2023-11-28T16:58:08.354622+0000","last_undegraded":"2023-11-28T16:58:08.354622+0000","last_fullsized":"2023-11-28T16:58:08.354622+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:43.751157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351569+0000","last_change":"2023-11-28T16:57:56.289398+0000","last_active":"2023-11-28T16:58:08.351569+0000","last_peered":"2023-11-28T16:58:08.351569+0000","last_clean":"2023-11-28T16:58:08.351569+0000","last_became_active":"2023-11-28T16:57:56.289082+0000","last_became_peered":"2023-11-28T16:57:56.289082+0000","last_unstale":"2023-11-28T16:58:08.351569+0000","last_undegraded":"2023-11-28T16:58:08.351569+0000","last_fullsized":"2023-11-28T16:58:08.351569+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:34.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352786+0000","last_change":"2023-11-28T16:58:09.352786+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352786+0000","last_undegraded":"2023-11-28T16:58:09.352786+0000","last_fullsized":"2023-11-28T16:58:09.352786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.364251+0000","last_change":"2023-11-28T16:58:09.358558+0000","last_active":"2023-11-28T16:58:09.364251+0000","last_peered":"2023-11-28T16:58:09.364251+0000","last_clean":"2023-11-28T16:58:09.364251+0000","last_became_active":"2023-11-28T16:58:09.358275+0000","last_became_peered":"2023-11-28T16:58:09.358275+0000","last_unstale":"2023-11-28T16:58:09.364251+0000","last_undegraded":"2023-11-28T16:58:09.364251+0000","last_fullsized":"2023-11-28T16:58:09.364251+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:58.060491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.354414+0000","last_change":"2023-11-28T16:57:57.302840+0000","last_active":"2023-11-28T16:58:08.354414+0000","last_peered":"2023-11-28T16:58:08.354414+0000","last_clean":"2023-11-28T16:58:08.354414+0000","last_became_active":"2023-11-28T16:57:57.302446+0000","last_became_peered":"2023-11-28T16:57:57.302446+0000","last_unstale":"2023-11-28T16:58:08.354414+0000","last_undegraded":"2023-11-28T16:58:08.354414+0000","last_fullsized":"2023-11-28T16:58:08.354414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:06.791283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344352+0000","last_change":"2023-11-28T16:57:56.295304+0000","last_active":"2023-11-28T16:58:08.344352+0000","last_peered":"2023-11-28T16:58:08.344352+0000","last_clean":"2023-11-28T16:58:08.344352+0000","last_became_active":"2023-11-28T16:57:56.295041+0000","last_became_peered":"2023-11-28T16:57:56.295041+0000","last_unstale":"2023-11-28T16:58:08.344352+0000","last_undegraded":"2023-11-28T16:58:08.344352+0000","last_fullsized":"2023-11-28T16:58:08.344352+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.346442+0000","last_change":"2023-11-28T16:58:09.346442+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.346442+0000","last_undegraded":"2023-11-28T16:58:09.346442+0000","last_fullsized":"2023-11-28T16:58:09.346442+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.383002+0000","last_change":"2023-11-28T16:58:09.378133+0000","last_active":"2023-11-28T16:58:09.383002+0000","last_peered":"2023-11-28T16:58:09.383002+0000","last_clean":"2023-11-28T16:58:09.383002+0000","last_became_active":"2023-11-28T16:58:09.377825+0000","last_became_peered":"2023-11-28T16:58:09.377825+0000","last_unstale":"2023-11-28T16:58:09.383002+0000","last_undegraded":"2023-11-28T16:58:09.383002+0000","last_fullsized":"2023-11-28T16:58:09.383002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:46.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.351143+0000","last_change":"2023-11-28T16:57:57.285348+0000","last_active":"2023-11-28T16:58:08.351143+0000","last_peered":"2023-11-28T16:58:08.351143+0000","last_clean":"2023-11-28T16:58:08.351143+0000","last_became_active":"2023-11-28T16:57:57.285004+0000","last_became_peered":"2023-11-28T16:57:57.285004+0000","last_unstale":"2023-11-28T16:58:08.351143+0000","last_undegraded":"2023-11-28T16:58:08.351143+0000","last_fullsized":"2023-11-28T16:58:08.351143+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:56.757486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.355091+0000","last_change":"2023-11-28T16:57:56.291833+0000","last_active":"2023-11-28T16:58:08.355091+0000","last_peered":"2023-11-28T16:58:08.355091+0000","last_clean":"2023-11-28T16:58:08.355091+0000","last_became_active":"2023-11-28T16:57:56.291493+0000","last_became_peered":"2023-11-28T16:57:56.291493+0000","last_unstale":"2023-11-28T16:58:08.355091+0000","last_undegraded":"2023-11-28T16:58:08.355091+0000","last_fullsized":"2023-11-28T16:58:08.355091+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:36.485569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355205+0000","last_change":"2023-11-28T16:58:09.355205+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355205+0000","last_undegraded":"2023-11-28T16:58:09.355205+0000","last_fullsized":"2023-11-28T16:58:09.355205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.376688+0000","last_change":"2023-11-28T16:58:09.366789+0000","last_active":"2023-11-28T16:58:09.376688+0000","last_peered":"2023-11-28T16:58:09.376688+0000","last_clean":"2023-11-28T16:58:09.376688+0000","last_became_active":"2023-11-28T16:58:09.366058+0000","last_became_peered":"2023-11-28T16:58:09.366058+0000","last_unstale":"2023-11-28T16:58:09.376688+0000","last_undegraded":"2023-11-28T16:58:09.376688+0000","last_fullsized":"2023-11-28T16:58:09.376688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:47.534548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.344265+0000","last_change":"2023-11-28T16:57:57.294725+0000","last_active":"2023-11-28T16:58:08.344265+0000","last_peered":"2023-11-28T16:58:08.344265+0000","last_clean":"2023-11-28T16:58:08.344265+0000","last_became_active":"2023-11-28T16:57:57.294368+0000","last_became_peered":"2023-11-28T16:57:57.294368+0000","last_unstale":"2023-11-28T16:58:08.344265+0000","last_undegraded":"2023-11-28T16:58:08.344265+0000","last_fullsized":"2023-11-28T16:58:08.344265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352261+0000","last_change":"2023-11-28T16:57:56.295240+0000","last_active":"2023-11-28T16:58:08.352261+0000","last_peered":"2023-11-28T16:58:08.352261+0000","last_clean":"2023-11-28T16:58:08.352261+0000","last_became_active":"2023-11-28T16:57:56.292758+0000","last_became_peered":"2023-11-28T16:57:56.292758+0000","last_unstale":"2023-11-28T16:58:08.352261+0000","last_undegraded":"2023-11-28T16:58:08.352261+0000","last_fullsized":"2023-11-28T16:58:08.352261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.352661+0000","last_change":"2023-11-28T16:58:09.352661+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.352661+0000","last_undegraded":"2023-11-28T16:58:09.352661+0000","last_fullsized":"2023-11-28T16:58:09.352661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.365162+0000","last_change":"2023-11-28T16:58:09.356981+0000","last_active":"2023-11-28T16:58:09.365162+0000","last_peered":"2023-11-28T16:58:09.365162+0000","last_clean":"2023-11-28T16:58:09.365162+0000","last_became_active":"2023-11-28T16:58:09.356658+0000","last_became_peered":"2023-11-28T16:58:09.356658+0000","last_unstale":"2023-11-28T16:58:09.365162+0000","last_undegraded":"2023-11-28T16:58:09.365162+0000","last_fullsized":"2023-11-28T16:58:09.365162+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:20.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347589+0000","last_change":"2023-11-28T16:57:57.306973+0000","last_active":"2023-11-28T16:58:08.347589+0000","last_peered":"2023-11-28T16:58:08.347589+0000","last_clean":"2023-11-28T16:58:08.347589+0000","last_became_active":"2023-11-28T16:57:57.304696+0000","last_became_peered":"2023-11-28T16:57:57.304696+0000","last_unstale":"2023-11-28T16:58:08.347589+0000","last_undegraded":"2023-11-28T16:58:08.347589+0000","last_fullsized":"2023-11-28T16:58:08.347589+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.596110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350902+0000","last_change":"2023-11-28T16:57:56.293462+0000","last_active":"2023-11-28T16:58:08.350902+0000","last_peered":"2023-11-28T16:58:08.350902+0000","last_clean":"2023-11-28T16:58:08.350902+0000","last_became_active":"2023-11-28T16:57:56.293039+0000","last_became_peered":"2023-11-28T16:57:56.293039+0000","last_unstale":"2023-11-28T16:58:08.350902+0000","last_undegraded":"2023-11-28T16:58:08.350902+0000","last_fullsized":"2023-11-28T16:58:08.350902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:40.083816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.359972+0000","last_change":"2023-11-28T16:58:09.359972+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.359972+0000","last_undegraded":"2023-11-28T16:58:09.359972+0000","last_fullsized":"2023-11-28T16:58:09.359972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382416+0000","last_change":"2023-11-28T16:58:09.375351+0000","last_active":"2023-11-28T16:58:09.382416+0000","last_peered":"2023-11-28T16:58:09.382416+0000","last_clean":"2023-11-28T16:58:09.382416+0000","last_became_active":"2023-11-28T16:58:09.375020+0000","last_became_peered":"2023-11-28T16:58:09.375020+0000","last_unstale":"2023-11-28T16:58:09.382416+0000","last_undegraded":"2023-11-28T16:58:09.382416+0000","last_fullsized":"2023-11-28T16:58:09.382416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:12:09.510947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350448+0000","last_change":"2023-11-28T16:57:57.307851+0000","last_active":"2023-11-28T16:58:08.350448+0000","last_peered":"2023-11-28T16:58:08.350448+0000","last_clean":"2023-11-28T16:58:08.350448+0000","last_became_active":"2023-11-28T16:57:57.307208+0000","last_became_peered":"2023-11-28T16:57:57.307208+0000","last_unstale":"2023-11-28T16:58:08.350448+0000","last_undegraded":"2023-11-28T16:58:08.350448+0000","last_fullsized":"2023-11-28T16:58:08.350448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.345623+0000","last_change":"2023-11-28T16:57:56.286826+0000","last_active":"2023-11-28T16:58:08.345623+0000","last_peered":"2023-11-28T16:58:08.345623+0000","last_clean":"2023-11-28T16:58:08.345623+0000","last_became_active":"2023-11-28T16:57:56.286506+0000","last_became_peered":"2023-11-28T16:57:56.286506+0000","last_unstale":"2023-11-28T16:58:08.345623+0000","last_undegraded":"2023-11-28T16:58:08.345623+0000","last_fullsized":"2023-11-28T16:58:08.345623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:28.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.354653+0000","last_change":"2023-11-28T16:58:09.354653+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.354653+0000","last_undegraded":"2023-11-28T16:58:09.354653+0000","last_fullsized":"2023-11-28T16:58:09.354653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.381105+0000","last_change":"2023-11-28T16:58:09.376587+0000","last_active":"2023-11-28T16:58:09.381105+0000","last_peered":"2023-11-28T16:58:09.381105+0000","last_clean":"2023-11-28T16:58:09.381105+0000","last_became_active":"2023-11-28T16:58:09.376044+0000","last_became_peered":"2023-11-28T16:58:09.376044+0000","last_unstale":"2023-11-28T16:58:09.381105+0000","last_undegraded":"2023-11-28T16:58:09.381105+0000","last_fullsized":"2023-11-28T16:58:09.381105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:51:04.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350673+0000","last_change":"2023-11-28T16:57:57.293525+0000","last_active":"2023-11-28T16:58:08.350673+0000","last_peered":"2023-11-28T16:58:08.350673+0000","last_clean":"2023-11-28T16:58:08.350673+0000","last_became_active":"2023-11-28T16:57:57.293155+0000","last_became_peered":"2023-11-28T16:57:57.293155+0000","last_unstale":"2023-11-28T16:58:08.350673+0000","last_undegraded":"2023-11-28T16:58:08.350673+0000","last_fullsized":"2023-11-28T16:58:08.350673+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:54.496874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.350841+0000","last_change":"2023-11-28T16:57:56.289797+0000","last_active":"2023-11-28T16:58:08.350841+0000","last_peered":"2023-11-28T16:58:08.350841+0000","last_clean":"2023-11-28T16:58:08.350841+0000","last_became_active":"2023-11-28T16:57:56.286507+0000","last_became_peered":"2023-11-28T16:57:56.286507+0000","last_unstale":"2023-11-28T16:58:08.350841+0000","last_undegraded":"2023-11-28T16:58:08.350841+0000","last_fullsized":"2023-11-28T16:58:08.350841+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:55.952116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.360939+0000","last_change":"2023-11-28T16:58:09.360939+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.360939+0000","last_undegraded":"2023-11-28T16:58:09.360939+0000","last_fullsized":"2023-11-28T16:58:09.360939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.371695+0000","last_change":"2023-11-28T16:58:09.366936+0000","last_active":"2023-11-28T16:58:09.371695+0000","last_peered":"2023-11-28T16:58:09.371695+0000","last_clean":"2023-11-28T16:58:09.371695+0000","last_became_active":"2023-11-28T16:58:09.366532+0000","last_became_peered":"2023-11-28T16:58:09.366532+0000","last_unstale":"2023-11-28T16:58:09.371695+0000","last_undegraded":"2023-11-28T16:58:09.371695+0000","last_fullsized":"2023-11-28T16:58:09.371695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:05.414794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347366+0000","last_change":"2023-11-28T16:57:57.295933+0000","last_active":"2023-11-28T16:58:08.347366+0000","last_peered":"2023-11-28T16:58:08.347366+0000","last_clean":"2023-11-28T16:58:08.347366+0000","last_became_active":"2023-11-28T16:57:57.295567+0000","last_became_peered":"2023-11-28T16:57:57.295567+0000","last_unstale":"2023-11-28T16:58:08.347366+0000","last_undegraded":"2023-11-28T16:58:08.347366+0000","last_fullsized":"2023-11-28T16:58:08.347366+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:13.997222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347522+0000","last_change":"2023-11-28T16:57:56.296292+0000","last_active":"2023-11-28T16:58:08.347522+0000","last_peered":"2023-11-28T16:58:08.347522+0000","last_clean":"2023-11-28T16:58:08.347522+0000","last_became_active":"2023-11-28T16:57:56.295958+0000","last_became_peered":"2023-11-28T16:57:56.295958+0000","last_unstale":"2023-11-28T16:58:08.347522+0000","last_undegraded":"2023-11-28T16:58:08.347522+0000","last_fullsized":"2023-11-28T16:58:08.347522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.008383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-28T16:58:09.355572+0000","last_change":"2023-11-28T16:58:09.355572+0000","last_active":"2023-11-28T16:58:09.338249+0000","last_peered":"2023-11-28T16:58:09.338249+0000","last_clean":"2023-11-28T16:58:09.338249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:58:09.355572+0000","last_undegraded":"2023-11-28T16:58:09.355572+0000","last_fullsized":"2023-11-28T16:58:09.355572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.382246+0000","last_change":"2023-11-28T16:58:09.373511+0000","last_active":"2023-11-28T16:58:09.382246+0000","last_peered":"2023-11-28T16:58:09.382246+0000","last_clean":"2023-11-28T16:58:09.382246+0000","last_became_active":"2023-11-28T16:58:09.373187+0000","last_became_peered":"2023-11-28T16:58:09.373187+0000","last_unstale":"2023-11-28T16:58:09.382246+0000","last_undegraded":"2023-11-28T16:58:09.382246+0000","last_fullsized":"2023-11-28T16:58:09.382246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:59.249097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.347438+0000","last_change":"2023-11-28T16:57:57.308508+0000","last_active":"2023-11-28T16:58:08.347438+0000","last_peered":"2023-11-28T16:58:08.347438+0000","last_clean":"2023-11-28T16:58:08.347438+0000","last_became_active":"2023-11-28T16:57:57.308197+0000","last_became_peered":"2023-11-28T16:57:57.308197+0000","last_unstale":"2023-11-28T16:58:08.347438+0000","last_undegraded":"2023-11-28T16:58:08.347438+0000","last_fullsized":"2023-11-28T16:58:08.347438+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:41.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T16:58:08.352073+0000","last_change":"2023-11-28T16:57:56.296886+0000","last_active":"2023-11-28T16:58:08.352073+0000","last_peered":"2023-11-28T16:58:08.352073+0000","last_clean":"2023-11-28T16:58:08.352073+0000","last_became_active":"2023-11-28T16:57:56.296594+0000","last_became_peered":"2023-11-28T16:57:56.296594+0000","last_unstale":"2023-11-28T16:58:08.352073+0000","last_undegraded":"2023-11-28T16:58:08.352073+0000","last_fullsized":"2023-11-28T16:58:08.352073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:40.306391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T16:58:09.347446+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:09.347446+0000","last_peered":"2023-11-28T16:58:09.347446+0000","last_clean":"2023-11-28T16:58:09.347446+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:09.347446+0000","last_undegraded":"2023-11-28T16:58:09.347446+0000","last_fullsized":"2023-11-28T16:58:09.347446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1212416,"data_stored":849032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64500000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.628}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.70699999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":258504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.82299999999999995,"5min":1.474,"15min":1.474},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.73399999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.72799999999999998,"15min":0.753},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.879}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.749}]},{"osd":3,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92300000000000004,"5min":1.071,"15min":1.071},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.92500000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.52900000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.341,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4019999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":259156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69099999999999995}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.52100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76400000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.749},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89200000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54700000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96199999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":261611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.234,"15min":1.234},"last":0.66500000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.871,"5min":1.964,"15min":1.964},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.704,"15min":1.704},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88400000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.254,"15min":1.254},"last":0.497},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88,"5min":1.548,"15min":1.548},"last":0.61599999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90800000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.754}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.218,"15min":1.218},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.593,"15min":1.593},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":630784,"data_stored":265690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.56100000000000005,"5min":0.745,"15min":0.745},"last":0.434}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.874,"15min":0.874},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.47899999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.089,"5min":1.21,"15min":1.21},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91900000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0049999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.629},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0309999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.022,"5min":1.25,"15min":1.25},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.423,"15min":1.423},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":265690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.443},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68700000000000006}]},{"osd":5,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.627},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":258594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52700000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45800000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.56000000000000005,"5min":0.746,"15min":0.746},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.55600000000000005,"5min":1.04,"15min":1.04},"last":0.42799999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.625,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.60399999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.98699999999999999,"5min":1.446,"15min":1.446},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.034,"5min":1.47,"15min":1.47},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1180000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0820000000000001,"5min":1.327,"15min":1.327},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94599999999999995,"5min":1.3,"15min":1.3},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.167,"5min":1.526,"15min":1.526},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1459999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1220608,"data_stored":852561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.63}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:58:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-28T16:58:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.356934+0000', 'last_change': '2023-11-28T16:58:09.356934+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.356934+0000', 'last_undegraded': '2023-11-28T16:58:09.356934+0000', 'last_fullsized': '2023-11-28T16:58:09.356934+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T16:58:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-28T16:58:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.352892+0000', 'last_change': '2023-11-28T16:58:09.352892+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.352892+0000', 'last_undegraded': '2023-11-28T16:58:09.352892+0000', 'last_fullsized': '2023-11-28T16:58:09.352892+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T16:58:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-11-28T16:58:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355797+0000', 'last_change': '2023-11-28T16:58:09.355797+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355797+0000', 'last_undegraded': '2023-11-28T16:58:09.355797+0000', 'last_fullsized': '2023-11-28T16:58:09.355797+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-28T16:58:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.365573+0000', 'last_change': '2023-11-28T16:58:09.365573+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.365573+0000', 'last_undegraded': '2023-11-28T16:58:09.365573+0000', 'last_fullsized': '2023-11-28T16:58:09.365573+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-28T16:58:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354028+0000', 'last_change': '2023-11-28T16:58:09.354028+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354028+0000', 'last_undegraded': '2023-11-28T16:58:09.354028+0000', 'last_fullsized': '2023-11-28T16:58:09.354028+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-28T16:58:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.362280+0000', 'last_change': '2023-11-28T16:58:09.362280+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.362280+0000', 'last_undegraded': '2023-11-28T16:58:09.362280+0000', 'last_fullsized': '2023-11-28T16:58:09.362280+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.353798+0000', 'last_change': '2023-11-28T16:58:09.353798+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.353798+0000', 'last_undegraded': '2023-11-28T16:58:09.353798+0000', 'last_fullsized': '2023-11-28T16:58:09.353798+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.364239+0000', 'last_change': '2023-11-28T16:58:09.364239+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.364239+0000', 'last_undegraded': '2023-11-28T16:58:09.364239+0000', 'last_fullsized': '2023-11-28T16:58:09.364239+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354554+0000', 'last_change': '2023-11-28T16:58:09.354554+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354554+0000', 'last_undegraded': '2023-11-28T16:58:09.354554+0000', 'last_fullsized': '2023-11-28T16:58:09.354554+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.356219+0000', 'last_change': '2023-11-28T16:58:09.356219+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.356219+0000', 'last_undegraded': '2023-11-28T16:58:09.356219+0000', 'last_fullsized': '2023-11-28T16:58:09.356219+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T16:58:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-28T16:58:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.359820+0000', 'last_change': '2023-11-28T16:58:09.359820+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.359820+0000', 'last_undegraded': '2023-11-28T16:58:09.359820+0000', 'last_fullsized': '2023-11-28T16:58:09.359820+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-28T16:58:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.351087+0000', 'last_change': '2023-11-28T16:58:09.351087+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.351087+0000', 'last_undegraded': '2023-11-28T16:58:09.351087+0000', 'last_fullsized': '2023-11-28T16:58:09.351087+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-28T16:58:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.347055+0000', 'last_change': '2023-11-28T16:58:09.347055+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.347055+0000', 'last_undegraded': '2023-11-28T16:58:09.347055+0000', 'last_fullsized': '2023-11-28T16:58:09.347055+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.349211+0000', 'last_change': '2023-11-28T16:58:09.349211+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.349211+0000', 'last_undegraded': '2023-11-28T16:58:09.349211+0000', 'last_fullsized': '2023-11-28T16:58:09.349211+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.346377+0000', 'last_change': '2023-11-28T16:58:09.346377+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.346377+0000', 'last_undegraded': '2023-11-28T16:58:09.346377+0000', 'last_fullsized': '2023-11-28T16:58:09.346377+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.362056+0000', 'last_change': '2023-11-28T16:58:09.362056+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.362056+0000', 'last_undegraded': '2023-11-28T16:58:09.362056+0000', 'last_fullsized': '2023-11-28T16:58:09.362056+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-28T16:58:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.366415+0000', 'last_change': '2023-11-28T16:58:09.366415+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.366415+0000', 'last_undegraded': '2023-11-28T16:58:09.366415+0000', 'last_fullsized': '2023-11-28T16:58:09.366415+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-28T16:58:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.346855+0000', 'last_change': '2023-11-28T16:58:09.346855+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.346855+0000', 'last_undegraded': '2023-11-28T16:58:09.346855+0000', 'last_fullsized': '2023-11-28T16:58:09.346855+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T16:58:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-28T16:58:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.359147+0000', 'last_change': '2023-11-28T16:58:09.359147+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.359147+0000', 'last_undegraded': '2023-11-28T16:58:09.359147+0000', 'last_fullsized': '2023-11-28T16:58:09.359147+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-28T16:58:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354562+0000', 'last_change': '2023-11-28T16:58:09.354562+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354562+0000', 'last_undegraded': '2023-11-28T16:58:09.354562+0000', 'last_fullsized': '2023-11-28T16:58:09.354562+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T16:58:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355577+0000', 'last_change': '2023-11-28T16:58:09.355577+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355577+0000', 'last_undegraded': '2023-11-28T16:58:09.355577+0000', 'last_fullsized': '2023-11-28T16:58:09.355577+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354170+0000', 'last_change': '2023-11-28T16:58:09.354170+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354170+0000', 'last_undegraded': '2023-11-28T16:58:09.354170+0000', 'last_fullsized': '2023-11-28T16:58:09.354170+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.349265+0000', 'last_change': '2023-11-28T16:58:09.349265+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.349265+0000', 'last_undegraded': '2023-11-28T16:58:09.349265+0000', 'last_fullsized': '2023-11-28T16:58:09.349265+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.348943+0000', 'last_change': '2023-11-28T16:58:09.348943+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.348943+0000', 'last_undegraded': '2023-11-28T16:58:09.348943+0000', 'last_fullsized': '2023-11-28T16:58:09.348943+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.356410+0000', 'last_change': '2023-11-28T16:58:09.356410+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.356410+0000', 'last_undegraded': '2023-11-28T16:58:09.356410+0000', 'last_fullsized': '2023-11-28T16:58:09.356410+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.349986+0000', 'last_change': '2023-11-28T16:58:09.349986+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.349986+0000', 'last_undegraded': '2023-11-28T16:58:09.349986+0000', 'last_fullsized': '2023-11-28T16:58:09.349986+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.349811+0000', 'last_change': '2023-11-28T16:58:09.349811+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.349811+0000', 'last_undegraded': '2023-11-28T16:58:09.349811+0000', 'last_fullsized': '2023-11-28T16:58:09.349811+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355951+0000', 'last_change': '2023-11-28T16:58:09.355951+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355951+0000', 'last_undegraded': '2023-11-28T16:58:09.355951+0000', 'last_fullsized': '2023-11-28T16:58:09.355951+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-28T16:58:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.353445+0000', 'last_change': '2023-11-28T16:58:09.353445+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.353445+0000', 'last_undegraded': '2023-11-28T16:58:09.353445+0000', 'last_fullsized': '2023-11-28T16:58:09.353445+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-28T16:58:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.359339+0000', 'last_change': '2023-11-28T16:58:09.359339+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.359339+0000', 'last_undegraded': '2023-11-28T16:58:09.359339+0000', 'last_fullsized': '2023-11-28T16:58:09.359339+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-28T16:58:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.358941+0000', 'last_change': '2023-11-28T16:58:09.358941+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.358941+0000', 'last_undegraded': '2023-11-28T16:58:09.358941+0000', 'last_fullsized': '2023-11-28T16:58:09.358941+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T16:58:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-28T16:58:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.353541+0000', 'last_change': '2023-11-28T16:58:09.353541+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.353541+0000', 'last_undegraded': '2023-11-28T16:58:09.353541+0000', 'last_fullsized': '2023-11-28T16:58:09.353541+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.362611+0000', 'last_change': '2023-11-28T16:58:09.362611+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.362611+0000', 'last_undegraded': '2023-11-28T16:58:09.362611+0000', 'last_fullsized': '2023-11-28T16:58:09.362611+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.353750+0000', 'last_change': '2023-11-28T16:58:09.353750+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.353750+0000', 'last_undegraded': '2023-11-28T16:58:09.353750+0000', 'last_fullsized': '2023-11-28T16:58:09.353750+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.353707+0000', 'last_change': '2023-11-28T16:58:09.353707+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.353707+0000', 'last_undegraded': '2023-11-28T16:58:09.353707+0000', 'last_fullsized': '2023-11-28T16:58:09.353707+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-28T16:58:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354275+0000', 'last_change': '2023-11-28T16:58:09.354275+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354275+0000', 'last_undegraded': '2023-11-28T16:58:09.354275+0000', 'last_fullsized': '2023-11-28T16:58:09.354275+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354538+0000', 'last_change': '2023-11-28T16:58:09.354538+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354538+0000', 'last_undegraded': '2023-11-28T16:58:09.354538+0000', 'last_fullsized': '2023-11-28T16:58:09.354538+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.346285+0000', 'last_change': '2023-11-28T16:58:09.346285+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.346285+0000', 'last_undegraded': '2023-11-28T16:58:09.346285+0000', 'last_fullsized': '2023-11-28T16:58:09.346285+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.352949+0000', 'last_change': '2023-11-28T16:58:09.352949+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.352949+0000', 'last_undegraded': '2023-11-28T16:58:09.352949+0000', 'last_fullsized': '2023-11-28T16:58:09.352949+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-28T16:58:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.350692+0000', 'last_change': '2023-11-28T16:58:09.350692+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.350692+0000', 'last_undegraded': '2023-11-28T16:58:09.350692+0000', 'last_fullsized': '2023-11-28T16:58:09.350692+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.362168+0000', 'last_change': '2023-11-28T16:58:09.362168+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.362168+0000', 'last_undegraded': '2023-11-28T16:58:09.362168+0000', 'last_fullsized': '2023-11-28T16:58:09.362168+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.362301+0000', 'last_change': '2023-11-28T16:58:09.362301+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.362301+0000', 'last_undegraded': '2023-11-28T16:58:09.362301+0000', 'last_fullsized': '2023-11-28T16:58:09.362301+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355503+0000', 'last_change': '2023-11-28T16:58:09.355503+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355503+0000', 'last_undegraded': '2023-11-28T16:58:09.355503+0000', 'last_fullsized': '2023-11-28T16:58:09.355503+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-11-28T16:58:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354734+0000', 'last_change': '2023-11-28T16:58:09.354734+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354734+0000', 'last_undegraded': '2023-11-28T16:58:09.354734+0000', 'last_fullsized': '2023-11-28T16:58:09.354734+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.346336+0000', 'last_change': '2023-11-28T16:58:09.346336+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.346336+0000', 'last_undegraded': '2023-11-28T16:58:09.346336+0000', 'last_fullsized': '2023-11-28T16:58:09.346336+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.363329+0000', 'last_change': '2023-11-28T16:58:09.363329+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.363329+0000', 'last_undegraded': '2023-11-28T16:58:09.363329+0000', 'last_fullsized': '2023-11-28T16:58:09.363329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.352850+0000', 'last_change': '2023-11-28T16:58:09.352850+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.352850+0000', 'last_undegraded': '2023-11-28T16:58:09.352850+0000', 'last_fullsized': '2023-11-28T16:58:09.352850+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-28T16:58:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354576+0000', 'last_change': '2023-11-28T16:58:09.354576+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354576+0000', 'last_undegraded': '2023-11-28T16:58:09.354576+0000', 'last_fullsized': '2023-11-28T16:58:09.354576+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355743+0000', 'last_change': '2023-11-28T16:58:09.355743+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355743+0000', 'last_undegraded': '2023-11-28T16:58:09.355743+0000', 'last_fullsized': '2023-11-28T16:58:09.355743+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355335+0000', 'last_change': '2023-11-28T16:58:09.355335+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355335+0000', 'last_undegraded': '2023-11-28T16:58:09.355335+0000', 'last_fullsized': '2023-11-28T16:58:09.355335+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.350168+0000', 'last_change': '2023-11-28T16:58:09.350168+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.350168+0000', 'last_undegraded': '2023-11-28T16:58:09.350168+0000', 'last_fullsized': '2023-11-28T16:58:09.350168+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-11-28T16:58:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.351588+0000', 'last_change': '2023-11-28T16:58:09.351588+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.351588+0000', 'last_undegraded': '2023-11-28T16:58:09.351588+0000', 'last_fullsized': '2023-11-28T16:58:09.351588+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.352898+0000', 'last_change': '2023-11-28T16:58:09.352898+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.352898+0000', 'last_undegraded': '2023-11-28T16:58:09.352898+0000', 'last_fullsized': '2023-11-28T16:58:09.352898+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.353794+0000', 'last_change': '2023-11-28T16:58:09.353794+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.353794+0000', 'last_undegraded': '2023-11-28T16:58:09.353794+0000', 'last_fullsized': '2023-11-28T16:58:09.353794+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.359572+0000', 'last_change': '2023-11-28T16:58:09.359572+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.359572+0000', 'last_undegraded': '2023-11-28T16:58:09.359572+0000', 'last_fullsized': '2023-11-28T16:58:09.359572+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-11-28T16:58:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.351550+0000', 'last_change': '2023-11-28T16:58:09.351550+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.351550+0000', 'last_undegraded': '2023-11-28T16:58:09.351550+0000', 'last_fullsized': '2023-11-28T16:58:09.351550+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-11-28T16:58:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.352786+0000', 'last_change': '2023-11-28T16:58:09.352786+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.352786+0000', 'last_undegraded': '2023-11-28T16:58:09.352786+0000', 'last_fullsized': '2023-11-28T16:58:09.352786+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T16:58:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-28T16:58:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.346442+0000', 'last_change': '2023-11-28T16:58:09.346442+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.346442+0000', 'last_undegraded': '2023-11-28T16:58:09.346442+0000', 'last_fullsized': '2023-11-28T16:58:09.346442+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T16:58:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-28T16:58:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355205+0000', 'last_change': '2023-11-28T16:58:09.355205+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355205+0000', 'last_undegraded': '2023-11-28T16:58:09.355205+0000', 'last_fullsized': '2023-11-28T16:58:09.355205+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.352661+0000', 'last_change': '2023-11-28T16:58:09.352661+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.352661+0000', 'last_undegraded': '2023-11-28T16:58:09.352661+0000', 'last_fullsized': '2023-11-28T16:58:09.352661+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.359972+0000', 'last_change': '2023-11-28T16:58:09.359972+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.359972+0000', 'last_undegraded': '2023-11-28T16:58:09.359972+0000', 'last_fullsized': '2023-11-28T16:58:09.359972+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.354653+0000', 'last_change': '2023-11-28T16:58:09.354653+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.354653+0000', 'last_undegraded': '2023-11-28T16:58:09.354653+0000', 'last_fullsized': '2023-11-28T16:58:09.354653+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-28T16:58:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.360939+0000', 'last_change': '2023-11-28T16:58:09.360939+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.360939+0000', 'last_undegraded': '2023-11-28T16:58:09.360939+0000', 'last_fullsized': '2023-11-28T16:58:09.360939+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T16:58:15.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-28T16:58:15.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-28T16:58:09.355572+0000', 'last_change': '2023-11-28T16:58:09.355572+0000', 'last_active': '2023-11-28T16:58:09.338249+0000', 'last_peered': '2023-11-28T16:58:09.338249+0000', 'last_clean': '2023-11-28T16:58:09.338249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T16:58:09.355572+0000', 'last_undegraded': '2023-11-28T16:58:09.355572+0000', 'last_fullsized': '2023-11-28T16:58:09.355572+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'last_clean_scrub_stamp': '2023-11-28T16:58:09.338249+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T16:58:15.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T16:58:15.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 Processor -- start 2023-11-28T16:58:15.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 -- start start 2023-11-28T16:58:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fca101520f0 0x7fca100c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca10155660 0x7fca1006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca1006b650 0x7fca100c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1006c020 con 0x7fca1006b650 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca101524d0 con 0x7fca101520f0 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca175c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca100c5520 con 0x7fca10155660 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca1006b650 0x7fca100c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca1006b650 0x7fca100c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37128/0 (socket says 172.21.15.26:37128) 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 -- 172.21.15.26:0/3792527107 learned_addr learned my addr 172.21.15.26:0/3792527107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15360640 1 --2- 172.21.15.26:0/3792527107 >> v2:172.21.15.79:3300/0 conn(0x7fca101520f0 0x7fca100c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca14b5f640 1 --2- 172.21.15.26:0/3792527107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca10155660 0x7fca1006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 -- 172.21.15.26:0/3792527107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca10155660 msgr2=0x7fca1006b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 --2- 172.21.15.26:0/3792527107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca10155660 0x7fca1006b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 -- 172.21.15.26:0/3792527107 >> v2:172.21.15.79:3300/0 conn(0x7fca101520f0 msgr2=0x7fca100c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 --2- 172.21.15.26:0/3792527107 >> v2:172.21.15.79:3300/0 conn(0x7fca101520f0 0x7fca100c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.473+0000 7fca15b61640 1 -- 172.21.15.26:0/3792527107 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca100c9a80 con 0x7fca1006b650 2023-11-28T16:58:15.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca15b61640 1 --2- 172.21.15.26:0/3792527107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca1006b650 0x7fca100c7f70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fca1006d200 tx=0x7fca0801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d503156e29af7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca07fff640 1 -- 172.21.15.26:0/3792527107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080ab600 con 0x7fca1006b650 2023-11-28T16:58:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca07fff640 1 -- 172.21.15.26:0/3792527107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca080ab760 con 0x7fca1006b650 2023-11-28T16:58:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca07fff640 1 -- 172.21.15.26:0/3792527107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080abaf0 con 0x7fca1006b650 2023-11-28T16:58:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 -- 172.21.15.26:0/3792527107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca1006b650 msgr2=0x7fca100c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 --2- 172.21.15.26:0/3792527107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca1006b650 0x7fca100c7f70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fca1006d200 tx=0x7fca0801c440 comp rx=0 tx=0).stop 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 -- 172.21.15.26:0/3792527107 shutdown_connections 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 --2- 172.21.15.26:0/3792527107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca1006b650 0x7fca100c7f70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 --2- 172.21.15.26:0/3792527107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca10155660 0x7fca1006b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 --2- 172.21.15.26:0/3792527107 >> v2:172.21.15.79:3300/0 conn(0x7fca101520f0 0x7fca100c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 -- 172.21.15.26:0/3792527107 >> 172.21.15.26:0/3792527107 conn(0x7fca100ca070 msgr2=0x7fca100ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 -- 172.21.15.26:0/3792527107 shutdown_connections 2023-11-28T16:58:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.477+0000 7fca175c4640 1 -- 172.21.15.26:0/3792527107 wait complete. 2023-11-28T16:58:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 Processor -- start 2023-11-28T16:58:15.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 -- start start 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca1006b650 0x7fca101edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca101520f0 0x7fca10150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca10155660 0x7fca1014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1006b3a0 con 0x7fca101520f0 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1014ba10 con 0x7fca10155660 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1014bf20 con 0x7fca1006b650 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca101520f0 0x7fca10150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca101520f0 0x7fca10150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37136/0 (socket says 172.21.15.26:37136) 2023-11-28T16:58:15.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 -- 172.21.15.26:0/3330464514 learned_addr learned my addr 172.21.15.26:0/3330464514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca15b61640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca10155660 0x7fca1014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca15360640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca1006b650 0x7fca101edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 -- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca1006b650 msgr2=0x7fca101edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca1006b650 0x7fca101edc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 -- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca10155660 msgr2=0x7fca1014c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca10155660 0x7fca1014c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 -- 172.21.15.26:0/3330464514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080094d0 con 0x7fca101520f0 2023-11-28T16:58:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca14b5f640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca101520f0 0x7fca10150340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fca0000d5d0 tx=0x7fca0000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca05ffb640 1 -- 172.21.15.26:0/3330464514 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00004240 con 0x7fca101520f0 2023-11-28T16:58:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca05ffb640 1 -- 172.21.15.26:0/3330464514 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca000043a0 con 0x7fca101520f0 2023-11-28T16:58:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca05ffb640 1 -- 172.21.15.26:0/3330464514 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00003840 con 0x7fca101520f0 2023-11-28T16:58:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1014bc40 con 0x7fca101520f0 2023-11-28T16:58:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.481+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca101ed470 con 0x7fca101520f0 2023-11-28T16:58:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.485+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1004e890 con 0x7fca101520f0 2023-11-28T16:58:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.485+0000 7fca05ffb640 1 -- 172.21.15.26:0/3330464514 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fca000039a0 con 0x7fca101520f0 2023-11-28T16:58:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.485+0000 7fca05ffb640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9f4066900 0x7fc9f4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.485+0000 7fca05ffb640 1 -- 172.21.15.26:0/3330464514 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fca00084a30 con 0x7fca101520f0 2023-11-28T16:58:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.485+0000 7fca15360640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9f4066900 0x7fc9f4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.485+0000 7fca15360640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9f4066900 0x7fc9f4068dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca0c003fd0 tx=0x7fca0c003a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.489+0000 7fca05ffb640 1 -- 172.21.15.26:0/3330464514 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca00051870 con 0x7fca101520f0 2023-11-28T16:58:15.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fca100c5700 con 0x7fca101520f0 2023-11-28T16:58:15.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca05ffb640 1 -- 172.21.15.26:0/3330464514 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1748 (secure 0 0 0) 0x7fca00054e90 con 0x7fca101520f0 2023-11-28T16:58:15.704 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:15.704 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":143,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1701190564,"num_in_osds":8,"osd_in_since":1701190555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129},{"state_name":"creating+peering","count":64}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":244551680,"bytes_avail":772849561600,"bytes_total":773094113280,"inactive_pgs_ratio":0.33160620927810669,"write_bytes_sec":389,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":37,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5715},{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5718}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-28T16:57:05.584951+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T16:58:15.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9f4066900 msgr2=0x7fc9f4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9f4066900 0x7fc9f4068dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca0c003fd0 tx=0x7fca0c003a00 comp rx=0 tx=0).stop 2023-11-28T16:58:15.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca101520f0 msgr2=0x7fca10150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca101520f0 0x7fca10150340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fca0000d5d0 tx=0x7fca0000da90 comp rx=0 tx=0).stop 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 shutdown_connections 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca10155660 0x7fca1014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca101520f0 0x7fca10150340 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc9f4066900 0x7fc9f4068dc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 --2- 172.21.15.26:0/3330464514 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca1006b650 0x7fca101edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.701+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 >> 172.21.15.26:0/3330464514 conn(0x7fca100ca070 msgr2=0x7fca10148020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.705+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 shutdown_connections 2023-11-28T16:58:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.705+0000 7fca175c4640 1 -- 172.21.15.26:0/3330464514 wait complete. 2023-11-28T16:58:15.726 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T16:58:15.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:58:15.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 Processor -- start 2023-11-28T16:58:15.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 -- start start 2023-11-28T16:58:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e440af5b0 0x7f4e440ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e440c48b0 0x7f4e440c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440bd5c0 0x7f4e440c8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e440af990 con 0x7f4e440c48b0 2023-11-28T16:58:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4406b100 con 0x7f4e440af5b0 2023-11-28T16:58:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.865+0000 7f4e4a5d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4406b6c0 con 0x7f4e440bd5c0 2023-11-28T16:58:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e440c48b0 0x7f4e440c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e440c48b0 0x7f4e440c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37144/0 (socket says 172.21.15.26:37144) 2023-11-28T16:58:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 -- 172.21.15.26:0/779848641 learned_addr learned my addr 172.21.15.26:0/779848641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e495ce640 1 --2- 172.21.15.26:0/779848641 >> v2:172.21.15.79:3300/0 conn(0x7f4e440af5b0 0x7f4e440ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e49dcf640 1 --2- 172.21.15.26:0/779848641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440bd5c0 0x7f4e440c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 -- 172.21.15.26:0/779848641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440bd5c0 msgr2=0x7f4e440c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 --2- 172.21.15.26:0/779848641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440bd5c0 0x7f4e440c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 -- 172.21.15.26:0/779848641 >> v2:172.21.15.79:3300/0 conn(0x7f4e440af5b0 msgr2=0x7f4e440ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 --2- 172.21.15.26:0/779848641 >> v2:172.21.15.79:3300/0 conn(0x7f4e440af5b0 0x7f4e440ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 -- 172.21.15.26:0/779848641 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44155050 con 0x7f4e440c48b0 2023-11-28T16:58:15.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e48dcd640 1 --2- 172.21.15.26:0/779848641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e440c7e30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4e440ac950 tx=0x7f4e3401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94dedfff1539744 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e3bfff640 1 -- 172.21.15.26:0/779848641 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340ab600 con 0x7f4e440c48b0 2023-11-28T16:58:15.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e3bfff640 1 -- 172.21.15.26:0/779848641 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e340a7050 con 0x7f4e440c48b0 2023-11-28T16:58:15.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.869+0000 7f4e3bfff640 1 -- 172.21.15.26:0/779848641 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340ab980 con 0x7f4e440c48b0 2023-11-28T16:58:15.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/779848641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 msgr2=0x7f4e440c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/779848641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e440c7e30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4e440ac950 tx=0x7f4e3401c3e0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/779848641 shutdown_connections 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/779848641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440bd5c0 0x7f4e440c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/779848641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e440c7e30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/779848641 >> v2:172.21.15.79:3300/0 conn(0x7f4e440af5b0 0x7f4e440ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/779848641 >> 172.21.15.26:0/779848641 conn(0x7f4e440ac0c0 msgr2=0x7f4e440c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/779848641 shutdown_connections 2023-11-28T16:58:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/779848641 wait complete. 2023-11-28T16:58:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 Processor -- start 2023-11-28T16:58:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- start start 2023-11-28T16:58:15.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440af5b0 0x7f4e440c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e440bd5c0 0x7f4e441ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e441edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441ed280 con 0x7f4e440c48b0 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441f07f0 con 0x7f4e440bd5c0 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e4a5d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4414ce70 con 0x7f4e440af5b0 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e441edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e441edbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37154/0 (socket says 172.21.15.26:37154) 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 -- 172.21.15.26:0/3963644723 learned_addr learned my addr 172.21.15.26:0/3963644723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e495ce640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440af5b0 0x7f4e440c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e48dcd640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e440bd5c0 0x7f4e441ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 -- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440af5b0 msgr2=0x7f4e440c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440af5b0 0x7f4e440c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 -- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e440bd5c0 msgr2=0x7f4e441ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e440bd5c0 0x7f4e441ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.873+0000 7f4e49dcf640 1 -- 172.21.15.26:0/3963644723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340094d0 con 0x7f4e440c48b0 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e49dcf640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e441edbd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007e30 tx=0x7f4e3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e39ffb640 1 -- 172.21.15.26:0/3963644723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c014620 con 0x7f4e440c48b0 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e39ffb640 1 -- 172.21.15.26:0/3963644723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c00ee90 con 0x7f4e440c48b0 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4414d150 con 0x7f4e440c48b0 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e39ffb640 1 -- 172.21.15.26:0/3963644723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0149c0 con 0x7f4e440c48b0 2023-11-28T16:58:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e440c17a0 con 0x7f4e440c48b0 2023-11-28T16:58:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4406c010 con 0x7f4e440c48b0 2023-11-28T16:58:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.877+0000 7f4e39ffb640 1 -- 172.21.15.26:0/3963644723 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e3c014b20 con 0x7f4e440c48b0 2023-11-28T16:58:15.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.881+0000 7f4e39ffb640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e28066900 0x7f4e28068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:15.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.881+0000 7f4e39ffb640 1 -- 172.21.15.26:0/3963644723 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e3c084ff0 con 0x7f4e440c48b0 2023-11-28T16:58:15.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.881+0000 7f4e495ce640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e28066900 0x7f4e28068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.881+0000 7f4e495ce640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e28066900 0x7f4e28068dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4e4415ebf0 tx=0x7f4e40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:15.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:15.885+0000 7f4e39ffb640 1 -- 172.21.15.26:0/3963644723 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e3c051f70 con 0x7f4e440c48b0 2023-11-28T16:58:16.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.041+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e440c9d80 con 0x7f4e28066900 2023-11-28T16:58:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.053+0000 7f4e39ffb640 1 -- 172.21.15.26:0/3963644723 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527406 (secure 0 0 0) 0x7f4e4000b720 con 0x7f4e28066900 2023-11-28T16:58:16.063 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:16.067 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:58:16.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e28066900 msgr2=0x7f4e28068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:16.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e28066900 0x7f4e28068dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4e4415ebf0 tx=0x7f4e40008040 comp rx=0 tx=0).stop 2023-11-28T16:58:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 msgr2=0x7f4e441edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e441edbd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007e30 tx=0x7f4e3c00e4b0 comp rx=0 tx=0).stop 2023-11-28T16:58:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 shutdown_connections 2023-11-28T16:58:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e440c48b0 0x7f4e441edbd0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e440bd5c0 0x7f4e441ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e28066900 0x7f4e28068dc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 --2- 172.21.15.26:0/3963644723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e440af5b0 0x7f4e440c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 >> 172.21.15.26:0/3963644723 conn(0x7f4e440ac0c0 msgr2=0x7f4e440ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 shutdown_connections 2023-11-28T16:58:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:16.061+0000 7f4e4a5d0640 1 -- 172.21.15.26:0/3963644723 wait complete. 2023-11-28T16:58:16.082 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-11-28T16:58:15.601905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239184,"kb_used_data":6344,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735536,"statfs":{"total":773094113280,"available":772849188864,"internally_reserved":0,"allocated":6496256,"data_stored":3436758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3651,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.256988"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852228+0000","last_change":"2023-11-28T16:58:10.389129+0000","last_active":"2023-11-28T16:58:11.852228+0000","last_peered":"2023-11-28T16:58:11.852228+0000","last_clean":"2023-11-28T16:58:11.852228+0000","last_became_active":"2023-11-28T16:58:10.388693+0000","last_became_peered":"2023-11-28T16:58:10.388693+0000","last_unstale":"2023-11-28T16:58:11.852228+0000","last_undegraded":"2023-11-28T16:58:11.852228+0000","last_fullsized":"2023-11-28T16:58:11.852228+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:41.315954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382257+0000","last_change":"2023-11-28T16:57:57.311201+0000","last_active":"2023-11-28T16:58:10.382257+0000","last_peered":"2023-11-28T16:58:10.382257+0000","last_clean":"2023-11-28T16:58:10.382257+0000","last_became_active":"2023-11-28T16:57:57.310858+0000","last_became_peered":"2023-11-28T16:57:57.310858+0000","last_unstale":"2023-11-28T16:58:10.382257+0000","last_undegraded":"2023-11-28T16:58:10.382257+0000","last_fullsized":"2023-11-28T16:58:10.382257+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:38.198969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853232+0000","last_change":"2023-11-28T16:58:10.396508+0000","last_active":"2023-11-28T16:58:11.853232+0000","last_peered":"2023-11-28T16:58:11.853232+0000","last_clean":"2023-11-28T16:58:11.853232+0000","last_became_active":"2023-11-28T16:58:10.396153+0000","last_became_peered":"2023-11-28T16:58:10.396153+0000","last_unstale":"2023-11-28T16:58:11.853232+0000","last_undegraded":"2023-11-28T16:58:11.853232+0000","last_fullsized":"2023-11-28T16:58:11.853232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:52.255310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375399+0000","last_change":"2023-11-28T16:57:57.307903+0000","last_active":"2023-11-28T16:58:10.375399+0000","last_peered":"2023-11-28T16:58:10.375399+0000","last_clean":"2023-11-28T16:58:10.375399+0000","last_became_active":"2023-11-28T16:57:57.305651+0000","last_became_peered":"2023-11-28T16:57:57.305651+0000","last_unstale":"2023-11-28T16:58:10.375399+0000","last_undegraded":"2023-11-28T16:58:10.375399+0000","last_fullsized":"2023-11-28T16:58:10.375399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:58.350824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382473+0000","last_change":"2023-11-28T16:58:10.387612+0000","last_active":"2023-11-28T16:58:11.382473+0000","last_peered":"2023-11-28T16:58:11.382473+0000","last_clean":"2023-11-28T16:58:11.382473+0000","last_became_active":"2023-11-28T16:58:10.387322+0000","last_became_peered":"2023-11-28T16:58:10.387322+0000","last_unstale":"2023-11-28T16:58:11.382473+0000","last_undegraded":"2023-11-28T16:58:11.382473+0000","last_fullsized":"2023-11-28T16:58:11.382473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:21.777471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361940+0000","last_change":"2023-11-28T16:57:57.295922+0000","last_active":"2023-11-28T16:58:10.361940+0000","last_peered":"2023-11-28T16:58:10.361940+0000","last_clean":"2023-11-28T16:58:10.361940+0000","last_became_active":"2023-11-28T16:57:57.295614+0000","last_became_peered":"2023-11-28T16:57:57.295614+0000","last_unstale":"2023-11-28T16:58:10.361940+0000","last_undegraded":"2023-11-28T16:58:10.361940+0000","last_fullsized":"2023-11-28T16:58:10.361940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854703+0000","last_change":"2023-11-28T16:58:10.390874+0000","last_active":"2023-11-28T16:58:11.854703+0000","last_peered":"2023-11-28T16:58:11.854703+0000","last_clean":"2023-11-28T16:58:11.854703+0000","last_became_active":"2023-11-28T16:58:10.390644+0000","last_became_peered":"2023-11-28T16:58:10.390644+0000","last_unstale":"2023-11-28T16:58:11.854703+0000","last_undegraded":"2023-11-28T16:58:11.854703+0000","last_fullsized":"2023-11-28T16:58:11.854703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:30.767044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381083+0000","last_change":"2023-11-28T16:57:57.307103+0000","last_active":"2023-11-28T16:58:10.381083+0000","last_peered":"2023-11-28T16:58:10.381083+0000","last_clean":"2023-11-28T16:58:10.381083+0000","last_became_active":"2023-11-28T16:57:57.306791+0000","last_became_peered":"2023-11-28T16:57:57.306791+0000","last_unstale":"2023-11-28T16:58:10.381083+0000","last_undegraded":"2023-11-28T16:58:10.381083+0000","last_fullsized":"2023-11-28T16:58:10.381083+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383579+0000","last_change":"2023-11-28T16:58:10.400809+0000","last_active":"2023-11-28T16:58:11.383579+0000","last_peered":"2023-11-28T16:58:11.383579+0000","last_clean":"2023-11-28T16:58:11.383579+0000","last_became_active":"2023-11-28T16:58:10.397941+0000","last_became_peered":"2023-11-28T16:58:10.397941+0000","last_unstale":"2023-11-28T16:58:11.383579+0000","last_undegraded":"2023-11-28T16:58:11.383579+0000","last_fullsized":"2023-11-28T16:58:11.383579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:28.372594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382811+0000","last_change":"2023-11-28T16:57:57.294572+0000","last_active":"2023-11-28T16:58:10.382811+0000","last_peered":"2023-11-28T16:58:10.382811+0000","last_clean":"2023-11-28T16:58:10.382811+0000","last_became_active":"2023-11-28T16:57:57.294253+0000","last_became_peered":"2023-11-28T16:57:57.294253+0000","last_unstale":"2023-11-28T16:58:10.382811+0000","last_undegraded":"2023-11-28T16:58:10.382811+0000","last_fullsized":"2023-11-28T16:58:10.382811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:08.044829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853421+0000","last_change":"2023-11-28T16:58:10.393252+0000","last_active":"2023-11-28T16:58:11.853421+0000","last_peered":"2023-11-28T16:58:11.853421+0000","last_clean":"2023-11-28T16:58:11.853421+0000","last_became_active":"2023-11-28T16:58:10.392917+0000","last_became_peered":"2023-11-28T16:58:10.392917+0000","last_unstale":"2023-11-28T16:58:11.853421+0000","last_undegraded":"2023-11-28T16:58:11.853421+0000","last_fullsized":"2023-11-28T16:58:11.853421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:21.160963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367290+0000","last_change":"2023-11-28T16:57:57.303700+0000","last_active":"2023-11-28T16:58:10.367290+0000","last_peered":"2023-11-28T16:58:10.367290+0000","last_clean":"2023-11-28T16:58:10.367290+0000","last_became_active":"2023-11-28T16:57:57.303377+0000","last_became_peered":"2023-11-28T16:57:57.303377+0000","last_unstale":"2023-11-28T16:58:10.367290+0000","last_undegraded":"2023-11-28T16:58:10.367290+0000","last_fullsized":"2023-11-28T16:58:10.367290+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853627+0000","last_change":"2023-11-28T16:58:10.384901+0000","last_active":"2023-11-28T16:58:11.853627+0000","last_peered":"2023-11-28T16:58:11.853627+0000","last_clean":"2023-11-28T16:58:11.853627+0000","last_became_active":"2023-11-28T16:58:10.384647+0000","last_became_peered":"2023-11-28T16:58:10.384647+0000","last_unstale":"2023-11-28T16:58:11.853627+0000","last_undegraded":"2023-11-28T16:58:11.853627+0000","last_fullsized":"2023-11-28T16:58:11.853627+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:40.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367097+0000","last_change":"2023-11-28T16:57:57.290167+0000","last_active":"2023-11-28T16:58:10.367097+0000","last_peered":"2023-11-28T16:58:10.367097+0000","last_clean":"2023-11-28T16:58:10.367097+0000","last_became_active":"2023-11-28T16:57:57.289873+0000","last_became_peered":"2023-11-28T16:57:57.289873+0000","last_unstale":"2023-11-28T16:58:10.367097+0000","last_undegraded":"2023-11-28T16:58:10.367097+0000","last_fullsized":"2023-11-28T16:58:10.367097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:53.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854761+0000","last_change":"2023-11-28T16:58:10.393488+0000","last_active":"2023-11-28T16:58:11.854761+0000","last_peered":"2023-11-28T16:58:11.854761+0000","last_clean":"2023-11-28T16:58:11.854761+0000","last_became_active":"2023-11-28T16:58:10.393197+0000","last_became_peered":"2023-11-28T16:58:10.393197+0000","last_unstale":"2023-11-28T16:58:11.854761+0000","last_undegraded":"2023-11-28T16:58:11.854761+0000","last_fullsized":"2023-11-28T16:58:11.854761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:59.066815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.363867+0000","last_change":"2023-11-28T16:57:57.294040+0000","last_active":"2023-11-28T16:58:10.363867+0000","last_peered":"2023-11-28T16:58:10.363867+0000","last_clean":"2023-11-28T16:58:10.363867+0000","last_became_active":"2023-11-28T16:57:57.293696+0000","last_became_peered":"2023-11-28T16:57:57.293696+0000","last_unstale":"2023-11-28T16:58:10.363867+0000","last_undegraded":"2023-11-28T16:58:10.363867+0000","last_fullsized":"2023-11-28T16:58:10.363867+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:45.988064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382363+0000","last_change":"2023-11-28T16:58:10.390236+0000","last_active":"2023-11-28T16:58:11.382363+0000","last_peered":"2023-11-28T16:58:11.382363+0000","last_clean":"2023-11-28T16:58:11.382363+0000","last_became_active":"2023-11-28T16:58:10.389846+0000","last_became_peered":"2023-11-28T16:58:10.389846+0000","last_unstale":"2023-11-28T16:58:11.382363+0000","last_undegraded":"2023-11-28T16:58:11.382363+0000","last_fullsized":"2023-11-28T16:58:11.382363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:59.964513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368419+0000","last_change":"2023-11-28T16:57:57.291252+0000","last_active":"2023-11-28T16:58:10.368419+0000","last_peered":"2023-11-28T16:58:10.368419+0000","last_clean":"2023-11-28T16:58:10.368419+0000","last_became_active":"2023-11-28T16:57:57.290870+0000","last_became_peered":"2023-11-28T16:57:57.290870+0000","last_unstale":"2023-11-28T16:58:10.368419+0000","last_undegraded":"2023-11-28T16:58:10.368419+0000","last_fullsized":"2023-11-28T16:58:10.368419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:24.268675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852526+0000","last_change":"2023-11-28T16:58:10.388089+0000","last_active":"2023-11-28T16:58:11.852526+0000","last_peered":"2023-11-28T16:58:11.852526+0000","last_clean":"2023-11-28T16:58:11.852526+0000","last_became_active":"2023-11-28T16:58:10.387799+0000","last_became_peered":"2023-11-28T16:58:10.387799+0000","last_unstale":"2023-11-28T16:58:11.852526+0000","last_undegraded":"2023-11-28T16:58:11.852526+0000","last_fullsized":"2023-11-28T16:58:11.852526+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:38.063737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376272+0000","last_change":"2023-11-28T16:57:57.293326+0000","last_active":"2023-11-28T16:58:10.376272+0000","last_peered":"2023-11-28T16:58:10.376272+0000","last_clean":"2023-11-28T16:58:10.376272+0000","last_became_active":"2023-11-28T16:57:57.292663+0000","last_became_peered":"2023-11-28T16:57:57.292663+0000","last_unstale":"2023-11-28T16:58:10.376272+0000","last_undegraded":"2023-11-28T16:58:10.376272+0000","last_fullsized":"2023-11-28T16:58:10.376272+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:07.257033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854435+0000","last_change":"2023-11-28T16:58:10.400911+0000","last_active":"2023-11-28T16:58:11.854435+0000","last_peered":"2023-11-28T16:58:11.854435+0000","last_clean":"2023-11-28T16:58:11.854435+0000","last_became_active":"2023-11-28T16:58:10.400409+0000","last_became_peered":"2023-11-28T16:58:10.400409+0000","last_unstale":"2023-11-28T16:58:11.854435+0000","last_undegraded":"2023-11-28T16:58:11.854435+0000","last_fullsized":"2023-11-28T16:58:11.854435+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:07.575625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376117+0000","last_change":"2023-11-28T16:57:57.285037+0000","last_active":"2023-11-28T16:58:10.376117+0000","last_peered":"2023-11-28T16:58:10.376117+0000","last_clean":"2023-11-28T16:58:10.376117+0000","last_became_active":"2023-11-28T16:57:57.284722+0000","last_became_peered":"2023-11-28T16:57:57.284722+0000","last_unstale":"2023-11-28T16:58:10.376117+0000","last_undegraded":"2023-11-28T16:58:10.376117+0000","last_fullsized":"2023-11-28T16:58:10.376117+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:29.116162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.855099+0000","last_change":"2023-11-28T16:58:10.389126+0000","last_active":"2023-11-28T16:58:11.855099+0000","last_peered":"2023-11-28T16:58:11.855099+0000","last_clean":"2023-11-28T16:58:11.855099+0000","last_became_active":"2023-11-28T16:58:10.388787+0000","last_became_peered":"2023-11-28T16:58:10.388787+0000","last_unstale":"2023-11-28T16:58:11.855099+0000","last_undegraded":"2023-11-28T16:58:11.855099+0000","last_fullsized":"2023-11-28T16:58:11.855099+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:47.300754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381231+0000","last_change":"2023-11-28T16:57:57.303913+0000","last_active":"2023-11-28T16:58:10.381231+0000","last_peered":"2023-11-28T16:58:10.381231+0000","last_clean":"2023-11-28T16:58:10.381231+0000","last_became_active":"2023-11-28T16:57:57.303625+0000","last_became_peered":"2023-11-28T16:57:57.303625+0000","last_unstale":"2023-11-28T16:58:10.381231+0000","last_undegraded":"2023-11-28T16:58:10.381231+0000","last_fullsized":"2023-11-28T16:58:10.381231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380476+0000","last_change":"2023-11-28T16:58:10.382499+0000","last_active":"2023-11-28T16:58:11.380476+0000","last_peered":"2023-11-28T16:58:11.380476+0000","last_clean":"2023-11-28T16:58:11.380476+0000","last_became_active":"2023-11-28T16:58:10.382207+0000","last_became_peered":"2023-11-28T16:58:10.382207+0000","last_unstale":"2023-11-28T16:58:11.380476+0000","last_undegraded":"2023-11-28T16:58:11.380476+0000","last_fullsized":"2023-11-28T16:58:11.380476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:11.429575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376085+0000","last_change":"2023-11-28T16:57:57.305618+0000","last_active":"2023-11-28T16:58:10.376085+0000","last_peered":"2023-11-28T16:58:10.376085+0000","last_clean":"2023-11-28T16:58:10.376085+0000","last_became_active":"2023-11-28T16:57:57.305369+0000","last_became_peered":"2023-11-28T16:57:57.305369+0000","last_unstale":"2023-11-28T16:58:10.376085+0000","last_undegraded":"2023-11-28T16:58:10.376085+0000","last_fullsized":"2023-11-28T16:58:10.376085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:26.927795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853765+0000","last_change":"2023-11-28T16:58:10.389750+0000","last_active":"2023-11-28T16:58:11.853765+0000","last_peered":"2023-11-28T16:58:11.853765+0000","last_clean":"2023-11-28T16:58:11.853765+0000","last_became_active":"2023-11-28T16:58:10.389434+0000","last_became_peered":"2023-11-28T16:58:10.389434+0000","last_unstale":"2023-11-28T16:58:11.853765+0000","last_undegraded":"2023-11-28T16:58:11.853765+0000","last_fullsized":"2023-11-28T16:58:11.853765+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:32.158497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366778+0000","last_change":"2023-11-28T16:57:57.286182+0000","last_active":"2023-11-28T16:58:10.366778+0000","last_peered":"2023-11-28T16:58:10.366778+0000","last_clean":"2023-11-28T16:58:10.366778+0000","last_became_active":"2023-11-28T16:57:57.285885+0000","last_became_peered":"2023-11-28T16:57:57.285885+0000","last_unstale":"2023-11-28T16:58:10.366778+0000","last_undegraded":"2023-11-28T16:58:10.366778+0000","last_fullsized":"2023-11-28T16:58:10.366778+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:34.325761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380638+0000","last_change":"2023-11-28T16:58:10.392097+0000","last_active":"2023-11-28T16:58:11.380638+0000","last_peered":"2023-11-28T16:58:11.380638+0000","last_clean":"2023-11-28T16:58:11.380638+0000","last_became_active":"2023-11-28T16:58:10.391748+0000","last_became_peered":"2023-11-28T16:58:10.391748+0000","last_unstale":"2023-11-28T16:58:11.380638+0000","last_undegraded":"2023-11-28T16:58:11.380638+0000","last_fullsized":"2023-11-28T16:58:11.380638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.452379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367252+0000","last_change":"2023-11-28T16:57:57.288466+0000","last_active":"2023-11-28T16:58:10.367252+0000","last_peered":"2023-11-28T16:58:10.367252+0000","last_clean":"2023-11-28T16:58:10.367252+0000","last_became_active":"2023-11-28T16:57:57.288071+0000","last_became_peered":"2023-11-28T16:57:57.288071+0000","last_unstale":"2023-11-28T16:58:10.367252+0000","last_undegraded":"2023-11-28T16:58:10.367252+0000","last_fullsized":"2023-11-28T16:58:10.367252+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:54.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851988+0000","last_change":"2023-11-28T16:58:10.397455+0000","last_active":"2023-11-28T16:58:11.851988+0000","last_peered":"2023-11-28T16:58:11.851988+0000","last_clean":"2023-11-28T16:58:11.851988+0000","last_became_active":"2023-11-28T16:58:10.396936+0000","last_became_peered":"2023-11-28T16:58:10.396936+0000","last_unstale":"2023-11-28T16:58:11.851988+0000","last_undegraded":"2023-11-28T16:58:11.851988+0000","last_fullsized":"2023-11-28T16:58:11.851988+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:49.369425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367667+0000","last_change":"2023-11-28T16:57:57.298522+0000","last_active":"2023-11-28T16:58:10.367667+0000","last_peered":"2023-11-28T16:58:10.367667+0000","last_clean":"2023-11-28T16:58:10.367667+0000","last_became_active":"2023-11-28T16:57:57.298241+0000","last_became_peered":"2023-11-28T16:57:57.298241+0000","last_unstale":"2023-11-28T16:58:10.367667+0000","last_undegraded":"2023-11-28T16:58:10.367667+0000","last_fullsized":"2023-11-28T16:58:10.367667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854917+0000","last_change":"2023-11-28T16:58:10.393575+0000","last_active":"2023-11-28T16:58:11.854917+0000","last_peered":"2023-11-28T16:58:11.854917+0000","last_clean":"2023-11-28T16:58:11.854917+0000","last_became_active":"2023-11-28T16:58:10.392989+0000","last_became_peered":"2023-11-28T16:58:10.392989+0000","last_unstale":"2023-11-28T16:58:11.854917+0000","last_undegraded":"2023-11-28T16:58:11.854917+0000","last_fullsized":"2023-11-28T16:58:11.854917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:47.300754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375086+0000","last_change":"2023-11-28T16:57:57.306762+0000","last_active":"2023-11-28T16:58:10.375086+0000","last_peered":"2023-11-28T16:58:10.375086+0000","last_clean":"2023-11-28T16:58:10.375086+0000","last_became_active":"2023-11-28T16:57:57.306428+0000","last_became_peered":"2023-11-28T16:57:57.306428+0000","last_unstale":"2023-11-28T16:58:10.375086+0000","last_undegraded":"2023-11-28T16:58:10.375086+0000","last_fullsized":"2023-11-28T16:58:10.375086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:34.023526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380883+0000","last_change":"2023-11-28T16:58:10.401687+0000","last_active":"2023-11-28T16:58:11.380883+0000","last_peered":"2023-11-28T16:58:11.380883+0000","last_clean":"2023-11-28T16:58:11.380883+0000","last_became_active":"2023-11-28T16:58:10.400826+0000","last_became_peered":"2023-11-28T16:58:10.400826+0000","last_unstale":"2023-11-28T16:58:11.380883+0000","last_undegraded":"2023-11-28T16:58:11.380883+0000","last_fullsized":"2023-11-28T16:58:11.380883+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:03.319383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361702+0000","last_change":"2023-11-28T16:57:57.301733+0000","last_active":"2023-11-28T16:58:10.361702+0000","last_peered":"2023-11-28T16:58:10.361702+0000","last_clean":"2023-11-28T16:58:10.361702+0000","last_became_active":"2023-11-28T16:57:57.301402+0000","last_became_peered":"2023-11-28T16:57:57.301402+0000","last_unstale":"2023-11-28T16:58:10.361702+0000","last_undegraded":"2023-11-28T16:58:10.361702+0000","last_fullsized":"2023-11-28T16:58:10.361702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:35.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854509+0000","last_change":"2023-11-28T16:58:10.401381+0000","last_active":"2023-11-28T16:58:11.854509+0000","last_peered":"2023-11-28T16:58:11.854509+0000","last_clean":"2023-11-28T16:58:11.854509+0000","last_became_active":"2023-11-28T16:58:10.401101+0000","last_became_peered":"2023-11-28T16:58:10.401101+0000","last_unstale":"2023-11-28T16:58:11.854509+0000","last_undegraded":"2023-11-28T16:58:11.854509+0000","last_fullsized":"2023-11-28T16:58:11.854509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:19:00.255422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382504+0000","last_change":"2023-11-28T16:57:57.299228+0000","last_active":"2023-11-28T16:58:10.382504+0000","last_peered":"2023-11-28T16:58:10.382504+0000","last_clean":"2023-11-28T16:58:10.382504+0000","last_became_active":"2023-11-28T16:57:57.298919+0000","last_became_peered":"2023-11-28T16:57:57.298919+0000","last_unstale":"2023-11-28T16:58:10.382504+0000","last_undegraded":"2023-11-28T16:58:10.382504+0000","last_fullsized":"2023-11-28T16:58:10.382504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:09.019656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854006+0000","last_change":"2023-11-28T16:58:10.387592+0000","last_active":"2023-11-28T16:58:11.854006+0000","last_peered":"2023-11-28T16:58:11.854006+0000","last_clean":"2023-11-28T16:58:11.854006+0000","last_became_active":"2023-11-28T16:58:10.387334+0000","last_became_peered":"2023-11-28T16:58:10.387334+0000","last_unstale":"2023-11-28T16:58:11.854006+0000","last_undegraded":"2023-11-28T16:58:11.854006+0000","last_fullsized":"2023-11-28T16:58:11.854006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:18.094893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374620+0000","last_change":"2023-11-28T16:57:57.299427+0000","last_active":"2023-11-28T16:58:10.374620+0000","last_peered":"2023-11-28T16:58:10.374620+0000","last_clean":"2023-11-28T16:58:10.374620+0000","last_became_active":"2023-11-28T16:57:57.299152+0000","last_became_peered":"2023-11-28T16:57:57.299152+0000","last_unstale":"2023-11-28T16:58:10.374620+0000","last_undegraded":"2023-11-28T16:58:10.374620+0000","last_fullsized":"2023-11-28T16:58:10.374620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:15.293843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382088+0000","last_change":"2023-11-28T16:58:10.399459+0000","last_active":"2023-11-28T16:58:11.382088+0000","last_peered":"2023-11-28T16:58:11.382088+0000","last_clean":"2023-11-28T16:58:11.382088+0000","last_became_active":"2023-11-28T16:58:10.399075+0000","last_became_peered":"2023-11-28T16:58:10.399075+0000","last_unstale":"2023-11-28T16:58:11.382088+0000","last_undegraded":"2023-11-28T16:58:11.382088+0000","last_fullsized":"2023-11-28T16:58:11.382088+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:09.954778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360524+0000","last_change":"2023-11-28T16:57:57.293718+0000","last_active":"2023-11-28T16:58:10.360524+0000","last_peered":"2023-11-28T16:58:10.360524+0000","last_clean":"2023-11-28T16:58:10.360524+0000","last_became_active":"2023-11-28T16:57:57.293317+0000","last_became_peered":"2023-11-28T16:57:57.293317+0000","last_unstale":"2023-11-28T16:58:10.360524+0000","last_undegraded":"2023-11-28T16:58:10.360524+0000","last_fullsized":"2023-11-28T16:58:10.360524+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.381750+0000","last_change":"2023-11-28T16:58:10.395224+0000","last_active":"2023-11-28T16:58:11.381750+0000","last_peered":"2023-11-28T16:58:11.381750+0000","last_clean":"2023-11-28T16:58:11.381750+0000","last_became_active":"2023-11-28T16:58:10.394668+0000","last_became_peered":"2023-11-28T16:58:10.394668+0000","last_unstale":"2023-11-28T16:58:11.381750+0000","last_undegraded":"2023-11-28T16:58:11.381750+0000","last_fullsized":"2023-11-28T16:58:11.381750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:12.076027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377652+0000","last_change":"2023-11-28T16:57:57.307374+0000","last_active":"2023-11-28T16:58:10.377652+0000","last_peered":"2023-11-28T16:58:10.377652+0000","last_clean":"2023-11-28T16:58:10.377652+0000","last_became_active":"2023-11-28T16:57:57.305540+0000","last_became_peered":"2023-11-28T16:57:57.305540+0000","last_unstale":"2023-11-28T16:58:10.377652+0000","last_undegraded":"2023-11-28T16:58:10.377652+0000","last_fullsized":"2023-11-28T16:58:10.377652+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:34.222003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854834+0000","last_change":"2023-11-28T16:58:10.374427+0000","last_active":"2023-11-28T16:58:11.854834+0000","last_peered":"2023-11-28T16:58:11.854834+0000","last_clean":"2023-11-28T16:58:11.854834+0000","last_became_active":"2023-11-28T16:58:10.374146+0000","last_became_peered":"2023-11-28T16:58:10.374146+0000","last_unstale":"2023-11-28T16:58:11.854834+0000","last_undegraded":"2023-11-28T16:58:11.854834+0000","last_fullsized":"2023-11-28T16:58:11.854834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:59.066815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360449+0000","last_change":"2023-11-28T16:57:57.300922+0000","last_active":"2023-11-28T16:58:10.360449+0000","last_peered":"2023-11-28T16:58:10.360449+0000","last_clean":"2023-11-28T16:58:10.360449+0000","last_became_active":"2023-11-28T16:57:57.300127+0000","last_became_peered":"2023-11-28T16:57:57.300127+0000","last_unstale":"2023-11-28T16:58:10.360449+0000","last_undegraded":"2023-11-28T16:58:10.360449+0000","last_fullsized":"2023-11-28T16:58:10.360449+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854357+0000","last_change":"2023-11-28T16:58:10.388901+0000","last_active":"2023-11-28T16:58:11.854357+0000","last_peered":"2023-11-28T16:58:11.854357+0000","last_clean":"2023-11-28T16:58:11.854357+0000","last_became_active":"2023-11-28T16:58:10.388408+0000","last_became_peered":"2023-11-28T16:58:10.388408+0000","last_unstale":"2023-11-28T16:58:11.854357+0000","last_undegraded":"2023-11-28T16:58:11.854357+0000","last_fullsized":"2023-11-28T16:58:11.854357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:50.217884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376168+0000","last_change":"2023-11-28T16:57:57.307862+0000","last_active":"2023-11-28T16:58:10.376168+0000","last_peered":"2023-11-28T16:58:10.376168+0000","last_clean":"2023-11-28T16:58:10.376168+0000","last_became_active":"2023-11-28T16:57:57.307540+0000","last_became_peered":"2023-11-28T16:57:57.307540+0000","last_unstale":"2023-11-28T16:58:10.376168+0000","last_undegraded":"2023-11-28T16:58:10.376168+0000","last_fullsized":"2023-11-28T16:58:10.376168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:36.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852379+0000","last_change":"2023-11-28T16:58:10.392911+0000","last_active":"2023-11-28T16:58:11.852379+0000","last_peered":"2023-11-28T16:58:11.852379+0000","last_clean":"2023-11-28T16:58:11.852379+0000","last_became_active":"2023-11-28T16:58:10.388454+0000","last_became_peered":"2023-11-28T16:58:10.388454+0000","last_unstale":"2023-11-28T16:58:11.852379+0000","last_undegraded":"2023-11-28T16:58:11.852379+0000","last_fullsized":"2023-11-28T16:58:11.852379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:34.498594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382498+0000","last_change":"2023-11-28T16:57:57.284808+0000","last_active":"2023-11-28T16:58:10.382498+0000","last_peered":"2023-11-28T16:58:10.382498+0000","last_clean":"2023-11-28T16:58:10.382498+0000","last_became_active":"2023-11-28T16:57:57.284304+0000","last_became_peered":"2023-11-28T16:57:57.284304+0000","last_unstale":"2023-11-28T16:58:10.382498+0000","last_undegraded":"2023-11-28T16:58:10.382498+0000","last_fullsized":"2023-11-28T16:58:10.382498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:56.940553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854061+0000","last_change":"2023-11-28T16:58:10.388480+0000","last_active":"2023-11-28T16:58:11.854061+0000","last_peered":"2023-11-28T16:58:11.854061+0000","last_clean":"2023-11-28T16:58:11.854061+0000","last_became_active":"2023-11-28T16:58:10.388153+0000","last_became_peered":"2023-11-28T16:58:10.388153+0000","last_unstale":"2023-11-28T16:58:11.854061+0000","last_undegraded":"2023-11-28T16:58:11.854061+0000","last_fullsized":"2023-11-28T16:58:11.854061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:21.000572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381476+0000","last_change":"2023-11-28T16:57:57.291693+0000","last_active":"2023-11-28T16:58:10.381476+0000","last_peered":"2023-11-28T16:58:10.381476+0000","last_clean":"2023-11-28T16:58:10.381476+0000","last_became_active":"2023-11-28T16:57:57.291320+0000","last_became_peered":"2023-11-28T16:57:57.291320+0000","last_unstale":"2023-11-28T16:58:10.381476+0000","last_undegraded":"2023-11-28T16:58:10.381476+0000","last_fullsized":"2023-11-28T16:58:10.381476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:21.959226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.855183+0000","last_change":"2023-11-28T16:58:10.385804+0000","last_active":"2023-11-28T16:58:11.855183+0000","last_peered":"2023-11-28T16:58:11.855183+0000","last_clean":"2023-11-28T16:58:11.855183+0000","last_became_active":"2023-11-28T16:58:10.385484+0000","last_became_peered":"2023-11-28T16:58:10.385484+0000","last_unstale":"2023-11-28T16:58:11.855183+0000","last_undegraded":"2023-11-28T16:58:11.855183+0000","last_fullsized":"2023-11-28T16:58:11.855183+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:37.810329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367967+0000","last_change":"2023-11-28T16:57:57.299843+0000","last_active":"2023-11-28T16:58:10.367967+0000","last_peered":"2023-11-28T16:58:10.367967+0000","last_clean":"2023-11-28T16:58:10.367967+0000","last_became_active":"2023-11-28T16:57:57.299266+0000","last_became_peered":"2023-11-28T16:57:57.299266+0000","last_unstale":"2023-11-28T16:58:10.367967+0000","last_undegraded":"2023-11-28T16:58:10.367967+0000","last_fullsized":"2023-11-28T16:58:10.367967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384625+0000","last_change":"2023-11-28T16:58:10.399844+0000","last_active":"2023-11-28T16:58:11.384625+0000","last_peered":"2023-11-28T16:58:11.384625+0000","last_clean":"2023-11-28T16:58:11.384625+0000","last_became_active":"2023-11-28T16:58:10.399612+0000","last_became_peered":"2023-11-28T16:58:10.399612+0000","last_unstale":"2023-11-28T16:58:11.384625+0000","last_undegraded":"2023-11-28T16:58:11.384625+0000","last_fullsized":"2023-11-28T16:58:11.384625+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:39.374588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383013+0000","last_change":"2023-11-28T16:57:57.294587+0000","last_active":"2023-11-28T16:58:10.383013+0000","last_peered":"2023-11-28T16:58:10.383013+0000","last_clean":"2023-11-28T16:58:10.383013+0000","last_became_active":"2023-11-28T16:57:57.294283+0000","last_became_peered":"2023-11-28T16:57:57.294283+0000","last_unstale":"2023-11-28T16:58:10.383013+0000","last_undegraded":"2023-11-28T16:58:10.383013+0000","last_fullsized":"2023-11-28T16:58:10.383013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:35.632692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383695+0000","last_change":"2023-11-28T16:58:10.402027+0000","last_active":"2023-11-28T16:58:11.383695+0000","last_peered":"2023-11-28T16:58:11.383695+0000","last_clean":"2023-11-28T16:58:11.383695+0000","last_became_active":"2023-11-28T16:58:10.398300+0000","last_became_peered":"2023-11-28T16:58:10.398300+0000","last_unstale":"2023-11-28T16:58:11.383695+0000","last_undegraded":"2023-11-28T16:58:11.383695+0000","last_fullsized":"2023-11-28T16:58:11.383695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:00.310975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374778+0000","last_change":"2023-11-28T16:57:57.298034+0000","last_active":"2023-11-28T16:58:10.374778+0000","last_peered":"2023-11-28T16:58:10.374778+0000","last_clean":"2023-11-28T16:58:10.374778+0000","last_became_active":"2023-11-28T16:57:57.297743+0000","last_became_peered":"2023-11-28T16:57:57.297743+0000","last_unstale":"2023-11-28T16:58:10.374778+0000","last_undegraded":"2023-11-28T16:58:10.374778+0000","last_fullsized":"2023-11-28T16:58:10.374778+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:26.295837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854322+0000","last_change":"2023-11-28T16:58:10.394623+0000","last_active":"2023-11-28T16:58:11.854322+0000","last_peered":"2023-11-28T16:58:11.854322+0000","last_clean":"2023-11-28T16:58:11.854322+0000","last_became_active":"2023-11-28T16:58:10.394306+0000","last_became_peered":"2023-11-28T16:58:10.394306+0000","last_unstale":"2023-11-28T16:58:11.854322+0000","last_undegraded":"2023-11-28T16:58:11.854322+0000","last_fullsized":"2023-11-28T16:58:11.854322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:21.000572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360464+0000","last_change":"2023-11-28T16:57:57.296838+0000","last_active":"2023-11-28T16:58:10.360464+0000","last_peered":"2023-11-28T16:58:10.360464+0000","last_clean":"2023-11-28T16:58:10.360464+0000","last_became_active":"2023-11-28T16:57:57.295762+0000","last_became_peered":"2023-11-28T16:57:57.295762+0000","last_unstale":"2023-11-28T16:58:10.360464+0000","last_undegraded":"2023-11-28T16:58:10.360464+0000","last_fullsized":"2023-11-28T16:58:10.360464+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852421+0000","last_change":"2023-11-28T16:58:10.399375+0000","last_active":"2023-11-28T16:58:11.852421+0000","last_peered":"2023-11-28T16:58:11.852421+0000","last_clean":"2023-11-28T16:58:11.852421+0000","last_became_active":"2023-11-28T16:58:10.399093+0000","last_became_peered":"2023-11-28T16:58:10.399093+0000","last_unstale":"2023-11-28T16:58:11.852421+0000","last_undegraded":"2023-11-28T16:58:11.852421+0000","last_fullsized":"2023-11-28T16:58:11.852421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:59:26.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380817+0000","last_change":"2023-11-28T16:57:57.291516+0000","last_active":"2023-11-28T16:58:10.380817+0000","last_peered":"2023-11-28T16:58:10.380817+0000","last_clean":"2023-11-28T16:58:10.380817+0000","last_became_active":"2023-11-28T16:57:57.291201+0000","last_became_peered":"2023-11-28T16:57:57.291201+0000","last_unstale":"2023-11-28T16:58:10.380817+0000","last_undegraded":"2023-11-28T16:58:10.380817+0000","last_fullsized":"2023-11-28T16:58:10.380817+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:23.828578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383772+0000","last_change":"2023-11-28T16:58:10.400034+0000","last_active":"2023-11-28T16:58:11.383772+0000","last_peered":"2023-11-28T16:58:11.383772+0000","last_clean":"2023-11-28T16:58:11.383772+0000","last_became_active":"2023-11-28T16:58:10.399697+0000","last_became_peered":"2023-11-28T16:58:10.399697+0000","last_unstale":"2023-11-28T16:58:11.383772+0000","last_undegraded":"2023-11-28T16:58:11.383772+0000","last_fullsized":"2023-11-28T16:58:11.383772+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:13.674861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366340+0000","last_change":"2023-11-28T16:57:57.308867+0000","last_active":"2023-11-28T16:58:10.366340+0000","last_peered":"2023-11-28T16:58:10.366340+0000","last_clean":"2023-11-28T16:58:10.366340+0000","last_became_active":"2023-11-28T16:57:57.307693+0000","last_became_peered":"2023-11-28T16:57:57.307693+0000","last_unstale":"2023-11-28T16:58:10.366340+0000","last_undegraded":"2023-11-28T16:58:10.366340+0000","last_fullsized":"2023-11-28T16:58:10.366340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:24.984986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854132+0000","last_change":"2023-11-28T16:58:10.387001+0000","last_active":"2023-11-28T16:58:11.854132+0000","last_peered":"2023-11-28T16:58:11.854132+0000","last_clean":"2023-11-28T16:58:11.854132+0000","last_became_active":"2023-11-28T16:58:10.386629+0000","last_became_peered":"2023-11-28T16:58:10.386629+0000","last_unstale":"2023-11-28T16:58:11.854132+0000","last_undegraded":"2023-11-28T16:58:11.854132+0000","last_fullsized":"2023-11-28T16:58:11.854132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:49.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.401880+0000","last_change":"2023-11-28T16:58:09.374084+0000","last_active":"2023-11-28T16:58:10.401880+0000","last_peered":"2023-11-28T16:58:10.401880+0000","last_clean":"2023-11-28T16:58:10.401880+0000","last_became_active":"2023-11-28T16:58:09.373766+0000","last_became_peered":"2023-11-28T16:58:09.373766+0000","last_unstale":"2023-11-28T16:58:10.401880+0000","last_undegraded":"2023-11-28T16:58:10.401880+0000","last_fullsized":"2023-11-28T16:58:10.401880+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:20.154638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368999+0000","last_change":"2023-11-28T16:57:57.292539+0000","last_active":"2023-11-28T16:58:10.368999+0000","last_peered":"2023-11-28T16:58:10.368999+0000","last_clean":"2023-11-28T16:58:10.368999+0000","last_became_active":"2023-11-28T16:57:57.292189+0000","last_became_peered":"2023-11-28T16:57:57.292189+0000","last_unstale":"2023-11-28T16:58:10.368999+0000","last_undegraded":"2023-11-28T16:58:10.368999+0000","last_fullsized":"2023-11-28T16:58:10.368999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368405+0000","last_change":"2023-11-28T16:57:56.296007+0000","last_active":"2023-11-28T16:58:10.368405+0000","last_peered":"2023-11-28T16:58:10.368405+0000","last_clean":"2023-11-28T16:58:10.368405+0000","last_became_active":"2023-11-28T16:57:56.295636+0000","last_became_peered":"2023-11-28T16:57:56.295636+0000","last_unstale":"2023-11-28T16:58:10.368405+0000","last_undegraded":"2023-11-28T16:58:10.368405+0000","last_fullsized":"2023-11-28T16:58:10.368405+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:38.988857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382557+0000","last_change":"2023-11-28T16:58:10.381875+0000","last_active":"2023-11-28T16:58:11.382557+0000","last_peered":"2023-11-28T16:58:11.382557+0000","last_clean":"2023-11-28T16:58:11.382557+0000","last_became_active":"2023-11-28T16:58:10.381618+0000","last_became_peered":"2023-11-28T16:58:10.381618+0000","last_unstale":"2023-11-28T16:58:11.382557+0000","last_undegraded":"2023-11-28T16:58:11.382557+0000","last_fullsized":"2023-11-28T16:58:11.382557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:38.770172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.395002+0000","last_change":"2023-11-28T16:58:09.372867+0000","last_active":"2023-11-28T16:58:10.395002+0000","last_peered":"2023-11-28T16:58:10.395002+0000","last_clean":"2023-11-28T16:58:10.395002+0000","last_became_active":"2023-11-28T16:58:09.372597+0000","last_became_peered":"2023-11-28T16:58:09.372597+0000","last_unstale":"2023-11-28T16:58:10.395002+0000","last_undegraded":"2023-11-28T16:58:10.395002+0000","last_fullsized":"2023-11-28T16:58:10.395002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:10.354729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376253+0000","last_change":"2023-11-28T16:57:57.281906+0000","last_active":"2023-11-28T16:58:10.376253+0000","last_peered":"2023-11-28T16:58:10.376253+0000","last_clean":"2023-11-28T16:58:10.376253+0000","last_became_active":"2023-11-28T16:57:57.281593+0000","last_became_peered":"2023-11-28T16:57:57.281593+0000","last_unstale":"2023-11-28T16:58:10.376253+0000","last_undegraded":"2023-11-28T16:58:10.376253+0000","last_fullsized":"2023-11-28T16:58:10.376253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375522+0000","last_change":"2023-11-28T16:57:56.301479+0000","last_active":"2023-11-28T16:58:10.375522+0000","last_peered":"2023-11-28T16:58:10.375522+0000","last_clean":"2023-11-28T16:58:10.375522+0000","last_became_active":"2023-11-28T16:57:56.301262+0000","last_became_peered":"2023-11-28T16:57:56.301262+0000","last_unstale":"2023-11-28T16:58:10.375522+0000","last_undegraded":"2023-11-28T16:58:10.375522+0000","last_fullsized":"2023-11-28T16:58:10.375522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:34.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382465+0000","last_change":"2023-11-28T16:58:10.398175+0000","last_active":"2023-11-28T16:58:11.382465+0000","last_peered":"2023-11-28T16:58:11.382465+0000","last_clean":"2023-11-28T16:58:11.382465+0000","last_became_active":"2023-11-28T16:58:10.397893+0000","last_became_peered":"2023-11-28T16:58:10.397893+0000","last_unstale":"2023-11-28T16:58:11.382465+0000","last_undegraded":"2023-11-28T16:58:11.382465+0000","last_fullsized":"2023-11-28T16:58:11.382465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:42.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383723+0000","last_change":"2023-11-28T16:58:09.371624+0000","last_active":"2023-11-28T16:58:10.383723+0000","last_peered":"2023-11-28T16:58:10.383723+0000","last_clean":"2023-11-28T16:58:10.383723+0000","last_became_active":"2023-11-28T16:58:09.371252+0000","last_became_peered":"2023-11-28T16:58:09.371252+0000","last_unstale":"2023-11-28T16:58:10.383723+0000","last_undegraded":"2023-11-28T16:58:10.383723+0000","last_fullsized":"2023-11-28T16:58:10.383723+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:33.587590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367699+0000","last_change":"2023-11-28T16:57:57.296485+0000","last_active":"2023-11-28T16:58:10.367699+0000","last_peered":"2023-11-28T16:58:10.367699+0000","last_clean":"2023-11-28T16:58:10.367699+0000","last_became_active":"2023-11-28T16:57:57.296210+0000","last_became_peered":"2023-11-28T16:57:57.296210+0000","last_unstale":"2023-11-28T16:58:10.367699+0000","last_undegraded":"2023-11-28T16:58:10.367699+0000","last_fullsized":"2023-11-28T16:58:10.367699+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368219+0000","last_change":"2023-11-28T16:57:56.284952+0000","last_active":"2023-11-28T16:58:10.368219+0000","last_peered":"2023-11-28T16:58:10.368219+0000","last_clean":"2023-11-28T16:58:10.368219+0000","last_became_active":"2023-11-28T16:57:56.284663+0000","last_became_peered":"2023-11-28T16:57:56.284663+0000","last_unstale":"2023-11-28T16:58:10.368219+0000","last_undegraded":"2023-11-28T16:58:10.368219+0000","last_fullsized":"2023-11-28T16:58:10.368219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854666+0000","last_change":"2023-11-28T16:58:10.400740+0000","last_active":"2023-11-28T16:58:11.854666+0000","last_peered":"2023-11-28T16:58:11.854666+0000","last_clean":"2023-11-28T16:58:11.854666+0000","last_became_active":"2023-11-28T16:58:10.399606+0000","last_became_peered":"2023-11-28T16:58:10.399606+0000","last_unstale":"2023-11-28T16:58:11.854666+0000","last_undegraded":"2023-11-28T16:58:11.854666+0000","last_fullsized":"2023-11-28T16:58:11.854666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:09.836237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.385172+0000","last_change":"2023-11-28T16:58:09.379004+0000","last_active":"2023-11-28T16:58:10.385172+0000","last_peered":"2023-11-28T16:58:10.385172+0000","last_clean":"2023-11-28T16:58:10.385172+0000","last_became_active":"2023-11-28T16:58:09.378364+0000","last_became_peered":"2023-11-28T16:58:09.378364+0000","last_unstale":"2023-11-28T16:58:10.385172+0000","last_undegraded":"2023-11-28T16:58:10.385172+0000","last_fullsized":"2023-11-28T16:58:10.385172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:46.095952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368050+0000","last_change":"2023-11-28T16:57:57.299545+0000","last_active":"2023-11-28T16:58:10.368050+0000","last_peered":"2023-11-28T16:58:10.368050+0000","last_clean":"2023-11-28T16:58:10.368050+0000","last_became_active":"2023-11-28T16:57:57.298953+0000","last_became_peered":"2023-11-28T16:57:57.298953+0000","last_unstale":"2023-11-28T16:58:10.368050+0000","last_undegraded":"2023-11-28T16:58:10.368050+0000","last_fullsized":"2023-11-28T16:58:10.368050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381211+0000","last_change":"2023-11-28T16:57:56.293038+0000","last_active":"2023-11-28T16:58:10.381211+0000","last_peered":"2023-11-28T16:58:10.381211+0000","last_clean":"2023-11-28T16:58:10.381211+0000","last_became_active":"2023-11-28T16:57:56.292443+0000","last_became_peered":"2023-11-28T16:57:56.292443+0000","last_unstale":"2023-11-28T16:58:10.381211+0000","last_undegraded":"2023-11-28T16:58:10.381211+0000","last_fullsized":"2023-11-28T16:58:10.381211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851647+0000","last_change":"2023-11-28T16:58:10.393323+0000","last_active":"2023-11-28T16:58:11.851647+0000","last_peered":"2023-11-28T16:58:11.851647+0000","last_clean":"2023-11-28T16:58:11.851647+0000","last_became_active":"2023-11-28T16:58:10.393055+0000","last_became_peered":"2023-11-28T16:58:10.393055+0000","last_unstale":"2023-11-28T16:58:11.851647+0000","last_undegraded":"2023-11-28T16:58:11.851647+0000","last_fullsized":"2023-11-28T16:58:11.851647+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:54.392901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.363377+0000","last_change":"2023-11-28T16:58:09.366910+0000","last_active":"2023-11-28T16:58:10.363377+0000","last_peered":"2023-11-28T16:58:10.363377+0000","last_clean":"2023-11-28T16:58:10.363377+0000","last_became_active":"2023-11-28T16:58:09.366580+0000","last_became_peered":"2023-11-28T16:58:09.366580+0000","last_unstale":"2023-11-28T16:58:10.363377+0000","last_undegraded":"2023-11-28T16:58:10.363377+0000","last_fullsized":"2023-11-28T16:58:10.363377+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:00.459338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377733+0000","last_change":"2023-11-28T16:57:57.307182+0000","last_active":"2023-11-28T16:58:10.377733+0000","last_peered":"2023-11-28T16:58:10.377733+0000","last_clean":"2023-11-28T16:58:10.377733+0000","last_became_active":"2023-11-28T16:57:57.305143+0000","last_became_peered":"2023-11-28T16:57:57.305143+0000","last_unstale":"2023-11-28T16:58:10.377733+0000","last_undegraded":"2023-11-28T16:58:10.377733+0000","last_fullsized":"2023-11-28T16:58:10.377733+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:16.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367596+0000","last_change":"2023-11-28T16:57:56.298135+0000","last_active":"2023-11-28T16:58:10.367596+0000","last_peered":"2023-11-28T16:58:10.367596+0000","last_clean":"2023-11-28T16:58:10.367596+0000","last_became_active":"2023-11-28T16:57:56.297267+0000","last_became_peered":"2023-11-28T16:57:56.297267+0000","last_unstale":"2023-11-28T16:58:10.367596+0000","last_undegraded":"2023-11-28T16:58:10.367596+0000","last_fullsized":"2023-11-28T16:58:10.367596+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:46.168912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380533+0000","last_change":"2023-11-28T16:58:10.381177+0000","last_active":"2023-11-28T16:58:11.380533+0000","last_peered":"2023-11-28T16:58:11.380533+0000","last_clean":"2023-11-28T16:58:11.380533+0000","last_became_active":"2023-11-28T16:58:10.380843+0000","last_became_peered":"2023-11-28T16:58:10.380843+0000","last_unstale":"2023-11-28T16:58:11.380533+0000","last_undegraded":"2023-11-28T16:58:11.380533+0000","last_fullsized":"2023-11-28T16:58:11.380533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:34.593915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.379560+0000","last_change":"2023-11-28T16:58:09.379828+0000","last_active":"2023-11-28T16:58:10.379560+0000","last_peered":"2023-11-28T16:58:10.379560+0000","last_clean":"2023-11-28T16:58:10.379560+0000","last_became_active":"2023-11-28T16:58:09.378437+0000","last_became_peered":"2023-11-28T16:58:09.378437+0000","last_unstale":"2023-11-28T16:58:10.379560+0000","last_undegraded":"2023-11-28T16:58:10.379560+0000","last_fullsized":"2023-11-28T16:58:10.379560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:13:09.032301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374537+0000","last_change":"2023-11-28T16:57:57.310944+0000","last_active":"2023-11-28T16:58:10.374537+0000","last_peered":"2023-11-28T16:58:10.374537+0000","last_clean":"2023-11-28T16:58:10.374537+0000","last_became_active":"2023-11-28T16:57:57.306481+0000","last_became_peered":"2023-11-28T16:57:57.306481+0000","last_unstale":"2023-11-28T16:58:10.374537+0000","last_undegraded":"2023-11-28T16:58:10.374537+0000","last_fullsized":"2023-11-28T16:58:10.374537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.181027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367349+0000","last_change":"2023-11-28T16:57:56.294742+0000","last_active":"2023-11-28T16:58:10.367349+0000","last_peered":"2023-11-28T16:58:10.367349+0000","last_clean":"2023-11-28T16:58:10.367349+0000","last_became_active":"2023-11-28T16:57:56.294263+0000","last_became_peered":"2023-11-28T16:57:56.294263+0000","last_unstale":"2023-11-28T16:58:10.367349+0000","last_undegraded":"2023-11-28T16:58:10.367349+0000","last_fullsized":"2023-11-28T16:58:10.367349+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383927+0000","last_change":"2023-11-28T16:58:10.397454+0000","last_active":"2023-11-28T16:58:11.383927+0000","last_peered":"2023-11-28T16:58:11.383927+0000","last_clean":"2023-11-28T16:58:11.383927+0000","last_became_active":"2023-11-28T16:58:10.397161+0000","last_became_peered":"2023-11-28T16:58:10.397161+0000","last_unstale":"2023-11-28T16:58:11.383927+0000","last_undegraded":"2023-11-28T16:58:11.383927+0000","last_fullsized":"2023-11-28T16:58:11.383927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.259778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.387514+0000","last_change":"2023-11-28T16:58:09.370886+0000","last_active":"2023-11-28T16:58:10.387514+0000","last_peered":"2023-11-28T16:58:10.387514+0000","last_clean":"2023-11-28T16:58:10.387514+0000","last_became_active":"2023-11-28T16:58:09.370548+0000","last_became_peered":"2023-11-28T16:58:09.370548+0000","last_unstale":"2023-11-28T16:58:10.387514+0000","last_undegraded":"2023-11-28T16:58:10.387514+0000","last_fullsized":"2023-11-28T16:58:10.387514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:37.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376269+0000","last_change":"2023-11-28T16:57:57.303350+0000","last_active":"2023-11-28T16:58:10.376269+0000","last_peered":"2023-11-28T16:58:10.376269+0000","last_clean":"2023-11-28T16:58:10.376269+0000","last_became_active":"2023-11-28T16:57:57.302817+0000","last_became_peered":"2023-11-28T16:57:57.302817+0000","last_unstale":"2023-11-28T16:58:10.376269+0000","last_undegraded":"2023-11-28T16:58:10.376269+0000","last_fullsized":"2023-11-28T16:58:10.376269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:18.750912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383739+0000","last_change":"2023-11-28T16:57:56.289134+0000","last_active":"2023-11-28T16:58:10.383739+0000","last_peered":"2023-11-28T16:58:10.383739+0000","last_clean":"2023-11-28T16:58:10.383739+0000","last_became_active":"2023-11-28T16:57:56.288857+0000","last_became_peered":"2023-11-28T16:57:56.288857+0000","last_unstale":"2023-11-28T16:58:10.383739+0000","last_undegraded":"2023-11-28T16:58:10.383739+0000","last_fullsized":"2023-11-28T16:58:10.383739+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:02.295044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854723+0000","last_change":"2023-11-28T16:58:10.385980+0000","last_active":"2023-11-28T16:58:11.854723+0000","last_peered":"2023-11-28T16:58:11.854723+0000","last_clean":"2023-11-28T16:58:11.854723+0000","last_became_active":"2023-11-28T16:58:10.385681+0000","last_became_peered":"2023-11-28T16:58:10.385681+0000","last_unstale":"2023-11-28T16:58:11.854723+0000","last_undegraded":"2023-11-28T16:58:11.854723+0000","last_fullsized":"2023-11-28T16:58:11.854723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:30.767044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.395658+0000","last_change":"2023-11-28T16:58:09.370650+0000","last_active":"2023-11-28T16:58:10.395658+0000","last_peered":"2023-11-28T16:58:10.395658+0000","last_clean":"2023-11-28T16:58:10.395658+0000","last_became_active":"2023-11-28T16:58:09.370449+0000","last_became_peered":"2023-11-28T16:58:09.370449+0000","last_unstale":"2023-11-28T16:58:10.395658+0000","last_undegraded":"2023-11-28T16:58:10.395658+0000","last_fullsized":"2023-11-28T16:58:10.395658+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:37.057412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374710+0000","last_change":"2023-11-28T16:57:57.296614+0000","last_active":"2023-11-28T16:58:10.374710+0000","last_peered":"2023-11-28T16:58:10.374710+0000","last_clean":"2023-11-28T16:58:10.374710+0000","last_became_active":"2023-11-28T16:57:57.296296+0000","last_became_peered":"2023-11-28T16:57:57.296296+0000","last_unstale":"2023-11-28T16:58:10.374710+0000","last_undegraded":"2023-11-28T16:58:10.374710+0000","last_fullsized":"2023-11-28T16:58:10.374710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:24.731578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367337+0000","last_change":"2023-11-28T16:57:56.297579+0000","last_active":"2023-11-28T16:58:10.367337+0000","last_peered":"2023-11-28T16:58:10.367337+0000","last_clean":"2023-11-28T16:58:10.367337+0000","last_became_active":"2023-11-28T16:57:56.297237+0000","last_became_peered":"2023-11-28T16:57:56.297237+0000","last_unstale":"2023-11-28T16:58:10.367337+0000","last_undegraded":"2023-11-28T16:58:10.367337+0000","last_fullsized":"2023-11-28T16:58:10.367337+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:53.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854279+0000","last_change":"2023-11-28T16:58:10.393137+0000","last_active":"2023-11-28T16:58:11.854279+0000","last_peered":"2023-11-28T16:58:11.854279+0000","last_clean":"2023-11-28T16:58:11.854279+0000","last_became_active":"2023-11-28T16:58:10.392430+0000","last_became_peered":"2023-11-28T16:58:10.392430+0000","last_unstale":"2023-11-28T16:58:11.854279+0000","last_undegraded":"2023-11-28T16:58:11.854279+0000","last_fullsized":"2023-11-28T16:58:11.854279+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:32.158497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.402730+0000","last_change":"2023-11-28T16:58:09.371255+0000","last_active":"2023-11-28T16:58:10.402730+0000","last_peered":"2023-11-28T16:58:10.402730+0000","last_clean":"2023-11-28T16:58:10.402730+0000","last_became_active":"2023-11-28T16:58:09.368332+0000","last_became_peered":"2023-11-28T16:58:09.368332+0000","last_unstale":"2023-11-28T16:58:10.402730+0000","last_undegraded":"2023-11-28T16:58:10.402730+0000","last_fullsized":"2023-11-28T16:58:10.402730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:39:21.467530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368278+0000","last_change":"2023-11-28T16:57:57.288341+0000","last_active":"2023-11-28T16:58:10.368278+0000","last_peered":"2023-11-28T16:58:10.368278+0000","last_clean":"2023-11-28T16:58:10.368278+0000","last_became_active":"2023-11-28T16:57:57.286946+0000","last_became_peered":"2023-11-28T16:57:57.286946+0000","last_unstale":"2023-11-28T16:58:10.368278+0000","last_undegraded":"2023-11-28T16:58:10.368278+0000","last_fullsized":"2023-11-28T16:58:10.368278+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:03.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362086+0000","last_change":"2023-11-28T16:57:56.303238+0000","last_active":"2023-11-28T16:58:10.362086+0000","last_peered":"2023-11-28T16:58:10.362086+0000","last_clean":"2023-11-28T16:58:10.362086+0000","last_became_active":"2023-11-28T16:57:56.302991+0000","last_became_peered":"2023-11-28T16:57:56.302991+0000","last_unstale":"2023-11-28T16:58:10.362086+0000","last_undegraded":"2023-11-28T16:58:10.362086+0000","last_fullsized":"2023-11-28T16:58:10.362086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854290+0000","last_change":"2023-11-28T16:58:10.382967+0000","last_active":"2023-11-28T16:58:11.854290+0000","last_peered":"2023-11-28T16:58:11.854290+0000","last_clean":"2023-11-28T16:58:11.854290+0000","last_became_active":"2023-11-28T16:58:10.382676+0000","last_became_peered":"2023-11-28T16:58:10.382676+0000","last_unstale":"2023-11-28T16:58:11.854290+0000","last_undegraded":"2023-11-28T16:58:11.854290+0000","last_fullsized":"2023-11-28T16:58:11.854290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:30.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.403098+0000","last_change":"2023-11-28T16:58:09.380840+0000","last_active":"2023-11-28T16:58:10.403098+0000","last_peered":"2023-11-28T16:58:10.403098+0000","last_clean":"2023-11-28T16:58:10.403098+0000","last_became_active":"2023-11-28T16:58:09.380365+0000","last_became_peered":"2023-11-28T16:58:09.380365+0000","last_unstale":"2023-11-28T16:58:10.403098+0000","last_undegraded":"2023-11-28T16:58:10.403098+0000","last_fullsized":"2023-11-28T16:58:10.403098+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:55.823583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361990+0000","last_change":"2023-11-28T16:57:57.292344+0000","last_active":"2023-11-28T16:58:10.361990+0000","last_peered":"2023-11-28T16:58:10.361990+0000","last_clean":"2023-11-28T16:58:10.361990+0000","last_became_active":"2023-11-28T16:57:57.291977+0000","last_became_peered":"2023-11-28T16:57:57.291977+0000","last_unstale":"2023-11-28T16:58:10.361990+0000","last_undegraded":"2023-11-28T16:58:10.361990+0000","last_fullsized":"2023-11-28T16:58:10.361990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:35.065157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375611+0000","last_change":"2023-11-28T16:57:56.300060+0000","last_active":"2023-11-28T16:58:10.375611+0000","last_peered":"2023-11-28T16:58:10.375611+0000","last_clean":"2023-11-28T16:58:10.375611+0000","last_became_active":"2023-11-28T16:57:56.299780+0000","last_became_peered":"2023-11-28T16:57:56.299780+0000","last_unstale":"2023-11-28T16:58:10.375611+0000","last_undegraded":"2023-11-28T16:58:10.375611+0000","last_fullsized":"2023-11-28T16:58:10.375611+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:18.071987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384746+0000","last_change":"2023-11-28T16:58:10.396588+0000","last_active":"2023-11-28T16:58:11.384746+0000","last_peered":"2023-11-28T16:58:11.384746+0000","last_clean":"2023-11-28T16:58:11.384746+0000","last_became_active":"2023-11-28T16:58:10.396059+0000","last_became_peered":"2023-11-28T16:58:10.396059+0000","last_unstale":"2023-11-28T16:58:11.384746+0000","last_undegraded":"2023-11-28T16:58:11.384746+0000","last_fullsized":"2023-11-28T16:58:11.384746+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:11.429575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367294+0000","last_change":"2023-11-28T16:58:09.374674+0000","last_active":"2023-11-28T16:58:10.367294+0000","last_peered":"2023-11-28T16:58:10.367294+0000","last_clean":"2023-11-28T16:58:10.367294+0000","last_became_active":"2023-11-28T16:58:09.374379+0000","last_became_peered":"2023-11-28T16:58:09.374379+0000","last_unstale":"2023-11-28T16:58:10.367294+0000","last_undegraded":"2023-11-28T16:58:10.367294+0000","last_fullsized":"2023-11-28T16:58:10.367294+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:47.534548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376038+0000","last_change":"2023-11-28T16:57:57.291393+0000","last_active":"2023-11-28T16:58:10.376038+0000","last_peered":"2023-11-28T16:58:10.376038+0000","last_clean":"2023-11-28T16:58:10.376038+0000","last_became_active":"2023-11-28T16:57:57.290974+0000","last_became_peered":"2023-11-28T16:57:57.290974+0000","last_unstale":"2023-11-28T16:58:10.376038+0000","last_undegraded":"2023-11-28T16:58:10.376038+0000","last_fullsized":"2023-11-28T16:58:10.376038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:47.176671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362341+0000","last_change":"2023-11-28T16:57:56.293494+0000","last_active":"2023-11-28T16:58:10.362341+0000","last_peered":"2023-11-28T16:58:10.362341+0000","last_clean":"2023-11-28T16:58:10.362341+0000","last_became_active":"2023-11-28T16:57:56.293071+0000","last_became_peered":"2023-11-28T16:57:56.293071+0000","last_unstale":"2023-11-28T16:58:10.362341+0000","last_undegraded":"2023-11-28T16:58:10.362341+0000","last_fullsized":"2023-11-28T16:58:10.362341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:42.043041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382622+0000","last_change":"2023-11-28T16:58:10.394814+0000","last_active":"2023-11-28T16:58:11.382622+0000","last_peered":"2023-11-28T16:58:11.382622+0000","last_clean":"2023-11-28T16:58:11.382622+0000","last_became_active":"2023-11-28T16:58:10.393783+0000","last_became_peered":"2023-11-28T16:58:10.393783+0000","last_unstale":"2023-11-28T16:58:11.382622+0000","last_undegraded":"2023-11-28T16:58:11.382622+0000","last_fullsized":"2023-11-28T16:58:11.382622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:39:22.473855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.387355+0000","last_change":"2023-11-28T16:58:09.377961+0000","last_active":"2023-11-28T16:58:10.387355+0000","last_peered":"2023-11-28T16:58:10.387355+0000","last_clean":"2023-11-28T16:58:10.387355+0000","last_became_active":"2023-11-28T16:58:09.377333+0000","last_became_peered":"2023-11-28T16:58:09.377333+0000","last_unstale":"2023-11-28T16:58:10.387355+0000","last_undegraded":"2023-11-28T16:58:10.387355+0000","last_fullsized":"2023-11-28T16:58:10.387355+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362025+0000","last_change":"2023-11-28T16:57:57.293148+0000","last_active":"2023-11-28T16:58:10.362025+0000","last_peered":"2023-11-28T16:58:10.362025+0000","last_clean":"2023-11-28T16:58:10.362025+0000","last_became_active":"2023-11-28T16:57:57.292674+0000","last_became_peered":"2023-11-28T16:57:57.292674+0000","last_unstale":"2023-11-28T16:58:10.362025+0000","last_undegraded":"2023-11-28T16:58:10.362025+0000","last_fullsized":"2023-11-28T16:58:10.362025+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367621+0000","last_change":"2023-11-28T16:57:56.289047+0000","last_active":"2023-11-28T16:58:10.367621+0000","last_peered":"2023-11-28T16:58:10.367621+0000","last_clean":"2023-11-28T16:58:10.367621+0000","last_became_active":"2023-11-28T16:57:56.288333+0000","last_became_peered":"2023-11-28T16:57:56.288333+0000","last_unstale":"2023-11-28T16:58:10.367621+0000","last_undegraded":"2023-11-28T16:58:10.367621+0000","last_fullsized":"2023-11-28T16:58:10.367621+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:55.749727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380546+0000","last_change":"2023-11-28T16:58:10.393234+0000","last_active":"2023-11-28T16:58:11.380546+0000","last_peered":"2023-11-28T16:58:11.380546+0000","last_clean":"2023-11-28T16:58:11.380546+0000","last_became_active":"2023-11-28T16:58:10.392969+0000","last_became_peered":"2023-11-28T16:58:10.392969+0000","last_unstale":"2023-11-28T16:58:11.380546+0000","last_undegraded":"2023-11-28T16:58:11.380546+0000","last_fullsized":"2023-11-28T16:58:11.380546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:49.906373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383579+0000","last_change":"2023-11-28T16:58:09.369628+0000","last_active":"2023-11-28T16:58:10.383579+0000","last_peered":"2023-11-28T16:58:10.383579+0000","last_clean":"2023-11-28T16:58:10.383579+0000","last_became_active":"2023-11-28T16:58:09.369340+0000","last_became_peered":"2023-11-28T16:58:09.369340+0000","last_unstale":"2023-11-28T16:58:10.383579+0000","last_undegraded":"2023-11-28T16:58:10.383579+0000","last_fullsized":"2023-11-28T16:58:10.383579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:26.069648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380530+0000","last_change":"2023-11-28T16:57:57.306068+0000","last_active":"2023-11-28T16:58:10.380530+0000","last_peered":"2023-11-28T16:58:10.380530+0000","last_clean":"2023-11-28T16:58:10.380530+0000","last_became_active":"2023-11-28T16:57:57.305881+0000","last_became_peered":"2023-11-28T16:57:57.305881+0000","last_unstale":"2023-11-28T16:58:10.380530+0000","last_undegraded":"2023-11-28T16:58:10.380530+0000","last_fullsized":"2023-11-28T16:58:10.380530+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:39.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374670+0000","last_change":"2023-11-28T16:57:56.297847+0000","last_active":"2023-11-28T16:58:10.374670+0000","last_peered":"2023-11-28T16:58:10.374670+0000","last_clean":"2023-11-28T16:58:10.374670+0000","last_became_active":"2023-11-28T16:57:56.297578+0000","last_became_peered":"2023-11-28T16:57:56.297578+0000","last_unstale":"2023-11-28T16:58:10.374670+0000","last_undegraded":"2023-11-28T16:58:10.374670+0000","last_fullsized":"2023-11-28T16:58:10.374670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.329569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851647+0000","last_change":"2023-11-28T16:58:10.391908+0000","last_active":"2023-11-28T16:58:11.851647+0000","last_peered":"2023-11-28T16:58:11.851647+0000","last_clean":"2023-11-28T16:58:11.851647+0000","last_became_active":"2023-11-28T16:58:10.391594+0000","last_became_peered":"2023-11-28T16:58:10.391594+0000","last_unstale":"2023-11-28T16:58:11.851647+0000","last_undegraded":"2023-11-28T16:58:11.851647+0000","last_fullsized":"2023-11-28T16:58:11.851647+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:50.232526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.386099+0000","last_change":"2023-11-28T16:58:09.362708+0000","last_active":"2023-11-28T16:58:10.386099+0000","last_peered":"2023-11-28T16:58:10.386099+0000","last_clean":"2023-11-28T16:58:10.386099+0000","last_became_active":"2023-11-28T16:58:09.362441+0000","last_became_peered":"2023-11-28T16:58:09.362441+0000","last_unstale":"2023-11-28T16:58:10.386099+0000","last_undegraded":"2023-11-28T16:58:10.386099+0000","last_fullsized":"2023-11-28T16:58:10.386099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360728+0000","last_change":"2023-11-28T16:57:57.295241+0000","last_active":"2023-11-28T16:58:10.360728+0000","last_peered":"2023-11-28T16:58:10.360728+0000","last_clean":"2023-11-28T16:58:10.360728+0000","last_became_active":"2023-11-28T16:57:57.295059+0000","last_became_peered":"2023-11-28T16:57:57.295059+0000","last_unstale":"2023-11-28T16:58:10.360728+0000","last_undegraded":"2023-11-28T16:58:10.360728+0000","last_fullsized":"2023-11-28T16:58:10.360728+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.378674+0000","last_change":"2023-11-28T16:57:56.292527+0000","last_active":"2023-11-28T16:58:10.378674+0000","last_peered":"2023-11-28T16:58:10.378674+0000","last_clean":"2023-11-28T16:58:10.378674+0000","last_became_active":"2023-11-28T16:57:56.292280+0000","last_became_peered":"2023-11-28T16:57:56.292280+0000","last_unstale":"2023-11-28T16:58:10.378674+0000","last_undegraded":"2023-11-28T16:58:10.378674+0000","last_fullsized":"2023-11-28T16:58:10.378674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:36.146016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.381939+0000","last_change":"2023-11-28T16:58:10.386882+0000","last_active":"2023-11-28T16:58:11.381939+0000","last_peered":"2023-11-28T16:58:11.381939+0000","last_clean":"2023-11-28T16:58:11.381939+0000","last_became_active":"2023-11-28T16:58:10.386608+0000","last_became_peered":"2023-11-28T16:58:10.386608+0000","last_unstale":"2023-11-28T16:58:11.381939+0000","last_undegraded":"2023-11-28T16:58:11.381939+0000","last_fullsized":"2023-11-28T16:58:11.381939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:03.570619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382568+0000","last_change":"2023-11-28T16:58:09.370461+0000","last_active":"2023-11-28T16:58:10.382568+0000","last_peered":"2023-11-28T16:58:10.382568+0000","last_clean":"2023-11-28T16:58:10.382568+0000","last_became_active":"2023-11-28T16:58:09.370211+0000","last_became_peered":"2023-11-28T16:58:09.370211+0000","last_unstale":"2023-11-28T16:58:10.382568+0000","last_undegraded":"2023-11-28T16:58:10.382568+0000","last_fullsized":"2023-11-28T16:58:10.382568+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:39.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367221+0000","last_change":"2023-11-28T16:57:57.292399+0000","last_active":"2023-11-28T16:58:10.367221+0000","last_peered":"2023-11-28T16:58:10.367221+0000","last_clean":"2023-11-28T16:58:10.367221+0000","last_became_active":"2023-11-28T16:57:57.291492+0000","last_became_peered":"2023-11-28T16:57:57.291492+0000","last_unstale":"2023-11-28T16:58:10.367221+0000","last_undegraded":"2023-11-28T16:58:10.367221+0000","last_fullsized":"2023-11-28T16:58:10.367221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383820+0000","last_change":"2023-11-28T16:57:56.288401+0000","last_active":"2023-11-28T16:58:10.383820+0000","last_peered":"2023-11-28T16:58:10.383820+0000","last_clean":"2023-11-28T16:58:10.383820+0000","last_became_active":"2023-11-28T16:57:56.288046+0000","last_became_peered":"2023-11-28T16:57:56.288046+0000","last_unstale":"2023-11-28T16:58:10.383820+0000","last_undegraded":"2023-11-28T16:58:10.383820+0000","last_fullsized":"2023-11-28T16:58:10.383820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:23.260917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384273+0000","last_change":"2023-11-28T16:58:10.396994+0000","last_active":"2023-11-28T16:58:11.384273+0000","last_peered":"2023-11-28T16:58:11.384273+0000","last_clean":"2023-11-28T16:58:11.384273+0000","last_became_active":"2023-11-28T16:58:10.396691+0000","last_became_peered":"2023-11-28T16:58:10.396691+0000","last_unstale":"2023-11-28T16:58:11.384273+0000","last_undegraded":"2023-11-28T16:58:11.384273+0000","last_fullsized":"2023-11-28T16:58:11.384273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:47.102277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.378404+0000","last_change":"2023-11-28T16:58:09.381709+0000","last_active":"2023-11-28T16:58:10.378404+0000","last_peered":"2023-11-28T16:58:10.378404+0000","last_clean":"2023-11-28T16:58:10.378404+0000","last_became_active":"2023-11-28T16:58:09.381442+0000","last_became_peered":"2023-11-28T16:58:09.381442+0000","last_unstale":"2023-11-28T16:58:10.378404+0000","last_undegraded":"2023-11-28T16:58:10.378404+0000","last_fullsized":"2023-11-28T16:58:10.378404+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:03.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360704+0000","last_change":"2023-11-28T16:57:57.300273+0000","last_active":"2023-11-28T16:58:10.360704+0000","last_peered":"2023-11-28T16:58:10.360704+0000","last_clean":"2023-11-28T16:58:10.360704+0000","last_became_active":"2023-11-28T16:57:57.300005+0000","last_became_peered":"2023-11-28T16:57:57.300005+0000","last_unstale":"2023-11-28T16:58:10.360704+0000","last_undegraded":"2023-11-28T16:58:10.360704+0000","last_fullsized":"2023-11-28T16:58:10.360704+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360636+0000","last_change":"2023-11-28T16:57:56.297211+0000","last_active":"2023-11-28T16:58:10.360636+0000","last_peered":"2023-11-28T16:58:10.360636+0000","last_clean":"2023-11-28T16:58:10.360636+0000","last_became_active":"2023-11-28T16:57:56.296321+0000","last_became_peered":"2023-11-28T16:57:56.296321+0000","last_unstale":"2023-11-28T16:58:10.360636+0000","last_undegraded":"2023-11-28T16:58:10.360636+0000","last_fullsized":"2023-11-28T16:58:10.360636+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853066+0000","last_change":"2023-11-28T16:58:10.386695+0000","last_active":"2023-11-28T16:58:11.853066+0000","last_peered":"2023-11-28T16:58:11.853066+0000","last_clean":"2023-11-28T16:58:11.853066+0000","last_became_active":"2023-11-28T16:58:10.386245+0000","last_became_peered":"2023-11-28T16:58:10.386245+0000","last_unstale":"2023-11-28T16:58:11.853066+0000","last_undegraded":"2023-11-28T16:58:11.853066+0000","last_fullsized":"2023-11-28T16:58:11.853066+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:04.924665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.396055+0000","last_change":"2023-11-28T16:58:09.372355+0000","last_active":"2023-11-28T16:58:10.396055+0000","last_peered":"2023-11-28T16:58:10.396055+0000","last_clean":"2023-11-28T16:58:10.396055+0000","last_became_active":"2023-11-28T16:58:09.372007+0000","last_became_peered":"2023-11-28T16:58:09.372007+0000","last_unstale":"2023-11-28T16:58:10.396055+0000","last_undegraded":"2023-11-28T16:58:10.396055+0000","last_fullsized":"2023-11-28T16:58:10.396055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:17.088568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361689+0000","last_change":"2023-11-28T16:57:57.294684+0000","last_active":"2023-11-28T16:58:10.361689+0000","last_peered":"2023-11-28T16:58:10.361689+0000","last_clean":"2023-11-28T16:58:10.361689+0000","last_became_active":"2023-11-28T16:57:57.294339+0000","last_became_peered":"2023-11-28T16:57:57.294339+0000","last_unstale":"2023-11-28T16:58:10.361689+0000","last_undegraded":"2023-11-28T16:58:10.361689+0000","last_fullsized":"2023-11-28T16:58:10.361689+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:19.079746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375285+0000","last_change":"2023-11-28T16:57:56.302265+0000","last_active":"2023-11-28T16:58:10.375285+0000","last_peered":"2023-11-28T16:58:10.375285+0000","last_clean":"2023-11-28T16:58:10.375285+0000","last_became_active":"2023-11-28T16:57:56.301960+0000","last_became_peered":"2023-11-28T16:57:56.301960+0000","last_unstale":"2023-11-28T16:58:10.375285+0000","last_undegraded":"2023-11-28T16:58:10.375285+0000","last_fullsized":"2023-11-28T16:58:10.375285+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:36.131374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854125+0000","last_change":"2023-11-28T16:58:10.395955+0000","last_active":"2023-11-28T16:58:11.854125+0000","last_peered":"2023-11-28T16:58:11.854125+0000","last_clean":"2023-11-28T16:58:11.854125+0000","last_became_active":"2023-11-28T16:58:10.395688+0000","last_became_peered":"2023-11-28T16:58:10.395688+0000","last_unstale":"2023-11-28T16:58:11.854125+0000","last_undegraded":"2023-11-28T16:58:11.854125+0000","last_fullsized":"2023-11-28T16:58:11.854125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:48.470091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361390+0000","last_change":"2023-11-28T16:58:09.358618+0000","last_active":"2023-11-28T16:58:10.361390+0000","last_peered":"2023-11-28T16:58:10.361390+0000","last_clean":"2023-11-28T16:58:10.361390+0000","last_became_active":"2023-11-28T16:58:09.358326+0000","last_became_peered":"2023-11-28T16:58:09.358326+0000","last_unstale":"2023-11-28T16:58:10.361390+0000","last_undegraded":"2023-11-28T16:58:10.361390+0000","last_fullsized":"2023-11-28T16:58:10.361390+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:48.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381303+0000","last_change":"2023-11-28T16:57:57.296609+0000","last_active":"2023-11-28T16:58:10.381303+0000","last_peered":"2023-11-28T16:58:10.381303+0000","last_clean":"2023-11-28T16:58:10.381303+0000","last_became_active":"2023-11-28T16:57:57.296304+0000","last_became_peered":"2023-11-28T16:57:57.296304+0000","last_unstale":"2023-11-28T16:58:10.381303+0000","last_undegraded":"2023-11-28T16:58:10.381303+0000","last_fullsized":"2023-11-28T16:58:10.381303+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:27.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.369094+0000","last_change":"2023-11-28T16:57:56.296905+0000","last_active":"2023-11-28T16:58:10.369094+0000","last_peered":"2023-11-28T16:58:10.369094+0000","last_clean":"2023-11-28T16:58:10.369094+0000","last_became_active":"2023-11-28T16:57:56.295819+0000","last_became_peered":"2023-11-28T16:57:56.295819+0000","last_unstale":"2023-11-28T16:58:10.369094+0000","last_undegraded":"2023-11-28T16:58:10.369094+0000","last_fullsized":"2023-11-28T16:58:10.369094+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.855362+0000","last_change":"2023-11-28T16:58:10.380247+0000","last_active":"2023-11-28T16:58:11.855362+0000","last_peered":"2023-11-28T16:58:11.855362+0000","last_clean":"2023-11-28T16:58:11.855362+0000","last_became_active":"2023-11-28T16:58:10.379952+0000","last_became_peered":"2023-11-28T16:58:10.379952+0000","last_unstale":"2023-11-28T16:58:11.855362+0000","last_undegraded":"2023-11-28T16:58:11.855362+0000","last_fullsized":"2023-11-28T16:58:11.855362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:27.075972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.404736+0000","last_change":"2023-11-28T16:58:09.375035+0000","last_active":"2023-11-28T16:58:10.404736+0000","last_peered":"2023-11-28T16:58:10.404736+0000","last_clean":"2023-11-28T16:58:10.404736+0000","last_became_active":"2023-11-28T16:58:09.374689+0000","last_became_peered":"2023-11-28T16:58:09.374689+0000","last_unstale":"2023-11-28T16:58:10.404736+0000","last_undegraded":"2023-11-28T16:58:10.404736+0000","last_fullsized":"2023-11-28T16:58:10.404736+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:26.409754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374703+0000","last_change":"2023-11-28T16:57:57.297238+0000","last_active":"2023-11-28T16:58:10.374703+0000","last_peered":"2023-11-28T16:58:10.374703+0000","last_clean":"2023-11-28T16:58:10.374703+0000","last_became_active":"2023-11-28T16:57:57.296895+0000","last_became_peered":"2023-11-28T16:57:57.296895+0000","last_unstale":"2023-11-28T16:58:10.374703+0000","last_undegraded":"2023-11-28T16:58:10.374703+0000","last_fullsized":"2023-11-28T16:58:10.374703+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:47.232224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.390145+0000","last_change":"2023-11-28T16:57:56.292453+0000","last_active":"2023-11-28T16:58:10.390145+0000","last_peered":"2023-11-28T16:58:10.390145+0000","last_clean":"2023-11-28T16:58:10.390145+0000","last_became_active":"2023-11-28T16:57:56.292147+0000","last_became_peered":"2023-11-28T16:57:56.292147+0000","last_unstale":"2023-11-28T16:58:10.390145+0000","last_undegraded":"2023-11-28T16:58:10.390145+0000","last_fullsized":"2023-11-28T16:58:10.390145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382971+0000","last_change":"2023-11-28T16:58:10.384350+0000","last_active":"2023-11-28T16:58:11.382971+0000","last_peered":"2023-11-28T16:58:11.382971+0000","last_clean":"2023-11-28T16:58:11.382971+0000","last_became_active":"2023-11-28T16:58:10.383738+0000","last_became_peered":"2023-11-28T16:58:10.383738+0000","last_unstale":"2023-11-28T16:58:11.382971+0000","last_undegraded":"2023-11-28T16:58:11.382971+0000","last_fullsized":"2023-11-28T16:58:11.382971+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:03.353470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.401514+0000","last_change":"2023-11-28T16:58:09.374106+0000","last_active":"2023-11-28T16:58:10.401514+0000","last_peered":"2023-11-28T16:58:10.401514+0000","last_clean":"2023-11-28T16:58:10.401514+0000","last_became_active":"2023-11-28T16:58:09.373822+0000","last_became_peered":"2023-11-28T16:58:09.373822+0000","last_unstale":"2023-11-28T16:58:10.401514+0000","last_undegraded":"2023-11-28T16:58:10.401514+0000","last_fullsized":"2023-11-28T16:58:10.401514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:47.137583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362138+0000","last_change":"2023-11-28T16:57:57.292951+0000","last_active":"2023-11-28T16:58:10.362138+0000","last_peered":"2023-11-28T16:58:10.362138+0000","last_clean":"2023-11-28T16:58:10.362138+0000","last_became_active":"2023-11-28T16:57:57.292254+0000","last_became_peered":"2023-11-28T16:57:57.292254+0000","last_unstale":"2023-11-28T16:58:10.362138+0000","last_undegraded":"2023-11-28T16:58:10.362138+0000","last_fullsized":"2023-11-28T16:58:10.362138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:07.921821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367788+0000","last_change":"2023-11-28T16:57:56.301392+0000","last_active":"2023-11-28T16:58:10.367788+0000","last_peered":"2023-11-28T16:58:10.367788+0000","last_clean":"2023-11-28T16:58:10.367788+0000","last_became_active":"2023-11-28T16:57:56.300939+0000","last_became_peered":"2023-11-28T16:57:56.300939+0000","last_unstale":"2023-11-28T16:58:10.367788+0000","last_undegraded":"2023-11-28T16:58:10.367788+0000","last_fullsized":"2023-11-28T16:58:10.367788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:05.783524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852031+0000","last_change":"2023-11-28T16:58:10.393025+0000","last_active":"2023-11-28T16:58:11.852031+0000","last_peered":"2023-11-28T16:58:11.852031+0000","last_clean":"2023-11-28T16:58:11.852031+0000","last_became_active":"2023-11-28T16:58:10.392671+0000","last_became_peered":"2023-11-28T16:58:10.392671+0000","last_unstale":"2023-11-28T16:58:11.852031+0000","last_undegraded":"2023-11-28T16:58:11.852031+0000","last_fullsized":"2023-11-28T16:58:11.852031+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:49:40.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383455+0000","last_change":"2023-11-28T16:58:09.381243+0000","last_active":"2023-11-28T16:58:10.383455+0000","last_peered":"2023-11-28T16:58:10.383455+0000","last_clean":"2023-11-28T16:58:10.383455+0000","last_became_active":"2023-11-28T16:58:09.381035+0000","last_became_peered":"2023-11-28T16:58:09.381035+0000","last_unstale":"2023-11-28T16:58:10.383455+0000","last_undegraded":"2023-11-28T16:58:10.383455+0000","last_fullsized":"2023-11-28T16:58:10.383455+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380613+0000","last_change":"2023-11-28T16:57:57.304252+0000","last_active":"2023-11-28T16:58:10.380613+0000","last_peered":"2023-11-28T16:58:10.380613+0000","last_clean":"2023-11-28T16:58:10.380613+0000","last_became_active":"2023-11-28T16:57:57.303963+0000","last_became_peered":"2023-11-28T16:57:57.303963+0000","last_unstale":"2023-11-28T16:58:10.380613+0000","last_undegraded":"2023-11-28T16:58:10.380613+0000","last_fullsized":"2023-11-28T16:58:10.380613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:08.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374816+0000","last_change":"2023-11-28T16:57:56.291678+0000","last_active":"2023-11-28T16:58:10.374816+0000","last_peered":"2023-11-28T16:58:10.374816+0000","last_clean":"2023-11-28T16:58:10.374816+0000","last_became_active":"2023-11-28T16:57:56.289787+0000","last_became_peered":"2023-11-28T16:57:56.289787+0000","last_unstale":"2023-11-28T16:58:10.374816+0000","last_undegraded":"2023-11-28T16:58:10.374816+0000","last_fullsized":"2023-11-28T16:58:10.374816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:08.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852052+0000","last_change":"2023-11-28T16:58:10.395002+0000","last_active":"2023-11-28T16:58:11.852052+0000","last_peered":"2023-11-28T16:58:11.852052+0000","last_clean":"2023-11-28T16:58:11.852052+0000","last_became_active":"2023-11-28T16:58:10.394684+0000","last_became_peered":"2023-11-28T16:58:10.394684+0000","last_unstale":"2023-11-28T16:58:11.852052+0000","last_undegraded":"2023-11-28T16:58:11.852052+0000","last_fullsized":"2023-11-28T16:58:11.852052+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:06.026494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366266+0000","last_change":"2023-11-28T16:58:09.376563+0000","last_active":"2023-11-28T16:58:10.366266+0000","last_peered":"2023-11-28T16:58:10.366266+0000","last_clean":"2023-11-28T16:58:10.366266+0000","last_became_active":"2023-11-28T16:58:09.376234+0000","last_became_peered":"2023-11-28T16:58:09.376234+0000","last_unstale":"2023-11-28T16:58:10.366266+0000","last_undegraded":"2023-11-28T16:58:10.366266+0000","last_fullsized":"2023-11-28T16:58:10.366266+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:26.069648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367089+0000","last_change":"2023-11-28T16:57:57.294132+0000","last_active":"2023-11-28T16:58:10.367089+0000","last_peered":"2023-11-28T16:58:10.367089+0000","last_clean":"2023-11-28T16:58:10.367089+0000","last_became_active":"2023-11-28T16:57:57.293808+0000","last_became_peered":"2023-11-28T16:57:57.293808+0000","last_unstale":"2023-11-28T16:58:10.367089+0000","last_undegraded":"2023-11-28T16:58:10.367089+0000","last_fullsized":"2023-11-28T16:58:10.367089+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.371167+0000","last_change":"2023-11-28T16:57:56.299832+0000","last_active":"2023-11-28T16:58:10.371167+0000","last_peered":"2023-11-28T16:58:10.371167+0000","last_clean":"2023-11-28T16:58:10.371167+0000","last_became_active":"2023-11-28T16:57:56.299505+0000","last_became_peered":"2023-11-28T16:57:56.299505+0000","last_unstale":"2023-11-28T16:58:10.371167+0000","last_undegraded":"2023-11-28T16:58:10.371167+0000","last_fullsized":"2023-11-28T16:58:10.371167+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:26.104747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851977+0000","last_change":"2023-11-28T16:58:10.387360+0000","last_active":"2023-11-28T16:58:11.851977+0000","last_peered":"2023-11-28T16:58:11.851977+0000","last_clean":"2023-11-28T16:58:11.851977+0000","last_became_active":"2023-11-28T16:58:10.386921+0000","last_became_peered":"2023-11-28T16:58:10.386921+0000","last_unstale":"2023-11-28T16:58:11.851977+0000","last_undegraded":"2023-11-28T16:58:11.851977+0000","last_fullsized":"2023-11-28T16:58:11.851977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:03.353470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.378592+0000","last_change":"2023-11-28T16:58:09.370643+0000","last_active":"2023-11-28T16:58:10.378592+0000","last_peered":"2023-11-28T16:58:10.378592+0000","last_clean":"2023-11-28T16:58:10.378592+0000","last_became_active":"2023-11-28T16:58:09.370427+0000","last_became_peered":"2023-11-28T16:58:09.370427+0000","last_unstale":"2023-11-28T16:58:10.378592+0000","last_undegraded":"2023-11-28T16:58:10.378592+0000","last_fullsized":"2023-11-28T16:58:10.378592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:51.248985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366913+0000","last_change":"2023-11-28T16:57:57.294705+0000","last_active":"2023-11-28T16:58:10.366913+0000","last_peered":"2023-11-28T16:58:10.366913+0000","last_clean":"2023-11-28T16:58:10.366913+0000","last_became_active":"2023-11-28T16:57:57.294386+0000","last_became_peered":"2023-11-28T16:57:57.294386+0000","last_unstale":"2023-11-28T16:58:10.366913+0000","last_undegraded":"2023-11-28T16:58:10.366913+0000","last_fullsized":"2023-11-28T16:58:10.366913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380390+0000","last_change":"2023-11-28T16:57:56.303059+0000","last_active":"2023-11-28T16:58:10.380390+0000","last_peered":"2023-11-28T16:58:10.380390+0000","last_clean":"2023-11-28T16:58:10.380390+0000","last_became_active":"2023-11-28T16:57:56.302716+0000","last_became_peered":"2023-11-28T16:57:56.302716+0000","last_unstale":"2023-11-28T16:58:10.380390+0000","last_undegraded":"2023-11-28T16:58:10.380390+0000","last_fullsized":"2023-11-28T16:58:10.380390+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382717+0000","last_change":"2023-11-28T16:58:10.388757+0000","last_active":"2023-11-28T16:58:11.382717+0000","last_peered":"2023-11-28T16:58:11.382717+0000","last_clean":"2023-11-28T16:58:11.382717+0000","last_became_active":"2023-11-28T16:58:10.388431+0000","last_became_peered":"2023-11-28T16:58:10.388431+0000","last_unstale":"2023-11-28T16:58:11.382717+0000","last_undegraded":"2023-11-28T16:58:11.382717+0000","last_fullsized":"2023-11-28T16:58:11.382717+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:44.597699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382821+0000","last_change":"2023-11-28T16:58:09.379068+0000","last_active":"2023-11-28T16:58:10.382821+0000","last_peered":"2023-11-28T16:58:10.382821+0000","last_clean":"2023-11-28T16:58:10.382821+0000","last_became_active":"2023-11-28T16:58:09.378744+0000","last_became_peered":"2023-11-28T16:58:09.378744+0000","last_unstale":"2023-11-28T16:58:10.382821+0000","last_undegraded":"2023-11-28T16:58:10.382821+0000","last_fullsized":"2023-11-28T16:58:10.382821+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:49.565754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381570+0000","last_change":"2023-11-28T16:57:57.310134+0000","last_active":"2023-11-28T16:58:10.381570+0000","last_peered":"2023-11-28T16:58:10.381570+0000","last_clean":"2023-11-28T16:58:10.381570+0000","last_became_active":"2023-11-28T16:57:57.309858+0000","last_became_peered":"2023-11-28T16:57:57.309858+0000","last_unstale":"2023-11-28T16:58:10.381570+0000","last_undegraded":"2023-11-28T16:58:10.381570+0000","last_fullsized":"2023-11-28T16:58:10.381570+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:43.751157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376341+0000","last_change":"2023-11-28T16:57:56.289398+0000","last_active":"2023-11-28T16:58:10.376341+0000","last_peered":"2023-11-28T16:58:10.376341+0000","last_clean":"2023-11-28T16:58:10.376341+0000","last_became_active":"2023-11-28T16:57:56.289082+0000","last_became_peered":"2023-11-28T16:57:56.289082+0000","last_unstale":"2023-11-28T16:58:10.376341+0000","last_undegraded":"2023-11-28T16:58:10.376341+0000","last_fullsized":"2023-11-28T16:58:10.376341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:34.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382710+0000","last_change":"2023-11-28T16:58:10.402989+0000","last_active":"2023-11-28T16:58:11.382710+0000","last_peered":"2023-11-28T16:58:11.382710+0000","last_clean":"2023-11-28T16:58:11.382710+0000","last_became_active":"2023-11-28T16:58:10.402710+0000","last_became_peered":"2023-11-28T16:58:10.402710+0000","last_unstale":"2023-11-28T16:58:11.382710+0000","last_undegraded":"2023-11-28T16:58:11.382710+0000","last_fullsized":"2023-11-28T16:58:11.382710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:50.432475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367540+0000","last_change":"2023-11-28T16:58:09.358558+0000","last_active":"2023-11-28T16:58:10.367540+0000","last_peered":"2023-11-28T16:58:10.367540+0000","last_clean":"2023-11-28T16:58:10.367540+0000","last_became_active":"2023-11-28T16:58:09.358275+0000","last_became_peered":"2023-11-28T16:58:09.358275+0000","last_unstale":"2023-11-28T16:58:10.367540+0000","last_undegraded":"2023-11-28T16:58:10.367540+0000","last_fullsized":"2023-11-28T16:58:10.367540+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:12.668536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381356+0000","last_change":"2023-11-28T16:57:57.302840+0000","last_active":"2023-11-28T16:58:10.381356+0000","last_peered":"2023-11-28T16:58:10.381356+0000","last_clean":"2023-11-28T16:58:10.381356+0000","last_became_active":"2023-11-28T16:57:57.302446+0000","last_became_peered":"2023-11-28T16:57:57.302446+0000","last_unstale":"2023-11-28T16:58:10.381356+0000","last_undegraded":"2023-11-28T16:58:10.381356+0000","last_fullsized":"2023-11-28T16:58:10.381356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:06.791283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.369176+0000","last_change":"2023-11-28T16:57:56.295304+0000","last_active":"2023-11-28T16:58:10.369176+0000","last_peered":"2023-11-28T16:58:10.369176+0000","last_clean":"2023-11-28T16:58:10.369176+0000","last_became_active":"2023-11-28T16:57:56.295041+0000","last_became_peered":"2023-11-28T16:57:56.295041+0000","last_unstale":"2023-11-28T16:58:10.369176+0000","last_undegraded":"2023-11-28T16:58:10.369176+0000","last_fullsized":"2023-11-28T16:58:10.369176+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.381153+0000","last_change":"2023-11-28T16:58:10.386165+0000","last_active":"2023-11-28T16:58:11.381153+0000","last_peered":"2023-11-28T16:58:11.381153+0000","last_clean":"2023-11-28T16:58:11.381153+0000","last_became_active":"2023-11-28T16:58:10.385435+0000","last_became_peered":"2023-11-28T16:58:10.385435+0000","last_unstale":"2023-11-28T16:58:11.381153+0000","last_undegraded":"2023-11-28T16:58:11.381153+0000","last_fullsized":"2023-11-28T16:58:11.381153+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:45.492789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.400784+0000","last_change":"2023-11-28T16:58:09.378133+0000","last_active":"2023-11-28T16:58:10.400784+0000","last_peered":"2023-11-28T16:58:10.400784+0000","last_clean":"2023-11-28T16:58:10.400784+0000","last_became_active":"2023-11-28T16:58:09.377825+0000","last_became_peered":"2023-11-28T16:58:09.377825+0000","last_unstale":"2023-11-28T16:58:10.400784+0000","last_undegraded":"2023-11-28T16:58:10.400784+0000","last_fullsized":"2023-11-28T16:58:10.400784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:21.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376141+0000","last_change":"2023-11-28T16:57:57.285348+0000","last_active":"2023-11-28T16:58:10.376141+0000","last_peered":"2023-11-28T16:58:10.376141+0000","last_clean":"2023-11-28T16:58:10.376141+0000","last_became_active":"2023-11-28T16:57:57.285004+0000","last_became_peered":"2023-11-28T16:57:57.285004+0000","last_unstale":"2023-11-28T16:58:10.376141+0000","last_undegraded":"2023-11-28T16:58:10.376141+0000","last_fullsized":"2023-11-28T16:58:10.376141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:56.757486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.385275+0000","last_change":"2023-11-28T16:57:56.291833+0000","last_active":"2023-11-28T16:58:10.385275+0000","last_peered":"2023-11-28T16:58:10.385275+0000","last_clean":"2023-11-28T16:58:10.385275+0000","last_became_active":"2023-11-28T16:57:56.291493+0000","last_became_peered":"2023-11-28T16:57:56.291493+0000","last_unstale":"2023-11-28T16:58:10.385275+0000","last_undegraded":"2023-11-28T16:58:10.385275+0000","last_fullsized":"2023-11-28T16:58:10.385275+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:36.485569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384770+0000","last_change":"2023-11-28T16:58:10.396359+0000","last_active":"2023-11-28T16:58:11.384770+0000","last_peered":"2023-11-28T16:58:11.384770+0000","last_clean":"2023-11-28T16:58:11.384770+0000","last_became_active":"2023-11-28T16:58:10.396042+0000","last_became_peered":"2023-11-28T16:58:10.396042+0000","last_unstale":"2023-11-28T16:58:11.384770+0000","last_undegraded":"2023-11-28T16:58:11.384770+0000","last_fullsized":"2023-11-28T16:58:11.384770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:34.593915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381431+0000","last_change":"2023-11-28T16:58:09.366789+0000","last_active":"2023-11-28T16:58:10.381431+0000","last_peered":"2023-11-28T16:58:10.381431+0000","last_clean":"2023-11-28T16:58:10.381431+0000","last_became_active":"2023-11-28T16:58:09.366058+0000","last_became_peered":"2023-11-28T16:58:09.366058+0000","last_unstale":"2023-11-28T16:58:10.381431+0000","last_undegraded":"2023-11-28T16:58:10.381431+0000","last_fullsized":"2023-11-28T16:58:10.381431+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:46.294429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368132+0000","last_change":"2023-11-28T16:57:57.294725+0000","last_active":"2023-11-28T16:58:10.368132+0000","last_peered":"2023-11-28T16:58:10.368132+0000","last_clean":"2023-11-28T16:58:10.368132+0000","last_became_active":"2023-11-28T16:57:57.294368+0000","last_became_peered":"2023-11-28T16:57:57.294368+0000","last_unstale":"2023-11-28T16:58:10.368132+0000","last_undegraded":"2023-11-28T16:58:10.368132+0000","last_fullsized":"2023-11-28T16:58:10.368132+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381307+0000","last_change":"2023-11-28T16:57:56.295240+0000","last_active":"2023-11-28T16:58:10.381307+0000","last_peered":"2023-11-28T16:58:10.381307+0000","last_clean":"2023-11-28T16:58:10.381307+0000","last_became_active":"2023-11-28T16:57:56.292758+0000","last_became_peered":"2023-11-28T16:57:56.292758+0000","last_unstale":"2023-11-28T16:58:10.381307+0000","last_undegraded":"2023-11-28T16:58:10.381307+0000","last_fullsized":"2023-11-28T16:58:10.381307+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852489+0000","last_change":"2023-11-28T16:58:10.389308+0000","last_active":"2023-11-28T16:58:11.852489+0000","last_peered":"2023-11-28T16:58:11.852489+0000","last_clean":"2023-11-28T16:58:11.852489+0000","last_became_active":"2023-11-28T16:58:10.389085+0000","last_became_peered":"2023-11-28T16:58:10.389085+0000","last_unstale":"2023-11-28T16:58:11.852489+0000","last_undegraded":"2023-11-28T16:58:11.852489+0000","last_fullsized":"2023-11-28T16:58:11.852489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:11.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367001+0000","last_change":"2023-11-28T16:58:09.356981+0000","last_active":"2023-11-28T16:58:10.367001+0000","last_peered":"2023-11-28T16:58:10.367001+0000","last_clean":"2023-11-28T16:58:10.367001+0000","last_became_active":"2023-11-28T16:58:09.356658+0000","last_became_peered":"2023-11-28T16:58:09.356658+0000","last_unstale":"2023-11-28T16:58:10.367001+0000","last_undegraded":"2023-11-28T16:58:10.367001+0000","last_fullsized":"2023-11-28T16:58:10.367001+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:21.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377841+0000","last_change":"2023-11-28T16:57:57.306973+0000","last_active":"2023-11-28T16:58:10.377841+0000","last_peered":"2023-11-28T16:58:10.377841+0000","last_clean":"2023-11-28T16:58:10.377841+0000","last_became_active":"2023-11-28T16:57:57.304696+0000","last_became_peered":"2023-11-28T16:57:57.304696+0000","last_unstale":"2023-11-28T16:58:10.377841+0000","last_undegraded":"2023-11-28T16:58:10.377841+0000","last_fullsized":"2023-11-28T16:58:10.377841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.596110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374663+0000","last_change":"2023-11-28T16:57:56.293462+0000","last_active":"2023-11-28T16:58:10.374663+0000","last_peered":"2023-11-28T16:58:10.374663+0000","last_clean":"2023-11-28T16:58:10.374663+0000","last_became_active":"2023-11-28T16:57:56.293039+0000","last_became_peered":"2023-11-28T16:57:56.293039+0000","last_unstale":"2023-11-28T16:58:10.374663+0000","last_undegraded":"2023-11-28T16:58:10.374663+0000","last_fullsized":"2023-11-28T16:58:10.374663+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:40.083816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853550+0000","last_change":"2023-11-28T16:58:10.394259+0000","last_active":"2023-11-28T16:58:11.853550+0000","last_peered":"2023-11-28T16:58:11.853550+0000","last_clean":"2023-11-28T16:58:11.853550+0000","last_became_active":"2023-11-28T16:58:10.393928+0000","last_became_peered":"2023-11-28T16:58:10.393928+0000","last_unstale":"2023-11-28T16:58:11.853550+0000","last_undegraded":"2023-11-28T16:58:11.853550+0000","last_fullsized":"2023-11-28T16:58:11.853550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:48.143908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375977+0000","last_change":"2023-11-28T16:58:09.375351+0000","last_active":"2023-11-28T16:58:10.375977+0000","last_peered":"2023-11-28T16:58:10.375977+0000","last_clean":"2023-11-28T16:58:10.375977+0000","last_became_active":"2023-11-28T16:58:09.375020+0000","last_became_peered":"2023-11-28T16:58:09.375020+0000","last_unstale":"2023-11-28T16:58:10.375977+0000","last_undegraded":"2023-11-28T16:58:10.375977+0000","last_fullsized":"2023-11-28T16:58:10.375977+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:18.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360812+0000","last_change":"2023-11-28T16:57:57.307851+0000","last_active":"2023-11-28T16:58:10.360812+0000","last_peered":"2023-11-28T16:58:10.360812+0000","last_clean":"2023-11-28T16:58:10.360812+0000","last_became_active":"2023-11-28T16:57:57.307208+0000","last_became_peered":"2023-11-28T16:57:57.307208+0000","last_unstale":"2023-11-28T16:58:10.360812+0000","last_undegraded":"2023-11-28T16:58:10.360812+0000","last_fullsized":"2023-11-28T16:58:10.360812+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366917+0000","last_change":"2023-11-28T16:57:56.286826+0000","last_active":"2023-11-28T16:58:10.366917+0000","last_peered":"2023-11-28T16:58:10.366917+0000","last_clean":"2023-11-28T16:58:10.366917+0000","last_became_active":"2023-11-28T16:57:56.286506+0000","last_became_peered":"2023-11-28T16:57:56.286506+0000","last_unstale":"2023-11-28T16:58:10.366917+0000","last_undegraded":"2023-11-28T16:58:10.366917+0000","last_fullsized":"2023-11-28T16:58:10.366917+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:28.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853505+0000","last_change":"2023-11-28T16:58:10.394202+0000","last_active":"2023-11-28T16:58:11.853505+0000","last_peered":"2023-11-28T16:58:11.853505+0000","last_clean":"2023-11-28T16:58:11.853505+0000","last_became_active":"2023-11-28T16:58:10.393945+0000","last_became_peered":"2023-11-28T16:58:10.393945+0000","last_unstale":"2023-11-28T16:58:11.853505+0000","last_undegraded":"2023-11-28T16:58:11.853505+0000","last_fullsized":"2023-11-28T16:58:11.853505+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:31.829663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382648+0000","last_change":"2023-11-28T16:58:09.376587+0000","last_active":"2023-11-28T16:58:10.382648+0000","last_peered":"2023-11-28T16:58:10.382648+0000","last_clean":"2023-11-28T16:58:10.382648+0000","last_became_active":"2023-11-28T16:58:09.376044+0000","last_became_peered":"2023-11-28T16:58:09.376044+0000","last_unstale":"2023-11-28T16:58:10.382648+0000","last_undegraded":"2023-11-28T16:58:10.382648+0000","last_fullsized":"2023-11-28T16:58:10.382648+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:39.184932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.363991+0000","last_change":"2023-11-28T16:57:57.293525+0000","last_active":"2023-11-28T16:58:10.363991+0000","last_peered":"2023-11-28T16:58:10.363991+0000","last_clean":"2023-11-28T16:58:10.363991+0000","last_became_active":"2023-11-28T16:57:57.293155+0000","last_became_peered":"2023-11-28T16:57:57.293155+0000","last_unstale":"2023-11-28T16:58:10.363991+0000","last_undegraded":"2023-11-28T16:58:10.363991+0000","last_fullsized":"2023-11-28T16:58:10.363991+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:54.496874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.370486+0000","last_change":"2023-11-28T16:57:56.289797+0000","last_active":"2023-11-28T16:58:10.370486+0000","last_peered":"2023-11-28T16:58:10.370486+0000","last_clean":"2023-11-28T16:58:10.370486+0000","last_became_active":"2023-11-28T16:57:56.286507+0000","last_became_peered":"2023-11-28T16:57:56.286507+0000","last_unstale":"2023-11-28T16:58:10.370486+0000","last_undegraded":"2023-11-28T16:58:10.370486+0000","last_fullsized":"2023-11-28T16:58:10.370486+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:55.952116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854351+0000","last_change":"2023-11-28T16:58:10.392372+0000","last_active":"2023-11-28T16:58:11.854351+0000","last_peered":"2023-11-28T16:58:11.854351+0000","last_clean":"2023-11-28T16:58:11.854351+0000","last_became_active":"2023-11-28T16:58:10.392077+0000","last_became_peered":"2023-11-28T16:58:10.392077+0000","last_unstale":"2023-11-28T16:58:11.854351+0000","last_undegraded":"2023-11-28T16:58:11.854351+0000","last_fullsized":"2023-11-28T16:58:11.854351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:50.217884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.370726+0000","last_change":"2023-11-28T16:58:09.366936+0000","last_active":"2023-11-28T16:58:10.370726+0000","last_peered":"2023-11-28T16:58:10.370726+0000","last_clean":"2023-11-28T16:58:10.370726+0000","last_became_active":"2023-11-28T16:58:09.366532+0000","last_became_peered":"2023-11-28T16:58:09.366532+0000","last_unstale":"2023-11-28T16:58:10.370726+0000","last_undegraded":"2023-11-28T16:58:10.370726+0000","last_fullsized":"2023-11-28T16:58:10.370726+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:34.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377051+0000","last_change":"2023-11-28T16:57:57.295933+0000","last_active":"2023-11-28T16:58:10.377051+0000","last_peered":"2023-11-28T16:58:10.377051+0000","last_clean":"2023-11-28T16:58:10.377051+0000","last_became_active":"2023-11-28T16:57:57.295567+0000","last_became_peered":"2023-11-28T16:57:57.295567+0000","last_unstale":"2023-11-28T16:58:10.377051+0000","last_undegraded":"2023-11-28T16:58:10.377051+0000","last_fullsized":"2023-11-28T16:58:10.377051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:13.997222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.364189+0000","last_change":"2023-11-28T16:57:56.296292+0000","last_active":"2023-11-28T16:58:10.364189+0000","last_peered":"2023-11-28T16:58:10.364189+0000","last_clean":"2023-11-28T16:58:10.364189+0000","last_became_active":"2023-11-28T16:57:56.295958+0000","last_became_peered":"2023-11-28T16:57:56.295958+0000","last_unstale":"2023-11-28T16:58:10.364189+0000","last_undegraded":"2023-11-28T16:58:10.364189+0000","last_fullsized":"2023-11-28T16:58:10.364189+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.008383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852404+0000","last_change":"2023-11-28T16:58:10.399888+0000","last_active":"2023-11-28T16:58:11.852404+0000","last_peered":"2023-11-28T16:58:11.852404+0000","last_clean":"2023-11-28T16:58:11.852404+0000","last_became_active":"2023-11-28T16:58:10.399310+0000","last_became_peered":"2023-11-28T16:58:10.399310+0000","last_unstale":"2023-11-28T16:58:11.852404+0000","last_undegraded":"2023-11-28T16:58:11.852404+0000","last_fullsized":"2023-11-28T16:58:11.852404+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:30:57.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.394499+0000","last_change":"2023-11-28T16:58:09.373511+0000","last_active":"2023-11-28T16:58:10.394499+0000","last_peered":"2023-11-28T16:58:10.394499+0000","last_clean":"2023-11-28T16:58:10.394499+0000","last_became_active":"2023-11-28T16:58:09.373187+0000","last_became_peered":"2023-11-28T16:58:09.373187+0000","last_unstale":"2023-11-28T16:58:10.394499+0000","last_undegraded":"2023-11-28T16:58:10.394499+0000","last_fullsized":"2023-11-28T16:58:10.394499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:55.823583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.364085+0000","last_change":"2023-11-28T16:57:57.308508+0000","last_active":"2023-11-28T16:58:10.364085+0000","last_peered":"2023-11-28T16:58:10.364085+0000","last_clean":"2023-11-28T16:58:10.364085+0000","last_became_active":"2023-11-28T16:57:57.308197+0000","last_became_peered":"2023-11-28T16:57:57.308197+0000","last_unstale":"2023-11-28T16:58:10.364085+0000","last_undegraded":"2023-11-28T16:58:10.364085+0000","last_fullsized":"2023-11-28T16:58:10.364085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:41.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376199+0000","last_change":"2023-11-28T16:57:56.296886+0000","last_active":"2023-11-28T16:58:10.376199+0000","last_peered":"2023-11-28T16:58:10.376199+0000","last_clean":"2023-11-28T16:58:10.376199+0000","last_became_active":"2023-11-28T16:57:56.296594+0000","last_became_peered":"2023-11-28T16:57:56.296594+0000","last_unstale":"2023-11-28T16:58:10.376199+0000","last_undegraded":"2023-11-28T16:58:10.376199+0000","last_fullsized":"2023-11-28T16:58:10.376199+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:40.306391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360961+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:10.360961+0000","last_peered":"2023-11-28T16:58:10.360961+0000","last_clean":"2023-11-28T16:58:10.360961+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:10.360961+0000","last_undegraded":"2023-11-28T16:58:10.360961+0000","last_fullsized":"2023-11-28T16:58:10.360961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1257472,"data_stored":871568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.93600000000000005}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.82099999999999995}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":1.1639999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.88}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.995}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.95099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":280516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.82299999999999995,"5min":1.474,"15min":1.474},"last":0.623},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.748}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.72799999999999998,"15min":0.753},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.70099999999999996}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.80600000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92300000000000004,"5min":1.071,"15min":1.071},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.59599999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.52900000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.341,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4019999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":281166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.52100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.628}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89200000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82599999999999996}]},{"osd":4,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72299999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77200000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96199999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":283601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.234,"15min":1.234},"last":0.73799999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.871,"5min":1.964,"15min":1.964},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.704,"15min":1.704},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88400000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.254,"15min":1.254},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88,"5min":1.548,"15min":1.548},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90800000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.218,"15min":1.218},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.593,"15min":1.593},"last":0.77500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":280592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.56100000000000005,"5min":0.745,"15min":0.745},"last":0.34699999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.874,"15min":0.874},"last":0.374},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.089,"5min":1.21,"15min":1.21},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91900000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0049999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0309999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.022,"5min":1.25,"15min":1.25},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.423,"15min":1.423},"last":0.64400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":282092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35699999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71499999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.65800000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78000000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.80200000000000005}]},{"osd":6,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92500000000000004,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":671744,"data_stored":282742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52700000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.56000000000000005,"5min":0.746,"15min":0.746},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.55600000000000005,"5min":1.04,"15min":1.04},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.625,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.98699999999999999,"5min":1.446,"15min":1.446},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.034,"5min":1.47,"15min":1.47},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1180000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0820000000000001,"5min":1.327,"15min":1.327},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94599999999999995,"5min":1.3,"15min":1.3},"last":0.626},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.167,"5min":1.526,"15min":1.526},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1459999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":874481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.44},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.56499999999999995}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.54700000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.627},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:58:17.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:58:17.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:58:19.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:58:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.245+0000 7fa6144d6640 1 Processor -- start 2023-11-28T16:58:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.245+0000 7fa6144d6640 1 -- start start 2023-11-28T16:58:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa6144d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa60c070b80 0x7fa60c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa6144d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c06d320 con 0x7fa60c0a8470 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa6144d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0721b0 con 0x7fa60c14e9d0 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa6144d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0c2830 con 0x7fa60c070b80 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa611a71640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa60c070b80 0x7fa60c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa611a71640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa60c070b80 0x7fa60c151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37162/0 (socket says 172.21.15.26:37162) 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa611a71640 1 -- 172.21.15.26:0/226522579 learned_addr learned my addr 172.21.15.26:0/226522579 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa612a73640 1 --1- 172.21.15.26:0/226522579 >> v1:172.21.15.26:6789/0 conn(0x7fa60c0a8470 0x7fa60c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49216/0 (socket says 172.21.15.26:49216) 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa611a71640 1 -- 172.21.15.26:0/226522579 >> v1:172.21.15.79:6789/0 conn(0x7fa60c14e9d0 legacy=0x7fa60c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa611a71640 1 -- 172.21.15.26:0/226522579 >> v1:172.21.15.26:6789/0 conn(0x7fa60c0a8470 legacy=0x7fa60c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa611a71640 1 -- 172.21.15.26:0/226522579 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c072450 con 0x7fa60c070b80 2023-11-28T16:58:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.249+0000 7fa611270640 1 -- 172.21.15.26:0/226522579 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932505419 0 0) 0x7fa60c06d320 con 0x7fa60c0a8470 2023-11-28T16:58:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa611a71640 1 --2- 172.21.15.26:0/226522579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c070b80 0x7fa60c151e60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009870 tx=0x7fa5fc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500fae47aab84fe3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa611270640 1 -- 172.21.15.26:0/226522579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0ad680 con 0x7fa60c070b80 2023-11-28T16:58:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa611270640 1 -- 172.21.15.26:0/226522579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc0ad7e0 con 0x7fa60c070b80 2023-11-28T16:58:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa611270640 1 -- 172.21.15.26:0/226522579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0adb70 con 0x7fa60c070b80 2023-11-28T16:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 -- 172.21.15.26:0/226522579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c070b80 msgr2=0x7fa60c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 --2- 172.21.15.26:0/226522579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c070b80 0x7fa60c151e60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009870 tx=0x7fa5fc01c470 comp rx=0 tx=0).stop 2023-11-28T16:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 -- 172.21.15.26:0/226522579 shutdown_connections 2023-11-28T16:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 --2- 172.21.15.26:0/226522579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c070b80 0x7fa60c151e60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 -- 172.21.15.26:0/226522579 >> 172.21.15.26:0/226522579 conn(0x7fa60c0c2ad0 msgr2=0x7fa60c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 -- 172.21.15.26:0/226522579 shutdown_connections 2023-11-28T16:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 -- 172.21.15.26:0/226522579 wait complete. 2023-11-28T16:58:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 Processor -- start 2023-11-28T16:58:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.253+0000 7fa6144d6640 1 -- start start 2023-11-28T16:58:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c070b80 0x7fa60c1417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c0a8470 0x7fa60c0bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa60c14e9d0 0x7fa60c1ecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c141d00 con 0x7fa60c0a8470 2023-11-28T16:58:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c14bb90 con 0x7fa60c070b80 2023-11-28T16:58:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c1401a0 con 0x7fa60c14e9d0 2023-11-28T16:58:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c0a8470 0x7fa60c0bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c0a8470 0x7fa60c0bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37172/0 (socket says 172.21.15.26:37172) 2023-11-28T16:58:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 -- 172.21.15.26:0/1147055953 learned_addr learned my addr 172.21.15.26:0/1147055953 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 -- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa60c14e9d0 msgr2=0x7fa60c1ecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa612272640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c070b80 0x7fa60c1417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa60c14e9d0 0x7fa60c1ecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 -- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c070b80 msgr2=0x7fa60c1417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c070b80 0x7fa60c1417c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 -- 172.21.15.26:0/1147055953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0094d0 con 0x7fa60c0a8470 2023-11-28T16:58:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa611a71640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c0a8470 0x7fa60c0bf660 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc019080 tx=0x7fa5fc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa602ffd640 1 -- 172.21.15.26:0/1147055953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0adea0 con 0x7fa60c0a8470 2023-11-28T16:58:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa602ffd640 1 -- 172.21.15.26:0/1147055953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc004020 con 0x7fa60c0a8470 2023-11-28T16:58:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c150bc0 con 0x7fa60c0a8470 2023-11-28T16:58:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa602ffd640 1 -- 172.21.15.26:0/1147055953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc004390 con 0x7fa60c0a8470 2023-11-28T16:58:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c1432e0 con 0x7fa60c0a8470 2023-11-28T16:58:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c04e890 con 0x7fa60c0a8470 2023-11-28T16:58:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.257+0000 7fa602ffd640 1 -- 172.21.15.26:0/1147055953 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa5fc003620 con 0x7fa60c0a8470 2023-11-28T16:58:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.261+0000 7fa602ffd640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5f00668d0 0x7fa5f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.261+0000 7fa602ffd640 1 -- 172.21.15.26:0/1147055953 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5fc11ec70 con 0x7fa60c0a8470 2023-11-28T16:58:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.261+0000 7fa612272640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5f00668d0 0x7fa5f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.261+0000 7fa612272640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5f00668d0 0x7fa5f0068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa60800a750 tx=0x7fa608008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.265+0000 7fa602ffd640 1 -- 172.21.15.26:0/1147055953 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5fc0ebc60 con 0x7fa60c0a8470 2023-11-28T16:58:19.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.417+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa60c06dec0 con 0x7fa5f00668d0 2023-11-28T16:58:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.433+0000 7fa602ffd640 1 -- 172.21.15.26:0/1147055953 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527406 (secure 0 0 0) 0x7fa60800a380 con 0x7fa5f00668d0 2023-11-28T16:58:19.442 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:58:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5f00668d0 msgr2=0x7fa5f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5f00668d0 0x7fa5f0068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa60800a750 tx=0x7fa608008040 comp rx=0 tx=0).stop 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c0a8470 msgr2=0x7fa60c0bf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c0a8470 0x7fa60c0bf660 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc019080 tx=0x7fa5fc019210 comp rx=0 tx=0).stop 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 shutdown_connections 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5f00668d0 0x7fa5f0068d90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa60c14e9d0 0x7fa60c1ecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa60c0a8470 0x7fa60c0bf660 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 --2- 172.21.15.26:0/1147055953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c070b80 0x7fa60c1417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 >> 172.21.15.26:0/1147055953 conn(0x7fa60c0c2ad0 msgr2=0x7fa60c148390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 shutdown_connections 2023-11-28T16:58:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.437+0000 7fa6144d6640 1 -- 172.21.15.26:0/1147055953 wait complete. 2023-11-28T16:58:19.459 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-11-28T16:58:17.602822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239184,"kb_used_data":6344,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735536,"statfs":{"total":773094113280,"available":772849188864,"internally_reserved":0,"allocated":6496256,"data_stored":3436758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3651,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002131"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852228+0000","last_change":"2023-11-28T16:58:10.389129+0000","last_active":"2023-11-28T16:58:11.852228+0000","last_peered":"2023-11-28T16:58:11.852228+0000","last_clean":"2023-11-28T16:58:11.852228+0000","last_became_active":"2023-11-28T16:58:10.388693+0000","last_became_peered":"2023-11-28T16:58:10.388693+0000","last_unstale":"2023-11-28T16:58:11.852228+0000","last_undegraded":"2023-11-28T16:58:11.852228+0000","last_fullsized":"2023-11-28T16:58:11.852228+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:41.315954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382257+0000","last_change":"2023-11-28T16:57:57.311201+0000","last_active":"2023-11-28T16:58:10.382257+0000","last_peered":"2023-11-28T16:58:10.382257+0000","last_clean":"2023-11-28T16:58:10.382257+0000","last_became_active":"2023-11-28T16:57:57.310858+0000","last_became_peered":"2023-11-28T16:57:57.310858+0000","last_unstale":"2023-11-28T16:58:10.382257+0000","last_undegraded":"2023-11-28T16:58:10.382257+0000","last_fullsized":"2023-11-28T16:58:10.382257+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:38.198969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853232+0000","last_change":"2023-11-28T16:58:10.396508+0000","last_active":"2023-11-28T16:58:11.853232+0000","last_peered":"2023-11-28T16:58:11.853232+0000","last_clean":"2023-11-28T16:58:11.853232+0000","last_became_active":"2023-11-28T16:58:10.396153+0000","last_became_peered":"2023-11-28T16:58:10.396153+0000","last_unstale":"2023-11-28T16:58:11.853232+0000","last_undegraded":"2023-11-28T16:58:11.853232+0000","last_fullsized":"2023-11-28T16:58:11.853232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:52.255310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375399+0000","last_change":"2023-11-28T16:57:57.307903+0000","last_active":"2023-11-28T16:58:10.375399+0000","last_peered":"2023-11-28T16:58:10.375399+0000","last_clean":"2023-11-28T16:58:10.375399+0000","last_became_active":"2023-11-28T16:57:57.305651+0000","last_became_peered":"2023-11-28T16:57:57.305651+0000","last_unstale":"2023-11-28T16:58:10.375399+0000","last_undegraded":"2023-11-28T16:58:10.375399+0000","last_fullsized":"2023-11-28T16:58:10.375399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:58.350824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382473+0000","last_change":"2023-11-28T16:58:10.387612+0000","last_active":"2023-11-28T16:58:11.382473+0000","last_peered":"2023-11-28T16:58:11.382473+0000","last_clean":"2023-11-28T16:58:11.382473+0000","last_became_active":"2023-11-28T16:58:10.387322+0000","last_became_peered":"2023-11-28T16:58:10.387322+0000","last_unstale":"2023-11-28T16:58:11.382473+0000","last_undegraded":"2023-11-28T16:58:11.382473+0000","last_fullsized":"2023-11-28T16:58:11.382473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:21.777471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361940+0000","last_change":"2023-11-28T16:57:57.295922+0000","last_active":"2023-11-28T16:58:10.361940+0000","last_peered":"2023-11-28T16:58:10.361940+0000","last_clean":"2023-11-28T16:58:10.361940+0000","last_became_active":"2023-11-28T16:57:57.295614+0000","last_became_peered":"2023-11-28T16:57:57.295614+0000","last_unstale":"2023-11-28T16:58:10.361940+0000","last_undegraded":"2023-11-28T16:58:10.361940+0000","last_fullsized":"2023-11-28T16:58:10.361940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854703+0000","last_change":"2023-11-28T16:58:10.390874+0000","last_active":"2023-11-28T16:58:11.854703+0000","last_peered":"2023-11-28T16:58:11.854703+0000","last_clean":"2023-11-28T16:58:11.854703+0000","last_became_active":"2023-11-28T16:58:10.390644+0000","last_became_peered":"2023-11-28T16:58:10.390644+0000","last_unstale":"2023-11-28T16:58:11.854703+0000","last_undegraded":"2023-11-28T16:58:11.854703+0000","last_fullsized":"2023-11-28T16:58:11.854703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:30.767044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381083+0000","last_change":"2023-11-28T16:57:57.307103+0000","last_active":"2023-11-28T16:58:10.381083+0000","last_peered":"2023-11-28T16:58:10.381083+0000","last_clean":"2023-11-28T16:58:10.381083+0000","last_became_active":"2023-11-28T16:57:57.306791+0000","last_became_peered":"2023-11-28T16:57:57.306791+0000","last_unstale":"2023-11-28T16:58:10.381083+0000","last_undegraded":"2023-11-28T16:58:10.381083+0000","last_fullsized":"2023-11-28T16:58:10.381083+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383579+0000","last_change":"2023-11-28T16:58:10.400809+0000","last_active":"2023-11-28T16:58:11.383579+0000","last_peered":"2023-11-28T16:58:11.383579+0000","last_clean":"2023-11-28T16:58:11.383579+0000","last_became_active":"2023-11-28T16:58:10.397941+0000","last_became_peered":"2023-11-28T16:58:10.397941+0000","last_unstale":"2023-11-28T16:58:11.383579+0000","last_undegraded":"2023-11-28T16:58:11.383579+0000","last_fullsized":"2023-11-28T16:58:11.383579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:28.372594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382811+0000","last_change":"2023-11-28T16:57:57.294572+0000","last_active":"2023-11-28T16:58:10.382811+0000","last_peered":"2023-11-28T16:58:10.382811+0000","last_clean":"2023-11-28T16:58:10.382811+0000","last_became_active":"2023-11-28T16:57:57.294253+0000","last_became_peered":"2023-11-28T16:57:57.294253+0000","last_unstale":"2023-11-28T16:58:10.382811+0000","last_undegraded":"2023-11-28T16:58:10.382811+0000","last_fullsized":"2023-11-28T16:58:10.382811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:08.044829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853421+0000","last_change":"2023-11-28T16:58:10.393252+0000","last_active":"2023-11-28T16:58:11.853421+0000","last_peered":"2023-11-28T16:58:11.853421+0000","last_clean":"2023-11-28T16:58:11.853421+0000","last_became_active":"2023-11-28T16:58:10.392917+0000","last_became_peered":"2023-11-28T16:58:10.392917+0000","last_unstale":"2023-11-28T16:58:11.853421+0000","last_undegraded":"2023-11-28T16:58:11.853421+0000","last_fullsized":"2023-11-28T16:58:11.853421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:21.160963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367290+0000","last_change":"2023-11-28T16:57:57.303700+0000","last_active":"2023-11-28T16:58:10.367290+0000","last_peered":"2023-11-28T16:58:10.367290+0000","last_clean":"2023-11-28T16:58:10.367290+0000","last_became_active":"2023-11-28T16:57:57.303377+0000","last_became_peered":"2023-11-28T16:57:57.303377+0000","last_unstale":"2023-11-28T16:58:10.367290+0000","last_undegraded":"2023-11-28T16:58:10.367290+0000","last_fullsized":"2023-11-28T16:58:10.367290+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853627+0000","last_change":"2023-11-28T16:58:10.384901+0000","last_active":"2023-11-28T16:58:11.853627+0000","last_peered":"2023-11-28T16:58:11.853627+0000","last_clean":"2023-11-28T16:58:11.853627+0000","last_became_active":"2023-11-28T16:58:10.384647+0000","last_became_peered":"2023-11-28T16:58:10.384647+0000","last_unstale":"2023-11-28T16:58:11.853627+0000","last_undegraded":"2023-11-28T16:58:11.853627+0000","last_fullsized":"2023-11-28T16:58:11.853627+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:40.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367097+0000","last_change":"2023-11-28T16:57:57.290167+0000","last_active":"2023-11-28T16:58:10.367097+0000","last_peered":"2023-11-28T16:58:10.367097+0000","last_clean":"2023-11-28T16:58:10.367097+0000","last_became_active":"2023-11-28T16:57:57.289873+0000","last_became_peered":"2023-11-28T16:57:57.289873+0000","last_unstale":"2023-11-28T16:58:10.367097+0000","last_undegraded":"2023-11-28T16:58:10.367097+0000","last_fullsized":"2023-11-28T16:58:10.367097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:53.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854761+0000","last_change":"2023-11-28T16:58:10.393488+0000","last_active":"2023-11-28T16:58:11.854761+0000","last_peered":"2023-11-28T16:58:11.854761+0000","last_clean":"2023-11-28T16:58:11.854761+0000","last_became_active":"2023-11-28T16:58:10.393197+0000","last_became_peered":"2023-11-28T16:58:10.393197+0000","last_unstale":"2023-11-28T16:58:11.854761+0000","last_undegraded":"2023-11-28T16:58:11.854761+0000","last_fullsized":"2023-11-28T16:58:11.854761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:59.066815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.363867+0000","last_change":"2023-11-28T16:57:57.294040+0000","last_active":"2023-11-28T16:58:10.363867+0000","last_peered":"2023-11-28T16:58:10.363867+0000","last_clean":"2023-11-28T16:58:10.363867+0000","last_became_active":"2023-11-28T16:57:57.293696+0000","last_became_peered":"2023-11-28T16:57:57.293696+0000","last_unstale":"2023-11-28T16:58:10.363867+0000","last_undegraded":"2023-11-28T16:58:10.363867+0000","last_fullsized":"2023-11-28T16:58:10.363867+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:45.988064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382363+0000","last_change":"2023-11-28T16:58:10.390236+0000","last_active":"2023-11-28T16:58:11.382363+0000","last_peered":"2023-11-28T16:58:11.382363+0000","last_clean":"2023-11-28T16:58:11.382363+0000","last_became_active":"2023-11-28T16:58:10.389846+0000","last_became_peered":"2023-11-28T16:58:10.389846+0000","last_unstale":"2023-11-28T16:58:11.382363+0000","last_undegraded":"2023-11-28T16:58:11.382363+0000","last_fullsized":"2023-11-28T16:58:11.382363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:59.964513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368419+0000","last_change":"2023-11-28T16:57:57.291252+0000","last_active":"2023-11-28T16:58:10.368419+0000","last_peered":"2023-11-28T16:58:10.368419+0000","last_clean":"2023-11-28T16:58:10.368419+0000","last_became_active":"2023-11-28T16:57:57.290870+0000","last_became_peered":"2023-11-28T16:57:57.290870+0000","last_unstale":"2023-11-28T16:58:10.368419+0000","last_undegraded":"2023-11-28T16:58:10.368419+0000","last_fullsized":"2023-11-28T16:58:10.368419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:24.268675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852526+0000","last_change":"2023-11-28T16:58:10.388089+0000","last_active":"2023-11-28T16:58:11.852526+0000","last_peered":"2023-11-28T16:58:11.852526+0000","last_clean":"2023-11-28T16:58:11.852526+0000","last_became_active":"2023-11-28T16:58:10.387799+0000","last_became_peered":"2023-11-28T16:58:10.387799+0000","last_unstale":"2023-11-28T16:58:11.852526+0000","last_undegraded":"2023-11-28T16:58:11.852526+0000","last_fullsized":"2023-11-28T16:58:11.852526+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:38.063737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376272+0000","last_change":"2023-11-28T16:57:57.293326+0000","last_active":"2023-11-28T16:58:10.376272+0000","last_peered":"2023-11-28T16:58:10.376272+0000","last_clean":"2023-11-28T16:58:10.376272+0000","last_became_active":"2023-11-28T16:57:57.292663+0000","last_became_peered":"2023-11-28T16:57:57.292663+0000","last_unstale":"2023-11-28T16:58:10.376272+0000","last_undegraded":"2023-11-28T16:58:10.376272+0000","last_fullsized":"2023-11-28T16:58:10.376272+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:07.257033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854435+0000","last_change":"2023-11-28T16:58:10.400911+0000","last_active":"2023-11-28T16:58:11.854435+0000","last_peered":"2023-11-28T16:58:11.854435+0000","last_clean":"2023-11-28T16:58:11.854435+0000","last_became_active":"2023-11-28T16:58:10.400409+0000","last_became_peered":"2023-11-28T16:58:10.400409+0000","last_unstale":"2023-11-28T16:58:11.854435+0000","last_undegraded":"2023-11-28T16:58:11.854435+0000","last_fullsized":"2023-11-28T16:58:11.854435+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:07.575625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376117+0000","last_change":"2023-11-28T16:57:57.285037+0000","last_active":"2023-11-28T16:58:10.376117+0000","last_peered":"2023-11-28T16:58:10.376117+0000","last_clean":"2023-11-28T16:58:10.376117+0000","last_became_active":"2023-11-28T16:57:57.284722+0000","last_became_peered":"2023-11-28T16:57:57.284722+0000","last_unstale":"2023-11-28T16:58:10.376117+0000","last_undegraded":"2023-11-28T16:58:10.376117+0000","last_fullsized":"2023-11-28T16:58:10.376117+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:29.116162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.855099+0000","last_change":"2023-11-28T16:58:10.389126+0000","last_active":"2023-11-28T16:58:11.855099+0000","last_peered":"2023-11-28T16:58:11.855099+0000","last_clean":"2023-11-28T16:58:11.855099+0000","last_became_active":"2023-11-28T16:58:10.388787+0000","last_became_peered":"2023-11-28T16:58:10.388787+0000","last_unstale":"2023-11-28T16:58:11.855099+0000","last_undegraded":"2023-11-28T16:58:11.855099+0000","last_fullsized":"2023-11-28T16:58:11.855099+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:47.300754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381231+0000","last_change":"2023-11-28T16:57:57.303913+0000","last_active":"2023-11-28T16:58:10.381231+0000","last_peered":"2023-11-28T16:58:10.381231+0000","last_clean":"2023-11-28T16:58:10.381231+0000","last_became_active":"2023-11-28T16:57:57.303625+0000","last_became_peered":"2023-11-28T16:57:57.303625+0000","last_unstale":"2023-11-28T16:58:10.381231+0000","last_undegraded":"2023-11-28T16:58:10.381231+0000","last_fullsized":"2023-11-28T16:58:10.381231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380476+0000","last_change":"2023-11-28T16:58:10.382499+0000","last_active":"2023-11-28T16:58:11.380476+0000","last_peered":"2023-11-28T16:58:11.380476+0000","last_clean":"2023-11-28T16:58:11.380476+0000","last_became_active":"2023-11-28T16:58:10.382207+0000","last_became_peered":"2023-11-28T16:58:10.382207+0000","last_unstale":"2023-11-28T16:58:11.380476+0000","last_undegraded":"2023-11-28T16:58:11.380476+0000","last_fullsized":"2023-11-28T16:58:11.380476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:11.429575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376085+0000","last_change":"2023-11-28T16:57:57.305618+0000","last_active":"2023-11-28T16:58:10.376085+0000","last_peered":"2023-11-28T16:58:10.376085+0000","last_clean":"2023-11-28T16:58:10.376085+0000","last_became_active":"2023-11-28T16:57:57.305369+0000","last_became_peered":"2023-11-28T16:57:57.305369+0000","last_unstale":"2023-11-28T16:58:10.376085+0000","last_undegraded":"2023-11-28T16:58:10.376085+0000","last_fullsized":"2023-11-28T16:58:10.376085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:03:26.927795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853765+0000","last_change":"2023-11-28T16:58:10.389750+0000","last_active":"2023-11-28T16:58:11.853765+0000","last_peered":"2023-11-28T16:58:11.853765+0000","last_clean":"2023-11-28T16:58:11.853765+0000","last_became_active":"2023-11-28T16:58:10.389434+0000","last_became_peered":"2023-11-28T16:58:10.389434+0000","last_unstale":"2023-11-28T16:58:11.853765+0000","last_undegraded":"2023-11-28T16:58:11.853765+0000","last_fullsized":"2023-11-28T16:58:11.853765+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:32.158497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366778+0000","last_change":"2023-11-28T16:57:57.286182+0000","last_active":"2023-11-28T16:58:10.366778+0000","last_peered":"2023-11-28T16:58:10.366778+0000","last_clean":"2023-11-28T16:58:10.366778+0000","last_became_active":"2023-11-28T16:57:57.285885+0000","last_became_peered":"2023-11-28T16:57:57.285885+0000","last_unstale":"2023-11-28T16:58:10.366778+0000","last_undegraded":"2023-11-28T16:58:10.366778+0000","last_fullsized":"2023-11-28T16:58:10.366778+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:34.325761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380638+0000","last_change":"2023-11-28T16:58:10.392097+0000","last_active":"2023-11-28T16:58:11.380638+0000","last_peered":"2023-11-28T16:58:11.380638+0000","last_clean":"2023-11-28T16:58:11.380638+0000","last_became_active":"2023-11-28T16:58:10.391748+0000","last_became_peered":"2023-11-28T16:58:10.391748+0000","last_unstale":"2023-11-28T16:58:11.380638+0000","last_undegraded":"2023-11-28T16:58:11.380638+0000","last_fullsized":"2023-11-28T16:58:11.380638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.452379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367252+0000","last_change":"2023-11-28T16:57:57.288466+0000","last_active":"2023-11-28T16:58:10.367252+0000","last_peered":"2023-11-28T16:58:10.367252+0000","last_clean":"2023-11-28T16:58:10.367252+0000","last_became_active":"2023-11-28T16:57:57.288071+0000","last_became_peered":"2023-11-28T16:57:57.288071+0000","last_unstale":"2023-11-28T16:58:10.367252+0000","last_undegraded":"2023-11-28T16:58:10.367252+0000","last_fullsized":"2023-11-28T16:58:10.367252+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:43:54.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851988+0000","last_change":"2023-11-28T16:58:10.397455+0000","last_active":"2023-11-28T16:58:11.851988+0000","last_peered":"2023-11-28T16:58:11.851988+0000","last_clean":"2023-11-28T16:58:11.851988+0000","last_became_active":"2023-11-28T16:58:10.396936+0000","last_became_peered":"2023-11-28T16:58:10.396936+0000","last_unstale":"2023-11-28T16:58:11.851988+0000","last_undegraded":"2023-11-28T16:58:11.851988+0000","last_fullsized":"2023-11-28T16:58:11.851988+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:49.369425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367667+0000","last_change":"2023-11-28T16:57:57.298522+0000","last_active":"2023-11-28T16:58:10.367667+0000","last_peered":"2023-11-28T16:58:10.367667+0000","last_clean":"2023-11-28T16:58:10.367667+0000","last_became_active":"2023-11-28T16:57:57.298241+0000","last_became_peered":"2023-11-28T16:57:57.298241+0000","last_unstale":"2023-11-28T16:58:10.367667+0000","last_undegraded":"2023-11-28T16:58:10.367667+0000","last_fullsized":"2023-11-28T16:58:10.367667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854917+0000","last_change":"2023-11-28T16:58:10.393575+0000","last_active":"2023-11-28T16:58:11.854917+0000","last_peered":"2023-11-28T16:58:11.854917+0000","last_clean":"2023-11-28T16:58:11.854917+0000","last_became_active":"2023-11-28T16:58:10.392989+0000","last_became_peered":"2023-11-28T16:58:10.392989+0000","last_unstale":"2023-11-28T16:58:11.854917+0000","last_undegraded":"2023-11-28T16:58:11.854917+0000","last_fullsized":"2023-11-28T16:58:11.854917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:47.300754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375086+0000","last_change":"2023-11-28T16:57:57.306762+0000","last_active":"2023-11-28T16:58:10.375086+0000","last_peered":"2023-11-28T16:58:10.375086+0000","last_clean":"2023-11-28T16:58:10.375086+0000","last_became_active":"2023-11-28T16:57:57.306428+0000","last_became_peered":"2023-11-28T16:57:57.306428+0000","last_unstale":"2023-11-28T16:58:10.375086+0000","last_undegraded":"2023-11-28T16:58:10.375086+0000","last_fullsized":"2023-11-28T16:58:10.375086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:34.023526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380883+0000","last_change":"2023-11-28T16:58:10.401687+0000","last_active":"2023-11-28T16:58:11.380883+0000","last_peered":"2023-11-28T16:58:11.380883+0000","last_clean":"2023-11-28T16:58:11.380883+0000","last_became_active":"2023-11-28T16:58:10.400826+0000","last_became_peered":"2023-11-28T16:58:10.400826+0000","last_unstale":"2023-11-28T16:58:11.380883+0000","last_undegraded":"2023-11-28T16:58:11.380883+0000","last_fullsized":"2023-11-28T16:58:11.380883+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:03.319383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361702+0000","last_change":"2023-11-28T16:57:57.301733+0000","last_active":"2023-11-28T16:58:10.361702+0000","last_peered":"2023-11-28T16:58:10.361702+0000","last_clean":"2023-11-28T16:58:10.361702+0000","last_became_active":"2023-11-28T16:57:57.301402+0000","last_became_peered":"2023-11-28T16:57:57.301402+0000","last_unstale":"2023-11-28T16:58:10.361702+0000","last_undegraded":"2023-11-28T16:58:10.361702+0000","last_fullsized":"2023-11-28T16:58:10.361702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:35.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854509+0000","last_change":"2023-11-28T16:58:10.401381+0000","last_active":"2023-11-28T16:58:11.854509+0000","last_peered":"2023-11-28T16:58:11.854509+0000","last_clean":"2023-11-28T16:58:11.854509+0000","last_became_active":"2023-11-28T16:58:10.401101+0000","last_became_peered":"2023-11-28T16:58:10.401101+0000","last_unstale":"2023-11-28T16:58:11.854509+0000","last_undegraded":"2023-11-28T16:58:11.854509+0000","last_fullsized":"2023-11-28T16:58:11.854509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:19:00.255422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382504+0000","last_change":"2023-11-28T16:57:57.299228+0000","last_active":"2023-11-28T16:58:10.382504+0000","last_peered":"2023-11-28T16:58:10.382504+0000","last_clean":"2023-11-28T16:58:10.382504+0000","last_became_active":"2023-11-28T16:57:57.298919+0000","last_became_peered":"2023-11-28T16:57:57.298919+0000","last_unstale":"2023-11-28T16:58:10.382504+0000","last_undegraded":"2023-11-28T16:58:10.382504+0000","last_fullsized":"2023-11-28T16:58:10.382504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:09.019656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854006+0000","last_change":"2023-11-28T16:58:10.387592+0000","last_active":"2023-11-28T16:58:11.854006+0000","last_peered":"2023-11-28T16:58:11.854006+0000","last_clean":"2023-11-28T16:58:11.854006+0000","last_became_active":"2023-11-28T16:58:10.387334+0000","last_became_peered":"2023-11-28T16:58:10.387334+0000","last_unstale":"2023-11-28T16:58:11.854006+0000","last_undegraded":"2023-11-28T16:58:11.854006+0000","last_fullsized":"2023-11-28T16:58:11.854006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:18.094893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374620+0000","last_change":"2023-11-28T16:57:57.299427+0000","last_active":"2023-11-28T16:58:10.374620+0000","last_peered":"2023-11-28T16:58:10.374620+0000","last_clean":"2023-11-28T16:58:10.374620+0000","last_became_active":"2023-11-28T16:57:57.299152+0000","last_became_peered":"2023-11-28T16:57:57.299152+0000","last_unstale":"2023-11-28T16:58:10.374620+0000","last_undegraded":"2023-11-28T16:58:10.374620+0000","last_fullsized":"2023-11-28T16:58:10.374620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:15.293843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382088+0000","last_change":"2023-11-28T16:58:10.399459+0000","last_active":"2023-11-28T16:58:11.382088+0000","last_peered":"2023-11-28T16:58:11.382088+0000","last_clean":"2023-11-28T16:58:11.382088+0000","last_became_active":"2023-11-28T16:58:10.399075+0000","last_became_peered":"2023-11-28T16:58:10.399075+0000","last_unstale":"2023-11-28T16:58:11.382088+0000","last_undegraded":"2023-11-28T16:58:11.382088+0000","last_fullsized":"2023-11-28T16:58:11.382088+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:09.954778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360524+0000","last_change":"2023-11-28T16:57:57.293718+0000","last_active":"2023-11-28T16:58:10.360524+0000","last_peered":"2023-11-28T16:58:10.360524+0000","last_clean":"2023-11-28T16:58:10.360524+0000","last_became_active":"2023-11-28T16:57:57.293317+0000","last_became_peered":"2023-11-28T16:57:57.293317+0000","last_unstale":"2023-11-28T16:58:10.360524+0000","last_undegraded":"2023-11-28T16:58:10.360524+0000","last_fullsized":"2023-11-28T16:58:10.360524+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:51.845914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.381750+0000","last_change":"2023-11-28T16:58:10.395224+0000","last_active":"2023-11-28T16:58:11.381750+0000","last_peered":"2023-11-28T16:58:11.381750+0000","last_clean":"2023-11-28T16:58:11.381750+0000","last_became_active":"2023-11-28T16:58:10.394668+0000","last_became_peered":"2023-11-28T16:58:10.394668+0000","last_unstale":"2023-11-28T16:58:11.381750+0000","last_undegraded":"2023-11-28T16:58:11.381750+0000","last_fullsized":"2023-11-28T16:58:11.381750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:12.076027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377652+0000","last_change":"2023-11-28T16:57:57.307374+0000","last_active":"2023-11-28T16:58:10.377652+0000","last_peered":"2023-11-28T16:58:10.377652+0000","last_clean":"2023-11-28T16:58:10.377652+0000","last_became_active":"2023-11-28T16:57:57.305540+0000","last_became_peered":"2023-11-28T16:57:57.305540+0000","last_unstale":"2023-11-28T16:58:10.377652+0000","last_undegraded":"2023-11-28T16:58:10.377652+0000","last_fullsized":"2023-11-28T16:58:10.377652+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:34.222003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854834+0000","last_change":"2023-11-28T16:58:10.374427+0000","last_active":"2023-11-28T16:58:11.854834+0000","last_peered":"2023-11-28T16:58:11.854834+0000","last_clean":"2023-11-28T16:58:11.854834+0000","last_became_active":"2023-11-28T16:58:10.374146+0000","last_became_peered":"2023-11-28T16:58:10.374146+0000","last_unstale":"2023-11-28T16:58:11.854834+0000","last_undegraded":"2023-11-28T16:58:11.854834+0000","last_fullsized":"2023-11-28T16:58:11.854834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:59.066815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360449+0000","last_change":"2023-11-28T16:57:57.300922+0000","last_active":"2023-11-28T16:58:10.360449+0000","last_peered":"2023-11-28T16:58:10.360449+0000","last_clean":"2023-11-28T16:58:10.360449+0000","last_became_active":"2023-11-28T16:57:57.300127+0000","last_became_peered":"2023-11-28T16:57:57.300127+0000","last_unstale":"2023-11-28T16:58:10.360449+0000","last_undegraded":"2023-11-28T16:58:10.360449+0000","last_fullsized":"2023-11-28T16:58:10.360449+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854357+0000","last_change":"2023-11-28T16:58:10.388901+0000","last_active":"2023-11-28T16:58:11.854357+0000","last_peered":"2023-11-28T16:58:11.854357+0000","last_clean":"2023-11-28T16:58:11.854357+0000","last_became_active":"2023-11-28T16:58:10.388408+0000","last_became_peered":"2023-11-28T16:58:10.388408+0000","last_unstale":"2023-11-28T16:58:11.854357+0000","last_undegraded":"2023-11-28T16:58:11.854357+0000","last_fullsized":"2023-11-28T16:58:11.854357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:50.217884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376168+0000","last_change":"2023-11-28T16:57:57.307862+0000","last_active":"2023-11-28T16:58:10.376168+0000","last_peered":"2023-11-28T16:58:10.376168+0000","last_clean":"2023-11-28T16:58:10.376168+0000","last_became_active":"2023-11-28T16:57:57.307540+0000","last_became_peered":"2023-11-28T16:57:57.307540+0000","last_unstale":"2023-11-28T16:58:10.376168+0000","last_undegraded":"2023-11-28T16:58:10.376168+0000","last_fullsized":"2023-11-28T16:58:10.376168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:36.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852379+0000","last_change":"2023-11-28T16:58:10.392911+0000","last_active":"2023-11-28T16:58:11.852379+0000","last_peered":"2023-11-28T16:58:11.852379+0000","last_clean":"2023-11-28T16:58:11.852379+0000","last_became_active":"2023-11-28T16:58:10.388454+0000","last_became_peered":"2023-11-28T16:58:10.388454+0000","last_unstale":"2023-11-28T16:58:11.852379+0000","last_undegraded":"2023-11-28T16:58:11.852379+0000","last_fullsized":"2023-11-28T16:58:11.852379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:34.498594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382498+0000","last_change":"2023-11-28T16:57:57.284808+0000","last_active":"2023-11-28T16:58:10.382498+0000","last_peered":"2023-11-28T16:58:10.382498+0000","last_clean":"2023-11-28T16:58:10.382498+0000","last_became_active":"2023-11-28T16:57:57.284304+0000","last_became_peered":"2023-11-28T16:57:57.284304+0000","last_unstale":"2023-11-28T16:58:10.382498+0000","last_undegraded":"2023-11-28T16:58:10.382498+0000","last_fullsized":"2023-11-28T16:58:10.382498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:56.940553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854061+0000","last_change":"2023-11-28T16:58:10.388480+0000","last_active":"2023-11-28T16:58:11.854061+0000","last_peered":"2023-11-28T16:58:11.854061+0000","last_clean":"2023-11-28T16:58:11.854061+0000","last_became_active":"2023-11-28T16:58:10.388153+0000","last_became_peered":"2023-11-28T16:58:10.388153+0000","last_unstale":"2023-11-28T16:58:11.854061+0000","last_undegraded":"2023-11-28T16:58:11.854061+0000","last_fullsized":"2023-11-28T16:58:11.854061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:21.000572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381476+0000","last_change":"2023-11-28T16:57:57.291693+0000","last_active":"2023-11-28T16:58:10.381476+0000","last_peered":"2023-11-28T16:58:10.381476+0000","last_clean":"2023-11-28T16:58:10.381476+0000","last_became_active":"2023-11-28T16:57:57.291320+0000","last_became_peered":"2023-11-28T16:57:57.291320+0000","last_unstale":"2023-11-28T16:58:10.381476+0000","last_undegraded":"2023-11-28T16:58:10.381476+0000","last_fullsized":"2023-11-28T16:58:10.381476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:21.959226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.855183+0000","last_change":"2023-11-28T16:58:10.385804+0000","last_active":"2023-11-28T16:58:11.855183+0000","last_peered":"2023-11-28T16:58:11.855183+0000","last_clean":"2023-11-28T16:58:11.855183+0000","last_became_active":"2023-11-28T16:58:10.385484+0000","last_became_peered":"2023-11-28T16:58:10.385484+0000","last_unstale":"2023-11-28T16:58:11.855183+0000","last_undegraded":"2023-11-28T16:58:11.855183+0000","last_fullsized":"2023-11-28T16:58:11.855183+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:37.810329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367967+0000","last_change":"2023-11-28T16:57:57.299843+0000","last_active":"2023-11-28T16:58:10.367967+0000","last_peered":"2023-11-28T16:58:10.367967+0000","last_clean":"2023-11-28T16:58:10.367967+0000","last_became_active":"2023-11-28T16:57:57.299266+0000","last_became_peered":"2023-11-28T16:57:57.299266+0000","last_unstale":"2023-11-28T16:58:10.367967+0000","last_undegraded":"2023-11-28T16:58:10.367967+0000","last_fullsized":"2023-11-28T16:58:10.367967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.337328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384625+0000","last_change":"2023-11-28T16:58:10.399844+0000","last_active":"2023-11-28T16:58:11.384625+0000","last_peered":"2023-11-28T16:58:11.384625+0000","last_clean":"2023-11-28T16:58:11.384625+0000","last_became_active":"2023-11-28T16:58:10.399612+0000","last_became_peered":"2023-11-28T16:58:10.399612+0000","last_unstale":"2023-11-28T16:58:11.384625+0000","last_undegraded":"2023-11-28T16:58:11.384625+0000","last_fullsized":"2023-11-28T16:58:11.384625+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:39.374588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383013+0000","last_change":"2023-11-28T16:57:57.294587+0000","last_active":"2023-11-28T16:58:10.383013+0000","last_peered":"2023-11-28T16:58:10.383013+0000","last_clean":"2023-11-28T16:58:10.383013+0000","last_became_active":"2023-11-28T16:57:57.294283+0000","last_became_peered":"2023-11-28T16:57:57.294283+0000","last_unstale":"2023-11-28T16:58:10.383013+0000","last_undegraded":"2023-11-28T16:58:10.383013+0000","last_fullsized":"2023-11-28T16:58:10.383013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:35.632692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383695+0000","last_change":"2023-11-28T16:58:10.402027+0000","last_active":"2023-11-28T16:58:11.383695+0000","last_peered":"2023-11-28T16:58:11.383695+0000","last_clean":"2023-11-28T16:58:11.383695+0000","last_became_active":"2023-11-28T16:58:10.398300+0000","last_became_peered":"2023-11-28T16:58:10.398300+0000","last_unstale":"2023-11-28T16:58:11.383695+0000","last_undegraded":"2023-11-28T16:58:11.383695+0000","last_fullsized":"2023-11-28T16:58:11.383695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:00.310975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374778+0000","last_change":"2023-11-28T16:57:57.298034+0000","last_active":"2023-11-28T16:58:10.374778+0000","last_peered":"2023-11-28T16:58:10.374778+0000","last_clean":"2023-11-28T16:58:10.374778+0000","last_became_active":"2023-11-28T16:57:57.297743+0000","last_became_peered":"2023-11-28T16:57:57.297743+0000","last_unstale":"2023-11-28T16:58:10.374778+0000","last_undegraded":"2023-11-28T16:58:10.374778+0000","last_fullsized":"2023-11-28T16:58:10.374778+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:26.295837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854322+0000","last_change":"2023-11-28T16:58:10.394623+0000","last_active":"2023-11-28T16:58:11.854322+0000","last_peered":"2023-11-28T16:58:11.854322+0000","last_clean":"2023-11-28T16:58:11.854322+0000","last_became_active":"2023-11-28T16:58:10.394306+0000","last_became_peered":"2023-11-28T16:58:10.394306+0000","last_unstale":"2023-11-28T16:58:11.854322+0000","last_undegraded":"2023-11-28T16:58:11.854322+0000","last_fullsized":"2023-11-28T16:58:11.854322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:21.000572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360464+0000","last_change":"2023-11-28T16:57:57.296838+0000","last_active":"2023-11-28T16:58:10.360464+0000","last_peered":"2023-11-28T16:58:10.360464+0000","last_clean":"2023-11-28T16:58:10.360464+0000","last_became_active":"2023-11-28T16:57:57.295762+0000","last_became_peered":"2023-11-28T16:57:57.295762+0000","last_unstale":"2023-11-28T16:58:10.360464+0000","last_undegraded":"2023-11-28T16:58:10.360464+0000","last_fullsized":"2023-11-28T16:58:10.360464+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852421+0000","last_change":"2023-11-28T16:58:10.399375+0000","last_active":"2023-11-28T16:58:11.852421+0000","last_peered":"2023-11-28T16:58:11.852421+0000","last_clean":"2023-11-28T16:58:11.852421+0000","last_became_active":"2023-11-28T16:58:10.399093+0000","last_became_peered":"2023-11-28T16:58:10.399093+0000","last_unstale":"2023-11-28T16:58:11.852421+0000","last_undegraded":"2023-11-28T16:58:11.852421+0000","last_fullsized":"2023-11-28T16:58:11.852421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:59:26.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380817+0000","last_change":"2023-11-28T16:57:57.291516+0000","last_active":"2023-11-28T16:58:10.380817+0000","last_peered":"2023-11-28T16:58:10.380817+0000","last_clean":"2023-11-28T16:58:10.380817+0000","last_became_active":"2023-11-28T16:57:57.291201+0000","last_became_peered":"2023-11-28T16:57:57.291201+0000","last_unstale":"2023-11-28T16:58:10.380817+0000","last_undegraded":"2023-11-28T16:58:10.380817+0000","last_fullsized":"2023-11-28T16:58:10.380817+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:23.828578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383772+0000","last_change":"2023-11-28T16:58:10.400034+0000","last_active":"2023-11-28T16:58:11.383772+0000","last_peered":"2023-11-28T16:58:11.383772+0000","last_clean":"2023-11-28T16:58:11.383772+0000","last_became_active":"2023-11-28T16:58:10.399697+0000","last_became_peered":"2023-11-28T16:58:10.399697+0000","last_unstale":"2023-11-28T16:58:11.383772+0000","last_undegraded":"2023-11-28T16:58:11.383772+0000","last_fullsized":"2023-11-28T16:58:11.383772+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:13.674861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366340+0000","last_change":"2023-11-28T16:57:57.308867+0000","last_active":"2023-11-28T16:58:10.366340+0000","last_peered":"2023-11-28T16:58:10.366340+0000","last_clean":"2023-11-28T16:58:10.366340+0000","last_became_active":"2023-11-28T16:57:57.307693+0000","last_became_peered":"2023-11-28T16:57:57.307693+0000","last_unstale":"2023-11-28T16:58:10.366340+0000","last_undegraded":"2023-11-28T16:58:10.366340+0000","last_fullsized":"2023-11-28T16:58:10.366340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:24.984986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854132+0000","last_change":"2023-11-28T16:58:10.387001+0000","last_active":"2023-11-28T16:58:11.854132+0000","last_peered":"2023-11-28T16:58:11.854132+0000","last_clean":"2023-11-28T16:58:11.854132+0000","last_became_active":"2023-11-28T16:58:10.386629+0000","last_became_peered":"2023-11-28T16:58:10.386629+0000","last_unstale":"2023-11-28T16:58:11.854132+0000","last_undegraded":"2023-11-28T16:58:11.854132+0000","last_fullsized":"2023-11-28T16:58:11.854132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:49.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.401880+0000","last_change":"2023-11-28T16:58:09.374084+0000","last_active":"2023-11-28T16:58:10.401880+0000","last_peered":"2023-11-28T16:58:10.401880+0000","last_clean":"2023-11-28T16:58:10.401880+0000","last_became_active":"2023-11-28T16:58:09.373766+0000","last_became_peered":"2023-11-28T16:58:09.373766+0000","last_unstale":"2023-11-28T16:58:10.401880+0000","last_undegraded":"2023-11-28T16:58:10.401880+0000","last_fullsized":"2023-11-28T16:58:10.401880+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:20.154638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368999+0000","last_change":"2023-11-28T16:57:57.292539+0000","last_active":"2023-11-28T16:58:10.368999+0000","last_peered":"2023-11-28T16:58:10.368999+0000","last_clean":"2023-11-28T16:58:10.368999+0000","last_became_active":"2023-11-28T16:57:57.292189+0000","last_became_peered":"2023-11-28T16:57:57.292189+0000","last_unstale":"2023-11-28T16:58:10.368999+0000","last_undegraded":"2023-11-28T16:58:10.368999+0000","last_fullsized":"2023-11-28T16:58:10.368999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368405+0000","last_change":"2023-11-28T16:57:56.296007+0000","last_active":"2023-11-28T16:58:10.368405+0000","last_peered":"2023-11-28T16:58:10.368405+0000","last_clean":"2023-11-28T16:58:10.368405+0000","last_became_active":"2023-11-28T16:57:56.295636+0000","last_became_peered":"2023-11-28T16:57:56.295636+0000","last_unstale":"2023-11-28T16:58:10.368405+0000","last_undegraded":"2023-11-28T16:58:10.368405+0000","last_fullsized":"2023-11-28T16:58:10.368405+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:38.988857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382557+0000","last_change":"2023-11-28T16:58:10.381875+0000","last_active":"2023-11-28T16:58:11.382557+0000","last_peered":"2023-11-28T16:58:11.382557+0000","last_clean":"2023-11-28T16:58:11.382557+0000","last_became_active":"2023-11-28T16:58:10.381618+0000","last_became_peered":"2023-11-28T16:58:10.381618+0000","last_unstale":"2023-11-28T16:58:11.382557+0000","last_undegraded":"2023-11-28T16:58:11.382557+0000","last_fullsized":"2023-11-28T16:58:11.382557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:38.770172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.395002+0000","last_change":"2023-11-28T16:58:09.372867+0000","last_active":"2023-11-28T16:58:10.395002+0000","last_peered":"2023-11-28T16:58:10.395002+0000","last_clean":"2023-11-28T16:58:10.395002+0000","last_became_active":"2023-11-28T16:58:09.372597+0000","last_became_peered":"2023-11-28T16:58:09.372597+0000","last_unstale":"2023-11-28T16:58:10.395002+0000","last_undegraded":"2023-11-28T16:58:10.395002+0000","last_fullsized":"2023-11-28T16:58:10.395002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:10.354729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376253+0000","last_change":"2023-11-28T16:57:57.281906+0000","last_active":"2023-11-28T16:58:10.376253+0000","last_peered":"2023-11-28T16:58:10.376253+0000","last_clean":"2023-11-28T16:58:10.376253+0000","last_became_active":"2023-11-28T16:57:57.281593+0000","last_became_peered":"2023-11-28T16:57:57.281593+0000","last_unstale":"2023-11-28T16:58:10.376253+0000","last_undegraded":"2023-11-28T16:58:10.376253+0000","last_fullsized":"2023-11-28T16:58:10.376253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375522+0000","last_change":"2023-11-28T16:57:56.301479+0000","last_active":"2023-11-28T16:58:10.375522+0000","last_peered":"2023-11-28T16:58:10.375522+0000","last_clean":"2023-11-28T16:58:10.375522+0000","last_became_active":"2023-11-28T16:57:56.301262+0000","last_became_peered":"2023-11-28T16:57:56.301262+0000","last_unstale":"2023-11-28T16:58:10.375522+0000","last_undegraded":"2023-11-28T16:58:10.375522+0000","last_fullsized":"2023-11-28T16:58:10.375522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:34.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382465+0000","last_change":"2023-11-28T16:58:10.398175+0000","last_active":"2023-11-28T16:58:11.382465+0000","last_peered":"2023-11-28T16:58:11.382465+0000","last_clean":"2023-11-28T16:58:11.382465+0000","last_became_active":"2023-11-28T16:58:10.397893+0000","last_became_peered":"2023-11-28T16:58:10.397893+0000","last_unstale":"2023-11-28T16:58:11.382465+0000","last_undegraded":"2023-11-28T16:58:11.382465+0000","last_fullsized":"2023-11-28T16:58:11.382465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:42.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383723+0000","last_change":"2023-11-28T16:58:09.371624+0000","last_active":"2023-11-28T16:58:10.383723+0000","last_peered":"2023-11-28T16:58:10.383723+0000","last_clean":"2023-11-28T16:58:10.383723+0000","last_became_active":"2023-11-28T16:58:09.371252+0000","last_became_peered":"2023-11-28T16:58:09.371252+0000","last_unstale":"2023-11-28T16:58:10.383723+0000","last_undegraded":"2023-11-28T16:58:10.383723+0000","last_fullsized":"2023-11-28T16:58:10.383723+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:33.587590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367699+0000","last_change":"2023-11-28T16:57:57.296485+0000","last_active":"2023-11-28T16:58:10.367699+0000","last_peered":"2023-11-28T16:58:10.367699+0000","last_clean":"2023-11-28T16:58:10.367699+0000","last_became_active":"2023-11-28T16:57:57.296210+0000","last_became_peered":"2023-11-28T16:57:57.296210+0000","last_unstale":"2023-11-28T16:58:10.367699+0000","last_undegraded":"2023-11-28T16:58:10.367699+0000","last_fullsized":"2023-11-28T16:58:10.367699+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368219+0000","last_change":"2023-11-28T16:57:56.284952+0000","last_active":"2023-11-28T16:58:10.368219+0000","last_peered":"2023-11-28T16:58:10.368219+0000","last_clean":"2023-11-28T16:58:10.368219+0000","last_became_active":"2023-11-28T16:57:56.284663+0000","last_became_peered":"2023-11-28T16:57:56.284663+0000","last_unstale":"2023-11-28T16:58:10.368219+0000","last_undegraded":"2023-11-28T16:58:10.368219+0000","last_fullsized":"2023-11-28T16:58:10.368219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854666+0000","last_change":"2023-11-28T16:58:10.400740+0000","last_active":"2023-11-28T16:58:11.854666+0000","last_peered":"2023-11-28T16:58:11.854666+0000","last_clean":"2023-11-28T16:58:11.854666+0000","last_became_active":"2023-11-28T16:58:10.399606+0000","last_became_peered":"2023-11-28T16:58:10.399606+0000","last_unstale":"2023-11-28T16:58:11.854666+0000","last_undegraded":"2023-11-28T16:58:11.854666+0000","last_fullsized":"2023-11-28T16:58:11.854666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:09.836237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.385172+0000","last_change":"2023-11-28T16:58:09.379004+0000","last_active":"2023-11-28T16:58:10.385172+0000","last_peered":"2023-11-28T16:58:10.385172+0000","last_clean":"2023-11-28T16:58:10.385172+0000","last_became_active":"2023-11-28T16:58:09.378364+0000","last_became_peered":"2023-11-28T16:58:09.378364+0000","last_unstale":"2023-11-28T16:58:10.385172+0000","last_undegraded":"2023-11-28T16:58:10.385172+0000","last_fullsized":"2023-11-28T16:58:10.385172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:46.095952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368050+0000","last_change":"2023-11-28T16:57:57.299545+0000","last_active":"2023-11-28T16:58:10.368050+0000","last_peered":"2023-11-28T16:58:10.368050+0000","last_clean":"2023-11-28T16:58:10.368050+0000","last_became_active":"2023-11-28T16:57:57.298953+0000","last_became_peered":"2023-11-28T16:57:57.298953+0000","last_unstale":"2023-11-28T16:58:10.368050+0000","last_undegraded":"2023-11-28T16:58:10.368050+0000","last_fullsized":"2023-11-28T16:58:10.368050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:09.844835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381211+0000","last_change":"2023-11-28T16:57:56.293038+0000","last_active":"2023-11-28T16:58:10.381211+0000","last_peered":"2023-11-28T16:58:10.381211+0000","last_clean":"2023-11-28T16:58:10.381211+0000","last_became_active":"2023-11-28T16:57:56.292443+0000","last_became_peered":"2023-11-28T16:57:56.292443+0000","last_unstale":"2023-11-28T16:58:10.381211+0000","last_undegraded":"2023-11-28T16:58:10.381211+0000","last_fullsized":"2023-11-28T16:58:10.381211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851647+0000","last_change":"2023-11-28T16:58:10.393323+0000","last_active":"2023-11-28T16:58:11.851647+0000","last_peered":"2023-11-28T16:58:11.851647+0000","last_clean":"2023-11-28T16:58:11.851647+0000","last_became_active":"2023-11-28T16:58:10.393055+0000","last_became_peered":"2023-11-28T16:58:10.393055+0000","last_unstale":"2023-11-28T16:58:11.851647+0000","last_undegraded":"2023-11-28T16:58:11.851647+0000","last_fullsized":"2023-11-28T16:58:11.851647+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:54.392901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.363377+0000","last_change":"2023-11-28T16:58:09.366910+0000","last_active":"2023-11-28T16:58:10.363377+0000","last_peered":"2023-11-28T16:58:10.363377+0000","last_clean":"2023-11-28T16:58:10.363377+0000","last_became_active":"2023-11-28T16:58:09.366580+0000","last_became_peered":"2023-11-28T16:58:09.366580+0000","last_unstale":"2023-11-28T16:58:10.363377+0000","last_undegraded":"2023-11-28T16:58:10.363377+0000","last_fullsized":"2023-11-28T16:58:10.363377+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:00.459338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377733+0000","last_change":"2023-11-28T16:57:57.307182+0000","last_active":"2023-11-28T16:58:10.377733+0000","last_peered":"2023-11-28T16:58:10.377733+0000","last_clean":"2023-11-28T16:58:10.377733+0000","last_became_active":"2023-11-28T16:57:57.305143+0000","last_became_peered":"2023-11-28T16:57:57.305143+0000","last_unstale":"2023-11-28T16:58:10.377733+0000","last_undegraded":"2023-11-28T16:58:10.377733+0000","last_fullsized":"2023-11-28T16:58:10.377733+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:16.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367596+0000","last_change":"2023-11-28T16:57:56.298135+0000","last_active":"2023-11-28T16:58:10.367596+0000","last_peered":"2023-11-28T16:58:10.367596+0000","last_clean":"2023-11-28T16:58:10.367596+0000","last_became_active":"2023-11-28T16:57:56.297267+0000","last_became_peered":"2023-11-28T16:57:56.297267+0000","last_unstale":"2023-11-28T16:58:10.367596+0000","last_undegraded":"2023-11-28T16:58:10.367596+0000","last_fullsized":"2023-11-28T16:58:10.367596+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:46.168912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380533+0000","last_change":"2023-11-28T16:58:10.381177+0000","last_active":"2023-11-28T16:58:11.380533+0000","last_peered":"2023-11-28T16:58:11.380533+0000","last_clean":"2023-11-28T16:58:11.380533+0000","last_became_active":"2023-11-28T16:58:10.380843+0000","last_became_peered":"2023-11-28T16:58:10.380843+0000","last_unstale":"2023-11-28T16:58:11.380533+0000","last_undegraded":"2023-11-28T16:58:11.380533+0000","last_fullsized":"2023-11-28T16:58:11.380533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:34.593915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.379560+0000","last_change":"2023-11-28T16:58:09.379828+0000","last_active":"2023-11-28T16:58:10.379560+0000","last_peered":"2023-11-28T16:58:10.379560+0000","last_clean":"2023-11-28T16:58:10.379560+0000","last_became_active":"2023-11-28T16:58:09.378437+0000","last_became_peered":"2023-11-28T16:58:09.378437+0000","last_unstale":"2023-11-28T16:58:10.379560+0000","last_undegraded":"2023-11-28T16:58:10.379560+0000","last_fullsized":"2023-11-28T16:58:10.379560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:13:09.032301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374537+0000","last_change":"2023-11-28T16:57:57.310944+0000","last_active":"2023-11-28T16:58:10.374537+0000","last_peered":"2023-11-28T16:58:10.374537+0000","last_clean":"2023-11-28T16:58:10.374537+0000","last_became_active":"2023-11-28T16:57:57.306481+0000","last_became_peered":"2023-11-28T16:57:57.306481+0000","last_unstale":"2023-11-28T16:58:10.374537+0000","last_undegraded":"2023-11-28T16:58:10.374537+0000","last_fullsized":"2023-11-28T16:58:10.374537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.181027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367349+0000","last_change":"2023-11-28T16:57:56.294742+0000","last_active":"2023-11-28T16:58:10.367349+0000","last_peered":"2023-11-28T16:58:10.367349+0000","last_clean":"2023-11-28T16:58:10.367349+0000","last_became_active":"2023-11-28T16:57:56.294263+0000","last_became_peered":"2023-11-28T16:57:56.294263+0000","last_unstale":"2023-11-28T16:58:10.367349+0000","last_undegraded":"2023-11-28T16:58:10.367349+0000","last_fullsized":"2023-11-28T16:58:10.367349+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.383927+0000","last_change":"2023-11-28T16:58:10.397454+0000","last_active":"2023-11-28T16:58:11.383927+0000","last_peered":"2023-11-28T16:58:11.383927+0000","last_clean":"2023-11-28T16:58:11.383927+0000","last_became_active":"2023-11-28T16:58:10.397161+0000","last_became_peered":"2023-11-28T16:58:10.397161+0000","last_unstale":"2023-11-28T16:58:11.383927+0000","last_undegraded":"2023-11-28T16:58:11.383927+0000","last_fullsized":"2023-11-28T16:58:11.383927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.259778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.387514+0000","last_change":"2023-11-28T16:58:09.370886+0000","last_active":"2023-11-28T16:58:10.387514+0000","last_peered":"2023-11-28T16:58:10.387514+0000","last_clean":"2023-11-28T16:58:10.387514+0000","last_became_active":"2023-11-28T16:58:09.370548+0000","last_became_peered":"2023-11-28T16:58:09.370548+0000","last_unstale":"2023-11-28T16:58:10.387514+0000","last_undegraded":"2023-11-28T16:58:10.387514+0000","last_fullsized":"2023-11-28T16:58:10.387514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:37.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376269+0000","last_change":"2023-11-28T16:57:57.303350+0000","last_active":"2023-11-28T16:58:10.376269+0000","last_peered":"2023-11-28T16:58:10.376269+0000","last_clean":"2023-11-28T16:58:10.376269+0000","last_became_active":"2023-11-28T16:57:57.302817+0000","last_became_peered":"2023-11-28T16:57:57.302817+0000","last_unstale":"2023-11-28T16:58:10.376269+0000","last_undegraded":"2023-11-28T16:58:10.376269+0000","last_fullsized":"2023-11-28T16:58:10.376269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:18.750912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383739+0000","last_change":"2023-11-28T16:57:56.289134+0000","last_active":"2023-11-28T16:58:10.383739+0000","last_peered":"2023-11-28T16:58:10.383739+0000","last_clean":"2023-11-28T16:58:10.383739+0000","last_became_active":"2023-11-28T16:57:56.288857+0000","last_became_peered":"2023-11-28T16:57:56.288857+0000","last_unstale":"2023-11-28T16:58:10.383739+0000","last_undegraded":"2023-11-28T16:58:10.383739+0000","last_fullsized":"2023-11-28T16:58:10.383739+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:02.295044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854723+0000","last_change":"2023-11-28T16:58:10.385980+0000","last_active":"2023-11-28T16:58:11.854723+0000","last_peered":"2023-11-28T16:58:11.854723+0000","last_clean":"2023-11-28T16:58:11.854723+0000","last_became_active":"2023-11-28T16:58:10.385681+0000","last_became_peered":"2023-11-28T16:58:10.385681+0000","last_unstale":"2023-11-28T16:58:11.854723+0000","last_undegraded":"2023-11-28T16:58:11.854723+0000","last_fullsized":"2023-11-28T16:58:11.854723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:30.767044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.395658+0000","last_change":"2023-11-28T16:58:09.370650+0000","last_active":"2023-11-28T16:58:10.395658+0000","last_peered":"2023-11-28T16:58:10.395658+0000","last_clean":"2023-11-28T16:58:10.395658+0000","last_became_active":"2023-11-28T16:58:09.370449+0000","last_became_peered":"2023-11-28T16:58:09.370449+0000","last_unstale":"2023-11-28T16:58:10.395658+0000","last_undegraded":"2023-11-28T16:58:10.395658+0000","last_fullsized":"2023-11-28T16:58:10.395658+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:37.057412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374710+0000","last_change":"2023-11-28T16:57:57.296614+0000","last_active":"2023-11-28T16:58:10.374710+0000","last_peered":"2023-11-28T16:58:10.374710+0000","last_clean":"2023-11-28T16:58:10.374710+0000","last_became_active":"2023-11-28T16:57:57.296296+0000","last_became_peered":"2023-11-28T16:57:57.296296+0000","last_unstale":"2023-11-28T16:58:10.374710+0000","last_undegraded":"2023-11-28T16:58:10.374710+0000","last_fullsized":"2023-11-28T16:58:10.374710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:24.731578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367337+0000","last_change":"2023-11-28T16:57:56.297579+0000","last_active":"2023-11-28T16:58:10.367337+0000","last_peered":"2023-11-28T16:58:10.367337+0000","last_clean":"2023-11-28T16:58:10.367337+0000","last_became_active":"2023-11-28T16:57:56.297237+0000","last_became_peered":"2023-11-28T16:57:56.297237+0000","last_unstale":"2023-11-28T16:58:10.367337+0000","last_undegraded":"2023-11-28T16:58:10.367337+0000","last_fullsized":"2023-11-28T16:58:10.367337+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:53.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854279+0000","last_change":"2023-11-28T16:58:10.393137+0000","last_active":"2023-11-28T16:58:11.854279+0000","last_peered":"2023-11-28T16:58:11.854279+0000","last_clean":"2023-11-28T16:58:11.854279+0000","last_became_active":"2023-11-28T16:58:10.392430+0000","last_became_peered":"2023-11-28T16:58:10.392430+0000","last_unstale":"2023-11-28T16:58:11.854279+0000","last_undegraded":"2023-11-28T16:58:11.854279+0000","last_fullsized":"2023-11-28T16:58:11.854279+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:32.158497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.402730+0000","last_change":"2023-11-28T16:58:09.371255+0000","last_active":"2023-11-28T16:58:10.402730+0000","last_peered":"2023-11-28T16:58:10.402730+0000","last_clean":"2023-11-28T16:58:10.402730+0000","last_became_active":"2023-11-28T16:58:09.368332+0000","last_became_peered":"2023-11-28T16:58:09.368332+0000","last_unstale":"2023-11-28T16:58:10.402730+0000","last_undegraded":"2023-11-28T16:58:10.402730+0000","last_fullsized":"2023-11-28T16:58:10.402730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:39:21.467530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368278+0000","last_change":"2023-11-28T16:57:57.288341+0000","last_active":"2023-11-28T16:58:10.368278+0000","last_peered":"2023-11-28T16:58:10.368278+0000","last_clean":"2023-11-28T16:58:10.368278+0000","last_became_active":"2023-11-28T16:57:57.286946+0000","last_became_peered":"2023-11-28T16:57:57.286946+0000","last_unstale":"2023-11-28T16:58:10.368278+0000","last_undegraded":"2023-11-28T16:58:10.368278+0000","last_fullsized":"2023-11-28T16:58:10.368278+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:03.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362086+0000","last_change":"2023-11-28T16:57:56.303238+0000","last_active":"2023-11-28T16:58:10.362086+0000","last_peered":"2023-11-28T16:58:10.362086+0000","last_clean":"2023-11-28T16:58:10.362086+0000","last_became_active":"2023-11-28T16:57:56.302991+0000","last_became_peered":"2023-11-28T16:57:56.302991+0000","last_unstale":"2023-11-28T16:58:10.362086+0000","last_undegraded":"2023-11-28T16:58:10.362086+0000","last_fullsized":"2023-11-28T16:58:10.362086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:26.421556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854290+0000","last_change":"2023-11-28T16:58:10.382967+0000","last_active":"2023-11-28T16:58:11.854290+0000","last_peered":"2023-11-28T16:58:11.854290+0000","last_clean":"2023-11-28T16:58:11.854290+0000","last_became_active":"2023-11-28T16:58:10.382676+0000","last_became_peered":"2023-11-28T16:58:10.382676+0000","last_unstale":"2023-11-28T16:58:11.854290+0000","last_undegraded":"2023-11-28T16:58:11.854290+0000","last_fullsized":"2023-11-28T16:58:11.854290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:30.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.403098+0000","last_change":"2023-11-28T16:58:09.380840+0000","last_active":"2023-11-28T16:58:10.403098+0000","last_peered":"2023-11-28T16:58:10.403098+0000","last_clean":"2023-11-28T16:58:10.403098+0000","last_became_active":"2023-11-28T16:58:09.380365+0000","last_became_peered":"2023-11-28T16:58:09.380365+0000","last_unstale":"2023-11-28T16:58:10.403098+0000","last_undegraded":"2023-11-28T16:58:10.403098+0000","last_fullsized":"2023-11-28T16:58:10.403098+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:55.823583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361990+0000","last_change":"2023-11-28T16:57:57.292344+0000","last_active":"2023-11-28T16:58:10.361990+0000","last_peered":"2023-11-28T16:58:10.361990+0000","last_clean":"2023-11-28T16:58:10.361990+0000","last_became_active":"2023-11-28T16:57:57.291977+0000","last_became_peered":"2023-11-28T16:57:57.291977+0000","last_unstale":"2023-11-28T16:58:10.361990+0000","last_undegraded":"2023-11-28T16:58:10.361990+0000","last_fullsized":"2023-11-28T16:58:10.361990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:35.065157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375611+0000","last_change":"2023-11-28T16:57:56.300060+0000","last_active":"2023-11-28T16:58:10.375611+0000","last_peered":"2023-11-28T16:58:10.375611+0000","last_clean":"2023-11-28T16:58:10.375611+0000","last_became_active":"2023-11-28T16:57:56.299780+0000","last_became_peered":"2023-11-28T16:57:56.299780+0000","last_unstale":"2023-11-28T16:58:10.375611+0000","last_undegraded":"2023-11-28T16:58:10.375611+0000","last_fullsized":"2023-11-28T16:58:10.375611+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:18.071987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384746+0000","last_change":"2023-11-28T16:58:10.396588+0000","last_active":"2023-11-28T16:58:11.384746+0000","last_peered":"2023-11-28T16:58:11.384746+0000","last_clean":"2023-11-28T16:58:11.384746+0000","last_became_active":"2023-11-28T16:58:10.396059+0000","last_became_peered":"2023-11-28T16:58:10.396059+0000","last_unstale":"2023-11-28T16:58:11.384746+0000","last_undegraded":"2023-11-28T16:58:11.384746+0000","last_fullsized":"2023-11-28T16:58:11.384746+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:11.429575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367294+0000","last_change":"2023-11-28T16:58:09.374674+0000","last_active":"2023-11-28T16:58:10.367294+0000","last_peered":"2023-11-28T16:58:10.367294+0000","last_clean":"2023-11-28T16:58:10.367294+0000","last_became_active":"2023-11-28T16:58:09.374379+0000","last_became_peered":"2023-11-28T16:58:09.374379+0000","last_unstale":"2023-11-28T16:58:10.367294+0000","last_undegraded":"2023-11-28T16:58:10.367294+0000","last_fullsized":"2023-11-28T16:58:10.367294+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:47.534548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376038+0000","last_change":"2023-11-28T16:57:57.291393+0000","last_active":"2023-11-28T16:58:10.376038+0000","last_peered":"2023-11-28T16:58:10.376038+0000","last_clean":"2023-11-28T16:58:10.376038+0000","last_became_active":"2023-11-28T16:57:57.290974+0000","last_became_peered":"2023-11-28T16:57:57.290974+0000","last_unstale":"2023-11-28T16:58:10.376038+0000","last_undegraded":"2023-11-28T16:58:10.376038+0000","last_fullsized":"2023-11-28T16:58:10.376038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:47.176671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362341+0000","last_change":"2023-11-28T16:57:56.293494+0000","last_active":"2023-11-28T16:58:10.362341+0000","last_peered":"2023-11-28T16:58:10.362341+0000","last_clean":"2023-11-28T16:58:10.362341+0000","last_became_active":"2023-11-28T16:57:56.293071+0000","last_became_peered":"2023-11-28T16:57:56.293071+0000","last_unstale":"2023-11-28T16:58:10.362341+0000","last_undegraded":"2023-11-28T16:58:10.362341+0000","last_fullsized":"2023-11-28T16:58:10.362341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:42.043041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382622+0000","last_change":"2023-11-28T16:58:10.394814+0000","last_active":"2023-11-28T16:58:11.382622+0000","last_peered":"2023-11-28T16:58:11.382622+0000","last_clean":"2023-11-28T16:58:11.382622+0000","last_became_active":"2023-11-28T16:58:10.393783+0000","last_became_peered":"2023-11-28T16:58:10.393783+0000","last_unstale":"2023-11-28T16:58:11.382622+0000","last_undegraded":"2023-11-28T16:58:11.382622+0000","last_fullsized":"2023-11-28T16:58:11.382622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:39:22.473855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.387355+0000","last_change":"2023-11-28T16:58:09.377961+0000","last_active":"2023-11-28T16:58:10.387355+0000","last_peered":"2023-11-28T16:58:10.387355+0000","last_clean":"2023-11-28T16:58:10.387355+0000","last_became_active":"2023-11-28T16:58:09.377333+0000","last_became_peered":"2023-11-28T16:58:09.377333+0000","last_unstale":"2023-11-28T16:58:10.387355+0000","last_undegraded":"2023-11-28T16:58:10.387355+0000","last_fullsized":"2023-11-28T16:58:10.387355+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362025+0000","last_change":"2023-11-28T16:57:57.293148+0000","last_active":"2023-11-28T16:58:10.362025+0000","last_peered":"2023-11-28T16:58:10.362025+0000","last_clean":"2023-11-28T16:58:10.362025+0000","last_became_active":"2023-11-28T16:57:57.292674+0000","last_became_peered":"2023-11-28T16:57:57.292674+0000","last_unstale":"2023-11-28T16:58:10.362025+0000","last_undegraded":"2023-11-28T16:58:10.362025+0000","last_fullsized":"2023-11-28T16:58:10.362025+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:08.082212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367621+0000","last_change":"2023-11-28T16:57:56.289047+0000","last_active":"2023-11-28T16:58:10.367621+0000","last_peered":"2023-11-28T16:58:10.367621+0000","last_clean":"2023-11-28T16:58:10.367621+0000","last_became_active":"2023-11-28T16:57:56.288333+0000","last_became_peered":"2023-11-28T16:57:56.288333+0000","last_unstale":"2023-11-28T16:58:10.367621+0000","last_undegraded":"2023-11-28T16:58:10.367621+0000","last_fullsized":"2023-11-28T16:58:10.367621+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:55.749727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.380546+0000","last_change":"2023-11-28T16:58:10.393234+0000","last_active":"2023-11-28T16:58:11.380546+0000","last_peered":"2023-11-28T16:58:11.380546+0000","last_clean":"2023-11-28T16:58:11.380546+0000","last_became_active":"2023-11-28T16:58:10.392969+0000","last_became_peered":"2023-11-28T16:58:10.392969+0000","last_unstale":"2023-11-28T16:58:11.380546+0000","last_undegraded":"2023-11-28T16:58:11.380546+0000","last_fullsized":"2023-11-28T16:58:11.380546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:49.906373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383579+0000","last_change":"2023-11-28T16:58:09.369628+0000","last_active":"2023-11-28T16:58:10.383579+0000","last_peered":"2023-11-28T16:58:10.383579+0000","last_clean":"2023-11-28T16:58:10.383579+0000","last_became_active":"2023-11-28T16:58:09.369340+0000","last_became_peered":"2023-11-28T16:58:09.369340+0000","last_unstale":"2023-11-28T16:58:10.383579+0000","last_undegraded":"2023-11-28T16:58:10.383579+0000","last_fullsized":"2023-11-28T16:58:10.383579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:26.069648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380530+0000","last_change":"2023-11-28T16:57:57.306068+0000","last_active":"2023-11-28T16:58:10.380530+0000","last_peered":"2023-11-28T16:58:10.380530+0000","last_clean":"2023-11-28T16:58:10.380530+0000","last_became_active":"2023-11-28T16:57:57.305881+0000","last_became_peered":"2023-11-28T16:57:57.305881+0000","last_unstale":"2023-11-28T16:58:10.380530+0000","last_undegraded":"2023-11-28T16:58:10.380530+0000","last_fullsized":"2023-11-28T16:58:10.380530+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:39.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374670+0000","last_change":"2023-11-28T16:57:56.297847+0000","last_active":"2023-11-28T16:58:10.374670+0000","last_peered":"2023-11-28T16:58:10.374670+0000","last_clean":"2023-11-28T16:58:10.374670+0000","last_became_active":"2023-11-28T16:57:56.297578+0000","last_became_peered":"2023-11-28T16:57:56.297578+0000","last_unstale":"2023-11-28T16:58:10.374670+0000","last_undegraded":"2023-11-28T16:58:10.374670+0000","last_fullsized":"2023-11-28T16:58:10.374670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.329569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851647+0000","last_change":"2023-11-28T16:58:10.391908+0000","last_active":"2023-11-28T16:58:11.851647+0000","last_peered":"2023-11-28T16:58:11.851647+0000","last_clean":"2023-11-28T16:58:11.851647+0000","last_became_active":"2023-11-28T16:58:10.391594+0000","last_became_peered":"2023-11-28T16:58:10.391594+0000","last_unstale":"2023-11-28T16:58:11.851647+0000","last_undegraded":"2023-11-28T16:58:11.851647+0000","last_fullsized":"2023-11-28T16:58:11.851647+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:50.232526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.386099+0000","last_change":"2023-11-28T16:58:09.362708+0000","last_active":"2023-11-28T16:58:10.386099+0000","last_peered":"2023-11-28T16:58:10.386099+0000","last_clean":"2023-11-28T16:58:10.386099+0000","last_became_active":"2023-11-28T16:58:09.362441+0000","last_became_peered":"2023-11-28T16:58:09.362441+0000","last_unstale":"2023-11-28T16:58:10.386099+0000","last_undegraded":"2023-11-28T16:58:10.386099+0000","last_fullsized":"2023-11-28T16:58:10.386099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360728+0000","last_change":"2023-11-28T16:57:57.295241+0000","last_active":"2023-11-28T16:58:10.360728+0000","last_peered":"2023-11-28T16:58:10.360728+0000","last_clean":"2023-11-28T16:58:10.360728+0000","last_became_active":"2023-11-28T16:57:57.295059+0000","last_became_peered":"2023-11-28T16:57:57.295059+0000","last_unstale":"2023-11-28T16:58:10.360728+0000","last_undegraded":"2023-11-28T16:58:10.360728+0000","last_fullsized":"2023-11-28T16:58:10.360728+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.176559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.378674+0000","last_change":"2023-11-28T16:57:56.292527+0000","last_active":"2023-11-28T16:58:10.378674+0000","last_peered":"2023-11-28T16:58:10.378674+0000","last_clean":"2023-11-28T16:58:10.378674+0000","last_became_active":"2023-11-28T16:57:56.292280+0000","last_became_peered":"2023-11-28T16:57:56.292280+0000","last_unstale":"2023-11-28T16:58:10.378674+0000","last_undegraded":"2023-11-28T16:58:10.378674+0000","last_fullsized":"2023-11-28T16:58:10.378674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:36.146016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.381939+0000","last_change":"2023-11-28T16:58:10.386882+0000","last_active":"2023-11-28T16:58:11.381939+0000","last_peered":"2023-11-28T16:58:11.381939+0000","last_clean":"2023-11-28T16:58:11.381939+0000","last_became_active":"2023-11-28T16:58:10.386608+0000","last_became_peered":"2023-11-28T16:58:10.386608+0000","last_unstale":"2023-11-28T16:58:11.381939+0000","last_undegraded":"2023-11-28T16:58:11.381939+0000","last_fullsized":"2023-11-28T16:58:11.381939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:03.570619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382568+0000","last_change":"2023-11-28T16:58:09.370461+0000","last_active":"2023-11-28T16:58:10.382568+0000","last_peered":"2023-11-28T16:58:10.382568+0000","last_clean":"2023-11-28T16:58:10.382568+0000","last_became_active":"2023-11-28T16:58:09.370211+0000","last_became_peered":"2023-11-28T16:58:09.370211+0000","last_unstale":"2023-11-28T16:58:10.382568+0000","last_undegraded":"2023-11-28T16:58:10.382568+0000","last_fullsized":"2023-11-28T16:58:10.382568+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:39.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367221+0000","last_change":"2023-11-28T16:57:57.292399+0000","last_active":"2023-11-28T16:58:10.367221+0000","last_peered":"2023-11-28T16:58:10.367221+0000","last_clean":"2023-11-28T16:58:10.367221+0000","last_became_active":"2023-11-28T16:57:57.291492+0000","last_became_peered":"2023-11-28T16:57:57.291492+0000","last_unstale":"2023-11-28T16:58:10.367221+0000","last_undegraded":"2023-11-28T16:58:10.367221+0000","last_fullsized":"2023-11-28T16:58:10.367221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:57.438521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383820+0000","last_change":"2023-11-28T16:57:56.288401+0000","last_active":"2023-11-28T16:58:10.383820+0000","last_peered":"2023-11-28T16:58:10.383820+0000","last_clean":"2023-11-28T16:58:10.383820+0000","last_became_active":"2023-11-28T16:57:56.288046+0000","last_became_peered":"2023-11-28T16:57:56.288046+0000","last_unstale":"2023-11-28T16:58:10.383820+0000","last_undegraded":"2023-11-28T16:58:10.383820+0000","last_fullsized":"2023-11-28T16:58:10.383820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:23.260917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384273+0000","last_change":"2023-11-28T16:58:10.396994+0000","last_active":"2023-11-28T16:58:11.384273+0000","last_peered":"2023-11-28T16:58:11.384273+0000","last_clean":"2023-11-28T16:58:11.384273+0000","last_became_active":"2023-11-28T16:58:10.396691+0000","last_became_peered":"2023-11-28T16:58:10.396691+0000","last_unstale":"2023-11-28T16:58:11.384273+0000","last_undegraded":"2023-11-28T16:58:11.384273+0000","last_fullsized":"2023-11-28T16:58:11.384273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:47.102277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.378404+0000","last_change":"2023-11-28T16:58:09.381709+0000","last_active":"2023-11-28T16:58:10.378404+0000","last_peered":"2023-11-28T16:58:10.378404+0000","last_clean":"2023-11-28T16:58:10.378404+0000","last_became_active":"2023-11-28T16:58:09.381442+0000","last_became_peered":"2023-11-28T16:58:09.381442+0000","last_unstale":"2023-11-28T16:58:10.378404+0000","last_undegraded":"2023-11-28T16:58:10.378404+0000","last_fullsized":"2023-11-28T16:58:10.378404+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:03.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360704+0000","last_change":"2023-11-28T16:57:57.300273+0000","last_active":"2023-11-28T16:58:10.360704+0000","last_peered":"2023-11-28T16:58:10.360704+0000","last_clean":"2023-11-28T16:58:10.360704+0000","last_became_active":"2023-11-28T16:57:57.300005+0000","last_became_peered":"2023-11-28T16:57:57.300005+0000","last_unstale":"2023-11-28T16:58:10.360704+0000","last_undegraded":"2023-11-28T16:58:10.360704+0000","last_fullsized":"2023-11-28T16:58:10.360704+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360636+0000","last_change":"2023-11-28T16:57:56.297211+0000","last_active":"2023-11-28T16:58:10.360636+0000","last_peered":"2023-11-28T16:58:10.360636+0000","last_clean":"2023-11-28T16:58:10.360636+0000","last_became_active":"2023-11-28T16:57:56.296321+0000","last_became_peered":"2023-11-28T16:57:56.296321+0000","last_unstale":"2023-11-28T16:58:10.360636+0000","last_undegraded":"2023-11-28T16:58:10.360636+0000","last_fullsized":"2023-11-28T16:58:10.360636+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853066+0000","last_change":"2023-11-28T16:58:10.386695+0000","last_active":"2023-11-28T16:58:11.853066+0000","last_peered":"2023-11-28T16:58:11.853066+0000","last_clean":"2023-11-28T16:58:11.853066+0000","last_became_active":"2023-11-28T16:58:10.386245+0000","last_became_peered":"2023-11-28T16:58:10.386245+0000","last_unstale":"2023-11-28T16:58:11.853066+0000","last_undegraded":"2023-11-28T16:58:11.853066+0000","last_fullsized":"2023-11-28T16:58:11.853066+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:04.924665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.396055+0000","last_change":"2023-11-28T16:58:09.372355+0000","last_active":"2023-11-28T16:58:10.396055+0000","last_peered":"2023-11-28T16:58:10.396055+0000","last_clean":"2023-11-28T16:58:10.396055+0000","last_became_active":"2023-11-28T16:58:09.372007+0000","last_became_peered":"2023-11-28T16:58:09.372007+0000","last_unstale":"2023-11-28T16:58:10.396055+0000","last_undegraded":"2023-11-28T16:58:10.396055+0000","last_fullsized":"2023-11-28T16:58:10.396055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:17.088568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361689+0000","last_change":"2023-11-28T16:57:57.294684+0000","last_active":"2023-11-28T16:58:10.361689+0000","last_peered":"2023-11-28T16:58:10.361689+0000","last_clean":"2023-11-28T16:58:10.361689+0000","last_became_active":"2023-11-28T16:57:57.294339+0000","last_became_peered":"2023-11-28T16:57:57.294339+0000","last_unstale":"2023-11-28T16:58:10.361689+0000","last_undegraded":"2023-11-28T16:58:10.361689+0000","last_fullsized":"2023-11-28T16:58:10.361689+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:19.079746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375285+0000","last_change":"2023-11-28T16:57:56.302265+0000","last_active":"2023-11-28T16:58:10.375285+0000","last_peered":"2023-11-28T16:58:10.375285+0000","last_clean":"2023-11-28T16:58:10.375285+0000","last_became_active":"2023-11-28T16:57:56.301960+0000","last_became_peered":"2023-11-28T16:57:56.301960+0000","last_unstale":"2023-11-28T16:58:10.375285+0000","last_undegraded":"2023-11-28T16:58:10.375285+0000","last_fullsized":"2023-11-28T16:58:10.375285+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:36.131374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854125+0000","last_change":"2023-11-28T16:58:10.395955+0000","last_active":"2023-11-28T16:58:11.854125+0000","last_peered":"2023-11-28T16:58:11.854125+0000","last_clean":"2023-11-28T16:58:11.854125+0000","last_became_active":"2023-11-28T16:58:10.395688+0000","last_became_peered":"2023-11-28T16:58:10.395688+0000","last_unstale":"2023-11-28T16:58:11.854125+0000","last_undegraded":"2023-11-28T16:58:11.854125+0000","last_fullsized":"2023-11-28T16:58:11.854125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:48.470091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.361390+0000","last_change":"2023-11-28T16:58:09.358618+0000","last_active":"2023-11-28T16:58:10.361390+0000","last_peered":"2023-11-28T16:58:10.361390+0000","last_clean":"2023-11-28T16:58:10.361390+0000","last_became_active":"2023-11-28T16:58:09.358326+0000","last_became_peered":"2023-11-28T16:58:09.358326+0000","last_unstale":"2023-11-28T16:58:10.361390+0000","last_undegraded":"2023-11-28T16:58:10.361390+0000","last_fullsized":"2023-11-28T16:58:10.361390+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:48.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381303+0000","last_change":"2023-11-28T16:57:57.296609+0000","last_active":"2023-11-28T16:58:10.381303+0000","last_peered":"2023-11-28T16:58:10.381303+0000","last_clean":"2023-11-28T16:58:10.381303+0000","last_became_active":"2023-11-28T16:57:57.296304+0000","last_became_peered":"2023-11-28T16:57:57.296304+0000","last_unstale":"2023-11-28T16:58:10.381303+0000","last_undegraded":"2023-11-28T16:58:10.381303+0000","last_fullsized":"2023-11-28T16:58:10.381303+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:27.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.369094+0000","last_change":"2023-11-28T16:57:56.296905+0000","last_active":"2023-11-28T16:58:10.369094+0000","last_peered":"2023-11-28T16:58:10.369094+0000","last_clean":"2023-11-28T16:58:10.369094+0000","last_became_active":"2023-11-28T16:57:56.295819+0000","last_became_peered":"2023-11-28T16:57:56.295819+0000","last_unstale":"2023-11-28T16:58:10.369094+0000","last_undegraded":"2023-11-28T16:58:10.369094+0000","last_fullsized":"2023-11-28T16:58:10.369094+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:47.379153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.855362+0000","last_change":"2023-11-28T16:58:10.380247+0000","last_active":"2023-11-28T16:58:11.855362+0000","last_peered":"2023-11-28T16:58:11.855362+0000","last_clean":"2023-11-28T16:58:11.855362+0000","last_became_active":"2023-11-28T16:58:10.379952+0000","last_became_peered":"2023-11-28T16:58:10.379952+0000","last_unstale":"2023-11-28T16:58:11.855362+0000","last_undegraded":"2023-11-28T16:58:11.855362+0000","last_fullsized":"2023-11-28T16:58:11.855362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:27.075972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.404736+0000","last_change":"2023-11-28T16:58:09.375035+0000","last_active":"2023-11-28T16:58:10.404736+0000","last_peered":"2023-11-28T16:58:10.404736+0000","last_clean":"2023-11-28T16:58:10.404736+0000","last_became_active":"2023-11-28T16:58:09.374689+0000","last_became_peered":"2023-11-28T16:58:09.374689+0000","last_unstale":"2023-11-28T16:58:10.404736+0000","last_undegraded":"2023-11-28T16:58:10.404736+0000","last_fullsized":"2023-11-28T16:58:10.404736+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:26.409754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374703+0000","last_change":"2023-11-28T16:57:57.297238+0000","last_active":"2023-11-28T16:58:10.374703+0000","last_peered":"2023-11-28T16:58:10.374703+0000","last_clean":"2023-11-28T16:58:10.374703+0000","last_became_active":"2023-11-28T16:57:57.296895+0000","last_became_peered":"2023-11-28T16:57:57.296895+0000","last_unstale":"2023-11-28T16:58:10.374703+0000","last_undegraded":"2023-11-28T16:58:10.374703+0000","last_fullsized":"2023-11-28T16:58:10.374703+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:47.232224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.390145+0000","last_change":"2023-11-28T16:57:56.292453+0000","last_active":"2023-11-28T16:58:10.390145+0000","last_peered":"2023-11-28T16:58:10.390145+0000","last_clean":"2023-11-28T16:58:10.390145+0000","last_became_active":"2023-11-28T16:57:56.292147+0000","last_became_peered":"2023-11-28T16:57:56.292147+0000","last_unstale":"2023-11-28T16:58:10.390145+0000","last_undegraded":"2023-11-28T16:58:10.390145+0000","last_fullsized":"2023-11-28T16:58:10.390145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:02.633416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382971+0000","last_change":"2023-11-28T16:58:10.384350+0000","last_active":"2023-11-28T16:58:11.382971+0000","last_peered":"2023-11-28T16:58:11.382971+0000","last_clean":"2023-11-28T16:58:11.382971+0000","last_became_active":"2023-11-28T16:58:10.383738+0000","last_became_peered":"2023-11-28T16:58:10.383738+0000","last_unstale":"2023-11-28T16:58:11.382971+0000","last_undegraded":"2023-11-28T16:58:11.382971+0000","last_fullsized":"2023-11-28T16:58:11.382971+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:03.353470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.401514+0000","last_change":"2023-11-28T16:58:09.374106+0000","last_active":"2023-11-28T16:58:10.401514+0000","last_peered":"2023-11-28T16:58:10.401514+0000","last_clean":"2023-11-28T16:58:10.401514+0000","last_became_active":"2023-11-28T16:58:09.373822+0000","last_became_peered":"2023-11-28T16:58:09.373822+0000","last_unstale":"2023-11-28T16:58:10.401514+0000","last_undegraded":"2023-11-28T16:58:10.401514+0000","last_fullsized":"2023-11-28T16:58:10.401514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:47.137583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.362138+0000","last_change":"2023-11-28T16:57:57.292951+0000","last_active":"2023-11-28T16:58:10.362138+0000","last_peered":"2023-11-28T16:58:10.362138+0000","last_clean":"2023-11-28T16:58:10.362138+0000","last_became_active":"2023-11-28T16:57:57.292254+0000","last_became_peered":"2023-11-28T16:57:57.292254+0000","last_unstale":"2023-11-28T16:58:10.362138+0000","last_undegraded":"2023-11-28T16:58:10.362138+0000","last_fullsized":"2023-11-28T16:58:10.362138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:07.921821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367788+0000","last_change":"2023-11-28T16:57:56.301392+0000","last_active":"2023-11-28T16:58:10.367788+0000","last_peered":"2023-11-28T16:58:10.367788+0000","last_clean":"2023-11-28T16:58:10.367788+0000","last_became_active":"2023-11-28T16:57:56.300939+0000","last_became_peered":"2023-11-28T16:57:56.300939+0000","last_unstale":"2023-11-28T16:58:10.367788+0000","last_undegraded":"2023-11-28T16:58:10.367788+0000","last_fullsized":"2023-11-28T16:58:10.367788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:05.783524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852031+0000","last_change":"2023-11-28T16:58:10.393025+0000","last_active":"2023-11-28T16:58:11.852031+0000","last_peered":"2023-11-28T16:58:11.852031+0000","last_clean":"2023-11-28T16:58:11.852031+0000","last_became_active":"2023-11-28T16:58:10.392671+0000","last_became_peered":"2023-11-28T16:58:10.392671+0000","last_unstale":"2023-11-28T16:58:11.852031+0000","last_undegraded":"2023-11-28T16:58:11.852031+0000","last_fullsized":"2023-11-28T16:58:11.852031+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:49:40.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.383455+0000","last_change":"2023-11-28T16:58:09.381243+0000","last_active":"2023-11-28T16:58:10.383455+0000","last_peered":"2023-11-28T16:58:10.383455+0000","last_clean":"2023-11-28T16:58:10.383455+0000","last_became_active":"2023-11-28T16:58:09.381035+0000","last_became_peered":"2023-11-28T16:58:09.381035+0000","last_unstale":"2023-11-28T16:58:10.383455+0000","last_undegraded":"2023-11-28T16:58:10.383455+0000","last_fullsized":"2023-11-28T16:58:10.383455+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:36.804004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380613+0000","last_change":"2023-11-28T16:57:57.304252+0000","last_active":"2023-11-28T16:58:10.380613+0000","last_peered":"2023-11-28T16:58:10.380613+0000","last_clean":"2023-11-28T16:58:10.380613+0000","last_became_active":"2023-11-28T16:57:57.303963+0000","last_became_peered":"2023-11-28T16:57:57.303963+0000","last_unstale":"2023-11-28T16:58:10.380613+0000","last_undegraded":"2023-11-28T16:58:10.380613+0000","last_fullsized":"2023-11-28T16:58:10.380613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:08.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374816+0000","last_change":"2023-11-28T16:57:56.291678+0000","last_active":"2023-11-28T16:58:10.374816+0000","last_peered":"2023-11-28T16:58:10.374816+0000","last_clean":"2023-11-28T16:58:10.374816+0000","last_became_active":"2023-11-28T16:57:56.289787+0000","last_became_peered":"2023-11-28T16:57:56.289787+0000","last_unstale":"2023-11-28T16:58:10.374816+0000","last_undegraded":"2023-11-28T16:58:10.374816+0000","last_fullsized":"2023-11-28T16:58:10.374816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:08.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852052+0000","last_change":"2023-11-28T16:58:10.395002+0000","last_active":"2023-11-28T16:58:11.852052+0000","last_peered":"2023-11-28T16:58:11.852052+0000","last_clean":"2023-11-28T16:58:11.852052+0000","last_became_active":"2023-11-28T16:58:10.394684+0000","last_became_peered":"2023-11-28T16:58:10.394684+0000","last_unstale":"2023-11-28T16:58:11.852052+0000","last_undegraded":"2023-11-28T16:58:11.852052+0000","last_fullsized":"2023-11-28T16:58:11.852052+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:06.026494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366266+0000","last_change":"2023-11-28T16:58:09.376563+0000","last_active":"2023-11-28T16:58:10.366266+0000","last_peered":"2023-11-28T16:58:10.366266+0000","last_clean":"2023-11-28T16:58:10.366266+0000","last_became_active":"2023-11-28T16:58:09.376234+0000","last_became_peered":"2023-11-28T16:58:09.376234+0000","last_unstale":"2023-11-28T16:58:10.366266+0000","last_undegraded":"2023-11-28T16:58:10.366266+0000","last_fullsized":"2023-11-28T16:58:10.366266+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:26.069648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367089+0000","last_change":"2023-11-28T16:57:57.294132+0000","last_active":"2023-11-28T16:58:10.367089+0000","last_peered":"2023-11-28T16:58:10.367089+0000","last_clean":"2023-11-28T16:58:10.367089+0000","last_became_active":"2023-11-28T16:57:57.293808+0000","last_became_peered":"2023-11-28T16:57:57.293808+0000","last_unstale":"2023-11-28T16:58:10.367089+0000","last_undegraded":"2023-11-28T16:58:10.367089+0000","last_fullsized":"2023-11-28T16:58:10.367089+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:05.016142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.371167+0000","last_change":"2023-11-28T16:57:56.299832+0000","last_active":"2023-11-28T16:58:10.371167+0000","last_peered":"2023-11-28T16:58:10.371167+0000","last_clean":"2023-11-28T16:58:10.371167+0000","last_became_active":"2023-11-28T16:57:56.299505+0000","last_became_peered":"2023-11-28T16:57:56.299505+0000","last_unstale":"2023-11-28T16:58:10.371167+0000","last_undegraded":"2023-11-28T16:58:10.371167+0000","last_fullsized":"2023-11-28T16:58:10.371167+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:26.104747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.851977+0000","last_change":"2023-11-28T16:58:10.387360+0000","last_active":"2023-11-28T16:58:11.851977+0000","last_peered":"2023-11-28T16:58:11.851977+0000","last_clean":"2023-11-28T16:58:11.851977+0000","last_became_active":"2023-11-28T16:58:10.386921+0000","last_became_peered":"2023-11-28T16:58:10.386921+0000","last_unstale":"2023-11-28T16:58:11.851977+0000","last_undegraded":"2023-11-28T16:58:11.851977+0000","last_fullsized":"2023-11-28T16:58:11.851977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:03.353470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.378592+0000","last_change":"2023-11-28T16:58:09.370643+0000","last_active":"2023-11-28T16:58:10.378592+0000","last_peered":"2023-11-28T16:58:10.378592+0000","last_clean":"2023-11-28T16:58:10.378592+0000","last_became_active":"2023-11-28T16:58:09.370427+0000","last_became_peered":"2023-11-28T16:58:09.370427+0000","last_unstale":"2023-11-28T16:58:10.378592+0000","last_undegraded":"2023-11-28T16:58:10.378592+0000","last_fullsized":"2023-11-28T16:58:10.378592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:51.248985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366913+0000","last_change":"2023-11-28T16:57:57.294705+0000","last_active":"2023-11-28T16:58:10.366913+0000","last_peered":"2023-11-28T16:58:10.366913+0000","last_clean":"2023-11-28T16:58:10.366913+0000","last_became_active":"2023-11-28T16:57:57.294386+0000","last_became_peered":"2023-11-28T16:57:57.294386+0000","last_unstale":"2023-11-28T16:58:10.366913+0000","last_undegraded":"2023-11-28T16:58:10.366913+0000","last_fullsized":"2023-11-28T16:58:10.366913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:58.282303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.380390+0000","last_change":"2023-11-28T16:57:56.303059+0000","last_active":"2023-11-28T16:58:10.380390+0000","last_peered":"2023-11-28T16:58:10.380390+0000","last_clean":"2023-11-28T16:58:10.380390+0000","last_became_active":"2023-11-28T16:57:56.302716+0000","last_became_peered":"2023-11-28T16:57:56.302716+0000","last_unstale":"2023-11-28T16:58:10.380390+0000","last_undegraded":"2023-11-28T16:58:10.380390+0000","last_fullsized":"2023-11-28T16:58:10.380390+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:52.334609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382717+0000","last_change":"2023-11-28T16:58:10.388757+0000","last_active":"2023-11-28T16:58:11.382717+0000","last_peered":"2023-11-28T16:58:11.382717+0000","last_clean":"2023-11-28T16:58:11.382717+0000","last_became_active":"2023-11-28T16:58:10.388431+0000","last_became_peered":"2023-11-28T16:58:10.388431+0000","last_unstale":"2023-11-28T16:58:11.382717+0000","last_undegraded":"2023-11-28T16:58:11.382717+0000","last_fullsized":"2023-11-28T16:58:11.382717+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:44.597699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382821+0000","last_change":"2023-11-28T16:58:09.379068+0000","last_active":"2023-11-28T16:58:10.382821+0000","last_peered":"2023-11-28T16:58:10.382821+0000","last_clean":"2023-11-28T16:58:10.382821+0000","last_became_active":"2023-11-28T16:58:09.378744+0000","last_became_peered":"2023-11-28T16:58:09.378744+0000","last_unstale":"2023-11-28T16:58:10.382821+0000","last_undegraded":"2023-11-28T16:58:10.382821+0000","last_fullsized":"2023-11-28T16:58:10.382821+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:49.565754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381570+0000","last_change":"2023-11-28T16:57:57.310134+0000","last_active":"2023-11-28T16:58:10.381570+0000","last_peered":"2023-11-28T16:58:10.381570+0000","last_clean":"2023-11-28T16:58:10.381570+0000","last_became_active":"2023-11-28T16:57:57.309858+0000","last_became_peered":"2023-11-28T16:57:57.309858+0000","last_unstale":"2023-11-28T16:58:10.381570+0000","last_undegraded":"2023-11-28T16:58:10.381570+0000","last_fullsized":"2023-11-28T16:58:10.381570+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:43.751157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376341+0000","last_change":"2023-11-28T16:57:56.289398+0000","last_active":"2023-11-28T16:58:10.376341+0000","last_peered":"2023-11-28T16:58:10.376341+0000","last_clean":"2023-11-28T16:58:10.376341+0000","last_became_active":"2023-11-28T16:57:56.289082+0000","last_became_peered":"2023-11-28T16:57:56.289082+0000","last_unstale":"2023-11-28T16:58:10.376341+0000","last_undegraded":"2023-11-28T16:58:10.376341+0000","last_fullsized":"2023-11-28T16:58:10.376341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:34.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.382710+0000","last_change":"2023-11-28T16:58:10.402989+0000","last_active":"2023-11-28T16:58:11.382710+0000","last_peered":"2023-11-28T16:58:11.382710+0000","last_clean":"2023-11-28T16:58:11.382710+0000","last_became_active":"2023-11-28T16:58:10.402710+0000","last_became_peered":"2023-11-28T16:58:10.402710+0000","last_unstale":"2023-11-28T16:58:11.382710+0000","last_undegraded":"2023-11-28T16:58:11.382710+0000","last_fullsized":"2023-11-28T16:58:11.382710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:50.432475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367540+0000","last_change":"2023-11-28T16:58:09.358558+0000","last_active":"2023-11-28T16:58:10.367540+0000","last_peered":"2023-11-28T16:58:10.367540+0000","last_clean":"2023-11-28T16:58:10.367540+0000","last_became_active":"2023-11-28T16:58:09.358275+0000","last_became_peered":"2023-11-28T16:58:09.358275+0000","last_unstale":"2023-11-28T16:58:10.367540+0000","last_undegraded":"2023-11-28T16:58:10.367540+0000","last_fullsized":"2023-11-28T16:58:10.367540+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:12.668536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381356+0000","last_change":"2023-11-28T16:57:57.302840+0000","last_active":"2023-11-28T16:58:10.381356+0000","last_peered":"2023-11-28T16:58:10.381356+0000","last_clean":"2023-11-28T16:58:10.381356+0000","last_became_active":"2023-11-28T16:57:57.302446+0000","last_became_peered":"2023-11-28T16:57:57.302446+0000","last_unstale":"2023-11-28T16:58:10.381356+0000","last_undegraded":"2023-11-28T16:58:10.381356+0000","last_fullsized":"2023-11-28T16:58:10.381356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:06.791283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.369176+0000","last_change":"2023-11-28T16:57:56.295304+0000","last_active":"2023-11-28T16:58:10.369176+0000","last_peered":"2023-11-28T16:58:10.369176+0000","last_clean":"2023-11-28T16:58:10.369176+0000","last_became_active":"2023-11-28T16:57:56.295041+0000","last_became_peered":"2023-11-28T16:57:56.295041+0000","last_unstale":"2023-11-28T16:58:10.369176+0000","last_undegraded":"2023-11-28T16:58:10.369176+0000","last_fullsized":"2023-11-28T16:58:10.369176+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.381153+0000","last_change":"2023-11-28T16:58:10.386165+0000","last_active":"2023-11-28T16:58:11.381153+0000","last_peered":"2023-11-28T16:58:11.381153+0000","last_clean":"2023-11-28T16:58:11.381153+0000","last_became_active":"2023-11-28T16:58:10.385435+0000","last_became_peered":"2023-11-28T16:58:10.385435+0000","last_unstale":"2023-11-28T16:58:11.381153+0000","last_undegraded":"2023-11-28T16:58:11.381153+0000","last_fullsized":"2023-11-28T16:58:11.381153+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:45.492789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.400784+0000","last_change":"2023-11-28T16:58:09.378133+0000","last_active":"2023-11-28T16:58:10.400784+0000","last_peered":"2023-11-28T16:58:10.400784+0000","last_clean":"2023-11-28T16:58:10.400784+0000","last_became_active":"2023-11-28T16:58:09.377825+0000","last_became_peered":"2023-11-28T16:58:09.377825+0000","last_unstale":"2023-11-28T16:58:10.400784+0000","last_undegraded":"2023-11-28T16:58:10.400784+0000","last_fullsized":"2023-11-28T16:58:10.400784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:21.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376141+0000","last_change":"2023-11-28T16:57:57.285348+0000","last_active":"2023-11-28T16:58:10.376141+0000","last_peered":"2023-11-28T16:58:10.376141+0000","last_clean":"2023-11-28T16:58:10.376141+0000","last_became_active":"2023-11-28T16:57:57.285004+0000","last_became_peered":"2023-11-28T16:57:57.285004+0000","last_unstale":"2023-11-28T16:58:10.376141+0000","last_undegraded":"2023-11-28T16:58:10.376141+0000","last_fullsized":"2023-11-28T16:58:10.376141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:01:56.757486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.385275+0000","last_change":"2023-11-28T16:57:56.291833+0000","last_active":"2023-11-28T16:58:10.385275+0000","last_peered":"2023-11-28T16:58:10.385275+0000","last_clean":"2023-11-28T16:58:10.385275+0000","last_became_active":"2023-11-28T16:57:56.291493+0000","last_became_peered":"2023-11-28T16:57:56.291493+0000","last_unstale":"2023-11-28T16:58:10.385275+0000","last_undegraded":"2023-11-28T16:58:10.385275+0000","last_fullsized":"2023-11-28T16:58:10.385275+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:36.485569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.384770+0000","last_change":"2023-11-28T16:58:10.396359+0000","last_active":"2023-11-28T16:58:11.384770+0000","last_peered":"2023-11-28T16:58:11.384770+0000","last_clean":"2023-11-28T16:58:11.384770+0000","last_became_active":"2023-11-28T16:58:10.396042+0000","last_became_peered":"2023-11-28T16:58:10.396042+0000","last_unstale":"2023-11-28T16:58:11.384770+0000","last_undegraded":"2023-11-28T16:58:11.384770+0000","last_fullsized":"2023-11-28T16:58:11.384770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:34.593915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381431+0000","last_change":"2023-11-28T16:58:09.366789+0000","last_active":"2023-11-28T16:58:10.381431+0000","last_peered":"2023-11-28T16:58:10.381431+0000","last_clean":"2023-11-28T16:58:10.381431+0000","last_became_active":"2023-11-28T16:58:09.366058+0000","last_became_peered":"2023-11-28T16:58:09.366058+0000","last_unstale":"2023-11-28T16:58:10.381431+0000","last_undegraded":"2023-11-28T16:58:10.381431+0000","last_fullsized":"2023-11-28T16:58:10.381431+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:05:46.294429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.368132+0000","last_change":"2023-11-28T16:57:57.294725+0000","last_active":"2023-11-28T16:58:10.368132+0000","last_peered":"2023-11-28T16:58:10.368132+0000","last_clean":"2023-11-28T16:58:10.368132+0000","last_became_active":"2023-11-28T16:57:57.294368+0000","last_became_peered":"2023-11-28T16:57:57.294368+0000","last_unstale":"2023-11-28T16:58:10.368132+0000","last_undegraded":"2023-11-28T16:58:10.368132+0000","last_fullsized":"2023-11-28T16:58:10.368132+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:35.462122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.381307+0000","last_change":"2023-11-28T16:57:56.295240+0000","last_active":"2023-11-28T16:58:10.381307+0000","last_peered":"2023-11-28T16:58:10.381307+0000","last_clean":"2023-11-28T16:58:10.381307+0000","last_became_active":"2023-11-28T16:57:56.292758+0000","last_became_peered":"2023-11-28T16:57:56.292758+0000","last_unstale":"2023-11-28T16:58:10.381307+0000","last_undegraded":"2023-11-28T16:58:10.381307+0000","last_fullsized":"2023-11-28T16:58:10.381307+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:56.548360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852489+0000","last_change":"2023-11-28T16:58:10.389308+0000","last_active":"2023-11-28T16:58:11.852489+0000","last_peered":"2023-11-28T16:58:11.852489+0000","last_clean":"2023-11-28T16:58:11.852489+0000","last_became_active":"2023-11-28T16:58:10.389085+0000","last_became_peered":"2023-11-28T16:58:10.389085+0000","last_unstale":"2023-11-28T16:58:11.852489+0000","last_undegraded":"2023-11-28T16:58:11.852489+0000","last_fullsized":"2023-11-28T16:58:11.852489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:11.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.367001+0000","last_change":"2023-11-28T16:58:09.356981+0000","last_active":"2023-11-28T16:58:10.367001+0000","last_peered":"2023-11-28T16:58:10.367001+0000","last_clean":"2023-11-28T16:58:10.367001+0000","last_became_active":"2023-11-28T16:58:09.356658+0000","last_became_peered":"2023-11-28T16:58:09.356658+0000","last_unstale":"2023-11-28T16:58:10.367001+0000","last_undegraded":"2023-11-28T16:58:10.367001+0000","last_fullsized":"2023-11-28T16:58:10.367001+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:21.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377841+0000","last_change":"2023-11-28T16:57:57.306973+0000","last_active":"2023-11-28T16:58:10.377841+0000","last_peered":"2023-11-28T16:58:10.377841+0000","last_clean":"2023-11-28T16:58:10.377841+0000","last_became_active":"2023-11-28T16:57:57.304696+0000","last_became_peered":"2023-11-28T16:57:57.304696+0000","last_unstale":"2023-11-28T16:58:10.377841+0000","last_undegraded":"2023-11-28T16:58:10.377841+0000","last_fullsized":"2023-11-28T16:58:10.377841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.596110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.374663+0000","last_change":"2023-11-28T16:57:56.293462+0000","last_active":"2023-11-28T16:58:10.374663+0000","last_peered":"2023-11-28T16:58:10.374663+0000","last_clean":"2023-11-28T16:58:10.374663+0000","last_became_active":"2023-11-28T16:57:56.293039+0000","last_became_peered":"2023-11-28T16:57:56.293039+0000","last_unstale":"2023-11-28T16:58:10.374663+0000","last_undegraded":"2023-11-28T16:58:10.374663+0000","last_fullsized":"2023-11-28T16:58:10.374663+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:40.083816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853550+0000","last_change":"2023-11-28T16:58:10.394259+0000","last_active":"2023-11-28T16:58:11.853550+0000","last_peered":"2023-11-28T16:58:11.853550+0000","last_clean":"2023-11-28T16:58:11.853550+0000","last_became_active":"2023-11-28T16:58:10.393928+0000","last_became_peered":"2023-11-28T16:58:10.393928+0000","last_unstale":"2023-11-28T16:58:11.853550+0000","last_undegraded":"2023-11-28T16:58:11.853550+0000","last_fullsized":"2023-11-28T16:58:11.853550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:48.143908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.375977+0000","last_change":"2023-11-28T16:58:09.375351+0000","last_active":"2023-11-28T16:58:10.375977+0000","last_peered":"2023-11-28T16:58:10.375977+0000","last_clean":"2023-11-28T16:58:10.375977+0000","last_became_active":"2023-11-28T16:58:09.375020+0000","last_became_peered":"2023-11-28T16:58:09.375020+0000","last_unstale":"2023-11-28T16:58:10.375977+0000","last_undegraded":"2023-11-28T16:58:10.375977+0000","last_fullsized":"2023-11-28T16:58:10.375977+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:18.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360812+0000","last_change":"2023-11-28T16:57:57.307851+0000","last_active":"2023-11-28T16:58:10.360812+0000","last_peered":"2023-11-28T16:58:10.360812+0000","last_clean":"2023-11-28T16:58:10.360812+0000","last_became_active":"2023-11-28T16:57:57.307208+0000","last_became_peered":"2023-11-28T16:57:57.307208+0000","last_unstale":"2023-11-28T16:58:10.360812+0000","last_undegraded":"2023-11-28T16:58:10.360812+0000","last_fullsized":"2023-11-28T16:58:10.360812+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:44.147984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.366917+0000","last_change":"2023-11-28T16:57:56.286826+0000","last_active":"2023-11-28T16:58:10.366917+0000","last_peered":"2023-11-28T16:58:10.366917+0000","last_clean":"2023-11-28T16:58:10.366917+0000","last_became_active":"2023-11-28T16:57:56.286506+0000","last_became_peered":"2023-11-28T16:57:56.286506+0000","last_unstale":"2023-11-28T16:58:10.366917+0000","last_undegraded":"2023-11-28T16:58:10.366917+0000","last_fullsized":"2023-11-28T16:58:10.366917+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:45:28.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.853505+0000","last_change":"2023-11-28T16:58:10.394202+0000","last_active":"2023-11-28T16:58:11.853505+0000","last_peered":"2023-11-28T16:58:11.853505+0000","last_clean":"2023-11-28T16:58:11.853505+0000","last_became_active":"2023-11-28T16:58:10.393945+0000","last_became_peered":"2023-11-28T16:58:10.393945+0000","last_unstale":"2023-11-28T16:58:11.853505+0000","last_undegraded":"2023-11-28T16:58:11.853505+0000","last_fullsized":"2023-11-28T16:58:11.853505+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:31.829663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.382648+0000","last_change":"2023-11-28T16:58:09.376587+0000","last_active":"2023-11-28T16:58:10.382648+0000","last_peered":"2023-11-28T16:58:10.382648+0000","last_clean":"2023-11-28T16:58:10.382648+0000","last_became_active":"2023-11-28T16:58:09.376044+0000","last_became_peered":"2023-11-28T16:58:09.376044+0000","last_unstale":"2023-11-28T16:58:10.382648+0000","last_undegraded":"2023-11-28T16:58:10.382648+0000","last_fullsized":"2023-11-28T16:58:10.382648+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:39.184932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.363991+0000","last_change":"2023-11-28T16:57:57.293525+0000","last_active":"2023-11-28T16:58:10.363991+0000","last_peered":"2023-11-28T16:58:10.363991+0000","last_clean":"2023-11-28T16:58:10.363991+0000","last_became_active":"2023-11-28T16:57:57.293155+0000","last_became_peered":"2023-11-28T16:57:57.293155+0000","last_unstale":"2023-11-28T16:58:10.363991+0000","last_undegraded":"2023-11-28T16:58:10.363991+0000","last_fullsized":"2023-11-28T16:58:10.363991+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:54.496874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.370486+0000","last_change":"2023-11-28T16:57:56.289797+0000","last_active":"2023-11-28T16:58:10.370486+0000","last_peered":"2023-11-28T16:58:10.370486+0000","last_clean":"2023-11-28T16:58:10.370486+0000","last_became_active":"2023-11-28T16:57:56.286507+0000","last_became_peered":"2023-11-28T16:57:56.286507+0000","last_unstale":"2023-11-28T16:58:10.370486+0000","last_undegraded":"2023-11-28T16:58:10.370486+0000","last_fullsized":"2023-11-28T16:58:10.370486+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:55.952116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.854351+0000","last_change":"2023-11-28T16:58:10.392372+0000","last_active":"2023-11-28T16:58:11.854351+0000","last_peered":"2023-11-28T16:58:11.854351+0000","last_clean":"2023-11-28T16:58:11.854351+0000","last_became_active":"2023-11-28T16:58:10.392077+0000","last_became_peered":"2023-11-28T16:58:10.392077+0000","last_unstale":"2023-11-28T16:58:11.854351+0000","last_undegraded":"2023-11-28T16:58:11.854351+0000","last_fullsized":"2023-11-28T16:58:11.854351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:50.217884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.370726+0000","last_change":"2023-11-28T16:58:09.366936+0000","last_active":"2023-11-28T16:58:10.370726+0000","last_peered":"2023-11-28T16:58:10.370726+0000","last_clean":"2023-11-28T16:58:10.370726+0000","last_became_active":"2023-11-28T16:58:09.366532+0000","last_became_peered":"2023-11-28T16:58:09.366532+0000","last_unstale":"2023-11-28T16:58:10.370726+0000","last_undegraded":"2023-11-28T16:58:10.370726+0000","last_fullsized":"2023-11-28T16:58:10.370726+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:34.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.377051+0000","last_change":"2023-11-28T16:57:57.295933+0000","last_active":"2023-11-28T16:58:10.377051+0000","last_peered":"2023-11-28T16:58:10.377051+0000","last_clean":"2023-11-28T16:58:10.377051+0000","last_became_active":"2023-11-28T16:57:57.295567+0000","last_became_peered":"2023-11-28T16:57:57.295567+0000","last_unstale":"2023-11-28T16:58:10.377051+0000","last_undegraded":"2023-11-28T16:58:10.377051+0000","last_fullsized":"2023-11-28T16:58:10.377051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:13.997222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.364189+0000","last_change":"2023-11-28T16:57:56.296292+0000","last_active":"2023-11-28T16:58:10.364189+0000","last_peered":"2023-11-28T16:58:10.364189+0000","last_clean":"2023-11-28T16:58:10.364189+0000","last_became_active":"2023-11-28T16:57:56.295958+0000","last_became_peered":"2023-11-28T16:57:56.295958+0000","last_unstale":"2023-11-28T16:58:10.364189+0000","last_undegraded":"2023-11-28T16:58:10.364189+0000","last_fullsized":"2023-11-28T16:58:10.364189+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.008383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T16:58:11.852404+0000","last_change":"2023-11-28T16:58:10.399888+0000","last_active":"2023-11-28T16:58:11.852404+0000","last_peered":"2023-11-28T16:58:11.852404+0000","last_clean":"2023-11-28T16:58:11.852404+0000","last_became_active":"2023-11-28T16:58:10.399310+0000","last_became_peered":"2023-11-28T16:58:10.399310+0000","last_unstale":"2023-11-28T16:58:11.852404+0000","last_undegraded":"2023-11-28T16:58:11.852404+0000","last_fullsized":"2023-11-28T16:58:11.852404+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:09.338249+0000","last_clean_scrub_stamp":"2023-11-28T16:58:09.338249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:30:57.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.394499+0000","last_change":"2023-11-28T16:58:09.373511+0000","last_active":"2023-11-28T16:58:10.394499+0000","last_peered":"2023-11-28T16:58:10.394499+0000","last_clean":"2023-11-28T16:58:10.394499+0000","last_became_active":"2023-11-28T16:58:09.373187+0000","last_became_peered":"2023-11-28T16:58:09.373187+0000","last_unstale":"2023-11-28T16:58:10.394499+0000","last_undegraded":"2023-11-28T16:58:10.394499+0000","last_fullsized":"2023-11-28T16:58:10.394499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:08.331924+0000","last_clean_scrub_stamp":"2023-11-28T16:58:08.331924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:00:55.823583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.364085+0000","last_change":"2023-11-28T16:57:57.308508+0000","last_active":"2023-11-28T16:58:10.364085+0000","last_peered":"2023-11-28T16:58:10.364085+0000","last_clean":"2023-11-28T16:58:10.364085+0000","last_became_active":"2023-11-28T16:57:57.308197+0000","last_became_peered":"2023-11-28T16:57:57.308197+0000","last_unstale":"2023-11-28T16:58:10.364085+0000","last_undegraded":"2023-11-28T16:58:10.364085+0000","last_fullsized":"2023-11-28T16:58:10.364085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:56.259498+0000","last_clean_scrub_stamp":"2023-11-28T16:57:56.259498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:41.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.376199+0000","last_change":"2023-11-28T16:57:56.296886+0000","last_active":"2023-11-28T16:58:10.376199+0000","last_peered":"2023-11-28T16:58:10.376199+0000","last_clean":"2023-11-28T16:58:10.376199+0000","last_became_active":"2023-11-28T16:57:56.296594+0000","last_became_peered":"2023-11-28T16:57:56.296594+0000","last_unstale":"2023-11-28T16:58:10.376199+0000","last_undegraded":"2023-11-28T16:58:10.376199+0000","last_fullsized":"2023-11-28T16:58:10.376199+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:57:55.251739+0000","last_clean_scrub_stamp":"2023-11-28T16:57:55.251739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:45:40.306391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T16:58:10.360961+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:10.360961+0000","last_peered":"2023-11-28T16:58:10.360961+0000","last_clean":"2023-11-28T16:58:10.360961+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:10.360961+0000","last_undegraded":"2023-11-28T16:58:10.360961+0000","last_fullsized":"2023-11-28T16:58:10.360961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1257472,"data_stored":871568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.93600000000000005}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.82099999999999995}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":1.1639999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.88}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.995}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.95099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":280516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.82299999999999995,"5min":1.474,"15min":1.474},"last":0.623},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.748}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.72799999999999998,"15min":0.753},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.70099999999999996}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.80600000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92300000000000004,"5min":1.071,"15min":1.071},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.59599999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.52900000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.341,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4019999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":281166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.52100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.628}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89200000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82599999999999996}]},{"osd":4,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72299999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77200000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96199999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":283601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.234,"15min":1.234},"last":0.73799999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.871,"5min":1.964,"15min":1.964},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.704,"15min":1.704},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88400000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.254,"15min":1.254},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88,"5min":1.548,"15min":1.548},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90800000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.218,"15min":1.218},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.593,"15min":1.593},"last":0.77500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":280592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.56100000000000005,"5min":0.745,"15min":0.745},"last":0.34699999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.874,"15min":0.874},"last":0.374},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.089,"5min":1.21,"15min":1.21},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91900000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0049999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0309999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.022,"5min":1.25,"15min":1.25},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.423,"15min":1.423},"last":0.64400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":282092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35699999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71499999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.65800000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78000000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.80200000000000005}]},{"osd":6,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92500000000000004,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":671744,"data_stored":282742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52700000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.56000000000000005,"5min":0.746,"15min":0.746},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.55600000000000005,"5min":1.04,"15min":1.04},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.625,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.98699999999999999,"5min":1.446,"15min":1.446},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.034,"5min":1.47,"15min":1.47},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1180000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0820000000000001,"5min":1.327,"15min":1.327},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94599999999999995,"5min":1.3,"15min":1.3},"last":0.626},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.167,"5min":1.526,"15min":1.526},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1459999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":874481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.44},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.56499999999999995}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.54700000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.627},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:58:19.470 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T16:58:19.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-28T16:58:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7dcdd8640 1 Processor -- start 2023-11-28T16:58:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7dcdd8640 1 -- start start 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7dcdd8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7d8156600 0x7fe7d814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7dcdd8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe7d814fb30 0x7fe7d80aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7dcdd8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d8152d90 con 0x7fe7d80a86d0 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7dcdd8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d814ffa0 con 0x7fe7d814fb30 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7dcdd8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d8152480 con 0x7fe7d8156600 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7d6d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe7d814fb30 0x7fe7d80aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7d6d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe7d814fb30 0x7fe7d80aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37186/0 (socket says 172.21.15.26:37186) 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/3293834331 learned_addr learned my addr 172.21.15.26:0/3293834331 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:19.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.653+0000 7fe7cffff640 1 --2- 172.21.15.26:0/3293834331 >> v2:172.21.15.79:3300/0 conn(0x7fe7d8156600 0x7fe7d814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/3293834331 >> v2:172.21.15.79:3300/0 conn(0x7fe7d8156600 msgr2=0x7fe7d814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d6d9d640 1 --2- 172.21.15.26:0/3293834331 >> v2:172.21.15.79:3300/0 conn(0x7fe7d8156600 0x7fe7d814f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/3293834331 >> v1:172.21.15.79:6789/0 conn(0x7fe7d80a86d0 legacy=0x7fe7d80a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/3293834331 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d80a9760 con 0x7fe7d814fb30 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d6d9d640 1 --2- 172.21.15.26:0/3293834331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d814fb30 0x7fe7d80aae40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009e50 tx=0x7fe7d001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa08e55ed40e19b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d5d9b640 1 -- 172.21.15.26:0/3293834331 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00a5780 con 0x7fe7d814fb30 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d5d9b640 1 -- 172.21.15.26:0/3293834331 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d00a58e0 con 0x7fe7d814fb30 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7d5d9b640 1 -- 172.21.15.26:0/3293834331 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00a5c70 con 0x7fe7d814fb30 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/3293834331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d814fb30 msgr2=0x7fe7d80aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/3293834331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d814fb30 0x7fe7d80aae40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009e50 tx=0x7fe7d001c9d0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/3293834331 shutdown_connections 2023-11-28T16:58:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/3293834331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d814fb30 0x7fe7d80aae40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/3293834331 >> v2:172.21.15.79:3300/0 conn(0x7fe7d8156600 0x7fe7d814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/3293834331 >> 172.21.15.26:0/3293834331 conn(0x7fe7d80c2a60 msgr2=0x7fe7d80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/3293834331 shutdown_connections 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.657+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/3293834331 wait complete. 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 Processor -- start 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 -- start start 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d80a86d0 0x7fe7d81ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d814fb30 0x7fe7d815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d8156600 0x7fe7d80700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8147de0 con 0x7fe7d8156600 2023-11-28T16:58:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8070d50 con 0x7fe7d814fb30 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7dcdd8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80c2470 con 0x7fe7d80a86d0 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d8156600 0x7fe7d80700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d8156600 0x7fe7d80700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37194/0 (socket says 172.21.15.26:37194) 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/479489733 learned_addr learned my addr 172.21.15.26:0/479489733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7cffff640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d814fb30 0x7fe7d815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d659c640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d80a86d0 0x7fe7d81ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d80a86d0 msgr2=0x7fe7d81ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d80a86d0 0x7fe7d81ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d814fb30 msgr2=0x7fe7d815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d814fb30 0x7fe7d815b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 -- 172.21.15.26:0/479489733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0009b30 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7d6d9d640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d8156600 0x7fe7d80700f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00195e0 tx=0x7fe7d0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.661+0000 7fe7ceffd640 1 -- 172.21.15.26:0/479489733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00b8670 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7ceffd640 1 -- 172.21.15.26:0/479489733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d00b87d0 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d8147840 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7ceffd640 1 -- 172.21.15.26:0/479489733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00b8b80 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d8147b00 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d80c2240 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7ceffd640 1 -- 172.21.15.26:0/479489733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe7d00b8ce0 con 0x7fe7d8156600 2023-11-28T16:58:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7ceffd640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7b80668d0 0x7fe7b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:19.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7ceffd640 1 -- 172.21.15.26:0/479489733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe7d011fe60 con 0x7fe7d8156600 2023-11-28T16:58:19.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.665+0000 7fe7d659c640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7b80668d0 0x7fe7b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:19.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.669+0000 7fe7d659c640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7b80668d0 0x7fe7b8068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8000f70 tx=0x7fe7c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:19.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.669+0000 7fe7ceffd640 1 -- 172.21.15.26:0/479489733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7d80c2240 con 0x7fe7d8156600 2023-11-28T16:58:19.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.885+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fe7d80c2240 con 0x7fe7d8156600 2023-11-28T16:58:19.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.889+0000 7fe7ceffd640 1 -- 172.21.15.26:0/479489733 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v18) v1 ==== 185+0+142 (secure 0 0 0) 0x7fe7d80c2240 con 0x7fe7d8156600 2023-11-28T16:58:19.892 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-11-28T16:58:19.892 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg== 2023-11-28T16:58:19.893 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-11-28T16:58:19.893 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-11-28T16:58:19.893 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-28T16:58:19.893 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.1 2023-11-28T16:58:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7b80668d0 msgr2=0x7fe7b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7b80668d0 0x7fe7b8068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8000f70 tx=0x7fe7c8009040 comp rx=0 tx=0).stop 2023-11-28T16:58:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d8156600 msgr2=0x7fe7d80700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d8156600 0x7fe7d80700f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00195e0 tx=0x7fe7d0019770 comp rx=0 tx=0).stop 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 shutdown_connections 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7d8156600 0x7fe7d80700f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d814fb30 0x7fe7d815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7b80668d0 0x7fe7b8068d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 --2- 172.21.15.26:0/479489733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d80a86d0 0x7fe7d81ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 >> 172.21.15.26:0/479489733 conn(0x7fe7d80c2a60 msgr2=0x7fe7d80ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 shutdown_connections 2023-11-28T16:58:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:19.893+0000 7fe7dcdd8640 1 -- 172.21.15.26:0/479489733 wait complete. 2023-11-28T16:58:19.915 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:19.915 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:19.925 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:19.926 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:19.979 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:20.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 Processor -- start 2023-11-28T16:58:20.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 -- start start 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53a8152ce0 0x7f53a806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53a806db80 0x7f53a80700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a80705e0 0x7f53a80c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a8159b10 con 0x7f53a806db80 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a806bea0 con 0x7f53a8152ce0 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53b0032640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8159550 con 0x7f53a80705e0 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53a806db80 0x7f53a80700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53a806db80 0x7f53a80700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37196/0 (socket says 172.21.15.26:37196) 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3964210723 learned_addr learned my addr 172.21.15.26:0/3964210723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:20.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ae5cf640 1 --2- 172.21.15.26:0/3964210723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a80705e0 0x7f53a80c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53addce640 1 --2- 172.21.15.26:0/3964210723 >> v2:172.21.15.79:3300/0 conn(0x7f53a8152ce0 0x7f53a806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3964210723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a80705e0 msgr2=0x7f53a80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 --2- 172.21.15.26:0/3964210723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a80705e0 0x7f53a80c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3964210723 >> v2:172.21.15.79:3300/0 conn(0x7f53a8152ce0 msgr2=0x7f53a806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 --2- 172.21.15.26:0/3964210723 >> v2:172.21.15.79:3300/0 conn(0x7f53a8152ce0 0x7f53a806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.121+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3964210723 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a8159830 con 0x7f53a806db80 2023-11-28T16:58:20.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53ad5cd640 1 --2- 172.21.15.26:0/3964210723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a806db80 0x7f53a80700a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f53a80c2800 tx=0x7f539801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239aaad3f0204374 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53acdcc640 1 -- 172.21.15.26:0/3964210723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980a7070 con 0x7f53a806db80 2023-11-28T16:58:20.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53acdcc640 1 -- 172.21.15.26:0/3964210723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980ab430 con 0x7f53a806db80 2023-11-28T16:58:20.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53acdcc640 1 -- 172.21.15.26:0/3964210723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980ab7c0 con 0x7f53a806db80 2023-11-28T16:58:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 -- 172.21.15.26:0/3964210723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a806db80 msgr2=0x7f53a80700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 --2- 172.21.15.26:0/3964210723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a806db80 0x7f53a80700a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f53a80c2800 tx=0x7f539801c470 comp rx=0 tx=0).stop 2023-11-28T16:58:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 -- 172.21.15.26:0/3964210723 shutdown_connections 2023-11-28T16:58:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 --2- 172.21.15.26:0/3964210723 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a80705e0 0x7f53a80c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 --2- 172.21.15.26:0/3964210723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a806db80 0x7f53a80700a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 --2- 172.21.15.26:0/3964210723 >> v2:172.21.15.79:3300/0 conn(0x7f53a8152ce0 0x7f53a806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 -- 172.21.15.26:0/3964210723 >> 172.21.15.26:0/3964210723 conn(0x7f53a80c2ad0 msgr2=0x7f53a80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 -- 172.21.15.26:0/3964210723 shutdown_connections 2023-11-28T16:58:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.125+0000 7f53b0032640 1 -- 172.21.15.26:0/3964210723 wait complete. 2023-11-28T16:58:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 Processor -- start 2023-11-28T16:58:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 -- start start 2023-11-28T16:58:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a806db80 0x7f53a81f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a80705e0 0x7f53a8157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a8152ce0 0x7f53a8144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80ac1b0 con 0x7f53a80705e0 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80c4a40 con 0x7f53a8152ce0 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80c3e30 con 0x7f53a806db80 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a80705e0 0x7f53a8157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a80705e0 0x7f53a8157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37198/0 (socket says 172.21.15.26:37198) 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3342725892 learned_addr learned my addr 172.21.15.26:0/3342725892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a806db80 msgr2=0x7f53a81f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a806db80 0x7f53a81f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a8152ce0 msgr2=0x7f53a8144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a8152ce0 0x7f53a8144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 -- 172.21.15.26:0/3342725892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980094d0 con 0x7f53a80705e0 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53ad5cd640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a80705e0 0x7f53a8157f10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f539801ab20 tx=0x7f5398019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f539e7fc640 1 -- 172.21.15.26:0/3342725892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980ba070 con 0x7f53a80705e0 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f539e7fc640 1 -- 172.21.15.26:0/3342725892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980abe40 con 0x7f53a80705e0 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f539e7fc640 1 -- 172.21.15.26:0/3342725892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980b4640 con 0x7f53a80705e0 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a80c4110 con 0x7f53a80705e0 2023-11-28T16:58:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.129+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a80c46d0 con 0x7f53a80705e0 2023-11-28T16:58:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.133+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a804e890 con 0x7f53a80705e0 2023-11-28T16:58:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.133+0000 7f539e7fc640 1 -- 172.21.15.26:0/3342725892 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53980b47a0 con 0x7f53a80705e0 2023-11-28T16:58:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.133+0000 7f539e7fc640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f538c0668d0 0x7f538c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.133+0000 7f539e7fc640 1 -- 172.21.15.26:0/3342725892 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f539811e0a0 con 0x7f53a80705e0 2023-11-28T16:58:20.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.133+0000 7f53addce640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f538c0668d0 0x7f538c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.133+0000 7f53addce640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f538c0668d0 0x7f538c068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006aa0 tx=0x7f53a4006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.137+0000 7f539e7fc640 1 -- 172.21.15.26:0/3342725892 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53980eb090 con 0x7f53a80705e0 2023-11-28T16:58:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.297+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53a81569b0 con 0x7f53a80705e0 2023-11-28T16:58:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f539e7fc640 1 -- 172.21.15.26:0/3342725892 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20208 (secure 0 0 0) 0x7f53a81569b0 con 0x7f53a80705e0 2023-11-28T16:58:20.303 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:20.303 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:11.370310+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f538c0668d0 msgr2=0x7f538c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f538c0668d0 0x7f538c068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006aa0 tx=0x7f53a4006a30 comp rx=0 tx=0).stop 2023-11-28T16:58:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a80705e0 msgr2=0x7f53a8157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a80705e0 0x7f53a8157f10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f539801ab20 tx=0x7f5398019210 comp rx=0 tx=0).stop 2023-11-28T16:58:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 shutdown_connections 2023-11-28T16:58:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a8152ce0 0x7f53a8144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53a80705e0 0x7f53a8157f10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f538c0668d0 0x7f538c068d90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 --2- 172.21.15.26:0/3342725892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53a806db80 0x7f53a81f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 >> 172.21.15.26:0/3342725892 conn(0x7f53a80c2ad0 msgr2=0x7f53a814a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 shutdown_connections 2023-11-28T16:58:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.301+0000 7f53b0032640 1 -- 172.21.15.26:0/3342725892 wait complete. 2023-11-28T16:58:20.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:54.472607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:55.658818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:58:07.830332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:58:08.744612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:20.325 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc3479640 1 Processor -- start 2023-11-28T16:58:20.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc3479640 1 -- start start 2023-11-28T16:58:20.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc3479640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 0x7fefbc06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc3479640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fefbc0c7f20 0x7fefbc06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc3479640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc06cf70 con 0x7fefbc151d80 2023-11-28T16:58:20.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc3479640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc152160 con 0x7fefbc0c7f20 2023-11-28T16:58:20.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc3479640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c6a30 con 0x7fefbc0c8430 2023-11-28T16:58:20.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc1215640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fefbc151d80 0x7fefbc0c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49220/0 (socket says 172.21.15.26:49220) 2023-11-28T16:58:20.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc1215640 1 -- 172.21.15.26:0/2393590605 learned_addr learned my addr 172.21.15.26:0/2393590605 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:20.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc0a14640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 0x7fefbc06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefc1a16640 1 --2- 172.21.15.26:0/2393590605 >> v2:172.21.15.79:3300/0 conn(0x7fefbc0c7f20 0x7fefbc06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815869697 0 0) 0x7fefbc06cf70 con 0x7fefbc151d80 2023-11-28T16:58:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa8003530 con 0x7fefbc151d80 2023-11-28T16:58:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2898530845 0 0) 0x7fefa8003530 con 0x7fefbc151d80 2023-11-28T16:58:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 msgr2=0x7fefbc06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 0x7fefbc06b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 >> v2:172.21.15.79:3300/0 conn(0x7fefbc0c7f20 msgr2=0x7fefbc06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 --2- 172.21.15.26:0/2393590605 >> v2:172.21.15.79:3300/0 conn(0x7fefbc0c7f20 0x7fefbc06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0c72d0 con 0x7fefbc151d80 2023-11-28T16:58:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fefb8001680 con 0x7fefbc151d80 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 >> v1:172.21.15.26:6789/0 conn(0x7fefbc151d80 legacy=0x7fefbc0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa8003980 0x7fefa8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.469+0000 7fefb3fff640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa80047d0 0x7fefa8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefb3fff640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 0x7fefa8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc152160 con 0x7fefa8003980 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c6a30 con 0x7fefa80047d0 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa800b9e0 con 0x7fefbc0c8430 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1215640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa8003980 0x7fefa8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1a16640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 0x7fefa8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc0a14640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa80047d0 0x7fefa8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1215640 1 -- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 msgr2=0x7fefa8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1215640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 0x7fefa8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1215640 1 -- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa80047d0 msgr2=0x7fefa8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1215640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa80047d0 0x7fefa8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1215640 1 -- 172.21.15.26:0/2393590605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8003530 con 0x7fefa8003980 2023-11-28T16:58:20.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1a16640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc0c8430 0x7fefa8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:20.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc0a14640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa80047d0 0x7fefa8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:20.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefc1215640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa8003980 0x7fefa8003da0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fefb800c140 tx=0x7fefb801cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4869b4a085fda8c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80058e0 con 0x7fefa8003980 2023-11-28T16:58:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb8005a60 con 0x7fefa8003980 2023-11-28T16:58:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.473+0000 7fefb3fff640 1 -- 172.21.15.26:0/2393590605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8005e10 con 0x7fefa8003980 2023-11-28T16:58:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- 172.21.15.26:0/2393590605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa8003980 msgr2=0x7fefa8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 --2- 172.21.15.26:0/2393590605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa8003980 0x7fefa8003da0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fefb800c140 tx=0x7fefb801cb50 comp rx=0 tx=0).stop 2023-11-28T16:58:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 -- 172.21.15.26:0/2393590605 reap_dead start 2023-11-28T16:58:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- 172.21.15.26:0/2393590605 shutdown_connections 2023-11-28T16:58:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- 172.21.15.26:0/2393590605 >> 172.21.15.26:0/2393590605 conn(0x7fefbc0abd00 msgr2=0x7fefbc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:20.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- 172.21.15.26:0/2393590605 shutdown_connections 2023-11-28T16:58:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- 172.21.15.26:0/2393590605 wait complete. 2023-11-28T16:58:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 Processor -- start 2023-11-28T16:58:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- start start 2023-11-28T16:58:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa8003980 0x7fefbc1edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc150e70 0x7fefbc0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefbc0afc00 0x7fefbc152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc14db50 con 0x7fefbc0afc00 2023-11-28T16:58:20.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc149030 con 0x7fefa8003980 2023-11-28T16:58:20.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc3479640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1ee040 con 0x7fefbc150e70 2023-11-28T16:58:20.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefbc0afc00 0x7fefbc152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefbc0afc00 0x7fefbc152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37224/0 (socket says 172.21.15.26:37224) 2023-11-28T16:58:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 -- 172.21.15.26:0/1123716023 learned_addr learned my addr 172.21.15.26:0/1123716023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc0a14640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc150e70 0x7fefbc0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1215640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa8003980 0x7fefbc1edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 -- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc150e70 msgr2=0x7fefbc0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc150e70 0x7fefbc0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 -- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa8003980 msgr2=0x7fefbc1edb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa8003980 0x7fefbc1edb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.477+0000 7fefc1a16640 1 -- 172.21.15.26:0/1123716023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc150030 con 0x7fefbc0afc00 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefc0a14640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc150e70 0x7fefbc0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefc1a16640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefbc0afc00 0x7fefbc152ed0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fefbc06aaa0 tx=0x7fefb4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefb1ffb640 1 -- 172.21.15.26:0/1123716023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400e050 con 0x7fefbc0afc00 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefb1ffb640 1 -- 172.21.15.26:0/1123716023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb400f040 con 0x7fefbc0afc00 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc150310 con 0x7fefbc0afc00 2023-11-28T16:58:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefb1ffb640 1 -- 172.21.15.26:0/1123716023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40039a0 con 0x7fefbc0afc00 2023-11-28T16:58:20.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc1526d0 con 0x7fefbc0afc00 2023-11-28T16:58:20.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc152530 con 0x7fefbc0afc00 2023-11-28T16:58:20.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefb1ffb640 1 -- 172.21.15.26:0/1123716023 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fefb4015440 con 0x7fefbc0afc00 2023-11-28T16:58:20.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefb1ffb640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefa0066900 0x7fefa0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.481+0000 7fefb1ffb640 1 -- 172.21.15.26:0/1123716023 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fefb4084c90 con 0x7fefbc0afc00 2023-11-28T16:58:20.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.485+0000 7fefc1215640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefa0066900 0x7fefa0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.485+0000 7fefc1215640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefa0066900 0x7fefa0068dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefb80aa000 tx=0x7fefb80019b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.485+0000 7fefb1ffb640 1 -- 172.21.15.26:0/1123716023 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefbc152530 con 0x7fefbc0afc00 2023-11-28T16:58:20.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefbc152530 con 0x7fefbc0afc00 2023-11-28T16:58:20.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefb1ffb640 1 -- 172.21.15.26:0/1123716023 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefbc152530 con 0x7fefbc0afc00 2023-11-28T16:58:20.647 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:20.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefa0066900 msgr2=0x7fefa0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefa0066900 0x7fefa0068dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefb80aa000 tx=0x7fefb80019b0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefbc0afc00 msgr2=0x7fefbc152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefbc0afc00 0x7fefbc152ed0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fefbc06aaa0 tx=0x7fefb4010590 comp rx=0 tx=0).stop 2023-11-28T16:58:20.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 shutdown_connections 2023-11-28T16:58:20.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefbc0afc00 0x7fefbc152ed0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fefa0066900 0x7fefa0068dc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefbc150e70 0x7fefbc0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 --2- 172.21.15.26:0/1123716023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa8003980 0x7fefbc1edb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 >> 172.21.15.26:0/1123716023 conn(0x7fefbc0abd00 msgr2=0x7fefbc0c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 shutdown_connections 2023-11-28T16:58:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.645+0000 7fefc3479640 1 -- 172.21.15.26:0/1123716023 wait complete. 2023-11-28T16:58:20.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:58:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 Processor -- start 2023-11-28T16:58:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 -- start start 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79f00c6220 0x7f79f0158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c13a0 0x7f79f00c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79f0151bf0 0x7f79f0152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f0158580 con 0x7f79f0151bf0 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f0157f50 con 0x7f79f00c6220 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79f4c17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00c1f60 con 0x7f79f00c13a0 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79f0151bf0 0x7f79f0152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79f0151bf0 0x7f79f0152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37228/0 (socket says 172.21.15.26:37228) 2023-11-28T16:58:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 -- 172.21.15.26:0/2002663932 learned_addr learned my addr 172.21.15.26:0/2002663932 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79e7fff640 1 --2- 172.21.15.26:0/2002663932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c13a0 0x7f79f00c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79ee59c640 1 --2- 172.21.15.26:0/2002663932 >> v2:172.21.15.79:3300/0 conn(0x7f79f00c6220 0x7f79f0158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 -- 172.21.15.26:0/2002663932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c13a0 msgr2=0x7f79f00c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 --2- 172.21.15.26:0/2002663932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c13a0 0x7f79f00c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 -- 172.21.15.26:0/2002663932 >> v2:172.21.15.79:3300/0 conn(0x7f79f00c6220 msgr2=0x7f79f0158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 --2- 172.21.15.26:0/2002663932 >> v2:172.21.15.79:3300/0 conn(0x7f79f00c6220 0x7f79f0158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.813+0000 7f79eed9d640 1 -- 172.21.15.26:0/2002663932 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00c2240 con 0x7f79f0151bf0 2023-11-28T16:58:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79eed9d640 1 --2- 172.21.15.26:0/2002663932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f0152060 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f79f006b500 tx=0x7f79e801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62aa042d857125b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79edd9b640 1 -- 172.21.15.26:0/2002663932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80a57c0 con 0x7f79f0151bf0 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79edd9b640 1 -- 172.21.15.26:0/2002663932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e80a5920 con 0x7f79f0151bf0 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79edd9b640 1 -- 172.21.15.26:0/2002663932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80a5cb0 con 0x7f79f0151bf0 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 -- 172.21.15.26:0/2002663932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 msgr2=0x7f79f0152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2002663932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f0152060 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f79f006b500 tx=0x7f79e801c9a0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 -- 172.21.15.26:0/2002663932 shutdown_connections 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2002663932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f0152060 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2002663932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c13a0 0x7f79f00c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2002663932 >> v2:172.21.15.79:3300/0 conn(0x7f79f00c6220 0x7f79f0158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 -- 172.21.15.26:0/2002663932 >> 172.21.15.26:0/2002663932 conn(0x7f79f006a5a0 msgr2=0x7f79f006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:20.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 -- 172.21.15.26:0/2002663932 shutdown_connections 2023-11-28T16:58:20.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.817+0000 7f79f4c17640 1 -- 172.21.15.26:0/2002663932 wait complete. 2023-11-28T16:58:20.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 Processor -- start 2023-11-28T16:58:20.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 -- start start 2023-11-28T16:58:20.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79f00c13a0 0x7f79f01f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c6220 0x7f79f006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f01477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00aae30 con 0x7f79f0151bf0 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f006d520 con 0x7f79f00c13a0 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00ab010 con 0x7f79f00c6220 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f01477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f01477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37230/0 (socket says 172.21.15.26:37230) 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 -- 172.21.15.26:0/2310738515 learned_addr learned my addr 172.21.15.26:0/2310738515 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79e7fff640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c6220 0x7f79f006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79ee59c640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79f00c13a0 0x7f79f01f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 -- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c6220 msgr2=0x7f79f006ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c6220 0x7f79f006ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 -- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79f00c13a0 msgr2=0x7f79f01f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79f00c13a0 0x7f79f01f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 -- 172.21.15.26:0/2310738515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e8009b30 con 0x7f79f0151bf0 2023-11-28T16:58:20.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79ee59c640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79f00c13a0 0x7f79f01f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:20.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79eed9d640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f01477c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f79e80af040 tx=0x7f79e8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79e6ffd640 1 -- 172.21.15.26:0/2310738515 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80b8670 con 0x7f79f0151bf0 2023-11-28T16:58:20.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79e6ffd640 1 -- 172.21.15.26:0/2310738515 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e80b87d0 con 0x7f79f0151bf0 2023-11-28T16:58:20.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f00ab2f0 con 0x7f79f0151bf0 2023-11-28T16:58:20.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.821+0000 7f79e6ffd640 1 -- 172.21.15.26:0/2310738515 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80b8b80 con 0x7f79f0151bf0 2023-11-28T16:58:20.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.825+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f00ab8b0 con 0x7f79f0151bf0 2023-11-28T16:58:20.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.825+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f01474e0 con 0x7f79f0151bf0 2023-11-28T16:58:20.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.825+0000 7f79e6ffd640 1 -- 172.21.15.26:0/2310738515 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f79e80b8ce0 con 0x7f79f0151bf0 2023-11-28T16:58:20.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.825+0000 7f79e6ffd640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79d0066900 0x7f79d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:20.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.825+0000 7f79e6ffd640 1 -- 172.21.15.26:0/2310738515 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f79e811fca0 con 0x7f79f0151bf0 2023-11-28T16:58:20.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.825+0000 7f79ee59c640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79d0066900 0x7f79d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:20.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.829+0000 7f79ee59c640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79d0066900 0x7f79d0068dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009bb0 tx=0x7f79e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:20.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.829+0000 7f79e6ffd640 1 -- 172.21.15.26:0/2310738515 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79f01474e0 con 0x7f79f0151bf0 2023-11-28T16:58:20.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.985+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79f01474e0 con 0x7f79f0151bf0 2023-11-28T16:58:20.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.985+0000 7f79e6ffd640 1 -- 172.21.15.26:0/2310738515 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79e80bc020 con 0x7f79f0151bf0 2023-11-28T16:58:20.989 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79d0066900 msgr2=0x7f79d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79d0066900 0x7f79d0068dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009bb0 tx=0x7f79e0008040 comp rx=0 tx=0).stop 2023-11-28T16:58:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 msgr2=0x7f79f01477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f01477c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f79e80af040 tx=0x7f79e8019740 comp rx=0 tx=0).stop 2023-11-28T16:58:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 shutdown_connections 2023-11-28T16:58:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f0151bf0 0x7f79f01477c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f79d0066900 0x7f79d0068dc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79f00c6220 0x7f79f006ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 --2- 172.21.15.26:0/2310738515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79f00c13a0 0x7f79f01f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 >> 172.21.15.26:0/2310738515 conn(0x7f79f006a5a0 msgr2=0x7f79f00c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 shutdown_connections 2023-11-28T16:58:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:20.989+0000 7f79f4c17640 1 -- 172.21.15.26:0/2310738515 wait complete. 2023-11-28T16:58:21.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:58:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.153+0000 7f2b9ce17640 1 Processor -- start 2023-11-28T16:58:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.153+0000 7f2b9ce17640 1 -- start start 2023-11-28T16:58:21.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.153+0000 7f2b9ce17640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2b981500d0 0x7f2b981567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.153+0000 7f2b9ce17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b980a7330 0x7f2b98153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.153+0000 7f2b9ce17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9806f760 con 0x7f2b9814fcf0 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.153+0000 7f2b9ce17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b98156d10 con 0x7f2b980a7330 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.153+0000 7f2b9ce17640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b980adf90 con 0x7f2b981500d0 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b96d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b980a7330 0x7f2b98153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b9659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2b9814fcf0 0x7f2b980c3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49236/0 (socket says 172.21.15.26:49236) 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b9659c640 1 -- 172.21.15.26:0/111969228 learned_addr learned my addr 172.21.15.26:0/111969228 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b8ffff640 1 --2- 172.21.15.26:0/111969228 >> v2:172.21.15.79:3300/0 conn(0x7f2b981500d0 0x7f2b981567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b95d9b640 1 -- 172.21.15.26:0/111969228 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925219790 0 0) 0x7f2b9806f760 con 0x7f2b9814fcf0 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b95d9b640 1 -- 172.21.15.26:0/111969228 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b84003530 con 0x7f2b9814fcf0 2023-11-28T16:58:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b96d9d640 1 -- 172.21.15.26:0/111969228 >> v2:172.21.15.79:3300/0 conn(0x7f2b981500d0 msgr2=0x7f2b981567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:21.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b96d9d640 1 --2- 172.21.15.26:0/111969228 >> v2:172.21.15.79:3300/0 conn(0x7f2b981500d0 0x7f2b981567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b96d9d640 1 -- 172.21.15.26:0/111969228 >> v1:172.21.15.26:6789/0 conn(0x7f2b9814fcf0 legacy=0x7f2b980c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b96d9d640 1 -- 172.21.15.26:0/111969228 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9806fc90 con 0x7f2b980a7330 2023-11-28T16:58:21.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b96d9d640 1 --2- 172.21.15.26:0/111969228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b980a7330 0x7f2b98153f00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2b9806f700 tx=0x7f2b9001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de803aacef1af1ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b95d9b640 1 -- 172.21.15.26:0/111969228 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900a5910 con 0x7f2b980a7330 2023-11-28T16:58:21.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b95d9b640 1 -- 172.21.15.26:0/111969228 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b900a5a70 con 0x7f2b980a7330 2023-11-28T16:58:21.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.157+0000 7f2b95d9b640 1 -- 172.21.15.26:0/111969228 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900a5e00 con 0x7f2b980a7330 2023-11-28T16:58:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- 172.21.15.26:0/111969228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b980a7330 msgr2=0x7f2b98153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/111969228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b980a7330 0x7f2b98153f00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2b9806f700 tx=0x7f2b9001c850 comp rx=0 tx=0).stop 2023-11-28T16:58:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- 172.21.15.26:0/111969228 shutdown_connections 2023-11-28T16:58:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/111969228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b980a7330 0x7f2b98153f00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/111969228 >> v2:172.21.15.79:3300/0 conn(0x7f2b981500d0 0x7f2b981567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- 172.21.15.26:0/111969228 >> 172.21.15.26:0/111969228 conn(0x7f2b9806a5a0 msgr2=0x7f2b9806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- 172.21.15.26:0/111969228 shutdown_connections 2023-11-28T16:58:21.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- 172.21.15.26:0/111969228 wait complete. 2023-11-28T16:58:21.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 Processor -- start 2023-11-28T16:58:21.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- start start 2023-11-28T16:58:21.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b980a7330 0x7f2b981483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b9814fcf0 0x7f2b980c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b981500d0 0x7f2b980a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98148900 con 0x7f2b981500d0 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98148d20 con 0x7f2b980a7330 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9ce17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980aa030 con 0x7f2b9814fcf0 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b981500d0 0x7f2b980a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b981500d0 0x7f2b980a8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37260/0 (socket says 172.21.15.26:37260) 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 -- 172.21.15.26:0/1762745913 learned_addr learned my addr 172.21.15.26:0/1762745913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b8ffff640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b9814fcf0 0x7f2b980c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b9659c640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b980a7330 0x7f2b981483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 -- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b9814fcf0 msgr2=0x7f2b980c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b9814fcf0 0x7f2b980c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 -- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b980a7330 msgr2=0x7f2b981483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b980a7330 0x7f2b981483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.161+0000 7f2b96d9d640 1 -- 172.21.15.26:0/1762745913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009a70 con 0x7f2b981500d0 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b9659c640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b980a7330 0x7f2b981483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b96d9d640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b981500d0 0x7f2b980a8b20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2b90019460 tx=0x7f2b900195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b8effd640 1 -- 172.21.15.26:0/1762745913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900b9860 con 0x7f2b981500d0 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b8effd640 1 -- 172.21.15.26:0/1762745913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b900b99c0 con 0x7f2b981500d0 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b8effd640 1 -- 172.21.15.26:0/1762745913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900b9d70 con 0x7f2b981500d0 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b980aa310 con 0x7f2b981500d0 2023-11-28T16:58:21.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b98148050 con 0x7f2b981500d0 2023-11-28T16:58:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9804e890 con 0x7f2b981500d0 2023-11-28T16:58:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b8effd640 1 -- 172.21.15.26:0/1762745913 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2b900ad440 con 0x7f2b981500d0 2023-11-28T16:58:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b8effd640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b780668d0 0x7f2b78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b8effd640 1 -- 172.21.15.26:0/1762745913 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2b9011fb10 con 0x7f2b981500d0 2023-11-28T16:58:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.165+0000 7f2b9659c640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b780668d0 0x7f2b78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.169+0000 7f2b9659c640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b780668d0 0x7f2b78068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2b880011f0 tx=0x7f2b88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.169+0000 7f2b8effd640 1 -- 172.21.15.26:0/1762745913 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b900f0590 con 0x7f2b981500d0 2023-11-28T16:58:21.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b9815dee0 con 0x7f2b981500d0 2023-11-28T16:58:21.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b8effd640 1 -- 172.21.15.26:0/1762745913 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b900bd020 con 0x7f2b981500d0 2023-11-28T16:58:21.340 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:21.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b780668d0 msgr2=0x7f2b78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b780668d0 0x7f2b78068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2b880011f0 tx=0x7f2b88009040 comp rx=0 tx=0).stop 2023-11-28T16:58:21.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b981500d0 msgr2=0x7f2b980a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b981500d0 0x7f2b980a8b20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2b90019460 tx=0x7f2b900195f0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 shutdown_connections 2023-11-28T16:58:21.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b981500d0 0x7f2b980a8b20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2b780668d0 0x7f2b78068d90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b9814fcf0 0x7f2b980c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 --2- 172.21.15.26:0/1762745913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b980a7330 0x7f2b981483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 >> 172.21.15.26:0/1762745913 conn(0x7f2b9806a5a0 msgr2=0x7f2b980aca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:21.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 shutdown_connections 2023-11-28T16:58:21.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.337+0000 7f2b9ce17640 1 -- 172.21.15.26:0/1762745913 wait complete. 2023-11-28T16:58:21.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:58:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da8eea640 1 Processor -- start 2023-11-28T16:58:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da8eea640 1 -- start start 2023-11-28T16:58:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da8eea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4da414eaf0 0x7f4da4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da8eea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da4151f90 0x7f4da406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da8eea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da406de00 con 0x7f4da40c0370 2023-11-28T16:58:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da8eea640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da4070390 con 0x7f4da414eaf0 2023-11-28T16:58:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da8eea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da414eed0 con 0x7f4da4151f90 2023-11-28T16:58:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da2d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4da40c0370 0x7f4da406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44580/0 (socket says 172.21.15.26:44580) 2023-11-28T16:58:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da2d9d640 1 -- 172.21.15.26:0/3772942731 learned_addr learned my addr 172.21.15.26:0/3772942731 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:21.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4d9bfff640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da4151f90 0x7f4da406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da259c640 1 --2- 172.21.15.26:0/3772942731 >> v2:172.21.15.79:3300/0 conn(0x7f4da414eaf0 0x7f4da4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631280592 0 0) 0x7f4da406de00 con 0x7f4da40c0370 2023-11-28T16:58:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d90003530 con 0x7f4da40c0370 2023-11-28T16:58:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085753826 0 0) 0x7f4d90003530 con 0x7f4da40c0370 2023-11-28T16:58:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da4151f90 msgr2=0x7f4da406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da4151f90 0x7f4da406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 >> v2:172.21.15.79:3300/0 conn(0x7f4da414eaf0 msgr2=0x7f4da4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 --2- 172.21.15.26:0/3772942731 >> v2:172.21.15.79:3300/0 conn(0x7f4da414eaf0 0x7f4da4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4151270 con 0x7f4da40c0370 2023-11-28T16:58:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f4d9c001a00 con 0x7f4da40c0370 2023-11-28T16:58:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 >> v1:172.21.15.26:6789/0 conn(0x7f4da40c0370 legacy=0x7f4da406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4d90003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d900047d0 0x7f4d90004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d90005150 0x7f4d9000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4070390 con 0x7f4d90003980 2023-11-28T16:58:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da414eed0 con 0x7f4d90005150 2023-11-28T16:58:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9000bed0 con 0x7f4d900047d0 2023-11-28T16:58:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da259c640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4d90003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4d9bfff640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d900047d0 0x7f4d90004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.505+0000 7f4da2d9d640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d90005150 0x7f4d9000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da259c640 1 -- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d900047d0 msgr2=0x7f4d90004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da259c640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d900047d0 0x7f4d90004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da259c640 1 -- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d90005150 msgr2=0x7f4d9000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da259c640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d90005150 0x7f4d9000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da259c640 1 -- 172.21.15.26:0/3772942731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d90003530 con 0x7f4d90003980 2023-11-28T16:58:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da2d9d640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d90005150 0x7f4d9000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da259c640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4d90003da0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009b10 tx=0x7f4d9401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48000c3ed67ef1e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940a5630 con 0x7f4d90003980 2023-11-28T16:58:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d940a5790 con 0x7f4d90003980 2023-11-28T16:58:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da1d9b640 1 -- 172.21.15.26:0/3772942731 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940a5b40 con 0x7f4d90003980 2023-11-28T16:58:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da8eea640 1 -- 172.21.15.26:0/3772942731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 msgr2=0x7f4d90003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da8eea640 1 --2- 172.21.15.26:0/3772942731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4d90003da0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009b10 tx=0x7f4d9401ca60 comp rx=0 tx=0).stop 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da2d9d640 1 -- 172.21.15.26:0/3772942731 reap_dead start 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da8eea640 1 -- 172.21.15.26:0/3772942731 shutdown_connections 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da8eea640 1 -- 172.21.15.26:0/3772942731 >> 172.21.15.26:0/3772942731 conn(0x7f4da40c2a60 msgr2=0x7f4da40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da8eea640 1 -- 172.21.15.26:0/3772942731 shutdown_connections 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.509+0000 7f4da8eea640 1 -- 172.21.15.26:0/3772942731 wait complete. 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 Processor -- start 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 -- start start 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4da414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da41f1150 0x7f4da414fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da41ecf70 0x7f4da41ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da414c8e0 con 0x7f4d90003980 2023-11-28T16:58:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da41f0cc0 con 0x7f4da41f1150 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da8eea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da414c320 con 0x7f4da41ecf70 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4da414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4da414cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34392/0 (socket says 172.21.15.26:34392) 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 -- 172.21.15.26:0/1698613245 learned_addr learned my addr 172.21.15.26:0/1698613245 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da2d9d640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da41ecf70 0x7f4da41ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4d9bfff640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da41f1150 0x7f4da414fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 -- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da41ecf70 msgr2=0x7f4da41ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da41ecf70 0x7f4da41ed3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 -- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da41f1150 msgr2=0x7f4da414fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da41f1150 0x7f4da414fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 -- 172.21.15.26:0/1698613245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da414c600 con 0x7f4d90003980 2023-11-28T16:58:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4da259c640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4da414cae0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009b10 tx=0x7f4d90005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.513+0000 7f4d9affd640 1 -- 172.21.15.26:0/1698613245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940a5630 con 0x7f4d90003980 2023-11-28T16:58:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4d9affd640 1 -- 172.21.15.26:0/1698613245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d94004020 con 0x7f4d90003980 2023-11-28T16:58:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4d9affd640 1 -- 172.21.15.26:0/1698613245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940043d0 con 0x7f4d90003980 2023-11-28T16:58:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da41f0670 con 0x7f4d90003980 2023-11-28T16:58:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da40ac010 con 0x7f4d90003980 2023-11-28T16:58:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da404e890 con 0x7f4d90003980 2023-11-28T16:58:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4d9affd640 1 -- 172.21.15.26:0/1698613245 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4d940b4040 con 0x7f4d90003980 2023-11-28T16:58:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4d9affd640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d84066900 0x7f4d84068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4d9affd640 1 -- 172.21.15.26:0/1698613245 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4d9411e770 con 0x7f4d90003980 2023-11-28T16:58:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.517+0000 7f4d9bfff640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d84066900 0x7f4d84068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.521+0000 7f4d9bfff640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d84066900 0x7f4d84068dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4da41f1600 tx=0x7f4d8c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.521+0000 7f4d9affd640 1 -- 172.21.15.26:0/1698613245 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d940eb8d0 con 0x7f4d90003980 2023-11-28T16:58:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4da414c8e0 con 0x7f4d90003980 2023-11-28T16:58:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4d9affd640 1 -- 172.21.15.26:0/1698613245 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4d940eeef0 con 0x7f4d90003980 2023-11-28T16:58:21.684 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:21.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d84066900 msgr2=0x7f4d84068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d84066900 0x7f4d84068dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4da41f1600 tx=0x7f4d8c009190 comp rx=0 tx=0).stop 2023-11-28T16:58:21.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 msgr2=0x7f4da414cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4da414cae0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009b10 tx=0x7f4d90005800 comp rx=0 tx=0).stop 2023-11-28T16:58:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 shutdown_connections 2023-11-28T16:58:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4d84066900 0x7f4d84068dc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da41ecf70 0x7f4da41ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da41f1150 0x7f4da414fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 --2- 172.21.15.26:0/1698613245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d90003980 0x7f4da414cae0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 >> 172.21.15.26:0/1698613245 conn(0x7f4da40c2a60 msgr2=0x7f4da4071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 shutdown_connections 2023-11-28T16:58:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.681+0000 7f4da8eea640 1 -- 172.21.15.26:0/1698613245 wait complete. 2023-11-28T16:58:21.705 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:58:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48ca4fe640 1 Processor -- start 2023-11-28T16:58:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48ca4fe640 1 -- start start 2023-11-28T16:58:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48ca4fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48c40c7f20 0x7f48c406be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48ca4fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c406cf70 con 0x7f48c40c8430 2023-11-28T16:58:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48ca4fe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c4152160 con 0x7f48c4151d80 2023-11-28T16:58:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48ca4fe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40c6a30 con 0x7f48c40c7f20 2023-11-28T16:58:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f48c40c8430 0x7f48c406b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44586/0 (socket says 172.21.15.26:44586) 2023-11-28T16:58:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c37fe640 1 -- 172.21.15.26:0/1654594312 learned_addr learned my addr 172.21.15.26:0/1654594312 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c8a9b640 1 --2- 172.21.15.26:0/1654594312 >> v2:172.21.15.79:3300/0 conn(0x7f48c40c7f20 0x7f48c406be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c2ffd640 1 -- 172.21.15.26:0/1654594312 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916157372 0 0) 0x7f48c406cf70 con 0x7f48c40c8430 2023-11-28T16:58:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c2ffd640 1 -- 172.21.15.26:0/1654594312 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ac003530 con 0x7f48c40c8430 2023-11-28T16:58:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c8a9b640 1 -- 172.21.15.26:0/1654594312 >> v1:172.21.15.79:6789/0 conn(0x7f48c4151d80 legacy=0x7f48c40c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c8a9b640 1 -- 172.21.15.26:0/1654594312 >> v1:172.21.15.26:6789/0 conn(0x7f48c40c8430 legacy=0x7f48c406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.849+0000 7f48c8a9b640 1 -- 172.21.15.26:0/1654594312 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40c72d0 con 0x7f48c40c7f20 2023-11-28T16:58:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48c8a9b640 1 --2- 172.21.15.26:0/1654594312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c7f20 0x7f48c406be30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009d90 tx=0x7f48bc01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8e8f6e7e9b6169 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48c2ffd640 1 -- 172.21.15.26:0/1654594312 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0a5950 con 0x7f48c40c7f20 2023-11-28T16:58:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48c2ffd640 1 -- 172.21.15.26:0/1654594312 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc0a5ab0 con 0x7f48c40c7f20 2023-11-28T16:58:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48c2ffd640 1 -- 172.21.15.26:0/1654594312 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0a5e40 con 0x7f48c40c7f20 2023-11-28T16:58:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1654594312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c7f20 msgr2=0x7f48c406be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1654594312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c7f20 0x7f48c406be30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009d90 tx=0x7f48bc01c890 comp rx=0 tx=0).stop 2023-11-28T16:58:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1654594312 shutdown_connections 2023-11-28T16:58:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1654594312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c7f20 0x7f48c406be30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1654594312 >> 172.21.15.26:0/1654594312 conn(0x7f48c40abd00 msgr2=0x7f48c40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1654594312 shutdown_connections 2023-11-28T16:58:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.853+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1654594312 wait complete. 2023-11-28T16:58:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 Processor -- start 2023-11-28T16:58:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 -- start start 2023-11-28T16:58:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c40c7f20 0x7f48c4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c8430 0x7f48c4158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4151d80 0x7f48c41559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4157e90 con 0x7f48c40c7f20 2023-11-28T16:58:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40af680 con 0x7f48c40c8430 2023-11-28T16:58:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c41f0470 con 0x7f48c4151d80 2023-11-28T16:58:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c40c7f20 0x7f48c4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c40c7f20 0x7f48c4154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34404/0 (socket says 172.21.15.26:34404) 2023-11-28T16:58:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 -- 172.21.15.26:0/1475745184 learned_addr learned my addr 172.21.15.26:0/1475745184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c37fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c8430 0x7f48c4158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c8a9b640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4151d80 0x7f48c41559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 -- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4151d80 msgr2=0x7f48c41559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4151d80 0x7f48c41559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 -- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c8430 msgr2=0x7f48c4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c8430 0x7f48c4158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:21.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 -- 172.21.15.26:0/1475745184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc009a70 con 0x7f48c40c7f20 2023-11-28T16:58:21.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c3fff640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c40c7f20 0x7f48c4154280 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c530 tx=0x7f48b400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c0ff9640 1 -- 172.21.15.26:0/1475745184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4005220 con 0x7f48c40c7f20 2023-11-28T16:58:21.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c0ff9640 1 -- 172.21.15.26:0/1475745184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4005380 con 0x7f48c40c7f20 2023-11-28T16:58:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c41f0750 con 0x7f48c40c7f20 2023-11-28T16:58:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48c0ff9640 1 -- 172.21.15.26:0/1475745184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4007270 con 0x7f48c40c7f20 2023-11-28T16:58:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.857+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c41547c0 con 0x7f48c40c7f20 2023-11-28T16:58:21.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.861+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c41f0990 con 0x7f48c40c7f20 2023-11-28T16:58:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.861+0000 7f48c0ff9640 1 -- 172.21.15.26:0/1475745184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f48b40073d0 con 0x7f48c40c7f20 2023-11-28T16:58:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.861+0000 7f48c0ff9640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f48b0066900 0x7f48b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.861+0000 7f48c0ff9640 1 -- 172.21.15.26:0/1475745184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f48b4083dd0 con 0x7f48c40c7f20 2023-11-28T16:58:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.861+0000 7f48c37fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f48b0066900 0x7f48b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.861+0000 7f48c37fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f48b0066900 0x7f48b0068dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ac7f0 tx=0x7f48b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:21.865+0000 7f48c0ff9640 1 -- 172.21.15.26:0/1475745184 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48b4050d50 con 0x7f48c40c7f20 2023-11-28T16:58:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.021+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f48c4152160 con 0x7f48c40c7f20 2023-11-28T16:58:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.021+0000 7f48c0ff9640 1 -- 172.21.15.26:0/1475745184 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f48c4152160 con 0x7f48c40c7f20 2023-11-28T16:58:22.026 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f48b0066900 msgr2=0x7f48b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f48b0066900 0x7f48b0068dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ac7f0 tx=0x7f48b8009040 comp rx=0 tx=0).stop 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c40c7f20 msgr2=0x7f48c4154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c40c7f20 0x7f48c4154280 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c530 tx=0x7f48b400c9f0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 shutdown_connections 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f48b0066900 0x7f48b0068dc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4151d80 0x7f48c41559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c40c8430 0x7f48c4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 --2- 172.21.15.26:0/1475745184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c40c7f20 0x7f48c4154280 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 >> 172.21.15.26:0/1475745184 conn(0x7f48c40abd00 msgr2=0x7f48c414e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 shutdown_connections 2023-11-28T16:58:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.025+0000 7f48ca4fe640 1 -- 172.21.15.26:0/1475745184 wait complete. 2023-11-28T16:58:22.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:58:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.189+0000 7eff3f99d640 1 Processor -- start 2023-11-28T16:58:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.189+0000 7eff3f99d640 1 -- start start 2023-11-28T16:58:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3f99d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff380a6e50 0x7eff380c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3f99d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff38158010 0x7eff381584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3f99d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff380c70a0 con 0x7eff381555d0 2023-11-28T16:58:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3f99d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff380c7380 con 0x7eff380a6e50 2023-11-28T16:58:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3f99d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3806c470 con 0x7eff38158010 2023-11-28T16:58:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff380a6e50 0x7eff380c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff380a6e50 0x7eff380c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34410/0 (socket says 172.21.15.26:34410) 2023-11-28T16:58:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 -- 172.21.15.26:0/2323960748 learned_addr learned my addr 172.21.15.26:0/2323960748 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3df3a640 1 --2- 172.21.15.26:0/2323960748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff38158010 0x7eff381584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 -- 172.21.15.26:0/2323960748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff38158010 msgr2=0x7eff381584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 --2- 172.21.15.26:0/2323960748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff38158010 0x7eff381584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 -- 172.21.15.26:0/2323960748 >> v1:172.21.15.79:6789/0 conn(0x7eff381555d0 legacy=0x7eff380c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 -- 172.21.15.26:0/2323960748 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3806c750 con 0x7eff380a6e50 2023-11-28T16:58:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.193+0000 7eff3cf38640 1 --2- 172.21.15.26:0/2323960748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff380a6e50 0x7eff380c78e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7eff28009870 tx=0x7eff2801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a260abd467fd8d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff2ffff640 1 -- 172.21.15.26:0/2323960748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280ac640 con 0x7eff380a6e50 2023-11-28T16:58:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff2ffff640 1 -- 172.21.15.26:0/2323960748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff280ac7a0 con 0x7eff380a6e50 2023-11-28T16:58:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff2ffff640 1 -- 172.21.15.26:0/2323960748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280acb30 con 0x7eff380a6e50 2023-11-28T16:58:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- 172.21.15.26:0/2323960748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff380a6e50 msgr2=0x7eff380c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 --2- 172.21.15.26:0/2323960748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff380a6e50 0x7eff380c78e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7eff28009870 tx=0x7eff2801c500 comp rx=0 tx=0).stop 2023-11-28T16:58:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- 172.21.15.26:0/2323960748 shutdown_connections 2023-11-28T16:58:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 --2- 172.21.15.26:0/2323960748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff38158010 0x7eff381584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 --2- 172.21.15.26:0/2323960748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff380a6e50 0x7eff380c78e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- 172.21.15.26:0/2323960748 >> 172.21.15.26:0/2323960748 conn(0x7eff380c4960 msgr2=0x7eff380c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:22.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- 172.21.15.26:0/2323960748 shutdown_connections 2023-11-28T16:58:22.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- 172.21.15.26:0/2323960748 wait complete. 2023-11-28T16:58:22.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 Processor -- start 2023-11-28T16:58:22.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- start start 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff380a6e50 0x7eff3814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff381555d0 0x7eff380ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff38158010 0x7eff380adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380ab040 con 0x7eff381555d0 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380ad0a0 con 0x7eff38158010 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3f99d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff380ac770 con 0x7eff380a6e50 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3cf38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff381555d0 0x7eff380ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3cf38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff381555d0 0x7eff380ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34416/0 (socket says 172.21.15.26:34416) 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.197+0000 7eff3cf38640 1 -- 172.21.15.26:0/917127116 learned_addr learned my addr 172.21.15.26:0/917127116 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3d739640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff380a6e50 0x7eff3814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3df3a640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff38158010 0x7eff380adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3cf38640 1 -- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff380a6e50 msgr2=0x7eff3814e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3cf38640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff380a6e50 0x7eff3814e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3cf38640 1 -- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff38158010 msgr2=0x7eff380adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3cf38640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff38158010 0x7eff380adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3cf38640 1 -- 172.21.15.26:0/917127116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280094d0 con 0x7eff381555d0 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3cf38640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff381555d0 0x7eff380ad700 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7eff280af040 tx=0x7eff280192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff2dffb640 1 -- 172.21.15.26:0/917127116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280b5640 con 0x7eff381555d0 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff2dffb640 1 -- 172.21.15.26:0/917127116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff280b57a0 con 0x7eff381555d0 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff2dffb640 1 -- 172.21.15.26:0/917127116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280b5b50 con 0x7eff381555d0 2023-11-28T16:58:22.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff380aca50 con 0x7eff381555d0 2023-11-28T16:58:22.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3814e870 con 0x7eff381555d0 2023-11-28T16:58:22.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3804e890 con 0x7eff381555d0 2023-11-28T16:58:22.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff2dffb640 1 -- 172.21.15.26:0/917127116 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff280b3070 con 0x7eff381555d0 2023-11-28T16:58:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.201+0000 7eff2dffb640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c066950 0x7eff1c068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.205+0000 7eff2dffb640 1 -- 172.21.15.26:0/917127116 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7eff2811e940 con 0x7eff381555d0 2023-11-28T16:58:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.205+0000 7eff3d739640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c066950 0x7eff1c068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.205+0000 7eff3d739640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c066950 0x7eff1c068e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7eff34004e30 tx=0x7eff34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:22.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.205+0000 7eff2dffb640 1 -- 172.21.15.26:0/917127116 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff280eb810 con 0x7eff381555d0 2023-11-28T16:58:22.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.377+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff3804e890 con 0x7eff381555d0 2023-11-28T16:58:22.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff2dffb640 1 -- 172.21.15.26:0/917127116 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff280eee30 con 0x7eff381555d0 2023-11-28T16:58:22.382 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:58:22.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c066950 msgr2=0x7eff1c068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c066950 0x7eff1c068e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7eff34004e30 tx=0x7eff34009040 comp rx=0 tx=0).stop 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff381555d0 msgr2=0x7eff380ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff381555d0 0x7eff380ad700 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7eff280af040 tx=0x7eff280192a0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 shutdown_connections 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff38158010 0x7eff380adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff381555d0 0x7eff380ad700 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c066950 0x7eff1c068e10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 --2- 172.21.15.26:0/917127116 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff380a6e50 0x7eff3814e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 >> 172.21.15.26:0/917127116 conn(0x7eff380c4960 msgr2=0x7eff380c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 shutdown_connections 2023-11-28T16:58:22.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.381+0000 7eff3f99d640 1 -- 172.21.15.26:0/917127116 wait complete. 2023-11-28T16:58:22.404 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T16:58:22.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:22.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:22.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:58:22.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:22.438 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:58:22.492 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:22.492 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:22.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:58:22.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:58:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bd586b640 1 Processor -- start 2023-11-28T16:58:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bd586b640 1 -- start start 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bd586b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bd0157670 0x7f8bd006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bd586b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8bd006c3a0 0x7f8bd00c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bd586b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd01556c0 con 0x7f8bd0155170 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bd586b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd006ba10 con 0x7f8bd0157670 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bd586b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd0157a50 con 0x7f8bd006c3a0 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bceffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bd0157670 0x7f8bd006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bceffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bd0157670 0x7f8bd006be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34426/0 (socket says 172.21.15.26:34426) 2023-11-28T16:58:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bceffd640 1 -- 172.21.15.26:0/3108290021 learned_addr learned my addr 172.21.15.26:0/3108290021 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bcf7fe640 1 --2- 172.21.15.26:0/3108290021 >> v2:172.21.15.79:3300/0 conn(0x7f8bd006c3a0 0x7f8bd00c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bceffd640 1 -- 172.21.15.26:0/3108290021 >> v2:172.21.15.79:3300/0 conn(0x7f8bd006c3a0 msgr2=0x7f8bd00c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bceffd640 1 --2- 172.21.15.26:0/3108290021 >> v2:172.21.15.79:3300/0 conn(0x7f8bd006c3a0 0x7f8bd00c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bceffd640 1 -- 172.21.15.26:0/3108290021 >> v1:172.21.15.79:6789/0 conn(0x7f8bd0155170 legacy=0x7f8bd00c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.685+0000 7f8bceffd640 1 -- 172.21.15.26:0/3108290021 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd006c830 con 0x7f8bd0157670 2023-11-28T16:58:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bceffd640 1 --2- 172.21.15.26:0/3108290021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0157670 0x7f8bd006be60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8bd008b380 tx=0x7f8bc001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738a66aab88ced31 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bcdffb640 1 -- 172.21.15.26:0/3108290021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00ac410 con 0x7f8bd0157670 2023-11-28T16:58:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bcdffb640 1 -- 172.21.15.26:0/3108290021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc00ac570 con 0x7f8bd0157670 2023-11-28T16:58:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bcdffb640 1 -- 172.21.15.26:0/3108290021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00ac900 con 0x7f8bd0157670 2023-11-28T16:58:22.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 -- 172.21.15.26:0/3108290021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0157670 msgr2=0x7f8bd006be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3108290021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0157670 0x7f8bd006be60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8bd008b380 tx=0x7f8bc001c3b0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 -- 172.21.15.26:0/3108290021 shutdown_connections 2023-11-28T16:58:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3108290021 >> v2:172.21.15.79:3300/0 conn(0x7f8bd006c3a0 0x7f8bd00c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3108290021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0157670 0x7f8bd006be60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 -- 172.21.15.26:0/3108290021 >> 172.21.15.26:0/3108290021 conn(0x7f8bd00abe70 msgr2=0x7f8bd00ac280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 -- 172.21.15.26:0/3108290021 shutdown_connections 2023-11-28T16:58:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.689+0000 7f8bd586b640 1 -- 172.21.15.26:0/3108290021 wait complete. 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 Processor -- start 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 -- start start 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd006c3a0 0x7f8bd0151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0155170 0x7f8bd015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bd0157670 0x7f8bd015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd015ddc0 con 0x7f8bd0155170 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00aec50 con 0x7f8bd006c3a0 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00af210 con 0x7f8bd0157670 2023-11-28T16:58:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0155170 0x7f8bd015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0155170 0x7f8bd015d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34434/0 (socket says 172.21.15.26:34434) 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 -- 172.21.15.26:0/3706659275 learned_addr learned my addr 172.21.15.26:0/3706659275 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bcf7fe640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bd0157670 0x7f8bd015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bceffd640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd006c3a0 0x7f8bd0151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 -- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bd0157670 msgr2=0x7f8bd015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bd0157670 0x7f8bd015d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 -- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd006c3a0 msgr2=0x7f8bd0151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd006c3a0 0x7f8bd0151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 -- 172.21.15.26:0/3706659275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00094d0 con 0x7f8bd0155170 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bce7fc640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0155170 0x7f8bd015d340 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400c370 tx=0x7f8bc400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bb7fff640 1 -- 172.21.15.26:0/3706659275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40052d0 con 0x7f8bd0155170 2023-11-28T16:58:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bb7fff640 1 -- 172.21.15.26:0/3706659275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc4005430 con 0x7f8bd0155170 2023-11-28T16:58:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bb7fff640 1 -- 172.21.15.26:0/3706659275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4007260 con 0x7f8bd0155170 2023-11-28T16:58:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd006d350 con 0x7f8bd0155170 2023-11-28T16:58:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.693+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd01ed680 con 0x7f8bd0155170 2023-11-28T16:58:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.697+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd00acec0 con 0x7f8bd0155170 2023-11-28T16:58:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.697+0000 7f8bb7fff640 1 -- 172.21.15.26:0/3706659275 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8bc40073c0 con 0x7f8bd0155170 2023-11-28T16:58:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.697+0000 7f8bb7fff640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8bbc0668d0 0x7f8bbc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.697+0000 7f8bb7fff640 1 -- 172.21.15.26:0/3706659275 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8bc4083b40 con 0x7f8bd0155170 2023-11-28T16:58:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.697+0000 7f8bceffd640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8bbc0668d0 0x7f8bbc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.697+0000 7f8bceffd640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8bbc0668d0 0x7f8bbc068d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ae000 tx=0x7f8bc00a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.701+0000 7f8bb7fff640 1 -- 172.21.15.26:0/3706659275 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bd00acec0 con 0x7f8bd0155170 2023-11-28T16:58:22.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.889+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8bd00acec0 con 0x7f8bd0155170 2023-11-28T16:58:22.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.889+0000 7f8bb7fff640 1 -- 172.21.15.26:0/3706659275 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7f8bd00acec0 con 0x7f8bd0155170 2023-11-28T16:58:22.896 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:58:22.896 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T16:58:22.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8bbc0668d0 msgr2=0x7f8bbc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8bbc0668d0 0x7f8bbc068d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ae000 tx=0x7f8bc00a6040 comp rx=0 tx=0).stop 2023-11-28T16:58:22.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0155170 msgr2=0x7f8bd015d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:22.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0155170 0x7f8bd015d340 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400c370 tx=0x7f8bc400c830 comp rx=0 tx=0).stop 2023-11-28T16:58:22.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 shutdown_connections 2023-11-28T16:58:22.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8bbc0668d0 0x7f8bbc068d90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bd0157670 0x7f8bd015d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd0155170 0x7f8bd015d340 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 --2- 172.21.15.26:0/3706659275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd006c3a0 0x7f8bd0151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 >> 172.21.15.26:0/3706659275 conn(0x7f8bd00abe70 msgr2=0x7f8bd01565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 shutdown_connections 2023-11-28T16:58:22.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:22.893+0000 7f8bd586b640 1 -- 172.21.15.26:0/3706659275 wait complete. 2023-11-28T16:58:22.914 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:58:22.915 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:58:22.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:22.916 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:22.926 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42264sec preferred_lft 42264sec 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:58:22.927 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:58:22.928 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:58:22.929 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:58:22.929 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:22.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:22.930 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:58:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:58:22.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:22.993 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:58:23.049 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:58:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:58:23.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:23.051 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:58:23.051 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:58:23.051 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:58:23.051 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:58:23.051 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:58:23.051 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:58:23.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:23.148 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:58:23.157 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:58:23.158 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:58:23.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:23.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:58:23.219 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:23.219 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:23.271 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:58:23.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:23.272 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:23.322 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-11-28T16:58:23.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:23.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:23.418 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:23.418 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:58:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs2=/ 2023-11-28T16:58:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:58:23.436 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:58:23.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:23.436 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:23.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:23.458 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:58:23.517 INFO:teuthology.orchestra.run.smithi079.stdout:client6060 2023-11-28T16:58:23.517 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:23.518 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:23.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-11-28T16:58:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.721+0000 7fe1161f8640 1 Processor -- start 2023-11-28T16:58:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.721+0000 7fe1161f8640 1 -- start start 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1161f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1100c7ce0 0x7fe1100c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1161f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1100c4ca0 0x7fe11006b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1161f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe110151e90 con 0x7fe110151ab0 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1161f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100c71a0 con 0x7fe1100c4ca0 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1161f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100c6900 con 0x7fe1100c7ce0 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1159f7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1100c4ca0 0x7fe11006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1159f7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1100c4ca0 0x7fe11006b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34438/0 (socket says 172.21.15.26:34438) 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1159f7640 1 -- 172.21.15.26:0/2979029619 learned_addr learned my addr 172.21.15.26:0/2979029619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1149f5640 1 --2- 172.21.15.26:0/2979029619 >> v2:172.21.15.79:3300/0 conn(0x7fe1100c7ce0 0x7fe1100c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1159f7640 1 -- 172.21.15.26:0/2979029619 >> v2:172.21.15.79:3300/0 conn(0x7fe1100c7ce0 msgr2=0x7fe1100c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1159f7640 1 --2- 172.21.15.26:0/2979029619 >> v2:172.21.15.79:3300/0 conn(0x7fe1100c7ce0 0x7fe1100c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1159f7640 1 -- 172.21.15.26:0/2979029619 >> v1:172.21.15.79:6789/0 conn(0x7fe110151ab0 legacy=0x7fe110154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.725+0000 7fe1159f7640 1 -- 172.21.15.26:0/2979029619 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100c6be0 con 0x7fe1100c4ca0 2023-11-28T16:58:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1159f7640 1 --2- 172.21.15.26:0/2979029619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c4ca0 0x7fe11006b800 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c5ff0 tx=0x7fe10801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8350dd55d6a50d74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe107fff640 1 -- 172.21.15.26:0/2979029619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1080a56b0 con 0x7fe1100c4ca0 2023-11-28T16:58:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe107fff640 1 -- 172.21.15.26:0/2979029619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1080a5810 con 0x7fe1100c4ca0 2023-11-28T16:58:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe107fff640 1 -- 172.21.15.26:0/2979029619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1080a5ba0 con 0x7fe1100c4ca0 2023-11-28T16:58:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- 172.21.15.26:0/2979029619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c4ca0 msgr2=0x7fe11006b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 --2- 172.21.15.26:0/2979029619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c4ca0 0x7fe11006b800 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c5ff0 tx=0x7fe10801c900 comp rx=0 tx=0).stop 2023-11-28T16:58:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- 172.21.15.26:0/2979029619 shutdown_connections 2023-11-28T16:58:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 --2- 172.21.15.26:0/2979029619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c4ca0 0x7fe11006b800 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 --2- 172.21.15.26:0/2979029619 >> v2:172.21.15.79:3300/0 conn(0x7fe1100c7ce0 0x7fe1100c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- 172.21.15.26:0/2979029619 >> 172.21.15.26:0/2979029619 conn(0x7fe1100abba0 msgr2=0x7fe1100abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- 172.21.15.26:0/2979029619 shutdown_connections 2023-11-28T16:58:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- 172.21.15.26:0/2979029619 wait complete. 2023-11-28T16:58:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 Processor -- start 2023-11-28T16:58:23.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- start start 2023-11-28T16:58:23.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100c4ca0 0x7fe1101460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:23.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c7ce0 0x7fe1101f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:23.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe110151ab0 0x7fe1101f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:23.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100afb60 con 0x7fe1100c7ce0 2023-11-28T16:58:23.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100ab0b0 con 0x7fe1100c4ca0 2023-11-28T16:58:23.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.729+0000 7fe1161f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101f0d40 con 0x7fe110151ab0 2023-11-28T16:58:23.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c7ce0 0x7fe1101f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:23.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1151f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100c4ca0 0x7fe1101460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:23.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c7ce0 0x7fe1101f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34452/0 (socket says 172.21.15.26:34452) 2023-11-28T16:58:23.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1151f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100c4ca0 0x7fe1101460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:37454/0 (socket says 172.21.15.26:37454) 2023-11-28T16:58:23.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1159f7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe110151ab0 0x7fe1101f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:23.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 -- 172.21.15.26:0/3873641375 learned_addr learned my addr 172.21.15.26:0/3873641375 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:23.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 -- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe110151ab0 msgr2=0x7fe1101f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:23.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe110151ab0 0x7fe1101f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 -- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100c4ca0 msgr2=0x7fe1101460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:23.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100c4ca0 0x7fe1101460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 -- 172.21.15.26:0/3873641375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108009b30 con 0x7fe1100c7ce0 2023-11-28T16:58:23.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1151f6640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100c4ca0 0x7fe1101460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:23.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1149f5640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c7ce0 0x7fe1101f0100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e930 tx=0x7fe10000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:23.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe105ffb640 1 -- 172.21.15.26:0/3873641375 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100009690 con 0x7fe1100c7ce0 2023-11-28T16:58:23.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe105ffb640 1 -- 172.21.15.26:0/3873641375 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10000ca00 con 0x7fe1100c7ce0 2023-11-28T16:58:23.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe105ffb640 1 -- 172.21.15.26:0/3873641375 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10000cdb0 con 0x7fe1100c7ce0 2023-11-28T16:58:23.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1100aa2f0 con 0x7fe1100c7ce0 2023-11-28T16:58:23.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1100aa8b0 con 0x7fe1100c7ce0 2023-11-28T16:58:23.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe110067a10 con 0x7fe1100c7ce0 2023-11-28T16:58:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.733+0000 7fe105ffb640 1 -- 172.21.15.26:0/3873641375 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe100013470 con 0x7fe1100c7ce0 2023-11-28T16:58:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.737+0000 7fe105ffb640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0f40668d0 0x7fe0f4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.737+0000 7fe105ffb640 1 -- 172.21.15.26:0/3873641375 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe100084990 con 0x7fe1100c7ce0 2023-11-28T16:58:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.737+0000 7fe1151f6640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0f40668d0 0x7fe0f4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.737+0000 7fe1151f6640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0f40668d0 0x7fe0f4068d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1100ab2f0 tx=0x7fe10c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:23.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.741+0000 7fe105ffb640 1 -- 172.21.15.26:0/3873641375 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1000519d0 con 0x7fe1100c7ce0 2023-11-28T16:58:23.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.953+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7fe110074970 con 0x7fe1100c7ce0 2023-11-28T16:58:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.953+0000 7fe105ffb640 1 -- 172.21.15.26:0/3873641375 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v19) v1 ==== 291+0+0 (secure 0 0 0) 0x7fe100054ff0 con 0x7fe1100c7ce0 2023-11-28T16:58:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:added key for client.testuser 2023-11-28T16:58:23.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0f40668d0 msgr2=0x7fe0f4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:23.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0f40668d0 0x7fe0f4068d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1100ab2f0 tx=0x7fe10c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c7ce0 msgr2=0x7fe1101f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c7ce0 0x7fe1101f0100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e930 tx=0x7fe10000edf0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 shutdown_connections 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0f40668d0 0x7fe0f4068d90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe110151ab0 0x7fe1101f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100c7ce0 0x7fe1101f0100 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 --2- 172.21.15.26:0/3873641375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100c4ca0 0x7fe1101460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 >> 172.21.15.26:0/3873641375 conn(0x7fe1100abba0 msgr2=0x7fe1100c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 shutdown_connections 2023-11-28T16:58:23.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:23.957+0000 7fe1161f8640 1 -- 172.21.15.26:0/3873641375 wait complete. 2023-11-28T16:58:23.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f658525a640 1 Processor -- start 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f658525a640 1 -- start start 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f658525a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f658006d980 0x7f65800c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f658525a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6580156980 con 0x7f6580156500 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f658525a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65800ab580 con 0x7f658014fcc0 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f658525a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800aa340 con 0x7f658006d980 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f6577fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6580156500 0x7f65800c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44588/0 (socket says 172.21.15.26:44588) 2023-11-28T16:58:24.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f6577fff640 1 -- 172.21.15.26:0/3831580561 learned_addr learned my addr 172.21.15.26:0/3831580561 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:24.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f657f59e640 1 --2- 172.21.15.26:0/3831580561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f658006d980 0x7f65800c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f657e59c640 1 -- 172.21.15.26:0/3831580561 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82757981 0 0) 0x7f6568001120 con 0x7f6580156500 2023-11-28T16:58:24.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f657e59c640 1 -- 172.21.15.26:0/3831580561 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f656c003530 con 0x7f6580156500 2023-11-28T16:58:24.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f657e59c640 1 -- 172.21.15.26:0/3831580561 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268495237 0 0) 0x7f65800ab580 con 0x7f658014fcc0 2023-11-28T16:58:24.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f657f59e640 1 -- 172.21.15.26:0/3831580561 >> v1:172.21.15.79:6789/0 conn(0x7f658014fcc0 legacy=0x7f65800aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f657f59e640 1 -- 172.21.15.26:0/3831580561 >> v1:172.21.15.26:6789/0 conn(0x7f6580156500 legacy=0x7f65800c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.121+0000 7f657f59e640 1 -- 172.21.15.26:0/3831580561 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580152fe0 con 0x7f658006d980 2023-11-28T16:58:24.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f657f59e640 1 --2- 172.21.15.26:0/3831580561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f658006d980 0x7f65800c20f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6578009dc0 tx=0x7f657801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eccf698897056f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:24.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f657e59c640 1 -- 172.21.15.26:0/3831580561 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780a5a00 con 0x7f658006d980 2023-11-28T16:58:24.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f657e59c640 1 -- 172.21.15.26:0/3831580561 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65780a5b60 con 0x7f658006d980 2023-11-28T16:58:24.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f657e59c640 1 -- 172.21.15.26:0/3831580561 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780ad440 con 0x7f658006d980 2023-11-28T16:58:24.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f658525a640 1 -- 172.21.15.26:0/3831580561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f658006d980 msgr2=0x7f65800c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f658525a640 1 --2- 172.21.15.26:0/3831580561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f658006d980 0x7f65800c20f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6578009dc0 tx=0x7f657801c940 comp rx=0 tx=0).stop 2023-11-28T16:58:24.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f658525a640 1 -- 172.21.15.26:0/3831580561 shutdown_connections 2023-11-28T16:58:24.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f658525a640 1 --2- 172.21.15.26:0/3831580561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f658006d980 0x7f65800c20f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f658525a640 1 -- 172.21.15.26:0/3831580561 >> 172.21.15.26:0/3831580561 conn(0x7f65800c2ad0 msgr2=0x7f65800c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:24.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f658525a640 1 -- 172.21.15.26:0/3831580561 shutdown_connections 2023-11-28T16:58:24.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.125+0000 7f658525a640 1 -- 172.21.15.26:0/3831580561 wait complete. 2023-11-28T16:58:24.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 Processor -- start 2023-11-28T16:58:24.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 -- start start 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658006d980 0x7f658015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6580156500 0x7f65801ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65800baff0 0x7f65801ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65801f0660 con 0x7f658006d980 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65801f0b90 con 0x7f65800baff0 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65801ec880 con 0x7f6580156500 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658006d980 0x7f658015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658006d980 0x7f658015c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34454/0 (socket says 172.21.15.26:34454) 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 -- 172.21.15.26:0/2241576073 learned_addr learned my addr 172.21.15.26:0/2241576073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:24.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f6577fff640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6580156500 0x7f65801ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657f59e640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65800baff0 0x7f65801ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 -- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6580156500 msgr2=0x7f65801ecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6580156500 0x7f65801ecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 -- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65800baff0 msgr2=0x7f65801ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65800baff0 0x7f65801ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 -- 172.21.15.26:0/2241576073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578009a70 con 0x7f658006d980 2023-11-28T16:58:24.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f657ed9d640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658006d980 0x7f658015c570 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f657000c530 tx=0x7f657000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:24.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f65777fe640 1 -- 172.21.15.26:0/2241576073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570005480 con 0x7f658006d980 2023-11-28T16:58:24.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f65777fe640 1 -- 172.21.15.26:0/2241576073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6570003600 con 0x7f658006d980 2023-11-28T16:58:24.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6580152490 con 0x7f658006d980 2023-11-28T16:58:24.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f65777fe640 1 -- 172.21.15.26:0/2241576073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65700039b0 con 0x7f658006d980 2023-11-28T16:58:24.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.129+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65800a8920 con 0x7f658006d980 2023-11-28T16:58:24.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.133+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658004e890 con 0x7f658006d980 2023-11-28T16:58:24.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.133+0000 7f65777fe640 1 -- 172.21.15.26:0/2241576073 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6570003b10 con 0x7f658006d980 2023-11-28T16:58:24.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.133+0000 7f65777fe640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65600668d0 0x7f6560068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.133+0000 7f65777fe640 1 -- 172.21.15.26:0/2241576073 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6570083c80 con 0x7f658006d980 2023-11-28T16:58:24.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.133+0000 7f6577fff640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65600668d0 0x7f6560068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.133+0000 7f6577fff640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65600668d0 0x7f6560068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6568007fd0 tx=0x7f6568009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:24.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.137+0000 7f65777fe640 1 -- 172.21.15.26:0/2241576073 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6570089020 con 0x7f658006d980 2023-11-28T16:58:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f658006ce10 con 0x7f658006d980 2023-11-28T16:58:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f65777fe640 1 -- 172.21.15.26:0/2241576073 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v19) v1 ==== 85+0+245 (secure 0 0 0) 0x7f6570017070 con 0x7f658006d980 2023-11-28T16:58:24.351 INFO:teuthology.orchestra.run.smithi026.stdout:[client.testuser] 2023-11-28T16:58:24.351 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAvHGZl3K7vOBAAZ1K0naJd5Vgb5lYjY6X4+g== 2023-11-28T16:58:24.351 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-28T16:58:24.351 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-11-28T16:58:24.351 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65600668d0 msgr2=0x7f6560068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65600668d0 0x7f6560068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6568007fd0 tx=0x7f6568009040 comp rx=0 tx=0).stop 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658006d980 msgr2=0x7f658015c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658006d980 0x7f658015c570 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f657000c530 tx=0x7f657000c9f0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 shutdown_connections 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65800baff0 0x7f65801ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65600668d0 0x7f6560068d90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6580156500 0x7f65801ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 --2- 172.21.15.26:0/2241576073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658006d980 0x7f658015c570 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 >> 172.21.15.26:0/2241576073 conn(0x7f65800c2ad0 msgr2=0x7f6580154630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 shutdown_connections 2023-11-28T16:58:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.349+0000 7f658525a640 1 -- 172.21.15.26:0/2241576073 wait complete. 2023-11-28T16:58:24.372 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-11-28T16:58:24.381 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.VLHTTORpYO 2023-11-28T16:58:24.381 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:24.381 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/tmp/tmp.VLHTTORpYO 2023-11-28T16:58:24.430 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:24.430 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:24.483 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:24.483 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:24.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a6e9a640 1 Processor -- start 2023-11-28T16:58:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a6e9a640 1 -- start start 2023-11-28T16:58:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a6e9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a6e9a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a006d320 con 0x7fa1a014e9d0 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a6e9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a00721b0 con 0x7fa1a00a8470 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a6e9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a00c2830 con 0x7fa1a0070b80 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a4c36640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa1a014e9d0 0x7fa1a00c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44596/0 (socket says 172.21.15.26:44596) 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa1a4c36640 1 -- 172.21.15.26:0/1385341291 learned_addr learned my addr 172.21.15.26:0/1385341291 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa19ffff640 1 --2- 172.21.15.26:0/1385341291 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa19f7fe640 1 -- 172.21.15.26:0/1385341291 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177229051 0 0) 0x7fa1a006d320 con 0x7fa1a014e9d0 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa19f7fe640 1 -- 172.21.15.26:0/1385341291 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa190003530 con 0x7fa1a014e9d0 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa19f7fe640 1 -- 172.21.15.26:0/1385341291 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843527971 0 0) 0x7fa1a00721b0 con 0x7fa1a00a8470 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa19ffff640 1 -- 172.21.15.26:0/1385341291 >> v1:172.21.15.79:6789/0 conn(0x7fa1a00a8470 legacy=0x7fa1a006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa19ffff640 1 -- 172.21.15.26:0/1385341291 >> v1:172.21.15.26:6789/0 conn(0x7fa1a014e9d0 legacy=0x7fa1a00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.725+0000 7fa19ffff640 1 -- 172.21.15.26:0/1385341291 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0072450 con 0x7fa1a0070b80 2023-11-28T16:58:24.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa19ffff640 1 --2- 172.21.15.26:0/1385341291 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0151e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0097f0 tx=0x7fa18c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78efb4b09ec29276 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:24.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa19f7fe640 1 -- 172.21.15.26:0/1385341291 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0ab600 con 0x7fa1a0070b80 2023-11-28T16:58:24.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa19f7fe640 1 -- 172.21.15.26:0/1385341291 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c0a7050 con 0x7fa1a0070b80 2023-11-28T16:58:24.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa19f7fe640 1 -- 172.21.15.26:0/1385341291 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0ab980 con 0x7fa1a0070b80 2023-11-28T16:58:24.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/1385341291 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 msgr2=0x7fa1a0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/1385341291 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0151e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0097f0 tx=0x7fa18c01c430 comp rx=0 tx=0).stop 2023-11-28T16:58:24.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/1385341291 shutdown_connections 2023-11-28T16:58:24.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/1385341291 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0151e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/1385341291 >> 172.21.15.26:0/1385341291 conn(0x7fa1a00c2ad0 msgr2=0x7fa1a00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:24.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/1385341291 shutdown_connections 2023-11-28T16:58:24.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.729+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/1385341291 wait complete. 2023-11-28T16:58:24.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 Processor -- start 2023-11-28T16:58:24.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 -- start start 2023-11-28T16:58:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a00a8470 0x7fa1a01e8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1a014e9d0 0x7fa1a01529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0155510 con 0x7fa1a00a8470 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01557f0 con 0x7fa1a014e9d0 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01e87a0 con 0x7fa1a0070b80 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a00a8470 0x7fa1a01e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a00a8470 0x7fa1a01e8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34466/0 (socket says 172.21.15.26:34466) 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 -- 172.21.15.26:0/4204050948 learned_addr learned my addr 172.21.15.26:0/4204050948 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a4c36640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a5437640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1a014e9d0 0x7fa1a01529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 -- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 msgr2=0x7fa1a0154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 -- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1a014e9d0 msgr2=0x7fa1a01529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1a014e9d0 0x7fa1a01529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 -- 172.21.15.26:0/4204050948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c009420 con 0x7fa1a00a8470 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a5437640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1a014e9d0 0x7fa1a01529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19ffff640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a00a8470 0x7fa1a01e8fa0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0097f0 tx=0x7fa18c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19d7fa640 1 -- 172.21.15.26:0/4204050948 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0b4440 con 0x7fa1a00a8470 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19d7fa640 1 -- 172.21.15.26:0/4204050948 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c0b45a0 con 0x7fa1a00a8470 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a01e8a80 con 0x7fa1a00a8470 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa19d7fa640 1 -- 172.21.15.26:0/4204050948 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0b4910 con 0x7fa1a00a8470 2023-11-28T16:58:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.733+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a0152f20 con 0x7fa1a00a8470 2023-11-28T16:58:24.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.737+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a01e8c70 con 0x7fa1a00a8470 2023-11-28T16:58:24.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.737+0000 7fa19d7fa640 1 -- 172.21.15.26:0/4204050948 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa18c0b2070 con 0x7fa1a00a8470 2023-11-28T16:58:24.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.737+0000 7fa19d7fa640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa184066900 0x7fa184068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:24.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.737+0000 7fa19d7fa640 1 -- 172.21.15.26:0/4204050948 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa18c11e610 con 0x7fa1a00a8470 2023-11-28T16:58:24.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.737+0000 7fa1a4c36640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa184066900 0x7fa184068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:24.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.737+0000 7fa1a4c36640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa184066900 0x7fa184068dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa194005890 tx=0x7fa194009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:24.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.741+0000 7fa19d7fa640 1 -- 172.21.15.26:0/4204050948 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa18c0eb580 con 0x7fa1a00a8470 2023-11-28T16:58:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.901+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a004e890 con 0x7fa1a00a8470 2023-11-28T16:58:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa19d7fa640 1 -- 172.21.15.26:0/4204050948 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20208 (secure 0 0 0) 0x7fa18c0b0090 con 0x7fa1a00a8470 2023-11-28T16:58:24.907 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:24.907 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:11.370310+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa184066900 msgr2=0x7fa184068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa184066900 0x7fa184068dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa194005890 tx=0x7fa194009040 comp rx=0 tx=0).stop 2023-11-28T16:58:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a00a8470 msgr2=0x7fa1a01e8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a00a8470 0x7fa1a01e8fa0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0097f0 tx=0x7fa18c01ac70 comp rx=0 tx=0).stop 2023-11-28T16:58:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 shutdown_connections 2023-11-28T16:58:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1a014e9d0 0x7fa1a01529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a00a8470 0x7fa1a01e8fa0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa184066900 0x7fa184068dc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 --2- 172.21.15.26:0/4204050948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa1a0070b80 0x7fa1a0154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 >> 172.21.15.26:0/4204050948 conn(0x7fa1a00c2ad0 msgr2=0x7fa1a015c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 shutdown_connections 2023-11-28T16:58:24.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:24.905+0000 7fa1a6e9a640 1 -- 172.21.15.26:0/4204050948 wait complete. 2023-11-28T16:58:24.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:54.472607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:55.658818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:58:07.830332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:58:08.744612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:24.929 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcc0205f640 1 Processor -- start 2023-11-28T16:58:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcc0205f640 1 -- start start 2023-11-28T16:58:25.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcc0205f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcbfc14eaf0 0x7fcbfc151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcc0205f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc151f90 0x7fcbfc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcc0205f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc06de00 con 0x7fcbfc0c0370 2023-11-28T16:58:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcc0205f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc070390 con 0x7fcbfc14eaf0 2023-11-28T16:58:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcc0205f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc14eed0 con 0x7fcbfc151f90 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfaffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc151f90 0x7fcbfc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcbfc14eaf0 0x7fcbfc151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcbfc14eaf0 0x7fcbfc151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:37484/0 (socket says 172.21.15.26:37484) 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfb7fe640 1 -- 172.21.15.26:0/3048756478 learned_addr learned my addr 172.21.15.26:0/3048756478 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfbfff640 1 --1- 172.21.15.26:0/3048756478 >> v1:172.21.15.79:6789/0 conn(0x7fcbfc0c0370 0x7fcbfc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:59740/0 (socket says 172.21.15.26:59740) 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfb7fe640 1 -- 172.21.15.26:0/3048756478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc151f90 msgr2=0x7fcbfc06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfb7fe640 1 --2- 172.21.15.26:0/3048756478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc151f90 0x7fcbfc06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfb7fe640 1 -- 172.21.15.26:0/3048756478 >> v1:172.21.15.79:6789/0 conn(0x7fcbfc0c0370 legacy=0x7fcbfc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.073+0000 7fcbfb7fe640 1 -- 172.21.15.26:0/3048756478 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc151270 con 0x7fcbfc14eaf0 2023-11-28T16:58:25.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcbfb7fe640 1 --2- 172.21.15.26:0/3048756478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 0x7fcbfc151a50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009870 tx=0x7fcbec01e600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d4661ccda91df5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcbfa7fc640 1 -- 172.21.15.26:0/3048756478 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0aa630 con 0x7fcbfc14eaf0 2023-11-28T16:58:25.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcbfa7fc640 1 -- 172.21.15.26:0/3048756478 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec0aa790 con 0x7fcbfc14eaf0 2023-11-28T16:58:25.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcbfa7fc640 1 -- 172.21.15.26:0/3048756478 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0aab20 con 0x7fcbfc14eaf0 2023-11-28T16:58:25.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 -- 172.21.15.26:0/3048756478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 msgr2=0x7fcbfc151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 --2- 172.21.15.26:0/3048756478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 0x7fcbfc151a50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009870 tx=0x7fcbec01e600 comp rx=0 tx=0).stop 2023-11-28T16:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 -- 172.21.15.26:0/3048756478 shutdown_connections 2023-11-28T16:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 --2- 172.21.15.26:0/3048756478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc151f90 0x7fcbfc06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 --2- 172.21.15.26:0/3048756478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 0x7fcbfc151a50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 -- 172.21.15.26:0/3048756478 >> 172.21.15.26:0/3048756478 conn(0x7fcbfc0c2a60 msgr2=0x7fcbfc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 -- 172.21.15.26:0/3048756478 shutdown_connections 2023-11-28T16:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.077+0000 7fcc0205f640 1 -- 172.21.15.26:0/3048756478 wait complete. 2023-11-28T16:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 Processor -- start 2023-11-28T16:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 -- start start 2023-11-28T16:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc0c0370 0x7fcbfc1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 0x7fcbfc0c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbfc0aa590 0x7fcbfc1ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc148a00 con 0x7fcbfc0aa590 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0abfb0 con 0x7fcbfc14eaf0 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0ab7d0 con 0x7fcbfc0c0370 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbfc0aa590 0x7fcbfc1ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbfc0aa590 0x7fcbfc1ed3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34478/0 (socket says 172.21.15.26:34478) 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 -- 172.21.15.26:0/1736331066 learned_addr learned my addr 172.21.15.26:0/1736331066 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfaffd640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 0x7fcbfc0c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfb7fe640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc0c0370 0x7fcbfc1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 -- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc0c0370 msgr2=0x7fcbfc1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc0c0370 0x7fcbfc1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 -- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 msgr2=0x7fcbfc0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 0x7fcbfc0c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 -- 172.21.15.26:0/1736331066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0094d0 con 0x7fcbfc0aa590 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbfbfff640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbfc0aa590 0x7fcbfc1ed3c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c7a0 tx=0x7fcbf400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbe3fff640 1 -- 172.21.15.26:0/1736331066 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400a640 con 0x7fcbfc0aa590 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbe3fff640 1 -- 172.21.15.26:0/1736331066 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf400a7a0 con 0x7fcbfc0aa590 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcbe3fff640 1 -- 172.21.15.26:0/1736331066 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400ab10 con 0x7fcbfc0aa590 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc0c2760 con 0x7fcbfc0aa590 2023-11-28T16:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.081+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc0aa2b0 con 0x7fcbfc0aa590 2023-11-28T16:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.085+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc04e890 con 0x7fcbfc0aa590 2023-11-28T16:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.085+0000 7fcbe3fff640 1 -- 172.21.15.26:0/1736331066 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcbf400ac70 con 0x7fcbfc0aa590 2023-11-28T16:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.085+0000 7fcbe3fff640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcbe80668d0 0x7fcbe8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.085+0000 7fcbe3fff640 1 -- 172.21.15.26:0/1736331066 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcbf4083f00 con 0x7fcbfc0aa590 2023-11-28T16:58:25.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.085+0000 7fcbfb7fe640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcbe80668d0 0x7fcbe8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.085+0000 7fcbfb7fe640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcbe80668d0 0x7fcbe8068d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0b1000 tx=0x7fcbec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.089+0000 7fcbe3fff640 1 -- 172.21.15.26:0/1736331066 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbf4050e80 con 0x7fcbfc0aa590 2023-11-28T16:58:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbfc150890 con 0x7fcbfc0aa590 2023-11-28T16:58:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcbe3fff640 1 -- 172.21.15.26:0/1736331066 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbf4017020 con 0x7fcbfc0aa590 2023-11-28T16:58:25.252 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcbe80668d0 msgr2=0x7fcbe8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcbe80668d0 0x7fcbe8068d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0b1000 tx=0x7fcbec008040 comp rx=0 tx=0).stop 2023-11-28T16:58:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbfc0aa590 msgr2=0x7fcbfc1ed3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbfc0aa590 0x7fcbfc1ed3c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c7a0 tx=0x7fcbf400cc60 comp rx=0 tx=0).stop 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 shutdown_connections 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbfc0aa590 0x7fcbfc1ed3c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbfc14eaf0 0x7fcbfc0c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcbe80668d0 0x7fcbe8068d90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 --2- 172.21.15.26:0/1736331066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcbfc0c0370 0x7fcbfc1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.249+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 >> 172.21.15.26:0/1736331066 conn(0x7fcbfc0c2a60 msgr2=0x7fcbfc150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.253+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 shutdown_connections 2023-11-28T16:58:25.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.253+0000 7fcc0205f640 1 -- 172.21.15.26:0/1736331066 wait complete. 2023-11-28T16:58:25.274 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:58:25.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.417+0000 7f64cb281640 1 Processor -- start 2023-11-28T16:58:25.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.417+0000 7f64cb281640 1 -- start start 2023-11-28T16:58:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64cb281640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c40c2750 0x7f64c40bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64cb281640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64c4071f30 0x7f64c40bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64cb281640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c40c1410 con 0x7f64c40c0460 2023-11-28T16:58:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64cb281640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c40c0e90 con 0x7f64c4071f30 2023-11-28T16:58:25.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64cb281640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40c1130 con 0x7f64c40c2750 2023-11-28T16:58:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64caa80640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64c4071f30 0x7f64c40bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64caa80640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64c4071f30 0x7f64c40bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:37490/0 (socket says 172.21.15.26:37490) 2023-11-28T16:58:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64caa80640 1 -- 172.21.15.26:0/431927074 learned_addr learned my addr 172.21.15.26:0/431927074 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64ca27f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c40c2750 0x7f64c40bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64caa80640 1 -- 172.21.15.26:0/431927074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c40c2750 msgr2=0x7f64c40bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64caa80640 1 --2- 172.21.15.26:0/431927074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c40c2750 0x7f64c40bc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64caa80640 1 -- 172.21.15.26:0/431927074 >> v1:172.21.15.79:6789/0 conn(0x7f64c40c0460 legacy=0x7f64c40c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64caa80640 1 -- 172.21.15.26:0/431927074 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c406da20 con 0x7f64c4071f30 2023-11-28T16:58:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.421+0000 7f64c927d640 1 -- 172.21.15.26:0/431927074 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294304267 0 0) 0x7f64c40c1410 con 0x7f64c40c0460 2023-11-28T16:58:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64caa80640 1 --2- 172.21.15.26:0/431927074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4071f30 0x7f64c40bc8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e50 tx=0x7f64bc01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b5e36985f477ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64c927d640 1 -- 172.21.15.26:0/431927074 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0a57a0 con 0x7f64c4071f30 2023-11-28T16:58:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64c927d640 1 -- 172.21.15.26:0/431927074 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40c4020 con 0x7f64c4071f30 2023-11-28T16:58:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64c927d640 1 -- 172.21.15.26:0/431927074 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0a5b20 con 0x7f64c4071f30 2023-11-28T16:58:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 -- 172.21.15.26:0/431927074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4071f30 msgr2=0x7f64c40bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 --2- 172.21.15.26:0/431927074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4071f30 0x7f64c40bc8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e50 tx=0x7f64bc01c8c0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 -- 172.21.15.26:0/431927074 shutdown_connections 2023-11-28T16:58:25.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 --2- 172.21.15.26:0/431927074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4071f30 0x7f64c40bc8b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 --2- 172.21.15.26:0/431927074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c40c2750 0x7f64c40bc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 -- 172.21.15.26:0/431927074 >> 172.21.15.26:0/431927074 conn(0x7f64c40c5a60 msgr2=0x7f64c40c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 -- 172.21.15.26:0/431927074 shutdown_connections 2023-11-28T16:58:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 -- 172.21.15.26:0/431927074 wait complete. 2023-11-28T16:58:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 Processor -- start 2023-11-28T16:58:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.425+0000 7f64cb281640 1 -- start start 2023-11-28T16:58:25.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c4071f30 0x7f64c41ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64c40c0460 0x7f64c414a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c40c2750 0x7f64c4148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c414a490 con 0x7f64c40c0460 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c4149e80 con 0x7f64c40c2750 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41edd30 con 0x7f64c4071f30 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64c40c0460 0x7f64c414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64c40c0460 0x7f64c414a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34492/0 (socket says 172.21.15.26:34492) 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 -- 172.21.15.26:0/2344319361 learned_addr learned my addr 172.21.15.26:0/2344319361 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64caa80640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c40c2750 0x7f64c4148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64ca27f640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c4071f30 0x7f64c41ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 -- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c4071f30 msgr2=0x7f64c41ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c4071f30 0x7f64c41ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 -- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c40c2750 msgr2=0x7f64c4148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c40c2750 0x7f64c4148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 -- 172.21.15.26:0/2344319361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc009b30 con 0x7f64c40c0460 2023-11-28T16:58:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64c9a7e640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64c40c0460 0x7f64c414a920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f64b4001ec0 tx=0x7f64b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64baffd640 1 -- 172.21.15.26:0/2344319361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40054e0 con 0x7f64c40c0460 2023-11-28T16:58:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64baffd640 1 -- 172.21.15.26:0/2344319361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4003600 con 0x7f64c40c0460 2023-11-28T16:58:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64baffd640 1 -- 172.21.15.26:0/2344319361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40039b0 con 0x7f64c40c0460 2023-11-28T16:58:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c414a120 con 0x7f64c40c0460 2023-11-28T16:58:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c41557d0 con 0x7f64c40c0460 2023-11-28T16:58:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c40680c0 con 0x7f64c40c0460 2023-11-28T16:58:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.429+0000 7f64baffd640 1 -- 172.21.15.26:0/2344319361 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f64b4003b10 con 0x7f64c40c0460 2023-11-28T16:58:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.433+0000 7f64baffd640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64a80668d0 0x7f64a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.433+0000 7f64baffd640 1 -- 172.21.15.26:0/2344319361 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f64b4083c40 con 0x7f64c40c0460 2023-11-28T16:58:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.433+0000 7f64ca27f640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64a80668d0 0x7f64a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.433+0000 7f64ca27f640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64a80668d0 0x7f64a8068d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009b60 tx=0x7f64c0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.437+0000 7f64baffd640 1 -- 172.21.15.26:0/2344319361 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64b4050c60 con 0x7f64c40c0460 2023-11-28T16:58:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64c4074970 con 0x7f64c40c0460 2023-11-28T16:58:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64baffd640 1 -- 172.21.15.26:0/2344319361 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64b4017020 con 0x7f64c40c0460 2023-11-28T16:58:25.596 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64a80668d0 msgr2=0x7f64a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64a80668d0 0x7f64a8068d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009b60 tx=0x7f64c0009190 comp rx=0 tx=0).stop 2023-11-28T16:58:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64c40c0460 msgr2=0x7f64c414a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64c40c0460 0x7f64c414a920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f64b4001ec0 tx=0x7f64b400c8e0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 shutdown_connections 2023-11-28T16:58:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c40c2750 0x7f64c4148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64c40c0460 0x7f64c414a920 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64a80668d0 0x7f64a8068d90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 --2- 172.21.15.26:0/2344319361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64c4071f30 0x7f64c41ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 >> 172.21.15.26:0/2344319361 conn(0x7f64c40c5a60 msgr2=0x7f64c40a5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 shutdown_connections 2023-11-28T16:58:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.593+0000 7f64cb281640 1 -- 172.21.15.26:0/2344319361 wait complete. 2023-11-28T16:58:25.617 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:58:25.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f13e17640 1 Processor -- start 2023-11-28T16:58:25.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f13e17640 1 -- start start 2023-11-28T16:58:25.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f13e17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 0x7f4f0c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f13e17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c154920 con 0x7f4f0c0700f0 2023-11-28T16:58:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f13e17640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c154b90 con 0x7f4f0c06df30 2023-11-28T16:58:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f13e17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0a8710 con 0x7f4f0c154000 2023-11-28T16:58:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f113b2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4f0c0700f0 0x7f4f0c070f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44602/0 (socket says 172.21.15.26:44602) 2023-11-28T16:58:25.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f113b2640 1 -- 172.21.15.26:0/1103459736 learned_addr learned my addr 172.21.15.26:0/1103459736 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:25.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f11bb3640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 0x7f4f0c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642510356 0 0) 0x7f4f0c154920 con 0x7f4f0c0700f0 2023-11-28T16:58:25.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef8003530 con 0x7f4f0c0700f0 2023-11-28T16:58:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3447214157 0 0) 0x7f4ef8003530 con 0x7f4f0c0700f0 2023-11-28T16:58:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 msgr2=0x7f4f0c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 0x7f4f0c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 >> v1:172.21.15.79:6789/0 conn(0x7f4f0c06df30 legacy=0x7f4f0c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0abd70 con 0x7f4f0c0700f0 2023-11-28T16:58:25.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f4efc001680 con 0x7f4f0c0700f0 2023-11-28T16:58:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 >> v1:172.21.15.26:6789/0 conn(0x7f4f0c0700f0 legacy=0x7f4f0c070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef80039b0 0x7f4ef8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 0x7f4ef80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4ef8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef800cc30 con 0x7f4ef8004d10 2023-11-28T16:58:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef800cd70 con 0x7f4ef80039b0 2023-11-28T16:58:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.761+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef800cf30 con 0x7f4f0c154000 2023-11-28T16:58:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f123b4640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4ef8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f11bb3640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef80039b0 0x7f4ef8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f113b2640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 0x7f4ef80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f123b4640 1 -- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 msgr2=0x7f4ef80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f123b4640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c154000 0x7f4ef80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f123b4640 1 -- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef80039b0 msgr2=0x7f4ef8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:25.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f123b4640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef80039b0 0x7f4ef8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f123b4640 1 -- 172.21.15.26:0/1103459736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8003530 con 0x7f4ef8004d10 2023-11-28T16:58:25.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f123b4640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4ef8005190 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4f04001f60 tx=0x7f4f040211e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bdebca70924014 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040aae00 con 0x7f4ef8004d10 2023-11-28T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f040b2440 con 0x7f4ef8004d10 2023-11-28T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f10bb1640 1 -- 172.21.15.26:0/1103459736 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040b27f0 con 0x7f4ef8004d10 2023-11-28T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f13e17640 1 -- 172.21.15.26:0/1103459736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 msgr2=0x7f4ef8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.765+0000 7f4f13e17640 1 --2- 172.21.15.26:0/1103459736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4ef8005190 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4f04001f60 tx=0x7f4f040211e0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f123b4640 1 -- 172.21.15.26:0/1103459736 reap_dead start 2023-11-28T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- 172.21.15.26:0/1103459736 shutdown_connections 2023-11-28T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- 172.21.15.26:0/1103459736 >> 172.21.15.26:0/1103459736 conn(0x7f4f0c0c2a60 msgr2=0x7f4f0c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- 172.21.15.26:0/1103459736 shutdown_connections 2023-11-28T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- 172.21.15.26:0/1103459736 wait complete. 2023-11-28T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 Processor -- start 2023-11-28T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- start start 2023-11-28T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4f0c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c1ea5c0 0x7f4f0c14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f0c142230 0x7f4f0c141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14ea50 con 0x7f4ef8004d10 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c151780 con 0x7f4f0c142230 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f13e17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0c5c10 con 0x7f4f0c1ea5c0 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4f0c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4f0c14edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34510/0 (socket says 172.21.15.26:34510) 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 -- 172.21.15.26:0/1752119837 learned_addr learned my addr 172.21.15.26:0/1752119837 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f123b4640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f0c142230 0x7f4f0c141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f113b2640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c1ea5c0 0x7f4f0c14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 -- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c1ea5c0 msgr2=0x7f4f0c14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c1ea5c0 0x7f4f0c14f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 -- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f0c142230 msgr2=0x7f4f0c141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f0c142230 0x7f4f0c141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 -- 172.21.15.26:0/1752119837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c14e5c0 con 0x7f4ef8004d10 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.769+0000 7f4f11bb3640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4f0c14edb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4f08011a00 tx=0x7f4f08011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f027fc640 1 -- 172.21.15.26:0/1752119837 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800fb50 con 0x7f4ef8004d10 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f027fc640 1 -- 172.21.15.26:0/1752119837 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0800fcb0 con 0x7f4ef8004d10 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c14f8f0 con 0x7f4ef8004d10 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f027fc640 1 -- 172.21.15.26:0/1752119837 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08014440 con 0x7f4ef8004d10 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c0c5930 con 0x7f4ef8004d10 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c04e890 con 0x7f4ef8004d10 2023-11-28T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f027fc640 1 -- 172.21.15.26:0/1752119837 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4f080145a0 con 0x7f4ef8004d10 2023-11-28T16:58:25.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f027fc640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ef0066900 0x7f4ef0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:25.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f027fc640 1 -- 172.21.15.26:0/1752119837 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4f08084f00 con 0x7f4ef8004d10 2023-11-28T16:58:25.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.773+0000 7f4f113b2640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ef0066900 0x7f4ef0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:25.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.777+0000 7f4f113b2640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ef0066900 0x7f4ef0068dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c1e79b0 tx=0x7f4efc000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:25.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.777+0000 7f4f027fc640 1 -- 172.21.15.26:0/1752119837 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f08051f40 con 0x7f4ef8004d10 2023-11-28T16:58:25.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.933+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f0c14e390 con 0x7f4ef8004d10 2023-11-28T16:58:25.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.933+0000 7f4f027fc640 1 -- 172.21.15.26:0/1752119837 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f08055560 con 0x7f4ef8004d10 2023-11-28T16:58:25.938 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:25.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ef0066900 msgr2=0x7f4ef0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ef0066900 0x7f4ef0068dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c1e79b0 tx=0x7f4efc000f90 comp rx=0 tx=0).stop 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 msgr2=0x7f4f0c14edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4f0c14edb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4f08011a00 tx=0x7f4f08011ec0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 shutdown_connections 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f0c142230 0x7f4f0c141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4ef0066900 0x7f4ef0068dc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f0c1ea5c0 0x7f4f0c14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 --2- 172.21.15.26:0/1752119837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8004d10 0x7f4f0c14edb0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 >> 172.21.15.26:0/1752119837 conn(0x7f4f0c0c2a60 msgr2=0x7f4f0c0a99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 shutdown_connections 2023-11-28T16:58:25.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:25.937+0000 7f4f13e17640 1 -- 172.21.15.26:0/1752119837 wait complete. 2023-11-28T16:58:25.959 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:58:26.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.101+0000 7f92dd05f640 1 Processor -- start 2023-11-28T16:58:26.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.101+0000 7f92dd05f640 1 -- start start 2023-11-28T16:58:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92dd05f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d80a86d0 0x7f92d80a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92dd05f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92d8156600 0x7f92d814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92dd05f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d8152d90 con 0x7f92d814fb30 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92dd05f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d8152480 con 0x7f92d8156600 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92dd05f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80a9760 con 0x7f92d80a86d0 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92cffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92d8156600 0x7f92d814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92d759e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f92d814fb30 0x7f92d80aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44608/0 (socket says 172.21.15.26:44608) 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92d759e640 1 -- 172.21.15.26:0/3841233765 learned_addr learned my addr 172.21.15.26:0/3841233765 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92d6d9d640 1 --2- 172.21.15.26:0/3841233765 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d80a86d0 0x7f92d80a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92cffff640 1 -- 172.21.15.26:0/3841233765 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d80a86d0 msgr2=0x7f92d80a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92cffff640 1 --2- 172.21.15.26:0/3841233765 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d80a86d0 0x7f92d80a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92cffff640 1 -- 172.21.15.26:0/3841233765 >> v1:172.21.15.26:6789/0 conn(0x7f92d814fb30 legacy=0x7f92d80aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92cffff640 1 -- 172.21.15.26:0/3841233765 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d8152740 con 0x7f92d8156600 2023-11-28T16:58:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.105+0000 7f92d659c640 1 -- 172.21.15.26:0/3841233765 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231780961 0 0) 0x7f92d8152d90 con 0x7f92d814fb30 2023-11-28T16:58:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92cffff640 1 --2- 172.21.15.26:0/3841233765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d8156600 0x7f92d814f5f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f92c00097c0 tx=0x7f92c001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab37822ae5e245a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92d659c640 1 -- 172.21.15.26:0/3841233765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c00ab600 con 0x7f92d8156600 2023-11-28T16:58:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92d659c640 1 -- 172.21.15.26:0/3841233765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c00a7050 con 0x7f92d8156600 2023-11-28T16:58:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92d659c640 1 -- 172.21.15.26:0/3841233765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c00ab980 con 0x7f92d8156600 2023-11-28T16:58:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- 172.21.15.26:0/3841233765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d8156600 msgr2=0x7f92d814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3841233765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d8156600 0x7f92d814f5f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f92c00097c0 tx=0x7f92c001c480 comp rx=0 tx=0).stop 2023-11-28T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- 172.21.15.26:0/3841233765 shutdown_connections 2023-11-28T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3841233765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d8156600 0x7f92d814f5f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3841233765 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d80a86d0 0x7f92d80a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- 172.21.15.26:0/3841233765 >> 172.21.15.26:0/3841233765 conn(0x7f92d80c2a60 msgr2=0x7f92d80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- 172.21.15.26:0/3841233765 shutdown_connections 2023-11-28T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- 172.21.15.26:0/3841233765 wait complete. 2023-11-28T16:58:26.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 Processor -- start 2023-11-28T16:58:26.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- start start 2023-11-28T16:58:26.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d80a86d0 0x7f92d81eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d814fb30 0x7f92d81eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d8156600 0x7f92d81537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d806d520 con 0x7f92d80a86d0 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81ef290 con 0x7f92d814fb30 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.109+0000 7f92dd05f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d814e320 con 0x7f92d8156600 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d80a86d0 0x7f92d81eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d80a86d0 0x7f92d81eb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34534/0 (socket says 172.21.15.26:34534) 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 -- 172.21.15.26:0/3450671775 learned_addr learned my addr 172.21.15.26:0/3450671775 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d759e640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d8156600 0x7f92d81537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92cffff640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d814fb30 0x7f92d81eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 -- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d8156600 msgr2=0x7f92d81537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d8156600 0x7f92d81537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 -- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d814fb30 msgr2=0x7f92d81eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d814fb30 0x7f92d81eed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 -- 172.21.15.26:0/3450671775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009420 con 0x7f92d80a86d0 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d759e640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d8156600 0x7f92d81537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92cffff640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d814fb30 0x7f92d81eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92d6d9d640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d80a86d0 0x7f92d81eb9c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f92c800d800 tx=0x7f92c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92cf7fe640 1 -- 172.21.15.26:0/3450671775 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800b6c0 con 0x7f92d80a86d0 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92cf7fe640 1 -- 172.21.15.26:0/3450671775 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800b820 con 0x7f92d80a86d0 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92cf7fe640 1 -- 172.21.15.26:0/3450671775 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800bb90 con 0x7f92d80a86d0 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d814e600 con 0x7f92d80a86d0 2023-11-28T16:58:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d81eb1c0 con 0x7f92d80a86d0 2023-11-28T16:58:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d804e890 con 0x7f92d80a86d0 2023-11-28T16:58:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92cf7fe640 1 -- 172.21.15.26:0/3450671775 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f92c800bcf0 con 0x7f92d80a86d0 2023-11-28T16:58:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.113+0000 7f92cf7fe640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f92b80668d0 0x7f92b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.117+0000 7f92cf7fe640 1 -- 172.21.15.26:0/3450671775 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f92c8084cd0 con 0x7f92d80a86d0 2023-11-28T16:58:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.117+0000 7f92cffff640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f92b80668d0 0x7f92b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.117+0000 7f92cffff640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f92b80668d0 0x7f92b8068d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f92c00ad000 tx=0x7f92c00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.117+0000 7f92cf7fe640 1 -- 172.21.15.26:0/3450671775 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92c8051ba0 con 0x7f92d80a86d0 2023-11-28T16:58:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92d80c3230 con 0x7f92d80a86d0 2023-11-28T16:58:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92cf7fe640 1 -- 172.21.15.26:0/3450671775 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f92c80551c0 con 0x7f92d80a86d0 2023-11-28T16:58:26.280 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f92b80668d0 msgr2=0x7f92b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f92b80668d0 0x7f92b8068d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f92c00ad000 tx=0x7f92c00a6000 comp rx=0 tx=0).stop 2023-11-28T16:58:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d80a86d0 msgr2=0x7f92d81eb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d80a86d0 0x7f92d81eb9c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f92c800d800 tx=0x7f92c800dcc0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 shutdown_connections 2023-11-28T16:58:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f92b80668d0 0x7f92b8068d90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92d8156600 0x7f92d81537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d814fb30 0x7f92d81eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 --2- 172.21.15.26:0/3450671775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92d80a86d0 0x7f92d81eb9c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 >> 172.21.15.26:0/3450671775 conn(0x7f92d80c2a60 msgr2=0x7f92d80ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 shutdown_connections 2023-11-28T16:58:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.277+0000 7f92dd05f640 1 -- 172.21.15.26:0/3450671775 wait complete. 2023-11-28T16:58:26.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:58:26.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5746d80640 1 Processor -- start 2023-11-28T16:58:26.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5746d80640 1 -- start start 2023-11-28T16:58:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5746d80640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5740151d80 0x7f57400c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5746d80640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c7f20 0x7f574006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5746d80640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574006cf70 con 0x7f57400c8430 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5746d80640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5740152160 con 0x7f5740151d80 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5746d80640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400c6a30 con 0x7f57400c7f20 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5744b1c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5740151d80 0x7f57400c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5744b1c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5740151d80 0x7f57400c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34542/0 (socket says 172.21.15.26:34542) 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5744b1c640 1 -- 172.21.15.26:0/773699137 learned_addr learned my addr 172.21.15.26:0/773699137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f574531d640 1 --2- 172.21.15.26:0/773699137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c7f20 0x7f574006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5744b1c640 1 -- 172.21.15.26:0/773699137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c7f20 msgr2=0x7f574006be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5744b1c640 1 --2- 172.21.15.26:0/773699137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c7f20 0x7f574006be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5744b1c640 1 -- 172.21.15.26:0/773699137 >> v1:172.21.15.79:6789/0 conn(0x7f57400c8430 legacy=0x7f574006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.449+0000 7f5744b1c640 1 -- 172.21.15.26:0/773699137 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400c72d0 con 0x7f5740151d80 2023-11-28T16:58:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5744b1c640 1 --2- 172.21.15.26:0/773699137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5740151d80 0x7f57400c49a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5734009870 tx=0x7f573401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed3832865447423 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f573f7fe640 1 -- 172.21.15.26:0/773699137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340ab680 con 0x7f5740151d80 2023-11-28T16:58:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f573f7fe640 1 -- 172.21.15.26:0/773699137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57340ab7e0 con 0x7f5740151d80 2023-11-28T16:58:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f573f7fe640 1 -- 172.21.15.26:0/773699137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340abb70 con 0x7f5740151d80 2023-11-28T16:58:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 -- 172.21.15.26:0/773699137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5740151d80 msgr2=0x7f57400c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 --2- 172.21.15.26:0/773699137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5740151d80 0x7f57400c49a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5734009870 tx=0x7f573401c480 comp rx=0 tx=0).stop 2023-11-28T16:58:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 -- 172.21.15.26:0/773699137 shutdown_connections 2023-11-28T16:58:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 --2- 172.21.15.26:0/773699137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c7f20 0x7f574006be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 --2- 172.21.15.26:0/773699137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5740151d80 0x7f57400c49a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 -- 172.21.15.26:0/773699137 >> 172.21.15.26:0/773699137 conn(0x7f57400abd00 msgr2=0x7f57400ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 -- 172.21.15.26:0/773699137 shutdown_connections 2023-11-28T16:58:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.453+0000 7f5746d80640 1 -- 172.21.15.26:0/773699137 wait complete. 2023-11-28T16:58:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 Processor -- start 2023-11-28T16:58:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 -- start start 2023-11-28T16:58:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57400c7f20 0x7f5740145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c8430 0x7f57401432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5740151d80 0x7f5740143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400be560 con 0x7f57400c7f20 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740146980 con 0x7f5740151d80 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57401ed910 con 0x7f57400c8430 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57400c7f20 0x7f5740145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57400c7f20 0x7f5740145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34556/0 (socket says 172.21.15.26:34556) 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 -- 172.21.15.26:0/346329466 learned_addr learned my addr 172.21.15.26:0/346329466 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f573ffff640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c8430 0x7f57401432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f574531d640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5740151d80 0x7f5740143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 -- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c8430 msgr2=0x7f57401432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c8430 0x7f57401432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 -- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5740151d80 msgr2=0x7f5740143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5740151d80 0x7f5740143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 -- 172.21.15.26:0/346329466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57340094d0 con 0x7f57400c7f20 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f574531d640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5740151d80 0x7f5740143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5744b1c640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57400c7f20 0x7f5740145130 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f57340ad040 tx=0x7f573401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f573d7fa640 1 -- 172.21.15.26:0/346329466 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340b4800 con 0x7f57400c7f20 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f573d7fa640 1 -- 172.21.15.26:0/346329466 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57340b4980 con 0x7f57400c7f20 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f573d7fa640 1 -- 172.21.15.26:0/346329466 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340b4d30 con 0x7f57400c7f20 2023-11-28T16:58:26.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57401ede40 con 0x7f57400c7f20 2023-11-28T16:58:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.457+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400ab590 con 0x7f57400c7f20 2023-11-28T16:58:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.461+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574004e890 con 0x7f57400c7f20 2023-11-28T16:58:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.461+0000 7f573d7fa640 1 -- 172.21.15.26:0/346329466 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f57340c7440 con 0x7f57400c7f20 2023-11-28T16:58:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.461+0000 7f573d7fa640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57240668d0 0x7f5724068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.461+0000 7f573d7fa640 1 -- 172.21.15.26:0/346329466 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f573411f5a0 con 0x7f57400c7f20 2023-11-28T16:58:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.461+0000 7f573ffff640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57240668d0 0x7f5724068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.465+0000 7f573ffff640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57240668d0 0x7f5724068d90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f57400aad40 tx=0x7f572c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.465+0000 7f573d7fa640 1 -- 172.21.15.26:0/346329466 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57340ec520 con 0x7f57400c7f20 2023-11-28T16:58:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f574006cb20 con 0x7f57400c7f20 2023-11-28T16:58:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f573d7fa640 1 -- 172.21.15.26:0/346329466 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f57340efb40 con 0x7f57400c7f20 2023-11-28T16:58:26.628 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:26.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57240668d0 msgr2=0x7f5724068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57240668d0 0x7f5724068d90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f57400aad40 tx=0x7f572c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57400c7f20 msgr2=0x7f5740145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57400c7f20 0x7f5740145130 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f57340ad040 tx=0x7f573401acc0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 shutdown_connections 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5740151d80 0x7f5740143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57240668d0 0x7f5724068d90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57400c8430 0x7f57401432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 --2- 172.21.15.26:0/346329466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57400c7f20 0x7f5740145130 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 >> 172.21.15.26:0/346329466 conn(0x7f57400abd00 msgr2=0x7f57400c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 shutdown_connections 2023-11-28T16:58:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.625+0000 7f5746d80640 1 -- 172.21.15.26:0/346329466 wait complete. 2023-11-28T16:58:26.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:58:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.789+0000 7fa61fe17640 1 Processor -- start 2023-11-28T16:58:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.789+0000 7fa61fe17640 1 -- start start 2023-11-28T16:58:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.789+0000 7fa61fe17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa61806d100 0x7fa61806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.789+0000 7fa61fe17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61806bea0 con 0x7fa618152ce0 2023-11-28T16:58:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.789+0000 7fa61fe17640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa618159550 con 0x7fa61806db80 2023-11-28T16:58:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.789+0000 7fa61fe17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa618159b10 con 0x7fa61806d100 2023-11-28T16:58:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61dbb3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa618152ce0 0x7fa6180700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44614/0 (socket says 172.21.15.26:44614) 2023-11-28T16:58:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61dbb3640 1 -- 172.21.15.26:0/3588908732 learned_addr learned my addr 172.21.15.26:0/3588908732 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61e3b4640 1 --2- 172.21.15.26:0/3588908732 >> v2:172.21.15.26:3300/0 conn(0x7fa61806d100 0x7fa61806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61cbb1640 1 -- 172.21.15.26:0/3588908732 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935088567 0 0) 0x7fa61806bea0 con 0x7fa618152ce0 2023-11-28T16:58:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61cbb1640 1 -- 172.21.15.26:0/3588908732 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa604003530 con 0x7fa618152ce0 2023-11-28T16:58:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61e3b4640 1 -- 172.21.15.26:0/3588908732 >> v1:172.21.15.79:6789/0 conn(0x7fa61806db80 legacy=0x7fa6180c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61e3b4640 1 -- 172.21.15.26:0/3588908732 >> v1:172.21.15.26:6789/0 conn(0x7fa618152ce0 legacy=0x7fa6180700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61e3b4640 1 -- 172.21.15.26:0/3588908732 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618159830 con 0x7fa61806d100 2023-11-28T16:58:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61e3b4640 1 --2- 172.21.15.26:0/3588908732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61806c940 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa610009d90 tx=0x7fa61001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd595fd6b7e7408 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61cbb1640 1 -- 172.21.15.26:0/3588908732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100a5980 con 0x7fa61806d100 2023-11-28T16:58:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61cbb1640 1 -- 172.21.15.26:0/3588908732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6100a5ae0 con 0x7fa61806d100 2023-11-28T16:58:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.793+0000 7fa61cbb1640 1 -- 172.21.15.26:0/3588908732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100a5e70 con 0x7fa61806d100 2023-11-28T16:58:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- 172.21.15.26:0/3588908732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 msgr2=0x7fa61806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 --2- 172.21.15.26:0/3588908732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61806c940 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa610009d90 tx=0x7fa61001c8c0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- 172.21.15.26:0/3588908732 shutdown_connections 2023-11-28T16:58:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 --2- 172.21.15.26:0/3588908732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61806c940 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- 172.21.15.26:0/3588908732 >> 172.21.15.26:0/3588908732 conn(0x7fa6180c2ad0 msgr2=0x7fa6180c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- 172.21.15.26:0/3588908732 shutdown_connections 2023-11-28T16:58:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- 172.21.15.26:0/3588908732 wait complete. 2023-11-28T16:58:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 Processor -- start 2023-11-28T16:58:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- start start 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61813ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa61806db80 0x7fa6181477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa618152ce0 0x7fa618147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa618148230 con 0x7fa61806d100 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa618158270 con 0x7fa618152ce0 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61fe17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa618158520 con 0x7fa61806db80 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61813ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61813ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34572/0 (socket says 172.21.15.26:34572) 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 -- 172.21.15.26:0/462514163 learned_addr learned my addr 172.21.15.26:0/462514163 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61e3b4640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa618152ce0 0x7fa618147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61d3b2640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa61806db80 0x7fa6181477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 -- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa61806db80 msgr2=0x7fa6181477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa61806db80 0x7fa6181477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 -- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa618152ce0 msgr2=0x7fa618147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa618152ce0 0x7fa618147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61dbb3640 1 -- 172.21.15.26:0/462514163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610009a70 con 0x7fa61806d100 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.797+0000 7fa61e3b4640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa618152ce0 0x7fa618147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa61dbb3640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61813ae80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c420 tx=0x7fa61400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa60e7fc640 1 -- 172.21.15.26:0/462514163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614005cf0 con 0x7fa61806d100 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa60e7fc640 1 -- 172.21.15.26:0/462514163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614005e50 con 0x7fa61806d100 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa618158800 con 0x7fa61806d100 2023-11-28T16:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa60e7fc640 1 -- 172.21.15.26:0/462514163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140072d0 con 0x7fa61806d100 2023-11-28T16:58:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61814e7f0 con 0x7fa61806d100 2023-11-28T16:58:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61804e890 con 0x7fa61806d100 2023-11-28T16:58:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa60e7fc640 1 -- 172.21.15.26:0/462514163 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa614007430 con 0x7fa61806d100 2023-11-28T16:58:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa60e7fc640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5fc0668d0 0x7fa5fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa60e7fc640 1 -- 172.21.15.26:0/462514163 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa614083c20 con 0x7fa61806d100 2023-11-28T16:58:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.801+0000 7fa61d3b2640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5fc0668d0 0x7fa5fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.805+0000 7fa61d3b2640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5fc0668d0 0x7fa5fc068d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa6181421c0 tx=0x7fa608009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:26.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.805+0000 7fa60e7fc640 1 -- 172.21.15.26:0/462514163 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa614050ba0 con 0x7fa61806d100 2023-11-28T16:58:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.977+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa618145340 con 0x7fa61806d100 2023-11-28T16:58:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.977+0000 7fa60e7fc640 1 -- 172.21.15.26:0/462514163 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa614017020 con 0x7fa61806d100 2023-11-28T16:58:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:58:26.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5fc0668d0 msgr2=0x7fa5fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5fc0668d0 0x7fa5fc068d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa6181421c0 tx=0x7fa608009040 comp rx=0 tx=0).stop 2023-11-28T16:58:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 msgr2=0x7fa61813ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61813ae80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c420 tx=0x7fa61400c8e0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 shutdown_connections 2023-11-28T16:58:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa618152ce0 0x7fa618147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5fc0668d0 0x7fa5fc068d90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa61806db80 0x7fa6181477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 --2- 172.21.15.26:0/462514163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa61806d100 0x7fa61813ae80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 >> 172.21.15.26:0/462514163 conn(0x7fa6180c2ad0 msgr2=0x7fa6180c1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 shutdown_connections 2023-11-28T16:58:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:26.981+0000 7fa61fe17640 1 -- 172.21.15.26:0/462514163 wait complete. 2023-11-28T16:58:27.003 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T16:58:27.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:27.004 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:27.033 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:58:27.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:27.033 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T16:58:27.087 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:27.087 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:27.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:58:27.144 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:58:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.329+0000 7f36b0796640 1 Processor -- start 2023-11-28T16:58:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.329+0000 7f36b0796640 1 -- start start 2023-11-28T16:58:27.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36b0796640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36a8070b80 0x7f36a8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:27.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36b0796640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36a80a8470 0x7f36a806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:27.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36b0796640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a806d320 con 0x7f36a814e9d0 2023-11-28T16:58:27.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36b0796640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80721b0 con 0x7f36a80a8470 2023-11-28T16:58:27.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36b0796640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80c2830 con 0x7f36a8070b80 2023-11-28T16:58:27.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36ae532640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f36a814e9d0 0x7f36a80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44618/0 (socket says 172.21.15.26:44618) 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36ae532640 1 -- 172.21.15.26:0/2168191628 learned_addr learned my addr 172.21.15.26:0/2168191628 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36aed33640 1 --2- 172.21.15.26:0/2168191628 >> v2:172.21.15.26:3300/0 conn(0x7f36a80a8470 0x7f36a806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36add31640 1 --2- 172.21.15.26:0/2168191628 >> v2:172.21.15.79:3300/0 conn(0x7f36a8070b80 0x7f36a8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36ad530640 1 -- 172.21.15.26:0/2168191628 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565353470 0 0) 0x7f36a806d320 con 0x7f36a814e9d0 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36aed33640 1 -- 172.21.15.26:0/2168191628 >> v2:172.21.15.79:3300/0 conn(0x7f36a8070b80 msgr2=0x7f36a8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36aed33640 1 --2- 172.21.15.26:0/2168191628 >> v2:172.21.15.79:3300/0 conn(0x7f36a8070b80 0x7f36a8151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36aed33640 1 -- 172.21.15.26:0/2168191628 >> v1:172.21.15.26:6789/0 conn(0x7f36a814e9d0 legacy=0x7f36a80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.333+0000 7f36aed33640 1 -- 172.21.15.26:0/2168191628 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8072450 con 0x7f36a80a8470 2023-11-28T16:58:27.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36aed33640 1 --2- 172.21.15.26:0/2168191628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a806d7b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f36a806e420 tx=0x7f36a001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b997d6ae58c22581 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36ad530640 1 -- 172.21.15.26:0/2168191628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00a5850 con 0x7f36a80a8470 2023-11-28T16:58:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36ad530640 1 -- 172.21.15.26:0/2168191628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a00a59b0 con 0x7f36a80a8470 2023-11-28T16:58:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36ad530640 1 -- 172.21.15.26:0/2168191628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00a5d40 con 0x7f36a80a8470 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 -- 172.21.15.26:0/2168191628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 msgr2=0x7f36a806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 --2- 172.21.15.26:0/2168191628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a806d7b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f36a806e420 tx=0x7f36a001c880 comp rx=0 tx=0).stop 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 -- 172.21.15.26:0/2168191628 shutdown_connections 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 --2- 172.21.15.26:0/2168191628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a806d7b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 --2- 172.21.15.26:0/2168191628 >> v2:172.21.15.79:3300/0 conn(0x7f36a8070b80 0x7f36a8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 -- 172.21.15.26:0/2168191628 >> 172.21.15.26:0/2168191628 conn(0x7f36a80c2ad0 msgr2=0x7f36a80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 -- 172.21.15.26:0/2168191628 shutdown_connections 2023-11-28T16:58:27.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 -- 172.21.15.26:0/2168191628 wait complete. 2023-11-28T16:58:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 Processor -- start 2023-11-28T16:58:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.337+0000 7f36b0796640 1 -- start start 2023-11-28T16:58:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070b80 0x7f36a8150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a8159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a814e9d0 0x7f36a8153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81ed580 con 0x7f36a80a8470 2023-11-28T16:58:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8148670 con 0x7f36a814e9d0 2023-11-28T16:58:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8148910 con 0x7f36a8070b80 2023-11-28T16:58:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a8159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a8159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34594/0 (socket says 172.21.15.26:34594) 2023-11-28T16:58:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 -- 172.21.15.26:0/3507163493 learned_addr learned my addr 172.21.15.26:0/3507163493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36aed33640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a814e9d0 0x7f36a8153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36ae532640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070b80 0x7f36a8150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 -- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070b80 msgr2=0x7f36a8150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070b80 0x7f36a8150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 -- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a814e9d0 msgr2=0x7f36a8153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a814e9d0 0x7f36a8153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 -- 172.21.15.26:0/3507163493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0009a70 con 0x7f36a80a8470 2023-11-28T16:58:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36add31640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a8159b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f369800e900 tx=0x7f369800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f369effd640 1 -- 172.21.15.26:0/3507163493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698009690 con 0x7f36a80a8470 2023-11-28T16:58:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f369effd640 1 -- 172.21.15.26:0/3507163493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800ca00 con 0x7f36a80a8470 2023-11-28T16:58:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a815a350 con 0x7f36a80a8470 2023-11-28T16:58:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f369effd640 1 -- 172.21.15.26:0/3507163493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800cdb0 con 0x7f36a80a8470 2023-11-28T16:58:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81ed7d0 con 0x7f36a80a8470 2023-11-28T16:58:27.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a804e890 con 0x7f36a80a8470 2023-11-28T16:58:27.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.341+0000 7f369effd640 1 -- 172.21.15.26:0/3507163493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3698013470 con 0x7f36a80a8470 2023-11-28T16:58:27.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.345+0000 7f369effd640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f368c0668d0 0x7f368c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:27.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.345+0000 7f369effd640 1 -- 172.21.15.26:0/3507163493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3698084a00 con 0x7f36a80a8470 2023-11-28T16:58:27.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.345+0000 7f36ae532640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f368c0668d0 0x7f368c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:27.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.345+0000 7f36ae532640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f368c0668d0 0x7f368c068d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000f70 tx=0x7f36a4007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:27.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.349+0000 7f369effd640 1 -- 172.21.15.26:0/3507163493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36980518d0 con 0x7f36a80a8470 2023-11-28T16:58:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.541+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36a80700a0 con 0x7f36a80a8470 2023-11-28T16:58:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.541+0000 7f369effd640 1 -- 172.21.15.26:0/3507163493 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7f36980170b0 con 0x7f36a80a8470 2023-11-28T16:58:27.545 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:58:27.545 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T16:58:27.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f368c0668d0 msgr2=0x7f368c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:27.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f368c0668d0 0x7f368c068d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000f70 tx=0x7f36a4007c10 comp rx=0 tx=0).stop 2023-11-28T16:58:27.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 msgr2=0x7f36a8159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:27.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a8159b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f369800e900 tx=0x7f369800edc0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 shutdown_connections 2023-11-28T16:58:27.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a814e9d0 0x7f36a8153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36a80a8470 0x7f36a8159b00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f368c0668d0 0x7f368c068d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 --2- 172.21.15.26:0/3507163493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070b80 0x7f36a8150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 >> 172.21.15.26:0/3507163493 conn(0x7f36a80c2ad0 msgr2=0x7f36a814da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 shutdown_connections 2023-11-28T16:58:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:27.545+0000 7f36b0796640 1 -- 172.21.15.26:0/3507163493 wait complete. 2023-11-28T16:58:27.565 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T16:58:27.566 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:58:27.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-11-28T16:58:27.566 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T16:58:27.566 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:27.566 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T16:58:27.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:58:27.566 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.VLHTTORpYO 2023-11-28T16:58:27.566 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-11-28T16:58:27.575 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.9erflqXaIG 2023-11-28T16:58:27.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /tmp/tmp.VLHTTORpYO /tmp/tmp.9erflqXaIG 2023-11-28T16:58:27.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.9erflqXaIG 2023-11-28T16:58:27.762 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.9erflqXaIG is 245B 2023-11-28T16:58:27.779 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.9erflqXaIG 2023-11-28T16:58:27.788 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAvHGZl3K7vOBAAZ1K0naJd5Vgb5lYjY6X4+g== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-28T16:58:27.788 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:58:27.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:27.788 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-11-28T16:58:27.839 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42267sec preferred_lft 42267sec 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:27.840 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:1b:cd:da:6f brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:58:27.841 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:58:27.842 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:58:27.842 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:58:27.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:27.843 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:58:27.905 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-11-28T16:58:27.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:27.907 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-11-28T16:58:27.959 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-11-28T16:58:27.960 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:58:27.960 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T16:58:27.960 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:58:27.960 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T16:58:27.961 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:58:27.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:27.961 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:58:27.962 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:58:27.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T16:58:27.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T16:58:27.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T16:58:27.962 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:58:28.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:28.055 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:58:28.065 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T16:58:28.065 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:58:28.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:28.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-11-28T16:58:28.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:28.127 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:28.182 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:58:28.183 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:58:28.183 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:58:28.235 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:28.235 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/tmp/tmp.VLHTTORpYO of=/dev/stdout 2023-11-28T16:58:28.286 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-11-28T16:58:28.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:28.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAvHGZl3K7vOBAAZ1K0naJd5Vgb5lYjY6X4+g==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:28.382 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,secret=AQAvHGZl3K7vOBAAZ1K0naJd5Vgb5lYjY6X4+g==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:28.382 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:28.382 INFO:teuthology.orchestra.run.smithi026.stdout:keyring.get_secret failed 2023-11-28T16:58:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:mount.ceph: kernel BUG! 2023-11-28T16:58:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:mount error 13 = Permission denied 2023-11-28T16:58:28.393 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,secret=AQAvHGZl3K7vOBAAZ1K0naJd5Vgb5lYjY6X4+g==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:58:28.393 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:58:28.393 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:58:28.393 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: testuser@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs2=/ 2023-11-28T16:58:28.393 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:58:28.397 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T16:58:28.397 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-28T16:58:28.397 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T16:58:28.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:58:28.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:58:28.561 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T16:58:28.561 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:28.562 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:28.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:58:28.571 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:28.572 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:28.581 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:28.581 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:28.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:28.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.769+0000 7f0950a17640 1 Processor -- start 2023-11-28T16:58:28.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.769+0000 7f0950a17640 1 -- start start 2023-11-28T16:58:28.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f0950a17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c155360 0x7f094c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:28.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f0950a17640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f094c1580b0 0x7f094c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:28.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f0950a17640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c06e280 con 0x7f094c06baf0 2023-11-28T16:58:28.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f0950a17640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0c2150 con 0x7f094c1580b0 2023-11-28T16:58:28.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f0950a17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c157c60 con 0x7f094c155360 2023-11-28T16:58:28.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094a59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c155360 0x7f094c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:28.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f094c1580b0 0x7f094c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:28.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094a59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c155360 0x7f094c06b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:39114/0 (socket says 172.21.15.26:39114) 2023-11-28T16:58:28.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f0943fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f094c06baf0 0x7f094c06e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:59804/0 (socket says 172.21.15.26:59804) 2023-11-28T16:58:28.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094a59c640 1 -- 172.21.15.26:0/1726374722 learned_addr learned my addr 172.21.15.26:0/1726374722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:28.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094ad9d640 1 -- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c155360 msgr2=0x7f094c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:28.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094ad9d640 1 --2- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c155360 0x7f094c06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094ad9d640 1 -- 172.21.15.26:0/1726374722 >> v1:172.21.15.79:6789/0 conn(0x7f094c06baf0 legacy=0x7f094c06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:28.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094ad9d640 1 -- 172.21.15.26:0/1726374722 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0c1bd0 con 0x7f094c1580b0 2023-11-28T16:58:28.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.773+0000 7f094a59c640 1 --2- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c155360 0x7f094c06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:28.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f094ad9d640 1 --2- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c1580b0 0x7f094c158540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0944009d90 tx=0x7f094401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d48fe4ab1597c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:28.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0949d9b640 1 -- 172.21.15.26:0/1726374722 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440a5920 con 0x7f094c1580b0 2023-11-28T16:58:28.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0949d9b640 1 -- 172.21.15.26:0/1726374722 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09440a5a80 con 0x7f094c1580b0 2023-11-28T16:58:28.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0949d9b640 1 -- 172.21.15.26:0/1726374722 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440a5e10 con 0x7f094c1580b0 2023-11-28T16:58:28.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 -- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c1580b0 msgr2=0x7f094c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:28.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 --2- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c1580b0 0x7f094c158540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0944009d90 tx=0x7f094401c950 comp rx=0 tx=0).stop 2023-11-28T16:58:28.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 -- 172.21.15.26:0/1726374722 shutdown_connections 2023-11-28T16:58:28.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 --2- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c1580b0 0x7f094c158540 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 --2- 172.21.15.26:0/1726374722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c155360 0x7f094c06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 -- 172.21.15.26:0/1726374722 >> 172.21.15.26:0/1726374722 conn(0x7f094c0c3240 msgr2=0x7f094c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 -- 172.21.15.26:0/1726374722 shutdown_connections 2023-11-28T16:58:28.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 -- 172.21.15.26:0/1726374722 wait complete. 2023-11-28T16:58:28.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 Processor -- start 2023-11-28T16:58:28.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.777+0000 7f0950a17640 1 -- start start 2023-11-28T16:58:28.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f094c06baf0 0x7f094c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:28.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c155360 0x7f094c1f0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c1580b0 0x7f094c1f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1f1110 con 0x7f094c06baf0 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0a8300 con 0x7f094c155360 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0a9e00 con 0x7f094c1580b0 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0943fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c155360 0x7f094c1f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f094c06baf0 0x7f094c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f094c06baf0 0x7f094c0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34600/0 (socket says 172.21.15.26:34600) 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 -- 172.21.15.26:0/1100669093 learned_addr learned my addr 172.21.15.26:0/1100669093 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:28.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094ad9d640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c1580b0 0x7f094c1f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 -- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c1580b0 msgr2=0x7f094c1f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c1580b0 0x7f094c1f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 -- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c155360 msgr2=0x7f094c1f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c155360 0x7f094c1f0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 -- 172.21.15.26:0/1100669093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0094d0 con 0x7f094c06baf0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f094a59c640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f094c06baf0 0x7f094c0a98c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f093c00ea00 tx=0x7f093c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0942ffd640 1 -- 172.21.15.26:0/1100669093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00ca00 con 0x7f094c06baf0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0942ffd640 1 -- 172.21.15.26:0/1100669093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00cb60 con 0x7f094c06baf0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0944009a70 con 0x7f094c06baf0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0942ffd640 1 -- 172.21.15.26:0/1100669093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00ced0 con 0x7f094c06baf0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c150e90 con 0x7f094c06baf0 2023-11-28T16:58:28.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.781+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c04e890 con 0x7f094c06baf0 2023-11-28T16:58:28.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.785+0000 7f0942ffd640 1 -- 172.21.15.26:0/1100669093 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f093c013470 con 0x7f094c06baf0 2023-11-28T16:58:28.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.785+0000 7f0942ffd640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f092c0668d0 0x7f092c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:28.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.785+0000 7f0942ffd640 1 -- 172.21.15.26:0/1100669093 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f093c084990 con 0x7f094c06baf0 2023-11-28T16:58:28.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.785+0000 7f0943fff640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f092c0668d0 0x7f092c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:28.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.785+0000 7f0943fff640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f092c0668d0 0x7f092c068d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f094c0a6890 tx=0x7f0934007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:28.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.789+0000 7f0942ffd640 1 -- 172.21.15.26:0/1100669093 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f093c051910 con 0x7f094c06baf0 2023-11-28T16:58:28.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.945+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f094c0c4780 con 0x7f094c06baf0 2023-11-28T16:58:28.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.945+0000 7f0942ffd640 1 -- 172.21.15.26:0/1100669093 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20208 (secure 0 0 0) 0x7f093c054f30 con 0x7f094c06baf0 2023-11-28T16:58:28.951 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:28.951 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:11.370310+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f092c0668d0 msgr2=0x7f092c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f092c0668d0 0x7f092c068d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f094c0a6890 tx=0x7f0934007e90 comp rx=0 tx=0).stop 2023-11-28T16:58:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f094c06baf0 msgr2=0x7f094c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f094c06baf0 0x7f094c0a98c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f093c00ea00 tx=0x7f093c00eec0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 shutdown_connections 2023-11-28T16:58:28.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f092c0668d0 0x7f092c068d90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f094c1580b0 0x7f094c1f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f094c155360 0x7f094c1f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 --2- 172.21.15.26:0/1100669093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f094c06baf0 0x7f094c0a98c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 >> 172.21.15.26:0/1100669093 conn(0x7f094c0c3240 msgr2=0x7f094c0c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 shutdown_connections 2023-11-28T16:58:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:28.949+0000 7f0950a17640 1 -- 172.21.15.26:0/1100669093 wait complete. 2023-11-28T16:58:28.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:54.472607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:55.658818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:58:07.830332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:58:08.744612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:28.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e6780640 1 Processor -- start 2023-11-28T16:58:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e6780640 1 -- start start 2023-11-28T16:58:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e6780640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1e006f0d0 0x7fd1e00c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e6780640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 0x7fd1e006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e6780640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e0073710 con 0x7fd1e006b810 2023-11-28T16:58:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e6780640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e01589f0 con 0x7fd1e006f0d0 2023-11-28T16:58:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e6780640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01586e0 con 0x7fd1e00c2a60 2023-11-28T16:58:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1dffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd1e006b810 0x7fd1e00bfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44634/0 (socket says 172.21.15.26:44634) 2023-11-28T16:58:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1dffff640 1 -- 172.21.15.26:0/2825076812 learned_addr learned my addr 172.21.15.26:0/2825076812 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e4d1d640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 0x7fd1e006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/2825076812 >> v2:172.21.15.79:3300/0 conn(0x7fd1e006f0d0 0x7fd1e00c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714671158 0 0) 0x7fd1e0073710 con 0x7fd1e006b810 2023-11-28T16:58:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003530 con 0x7fd1e006b810 2023-11-28T16:58:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3341360311 0 0) 0x7fd1c8003530 con 0x7fd1e006b810 2023-11-28T16:58:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 msgr2=0x7fd1e006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 0x7fd1e006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 >> v2:172.21.15.79:3300/0 conn(0x7fd1e006f0d0 msgr2=0x7fd1e00c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 --2- 172.21.15.26:0/2825076812 >> v2:172.21.15.79:3300/0 conn(0x7fd1e006f0d0 0x7fd1e00c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00a6010 con 0x7fd1e006b810 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fd1d0001680 con 0x7fd1e006b810 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 >> v1:172.21.15.26:6789/0 conn(0x7fd1e006b810 legacy=0x7fd1e00bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 0x7fd1c8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8004d10 0x7fd1c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01589f0 con 0x7fd1c8003f00 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01586e0 con 0x7fd1c8004d10 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800b990 con 0x7fd1e00c2a60 2023-11-28T16:58:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1dffff640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 0x7fd1c8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1e4d1d640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8004d10 0x7fd1c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1df7fe640 1 -- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 msgr2=0x7fd1c8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e00c2a60 0x7fd1c8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1df7fe640 1 -- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8004d10 msgr2=0x7fd1c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8004d10 0x7fd1c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.117+0000 7fd1df7fe640 1 -- 172.21.15.26:0/2825076812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8003530 con 0x7fd1c8003f00 2023-11-28T16:58:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1c80047d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009ae0 tx=0x7fd1d401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e634732262176c18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40a5680 con 0x7fd1c8003f00 2023-11-28T16:58:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d40a57e0 con 0x7fd1c8003f00 2023-11-28T16:58:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1deffd640 1 -- 172.21.15.26:0/2825076812 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40a5b90 con 0x7fd1c8003f00 2023-11-28T16:58:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1e6780640 1 -- 172.21.15.26:0/2825076812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 msgr2=0x7fd1c80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1e6780640 1 --2- 172.21.15.26:0/2825076812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1c80047d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009ae0 tx=0x7fd1d401ca30 comp rx=0 tx=0).stop 2023-11-28T16:58:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1e4d1d640 1 -- 172.21.15.26:0/2825076812 reap_dead start 2023-11-28T16:58:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1e6780640 1 -- 172.21.15.26:0/2825076812 shutdown_connections 2023-11-28T16:58:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1e6780640 1 -- 172.21.15.26:0/2825076812 >> 172.21.15.26:0/2825076812 conn(0x7fd1e00c3240 msgr2=0x7fd1e00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1e6780640 1 -- 172.21.15.26:0/2825076812 shutdown_connections 2023-11-28T16:58:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.121+0000 7fd1e6780640 1 -- 172.21.15.26:0/2825076812 wait complete. 2023-11-28T16:58:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 Processor -- start 2023-11-28T16:58:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 -- start start 2023-11-28T16:58:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1e014fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e01548b0 0x7fd1e01460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0146610 0x7fd1e01ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0152710 con 0x7fd1c8003f00 2023-11-28T16:58:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0146a90 con 0x7fd1e0146610 2023-11-28T16:58:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0146c10 con 0x7fd1e01548b0 2023-11-28T16:58:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1e014fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1e014fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34624/0 (socket says 172.21.15.26:34624) 2023-11-28T16:58:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 -- 172.21.15.26:0/3027554084 learned_addr learned my addr 172.21.15.26:0/3027554084 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e4d1d640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0146610 0x7fd1e01ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 -- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e01548b0 msgr2=0x7fd1e01460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e01548b0 0x7fd1e01460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e01548b0 0x7fd1e01460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 -- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0146610 msgr2=0x7fd1e01ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0146610 0x7fd1e01ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 -- 172.21.15.26:0/3027554084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00aa7a0 con 0x7fd1c8003f00 2023-11-28T16:58:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e4d1d640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0146610 0x7fd1e01ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e01548b0 0x7fd1e01460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dffff640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1e014fb00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0012330 tx=0x7fd1d00127f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dcff9640 1 -- 172.21.15.26:0/3027554084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0014810 con 0x7fd1c8003f00 2023-11-28T16:58:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dcff9640 1 -- 172.21.15.26:0/3027554084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0014970 con 0x7fd1c8003f00 2023-11-28T16:58:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1dcff9640 1 -- 172.21.15.26:0/3027554084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0014d20 con 0x7fd1c8003f00 2023-11-28T16:58:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e00ab4d0 con 0x7fd1c8003f00 2023-11-28T16:58:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.125+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e0146e60 con 0x7fd1c8003f00 2023-11-28T16:58:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.129+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e0152850 con 0x7fd1c8003f00 2023-11-28T16:58:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.129+0000 7fd1dcff9640 1 -- 172.21.15.26:0/3027554084 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd1d00153e0 con 0x7fd1c8003f00 2023-11-28T16:58:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.129+0000 7fd1dcff9640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd1cc0668d0 0x7fd1cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.129+0000 7fd1dcff9640 1 -- 172.21.15.26:0/3027554084 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd1d0087130 con 0x7fd1c8003f00 2023-11-28T16:58:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.129+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd1cc0668d0 0x7fd1cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.129+0000 7fd1df7fe640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd1cc0668d0 0x7fd1cc068d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40af000 tx=0x7fd1d40046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.133+0000 7fd1dcff9640 1 -- 172.21.15.26:0/3027554084 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1e0152850 con 0x7fd1c8003f00 2023-11-28T16:58:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1e0152850 con 0x7fd1c8003f00 2023-11-28T16:58:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1dcff9640 1 -- 172.21.15.26:0/3027554084 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1e0152850 con 0x7fd1c8003f00 2023-11-28T16:58:29.296 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd1cc0668d0 msgr2=0x7fd1cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd1cc0668d0 0x7fd1cc068d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40af000 tx=0x7fd1d40046d0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 msgr2=0x7fd1e014fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1e014fb00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0012330 tx=0x7fd1d00127f0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 shutdown_connections 2023-11-28T16:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0146610 0x7fd1e01ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd1cc0668d0 0x7fd1cc068d90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1e01548b0 0x7fd1e01460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 --2- 172.21.15.26:0/3027554084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1c8003f00 0x7fd1e014fb00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 >> 172.21.15.26:0/3027554084 conn(0x7fd1e00c3240 msgr2=0x7fd1e00c1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 shutdown_connections 2023-11-28T16:58:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.293+0000 7fd1e6780640 1 -- 172.21.15.26:0/3027554084 wait complete. 2023-11-28T16:58:29.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.461+0000 7f6a18017640 1 Processor -- start 2023-11-28T16:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.461+0000 7f6a18017640 1 -- start start 2023-11-28T16:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.461+0000 7f6a18017640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a100c1140 0x7f6a1006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.461+0000 7f6a18017640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100c1590 con 0x7f6a1006b810 2023-11-28T16:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.461+0000 7f6a18017640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a10073710 con 0x7f6a1006f0d0 2023-11-28T16:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.461+0000 7f6a18017640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a101589f0 con 0x7f6a100c1140 2023-11-28T16:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a15db3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6a1006b810 0x7f6a100bfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44648/0 (socket says 172.21.15.26:44648) 2023-11-28T16:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a15db3640 1 -- 172.21.15.26:0/2275716785 learned_addr learned my addr 172.21.15.26:0/2275716785 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a165b4640 1 --2- 172.21.15.26:0/2275716785 >> v2:172.21.15.26:3300/0 conn(0x7f6a100c1140 0x7f6a1006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a14db1640 1 -- 172.21.15.26:0/2275716785 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796191754 0 0) 0x7f6a100c1590 con 0x7f6a1006b810 2023-11-28T16:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a14db1640 1 -- 172.21.15.26:0/2275716785 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69fc003530 con 0x7f6a1006b810 2023-11-28T16:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a14db1640 1 -- 172.21.15.26:0/2275716785 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489035595 0 0) 0x7f6a10073710 con 0x7f6a1006f0d0 2023-11-28T16:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a14db1640 1 -- 172.21.15.26:0/2275716785 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a100c1590 con 0x7f6a1006f0d0 2023-11-28T16:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a165b4640 1 -- 172.21.15.26:0/2275716785 >> v1:172.21.15.79:6789/0 conn(0x7f6a1006f0d0 legacy=0x7f6a100c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a165b4640 1 -- 172.21.15.26:0/2275716785 >> v1:172.21.15.26:6789/0 conn(0x7f6a1006b810 legacy=0x7f6a100bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a165b4640 1 -- 172.21.15.26:0/2275716785 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100a6010 con 0x7f6a100c1140 2023-11-28T16:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a165b4640 1 --2- 172.21.15.26:0/2275716785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a100c1140 0x7f6a1006e550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009d90 tx=0x7f6a0801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb28858db64bbb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a14db1640 1 -- 172.21.15.26:0/2275716785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080a5810 con 0x7f6a100c1140 2023-11-28T16:58:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a14db1640 1 -- 172.21.15.26:0/2275716785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080a5970 con 0x7f6a100c1140 2023-11-28T16:58:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.465+0000 7f6a14db1640 1 -- 172.21.15.26:0/2275716785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080a5d00 con 0x7f6a100c1140 2023-11-28T16:58:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- 172.21.15.26:0/2275716785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a100c1140 msgr2=0x7f6a1006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 --2- 172.21.15.26:0/2275716785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a100c1140 0x7f6a1006e550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009d90 tx=0x7f6a0801c950 comp rx=0 tx=0).stop 2023-11-28T16:58:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- 172.21.15.26:0/2275716785 shutdown_connections 2023-11-28T16:58:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 --2- 172.21.15.26:0/2275716785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a100c1140 0x7f6a1006e550 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- 172.21.15.26:0/2275716785 >> 172.21.15.26:0/2275716785 conn(0x7f6a100c3240 msgr2=0x7f6a100c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- 172.21.15.26:0/2275716785 shutdown_connections 2023-11-28T16:58:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- 172.21.15.26:0/2275716785 wait complete. 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 Processor -- start 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- start start 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a1006b810 0x7f6a100ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1006f0d0 0x7f6a1014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a100c1140 0x7f6a101f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101494d0 con 0x7f6a1006f0d0 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10149040 con 0x7f6a100c1140 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a18017640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10148710 con 0x7f6a1006b810 2023-11-28T16:58:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1006f0d0 0x7f6a1014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1006f0d0 0x7f6a1014b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34634/0 (socket says 172.21.15.26:34634) 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 -- 172.21.15.26:0/4243633104 learned_addr learned my addr 172.21.15.26:0/4243633104 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a165b4640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a100c1140 0x7f6a101f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a15db3640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a1006b810 0x7f6a100ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 -- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a1006b810 msgr2=0x7f6a100ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a1006b810 0x7f6a100ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 -- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a100c1140 msgr2=0x7f6a101f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a100c1140 0x7f6a101f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a155b2640 1 -- 172.21.15.26:0/4243633104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08009a70 con 0x7f6a1006f0d0 2023-11-28T16:58:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.469+0000 7f6a165b4640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a100c1140 0x7f6a101f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a155b2640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1006f0d0 0x7f6a1014b320 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c490 tx=0x7f6a0000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a067fc640 1 -- 172.21.15.26:0/4243633104 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000052d0 con 0x7f6a1006f0d0 2023-11-28T16:58:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a067fc640 1 -- 172.21.15.26:0/4243633104 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00005430 con 0x7f6a1006f0d0 2023-11-28T16:58:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a067fc640 1 -- 172.21.15.26:0/4243633104 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00012870 con 0x7f6a1006f0d0 2023-11-28T16:58:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a101489f0 con 0x7f6a1006f0d0 2023-11-28T16:58:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a100ab970 con 0x7f6a1006f0d0 2023-11-28T16:58:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a101491b0 con 0x7f6a1006f0d0 2023-11-28T16:58:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a067fc640 1 -- 172.21.15.26:0/4243633104 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6a000129d0 con 0x7f6a1006f0d0 2023-11-28T16:58:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a067fc640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69f4066950 0x7f69f4068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a067fc640 1 -- 172.21.15.26:0/4243633104 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6a000842f0 con 0x7f6a1006f0d0 2023-11-28T16:58:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.473+0000 7f6a15db3640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69f4066950 0x7f69f4068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.477+0000 7f6a15db3640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69f4066950 0x7f69f4068e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0011f0 tx=0x7f6a0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.477+0000 7f6a067fc640 1 -- 172.21.15.26:0/4243633104 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a00051240 con 0x7f6a1006f0d0 2023-11-28T16:58:29.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.633+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a1004e890 con 0x7f6a1006f0d0 2023-11-28T16:58:29.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.633+0000 7f6a067fc640 1 -- 172.21.15.26:0/4243633104 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a00054860 con 0x7f6a1006f0d0 2023-11-28T16:58:29.638 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69f4066950 msgr2=0x7f69f4068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69f4066950 0x7f69f4068e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0011f0 tx=0x7f6a0c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1006f0d0 msgr2=0x7f6a1014b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1006f0d0 0x7f6a1014b320 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c490 tx=0x7f6a0000c950 comp rx=0 tx=0).stop 2023-11-28T16:58:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 shutdown_connections 2023-11-28T16:58:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a100c1140 0x7f6a101f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1006f0d0 0x7f6a1014b320 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f69f4066950 0x7f69f4068e10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 --2- 172.21.15.26:0/4243633104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6a1006b810 0x7f6a100ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 >> 172.21.15.26:0/4243633104 conn(0x7f6a100c3240 msgr2=0x7f6a100c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 shutdown_connections 2023-11-28T16:58:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.637+0000 7f6a18017640 1 -- 172.21.15.26:0/4243633104 wait complete. 2023-11-28T16:58:29.659 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:58:29.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.801+0000 7ff7f5365640 1 Processor -- start 2023-11-28T16:58:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.801+0000 7ff7f5365640 1 -- start start 2023-11-28T16:58:29.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7f5365640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 0x7ff7f00c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7f5365640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f006bd20 con 0x7ff7f00c7da0 2023-11-28T16:58:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7f5365640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f006c5c0 con 0x7ff7f006ca50 2023-11-28T16:58:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7f5365640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00c5330 con 0x7ff7f0151e20 2023-11-28T16:58:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ef7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff7f00c7da0 0x7ff7f015efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44658/0 (socket says 172.21.15.26:44658) 2023-11-28T16:58:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ef7fe640 1 -- 172.21.15.26:0/2688970266 learned_addr learned my addr 172.21.15.26:0/2688970266 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 0x7ff7f00c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887718556 0 0) 0x7ff7f006bd20 con 0x7ff7f00c7da0 2023-11-28T16:58:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7dc003530 con 0x7ff7f00c7da0 2023-11-28T16:58:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223699688 0 0) 0x7ff7f006c5c0 con 0x7ff7f006ca50 2023-11-28T16:58:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7f006bd20 con 0x7ff7f006ca50 2023-11-28T16:58:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1947979951 0 0) 0x7ff7dc003530 con 0x7ff7f00c7da0 2023-11-28T16:58:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 msgr2=0x7ff7f00c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 0x7ff7f00c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 >> v1:172.21.15.79:6789/0 conn(0x7ff7f006ca50 legacy=0x7ff7f00c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0155480 con 0x7ff7f00c7da0 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7ff7e8001a00 con 0x7ff7f00c7da0 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 0x7ff7f00c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 >> v1:172.21.15.26:6789/0 conn(0x7ff7f00c7da0 legacy=0x7ff7f015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7dc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7dc0047d0 0x7ff7dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 0x7ff7dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc00bb20 con 0x7ff7dc003b40 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc00bc60 con 0x7ff7dc0047d0 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc00bdf0 con 0x7ff7f0151e20 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7dc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7e7fff640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7dc0047d0 0x7ff7dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7ef7fe640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 0x7ff7dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 -- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 msgr2=0x7ff7dc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f0151e20 0x7ff7dc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 -- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7dc0047d0 msgr2=0x7ff7dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7dc0047d0 0x7ff7dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.805+0000 7ff7eeffd640 1 -- 172.21.15.26:0/2688970266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0009420 con 0x7ff7dc003b40 2023-11-28T16:58:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7dc003f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009cb0 tx=0x7ff7e001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce2629071e444cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00a5860 con 0x7ff7dc003b40 2023-11-28T16:58:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e00a59c0 con 0x7ff7dc003b40 2023-11-28T16:58:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7ee7fc640 1 -- 172.21.15.26:0/2688970266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00a5b70 con 0x7ff7dc003b40 2023-11-28T16:58:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7f5365640 1 -- 172.21.15.26:0/2688970266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 msgr2=0x7ff7dc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7f5365640 1 --2- 172.21.15.26:0/2688970266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7dc003f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009cb0 tx=0x7ff7e001cbc0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7ef7fe640 1 -- 172.21.15.26:0/2688970266 reap_dead start 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7f5365640 1 -- 172.21.15.26:0/2688970266 shutdown_connections 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7f5365640 1 -- 172.21.15.26:0/2688970266 >> 172.21.15.26:0/2688970266 conn(0x7ff7f00aba70 msgr2=0x7ff7f00abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7f5365640 1 -- 172.21.15.26:0/2688970266 shutdown_connections 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7f5365640 1 -- 172.21.15.26:0/2688970266 wait complete. 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.809+0000 7ff7f5365640 1 Processor -- start 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 -- start start 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7f00c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f00c38f0 0x7ff7f014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f014b1b0 0x7ff7f00c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00c6b40 con 0x7ff7dc003b40 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01559d0 con 0x7ff7f014b1b0 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01ed550 con 0x7ff7f00c38f0 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7f00c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7f00c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34658/0 (socket says 172.21.15.26:34658) 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 -- 172.21.15.26:0/2033620275 learned_addr learned my addr 172.21.15.26:0/2033620275 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7e7fff640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f00c38f0 0x7ff7f014ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7ef7fe640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f014b1b0 0x7ff7f00c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 -- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f00c38f0 msgr2=0x7ff7f014ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f00c38f0 0x7ff7f014ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 -- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f014b1b0 msgr2=0x7ff7f00c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f014b1b0 0x7ff7f00c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 -- 172.21.15.26:0/2033620275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0155c90 con 0x7ff7dc003b40 2023-11-28T16:58:29.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7eeffd640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7f00c9330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009cb0 tx=0x7ff7dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7e77fe640 1 -- 172.21.15.26:0/2033620275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00ad440 con 0x7ff7dc003b40 2023-11-28T16:58:29.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7e77fe640 1 -- 172.21.15.26:0/2033620275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e00ad5c0 con 0x7ff7dc003b40 2023-11-28T16:58:29.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f0155f70 con 0x7ff7dc003b40 2023-11-28T16:58:29.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7e77fe640 1 -- 172.21.15.26:0/2033620275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00ad970 con 0x7ff7dc003b40 2023-11-28T16:58:29.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f00c9870 con 0x7ff7dc003b40 2023-11-28T16:58:29.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.813+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f0156490 con 0x7ff7dc003b40 2023-11-28T16:58:29.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.817+0000 7ff7e77fe640 1 -- 172.21.15.26:0/2033620275 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff7e00b4040 con 0x7ff7dc003b40 2023-11-28T16:58:29.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.817+0000 7ff7e77fe640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7d0066900 0x7ff7d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:29.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.817+0000 7ff7e77fe640 1 -- 172.21.15.26:0/2033620275 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff7e011ee20 con 0x7ff7dc003b40 2023-11-28T16:58:29.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.817+0000 7ff7e7fff640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7d0066900 0x7ff7d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:29.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.817+0000 7ff7e7fff640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7d0066900 0x7ff7d0068dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff7f014c450 tx=0x7ff7d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:29.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.821+0000 7ff7e77fe640 1 -- 172.21.15.26:0/2033620275 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7f0156490 con 0x7ff7dc003b40 2023-11-28T16:58:29.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7f0156490 con 0x7ff7dc003b40 2023-11-28T16:58:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7e77fe640 1 -- 172.21.15.26:0/2033620275 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff7f0156490 con 0x7ff7dc003b40 2023-11-28T16:58:29.980 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7d0066900 msgr2=0x7ff7d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7d0066900 0x7ff7d0068dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff7f014c450 tx=0x7ff7d8009040 comp rx=0 tx=0).stop 2023-11-28T16:58:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 msgr2=0x7ff7f00c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7f00c9330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009cb0 tx=0x7ff7dc005800 comp rx=0 tx=0).stop 2023-11-28T16:58:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 shutdown_connections 2023-11-28T16:58:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f014b1b0 0x7ff7f00c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff7d0066900 0x7ff7d0068dc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7f00c38f0 0x7ff7f014ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 --2- 172.21.15.26:0/2033620275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7dc003b40 0x7ff7f00c9330 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 >> 172.21.15.26:0/2033620275 conn(0x7ff7f00aba70 msgr2=0x7ff7f014da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 shutdown_connections 2023-11-28T16:58:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:29.977+0000 7ff7f5365640 1 -- 172.21.15.26:0/2033620275 wait complete. 2023-11-28T16:58:30.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:58:30.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.145+0000 7f35a1a09640 1 Processor -- start 2023-11-28T16:58:30.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.145+0000 7f35a1a09640 1 -- start start 2023-11-28T16:58:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f35a1a09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f359c158a10 0x7f359c0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f35a1a09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f359c151bf0 0x7f359c152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f35a1a09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c158580 con 0x7f359c0c6220 2023-11-28T16:58:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f35a1a09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c158e60 con 0x7f359c151bf0 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f35a1a09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c157f50 con 0x7f359c158a10 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f359c0c6220 0x7f359c0c13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44662/0 (socket says 172.21.15.26:44662) 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359affd640 1 -- 172.21.15.26:0/3899698031 learned_addr learned my addr 172.21.15.26:0/3899698031 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359b7fe640 1 --2- 172.21.15.26:0/3899698031 >> v2:172.21.15.26:3300/0 conn(0x7f359c151bf0 0x7f359c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f3593fff640 1 --2- 172.21.15.26:0/3899698031 >> v2:172.21.15.79:3300/0 conn(0x7f359c158a10 0x7f359c0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359a7fc640 1 -- 172.21.15.26:0/3899698031 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517523487 0 0) 0x7f359c158580 con 0x7f359c0c6220 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359a7fc640 1 -- 172.21.15.26:0/3899698031 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3588003530 con 0x7f359c0c6220 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359b7fe640 1 -- 172.21.15.26:0/3899698031 >> v2:172.21.15.79:3300/0 conn(0x7f359c158a10 msgr2=0x7f359c0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359b7fe640 1 --2- 172.21.15.26:0/3899698031 >> v2:172.21.15.79:3300/0 conn(0x7f359c158a10 0x7f359c0c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359b7fe640 1 -- 172.21.15.26:0/3899698031 >> v1:172.21.15.26:6789/0 conn(0x7f359c0c6220 legacy=0x7f359c0c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359b7fe640 1 -- 172.21.15.26:0/3899698031 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0c1f60 con 0x7f359c151bf0 2023-11-28T16:58:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359b7fe640 1 --2- 172.21.15.26:0/3899698031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c151bf0 0x7f359c152020 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f359c071980 tx=0x7f359401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3501dafa45983595 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359a7fc640 1 -- 172.21.15.26:0/3899698031 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940a59a0 con 0x7f359c151bf0 2023-11-28T16:58:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.149+0000 7f359a7fc640 1 -- 172.21.15.26:0/3899698031 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35940a5b00 con 0x7f359c151bf0 2023-11-28T16:58:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359a7fc640 1 -- 172.21.15.26:0/3899698031 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940a5e70 con 0x7f359c151bf0 2023-11-28T16:58:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- 172.21.15.26:0/3899698031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c151bf0 msgr2=0x7f359c152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 --2- 172.21.15.26:0/3899698031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c151bf0 0x7f359c152020 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f359c071980 tx=0x7f359401c8e0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- 172.21.15.26:0/3899698031 shutdown_connections 2023-11-28T16:58:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 --2- 172.21.15.26:0/3899698031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c151bf0 0x7f359c152020 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 --2- 172.21.15.26:0/3899698031 >> v2:172.21.15.79:3300/0 conn(0x7f359c158a10 0x7f359c0c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- 172.21.15.26:0/3899698031 >> 172.21.15.26:0/3899698031 conn(0x7f359c06a5a0 msgr2=0x7f359c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- 172.21.15.26:0/3899698031 shutdown_connections 2023-11-28T16:58:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- 172.21.15.26:0/3899698031 wait complete. 2023-11-28T16:58:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 Processor -- start 2023-11-28T16:58:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- start start 2023-11-28T16:58:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0c6220 0x7f359c14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c151bf0 0x7f359c14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c158a10 0x7f359c1effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0accb0 con 0x7f359c158a10 2023-11-28T16:58:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0ab860 con 0x7f359c0c6220 2023-11-28T16:58:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f35a1a09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0ad4f0 con 0x7f359c151bf0 2023-11-28T16:58:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c158a10 0x7f359c1effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c158a10 0x7f359c1effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34686/0 (socket says 172.21.15.26:34686) 2023-11-28T16:58:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 -- 172.21.15.26:0/2383337082 learned_addr learned my addr 172.21.15.26:0/2383337082 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f3593fff640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c151bf0 0x7f359c14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359affd640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0c6220 0x7f359c14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 -- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c151bf0 msgr2=0x7f359c14cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c151bf0 0x7f359c14cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 -- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0c6220 msgr2=0x7f359c14c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0c6220 0x7f359c14c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.153+0000 7f359b7fe640 1 -- 172.21.15.26:0/2383337082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009a70 con 0x7f359c158a10 2023-11-28T16:58:30.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f359b7fe640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c158a10 0x7f359c1effd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f35940194f0 tx=0x7f3594019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f3598ff9640 1 -- 172.21.15.26:0/2383337082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940aede0 con 0x7f359c158a10 2023-11-28T16:58:30.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f3598ff9640 1 -- 172.21.15.26:0/2383337082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594009450 con 0x7f359c158a10 2023-11-28T16:58:30.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f3598ff9640 1 -- 172.21.15.26:0/2383337082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940b7610 con 0x7f359c158a10 2023-11-28T16:58:30.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c1f0ee0 con 0x7f359c158a10 2023-11-28T16:58:30.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c0ac010 con 0x7f359c158a10 2023-11-28T16:58:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c0ad930 con 0x7f359c158a10 2023-11-28T16:58:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f3598ff9640 1 -- 172.21.15.26:0/2383337082 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f35940b4050 con 0x7f359c158a10 2023-11-28T16:58:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f3598ff9640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f357c066900 0x7f357c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f3598ff9640 1 -- 172.21.15.26:0/2383337082 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f359411f9c0 con 0x7f359c158a10 2023-11-28T16:58:30.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.157+0000 7f359affd640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f357c066900 0x7f357c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.161+0000 7f359affd640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f357c066900 0x7f357c068dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f358c005890 tx=0x7f358c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.161+0000 7f3598ff9640 1 -- 172.21.15.26:0/2383337082 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35940ec800 con 0x7f359c158a10 2023-11-28T16:58:30.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f359c04e890 con 0x7f359c158a10 2023-11-28T16:58:30.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f3598ff9640 1 -- 172.21.15.26:0/2383337082 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f35940b20b0 con 0x7f359c158a10 2023-11-28T16:58:30.324 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f357c066900 msgr2=0x7f357c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f357c066900 0x7f357c068dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f358c005890 tx=0x7f358c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c158a10 msgr2=0x7f359c1effd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c158a10 0x7f359c1effd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f35940194f0 tx=0x7f3594019680 comp rx=0 tx=0).stop 2023-11-28T16:58:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 shutdown_connections 2023-11-28T16:58:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f359c158a10 0x7f359c1effd0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f357c066900 0x7f357c068dc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c151bf0 0x7f359c14cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 --2- 172.21.15.26:0/2383337082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0c6220 0x7f359c14c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 >> 172.21.15.26:0/2383337082 conn(0x7f359c06a5a0 msgr2=0x7f359c151170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:30.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 shutdown_connections 2023-11-28T16:58:30.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.321+0000 7f35a1a09640 1 -- 172.21.15.26:0/2383337082 wait complete. 2023-11-28T16:58:30.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:58:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.489+0000 7ff2769a7640 1 Processor -- start 2023-11-28T16:58:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.489+0000 7ff2769a7640 1 -- start start 2023-11-28T16:58:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2769a7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff270151be0 0x7ff270158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2769a7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2700c7d60 0x7ff2700c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2769a7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff270151fc0 con 0x7ff2700c4d20 2023-11-28T16:58:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2769a7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff270154640 con 0x7ff270151be0 2023-11-28T16:58:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2769a7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700c6910 con 0x7ff2700c7d60 2023-11-28T16:58:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2761a6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff2700c4d20 0x7ff270154ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44670/0 (socket says 172.21.15.26:44670) 2023-11-28T16:58:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2761a6640 1 -- 172.21.15.26:0/2995834862 learned_addr learned my addr 172.21.15.26:0/2995834862 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2759a5640 1 --2- 172.21.15.26:0/2995834862 >> v2:172.21.15.26:3300/0 conn(0x7ff270151be0 0x7ff270158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2751a4640 1 --2- 172.21.15.26:0/2995834862 >> v2:172.21.15.79:3300/0 conn(0x7ff2700c7d60 0x7ff2700c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2759a5640 1 -- 172.21.15.26:0/2995834862 >> v2:172.21.15.79:3300/0 conn(0x7ff2700c7d60 msgr2=0x7ff2700c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2759a5640 1 --2- 172.21.15.26:0/2995834862 >> v2:172.21.15.79:3300/0 conn(0x7ff2700c7d60 0x7ff2700c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2759a5640 1 -- 172.21.15.26:0/2995834862 >> v1:172.21.15.26:6789/0 conn(0x7ff2700c4d20 legacy=0x7ff270154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2759a5640 1 -- 172.21.15.26:0/2995834862 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700c77e0 con 0x7ff270151be0 2023-11-28T16:58:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2749a3640 1 -- 172.21.15.26:0/2995834862 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234573740 0 0) 0x7ff2680014a0 con 0x7ff2700c4d20 2023-11-28T16:58:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.493+0000 7ff2759a5640 1 --2- 172.21.15.26:0/2995834862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270158520 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0097c0 tx=0x7ff26c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df5784c4586592f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2749a3640 1 -- 172.21.15.26:0/2995834862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0ab600 con 0x7ff270151be0 2023-11-28T16:58:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2749a3640 1 -- 172.21.15.26:0/2995834862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c0a7050 con 0x7ff270151be0 2023-11-28T16:58:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2749a3640 1 -- 172.21.15.26:0/2995834862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0ab980 con 0x7ff270151be0 2023-11-28T16:58:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- 172.21.15.26:0/2995834862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 msgr2=0x7ff270158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 --2- 172.21.15.26:0/2995834862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270158520 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0097c0 tx=0x7ff26c01c3b0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- 172.21.15.26:0/2995834862 shutdown_connections 2023-11-28T16:58:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 --2- 172.21.15.26:0/2995834862 >> v2:172.21.15.79:3300/0 conn(0x7ff2700c7d60 0x7ff2700c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 --2- 172.21.15.26:0/2995834862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270158520 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- 172.21.15.26:0/2995834862 >> 172.21.15.26:0/2995834862 conn(0x7ff2700aba30 msgr2=0x7ff2700abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- 172.21.15.26:0/2995834862 shutdown_connections 2023-11-28T16:58:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- 172.21.15.26:0/2995834862 wait complete. 2023-11-28T16:58:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 Processor -- start 2023-11-28T16:58:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- start start 2023-11-28T16:58:30.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2700c4d20 0x7ff2701578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2700c7d60 0x7ff2701ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2701ece10 con 0x7ff270151be0 2023-11-28T16:58:30.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27014bdd0 con 0x7ff2700c4d20 2023-11-28T16:58:30.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2769a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270157e30 con 0x7ff2700c7d60 2023-11-28T16:58:30.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.497+0000 7ff2761a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2759a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2700c4d20 0x7ff2701578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2761a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34714/0 (socket says 172.21.15.26:34714) 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2761a6640 1 -- 172.21.15.26:0/3888111651 learned_addr learned my addr 172.21.15.26:0/3888111651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2751a4640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2700c7d60 0x7ff2701ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2759a5640 1 -- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2700c7d60 msgr2=0x7ff2701ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2759a5640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2700c7d60 0x7ff2701ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2759a5640 1 -- 172.21.15.26:0/3888111651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 msgr2=0x7ff270153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2759a5640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2759a5640 1 -- 172.21.15.26:0/3888111651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c009420 con 0x7ff2700c4d20 2023-11-28T16:58:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2759a5640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2700c4d20 0x7ff2701578f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ab000 tx=0x7ff26c01abf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2667fc640 1 -- 172.21.15.26:0/3888111651 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b7650 con 0x7ff2700c4d20 2023-11-28T16:58:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2667fc640 1 -- 172.21.15.26:0/3888111651 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c0b77b0 con 0x7ff2700c4d20 2023-11-28T16:58:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2667fc640 1 -- 172.21.15.26:0/3888111651 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b7b60 con 0x7ff2700c4d20 2023-11-28T16:58:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2701edd40 con 0x7ff2700c4d20 2023-11-28T16:58:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2701ed000 con 0x7ff2700c4d20 2023-11-28T16:58:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2700c9370 con 0x7ff2700c4d20 2023-11-28T16:58:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2667fc640 1 -- 172.21.15.26:0/3888111651 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff26c0b7cc0 con 0x7ff2700c4d20 2023-11-28T16:58:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.501+0000 7ff2667fc640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2540668d0 0x7ff254068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.505+0000 7ff2667fc640 1 -- 172.21.15.26:0/3888111651 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff26c0a4e40 con 0x7ff2700c4d20 2023-11-28T16:58:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.505+0000 7ff2751a4640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2540668d0 0x7ff254068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.505+0000 7ff2751a4640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2540668d0 0x7ff254068d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff270157230 tx=0x7ff260009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.509+0000 7ff2667fc640 1 -- 172.21.15.26:0/3888111651 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff26c0ebd40 con 0x7ff2700c4d20 2023-11-28T16:58:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.665+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff270074970 con 0x7ff2700c4d20 2023-11-28T16:58:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.665+0000 7ff2667fc640 1 -- 172.21.15.26:0/3888111651 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff26c0bb0a0 con 0x7ff2700c4d20 2023-11-28T16:58:30.668 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.665+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2540668d0 msgr2=0x7ff254068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.665+0000 7ff2769a7640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2540668d0 0x7ff254068d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff270157230 tx=0x7ff260009190 comp rx=0 tx=0).stop 2023-11-28T16:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.665+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2700c4d20 msgr2=0x7ff2701578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.665+0000 7ff2769a7640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2700c4d20 0x7ff2701578f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ab000 tx=0x7ff26c01abf0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 shutdown_connections 2023-11-28T16:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270151be0 0x7ff270153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2540668d0 0x7ff254068d90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2700c7d60 0x7ff2701ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 --2- 172.21.15.26:0/3888111651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2700c4d20 0x7ff2701578f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 >> 172.21.15.26:0/3888111651 conn(0x7ff2700aba30 msgr2=0x7ff2700aa530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 shutdown_connections 2023-11-28T16:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.669+0000 7ff2769a7640 1 -- 172.21.15.26:0/3888111651 wait complete. 2023-11-28T16:58:30.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:58:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5359fb5640 1 Processor -- start 2023-11-28T16:58:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5359fb5640 1 -- start start 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5359fb5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53540ca620 0x7f53540caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5359fb5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53540bd5a0 0x7f53540c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5359fb5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535406b7d0 con 0x7f53540c4890 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5359fb5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5354155160 con 0x7f53540ca620 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5359fb5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535406b180 con 0x7f53540bd5a0 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5358fb3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53540ca620 0x7f53540caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5353fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f53540c4890 0x7f53540c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44686/0 (socket says 172.21.15.26:44686) 2023-11-28T16:58:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5353fff640 1 -- 172.21.15.26:0/3622688023 learned_addr learned my addr 172.21.15.26:0/3622688023 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f53597b4640 1 --2- 172.21.15.26:0/3622688023 >> v2:172.21.15.79:3300/0 conn(0x7f53540bd5a0 0x7f53540c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5358fb3640 1 -- 172.21.15.26:0/3622688023 >> v2:172.21.15.79:3300/0 conn(0x7f53540bd5a0 msgr2=0x7f53540c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5358fb3640 1 --2- 172.21.15.26:0/3622688023 >> v2:172.21.15.79:3300/0 conn(0x7f53540bd5a0 0x7f53540c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5358fb3640 1 -- 172.21.15.26:0/3622688023 >> v1:172.21.15.26:6789/0 conn(0x7f53540c4890 legacy=0x7f53540c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.833+0000 7f5358fb3640 1 -- 172.21.15.26:0/3622688023 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535406b460 con 0x7f53540ca620 2023-11-28T16:58:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5358fb3640 1 --2- 172.21.15.26:0/3622688023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540ca620 0x7f53540caa00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f535406ad80 tx=0x7f534801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459b3e380fb7f22f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f53537fe640 1 -- 172.21.15.26:0/3622688023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480ad660 con 0x7f53540ca620 2023-11-28T16:58:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f53537fe640 1 -- 172.21.15.26:0/3622688023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480ad7c0 con 0x7f53540ca620 2023-11-28T16:58:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f53537fe640 1 -- 172.21.15.26:0/3622688023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480adb50 con 0x7f53540ca620 2023-11-28T16:58:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 -- 172.21.15.26:0/3622688023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540ca620 msgr2=0x7f53540caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 --2- 172.21.15.26:0/3622688023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540ca620 0x7f53540caa00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f535406ad80 tx=0x7f534801c3d0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 -- 172.21.15.26:0/3622688023 shutdown_connections 2023-11-28T16:58:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 --2- 172.21.15.26:0/3622688023 >> v2:172.21.15.79:3300/0 conn(0x7f53540bd5a0 0x7f53540c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 --2- 172.21.15.26:0/3622688023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540ca620 0x7f53540caa00 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 -- 172.21.15.26:0/3622688023 >> 172.21.15.26:0/3622688023 conn(0x7f53540ac0a0 msgr2=0x7f53540c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 -- 172.21.15.26:0/3622688023 shutdown_connections 2023-11-28T16:58:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.837+0000 7f5359fb5640 1 -- 172.21.15.26:0/3622688023 wait complete. 2023-11-28T16:58:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 Processor -- start 2023-11-28T16:58:30.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 -- start start 2023-11-28T16:58:30.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540bd5a0 0x7f5354156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53540c4890 0x7f53540c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53540ca620 0x7f53541ed4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354156c40 con 0x7f53540bd5a0 2023-11-28T16:58:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540ade80 con 0x7f53540c4890 2023-11-28T16:58:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53540aeab0 con 0x7f53540ca620 2023-11-28T16:58:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540bd5a0 0x7f5354156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540bd5a0 0x7f5354156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34734/0 (socket says 172.21.15.26:34734) 2023-11-28T16:58:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 -- 172.21.15.26:0/1591967830 learned_addr learned my addr 172.21.15.26:0/1591967830 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5353fff640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53540c4890 0x7f53540c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f53597b4640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53540ca620 0x7f53541ed4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 -- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53540ca620 msgr2=0x7f53541ed4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53540ca620 0x7f53541ed4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 -- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53540c4890 msgr2=0x7f53540c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53540c4890 0x7f53540c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 -- 172.21.15.26:0/1591967830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009420 con 0x7f53540bd5a0 2023-11-28T16:58:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5358fb3640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540bd5a0 0x7f5354156700 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f53480b0040 tx=0x7f534801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f53517fa640 1 -- 172.21.15.26:0/1591967830 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480b9650 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f53517fa640 1 -- 172.21.15.26:0/1591967830 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480b97d0 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f53517fa640 1 -- 172.21.15.26:0/1591967830 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480b9b80 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53540aed90 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.841+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53541f0220 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.845+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535404e890 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.845+0000 7f53517fa640 1 -- 172.21.15.26:0/1591967830 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53480b9ce0 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.845+0000 7f53517fa640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53380668d0 0x7f5338068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.845+0000 7f53517fa640 1 -- 172.21.15.26:0/1591967830 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f534811f3c0 con 0x7f53540bd5a0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.845+0000 7f5353fff640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53380668d0 0x7f5338068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.845+0000 7f5353fff640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53380668d0 0x7f5338068d90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f53540c57d0 tx=0x7f5340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:30.849+0000 7f53517fa640 1 -- 172.21.15.26:0/1591967830 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53480ec2b0 con 0x7f53540bd5a0 2023-11-28T16:58:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53541542f0 con 0x7f53540bd5a0 2023-11-28T16:58:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f53517fa640 1 -- 172.21.15.26:0/1591967830 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53480ef8d0 con 0x7f53540bd5a0 2023-11-28T16:58:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:58:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53380668d0 msgr2=0x7f5338068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53380668d0 0x7f5338068d90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f53540c57d0 tx=0x7f5340009040 comp rx=0 tx=0).stop 2023-11-28T16:58:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540bd5a0 msgr2=0x7f5354156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540bd5a0 0x7f5354156700 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f53480b0040 tx=0x7f534801ac10 comp rx=0 tx=0).stop 2023-11-28T16:58:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 shutdown_connections 2023-11-28T16:58:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f53380668d0 0x7f5338068d90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53540ca620 0x7f53541ed4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53540c4890 0x7f53540c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 --2- 172.21.15.26:0/1591967830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53540bd5a0 0x7f5354156700 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 >> 172.21.15.26:0/1591967830 conn(0x7f53540ac0a0 msgr2=0x7f53540c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 shutdown_connections 2023-11-28T16:58:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.017+0000 7f5359fb5640 1 -- 172.21.15.26:0/1591967830 wait complete. 2023-11-28T16:58:31.041 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T16:58:31.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:31.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T16:58:31.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:58:31.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:58:31.072 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:58:31.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:31.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feebd654640 1 Processor -- start 2023-11-28T16:58:31.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feebd654640 1 -- start start 2023-11-28T16:58:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feebd654640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb81520f0 0x7feeb80c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feebd654640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feeb8155660 0x7feeb806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feebd654640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80c5520 con 0x7feeb806b650 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feebd654640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb806c020 con 0x7feeb8155660 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feebd654640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81524d0 con 0x7feeb81520f0 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeae7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feeb8155660 0x7feeb806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeae7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feeb8155660 0x7feeb806b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57578/0 (socket says 172.21.15.26:57578) 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeae7fc640 1 -- 172.21.15.26:0/3791357402 learned_addr learned my addr 172.21.15.26:0/3791357402 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeb6ffd640 1 --2- 172.21.15.26:0/3791357402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb81520f0 0x7feeb80c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeae7fc640 1 -- 172.21.15.26:0/3791357402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb81520f0 msgr2=0x7feeb80c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeae7fc640 1 --2- 172.21.15.26:0/3791357402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb81520f0 0x7feeb80c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeae7fc640 1 -- 172.21.15.26:0/3791357402 >> v1:172.21.15.79:6789/0 conn(0x7feeb806b650 legacy=0x7feeb80c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.269+0000 7feeae7fc640 1 -- 172.21.15.26:0/3791357402 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80c9a80 con 0x7feeb8155660 2023-11-28T16:58:31.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feeae7fc640 1 --2- 172.21.15.26:0/3791357402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb8155660 0x7feeb806b110 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feea0009870 tx=0x7feea001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b79eef41687f714 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feeb67fc640 1 -- 172.21.15.26:0/3791357402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00ab680 con 0x7feeb8155660 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feeb67fc640 1 -- 172.21.15.26:0/3791357402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00ab7e0 con 0x7feeb8155660 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feeb67fc640 1 -- 172.21.15.26:0/3791357402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00abb70 con 0x7feeb8155660 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 -- 172.21.15.26:0/3791357402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb8155660 msgr2=0x7feeb806b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 --2- 172.21.15.26:0/3791357402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb8155660 0x7feeb806b110 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feea0009870 tx=0x7feea001c480 comp rx=0 tx=0).stop 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 -- 172.21.15.26:0/3791357402 shutdown_connections 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 --2- 172.21.15.26:0/3791357402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb8155660 0x7feeb806b110 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 --2- 172.21.15.26:0/3791357402 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb81520f0 0x7feeb80c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 -- 172.21.15.26:0/3791357402 >> 172.21.15.26:0/3791357402 conn(0x7feeb80ca070 msgr2=0x7feeb80ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:31.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 -- 172.21.15.26:0/3791357402 shutdown_connections 2023-11-28T16:58:31.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.273+0000 7feebd654640 1 -- 172.21.15.26:0/3791357402 wait complete. 2023-11-28T16:58:31.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 Processor -- start 2023-11-28T16:58:31.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 -- start start 2023-11-28T16:58:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb806b650 0x7feeb8146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb81520f0 0x7feeb81ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeb8155660 0x7feeb80c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81ecf60 con 0x7feeb81520f0 2023-11-28T16:58:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8143c20 con 0x7feeb8155660 2023-11-28T16:58:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81ed7a0 con 0x7feeb806b650 2023-11-28T16:58:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb81520f0 0x7feeb81ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb81520f0 0x7feeb81ee3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57590/0 (socket says 172.21.15.26:57590) 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 -- 172.21.15.26:0/2732271000 learned_addr learned my addr 172.21.15.26:0/2732271000 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeb77fe640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeb8155660 0x7feeb80c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 -- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb806b650 msgr2=0x7feeb8146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeb6ffd640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb806b650 0x7feeb8146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb806b650 0x7feeb8146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 -- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeb8155660 msgr2=0x7feeb80c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeb8155660 0x7feeb80c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 -- 172.21.15.26:0/2732271000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00094d0 con 0x7feeb81520f0 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeb77fe640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeb8155660 0x7feeb80c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeb6ffd640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb806b650 0x7feeb8146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeae7fc640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb81520f0 0x7feeb81ee3d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feea00ad040 tx=0x7feea001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:31.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeaffff640 1 -- 172.21.15.26:0/2732271000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00b4800 con 0x7feeb81520f0 2023-11-28T16:58:31.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeaffff640 1 -- 172.21.15.26:0/2732271000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00b4980 con 0x7feeb81520f0 2023-11-28T16:58:31.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feeaffff640 1 -- 172.21.15.26:0/2732271000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00b4d30 con 0x7feeb81520f0 2023-11-28T16:58:31.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb81539d0 con 0x7feeb81520f0 2023-11-28T16:58:31.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb81f11c0 con 0x7feeb81520f0 2023-11-28T16:58:31.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.277+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb81ed910 con 0x7feeb81520f0 2023-11-28T16:58:31.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.281+0000 7feeaffff640 1 -- 172.21.15.26:0/2732271000 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feea00c7440 con 0x7feeb81520f0 2023-11-28T16:58:31.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.281+0000 7feeaffff640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee980668d0 0x7fee98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.281+0000 7feeaffff640 1 -- 172.21.15.26:0/2732271000 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7feea011f6b0 con 0x7feeb81520f0 2023-11-28T16:58:31.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.281+0000 7feeb6ffd640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee980668d0 0x7fee98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.281+0000 7feeb6ffd640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee980668d0 0x7fee98068d90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feea8009840 tx=0x7feea8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:31.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.285+0000 7feeaffff640 1 -- 172.21.15.26:0/2732271000 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feea00ec580 con 0x7feeb81520f0 2023-11-28T16:58:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.473+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeb804e890 con 0x7feeb81520f0 2023-11-28T16:58:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feeaffff640 1 -- 172.21.15.26:0/2732271000 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7feea00efba0 con 0x7feeb81520f0 2023-11-28T16:58:31.479 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:31.479 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:56.668279+0000","modified":"2023-11-28T16:57:59.688325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3225309020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3225309020},{"type":"v1","addr":"172.21.15.26:6835","nonce":3225309020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:31.480 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 37 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee980668d0 msgr2=0x7fee98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee980668d0 0x7fee98068d90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feea8009840 tx=0x7feea8008040 comp rx=0 tx=0).stop 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb81520f0 msgr2=0x7feeb81ee3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb81520f0 0x7feeb81ee3d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feea00ad040 tx=0x7feea001acc0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 shutdown_connections 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeb8155660 0x7feeb80c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb81520f0 0x7feeb81ee3d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee980668d0 0x7fee98068d90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 --2- 172.21.15.26:0/2732271000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feeb806b650 0x7feeb8146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 >> 172.21.15.26:0/2732271000 conn(0x7feeb80ca070 msgr2=0x7feeb814f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:31.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 shutdown_connections 2023-11-28T16:58:31.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.477+0000 7feebd654640 1 -- 172.21.15.26:0/2732271000 wait complete. 2023-11-28T16:58:31.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.641+0000 7fe3ba92a640 1 Processor -- start 2023-11-28T16:58:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.641+0000 7fe3ba92a640 1 -- start start 2023-11-28T16:58:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.641+0000 7fe3ba92a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3b40bd720 0x7fe3b4158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.641+0000 7fe3ba92a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b4158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.641+0000 7fe3ba92a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b4155790 con 0x7fe3b40ca610 2023-11-28T16:58:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.641+0000 7fe3ba92a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b40c4b00 con 0x7fe3b40bd720 2023-11-28T16:58:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.641+0000 7fe3ba92a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40c4de0 con 0x7fe3b406cd90 2023-11-28T16:58:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3b40bd720 0x7fe3b4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3b40ca610 0x7fe3b40c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52010/0 (socket says 172.21.15.26:52010) 2023-11-28T16:58:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b3fff640 1 -- 172.21.15.26:0/3692444965 learned_addr learned my addr 172.21.15.26:0/3692444965 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b8ec7640 1 --2- 172.21.15.26:0/3692444965 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b4158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b37fe640 1 -- 172.21.15.26:0/3692444965 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 msgr2=0x7fe3b4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b37fe640 1 --2- 172.21.15.26:0/3692444965 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b4158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b37fe640 1 -- 172.21.15.26:0/3692444965 >> v1:172.21.15.26:6789/0 conn(0x7fe3b40ca610 legacy=0x7fe3b40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b37fe640 1 -- 172.21.15.26:0/3692444965 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4157e30 con 0x7fe3b40bd720 2023-11-28T16:58:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b2ffd640 1 -- 172.21.15.26:0/3692444965 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570624076 0 0) 0x7fe3b4155790 con 0x7fe3b40ca610 2023-11-28T16:58:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b8ec7640 1 --2- 172.21.15.26:0/3692444965 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b4158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b37fe640 1 --2- 172.21.15.26:0/3692444965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40bd720 0x7fe3b4158350 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80097c0 tx=0x7fe3a801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519bd5c2557177a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b2ffd640 1 -- 172.21.15.26:0/3692444965 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40c52d0 con 0x7fe3b40bd720 2023-11-28T16:58:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b2ffd640 1 -- 172.21.15.26:0/3692444965 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a80a7050 con 0x7fe3b40bd720 2023-11-28T16:58:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.645+0000 7fe3b2ffd640 1 -- 172.21.15.26:0/3692444965 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80ab820 con 0x7fe3b40bd720 2023-11-28T16:58:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3692444965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40bd720 msgr2=0x7fe3b4158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3692444965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40bd720 0x7fe3b4158350 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80097c0 tx=0x7fe3a801c360 comp rx=0 tx=0).stop 2023-11-28T16:58:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3692444965 shutdown_connections 2023-11-28T16:58:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3692444965 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b4158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3692444965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40bd720 0x7fe3b4158350 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3692444965 >> 172.21.15.26:0/3692444965 conn(0x7fe3b4071ea0 msgr2=0x7fe3b40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3692444965 shutdown_connections 2023-11-28T16:58:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3692444965 wait complete. 2023-11-28T16:58:31.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 Processor -- start 2023-11-28T16:58:31.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- start start 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b415f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b40bd720 0x7fe3b41f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40ca610 0x7fe3b41f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40c3490 con 0x7fe3b40ca610 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40bdb20 con 0x7fe3b40bd720 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3ba92a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41f5440 con 0x7fe3b406cd90 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40ca610 0x7fe3b41f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40ca610 0x7fe3b41f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57594/0 (socket says 172.21.15.26:57594) 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 -- 172.21.15.26:0/3100605407 learned_addr learned my addr 172.21.15.26:0/3100605407 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:31.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b3fff640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b415f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 -- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 msgr2=0x7fe3b415f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b37fe640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b40bd720 0x7fe3b41f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b415f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 -- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b40bd720 msgr2=0x7fe3b41f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b40bd720 0x7fe3b41f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b8ec7640 1 -- 172.21.15.26:0/3100605407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009420 con 0x7fe3b40ca610 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b3fff640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:31.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.649+0000 7fe3b37fe640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b40bd720 0x7fe3b41f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:31.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b8ec7640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40ca610 0x7fe3b41f1a90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac007f20 tx=0x7fe3ac00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:31.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b0ff9640 1 -- 172.21.15.26:0/3100605407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00dee0 con 0x7fe3b40ca610 2023-11-28T16:58:31.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b0ff9640 1 -- 172.21.15.26:0/3100605407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00f040 con 0x7fe3b40ca610 2023-11-28T16:58:31.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b0ff9640 1 -- 172.21.15.26:0/3100605407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac003de0 con 0x7fe3b40ca610 2023-11-28T16:58:31.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b40c36a0 con 0x7fe3b40ca610 2023-11-28T16:58:31.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b415fe90 con 0x7fe3b40ca610 2023-11-28T16:58:31.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b404e890 con 0x7fe3b40ca610 2023-11-28T16:58:31.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b0ff9640 1 -- 172.21.15.26:0/3100605407 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe3ac004030 con 0x7fe3b40ca610 2023-11-28T16:58:31.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b0ff9640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3a00668d0 0x7fe3a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b0ff9640 1 -- 172.21.15.26:0/3100605407 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe3ac084aa0 con 0x7fe3b40ca610 2023-11-28T16:58:31.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.653+0000 7fe3b3fff640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3a00668d0 0x7fe3a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.657+0000 7fe3b3fff640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3a00668d0 0x7fe3a0068d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4000f70 tx=0x7fe3a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:31.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.657+0000 7fe3b0ff9640 1 -- 172.21.15.26:0/3100605407 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3ac051a10 con 0x7fe3b40ca610 2023-11-28T16:58:31.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.817+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3b406cb70 con 0x7fe3b40ca610 2023-11-28T16:58:31.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.817+0000 7fe3b0ff9640 1 -- 172.21.15.26:0/3100605407 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20208 (secure 0 0 0) 0x7fe3ac01a090 con 0x7fe3b40ca610 2023-11-28T16:58:31.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:31.821 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:11.370310+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:31.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3a00668d0 msgr2=0x7fe3a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3a00668d0 0x7fe3a0068d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4000f70 tx=0x7fe3a4009040 comp rx=0 tx=0).stop 2023-11-28T16:58:31.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40ca610 msgr2=0x7fe3b41f1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40ca610 0x7fe3b41f1a90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac007f20 tx=0x7fe3ac00d560 comp rx=0 tx=0).stop 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 shutdown_connections 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b40ca610 0x7fe3b41f1a90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b40bd720 0x7fe3b41f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3a00668d0 0x7fe3a0068d90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 --2- 172.21.15.26:0/3100605407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3b406cd90 0x7fe3b415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 >> 172.21.15.26:0/3100605407 conn(0x7fe3b4071ea0 msgr2=0x7fe3b4072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 shutdown_connections 2023-11-28T16:58:31.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.821+0000 7fe3ba92a640 1 -- 172.21.15.26:0/3100605407 wait complete. 2023-11-28T16:58:31.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:57:54.472607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:57:55.658818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:58:07.830332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:58:08.744612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:31.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.985+0000 7f2faf3b8640 1 Processor -- start 2023-11-28T16:58:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.985+0000 7f2faf3b8640 1 -- start start 2023-11-28T16:58:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2faf3b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c6220 0x7f2fa8158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2faf3b8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fa80c13a0 0x7f2fa80c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2faf3b8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa8158580 con 0x7f2fa8151bf0 2023-11-28T16:58:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2faf3b8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa8157f50 con 0x7f2fa80c13a0 2023-11-28T16:58:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2faf3b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80c1f60 con 0x7f2fa80c6220 2023-11-28T16:58:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fac953640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fa80c13a0 0x7f2fa80c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fac953640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fa80c13a0 0x7f2fa80c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57606/0 (socket says 172.21.15.26:57606) 2023-11-28T16:58:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fad955640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2fa8151bf0 0x7f2fa80a9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52012/0 (socket says 172.21.15.26:52012) 2023-11-28T16:58:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fac953640 1 -- 172.21.15.26:0/615720001 learned_addr learned my addr 172.21.15.26:0/615720001 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fad154640 1 --2- 172.21.15.26:0/615720001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c6220 0x7f2fa8158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fac953640 1 -- 172.21.15.26:0/615720001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c6220 msgr2=0x7f2fa8158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fac953640 1 --2- 172.21.15.26:0/615720001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c6220 0x7f2fa8158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fac953640 1 -- 172.21.15.26:0/615720001 >> v1:172.21.15.26:6789/0 conn(0x7f2fa8151bf0 legacy=0x7f2fa80a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.989+0000 7f2fac953640 1 -- 172.21.15.26:0/615720001 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80c2240 con 0x7f2fa80c13a0 2023-11-28T16:58:31.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2fac953640 1 --2- 172.21.15.26:0/615720001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c13a0 0x7f2fa80c28c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2f98006fd0 tx=0x7f2f9801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398ba87699941414 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2f9ffff640 1 -- 172.21.15.26:0/615720001 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980aa650 con 0x7f2fa80c13a0 2023-11-28T16:58:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2f9ffff640 1 -- 172.21.15.26:0/615720001 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f980aa7b0 con 0x7f2fa80c13a0 2023-11-28T16:58:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2f9ffff640 1 -- 172.21.15.26:0/615720001 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980aab40 con 0x7f2fa80c13a0 2023-11-28T16:58:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- 172.21.15.26:0/615720001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c13a0 msgr2=0x7f2fa80c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/615720001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c13a0 0x7f2fa80c28c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2f98006fd0 tx=0x7f2f9801c4f0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- 172.21.15.26:0/615720001 shutdown_connections 2023-11-28T16:58:31.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/615720001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c13a0 0x7f2fa80c28c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/615720001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c6220 0x7f2fa8158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:31.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- 172.21.15.26:0/615720001 >> 172.21.15.26:0/615720001 conn(0x7f2fa806a5a0 msgr2=0x7f2fa806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:31.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- 172.21.15.26:0/615720001 shutdown_connections 2023-11-28T16:58:31.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- 172.21.15.26:0/615720001 wait complete. 2023-11-28T16:58:31.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 Processor -- start 2023-11-28T16:58:31.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- start start 2023-11-28T16:58:31.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c13a0 0x7f2fa81ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c6220 0x7f2fa814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8151bf0 0x7f2fa8157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80ad820 con 0x7f2fa80c6220 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa814a040 con 0x7f2fa8151bf0 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.993+0000 7f2faf3b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa814a320 con 0x7f2fa80c13a0 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c6220 0x7f2fa814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c6220 0x7f2fa814ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57616/0 (socket says 172.21.15.26:57616) 2023-11-28T16:58:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 -- 172.21.15.26:0/2766714603 learned_addr learned my addr 172.21.15.26:0/2766714603 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fad154640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c13a0 0x7f2fa81ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fad955640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8151bf0 0x7f2fa8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 -- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c13a0 msgr2=0x7f2fa81ee110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c13a0 0x7f2fa81ee110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 -- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8151bf0 msgr2=0x7f2fa8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8151bf0 0x7f2fa8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 -- 172.21.15.26:0/2766714603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98009480 con 0x7f2fa80c6220 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fad955640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8151bf0 0x7f2fa8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2fac953640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c6220 0x7f2fa814ae00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2f9801aba0 tx=0x7f2f98019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2f9dffb640 1 -- 172.21.15.26:0/2766714603 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980aa650 con 0x7f2fa80c6220 2023-11-28T16:58:32.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2f9dffb640 1 -- 172.21.15.26:0/2766714603 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f980aad30 con 0x7f2fa80c6220 2023-11-28T16:58:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2f9dffb640 1 -- 172.21.15.26:0/2766714603 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980aaea0 con 0x7f2fa80c6220 2023-11-28T16:58:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa814a600 con 0x7f2fa80c6220 2023-11-28T16:58:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa8157540 con 0x7f2fa80c6220 2023-11-28T16:58:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa804e890 con 0x7f2fa80c6220 2023-11-28T16:58:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:31.997+0000 7f2f9dffb640 1 -- 172.21.15.26:0/2766714603 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2f98003840 con 0x7f2fa80c6220 2023-11-28T16:58:32.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.001+0000 7f2f9dffb640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2f8c066900 0x7f2f8c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.001+0000 7f2f9dffb640 1 -- 172.21.15.26:0/2766714603 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2f9811efa0 con 0x7f2fa80c6220 2023-11-28T16:58:32.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.001+0000 7f2fad154640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2f8c066900 0x7f2f8c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.001+0000 7f2fad154640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2f8c066900 0x7f2f8c068dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b9d0 tx=0x7f2fa4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.005+0000 7f2f9dffb640 1 -- 172.21.15.26:0/2766714603 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f980ebe70 con 0x7f2fa80c6220 2023-11-28T16:58:32.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fa814a460 con 0x7f2fa80c6220 2023-11-28T16:58:32.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2f9dffb640 1 -- 172.21.15.26:0/2766714603 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fa814a460 con 0x7f2fa80c6220 2023-11-28T16:58:32.167 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2f8c066900 msgr2=0x7f2f8c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2f8c066900 0x7f2f8c068dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b9d0 tx=0x7f2fa4008040 comp rx=0 tx=0).stop 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c6220 msgr2=0x7f2fa814ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c6220 0x7f2fa814ae00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2f9801aba0 tx=0x7f2f98019290 comp rx=0 tx=0).stop 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 shutdown_connections 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8151bf0 0x7f2fa8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa80c6220 0x7f2fa814ae00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2f8c066900 0x7f2f8c068dc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 --2- 172.21.15.26:0/2766714603 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fa80c13a0 0x7f2fa81ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 >> 172.21.15.26:0/2766714603 conn(0x7f2fa806a5a0 msgr2=0x7f2fa8150a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:32.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 shutdown_connections 2023-11-28T16:58:32.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.165+0000 7f2faf3b8640 1 -- 172.21.15.26:0/2766714603 wait complete. 2023-11-28T16:58:32.187 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:58:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.329+0000 7f236ae81640 1 Processor -- start 2023-11-28T16:58:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.329+0000 7f236ae81640 1 -- start start 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236ae81640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2364151be0 0x7f2364158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236ae81640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23640c7d60 0x7f23640c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236ae81640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2364151fc0 con 0x7f23640c4d20 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236ae81640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2364154640 con 0x7f23640c7d60 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236ae81640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640c6910 con 0x7f2364151be0 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236967e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23640c7d60 0x7f23640c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236a680640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f23640c4d20 0x7f2364154ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52014/0 (socket says 172.21.15.26:52014) 2023-11-28T16:58:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236967e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23640c7d60 0x7f23640c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57618/0 (socket says 172.21.15.26:57618) 2023-11-28T16:58:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236a680640 1 -- 172.21.15.26:0/1379524187 learned_addr learned my addr 172.21.15.26:0/1379524187 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f2369e7f640 1 --2- 172.21.15.26:0/1379524187 >> v2:172.21.15.79:3300/0 conn(0x7f2364151be0 0x7f2364158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f2368e7d640 1 -- 172.21.15.26:0/1379524187 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506073684 0 0) 0x7f235c0014a0 con 0x7f23640c4d20 2023-11-28T16:58:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236967e640 1 -- 172.21.15.26:0/1379524187 >> v2:172.21.15.79:3300/0 conn(0x7f2364151be0 msgr2=0x7f2364158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236967e640 1 --2- 172.21.15.26:0/1379524187 >> v2:172.21.15.79:3300/0 conn(0x7f2364151be0 0x7f2364158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236967e640 1 -- 172.21.15.26:0/1379524187 >> v1:172.21.15.26:6789/0 conn(0x7f23640c4d20 legacy=0x7f2364154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236967e640 1 -- 172.21.15.26:0/1379524187 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640c77e0 con 0x7f23640c7d60 2023-11-28T16:58:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.333+0000 7f236967e640 1 --2- 172.21.15.26:0/1379524187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c7d60 0x7f23640c47e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f23540097c0 tx=0x7f235401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bf741f3fc72ed6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f2368e7d640 1 -- 172.21.15.26:0/1379524187 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540ab600 con 0x7f23640c7d60 2023-11-28T16:58:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f2368e7d640 1 -- 172.21.15.26:0/1379524187 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540a7050 con 0x7f23640c7d60 2023-11-28T16:58:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f2368e7d640 1 -- 172.21.15.26:0/1379524187 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540ab980 con 0x7f23640c7d60 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- 172.21.15.26:0/1379524187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c7d60 msgr2=0x7f23640c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 --2- 172.21.15.26:0/1379524187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c7d60 0x7f23640c47e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f23540097c0 tx=0x7f235401c3b0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- 172.21.15.26:0/1379524187 shutdown_connections 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 --2- 172.21.15.26:0/1379524187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c7d60 0x7f23640c47e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 --2- 172.21.15.26:0/1379524187 >> v2:172.21.15.79:3300/0 conn(0x7f2364151be0 0x7f2364158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- 172.21.15.26:0/1379524187 >> 172.21.15.26:0/1379524187 conn(0x7f23640aba30 msgr2=0x7f23640abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- 172.21.15.26:0/1379524187 shutdown_connections 2023-11-28T16:58:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- 172.21.15.26:0/1379524187 wait complete. 2023-11-28T16:58:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 Processor -- start 2023-11-28T16:58:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- start start 2023-11-28T16:58:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c4d20 0x7f2364152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23640c7d60 0x7f2364153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2364151be0 0x7f23640c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640bdcd0 con 0x7f23640c4d20 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364145120 con 0x7f2364151be0 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f236ae81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2364144e40 con 0x7f23640c7d60 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f2369e7f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c4d20 0x7f2364152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f2369e7f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c4d20 0x7f2364152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57622/0 (socket says 172.21.15.26:57622) 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.337+0000 7f2369e7f640 1 -- 172.21.15.26:0/2275796163 learned_addr learned my addr 172.21.15.26:0/2275796163 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236a680640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2364151be0 0x7f23640c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236967e640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23640c7d60 0x7f2364153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f2369e7f640 1 -- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23640c7d60 msgr2=0x7f2364153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f2369e7f640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23640c7d60 0x7f2364153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f2369e7f640 1 -- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2364151be0 msgr2=0x7f23640c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f2369e7f640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2364151be0 0x7f23640c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f2369e7f640 1 -- 172.21.15.26:0/2275796163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354009420 con 0x7f23640c4d20 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236967e640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23640c7d60 0x7f2364153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236a680640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2364151be0 0x7f23640c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f2369e7f640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c4d20 0x7f2364152d20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f236000e870 tx=0x7f236000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f235a7fc640 1 -- 172.21.15.26:0/2275796163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360009510 con 0x7f23640c4d20 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f235a7fc640 1 -- 172.21.15.26:0/2275796163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236000eec0 con 0x7f23640c4d20 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f235a7fc640 1 -- 172.21.15.26:0/2275796163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236000cb40 con 0x7f23640c4d20 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23640c0fd0 con 0x7f23640c4d20 2023-11-28T16:58:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2364154210 con 0x7f23640c4d20 2023-11-28T16:58:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640c81f0 con 0x7f23640c4d20 2023-11-28T16:58:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f235a7fc640 1 -- 172.21.15.26:0/2275796163 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f236000cca0 con 0x7f23640c4d20 2023-11-28T16:58:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f235a7fc640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23480668d0 0x7f2348068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f235a7fc640 1 -- 172.21.15.26:0/2275796163 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2360084890 con 0x7f23640c4d20 2023-11-28T16:58:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.341+0000 7f236967e640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23480668d0 0x7f2348068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.345+0000 7f236967e640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23480668d0 0x7f2348068d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f23540ad000 tx=0x7f2354008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.345+0000 7f235a7fc640 1 -- 172.21.15.26:0/2275796163 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2360051800 con 0x7f23640c4d20 2023-11-28T16:58:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.505+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2364074970 con 0x7f23640c4d20 2023-11-28T16:58:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.505+0000 7f235a7fc640 1 -- 172.21.15.26:0/2275796163 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2360054e20 con 0x7f23640c4d20 2023-11-28T16:58:32.509 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23480668d0 msgr2=0x7f2348068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23480668d0 0x7f2348068d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f23540ad000 tx=0x7f2354008040 comp rx=0 tx=0).stop 2023-11-28T16:58:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c4d20 msgr2=0x7f2364152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c4d20 0x7f2364152d20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f236000e870 tx=0x7f236000ec70 comp rx=0 tx=0).stop 2023-11-28T16:58:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 shutdown_connections 2023-11-28T16:58:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2364151be0 0x7f23640c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f23480668d0 0x7f2348068d90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23640c7d60 0x7f2364153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 --2- 172.21.15.26:0/2275796163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23640c4d20 0x7f2364152d20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 >> 172.21.15.26:0/2275796163 conn(0x7f23640aba30 msgr2=0x7f236415e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 shutdown_connections 2023-11-28T16:58:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.509+0000 7f236ae81640 1 -- 172.21.15.26:0/2275796163 wait complete. 2023-11-28T16:58:32.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:58:32.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd1b7f8640 1 Processor -- start 2023-11-28T16:58:32.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd1b7f8640 1 -- start start 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd1b7f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd140c0370 0x7fcd1406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd1b7f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd140a8470 0x7fcd1406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd1b7f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1406de00 con 0x7fcd1414eaf0 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd1b7f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd14070390 con 0x7fcd140a8470 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd1b7f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1406db90 con 0x7fcd140c0370 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd19d95640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd140a8470 0x7fcd1406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd19d95640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd140a8470 0x7fcd1406d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57630/0 (socket says 172.21.15.26:57630) 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd19d95640 1 -- 172.21.15.26:0/1714997553 learned_addr learned my addr 172.21.15.26:0/1714997553 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.673+0000 7fcd18d93640 1 --2- 172.21.15.26:0/1714997553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd140c0370 0x7fcd1406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd19d95640 1 -- 172.21.15.26:0/1714997553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd140c0370 msgr2=0x7fcd1406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:32.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd19d95640 1 --2- 172.21.15.26:0/1714997553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd140c0370 0x7fcd1406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd19d95640 1 -- 172.21.15.26:0/1714997553 >> v1:172.21.15.79:6789/0 conn(0x7fcd1414eaf0 legacy=0x7fcd14151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd19d95640 1 -- 172.21.15.26:0/1714997553 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1414eed0 con 0x7fcd140a8470 2023-11-28T16:58:32.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd19d95640 1 --2- 172.21.15.26:0/1714997553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140a8470 0x7fcd1406d650 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e50 tx=0x7fcd0c01eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a391765eb91fa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd0bfff640 1 -- 172.21.15.26:0/1714997553 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0a79f0 con 0x7fcd140a8470 2023-11-28T16:58:32.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd0bfff640 1 -- 172.21.15.26:0/1714997553 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0a7b50 con 0x7fcd140a8470 2023-11-28T16:58:32.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd0bfff640 1 -- 172.21.15.26:0/1714997553 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0af3f0 con 0x7fcd140a8470 2023-11-28T16:58:32.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/1714997553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140a8470 msgr2=0x7fcd1406d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/1714997553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140a8470 0x7fcd1406d650 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e50 tx=0x7fcd0c01eb00 comp rx=0 tx=0).stop 2023-11-28T16:58:32.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/1714997553 shutdown_connections 2023-11-28T16:58:32.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/1714997553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140a8470 0x7fcd1406d650 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/1714997553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd140c0370 0x7fcd1406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.677+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/1714997553 >> 172.21.15.26:0/1714997553 conn(0x7fcd140c2a60 msgr2=0x7fcd140c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:32.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/1714997553 shutdown_connections 2023-11-28T16:58:32.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/1714997553 wait complete. 2023-11-28T16:58:32.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 Processor -- start 2023-11-28T16:58:32.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 -- start start 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd140a8470 0x7fcd140c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140c0370 0x7fcd14144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd1414eaf0 0x7fcd1414a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c53c0 con 0x7fcd140c0370 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c4ca0 con 0x7fcd140a8470 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd141f0e60 con 0x7fcd1414eaf0 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140c0370 0x7fcd14144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140c0370 0x7fcd14144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57634/0 (socket says 172.21.15.26:57634) 2023-11-28T16:58:32.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 -- 172.21.15.26:0/2334417661 learned_addr learned my addr 172.21.15.26:0/2334417661 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd19594640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd140a8470 0x7fcd140c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd19d95640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd1414eaf0 0x7fcd1414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 -- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd1414eaf0 msgr2=0x7fcd1414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd1414eaf0 0x7fcd1414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 -- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd140a8470 msgr2=0x7fcd140c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd140a8470 0x7fcd140c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 -- 172.21.15.26:0/2334417661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c009b30 con 0x7fcd140c0370 2023-11-28T16:58:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd19d95640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd1414eaf0 0x7fcd1414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd18d93640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140c0370 0x7fcd14144330 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400e900 tx=0x7fcd0400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd09ffb640 1 -- 172.21.15.26:0/2334417661 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04009690 con 0x7fcd140c0370 2023-11-28T16:58:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd09ffb640 1 -- 172.21.15.26:0/2334417661 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0400ca00 con 0x7fcd140c0370 2023-11-28T16:58:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd141f1140 con 0x7fcd140c0370 2023-11-28T16:58:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.681+0000 7fcd09ffb640 1 -- 172.21.15.26:0/2334417661 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0400cdb0 con 0x7fcd140c0370 2023-11-28T16:58:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.685+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd140c58f0 con 0x7fcd140c0370 2023-11-28T16:58:32.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.685+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1404e890 con 0x7fcd140c0370 2023-11-28T16:58:32.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.685+0000 7fcd09ffb640 1 -- 172.21.15.26:0/2334417661 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcd04013470 con 0x7fcd140c0370 2023-11-28T16:58:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.685+0000 7fcd09ffb640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fccf8066900 0x7fccf8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.685+0000 7fcd09ffb640 1 -- 172.21.15.26:0/2334417661 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcd04084930 con 0x7fcd140c0370 2023-11-28T16:58:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.689+0000 7fcd19594640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fccf8066900 0x7fccf8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.689+0000 7fcd19594640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fccf8066900 0x7fccf8068dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcd10007fd0 tx=0x7fcd10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.689+0000 7fcd09ffb640 1 -- 172.21.15.26:0/2334417661 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd04051820 con 0x7fcd140c0370 2023-11-28T16:58:32.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.849+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd14070b60 con 0x7fcd140c0370 2023-11-28T16:58:32.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.849+0000 7fcd09ffb640 1 -- 172.21.15.26:0/2334417661 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd04054e40 con 0x7fcd140c0370 2023-11-28T16:58:32.853 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fccf8066900 msgr2=0x7fccf8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fccf8066900 0x7fccf8068dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcd10007fd0 tx=0x7fcd10009040 comp rx=0 tx=0).stop 2023-11-28T16:58:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140c0370 msgr2=0x7fcd14144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140c0370 0x7fcd14144330 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400e900 tx=0x7fcd0400edc0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 shutdown_connections 2023-11-28T16:58:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fccf8066900 0x7fccf8068dc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd1414eaf0 0x7fcd1414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd140c0370 0x7fcd14144330 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 --2- 172.21.15.26:0/2334417661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd140a8470 0x7fcd140c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:32.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 >> 172.21.15.26:0/2334417661 conn(0x7fcd140c2a60 msgr2=0x7fcd140bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:32.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 shutdown_connections 2023-11-28T16:58:32.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:32.853+0000 7fcd1b7f8640 1 -- 172.21.15.26:0/2334417661 wait complete. 2023-11-28T16:58:32.876 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:58:33.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56b51f8640 1 Processor -- start 2023-11-28T16:58:33.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56b51f8640 1 -- start start 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56b51f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56b006f0d0 0x7f56b00c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56b51f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b0073710 con 0x7f56b006b810 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56b51f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b00a6010 con 0x7f56b00c2a60 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56b51f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b01589f0 con 0x7f56b006f0d0 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56aed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f56b006b810 0x7f56b00bfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52016/0 (socket says 172.21.15.26:52016) 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56aed9d640 1 -- 172.21.15.26:0/4081873660 learned_addr learned my addr 172.21.15.26:0/4081873660 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56a7fff640 1 --2- 172.21.15.26:0/4081873660 >> v2:172.21.15.79:3300/0 conn(0x7f56b006f0d0 0x7f56b00c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269583376 0 0) 0x7f56b0073710 con 0x7f56b006b810 2023-11-28T16:58:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f569c003530 con 0x7f56b006b810 2023-11-28T16:58:33.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411262624 0 0) 0x7f56b00a6010 con 0x7f56b00c2a60 2023-11-28T16:58:33.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b0073710 con 0x7f56b00c2a60 2023-11-28T16:58:33.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3547386843 0 0) 0x7f569c003530 con 0x7f56b006b810 2023-11-28T16:58:33.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56a7fff640 1 -- 172.21.15.26:0/4081873660 >> v1:172.21.15.79:6789/0 conn(0x7f56b00c2a60 legacy=0x7f56b006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56a7fff640 1 -- 172.21.15.26:0/4081873660 >> v1:172.21.15.26:6789/0 conn(0x7f56b006b810 legacy=0x7f56b00bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.021+0000 7f56a7fff640 1 -- 172.21.15.26:0/4081873660 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00739d0 con 0x7f56b006f0d0 2023-11-28T16:58:33.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56a7fff640 1 --2- 172.21.15.26:0/4081873660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 0x7f56b00c1140 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56980097c0 tx=0x7f569801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e1fc8cbb8f23896 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0001680 con 0x7f56b006f0d0 2023-11-28T16:58:33.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56980a7050 con 0x7f56b006f0d0 2023-11-28T16:58:33.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56ae59c640 1 -- 172.21.15.26:0/4081873660 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56980ab620 con 0x7f56b006f0d0 2023-11-28T16:58:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56b51f8640 1 -- 172.21.15.26:0/4081873660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 msgr2=0x7f56b00c1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56b51f8640 1 --2- 172.21.15.26:0/4081873660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 0x7f56b00c1140 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56980097c0 tx=0x7f569801c3a0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56b51f8640 1 -- 172.21.15.26:0/4081873660 shutdown_connections 2023-11-28T16:58:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56b51f8640 1 --2- 172.21.15.26:0/4081873660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 0x7f56b00c1140 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56b51f8640 1 -- 172.21.15.26:0/4081873660 >> 172.21.15.26:0/4081873660 conn(0x7f56b00c3240 msgr2=0x7f56b00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56b51f8640 1 -- 172.21.15.26:0/4081873660 shutdown_connections 2023-11-28T16:58:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.025+0000 7f56b51f8640 1 -- 172.21.15.26:0/4081873660 wait complete. 2023-11-28T16:58:33.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 Processor -- start 2023-11-28T16:58:33.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 -- start start 2023-11-28T16:58:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56b006b810 0x7f56b014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 0x7f56b00ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b00c2a60 0x7f56b00ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0143620 con 0x7f56b00c2a60 2023-11-28T16:58:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00a9820 con 0x7f56b006f0d0 2023-11-28T16:58:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b01f1230 con 0x7f56b006b810 2023-11-28T16:58:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b00c2a60 0x7f56b00ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b00c2a60 0x7f56b00ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57638/0 (socket says 172.21.15.26:57638) 2023-11-28T16:58:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 -- 172.21.15.26:0/1250998056 learned_addr learned my addr 172.21.15.26:0/1250998056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56aed9d640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56b006b810 0x7f56b014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56a7fff640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 0x7f56b00ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 -- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56b006b810 msgr2=0x7f56b014c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56b006b810 0x7f56b014c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 -- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 msgr2=0x7f56b00ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 0x7f56b00ab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 -- 172.21.15.26:0/1250998056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698009420 con 0x7f56b00c2a60 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56af59e640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b00c2a60 0x7f56b00ab840 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f56a800c790 tx=0x7f56a800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56a77fe640 1 -- 172.21.15.26:0/1250998056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800cea0 con 0x7f56b00c2a60 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56a77fe640 1 -- 172.21.15.26:0/1250998056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8003b80 con 0x7f56b00c2a60 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56a77fe640 1 -- 172.21.15.26:0/1250998056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800a850 con 0x7f56b00c2a60 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b01f0cd0 con 0x7f56b00c2a60 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.029+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b0156560 con 0x7f56b00c2a60 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.033+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b004e890 con 0x7f56b00c2a60 2023-11-28T16:58:33.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.033+0000 7f56a77fe640 1 -- 172.21.15.26:0/1250998056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f56a800a9b0 con 0x7f56b00c2a60 2023-11-28T16:58:33.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.033+0000 7f56a77fe640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5690066900 0x7f5690068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.033+0000 7f56a77fe640 1 -- 172.21.15.26:0/1250998056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f56a8084520 con 0x7f56b00c2a60 2023-11-28T16:58:33.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.033+0000 7f56aed9d640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5690066900 0x7f5690068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.033+0000 7f56aed9d640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5690066900 0x7f5690068dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f56a0000f70 tx=0x7f56a00016c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.037+0000 7f56a77fe640 1 -- 172.21.15.26:0/1250998056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56a80514a0 con 0x7f56b00c2a60 2023-11-28T16:58:33.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56b00734f0 con 0x7f56b00c2a60 2023-11-28T16:58:33.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56a77fe640 1 -- 172.21.15.26:0/1250998056 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f56a8054ac0 con 0x7f56b00c2a60 2023-11-28T16:58:33.199 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5690066900 msgr2=0x7f5690068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5690066900 0x7f5690068dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f56a0000f70 tx=0x7f56a00016c0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b00c2a60 msgr2=0x7f56b00ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b00c2a60 0x7f56b00ab840 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f56a800c790 tx=0x7f56a800cc50 comp rx=0 tx=0).stop 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 shutdown_connections 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b00c2a60 0x7f56b00ab840 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56b006f0d0 0x7f56b00ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5690066900 0x7f5690068dc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 --2- 172.21.15.26:0/1250998056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56b006b810 0x7f56b014c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 >> 172.21.15.26:0/1250998056 conn(0x7f56b00c3240 msgr2=0x7f56b00714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:33.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 shutdown_connections 2023-11-28T16:58:33.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.197+0000 7f56b51f8640 1 -- 172.21.15.26:0/1250998056 wait complete. 2023-11-28T16:58:33.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:58:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedf59e640 1 Processor -- start 2023-11-28T16:58:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedf59e640 1 -- start start 2023-11-28T16:58:33.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedf59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efee00c2750 0x7efee00bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedf59e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00c1410 con 0x7efee0071f30 2023-11-28T16:58:33.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedf59e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00c0e90 con 0x7efee00c0460 2023-11-28T16:58:33.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedf59e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee00c1130 con 0x7efee00c2750 2023-11-28T16:58:33.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efeded9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efee0071f30 0x7efee00c5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52024/0 (socket says 172.21.15.26:52024) 2023-11-28T16:58:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efeded9d640 1 -- 172.21.15.26:0/1181907334 learned_addr learned my addr 172.21.15.26:0/1181907334 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efede59c640 1 --2- 172.21.15.26:0/1181907334 >> v2:172.21.15.79:3300/0 conn(0x7efee00c2750 0x7efee00bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedd59a640 1 -- 172.21.15.26:0/1181907334 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596804082 0 0) 0x7efee00c1410 con 0x7efee0071f30 2023-11-28T16:58:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedd59a640 1 -- 172.21.15.26:0/1181907334 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec8005740 con 0x7efee0071f30 2023-11-28T16:58:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efedd59a640 1 -- 172.21.15.26:0/1181907334 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690748698 0 0) 0x7efee00c0e90 con 0x7efee00c0460 2023-11-28T16:58:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efede59c640 1 -- 172.21.15.26:0/1181907334 >> v1:172.21.15.79:6789/0 conn(0x7efee00c0460 legacy=0x7efee00c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efede59c640 1 -- 172.21.15.26:0/1181907334 >> v1:172.21.15.26:6789/0 conn(0x7efee0071f30 legacy=0x7efee00c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.365+0000 7efede59c640 1 -- 172.21.15.26:0/1181907334 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee006da20 con 0x7efee00c2750 2023-11-28T16:58:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efede59c640 1 --2- 172.21.15.26:0/1181907334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c2750 0x7efee00bc370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efed00097c0 tx=0x7efed001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d1bb486d7650c99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedd59a640 1 -- 172.21.15.26:0/1181907334 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00ab600 con 0x7efee00c2750 2023-11-28T16:58:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedd59a640 1 -- 172.21.15.26:0/1181907334 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed00a7050 con 0x7efee00c2750 2023-11-28T16:58:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedd59a640 1 -- 172.21.15.26:0/1181907334 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00ab960 con 0x7efee00c2750 2023-11-28T16:58:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedf59e640 1 -- 172.21.15.26:0/1181907334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c2750 msgr2=0x7efee00bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedf59e640 1 --2- 172.21.15.26:0/1181907334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c2750 0x7efee00bc370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efed00097c0 tx=0x7efed001c330 comp rx=0 tx=0).stop 2023-11-28T16:58:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedf59e640 1 -- 172.21.15.26:0/1181907334 shutdown_connections 2023-11-28T16:58:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedf59e640 1 --2- 172.21.15.26:0/1181907334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c2750 0x7efee00bc370 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedf59e640 1 -- 172.21.15.26:0/1181907334 >> 172.21.15.26:0/1181907334 conn(0x7efee00c5a60 msgr2=0x7efee00c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedf59e640 1 -- 172.21.15.26:0/1181907334 shutdown_connections 2023-11-28T16:58:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.369+0000 7efedf59e640 1 -- 172.21.15.26:0/1181907334 wait complete. 2023-11-28T16:58:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 Processor -- start 2023-11-28T16:58:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 -- start start 2023-11-28T16:58:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee0071f30 0x7efee00baf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c0460 0x7efee0154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efee00c2750 0x7efee0155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee009b5d0 con 0x7efee0071f30 2023-11-28T16:58:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0155580 con 0x7efee00c0460 2023-11-28T16:58:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee01f1110 con 0x7efee00c2750 2023-11-28T16:58:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee0071f30 0x7efee00baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee0071f30 0x7efee00baf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57652/0 (socket says 172.21.15.26:57652) 2023-11-28T16:58:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 -- 172.21.15.26:0/4047340126 learned_addr learned my addr 172.21.15.26:0/4047340126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efeddd9b640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c0460 0x7efee0154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efeded9d640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efee00c2750 0x7efee0155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 -- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efee00c2750 msgr2=0x7efee0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efee00c2750 0x7efee0155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 -- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c0460 msgr2=0x7efee0154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c0460 0x7efee0154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 -- 172.21.15.26:0/4047340126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009420 con 0x7efee0071f30 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efeddd9b640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c0460 0x7efee0154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efeded9d640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efee00c2750 0x7efee0155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efede59c640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee0071f30 0x7efee00baf10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efed0018f40 tx=0x7efed00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efeceffd640 1 -- 172.21.15.26:0/4047340126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00b4400 con 0x7efee0071f30 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efeceffd640 1 -- 172.21.15.26:0/4047340126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed00b4560 con 0x7efee0071f30 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efeceffd640 1 -- 172.21.15.26:0/4047340126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00b48d0 con 0x7efee0071f30 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.373+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee00bfb90 con 0x7efee0071f30 2023-11-28T16:58:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.377+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee01f0630 con 0x7efee0071f30 2023-11-28T16:58:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.377+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee00680c0 con 0x7efee0071f30 2023-11-28T16:58:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.377+0000 7efeceffd640 1 -- 172.21.15.26:0/4047340126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efed00b2040 con 0x7efee0071f30 2023-11-28T16:58:33.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.377+0000 7efeceffd640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efec00668d0 0x7efec0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.377+0000 7efeceffd640 1 -- 172.21.15.26:0/4047340126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efed011e740 con 0x7efee0071f30 2023-11-28T16:58:33.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.377+0000 7efeddd9b640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efec00668d0 0x7efec0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.381+0000 7efeddd9b640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efec00668d0 0x7efec0068d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efee00a6ed0 tx=0x7efed4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.381+0000 7efeceffd640 1 -- 172.21.15.26:0/4047340126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efed00eb6b0 con 0x7efee0071f30 2023-11-28T16:58:33.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7efee00c0c50 con 0x7efee0071f30 2023-11-28T16:58:33.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efeceffd640 1 -- 172.21.15.26:0/4047340126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7efee00c0c50 con 0x7efee0071f30 2023-11-28T16:58:33.544 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efec00668d0 msgr2=0x7efec0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efec00668d0 0x7efec0068d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efee00a6ed0 tx=0x7efed4009040 comp rx=0 tx=0).stop 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee0071f30 msgr2=0x7efee00baf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee0071f30 0x7efee00baf10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efed0018f40 tx=0x7efed00190d0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 shutdown_connections 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efec00668d0 0x7efec0068d90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efee00c2750 0x7efee0155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00c0460 0x7efee0154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 --2- 172.21.15.26:0/4047340126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee0071f30 0x7efee00baf10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 >> 172.21.15.26:0/4047340126 conn(0x7efee00c5a60 msgr2=0x7efee00c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 shutdown_connections 2023-11-28T16:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.541+0000 7efedf59e640 1 -- 172.21.15.26:0/4047340126 wait complete. 2023-11-28T16:58:33.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:33.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.705+0000 7f42141f8640 1 Processor -- start 2023-11-28T16:58:33.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.705+0000 7f42141f8640 1 -- start start 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f42141f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c151dc0 0x7f420c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f42141f8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f420c06baf0 0x7f420c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f42141f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0c2100 con 0x7f420c06e9a0 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f42141f8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0c1930 con 0x7f420c06baf0 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f42141f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c154890 con 0x7f420c151dc0 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f420c06baf0 0x7f420c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f420c06baf0 0x7f420c154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57664/0 (socket says 172.21.15.26:57664) 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 -- 172.21.15.26:0/1695271112 learned_addr learned my addr 172.21.15.26:0/1695271112 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 -- 172.21.15.26:0/1695271112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c151dc0 msgr2=0x7f420c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 --2- 172.21.15.26:0/1695271112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c151dc0 0x7f420c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 -- 172.21.15.26:0/1695271112 >> v1:172.21.15.79:6789/0 conn(0x7f420c06e9a0 legacy=0x7f420c155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 -- 172.21.15.26:0/1695271112 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c06d6a0 con 0x7f420c06baf0 2023-11-28T16:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.709+0000 7f4211793640 1 --2- 172.21.15.26:0/1695271112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c06baf0 0x7f420c154ce0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009870 tx=0x7f41fc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd3c6b8ddeb8018 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4210f92640 1 -- 172.21.15.26:0/1695271112 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0ac410 con 0x7f420c06baf0 2023-11-28T16:58:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4210f92640 1 -- 172.21.15.26:0/1695271112 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc0ac570 con 0x7f420c06baf0 2023-11-28T16:58:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4210f92640 1 -- 172.21.15.26:0/1695271112 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0ac900 con 0x7f420c06baf0 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- 172.21.15.26:0/1695271112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c06baf0 msgr2=0x7f420c154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 --2- 172.21.15.26:0/1695271112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c06baf0 0x7f420c154ce0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009870 tx=0x7f41fc01c500 comp rx=0 tx=0).stop 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- 172.21.15.26:0/1695271112 shutdown_connections 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 --2- 172.21.15.26:0/1695271112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c06baf0 0x7f420c154ce0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 --2- 172.21.15.26:0/1695271112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c151dc0 0x7f420c06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- 172.21.15.26:0/1695271112 >> 172.21.15.26:0/1695271112 conn(0x7f420c0c3240 msgr2=0x7f420c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- 172.21.15.26:0/1695271112 shutdown_connections 2023-11-28T16:58:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- 172.21.15.26:0/1695271112 wait complete. 2023-11-28T16:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 Processor -- start 2023-11-28T16:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- start start 2023-11-28T16:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c06baf0 0x7f420c1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f420c06e9a0 0x7f420c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c151dc0 0x7f420c1ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1f0410 con 0x7f420c151dc0 2023-11-28T16:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1f0f50 con 0x7f420c06e9a0 2023-11-28T16:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f42141f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1f0620 con 0x7f420c06baf0 2023-11-28T16:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4212795640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c151dc0 0x7f420c1ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4212795640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c151dc0 0x7f420c1ed0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57666/0 (socket says 172.21.15.26:57666) 2023-11-28T16:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4212795640 1 -- 172.21.15.26:0/4274017228 learned_addr learned my addr 172.21.15.26:0/4274017228 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4211793640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f420c06e9a0 0x7f420c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.713+0000 7f4211f94640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c06baf0 0x7f420c1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f4212795640 1 -- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c06baf0 msgr2=0x7f420c1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f4212795640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c06baf0 0x7f420c1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f4212795640 1 -- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f420c06e9a0 msgr2=0x7f420c14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f4212795640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f420c06e9a0 0x7f420c14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f4212795640 1 -- 172.21.15.26:0/4274017228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc0094d0 con 0x7f420c151dc0 2023-11-28T16:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f4212795640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c151dc0 0x7f420c1ed0c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f420400c7b0 tx=0x7f420400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42027fc640 1 -- 172.21.15.26:0/4274017228 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204004b70 con 0x7f420c151dc0 2023-11-28T16:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42027fc640 1 -- 172.21.15.26:0/4274017228 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204004cd0 con 0x7f420c151dc0 2023-11-28T16:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42027fc640 1 -- 172.21.15.26:0/4274017228 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420400aa90 con 0x7f420c151dc0 2023-11-28T16:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c1f0900 con 0x7f420c151dc0 2023-11-28T16:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c153ee0 con 0x7f420c151dc0 2023-11-28T16:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c1f1090 con 0x7f420c151dc0 2023-11-28T16:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42027fc640 1 -- 172.21.15.26:0/4274017228 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f420400abf0 con 0x7f420c151dc0 2023-11-28T16:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42027fc640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41f00668d0 0x7f41f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.717+0000 7f42027fc640 1 -- 172.21.15.26:0/4274017228 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f42040849a0 con 0x7f420c151dc0 2023-11-28T16:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.721+0000 7f4211f94640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41f00668d0 0x7f41f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.721+0000 7f4211f94640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41f00668d0 0x7f41f0068d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4208006fd0 tx=0x7f4208008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.721+0000 7f42027fc640 1 -- 172.21.15.26:0/4274017228 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f420c1f1090 con 0x7f420c151dc0 2023-11-28T16:58:33.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.913+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f420c1f1090 con 0x7f420c151dc0 2023-11-28T16:58:33.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.913+0000 7f42027fc640 1 -- 172.21.15.26:0/4274017228 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7f420c1f1090 con 0x7f420c151dc0 2023-11-28T16:58:33.916 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:33.916 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:56.668279+0000","modified":"2023-11-28T16:57:59.688325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3225309020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3225309020},{"type":"v1","addr":"172.21.15.26:6835","nonce":3225309020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:33.917 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 37 2023-11-28T16:58:33.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.913+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41f00668d0 msgr2=0x7f41f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.913+0000 7f42141f8640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41f00668d0 0x7f41f0068d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4208006fd0 tx=0x7f4208008040 comp rx=0 tx=0).stop 2023-11-28T16:58:33.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.913+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c151dc0 msgr2=0x7f420c1ed0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:33.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.913+0000 7f42141f8640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c151dc0 0x7f420c1ed0c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f420400c7b0 tx=0x7f420400cc70 comp rx=0 tx=0).stop 2023-11-28T16:58:33.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 shutdown_connections 2023-11-28T16:58:33.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c151dc0 0x7f420c1ed0c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f420c06e9a0 0x7f420c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f41f00668d0 0x7f41f0068d90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 --2- 172.21.15.26:0/4274017228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f420c06baf0 0x7f420c1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:33.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 >> 172.21.15.26:0/4274017228 conn(0x7f420c0c3240 msgr2=0x7f420c0c0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:33.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 shutdown_connections 2023-11-28T16:58:33.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:33.917+0000 7f42141f8640 1 -- 172.21.15.26:0/4274017228 wait complete. 2023-11-28T16:58:33.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:34.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.077+0000 7fd40cd96640 1 Processor -- start 2023-11-28T16:58:34.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.077+0000 7fd40cd96640 1 -- start start 2023-11-28T16:58:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd40cd96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4080c2ac0 0x7fd408070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd40cd96640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4080c5f20 0x7fd408151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd40cd96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd408152070 0x7fd4080c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd40cd96640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd408158b20 con 0x7fd4080c5f20 2023-11-28T16:58:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd40cd96640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd408070ba0 con 0x7fd4080c2ac0 2023-11-28T16:58:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd40cd96640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd408157f10 con 0x7fd408152070 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4080c5f20 0x7fd408151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4080c5f20 0x7fd408151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57668/0 (socket says 172.21.15.26:57668) 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 -- 172.21.15.26:0/2873439032 learned_addr learned my addr 172.21.15.26:0/2873439032 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd40659c640 1 --2- 172.21.15.26:0/2873439032 >> v2:172.21.15.79:3300/0 conn(0x7fd4080c2ac0 0x7fd408070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd406d9d640 1 --2- 172.21.15.26:0/2873439032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd408152070 0x7fd4080c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 -- 172.21.15.26:0/2873439032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd408152070 msgr2=0x7fd4080c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 --2- 172.21.15.26:0/2873439032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd408152070 0x7fd4080c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 -- 172.21.15.26:0/2873439032 >> v2:172.21.15.79:3300/0 conn(0x7fd4080c2ac0 msgr2=0x7fd408070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 --2- 172.21.15.26:0/2873439032 >> v2:172.21.15.79:3300/0 conn(0x7fd4080c2ac0 0x7fd408070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.081+0000 7fd3fffff640 1 -- 172.21.15.26:0/2873439032 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4081581f0 con 0x7fd4080c5f20 2023-11-28T16:58:34.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd3fffff640 1 --2- 172.21.15.26:0/2873439032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080c5f20 0x7fd408151b30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd4080c5ef0 tx=0x7fd3f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239eebbe1e9306c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd405d9b640 1 -- 172.21.15.26:0/2873439032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4080c1fe0 con 0x7fd4080c5f20 2023-11-28T16:58:34.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd405d9b640 1 -- 172.21.15.26:0/2873439032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00ab600 con 0x7fd4080c5f20 2023-11-28T16:58:34.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd405d9b640 1 -- 172.21.15.26:0/2873439032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00ab990 con 0x7fd4080c5f20 2023-11-28T16:58:34.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 -- 172.21.15.26:0/2873439032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080c5f20 msgr2=0x7fd408151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 --2- 172.21.15.26:0/2873439032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080c5f20 0x7fd408151b30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd4080c5ef0 tx=0x7fd3f001c440 comp rx=0 tx=0).stop 2023-11-28T16:58:34.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 -- 172.21.15.26:0/2873439032 shutdown_connections 2023-11-28T16:58:34.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 --2- 172.21.15.26:0/2873439032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd408152070 0x7fd4080c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 --2- 172.21.15.26:0/2873439032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080c5f20 0x7fd408151b30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 --2- 172.21.15.26:0/2873439032 >> v2:172.21.15.79:3300/0 conn(0x7fd4080c2ac0 0x7fd408070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 -- 172.21.15.26:0/2873439032 >> 172.21.15.26:0/2873439032 conn(0x7fd4080a9c10 msgr2=0x7fd4080aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 -- 172.21.15.26:0/2873439032 shutdown_connections 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 -- 172.21.15.26:0/2873439032 wait complete. 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 Processor -- start 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.085+0000 7fd40cd96640 1 -- start start 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4080c2ac0 0x7fd4081f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4080c5f20 0x7fd408142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408152070 0x7fd408143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408148d70 con 0x7fd408152070 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408146890 con 0x7fd4080c2ac0 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd408144710 con 0x7fd4080c5f20 2023-11-28T16:58:34.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408152070 0x7fd408143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4080c2ac0 0x7fd4081f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4080c2ac0 0x7fd4081f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:56454/0 (socket says 172.21.15.26:56454) 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408152070 0x7fd408143340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57678/0 (socket says 172.21.15.26:57678) 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 -- 172.21.15.26:0/580863943 learned_addr learned my addr 172.21.15.26:0/580863943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd3fffff640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4080c5f20 0x7fd408142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 -- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4080c5f20 msgr2=0x7fd408142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4080c5f20 0x7fd408142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 -- 172.21.15.26:0/580863943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408152070 msgr2=0x7fd408143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408152070 0x7fd408143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 -- 172.21.15.26:0/580863943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00094d0 con 0x7fd4080c2ac0 2023-11-28T16:58:34.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40659c640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4080c2ac0 0x7fd4081f0610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800d800 tx=0x7fd3f800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd3feffd640 1 -- 172.21.15.26:0/580863943 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800b6c0 con 0x7fd4080c2ac0 2023-11-28T16:58:34.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd3feffd640 1 -- 172.21.15.26:0/580863943 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f800b820 con 0x7fd4080c2ac0 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd3feffd640 1 -- 172.21.15.26:0/580863943 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800bb90 con 0x7fd4080c2ac0 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4081460d0 con 0x7fd4080c2ac0 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd408146370 con 0x7fd4080c2ac0 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40804e890 con 0x7fd4080c2ac0 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.089+0000 7fd3feffd640 1 -- 172.21.15.26:0/580863943 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd3f800bcf0 con 0x7fd4080c2ac0 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.093+0000 7fd3feffd640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd3e8066900 0x7fd3e8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.093+0000 7fd3feffd640 1 -- 172.21.15.26:0/580863943 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd3f8085070 con 0x7fd4080c2ac0 2023-11-28T16:58:34.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.093+0000 7fd3fffff640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd3e8066900 0x7fd3e8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.093+0000 7fd3fffff640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd3e8066900 0x7fd3e8068dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00af000 tx=0x7fd3f00b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.097+0000 7fd3feffd640 1 -- 172.21.15.26:0/580863943 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3f80520e0 con 0x7fd4080c2ac0 2023-11-28T16:58:34.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.253+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd408143880 con 0x7fd4080c2ac0 2023-11-28T16:58:34.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.253+0000 7fd3feffd640 1 -- 172.21.15.26:0/580863943 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20208 (secure 0 0 0) 0x7fd3f8055700 con 0x7fd4080c2ac0 2023-11-28T16:58:34.258 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:34.258 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:11.370310+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd3e8066900 msgr2=0x7fd3e8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd3e8066900 0x7fd3e8068dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00af000 tx=0x7fd3f00b6040 comp rx=0 tx=0).stop 2023-11-28T16:58:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4080c2ac0 msgr2=0x7fd4081f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4080c2ac0 0x7fd4081f0610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800d800 tx=0x7fd3f800dcc0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 shutdown_connections 2023-11-28T16:58:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408152070 0x7fd408143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd3e8066900 0x7fd3e8068dc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4080c5f20 0x7fd408142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 --2- 172.21.15.26:0/580863943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4080c2ac0 0x7fd4081f0610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 >> 172.21.15.26:0/580863943 conn(0x7fd4080a9c10 msgr2=0x7fd4080c71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:34.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 shutdown_connections 2023-11-28T16:58:34.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.257+0000 7fd40cd96640 1 -- 172.21.15.26:0/580863943 wait complete. 2023-11-28T16:58:34.280 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T16:58:34.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.421+0000 7f0ba359e640 1 Processor -- start 2023-11-28T16:58:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba359e640 1 -- start start 2023-11-28T16:58:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba359e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ba40c4890 0x7f0ba40caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba359e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba406b7d0 con 0x7f0ba40bd5a0 2023-11-28T16:58:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba359e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba4155160 con 0x7f0ba40ca620 2023-11-28T16:58:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba359e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba406b180 con 0x7f0ba40c4890 2023-11-28T16:58:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba2d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0ba40bd5a0 0x7f0ba40c8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52036/0 (socket says 172.21.15.26:52036) 2023-11-28T16:58:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba2d9d640 1 -- 172.21.15.26:0/317994585 learned_addr learned my addr 172.21.15.26:0/317994585 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba1d9b640 1 --2- 172.21.15.26:0/317994585 >> v2:172.21.15.79:3300/0 conn(0x7f0ba40c4890 0x7f0ba40caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43524203 0 0) 0x7f0ba406b7d0 con 0x7f0ba40bd5a0 2023-11-28T16:58:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b8c003530 con 0x7f0ba40bd5a0 2023-11-28T16:58:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494138031 0 0) 0x7f0ba4155160 con 0x7f0ba40ca620 2023-11-28T16:58:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba406b7d0 con 0x7f0ba40ca620 2023-11-28T16:58:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690909591 0 0) 0x7f0b8c003530 con 0x7f0ba40bd5a0 2023-11-28T16:58:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba1d9b640 1 -- 172.21.15.26:0/317994585 >> v1:172.21.15.79:6789/0 conn(0x7f0ba40ca620 legacy=0x7f0ba40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba1d9b640 1 -- 172.21.15.26:0/317994585 >> v1:172.21.15.26:6789/0 conn(0x7f0ba40bd5a0 legacy=0x7f0ba40c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.425+0000 7f0ba1d9b640 1 -- 172.21.15.26:0/317994585 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba406b460 con 0x7f0ba40c4890 2023-11-28T16:58:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba1d9b640 1 --2- 172.21.15.26:0/317994585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 0x7f0ba40caa00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b980097c0 tx=0x7f0b9801bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5ec935e05e9160 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c001a00 con 0x7f0ba40c4890 2023-11-28T16:58:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba40c9da0 con 0x7f0ba40c4890 2023-11-28T16:58:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba159a640 1 -- 172.21.15.26:0/317994585 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b980a56a0 con 0x7f0ba40c4890 2023-11-28T16:58:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba359e640 1 -- 172.21.15.26:0/317994585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 msgr2=0x7f0ba40caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba359e640 1 --2- 172.21.15.26:0/317994585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 0x7f0ba40caa00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b980097c0 tx=0x7f0b9801bf60 comp rx=0 tx=0).stop 2023-11-28T16:58:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba359e640 1 -- 172.21.15.26:0/317994585 shutdown_connections 2023-11-28T16:58:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba359e640 1 --2- 172.21.15.26:0/317994585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 0x7f0ba40caa00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba359e640 1 -- 172.21.15.26:0/317994585 >> 172.21.15.26:0/317994585 conn(0x7f0ba40ac0a0 msgr2=0x7f0ba40c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba359e640 1 -- 172.21.15.26:0/317994585 shutdown_connections 2023-11-28T16:58:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.429+0000 7f0ba359e640 1 -- 172.21.15.26:0/317994585 wait complete. 2023-11-28T16:58:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 Processor -- start 2023-11-28T16:58:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 -- start start 2023-11-28T16:58:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bd5a0 0x7f0ba4151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 0x7f0ba41448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba40ca620 0x7f0ba40aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba414d9a0 con 0x7f0ba40ca620 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba414d700 con 0x7f0ba40c4890 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba414f7b0 con 0x7f0ba40bd5a0 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba40ca620 0x7f0ba40aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba40ca620 0x7f0ba40aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57690/0 (socket says 172.21.15.26:57690) 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 -- 172.21.15.26:0/2838047713 learned_addr learned my addr 172.21.15.26:0/2838047713 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba259c640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bd5a0 0x7f0ba4151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba1d9b640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 0x7f0ba41448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 -- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bd5a0 msgr2=0x7f0ba4151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bd5a0 0x7f0ba4151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 -- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 msgr2=0x7f0ba41448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 0x7f0ba41448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 -- 172.21.15.26:0/2838047713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98009420 con 0x7f0ba40ca620 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba2d9d640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba40ca620 0x7f0ba40aaba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00cc80 tx=0x7f0b9c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0b92ffd640 1 -- 172.21.15.26:0/2838047713 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c00ce90 con 0x7f0ba40ca620 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0b92ffd640 1 -- 172.21.15.26:0/2838047713 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c012400 con 0x7f0ba40ca620 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba414f160 con 0x7f0ba40ca620 2023-11-28T16:58:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0b92ffd640 1 -- 172.21.15.26:0/2838047713 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0127f0 con 0x7f0ba40ca620 2023-11-28T16:58:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba414b500 con 0x7f0ba40ca620 2023-11-28T16:58:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.433+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba404e890 con 0x7f0ba40ca620 2023-11-28T16:58:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.437+0000 7f0b92ffd640 1 -- 172.21.15.26:0/2838047713 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0b9c012950 con 0x7f0ba40ca620 2023-11-28T16:58:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.437+0000 7f0b92ffd640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0b840668d0 0x7f0b84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.437+0000 7f0b92ffd640 1 -- 172.21.15.26:0/2838047713 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0b9c084da0 con 0x7f0ba40ca620 2023-11-28T16:58:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.437+0000 7f0ba259c640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0b840668d0 0x7f0b84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.437+0000 7f0ba259c640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0b840668d0 0x7f0b84068d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40c6100 tx=0x7f0b94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.441+0000 7f0b92ffd640 1 -- 172.21.15.26:0/2838047713 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b9c051d20 con 0x7f0ba40ca620 2023-11-28T16:58:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ba41ed510 con 0x7f0ba40ca620 2023-11-28T16:58:34.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0b92ffd640 1 -- 172.21.15.26:0/2838047713 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7f0b9c055340 con 0x7f0ba40ca620 2023-11-28T16:58:34.635 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:34.635 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:56.668279+0000","modified":"2023-11-28T16:57:59.688325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3225309020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3225309020},{"type":"v1","addr":"172.21.15.26:6835","nonce":3225309020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:34.635 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 37 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0b840668d0 msgr2=0x7f0b84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0b840668d0 0x7f0b84068d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40c6100 tx=0x7f0b94009040 comp rx=0 tx=0).stop 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba40ca620 msgr2=0x7f0ba40aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba40ca620 0x7f0ba40aaba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00cc80 tx=0x7f0b9c00a430 comp rx=0 tx=0).stop 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 shutdown_connections 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba40ca620 0x7f0ba40aaba0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40c4890 0x7f0ba41448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0b840668d0 0x7f0b84068d90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 --2- 172.21.15.26:0/2838047713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bd5a0 0x7f0ba4151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 >> 172.21.15.26:0/2838047713 conn(0x7f0ba40ac0a0 msgr2=0x7f0ba40c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 shutdown_connections 2023-11-28T16:58:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.633+0000 7f0ba359e640 1 -- 172.21.15.26:0/2838047713 wait complete. 2023-11-28T16:58:34.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:34.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d6950f640 1 Processor -- start 2023-11-28T16:58:34.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d6950f640 1 -- start start 2023-11-28T16:58:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d6950f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 0x7f3d64151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d6950f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6406d320 con 0x7f3d64070b80 2023-11-28T16:58:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d6950f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d640721b0 con 0x7f3d640a8470 2023-11-28T16:58:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d6950f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640c2830 con 0x7f3d6414e9d0 2023-11-28T16:58:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d5bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3d64070b80 0x7f3d640c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52048/0 (socket says 172.21.15.26:52048) 2023-11-28T16:58:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d5bfff640 1 -- 172.21.15.26:0/142235852 learned_addr learned my addr 172.21.15.26:0/142235852 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d62ffd640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 0x7f3d64151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.797+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82561672 0 0) 0x7f3d6406d320 con 0x7f3d64070b80 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d50003530 con 0x7f3d64070b80 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775281056 0 0) 0x7f3d640721b0 con 0x7f3d640a8470 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6406d320 con 0x7f3d640a8470 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3518541182 0 0) 0x7f3d50003530 con 0x7f3d64070b80 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 msgr2=0x7f3d64151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 0x7f3d64151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 >> v1:172.21.15.79:6789/0 conn(0x7f3d640a8470 legacy=0x7f3d6406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d64072450 con 0x7f3d64070b80 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f3d4c001680 con 0x7f3d64070b80 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 >> v1:172.21.15.26:6789/0 conn(0x7f3d64070b80 legacy=0x7f3d640c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d50003b40 0x7f3d50003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 0x7f3d500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d50004d10 0x7f3d50005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640c2830 con 0x7f3d50004d10 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5000dd30 con 0x7f3d50003b40 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5000dec0 con 0x7f3d6414e9d0 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d637fe640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d50004d10 0x7f3d50005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d5bfff640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 0x7f3d500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d62ffd640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d50003b40 0x7f3d50003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d637fe640 1 -- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 msgr2=0x7f3d500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d637fe640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d6414e9d0 0x7f3d500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d637fe640 1 -- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d50003b40 msgr2=0x7f3d50003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d637fe640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d50003b40 0x7f3d50003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d637fe640 1 -- 172.21.15.26:0/142235852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50003530 con 0x7f3d50004d10 2023-11-28T16:58:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.801+0000 7f3d62ffd640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d50003b40 0x7f3d50003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d637fe640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d50004d10 0x7f3d50005190 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001fd0 tx=0x7f3d5c01f010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747ffbd8aae055d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0a8c30 con 0x7f3d50004d10 2023-11-28T16:58:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c0a8db0 con 0x7f3d50004d10 2023-11-28T16:58:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d627fc640 1 -- 172.21.15.26:0/142235852 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c003bc0 con 0x7f3d50004d10 2023-11-28T16:58:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- 172.21.15.26:0/142235852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d50004d10 msgr2=0x7f3d50005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 --2- 172.21.15.26:0/142235852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d50004d10 0x7f3d50005190 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001fd0 tx=0x7f3d5c01f010 comp rx=0 tx=0).stop 2023-11-28T16:58:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d637fe640 1 -- 172.21.15.26:0/142235852 reap_dead start 2023-11-28T16:58:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- 172.21.15.26:0/142235852 shutdown_connections 2023-11-28T16:58:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- 172.21.15.26:0/142235852 >> 172.21.15.26:0/142235852 conn(0x7f3d640c2ad0 msgr2=0x7f3d640c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- 172.21.15.26:0/142235852 shutdown_connections 2023-11-28T16:58:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- 172.21.15.26:0/142235852 wait complete. 2023-11-28T16:58:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 Processor -- start 2023-11-28T16:58:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- start start 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d50004d10 0x7f3d640ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d640aa870 0x7f3d640c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d641ebb70 0x7f3d641ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d64152860 con 0x7f3d640aa870 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d641eb6e0 con 0x7f3d641ebb70 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.805+0000 7f3d6950f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640ab7d0 con 0x7f3d50004d10 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d640aa870 0x7f3d640c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d640aa870 0x7f3d640c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57710/0 (socket says 172.21.15.26:57710) 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 -- 172.21.15.26:0/4198922973 learned_addr learned my addr 172.21.15.26:0/4198922973 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d62ffd640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d50004d10 0x7f3d640ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 -- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d50004d10 msgr2=0x7f3d640ab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d637fe640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d641ebb70 0x7f3d641ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d50004d10 0x7f3d640ab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 -- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d641ebb70 msgr2=0x7f3d641ebff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d641ebb70 0x7f3d641ebff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 -- 172.21.15.26:0/4198922973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d641eb090 con 0x7f3d640aa870 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d62ffd640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d50004d10 0x7f3d640ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d637fe640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d641ebb70 0x7f3d641ebff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5bfff640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d640aa870 0x7f3d640c4e70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c001a20 tx=0x7f3d4c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5b7fe640 1 -- 172.21.15.26:0/4198922973 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c007770 con 0x7f3d640aa870 2023-11-28T16:58:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5b7fe640 1 -- 172.21.15.26:0/4198922973 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00f7b0 con 0x7f3d640aa870 2023-11-28T16:58:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5b7fe640 1 -- 172.21.15.26:0/4198922973 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00fb60 con 0x7f3d640aa870 2023-11-28T16:58:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d641eb370 con 0x7f3d640aa870 2023-11-28T16:58:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d640aacb0 con 0x7f3d640aa870 2023-11-28T16:58:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d64067a40 con 0x7f3d640aa870 2023-11-28T16:58:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5b7fe640 1 -- 172.21.15.26:0/4198922973 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3d4c00fcc0 con 0x7f3d640aa870 2023-11-28T16:58:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.809+0000 7f3d5b7fe640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3d440668d0 0x7f3d44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.813+0000 7f3d5b7fe640 1 -- 172.21.15.26:0/4198922973 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3d4c084900 con 0x7f3d640aa870 2023-11-28T16:58:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.813+0000 7f3d62ffd640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3d440668d0 0x7f3d44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.813+0000 7f3d62ffd640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3d440668d0 0x7f3d44068d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009a20 tx=0x7f3d54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:34.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:34.813+0000 7f3d5b7fe640 1 -- 172.21.15.26:0/4198922973 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d4c0516b0 con 0x7f3d640aa870 2023-11-28T16:58:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d641eaef0 con 0x7f3d640aa870 2023-11-28T16:58:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d5b7fe640 1 -- 172.21.15.26:0/4198922973 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7f3d641eaef0 con 0x7f3d640aa870 2023-11-28T16:58:35.007 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:35.007 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:57:56.668279+0000","modified":"2023-11-28T16:57:59.688325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3225309020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3225309020},{"type":"v1","addr":"172.21.15.26:6835","nonce":3225309020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 37 2023-11-28T16:58:35.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3d440668d0 msgr2=0x7f3d44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3d440668d0 0x7f3d44068d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009a20 tx=0x7f3d54008040 comp rx=0 tx=0).stop 2023-11-28T16:58:35.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d640aa870 msgr2=0x7f3d640c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d640aa870 0x7f3d640c4e70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c001a20 tx=0x7f3d4c007430 comp rx=0 tx=0).stop 2023-11-28T16:58:35.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 shutdown_connections 2023-11-28T16:58:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d641ebb70 0x7f3d641ebff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d640aa870 0x7f3d640c4e70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3d440668d0 0x7f3d44068d90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 --2- 172.21.15.26:0/4198922973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d50004d10 0x7f3d640ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 >> 172.21.15.26:0/4198922973 conn(0x7f3d640c2ad0 msgr2=0x7f3d6406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 shutdown_connections 2023-11-28T16:58:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.005+0000 7f3d6950f640 1 -- 172.21.15.26:0/4198922973 wait complete. 2023-11-28T16:58:35.028 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:35.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 Processor -- start 2023-11-28T16:58:35.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 -- start start 2023-11-28T16:58:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6890151ee0 0x7f689006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f689006b650 0x7f68900c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68900c49e0 0x7f68900c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900c6940 con 0x7f689006b650 2023-11-28T16:58:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900c5a30 con 0x7f6890151ee0 2023-11-28T16:58:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6896879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68901522c0 con 0x7f68900c49e0 2023-11-28T16:58:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f689006b650 0x7f68900c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6890151ee0 0x7f689006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f689006b650 0x7f68900c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57716/0 (socket says 172.21.15.26:57716) 2023-11-28T16:58:35.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6890151ee0 0x7f689006b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:56498/0 (socket says 172.21.15.26:56498) 2023-11-28T16:58:35.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688f7fe640 1 -- 172.21.15.26:0/2941055641 learned_addr learned my addr 172.21.15.26:0/2941055641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:35.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f6894e16640 1 --2- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68900c49e0 0x7f68900c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688ffff640 1 -- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68900c49e0 msgr2=0x7f68900c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:35.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688ffff640 1 --2- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68900c49e0 0x7f68900c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688ffff640 1 -- 172.21.15.26:0/2941055641 >> v2:172.21.15.26:3300/0 conn(0x7f689006b650 msgr2=0x7f68900c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:35.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688ffff640 1 --2- 172.21.15.26:0/2941055641 >> v2:172.21.15.26:3300/0 conn(0x7f689006b650 0x7f68900c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.169+0000 7f688ffff640 1 -- 172.21.15.26:0/2941055641 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689006bc70 con 0x7f6890151ee0 2023-11-28T16:58:35.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f688ffff640 1 --2- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6890151ee0 0x7f689006b110 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f68900c7af0 tx=0x7f688001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3076219675566e03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f688effd640 1 -- 172.21.15.26:0/2941055641 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800ad660 con 0x7f6890151ee0 2023-11-28T16:58:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f688effd640 1 -- 172.21.15.26:0/2941055641 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68800ad7c0 con 0x7f6890151ee0 2023-11-28T16:58:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f688effd640 1 -- 172.21.15.26:0/2941055641 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800adb50 con 0x7f6890151ee0 2023-11-28T16:58:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 -- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6890151ee0 msgr2=0x7f689006b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 --2- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6890151ee0 0x7f689006b110 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f68900c7af0 tx=0x7f688001c3a0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 -- 172.21.15.26:0/2941055641 shutdown_connections 2023-11-28T16:58:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 --2- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68900c49e0 0x7f68900c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 --2- 172.21.15.26:0/2941055641 >> v2:172.21.15.26:3300/0 conn(0x7f689006b650 0x7f68900c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 --2- 172.21.15.26:0/2941055641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6890151ee0 0x7f689006b110 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 -- 172.21.15.26:0/2941055641 >> 172.21.15.26:0/2941055641 conn(0x7f68900ca060 msgr2=0x7f68900ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:35.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 -- 172.21.15.26:0/2941055641 shutdown_connections 2023-11-28T16:58:35.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.173+0000 7f6896879640 1 -- 172.21.15.26:0/2941055641 wait complete. 2023-11-28T16:58:35.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 Processor -- start 2023-11-28T16:58:35.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 -- start start 2023-11-28T16:58:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f689006b650 0x7f689014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68900c49e0 0x7f68900ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6890151ee0 0x7f68900acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c3450 con 0x7f6890151ee0 2023-11-28T16:58:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900af720 con 0x7f68900c49e0 2023-11-28T16:58:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68901f1a40 con 0x7f689006b650 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6890151ee0 0x7f68900acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6890151ee0 0x7f68900acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57718/0 (socket says 172.21.15.26:57718) 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 -- 172.21.15.26:0/2028317653 learned_addr learned my addr 172.21.15.26:0/2028317653 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f688f7fe640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68900c49e0 0x7f68900ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f688ffff640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f689006b650 0x7f689014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 -- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f689006b650 msgr2=0x7f689014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f689006b650 0x7f689014de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 -- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68900c49e0 msgr2=0x7f68900ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68900c49e0 0x7f68900ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 -- 172.21.15.26:0/2028317653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880009420 con 0x7f6890151ee0 2023-11-28T16:58:35.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f688ffff640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f689006b650 0x7f689014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:35.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f688f7fe640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68900c49e0 0x7f68900ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:35.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6894e16640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6890151ee0 0x7f68900acc80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f688800efc0 tx=0x7f688800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f688cff9640 1 -- 172.21.15.26:0/2028317653 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888009ba0 con 0x7f6890151ee0 2023-11-28T16:58:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f688cff9640 1 -- 172.21.15.26:0/2028317653 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800f040 con 0x7f6890151ee0 2023-11-28T16:58:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f688cff9640 1 -- 172.21.15.26:0/2028317653 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68880146c0 con 0x7f6890151ee0 2023-11-28T16:58:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.177+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68900c0440 con 0x7f6890151ee0 2023-11-28T16:58:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.181+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68901f13f0 con 0x7f6890151ee0 2023-11-28T16:58:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.181+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689006c7a0 con 0x7f6890151ee0 2023-11-28T16:58:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.181+0000 7f688cff9640 1 -- 172.21.15.26:0/2028317653 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6888014820 con 0x7f6890151ee0 2023-11-28T16:58:35.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.181+0000 7f688cff9640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f687c0668d0 0x7f687c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.181+0000 7f688cff9640 1 -- 172.21.15.26:0/2028317653 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6888085560 con 0x7f6890151ee0 2023-11-28T16:58:35.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.181+0000 7f688ffff640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f687c0668d0 0x7f687c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.185+0000 7f688ffff640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f687c0668d0 0x7f687c068d90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68800af000 tx=0x7f6880008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.185+0000 7f688cff9640 1 -- 172.21.15.26:0/2028317653 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68880524d0 con 0x7f6890151ee0 2023-11-28T16:58:35.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68901f1bb0 con 0x7f6890151ee0 2023-11-28T16:58:35.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f688cff9640 1 -- 172.21.15.26:0/2028317653 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20208 (secure 0 0 0) 0x7f6888055af0 con 0x7f6890151ee0 2023-11-28T16:58:35.352 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:35.352 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":54,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:11.370310+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:57:54.472607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T16:57:55.658818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f687c0668d0 msgr2=0x7f687c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f687c0668d0 0x7f687c068d90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68800af000 tx=0x7f6880008040 comp rx=0 tx=0).stop 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6890151ee0 msgr2=0x7f68900acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6890151ee0 0x7f68900acc80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f688800efc0 tx=0x7f688800c490 comp rx=0 tx=0).stop 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 shutdown_connections 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6890151ee0 0x7f68900acc80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68900c49e0 0x7f68900ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f687c0668d0 0x7f687c068d90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 --2- 172.21.15.26:0/2028317653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f689006b650 0x7f689014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 >> 172.21.15.26:0/2028317653 conn(0x7f68900ca060 msgr2=0x7f68900c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:35.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 shutdown_connections 2023-11-28T16:58:35.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.349+0000 7f6896879640 1 -- 172.21.15.26:0/2028317653 wait complete. 2023-11-28T16:58:35.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T16:58:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.517+0000 7fca7752a640 1 Processor -- start 2023-11-28T16:58:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.517+0000 7fca7752a640 1 -- start start 2023-11-28T16:58:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca7752a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca70151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca7752a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fca700a8470 0x7fca7006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca7752a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7006d320 con 0x7fca7014e9d0 2023-11-28T16:58:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca7752a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca700721b0 con 0x7fca700a8470 2023-11-28T16:58:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca7752a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700c2830 con 0x7fca70070b80 2023-11-28T16:58:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca752c6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fca7014e9d0 0x7fca700c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52060/0 (socket says 172.21.15.26:52060) 2023-11-28T16:58:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca752c6640 1 -- 172.21.15.26:0/2126271501 learned_addr learned my addr 172.21.15.26:0/2126271501 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca75ac7640 1 --2- 172.21.15.26:0/2126271501 >> v2:172.21.15.79:3300/0 conn(0x7fca700a8470 0x7fca7006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca74ac5640 1 --2- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca70151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca67fff640 1 -- 172.21.15.26:0/2126271501 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943910490 0 0) 0x7fca7006d320 con 0x7fca7014e9d0 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca67fff640 1 -- 172.21.15.26:0/2126271501 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca5c003530 con 0x7fca7014e9d0 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca75ac7640 1 -- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 msgr2=0x7fca70151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca75ac7640 1 --2- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca70151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca75ac7640 1 -- 172.21.15.26:0/2126271501 >> v1:172.21.15.26:6789/0 conn(0x7fca7014e9d0 legacy=0x7fca700c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.521+0000 7fca75ac7640 1 -- 172.21.15.26:0/2126271501 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70072450 con 0x7fca700a8470 2023-11-28T16:58:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca75ac7640 1 --2- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca700a8470 0x7fca7006d7b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fca68009d90 tx=0x7fca6801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de6569722e4ff07 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca67fff640 1 -- 172.21.15.26:0/2126271501 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680a5890 con 0x7fca700a8470 2023-11-28T16:58:35.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca67fff640 1 -- 172.21.15.26:0/2126271501 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca680a59f0 con 0x7fca700a8470 2023-11-28T16:58:35.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca67fff640 1 -- 172.21.15.26:0/2126271501 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680a5d80 con 0x7fca700a8470 2023-11-28T16:58:35.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca700a8470 msgr2=0x7fca7006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 --2- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca700a8470 0x7fca7006d7b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fca68009d90 tx=0x7fca6801c8c0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- 172.21.15.26:0/2126271501 shutdown_connections 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 --2- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca700a8470 0x7fca7006d7b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 --2- 172.21.15.26:0/2126271501 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca70151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- 172.21.15.26:0/2126271501 >> 172.21.15.26:0/2126271501 conn(0x7fca700c2ad0 msgr2=0x7fca700c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- 172.21.15.26:0/2126271501 shutdown_connections 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- 172.21.15.26:0/2126271501 wait complete. 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 Processor -- start 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- start start 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca701471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700a8470 0x7fca7013c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7014e9d0 0x7fca7013cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700aa180 con 0x7fca700a8470 2023-11-28T16:58:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca701f0fe0 con 0x7fca7014e9d0 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.525+0000 7fca7752a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7013d160 con 0x7fca70070b80 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700a8470 0x7fca7013c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700a8470 0x7fca7013c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57724/0 (socket says 172.21.15.26:57724) 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 -- 172.21.15.26:0/2262567267 learned_addr learned my addr 172.21.15.26:0/2262567267 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca75ac7640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7014e9d0 0x7fca7013cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca752c6640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca701471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 -- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 msgr2=0x7fca701471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca701471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 -- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7014e9d0 msgr2=0x7fca7013cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7014e9d0 0x7fca7013cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 -- 172.21.15.26:0/2262567267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009a70 con 0x7fca700a8470 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca75ac7640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7014e9d0 0x7fca7013cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca74ac5640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700a8470 0x7fca7013c6e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fca6000e930 tx=0x7fca6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca65ffb640 1 -- 172.21.15.26:0/2262567267 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60009690 con 0x7fca700a8470 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca65ffb640 1 -- 172.21.15.26:0/2262567267 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6000ca00 con 0x7fca700a8470 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca65ffb640 1 -- 172.21.15.26:0/2262567267 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000cdb0 con 0x7fca700a8470 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7014bfb0 con 0x7fca700a8470 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca701f0740 con 0x7fca700a8470 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7004e890 con 0x7fca700a8470 2023-11-28T16:58:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.529+0000 7fca65ffb640 1 -- 172.21.15.26:0/2262567267 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fca60013470 con 0x7fca700a8470 2023-11-28T16:58:35.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.533+0000 7fca65ffb640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca540668d0 0x7fca54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.533+0000 7fca65ffb640 1 -- 172.21.15.26:0/2262567267 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fca600848b0 con 0x7fca700a8470 2023-11-28T16:58:35.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.533+0000 7fca752c6640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca540668d0 0x7fca54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.533+0000 7fca752c6640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca540668d0 0x7fca54068d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0011f0 tx=0x7fca6c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.537+0000 7fca65ffb640 1 -- 172.21.15.26:0/2262567267 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca60051970 con 0x7fca700a8470 2023-11-28T16:58:35.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.729+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fca70074a10 con 0x7fca700a8470 2023-11-28T16:58:35.732 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-11-28T16:58:35.729+0000 7fcd77275640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T16:58:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.733+0000 7fca65ffb640 1 -- 172.21.15.26:0/2262567267 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7fca60054f90 con 0x7fca700a8470 2023-11-28T16:58:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T16:58:35.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.733+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca540668d0 msgr2=0x7fca54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.733+0000 7fca7752a640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca540668d0 0x7fca54068d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0011f0 tx=0x7fca6c007d40 comp rx=0 tx=0).stop 2023-11-28T16:58:35.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.733+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700a8470 msgr2=0x7fca7013c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.733+0000 7fca7752a640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700a8470 0x7fca7013c6e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fca6000e930 tx=0x7fca6000edf0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 shutdown_connections 2023-11-28T16:58:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7014e9d0 0x7fca7013cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700a8470 0x7fca7013c6e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca540668d0 0x7fca54068d90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 --2- 172.21.15.26:0/2262567267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca70070b80 0x7fca701471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 >> 172.21.15.26:0/2262567267 conn(0x7fca700c2ad0 msgr2=0x7fca70141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 shutdown_connections 2023-11-28T16:58:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.737+0000 7fca7752a640 1 -- 172.21.15.26:0/2262567267 wait complete. 2023-11-28T16:58:35.745 INFO:tasks.ceph.mds.a.smithi026.stderr: -2801> 2023-11-28T16:58:03.245+0000 7fa6af101640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:58:35.759 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T16:58:35.792 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-11-28T16:58:35.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.901+0000 7f8258ff5640 1 Processor -- start 2023-11-28T16:58:35.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.901+0000 7f8258ff5640 1 -- start start 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f8258ff5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8254070760 0x7f82540701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f8258ff5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8254158ff0 0x7f8254159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f8258ff5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82541599c0 con 0x7f82541561d0 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f8258ff5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8254071020 con 0x7f8254070760 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f8258ff5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8254071300 con 0x7f8254158ff0 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f824bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8254070760 0x7f82540701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f824bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8254070760 0x7f82540701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57752/0 (socket says 172.21.15.26:57752) 2023-11-28T16:58:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f824bfff640 1 -- 172.21.15.26:0/2273820888 learned_addr learned my addr 172.21.15.26:0/2273820888 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f825259c640 1 --1- 172.21.15.26:0/2273820888 >> v1:172.21.15.26:6789/0 conn(0x7f82541561d0 0x7f825406d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52070/0 (socket says 172.21.15.26:52070) 2023-11-28T16:58:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f8252d9d640 1 --2- 172.21.15.26:0/2273820888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8254158ff0 0x7f8254159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f824bfff640 1 -- 172.21.15.26:0/2273820888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8254158ff0 msgr2=0x7f8254159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f824bfff640 1 --2- 172.21.15.26:0/2273820888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8254158ff0 0x7f8254159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f824bfff640 1 -- 172.21.15.26:0/2273820888 >> v1:172.21.15.26:6789/0 conn(0x7f82541561d0 legacy=0x7f825406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f824bfff640 1 -- 172.21.15.26:0/2273820888 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540715e0 con 0x7f8254070760 2023-11-28T16:58:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.905+0000 7f8251d9b640 1 -- 172.21.15.26:0/2273820888 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879710041 0 0) 0x7f82541599c0 con 0x7f82541561d0 2023-11-28T16:58:35.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f824bfff640 1 --2- 172.21.15.26:0/2273820888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82540701f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f823c009870 tx=0x7f823c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7969307a6c3877b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8251d9b640 1 -- 172.21.15.26:0/2273820888 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0ac620 con 0x7f8254070760 2023-11-28T16:58:35.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8251d9b640 1 -- 172.21.15.26:0/2273820888 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c0ac780 con 0x7f8254070760 2023-11-28T16:58:35.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8251d9b640 1 -- 172.21.15.26:0/2273820888 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0acb10 con 0x7f8254070760 2023-11-28T16:58:35.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- 172.21.15.26:0/2273820888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 msgr2=0x7f82540701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 --2- 172.21.15.26:0/2273820888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82540701f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f823c009870 tx=0x7f823c01c4b0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- 172.21.15.26:0/2273820888 shutdown_connections 2023-11-28T16:58:35.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 --2- 172.21.15.26:0/2273820888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8254158ff0 0x7f8254159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 --2- 172.21.15.26:0/2273820888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82540701f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- 172.21.15.26:0/2273820888 >> 172.21.15.26:0/2273820888 conn(0x7f82540c2a60 msgr2=0x7f82540c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:35.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- 172.21.15.26:0/2273820888 shutdown_connections 2023-11-28T16:58:35.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- 172.21.15.26:0/2273820888 wait complete. 2023-11-28T16:58:35.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 Processor -- start 2023-11-28T16:58:35.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- start start 2023-11-28T16:58:35.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82541f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82541561d0 0x7f82540c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8254158ff0 0x7f8254146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254151980 con 0x7f8254070760 2023-11-28T16:58:35.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254150480 con 0x7f8254158ff0 2023-11-28T16:58:35.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.909+0000 7f8258ff5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8254150740 con 0x7f82541561d0 2023-11-28T16:58:35.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82541f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82541f1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57768/0 (socket says 172.21.15.26:57768) 2023-11-28T16:58:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 -- 172.21.15.26:0/289874516 learned_addr learned my addr 172.21.15.26:0/289874516 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f8252d9d640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8254158ff0 0x7f8254146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f824bfff640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82541561d0 0x7f82540c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 -- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82541561d0 msgr2=0x7f82540c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82541561d0 0x7f82540c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 -- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8254158ff0 msgr2=0x7f8254146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8254158ff0 0x7f8254146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 -- 172.21.15.26:0/289874516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0094d0 con 0x7f8254070760 2023-11-28T16:58:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f825259c640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82541f1160 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f824400c480 tx=0x7f824400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f824affd640 1 -- 172.21.15.26:0/289874516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82440074e0 con 0x7f8254070760 2023-11-28T16:58:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f824affd640 1 -- 172.21.15.26:0/289874516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244007660 con 0x7f8254070760 2023-11-28T16:58:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f824affd640 1 -- 172.21.15.26:0/289874516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244004a30 con 0x7f8254070760 2023-11-28T16:58:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8254150a20 con 0x7f8254070760 2023-11-28T16:58:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8254150fe0 con 0x7f8254070760 2023-11-28T16:58:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82541524c0 con 0x7f8254070760 2023-11-28T16:58:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.913+0000 7f824affd640 1 -- 172.21.15.26:0/289874516 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8244004b90 con 0x7f8254070760 2023-11-28T16:58:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.917+0000 7f824affd640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82340668d0 0x7f8234068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.917+0000 7f824affd640 1 -- 172.21.15.26:0/289874516 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f8244083900 con 0x7f8254070760 2023-11-28T16:58:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.917+0000 7f824bfff640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82340668d0 0x7f8234068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.917+0000 7f824bfff640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82340668d0 0x7f8234068d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f823c0ae000 tx=0x7f823c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:35.921+0000 7f824affd640 1 -- 172.21.15.26:0/289874516 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8244050830 con 0x7f8254070760 2023-11-28T16:58:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.117+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f825404e890 con 0x7f8254070760 2023-11-28T16:58:36.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.733+0000 7f824affd640 1 -- 172.21.15.26:0/289874516 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8244053e50 con 0x7f8254070760 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82340668d0 msgr2=0x7f8234068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82340668d0 0x7f8234068d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f823c0ae000 tx=0x7f823c0a7000 comp rx=0 tx=0).stop 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 msgr2=0x7f82541f1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82541f1160 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f824400c480 tx=0x7f824400c940 comp rx=0 tx=0).stop 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 shutdown_connections 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8254158ff0 0x7f8254146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f82340668d0 0x7f8234068d90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82541561d0 0x7f82540c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 --2- 172.21.15.26:0/289874516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8254070760 0x7f82541f1160 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 >> 172.21.15.26:0/289874516 conn(0x7f82540c2a60 msgr2=0x7f8254157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 shutdown_connections 2023-11-28T16:58:36.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.737+0000 7f8258ff5640 1 -- 172.21.15.26:0/289874516 wait complete. 2023-11-28T16:58:36.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T16:58:36.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.949+0000 7f6d9485a640 1 Processor -- start 2023-11-28T16:58:36.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.949+0000 7f6d9485a640 1 -- start start 2023-11-28T16:58:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d9485a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d90154ea0 0x7f6d90155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d9485a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d9006b0c0 0x7f6d9014e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d9485a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d9014edc0 0x7f6d90070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d9485a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d901557c0 con 0x7f6d90154ea0 2023-11-28T16:58:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d9485a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d901559d0 con 0x7f6d9006b0c0 2023-11-28T16:58:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d9485a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9006d910 con 0x7f6d9014edc0 2023-11-28T16:58:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d90154ea0 0x7f6d90155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d90154ea0 0x7f6d90155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57778/0 (socket says 172.21.15.26:57778) 2023-11-28T16:58:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 -- 172.21.15.26:0/1661646177 learned_addr learned my addr 172.21.15.26:0/1661646177 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d87fff640 1 --2- 172.21.15.26:0/1661646177 >> v2:172.21.15.79:3300/0 conn(0x7f6d9006b0c0 0x7f6d9014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8ed9d640 1 --2- 172.21.15.26:0/1661646177 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d9014edc0 0x7f6d90070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 -- 172.21.15.26:0/1661646177 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d9014edc0 msgr2=0x7f6d90070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 --2- 172.21.15.26:0/1661646177 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d9014edc0 0x7f6d90070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 -- 172.21.15.26:0/1661646177 >> v2:172.21.15.79:3300/0 conn(0x7f6d9006b0c0 msgr2=0x7f6d9014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 --2- 172.21.15.26:0/1661646177 >> v2:172.21.15.79:3300/0 conn(0x7f6d9006b0c0 0x7f6d9014e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d8e59c640 1 -- 172.21.15.26:0/1661646177 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d900c1230 con 0x7f6d90154ea0 2023-11-28T16:58:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.953+0000 7f6d87fff640 1 --2- 172.21.15.26:0/1661646177 >> v2:172.21.15.79:3300/0 conn(0x7f6d9006b0c0 0x7f6d9014e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d8e59c640 1 --2- 172.21.15.26:0/1661646177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d90154ea0 0x7f6d90155280 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6d9006e3e0 tx=0x7f6d8001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934695ccb1115539 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d8dd9b640 1 -- 172.21.15.26:0/1661646177 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800a7b10 con 0x7f6d90154ea0 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d8dd9b640 1 -- 172.21.15.26:0/1661646177 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d800a7c70 con 0x7f6d90154ea0 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d8dd9b640 1 -- 172.21.15.26:0/1661646177 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800af440 con 0x7f6d90154ea0 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 -- 172.21.15.26:0/1661646177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d90154ea0 msgr2=0x7f6d90155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 --2- 172.21.15.26:0/1661646177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d90154ea0 0x7f6d90155280 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6d9006e3e0 tx=0x7f6d8001ea80 comp rx=0 tx=0).stop 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 -- 172.21.15.26:0/1661646177 shutdown_connections 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 --2- 172.21.15.26:0/1661646177 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d9014edc0 0x7f6d90070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 --2- 172.21.15.26:0/1661646177 >> v2:172.21.15.79:3300/0 conn(0x7f6d9006b0c0 0x7f6d9014e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 --2- 172.21.15.26:0/1661646177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d90154ea0 0x7f6d90155280 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 -- 172.21.15.26:0/1661646177 >> 172.21.15.26:0/1661646177 conn(0x7f6d9006a5a0 msgr2=0x7f6d9006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 -- 172.21.15.26:0/1661646177 shutdown_connections 2023-11-28T16:58:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 -- 172.21.15.26:0/1661646177 wait complete. 2023-11-28T16:58:36.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.957+0000 7f6d9485a640 1 Processor -- start 2023-11-28T16:58:36.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 -- start start 2023-11-28T16:58:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d9006b0c0 0x7f6d900abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d9014edc0 0x7f6d9015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d90154ea0 0x7f6d901f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900ab0d0 con 0x7f6d9006b0c0 2023-11-28T16:58:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90154ad0 con 0x7f6d9014edc0 2023-11-28T16:58:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900aa0d0 con 0x7f6d90154ea0 2023-11-28T16:58:36.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d9006b0c0 0x7f6d900abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d9006b0c0 0x7f6d900abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57788/0 (socket says 172.21.15.26:57788) 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 -- 172.21.15.26:0/3510215939 learned_addr learned my addr 172.21.15.26:0/3510215939 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d87fff640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d9014edc0 0x7f6d9015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8ed9d640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d90154ea0 0x7f6d901f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 -- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d90154ea0 msgr2=0x7f6d901f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d90154ea0 0x7f6d901f0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 -- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d9014edc0 msgr2=0x7f6d9015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d9014edc0 0x7f6d9015a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 -- 172.21.15.26:0/3510215939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8000b770 con 0x7f6d9006b0c0 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8ed9d640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d90154ea0 0x7f6d901f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d8e59c640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d9006b0c0 0x7f6d900abc00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6d8001d130 tx=0x7f6d90152660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d86ffd640 1 -- 172.21.15.26:0/3510215939 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800afe00 con 0x7f6d9006b0c0 2023-11-28T16:58:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d86ffd640 1 -- 172.21.15.26:0/3510215939 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d800ba440 con 0x7f6d9006b0c0 2023-11-28T16:58:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d86ffd640 1 -- 172.21.15.26:0/3510215939 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800ba7b0 con 0x7f6d9006b0c0 2023-11-28T16:58:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d900aa3b0 con 0x7f6d9006b0c0 2023-11-28T16:58:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d900ac270 con 0x7f6d9006b0c0 2023-11-28T16:58:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.961+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d900a98e0 con 0x7f6d9006b0c0 2023-11-28T16:58:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.965+0000 7f6d86ffd640 1 -- 172.21.15.26:0/3510215939 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6d800b93e0 con 0x7f6d9006b0c0 2023-11-28T16:58:36.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.965+0000 7f6d86ffd640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6d700668d0 0x7f6d70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:36.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.965+0000 7f6d86ffd640 1 -- 172.21.15.26:0/3510215939 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f6d8011ee90 con 0x7f6d9006b0c0 2023-11-28T16:58:36.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.965+0000 7f6d87fff640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6d700668d0 0x7f6d70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:36.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.965+0000 7f6d87fff640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6d700668d0 0x7f6d70068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6d9015aea0 tx=0x7f6d78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:36.969+0000 7f6d86ffd640 1 -- 172.21.15.26:0/3510215939 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d800ebe40 con 0x7f6d9006b0c0 2023-11-28T16:58:37.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.137+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d9004e890 con 0x7f6d9006b0c0 2023-11-28T16:58:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.737+0000 7f6d86ffd640 1 -- 172.21.15.26:0/3510215939 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6d800bf0d0 con 0x7f6d9006b0c0 2023-11-28T16:58:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-11-28T16:58:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.737+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6d700668d0 msgr2=0x7f6d70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.737+0000 7f6d9485a640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6d700668d0 0x7f6d70068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6d9015aea0 tx=0x7f6d78008040 comp rx=0 tx=0).stop 2023-11-28T16:58:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.737+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d9006b0c0 msgr2=0x7f6d900abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.737+0000 7f6d9485a640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d9006b0c0 0x7f6d900abc00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6d8001d130 tx=0x7f6d90152660 comp rx=0 tx=0).stop 2023-11-28T16:58:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 shutdown_connections 2023-11-28T16:58:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6d700668d0 0x7f6d70068d90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d90154ea0 0x7f6d901f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d9014edc0 0x7f6d9015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 --2- 172.21.15.26:0/3510215939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d9006b0c0 0x7f6d900abc00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 >> 172.21.15.26:0/3510215939 conn(0x7f6d9006a5a0 msgr2=0x7f6d9006c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 shutdown_connections 2023-11-28T16:58:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.741+0000 7f6d9485a640 1 -- 172.21.15.26:0/3510215939 wait complete. 2023-11-28T16:58:37.772 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T16:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafb0f9d640 1 Processor -- start 2023-11-28T16:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafb0f9d640 1 -- start start 2023-11-28T16:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafb0f9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0a9770 0x7fafac06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafb0f9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fafac0c2070 0x7fafac0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafb0f9d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac1569f0 con 0x7fafac155f00 2023-11-28T16:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafb0f9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac0a9bd0 con 0x7fafac0c2070 2023-11-28T16:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafb0f9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0abb60 con 0x7fafac0a9770 2023-11-28T16:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafaad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fafac0c2070 0x7fafac0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafa3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0a9770 0x7fafac06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafaa59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fafac155f00 0x7fafac1562e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:43684/0 (socket says 172.21.15.26:43684) 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.917+0000 7fafaa59c640 1 -- 172.21.15.26:0/2787551042 learned_addr learned my addr 172.21.15.26:0/2787551042 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafa9d9b640 1 -- 172.21.15.26:0/2787551042 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674848639 0 0) 0x7faf9c001120 con 0x7fafac155f00 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafa9d9b640 1 -- 172.21.15.26:0/2787551042 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf98003530 con 0x7fafac155f00 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafaad9d640 1 -- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0a9770 msgr2=0x7fafac06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafaad9d640 1 --2- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0a9770 0x7fafac06cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafaad9d640 1 -- 172.21.15.26:0/2787551042 >> v1:172.21.15.79:6789/0 conn(0x7fafac155f00 legacy=0x7fafac1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafaad9d640 1 -- 172.21.15.26:0/2787551042 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac06c7a0 con 0x7fafac0c2070 2023-11-28T16:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafa3fff640 1 --2- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0a9770 0x7fafac06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafaad9d640 1 --2- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac0c2500 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009d90 tx=0x7fafa401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=173077328101a589 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafa9d9b640 1 -- 172.21.15.26:0/2787551042 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa40a5780 con 0x7fafac0c2070 2023-11-28T16:58:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafa9d9b640 1 -- 172.21.15.26:0/2787551042 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa40a58e0 con 0x7fafac0c2070 2023-11-28T16:58:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.921+0000 7fafa9d9b640 1 -- 172.21.15.26:0/2787551042 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa40a5c50 con 0x7fafac0c2070 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 msgr2=0x7fafac0c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac0c2500 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009d90 tx=0x7fafa401c8c0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- 172.21.15.26:0/2787551042 shutdown_connections 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac0c2500 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/2787551042 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac0a9770 0x7fafac06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- 172.21.15.26:0/2787551042 >> 172.21.15.26:0/2787551042 conn(0x7fafac06a5a0 msgr2=0x7fafac06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- 172.21.15.26:0/2787551042 shutdown_connections 2023-11-28T16:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- 172.21.15.26:0/2787551042 wait complete. 2023-11-28T16:58:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 Processor -- start 2023-11-28T16:58:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- start start 2023-11-28T16:58:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0a9770 0x7fafac146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac1eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac155f00 0x7fafac1ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0be7f0 con 0x7fafac0a9770 2023-11-28T16:58:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1ef180 con 0x7fafac0c2070 2023-11-28T16:58:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafb0f9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0bba70 con 0x7fafac155f00 2023-11-28T16:58:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafaa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0a9770 0x7fafac146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafaa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0a9770 0x7fafac146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57804/0 (socket says 172.21.15.26:57804) 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafaa59c640 1 -- 172.21.15.26:0/387981637 learned_addr learned my addr 172.21.15.26:0/387981637 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.925+0000 7fafaad9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac155f00 0x7fafac1ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa3fff640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac1eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafaa59c640 1 -- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac155f00 msgr2=0x7fafac1ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafaa59c640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac155f00 0x7fafac1ed230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafaa59c640 1 -- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 msgr2=0x7fafac1eccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafaa59c640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac1eccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafaa59c640 1 -- 172.21.15.26:0/387981637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009420 con 0x7fafac0a9770 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafaad9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac155f00 0x7fafac1ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa3fff640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac1eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafaa59c640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0a9770 0x7fafac146e90 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c700 tx=0x7faf9c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa2ffd640 1 -- 172.21.15.26:0/387981637 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c005ac0 con 0x7fafac0a9770 2023-11-28T16:58:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa2ffd640 1 -- 172.21.15.26:0/387981637 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c005c60 con 0x7fafac0a9770 2023-11-28T16:58:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa2ffd640 1 -- 172.21.15.26:0/387981637 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c001d60 con 0x7fafac0a9770 2023-11-28T16:58:37.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa4009a70 con 0x7fafac0a9770 2023-11-28T16:58:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac1ec810 con 0x7fafac0a9770 2023-11-28T16:58:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac1eca10 con 0x7fafac0a9770 2023-11-28T16:58:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa2ffd640 1 -- 172.21.15.26:0/387981637 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faf9c007070 con 0x7fafac0a9770 2023-11-28T16:58:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa2ffd640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf8c0668d0 0x7faf8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.929+0000 7fafa2ffd640 1 -- 172.21.15.26:0/387981637 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6213+0+0 (secure 0 0 0) 0x7faf9c083950 con 0x7fafac0a9770 2023-11-28T16:58:37.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.933+0000 7fafa3fff640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf8c0668d0 0x7faf8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:37.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.933+0000 7fafa3fff640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf8c0668d0 0x7faf8c068d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fafac0c03c0 tx=0x7faf94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:37.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:37.933+0000 7fafa2ffd640 1 -- 172.21.15.26:0/387981637 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf9c050a30 con 0x7fafac0a9770 2023-11-28T16:58:38.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.093+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafac1569f0 con 0x7fafac0a9770 2023-11-28T16:58:38.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.745+0000 7fafa2ffd640 1 -- 172.21.15.26:0/387981637 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7fafac1569f0 con 0x7fafac0a9770 2023-11-28T16:58:38.749 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf8c0668d0 msgr2=0x7faf8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf8c0668d0 0x7faf8c068d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fafac0c03c0 tx=0x7faf94008040 comp rx=0 tx=0).stop 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0a9770 msgr2=0x7fafac146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0a9770 0x7fafac146e90 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c700 tx=0x7faf9c00cbc0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 shutdown_connections 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf8c0668d0 0x7faf8c068d90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafac155f00 0x7fafac1ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafac0c2070 0x7fafac1eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 --2- 172.21.15.26:0/387981637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafac0a9770 0x7fafac146e90 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 >> 172.21.15.26:0/387981637 conn(0x7fafac06a5a0 msgr2=0x7fafac0ab030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:38.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 shutdown_connections 2023-11-28T16:58:38.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.753+0000 7fafb0f9d640 1 -- 172.21.15.26:0/387981637 wait complete. 2023-11-28T16:58:38.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459ccea640 1 Processor -- start 2023-11-28T16:58:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459ccea640 1 -- start start 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459ccea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f459814e9d0 0x7f4598151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459ccea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459806d320 con 0x7f45980a8470 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459ccea640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45980721b0 con 0x7f4598070b80 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459ccea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45980c2830 con 0x7f459814e9d0 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f459814e9d0 0x7f4598151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f459814e9d0 0x7f4598151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57806/0 (socket says 172.21.15.26:57806) 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459659c640 1 -- 172.21.15.26:0/879276119 learned_addr learned my addr 172.21.15.26:0/879276119 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:38.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f4596d9d640 1 --1- 172.21.15.26:0/879276119 >> v1:172.21.15.26:6789/0 conn(0x7f45980a8470 0x7f459806d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52074/0 (socket says 172.21.15.26:52074) 2023-11-28T16:58:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459559a640 1 -- 172.21.15.26:0/879276119 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415600180 0 0) 0x7f459806d320 con 0x7f45980a8470 2023-11-28T16:58:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459559a640 1 -- 172.21.15.26:0/879276119 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4580003530 con 0x7f45980a8470 2023-11-28T16:58:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459659c640 1 -- 172.21.15.26:0/879276119 >> v1:172.21.15.79:6789/0 conn(0x7f4598070b80 legacy=0x7f45980c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459659c640 1 -- 172.21.15.26:0/879276119 >> v1:172.21.15.26:6789/0 conn(0x7f45980a8470 legacy=0x7f459806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.933+0000 7f459659c640 1 -- 172.21.15.26:0/879276119 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598072450 con 0x7f459814e9d0 2023-11-28T16:58:38.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459659c640 1 --2- 172.21.15.26:0/879276119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598151e60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f458800bb10 tx=0x7f458801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da70f6c272f04c47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:38.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459559a640 1 -- 172.21.15.26:0/879276119 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880a7a60 con 0x7f459814e9d0 2023-11-28T16:58:38.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459559a640 1 -- 172.21.15.26:0/879276119 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45880a7bc0 con 0x7f459814e9d0 2023-11-28T16:58:38.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459559a640 1 -- 172.21.15.26:0/879276119 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880af440 con 0x7f459814e9d0 2023-11-28T16:58:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459ccea640 1 -- 172.21.15.26:0/879276119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 msgr2=0x7f4598151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459ccea640 1 --2- 172.21.15.26:0/879276119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598151e60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f458800bb10 tx=0x7f458801eb80 comp rx=0 tx=0).stop 2023-11-28T16:58:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459ccea640 1 -- 172.21.15.26:0/879276119 shutdown_connections 2023-11-28T16:58:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459ccea640 1 --2- 172.21.15.26:0/879276119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598151e60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459ccea640 1 -- 172.21.15.26:0/879276119 >> 172.21.15.26:0/879276119 conn(0x7f45980c2ad0 msgr2=0x7f45980c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459ccea640 1 -- 172.21.15.26:0/879276119 shutdown_connections 2023-11-28T16:58:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.937+0000 7f459ccea640 1 -- 172.21.15.26:0/879276119 wait complete. 2023-11-28T16:58:38.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 Processor -- start 2023-11-28T16:58:38.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 -- start start 2023-11-28T16:58:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4598070b80 0x7f45981f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45980a8470 0x7f45980bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4598149a60 con 0x7f459814e9d0 2023-11-28T16:58:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45981f18a0 con 0x7f45980a8470 2023-11-28T16:58:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45981ee850 con 0x7f4598070b80 2023-11-28T16:58:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:38.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57822/0 (socket says 172.21.15.26:57822) 2023-11-28T16:58:38.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 -- 172.21.15.26:0/3091921309 learned_addr learned my addr 172.21.15.26:0/3091921309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:38.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459659c640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4598070b80 0x7f45981f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:38.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4595d9b640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45980a8470 0x7f45980bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 -- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4598070b80 msgr2=0x7f45981f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4598070b80 0x7f45981f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 -- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45980a8470 msgr2=0x7f45980bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45980a8470 0x7f45980bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 -- 172.21.15.26:0/3091921309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458800b770 con 0x7f459814e9d0 2023-11-28T16:58:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4596d9d640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598143770 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f459000c790 tx=0x7f459000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4586ffd640 1 -- 172.21.15.26:0/3091921309 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000cea0 con 0x7f459814e9d0 2023-11-28T16:58:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4586ffd640 1 -- 172.21.15.26:0/3091921309 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459000a5e0 con 0x7f459814e9d0 2023-11-28T16:58:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459814ae70 con 0x7f459814e9d0 2023-11-28T16:58:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f4586ffd640 1 -- 172.21.15.26:0/3091921309 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000a9d0 con 0x7f459814e9d0 2023-11-28T16:58:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459814b430 con 0x7f459814e9d0 2023-11-28T16:58:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.941+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459804e890 con 0x7f459814e9d0 2023-11-28T16:58:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.945+0000 7f4586ffd640 1 -- 172.21.15.26:0/3091921309 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f459000ab30 con 0x7f459814e9d0 2023-11-28T16:58:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.945+0000 7f4586ffd640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4578066900 0x7f4578068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.945+0000 7f4586ffd640 1 -- 172.21.15.26:0/3091921309 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f4590083cb0 con 0x7f459814e9d0 2023-11-28T16:58:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.945+0000 7f459659c640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4578066900 0x7f4578068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.945+0000 7f459659c640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4578066900 0x7f4578068dc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f45880b1000 tx=0x7f45880a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:38.949+0000 7f4586ffd640 1 -- 172.21.15.26:0/3091921309 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4590050ea0 con 0x7f459814e9d0 2023-11-28T16:58:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.105+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f459815cb50 con 0x7f459814e9d0 2023-11-28T16:58:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.105+0000 7f4586ffd640 1 -- 172.21.15.26:0/3091921309 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f4590017020 con 0x7f459814e9d0 2023-11-28T16:58:39.110 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:39.110 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":57,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:38.739534+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/3225309020":"2023-11-29T16:58:35.732005+0000","172.21.15.26:6834/3225309020":"2023-11-29T16:58:35.732005+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4578066900 msgr2=0x7f4578068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4578066900 0x7f4578068dc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f45880b1000 tx=0x7f45880a9070 comp rx=0 tx=0).stop 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 msgr2=0x7f4598143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598143770 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f459000c790 tx=0x7f459000cc50 comp rx=0 tx=0).stop 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 shutdown_connections 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459814e9d0 0x7f4598143770 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45980a8470 0x7f45980bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4578066900 0x7f4578068dc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 --2- 172.21.15.26:0/3091921309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4598070b80 0x7f45981f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 >> 172.21.15.26:0/3091921309 conn(0x7f45980c2ad0 msgr2=0x7f459814c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:39.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 shutdown_connections 2023-11-28T16:58:39.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.109+0000 7f459ccea640 1 -- 172.21.15.26:0/3091921309 wait complete. 2023-11-28T16:58:39.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:58:07.830332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:58:08.744612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:39.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:39.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.277+0000 7f9dc45d1640 1 Processor -- start 2023-11-28T16:58:39.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.277+0000 7f9dc45d1640 1 -- start start 2023-11-28T16:58:39.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.277+0000 7f9dc45d1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9dbc0c0370 0x7f9dbc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc45d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc45d1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc06de00 con 0x7f9dbc14eaf0 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc45d1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc070390 con 0x7f9dbc0c0370 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc45d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc06db90 con 0x7f9dbc0a8470 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc2b6e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc1b6c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9dbc0c0370 0x7f9dbc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc236d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9dbc14eaf0 0x7f9dbc151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:43712/0 (socket says 172.21.15.26:43712) 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc2b6e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc06d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:37812/0 (socket says 172.21.15.26:37812) 2023-11-28T16:58:39.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc236d640 1 -- 172.21.15.26:0/3054043482 learned_addr learned my addr 172.21.15.26:0/3054043482 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc136b640 1 -- 172.21.15.26:0/3054043482 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322259785 0 0) 0x7f9dbc06de00 con 0x7f9dbc14eaf0 2023-11-28T16:58:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc136b640 1 -- 172.21.15.26:0/3054043482 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da8003530 con 0x7f9dbc14eaf0 2023-11-28T16:58:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc2b6e640 1 -- 172.21.15.26:0/3054043482 >> v2:172.21.15.79:3300/0 conn(0x7f9dbc0c0370 msgr2=0x7f9dbc06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc2b6e640 1 --2- 172.21.15.26:0/3054043482 >> v2:172.21.15.79:3300/0 conn(0x7f9dbc0c0370 0x7f9dbc06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc2b6e640 1 -- 172.21.15.26:0/3054043482 >> v1:172.21.15.79:6789/0 conn(0x7f9dbc14eaf0 legacy=0x7f9dbc151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc2b6e640 1 -- 172.21.15.26:0/3054043482 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc14eed0 con 0x7f9dbc0a8470 2023-11-28T16:58:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.281+0000 7f9dc1b6c640 1 --2- 172.21.15.26:0/3054043482 >> v2:172.21.15.79:3300/0 conn(0x7f9dbc0c0370 0x7f9dbc06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:39.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc2b6e640 1 --2- 172.21.15.26:0/3054043482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc06d650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9db400bfa0 tx=0x7f9db401ea30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776a038e4478b56d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc136b640 1 -- 172.21.15.26:0/3054043482 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400b2d0 con 0x7f9dbc0a8470 2023-11-28T16:58:39.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc136b640 1 -- 172.21.15.26:0/3054043482 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db40a7920 con 0x7f9dbc0a8470 2023-11-28T16:58:39.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc136b640 1 -- 172.21.15.26:0/3054043482 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40a7cb0 con 0x7f9dbc0a8470 2023-11-28T16:58:39.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- 172.21.15.26:0/3054043482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 msgr2=0x7f9dbc06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/3054043482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc06d650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9db400bfa0 tx=0x7f9db401ea30 comp rx=0 tx=0).stop 2023-11-28T16:58:39.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- 172.21.15.26:0/3054043482 shutdown_connections 2023-11-28T16:58:39.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/3054043482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc06d650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/3054043482 >> v2:172.21.15.79:3300/0 conn(0x7f9dbc0c0370 0x7f9dbc06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- 172.21.15.26:0/3054043482 >> 172.21.15.26:0/3054043482 conn(0x7f9dbc0c2a60 msgr2=0x7f9dbc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:39.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- 172.21.15.26:0/3054043482 shutdown_connections 2023-11-28T16:58:39.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- 172.21.15.26:0/3054043482 wait complete. 2023-11-28T16:58:39.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 Processor -- start 2023-11-28T16:58:39.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- start start 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dbc0c0370 0x7f9dbc1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dbc14eaf0 0x7f9dbc143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c4ff0 con 0x7f9dbc0c0370 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c3d40 con 0x7f9dbc14eaf0 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc45d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c4520 con 0x7f9dbc0a8470 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.285+0000 7f9dc1b6c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dbc0c0370 0x7f9dbc1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dbc0c0370 0x7f9dbc1540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57824/0 (socket says 172.21.15.26:57824) 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 -- 172.21.15.26:0/1890153535 learned_addr learned my addr 172.21.15.26:0/1890153535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc236d640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc2b6e640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dbc14eaf0 0x7f9dbc143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 -- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 msgr2=0x7f9dbc14a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc14a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 -- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dbc14eaf0 msgr2=0x7f9dbc143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dbc14eaf0 0x7f9dbc143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 -- 172.21.15.26:0/1890153535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac009420 con 0x7f9dbc0c0370 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc2b6e640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dbc14eaf0 0x7f9dbc143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc1b6c640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dbc0c0370 0x7f9dbc1540e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00ea00 tx=0x7f9dac00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9db2ffd640 1 -- 172.21.15.26:0/1890153535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00ca60 con 0x7f9dbc0c0370 2023-11-28T16:58:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9db2ffd640 1 -- 172.21.15.26:0/1890153535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00cbc0 con 0x7f9dbc0c0370 2023-11-28T16:58:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db400bc80 con 0x7f9dbc0c0370 2023-11-28T16:58:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9db2ffd640 1 -- 172.21.15.26:0/1890153535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac013470 con 0x7f9dbc0c0370 2023-11-28T16:58:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc1f0ad0 con 0x7f9dbc0c0370 2023-11-28T16:58:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.289+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc04e890 con 0x7f9dbc0c0370 2023-11-28T16:58:39.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.293+0000 7f9db2ffd640 1 -- 172.21.15.26:0/1890153535 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9dac004020 con 0x7f9dbc0c0370 2023-11-28T16:58:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.293+0000 7f9db2ffd640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9da00668d0 0x7f9da0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.293+0000 7f9db2ffd640 1 -- 172.21.15.26:0/1890153535 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9dac084740 con 0x7f9dbc0c0370 2023-11-28T16:58:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.293+0000 7f9dc236d640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9da00668d0 0x7f9da0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.293+0000 7f9dc236d640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9da00668d0 0x7f9da0068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9db80011f0 tx=0x7f9db8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.293+0000 7f9db2ffd640 1 -- 172.21.15.26:0/1890153535 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dac0519b0 con 0x7f9dbc0c0370 2023-11-28T16:58:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.457+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9dbc148930 con 0x7f9dbc0c0370 2023-11-28T16:58:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.457+0000 7f9db2ffd640 1 -- 172.21.15.26:0/1890153535 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9dac0210a0 con 0x7f9dbc0c0370 2023-11-28T16:58:39.461 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9da00668d0 msgr2=0x7f9da0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9da00668d0 0x7f9da0068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9db80011f0 tx=0x7f9db8009040 comp rx=0 tx=0).stop 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dbc0c0370 msgr2=0x7f9dbc1540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dbc0c0370 0x7f9dbc1540e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00ea00 tx=0x7f9dac00eec0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 shutdown_connections 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dbc14eaf0 0x7f9dbc143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dbc0c0370 0x7f9dbc1540e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9da00668d0 0x7f9da0068d90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 --2- 172.21.15.26:0/1890153535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9dbc0a8470 0x7f9dbc14a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 >> 172.21.15.26:0/1890153535 conn(0x7f9dbc0c2a60 msgr2=0x7f9dbc070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:39.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 shutdown_connections 2023-11-28T16:58:39.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.460+0000 7f9dc45d1640 1 -- 172.21.15.26:0/1890153535 wait complete. 2023-11-28T16:58:39.482 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:58:39.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.624+0000 7f2817e17640 1 Processor -- start 2023-11-28T16:58:39.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.624+0000 7f2817e17640 1 -- start start 2023-11-28T16:58:39.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.624+0000 7f2817e17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f281006b810 0x7f28100c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.624+0000 7f2817e17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28100c2a60 0x7f281006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.624+0000 7f2817e17640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2810073710 con 0x7f281006f0d0 2023-11-28T16:58:39.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.624+0000 7f2817e17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28101589f0 con 0x7f281006b810 2023-11-28T16:58:39.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.624+0000 7f2817e17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28101586e0 con 0x7f28100c2a60 2023-11-28T16:58:39.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f281006b810 0x7f28100c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f281006b810 0x7f28100c1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57830/0 (socket says 172.21.15.26:57830) 2023-11-28T16:58:39.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 -- 172.21.15.26:0/536361094 learned_addr learned my addr 172.21.15.26:0/536361094 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:39.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f28163b4640 1 --2- 172.21.15.26:0/536361094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28100c2a60 0x7f281006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 -- 172.21.15.26:0/536361094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28100c2a60 msgr2=0x7f281006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:39.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 --2- 172.21.15.26:0/536361094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28100c2a60 0x7f281006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 -- 172.21.15.26:0/536361094 >> v1:172.21.15.79:6789/0 conn(0x7f281006f0d0 legacy=0x7f28100bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 -- 172.21.15.26:0/536361094 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100a6010 con 0x7f281006b810 2023-11-28T16:58:39.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2815bb3640 1 --2- 172.21.15.26:0/536361094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f281006b810 0x7f28100c1140 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b103885579cbebfa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2814bb1640 1 -- 172.21.15.26:0/536361094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0ab600 con 0x7f281006b810 2023-11-28T16:58:39.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2814bb1640 1 -- 172.21.15.26:0/536361094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c0a7050 con 0x7f281006b810 2023-11-28T16:58:39.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.628+0000 7f2814bb1640 1 -- 172.21.15.26:0/536361094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0ab980 con 0x7f281006b810 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- 172.21.15.26:0/536361094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f281006b810 msgr2=0x7f28100c1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 --2- 172.21.15.26:0/536361094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f281006b810 0x7f28100c1140 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c01c540 comp rx=0 tx=0).stop 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- 172.21.15.26:0/536361094 shutdown_connections 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 --2- 172.21.15.26:0/536361094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28100c2a60 0x7f281006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 --2- 172.21.15.26:0/536361094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f281006b810 0x7f28100c1140 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- 172.21.15.26:0/536361094 >> 172.21.15.26:0/536361094 conn(0x7f28100c3240 msgr2=0x7f28100c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- 172.21.15.26:0/536361094 shutdown_connections 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- 172.21.15.26:0/536361094 wait complete. 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 Processor -- start 2023-11-28T16:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- start start 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281006b810 0x7f28101ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f281006f0d0 0x7f2810153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28100c2a60 0x7f2810154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2810154740 con 0x7f28100c2a60 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2810157dc0 con 0x7f281006b810 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2817e17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28101edfb0 con 0x7f281006f0d0 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f28163b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28100c2a60 0x7f2810154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f28163b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28100c2a60 0x7f2810154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57832/0 (socket says 172.21.15.26:57832) 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f28163b4640 1 -- 172.21.15.26:0/1478966154 learned_addr learned my addr 172.21.15.26:0/1478966154 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f2815bb3640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281006b810 0x7f28101ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.632+0000 7f28153b2640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f281006f0d0 0x7f2810153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28163b4640 1 -- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f281006f0d0 msgr2=0x7f2810153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28163b4640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f281006f0d0 0x7f2810153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28163b4640 1 -- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281006b810 msgr2=0x7f28101ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28163b4640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281006b810 0x7f28101ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28163b4640 1 -- 172.21.15.26:0/1478966154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0094d0 con 0x7f28100c2a60 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28163b4640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28100c2a60 0x7f2810154200 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2808007e90 tx=0x7f280800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28067fc640 1 -- 172.21.15.26:0/1478966154 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808014420 con 0x7f28100c2a60 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28067fc640 1 -- 172.21.15.26:0/1478966154 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808014580 con 0x7f28100c2a60 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28067fc640 1 -- 172.21.15.26:0/1478966154 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808014930 con 0x7f28100c2a60 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28101edcd0 con 0x7f28100c2a60 2023-11-28T16:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28101537a0 con 0x7f28100c2a60 2023-11-28T16:58:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28101539c0 con 0x7f28100c2a60 2023-11-28T16:58:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28067fc640 1 -- 172.21.15.26:0/1478966154 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2808014a90 con 0x7f28100c2a60 2023-11-28T16:58:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28067fc640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f27f4066900 0x7f27f4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.636+0000 7f28067fc640 1 -- 172.21.15.26:0/1478966154 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2808084b40 con 0x7f28100c2a60 2023-11-28T16:58:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.640+0000 7f2815bb3640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f27f4066900 0x7f27f4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.640+0000 7f2815bb3640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f27f4066900 0x7f27f4068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f28100ac9b0 tx=0x7f280c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.640+0000 7f28067fc640 1 -- 172.21.15.26:0/1478966154 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2808051e60 con 0x7f28100c2a60 2023-11-28T16:58:39.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f281004e890 con 0x7f28100c2a60 2023-11-28T16:58:39.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f28067fc640 1 -- 172.21.15.26:0/1478966154 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7f2808055480 con 0x7f28100c2a60 2023-11-28T16:58:39.807 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:58:39.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f27f4066900 msgr2=0x7f27f4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f27f4066900 0x7f27f4068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f28100ac9b0 tx=0x7f280c0a6000 comp rx=0 tx=0).stop 2023-11-28T16:58:39.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28100c2a60 msgr2=0x7f2810154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28100c2a60 0x7f2810154200 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2808007e90 tx=0x7f280800e4b0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 shutdown_connections 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28100c2a60 0x7f2810154200 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f27f4066900 0x7f27f4068dc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f281006f0d0 0x7f2810153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 --2- 172.21.15.26:0/1478966154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281006b810 0x7f28101ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 >> 172.21.15.26:0/1478966154 conn(0x7f28100c3240 msgr2=0x7f28100c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 shutdown_connections 2023-11-28T16:58:39.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.804+0000 7f2817e17640 1 -- 172.21.15.26:0/1478966154 wait complete. 2023-11-28T16:58:39.829 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:58:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.968+0000 7f94ef4fe640 1 Processor -- start 2023-11-28T16:58:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.968+0000 7f94ef4fe640 1 -- start start 2023-11-28T16:58:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94ef4fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94e80a5e70 0x7f94e806b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94ef4fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80c2f80 con 0x7f94e806b5b0 2023-11-28T16:58:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94ef4fe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e8150ee0 con 0x7f94e80c09d0 2023-11-28T16:58:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94ef4fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e8151880 con 0x7f94e80a5e70 2023-11-28T16:58:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94eda9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94e80a5e70 0x7f94e806b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94ed29a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f94e806b5b0 0x7f94e80c4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52082/0 (socket says 172.21.15.26:52082) 2023-11-28T16:58:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94ed29a640 1 -- 172.21.15.26:0/2828683412 learned_addr learned my addr 172.21.15.26:0/2828683412 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:39.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94eda9b640 1 -- 172.21.15.26:0/2828683412 >> v1:172.21.15.79:6789/0 conn(0x7f94e80c09d0 legacy=0x7f94e8159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94eda9b640 1 -- 172.21.15.26:0/2828683412 >> v1:172.21.15.26:6789/0 conn(0x7f94e806b5b0 legacy=0x7f94e80c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.972+0000 7f94eda9b640 1 -- 172.21.15.26:0/2828683412 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e81511c0 con 0x7f94e80a5e70 2023-11-28T16:58:39.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94eda9b640 1 --2- 172.21.15.26:0/2828683412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e80a5e70 0x7f94e806b990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f94e000bfa0 tx=0x7f94e001ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8b8b5346a2c51e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94dffff640 1 -- 172.21.15.26:0/2828683412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000b2d0 con 0x7f94e80a5e70 2023-11-28T16:58:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94dffff640 1 -- 172.21.15.26:0/2828683412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e00a78a0 con 0x7f94e80a5e70 2023-11-28T16:58:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94dffff640 1 -- 172.21.15.26:0/2828683412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00a7c30 con 0x7f94e80a5e70 2023-11-28T16:58:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2828683412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e80a5e70 msgr2=0x7f94e806b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2828683412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e80a5e70 0x7f94e806b990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f94e000bfa0 tx=0x7f94e001ea30 comp rx=0 tx=0).stop 2023-11-28T16:58:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2828683412 shutdown_connections 2023-11-28T16:58:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2828683412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e80a5e70 0x7f94e806b990 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2828683412 >> 172.21.15.26:0/2828683412 conn(0x7f94e80c3240 msgr2=0x7f94e80c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2828683412 shutdown_connections 2023-11-28T16:58:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2828683412 wait complete. 2023-11-28T16:58:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 Processor -- start 2023-11-28T16:58:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.976+0000 7f94ef4fe640 1 -- start start 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e806b5b0 0x7f94e813c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94e80a5e70 0x7f94e80aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e80c09d0 0x7f94e8143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80ab3a0 con 0x7f94e806b5b0 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e813e890 con 0x7f94e80c09d0 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8140fb0 con 0x7f94e80a5e70 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e806b5b0 0x7f94e813c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e806b5b0 0x7f94e813c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57840/0 (socket says 172.21.15.26:57840) 2023-11-28T16:58:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 -- 172.21.15.26:0/2004376027 learned_addr learned my addr 172.21.15.26:0/2004376027 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94eca99640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94e80a5e70 0x7f94e80aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94eda9b640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e80c09d0 0x7f94e8143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 -- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94e80a5e70 msgr2=0x7f94e80aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94e80a5e70 0x7f94e80aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 -- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e80c09d0 msgr2=0x7f94e8143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e80c09d0 0x7f94e8143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 -- 172.21.15.26:0/2004376027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e000bc80 con 0x7f94e806b5b0 2023-11-28T16:58:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ed29a640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e806b5b0 0x7f94e813c400 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c430 tx=0x7f94e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ddffb640 1 -- 172.21.15.26:0/2004376027 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4016070 con 0x7f94e806b5b0 2023-11-28T16:58:39.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ddffb640 1 -- 172.21.15.26:0/2004376027 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e40069d0 con 0x7f94e806b5b0 2023-11-28T16:58:39.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ddffb640 1 -- 172.21.15.26:0/2004376027 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4006da0 con 0x7f94e806b5b0 2023-11-28T16:58:39.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e80ab0c0 con 0x7f94e806b5b0 2023-11-28T16:58:39.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e813e4b0 con 0x7f94e806b5b0 2023-11-28T16:58:39.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e813e030 con 0x7f94e806b5b0 2023-11-28T16:58:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.980+0000 7f94ddffb640 1 -- 172.21.15.26:0/2004376027 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f94e4011590 con 0x7f94e806b5b0 2023-11-28T16:58:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.984+0000 7f94ddffb640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94cc0668d0 0x7f94cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.984+0000 7f94ddffb640 1 -- 172.21.15.26:0/2004376027 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f94e4083ad0 con 0x7f94e806b5b0 2023-11-28T16:58:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.984+0000 7f94eca99640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94cc0668d0 0x7f94cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.984+0000 7f94eca99640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94cc0668d0 0x7f94cc068d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f94e80abdb0 tx=0x7f94d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:39.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:39.988+0000 7f94ddffb640 1 -- 172.21.15.26:0/2004376027 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94e813e030 con 0x7f94e806b5b0 2023-11-28T16:58:40.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.144+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f94e813e030 con 0x7f94e806b5b0 2023-11-28T16:58:40.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.144+0000 7f94ddffb640 1 -- 172.21.15.26:0/2004376027 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7f94e813e030 con 0x7f94e806b5b0 2023-11-28T16:58:40.149 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:58:40.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94cc0668d0 msgr2=0x7f94cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:40.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94cc0668d0 0x7f94cc068d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f94e80abdb0 tx=0x7f94d8009040 comp rx=0 tx=0).stop 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e806b5b0 msgr2=0x7f94e813c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e806b5b0 0x7f94e813c400 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c430 tx=0x7f94e400c8f0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 shutdown_connections 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e80c09d0 0x7f94e8143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94cc0668d0 0x7f94cc068d90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94e80a5e70 0x7f94e80aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 --2- 172.21.15.26:0/2004376027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94e806b5b0 0x7f94e813c400 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 >> 172.21.15.26:0/2004376027 conn(0x7f94e80c3240 msgr2=0x7f94e814f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 shutdown_connections 2023-11-28T16:58:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.148+0000 7f94ef4fe640 1 -- 172.21.15.26:0/2004376027 wait complete. 2023-11-28T16:58:40.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f71046ea640 1 Processor -- start 2023-11-28T16:58:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f71046ea640 1 -- start start 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f71046ea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc154870 0x7f70fc06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f71046ea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc072780 con 0x7f70fc0aacd0 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f71046ea640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0ac160 con 0x7f70fc0700a0 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f71046ea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0abe80 con 0x7f70fc154870 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f7102486640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70fc0aacd0 0x7f70fc154160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52088/0 (socket says 172.21.15.26:52088) 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f7102486640 1 -- 172.21.15.26:0/1776311125 learned_addr learned my addr 172.21.15.26:0/1776311125 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f7101c85640 1 --2- 172.21.15.26:0/1776311125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc154870 0x7f70fc06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.312+0000 7f7101484640 1 -- 172.21.15.26:0/1776311125 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962981650 0 0) 0x7f70fc072780 con 0x7f70fc0aacd0 2023-11-28T16:58:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101484640 1 -- 172.21.15.26:0/1776311125 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e8005740 con 0x7f70fc0aacd0 2023-11-28T16:58:40.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101484640 1 -- 172.21.15.26:0/1776311125 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996493984 0 0) 0x7f70fc0ac160 con 0x7f70fc0700a0 2023-11-28T16:58:40.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101c85640 1 -- 172.21.15.26:0/1776311125 >> v1:172.21.15.79:6789/0 conn(0x7f70fc0700a0 legacy=0x7f70fc06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:40.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101c85640 1 -- 172.21.15.26:0/1776311125 >> v1:172.21.15.26:6789/0 conn(0x7f70fc0aacd0 legacy=0x7f70fc154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:40.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101c85640 1 -- 172.21.15.26:0/1776311125 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc154cf0 con 0x7f70fc154870 2023-11-28T16:58:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101c85640 1 --2- 172.21.15.26:0/1776311125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc154870 0x7f70fc06c950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0097f0 tx=0x7f70ec01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce4329f8fde7f10a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101484640 1 -- 172.21.15.26:0/1776311125 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0ab600 con 0x7f70fc154870 2023-11-28T16:58:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101484640 1 -- 172.21.15.26:0/1776311125 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec0ab760 con 0x7f70fc154870 2023-11-28T16:58:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f7101484640 1 -- 172.21.15.26:0/1776311125 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0abad0 con 0x7f70fc154870 2023-11-28T16:58:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f71046ea640 1 -- 172.21.15.26:0/1776311125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc154870 msgr2=0x7f70fc06c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.316+0000 7f71046ea640 1 --2- 172.21.15.26:0/1776311125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc154870 0x7f70fc06c950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0097f0 tx=0x7f70ec01c400 comp rx=0 tx=0).stop 2023-11-28T16:58:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- 172.21.15.26:0/1776311125 shutdown_connections 2023-11-28T16:58:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 --2- 172.21.15.26:0/1776311125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc154870 0x7f70fc06c950 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- 172.21.15.26:0/1776311125 >> 172.21.15.26:0/1776311125 conn(0x7f70fc0c2ad0 msgr2=0x7f70fc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- 172.21.15.26:0/1776311125 shutdown_connections 2023-11-28T16:58:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- 172.21.15.26:0/1776311125 wait complete. 2023-11-28T16:58:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 Processor -- start 2023-11-28T16:58:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- start start 2023-11-28T16:58:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0700a0 0x7f70fc152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc0aacd0 0x7f70fc06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc154870 0x7f70fc1ee550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1edb60 con 0x7f70fc154870 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1ee090 con 0x7f70fc0700a0 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f71046ea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc144160 con 0x7f70fc0aacd0 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc154870 0x7f70fc1ee550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc154870 0x7f70fc1ee550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57854/0 (socket says 172.21.15.26:57854) 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 -- 172.21.15.26:0/3511156569 learned_addr learned my addr 172.21.15.26:0/3511156569 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7101c85640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc0aacd0 0x7f70fc06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102486640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0700a0 0x7f70fc152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 -- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc0aacd0 msgr2=0x7f70fc06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc0aacd0 0x7f70fc06ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 -- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0700a0 msgr2=0x7f70fc152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0700a0 0x7f70fc152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 -- 172.21.15.26:0/3511156569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009420 con 0x7f70fc154870 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.320+0000 7f7102c87640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc154870 0x7f70fc1ee550 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c7b0 tx=0x7f70f400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f70f2ffd640 1 -- 172.21.15.26:0/3511156569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4003db0 con 0x7f70fc154870 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f70f2ffd640 1 -- 172.21.15.26:0/3511156569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f400ce60 con 0x7f70fc154870 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f70f2ffd640 1 -- 172.21.15.26:0/3511156569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40052b0 con 0x7f70fc154870 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc1eddb0 con 0x7f70fc154870 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc152100 con 0x7f70fc154870 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc04e890 con 0x7f70fc154870 2023-11-28T16:58:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f70f2ffd640 1 -- 172.21.15.26:0/3511156569 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f70f4005410 con 0x7f70fc154870 2023-11-28T16:58:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f70f2ffd640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70e00668d0 0x7f70e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f70f2ffd640 1 -- 172.21.15.26:0/3511156569 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f70f4084110 con 0x7f70fc154870 2023-11-28T16:58:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.324+0000 7f7102486640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70e00668d0 0x7f70e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:40.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.328+0000 7f7102486640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70e00668d0 0x7f70e0068d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007fd0 tx=0x7f70f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:40.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.328+0000 7f70f2ffd640 1 -- 172.21.15.26:0/3511156569 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70f4051390 con 0x7f70fc154870 2023-11-28T16:58:40.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.520+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70fc0715b0 con 0x7f70fc154870 2023-11-28T16:58:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f70f2ffd640 1 -- 172.21.15.26:0/3511156569 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f70f40549b0 con 0x7f70fc154870 2023-11-28T16:58:42.993 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:42.993 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/894537520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":894537520},{"type":"v1","addr":"172.21.15.26:6835","nonce":894537520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 39 2023-11-28T16:58:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70e00668d0 msgr2=0x7f70e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70e00668d0 0x7f70e0068d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007fd0 tx=0x7f70f8009040 comp rx=0 tx=0).stop 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc154870 msgr2=0x7f70fc1ee550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc154870 0x7f70fc1ee550 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c7b0 tx=0x7f70f400cc70 comp rx=0 tx=0).stop 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 shutdown_connections 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc154870 0x7f70fc1ee550 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f70e00668d0 0x7f70e0068d90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70fc0aacd0 0x7f70fc06ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 --2- 172.21.15.26:0/3511156569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0700a0 0x7f70fc152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 >> 172.21.15.26:0/3511156569 conn(0x7f70fc0c2ad0 msgr2=0x7f70fc0a9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 shutdown_connections 2023-11-28T16:58:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:40.524+0000 7f71046ea640 1 -- 172.21.15.26:0/3511156569 wait complete. 2023-11-28T16:58:42.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d8a2c8640 1 Processor -- start 2023-11-28T16:58:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d8a2c8640 1 -- start start 2023-11-28T16:58:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d8a2c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840ca620 0x7f1d840caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d8a2c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d840c4890 0x7f1d840c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d8a2c8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8406b7d0 con 0x7f1d840bd5a0 2023-11-28T16:58:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d8a2c8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d84155160 con 0x7f1d840c4890 2023-11-28T16:58:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d8a2c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8406b180 con 0x7f1d840ca620 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d88ac5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d840c4890 0x7f1d840c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d88ac5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d840c4890 0x7f1d840c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51970/0 (socket says 172.21.15.26:51970) 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d88ac5640 1 -- 172.21.15.26:0/2416221292 learned_addr learned my addr 172.21.15.26:0/2416221292 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d892c6640 1 --2- 172.21.15.26:0/2416221292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840ca620 0x7f1d840caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d88ac5640 1 -- 172.21.15.26:0/2416221292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840ca620 msgr2=0x7f1d840caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d88ac5640 1 --2- 172.21.15.26:0/2416221292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840ca620 0x7f1d840caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d88ac5640 1 -- 172.21.15.26:0/2416221292 >> v1:172.21.15.26:6789/0 conn(0x7f1d840bd5a0 legacy=0x7f1d840c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d88ac5640 1 -- 172.21.15.26:0/2416221292 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8406b460 con 0x7f1d840c4890 2023-11-28T16:58:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.148+0000 7f1d7bfff640 1 -- 172.21.15.26:0/2416221292 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136353644 0 0) 0x7f1d8406b7d0 con 0x7f1d840bd5a0 2023-11-28T16:58:43.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d88ac5640 1 --2- 172.21.15.26:0/2416221292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c7f10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009870 tx=0x7f1d7401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f08432772c163df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d7bfff640 1 -- 172.21.15.26:0/2416221292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740ab600 con 0x7f1d840c4890 2023-11-28T16:58:43.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d7bfff640 1 -- 172.21.15.26:0/2416221292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d740ab760 con 0x7f1d840c4890 2023-11-28T16:58:43.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d7bfff640 1 -- 172.21.15.26:0/2416221292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740abaf0 con 0x7f1d840c4890 2023-11-28T16:58:43.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/2416221292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 msgr2=0x7f1d840c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/2416221292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c7f10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009870 tx=0x7f1d7401c4b0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/2416221292 shutdown_connections 2023-11-28T16:58:43.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/2416221292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c7f10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/2416221292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840ca620 0x7f1d840caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/2416221292 >> 172.21.15.26:0/2416221292 conn(0x7f1d840ac0a0 msgr2=0x7f1d840c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:43.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/2416221292 shutdown_connections 2023-11-28T16:58:43.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/2416221292 wait complete. 2023-11-28T16:58:43.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.152+0000 7f1d8a2c8640 1 Processor -- start 2023-11-28T16:58:43.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 -- start start 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840bd5a0 0x7f1d840bdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d840ca620 0x7f1d84158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840c19f0 con 0x7f1d840c4890 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8414d0c0 con 0x7f1d840ca620 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840c1f70 con 0x7f1d840bd5a0 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51984/0 (socket says 172.21.15.26:51984) 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 -- 172.21.15.26:0/3273840802 learned_addr learned my addr 172.21.15.26:0/3273840802 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d892c6640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840bd5a0 0x7f1d840bdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d89ac7640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d840ca620 0x7f1d84158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 -- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840bd5a0 msgr2=0x7f1d840bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840bd5a0 0x7f1d840bdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 -- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d840ca620 msgr2=0x7f1d84158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d840ca620 0x7f1d84158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 -- 172.21.15.26:0/3273840802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740094d0 con 0x7f1d840c4890 2023-11-28T16:58:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d88ac5640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c2400 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1d740ad040 tx=0x7f1d7401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d79ffb640 1 -- 172.21.15.26:0/3273840802 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740b4800 con 0x7f1d840c4890 2023-11-28T16:58:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d79ffb640 1 -- 172.21.15.26:0/3273840802 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d740b4980 con 0x7f1d840c4890 2023-11-28T16:58:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d79ffb640 1 -- 172.21.15.26:0/3273840802 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740b4d30 con 0x7f1d840c4890 2023-11-28T16:58:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d840c33a0 con 0x7f1d840c4890 2023-11-28T16:58:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d840c1c00 con 0x7f1d840c4890 2023-11-28T16:58:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.156+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d840c3850 con 0x7f1d840c4890 2023-11-28T16:58:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.160+0000 7f1d79ffb640 1 -- 172.21.15.26:0/3273840802 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1d740c7440 con 0x7f1d840c4890 2023-11-28T16:58:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.160+0000 7f1d79ffb640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1d680668d0 0x7f1d68068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.160+0000 7f1d79ffb640 1 -- 172.21.15.26:0/3273840802 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1d7411ee80 con 0x7f1d840c4890 2023-11-28T16:58:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.160+0000 7f1d892c6640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1d680668d0 0x7f1d68068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.160+0000 7f1d892c6640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1d680668d0 0x7f1d68068d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1d841535f0 tx=0x7f1d80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.164+0000 7f1d79ffb640 1 -- 172.21.15.26:0/3273840802 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d740ec100 con 0x7f1d840c4890 2023-11-28T16:58:43.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.324+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d8404e890 con 0x7f1d840c4890 2023-11-28T16:58:43.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.324+0000 7f1d79ffb640 1 -- 172.21.15.26:0/3273840802 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f1d740ef720 con 0x7f1d840c4890 2023-11-28T16:58:43.328 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:43.328 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":57,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:38.739534+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/3225309020":"2023-11-29T16:58:35.732005+0000","172.21.15.26:6834/3225309020":"2023-11-29T16:58:35.732005+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1d680668d0 msgr2=0x7f1d68068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1d680668d0 0x7f1d68068d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1d841535f0 tx=0x7f1d80008040 comp rx=0 tx=0).stop 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 msgr2=0x7f1d840c2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c2400 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1d740ad040 tx=0x7f1d7401acf0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 shutdown_connections 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d840ca620 0x7f1d84158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d840c4890 0x7f1d840c2400 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1d680668d0 0x7f1d68068d90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 --2- 172.21.15.26:0/3273840802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d840bd5a0 0x7f1d840bdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 >> 172.21.15.26:0/3273840802 conn(0x7f1d840ac0a0 msgr2=0x7f1d84152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:43.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 shutdown_connections 2023-11-28T16:58:43.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.328+0000 7f1d8a2c8640 1 -- 172.21.15.26:0/3273840802 wait complete. 2023-11-28T16:58:43.349 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-28T16:58:43.350 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:43.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 Processor -- start 2023-11-28T16:58:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 -- start start 2023-11-28T16:58:43.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60a41555d0 0x7f60a40c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60a40a6e50 0x7f60a40c3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40c3940 0x7f60a4158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40c70a0 con 0x7f60a40a6e50 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40c7380 con 0x7f60a41555d0 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a93f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a406c470 con 0x7f60a40c3940 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60a40a6e50 0x7f60a40c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60a40a6e50 0x7f60a40c3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51988/0 (socket says 172.21.15.26:51988) 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 -- 172.21.15.26:0/4085715722 learned_addr learned my addr 172.21.15.26:0/4085715722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a2ffd640 1 --2- 172.21.15.26:0/4085715722 >> v2:172.21.15.79:3300/0 conn(0x7f60a41555d0 0x7f60a40c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a37fe640 1 --2- 172.21.15.26:0/4085715722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40c3940 0x7f60a4158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 -- 172.21.15.26:0/4085715722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40c3940 msgr2=0x7f60a4158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 --2- 172.21.15.26:0/4085715722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40c3940 0x7f60a4158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 -- 172.21.15.26:0/4085715722 >> v2:172.21.15.79:3300/0 conn(0x7f60a41555d0 msgr2=0x7f60a40c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:43.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 --2- 172.21.15.26:0/4085715722 >> v2:172.21.15.79:3300/0 conn(0x7f60a41555d0 0x7f60a40c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f609a7fc640 1 -- 172.21.15.26:0/4085715722 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a406c750 con 0x7f60a40a6e50 2023-11-28T16:58:43.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.488+0000 7f60a2ffd640 1 --2- 172.21.15.26:0/4085715722 >> v2:172.21.15.79:3300/0 conn(0x7f60a41555d0 0x7f60a40c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:43.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f609a7fc640 1 --2- 172.21.15.26:0/4085715722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40a6e50 0x7f60a40c3400 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f60a4074560 tx=0x7f608c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52602e47877d5243 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a27fc640 1 -- 172.21.15.26:0/4085715722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0a5760 con 0x7f60a40a6e50 2023-11-28T16:58:43.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a27fc640 1 -- 172.21.15.26:0/4085715722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c0a58c0 con 0x7f60a40a6e50 2023-11-28T16:58:43.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a27fc640 1 -- 172.21.15.26:0/4085715722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0a5c50 con 0x7f60a40a6e50 2023-11-28T16:58:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 -- 172.21.15.26:0/4085715722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40a6e50 msgr2=0x7f60a40c3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 --2- 172.21.15.26:0/4085715722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40a6e50 0x7f60a40c3400 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f60a4074560 tx=0x7f608c01c990 comp rx=0 tx=0).stop 2023-11-28T16:58:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 -- 172.21.15.26:0/4085715722 shutdown_connections 2023-11-28T16:58:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 --2- 172.21.15.26:0/4085715722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40c3940 0x7f60a4158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 --2- 172.21.15.26:0/4085715722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40a6e50 0x7f60a40c3400 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 --2- 172.21.15.26:0/4085715722 >> v2:172.21.15.79:3300/0 conn(0x7f60a41555d0 0x7f60a40c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 -- 172.21.15.26:0/4085715722 >> 172.21.15.26:0/4085715722 conn(0x7f60a40c4960 msgr2=0x7f60a40c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:43.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 -- 172.21.15.26:0/4085715722 shutdown_connections 2023-11-28T16:58:43.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.492+0000 7f60a93f5640 1 -- 172.21.15.26:0/4085715722 wait complete. 2023-11-28T16:58:43.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 Processor -- start 2023-11-28T16:58:43.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 -- start start 2023-11-28T16:58:43.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40a6e50 0x7f60a41edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40c3940 0x7f60a4150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a41555d0 0x7f60a41574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a41edbb0 con 0x7f60a40c3940 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40702d0 con 0x7f60a41555d0 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4159580 con 0x7f60a40a6e50 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40c3940 0x7f60a4150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40c3940 0x7f60a4150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52004/0 (socket says 172.21.15.26:52004) 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 -- 172.21.15.26:0/445526113 learned_addr learned my addr 172.21.15.26:0/445526113 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a2ffd640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40a6e50 0x7f60a41edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a37fe640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a41555d0 0x7f60a41574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 -- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40a6e50 msgr2=0x7f60a41edfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40a6e50 0x7f60a41edfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 -- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a41555d0 msgr2=0x7f60a41574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a41555d0 0x7f60a41574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 -- 172.21.15.26:0/445526113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c009b30 con 0x7f60a40c3940 2023-11-28T16:58:43.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609a7fc640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40c3940 0x7f60a4150610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f608c01b040 tx=0x7f608c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609bfff640 1 -- 172.21.15.26:0/445526113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0b8670 con 0x7f60a40c3940 2023-11-28T16:58:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609bfff640 1 -- 172.21.15.26:0/445526113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c0b87d0 con 0x7f60a40c3940 2023-11-28T16:58:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a4158960 con 0x7f60a40c3940 2023-11-28T16:58:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f609bfff640 1 -- 172.21.15.26:0/445526113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0b8b80 con 0x7f60a40c3940 2023-11-28T16:58:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.496+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a40adbc0 con 0x7f60a40c3940 2023-11-28T16:58:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.500+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a404e890 con 0x7f60a40c3940 2023-11-28T16:58:43.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.500+0000 7f609bfff640 1 -- 172.21.15.26:0/445526113 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f608c0b8ce0 con 0x7f60a40c3940 2023-11-28T16:58:43.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.500+0000 7f609bfff640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f60840668d0 0x7f6084068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.500+0000 7f609bfff640 1 -- 172.21.15.26:0/445526113 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f608c11fa70 con 0x7f60a40c3940 2023-11-28T16:58:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.500+0000 7f60a2ffd640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f60840668d0 0x7f6084068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.500+0000 7f60a2ffd640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f60840668d0 0x7f6084068d90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f60a41564f0 tx=0x7f6094008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.504+0000 7f609bfff640 1 -- 172.21.15.26:0/445526113 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f608c0ecd90 con 0x7f60a40c3940 2023-11-28T16:58:43.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a406d370 con 0x7f60a40c3940 2023-11-28T16:58:43.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f609bfff640 1 -- 172.21.15.26:0/445526113 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f608c0bc090 con 0x7f60a40c3940 2023-11-28T16:58:43.696 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:43.696 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/894537520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":894537520},{"type":"v1","addr":"172.21.15.26:6835","nonce":894537520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:43.696 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 39 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f60840668d0 msgr2=0x7f6084068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f60840668d0 0x7f6084068d90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f60a41564f0 tx=0x7f6094008040 comp rx=0 tx=0).stop 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40c3940 msgr2=0x7f60a4150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40c3940 0x7f60a4150610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f608c01b040 tx=0x7f608c019730 comp rx=0 tx=0).stop 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 shutdown_connections 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a41555d0 0x7f60a41574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a40c3940 0x7f60a4150610 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f60840668d0 0x7f6084068d90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 --2- 172.21.15.26:0/445526113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60a40a6e50 0x7f60a41edfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.692+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 >> 172.21.15.26:0/445526113 conn(0x7f60a40c4960 msgr2=0x7f60a40a9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:43.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.696+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 shutdown_connections 2023-11-28T16:58:43.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.696+0000 7f60a93f5640 1 -- 172.21.15.26:0/445526113 wait complete. 2023-11-28T16:58:43.717 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.856+0000 7f644829c640 1 Processor -- start 2023-11-28T16:58:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.856+0000 7f644829c640 1 -- start start 2023-11-28T16:58:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f644829c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64401520f0 0x7f64400c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f644829c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64400c5520 con 0x7f6440155660 2023-11-28T16:58:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f644829c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64400c9a80 con 0x7f64400c7f70 2023-11-28T16:58:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f644829c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644006c020 con 0x7f64401520f0 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445837640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6440155660 0x7f644006b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36154/0 (socket says 172.21.15.26:36154) 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445837640 1 -- 172.21.15.26:0/1286493827 learned_addr learned my addr 172.21.15.26:0/1286493827 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446038640 1 --2- 172.21.15.26:0/1286493827 >> v2:172.21.15.79:3300/0 conn(0x7f64401520f0 0x7f64400c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806829756 0 0) 0x7f64400c5520 con 0x7f6440155660 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f642c003530 con 0x7f6440155660 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970145128 0 0) 0x7f642c003530 con 0x7f6440155660 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 >> v2:172.21.15.79:3300/0 conn(0x7f64401520f0 msgr2=0x7f64400c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 --2- 172.21.15.26:0/1286493827 >> v2:172.21.15.79:3300/0 conn(0x7f64401520f0 0x7f64400c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 >> v1:172.21.15.79:6789/0 conn(0x7f64400c7f70 legacy=0x7f644015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400c5240 con 0x7f6440155660 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f6430001680 con 0x7f6440155660 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 >> v1:172.21.15.26:6789/0 conn(0x7f6440155660 legacy=0x7f644006b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f642c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f642c004380 0x7f642c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f642c0050f0 0x7f642c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644006c020 con 0x7f642c003980 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c00c030 con 0x7f642c0050f0 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c00c1f0 con 0x7f642c004380 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446038640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f642c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446839640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f642c0050f0 0x7f642c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6445837640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f642c004380 0x7f642c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446038640 1 -- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f642c004380 msgr2=0x7f642c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446038640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f642c004380 0x7f642c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446038640 1 -- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f642c0050f0 msgr2=0x7f642c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446038640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f642c0050f0 0x7f642c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446038640 1 -- 172.21.15.26:0/1286493827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c003530 con 0x7f642c003980 2023-11-28T16:58:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.860+0000 7f6446839640 1 -- 172.21.15.26:0/1286493827 reap_dead start 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f6446038640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f642c003d60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f643c009ae0 tx=0x7f643c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3587d8f1fd84415 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0a6430 con 0x7f642c003980 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0a6590 con 0x7f642c003980 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f6445036640 1 -- 172.21.15.26:0/1286493827 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0a6940 con 0x7f642c003980 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 -- 172.21.15.26:0/1286493827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 msgr2=0x7f642c003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f642c003d60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f643c009ae0 tx=0x7f643c01ca50 comp rx=0 tx=0).stop 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 -- 172.21.15.26:0/1286493827 shutdown_connections 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 --2- 172.21.15.26:0/1286493827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f642c003d60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 -- 172.21.15.26:0/1286493827 >> 172.21.15.26:0/1286493827 conn(0x7f64400ca070 msgr2=0x7f64400ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 -- 172.21.15.26:0/1286493827 shutdown_connections 2023-11-28T16:58:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 -- 172.21.15.26:0/1286493827 wait complete. 2023-11-28T16:58:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.864+0000 7f644829c640 1 Processor -- start 2023-11-28T16:58:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 -- start start 2023-11-28T16:58:43.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f64401f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64401f11e0 0x7f6440147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64401484d0 0x7f64401479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644014bcc0 con 0x7f642c003980 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440147fa0 con 0x7f64401484d0 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644014b7c0 con 0x7f64401f11e0 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f64401f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f64401f0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52018/0 (socket says 172.21.15.26:52018) 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 -- 172.21.15.26:0/779577555 learned_addr learned my addr 172.21.15.26:0/779577555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6445837640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64401f11e0 0x7f6440147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446839640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64401484d0 0x7f64401479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 -- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64401f11e0 msgr2=0x7f6440147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64401f11e0 0x7f6440147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 -- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64401484d0 msgr2=0x7f64401479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64401484d0 0x7f64401479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 -- 172.21.15.26:0/779577555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64401481f0 con 0x7f642c003980 2023-11-28T16:58:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6446038640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f64401f0ca0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f643c01c880 tx=0x7f643c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6436ffd640 1 -- 172.21.15.26:0/779577555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0a6430 con 0x7f642c003980 2023-11-28T16:58:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6436ffd640 1 -- 172.21.15.26:0/779577555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c00f000 con 0x7f642c003980 2023-11-28T16:58:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64401f1730 con 0x7f642c003980 2023-11-28T16:58:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f6436ffd640 1 -- 172.21.15.26:0/779577555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0b9660 con 0x7f642c003980 2023-11-28T16:58:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64400c0de0 con 0x7f642c003980 2023-11-28T16:58:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.868+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644004e890 con 0x7f642c003980 2023-11-28T16:58:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.872+0000 7f6436ffd640 1 -- 172.21.15.26:0/779577555 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f643c0c2440 con 0x7f642c003980 2023-11-28T16:58:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.872+0000 7f6436ffd640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6424066900 0x7f6424068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.872+0000 7f6436ffd640 1 -- 172.21.15.26:0/779577555 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f643c11e510 con 0x7f642c003980 2023-11-28T16:58:43.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.872+0000 7f6445837640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6424066900 0x7f6424068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:43.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.872+0000 7f6445837640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6424066900 0x7f6424068dc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f644014fe00 tx=0x7f6430000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:43.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:43.876+0000 7f6436ffd640 1 -- 172.21.15.26:0/779577555 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f643c0eb6e0 con 0x7f642c003980 2023-11-28T16:58:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.064+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64400c9c70 con 0x7f642c003980 2023-11-28T16:58:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f6436ffd640 1 -- 172.21.15.26:0/779577555 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f643c0eed00 con 0x7f642c003980 2023-11-28T16:58:44.070 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:44.070 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/894537520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":894537520},{"type":"v1","addr":"172.21.15.26:6835","nonce":894537520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:09.747565+0000","modified":"2023-11-28T16:58:12.771603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5715":{"gid":5715,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6833/50257293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":50257293},{"type":"v1","addr":"172.21.15.26:6833","nonce":50257293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T16:58:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 39 2023-11-28T16:58:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6424066900 msgr2=0x7f6424068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6424066900 0x7f6424068dc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f644014fe00 tx=0x7f6430000ee0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 msgr2=0x7f64401f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f64401f0ca0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f643c01c880 tx=0x7f643c0197f0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 shutdown_connections 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64401484d0 0x7f64401479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6424066900 0x7f6424068dc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64401f11e0 0x7f6440147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 --2- 172.21.15.26:0/779577555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c003980 0x7f64401f0ca0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 >> 172.21.15.26:0/779577555 conn(0x7f64400ca070 msgr2=0x7f64400c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 shutdown_connections 2023-11-28T16:58:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.068+0000 7f644829c640 1 -- 172.21.15.26:0/779577555 wait complete. 2023-11-28T16:58:44.092 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe78e279640 1 Processor -- start 2023-11-28T16:58:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe78e279640 1 -- start start 2023-11-28T16:58:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe78e279640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe788070b80 0x7fe788151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe78e279640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78806d320 con 0x7fe78814e9d0 2023-11-28T16:58:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe78e279640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7880721b0 con 0x7fe7880a8470 2023-11-28T16:58:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe78e279640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880c2830 con 0x7fe788070b80 2023-11-28T16:58:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe7877fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe788070b80 0x7fe788151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe787fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe78814e9d0 0x7fe7880c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36160/0 (socket says 172.21.15.26:36160) 2023-11-28T16:58:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe787fff640 1 -- 172.21.15.26:0/1830484527 learned_addr learned my addr 172.21.15.26:0/1830484527 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe7877fe640 1 -- 172.21.15.26:0/1830484527 >> v1:172.21.15.79:6789/0 conn(0x7fe7880a8470 legacy=0x7fe78806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe7877fe640 1 -- 172.21.15.26:0/1830484527 >> v1:172.21.15.26:6789/0 conn(0x7fe78814e9d0 legacy=0x7fe7880c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.232+0000 7fe7877fe640 1 -- 172.21.15.26:0/1830484527 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788072450 con 0x7fe788070b80 2023-11-28T16:58:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe7877fe640 1 --2- 172.21.15.26:0/1830484527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe788070b80 0x7fe788151e60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0097c0 tx=0x7fe77c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a9d0bb90ea1aed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe786ffd640 1 -- 172.21.15.26:0/1830484527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0ab600 con 0x7fe788070b80 2023-11-28T16:58:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe786ffd640 1 -- 172.21.15.26:0/1830484527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c0a7050 con 0x7fe788070b80 2023-11-28T16:58:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe786ffd640 1 -- 172.21.15.26:0/1830484527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0ab980 con 0x7fe788070b80 2023-11-28T16:58:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe78e279640 1 -- 172.21.15.26:0/1830484527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe788070b80 msgr2=0x7fe788151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe78e279640 1 --2- 172.21.15.26:0/1830484527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe788070b80 0x7fe788151e60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0097c0 tx=0x7fe77c01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe78e279640 1 -- 172.21.15.26:0/1830484527 shutdown_connections 2023-11-28T16:58:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe78e279640 1 --2- 172.21.15.26:0/1830484527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe788070b80 0x7fe788151e60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe78e279640 1 -- 172.21.15.26:0/1830484527 >> 172.21.15.26:0/1830484527 conn(0x7fe7880c2ad0 msgr2=0x7fe7880c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe78e279640 1 -- 172.21.15.26:0/1830484527 shutdown_connections 2023-11-28T16:58:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.236+0000 7fe78e279640 1 -- 172.21.15.26:0/1830484527 wait complete. 2023-11-28T16:58:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 Processor -- start 2023-11-28T16:58:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 -- start start 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe788070b80 0x7fe7880c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7880a8470 0x7fe788149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe78814e9d0 0x7fe78814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7881f1770 con 0x7fe7880a8470 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7881f1ca0 con 0x7fe78814e9d0 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7881f19c0 con 0x7fe788070b80 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7880a8470 0x7fe788149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7880a8470 0x7fe788149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52032/0 (socket says 172.21.15.26:52032) 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 -- 172.21.15.26:0/3189441545 learned_addr learned my addr 172.21.15.26:0/3189441545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe787fff640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe788070b80 0x7fe7880c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78c816640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe78814e9d0 0x7fe78814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 -- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe788070b80 msgr2=0x7fe7880c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe788070b80 0x7fe7880c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 -- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe78814e9d0 msgr2=0x7fe78814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe78814e9d0 0x7fe78814c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 -- 172.21.15.26:0/3189441545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c009420 con 0x7fe7880a8470 2023-11-28T16:58:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78c816640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe78814e9d0 0x7fe78814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe7877fe640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7880a8470 0x7fe788149f00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe77c019000 tx=0x7fe77c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe784ff9640 1 -- 172.21.15.26:0/3189441545 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0b4610 con 0x7fe7880a8470 2023-11-28T16:58:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe784ff9640 1 -- 172.21.15.26:0/3189441545 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c0abe90 con 0x7fe7880a8470 2023-11-28T16:58:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe784ff9640 1 -- 172.21.15.26:0/3189441545 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0b49d0 con 0x7fe7880a8470 2023-11-28T16:58:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78814d6a0 con 0x7fe7880a8470 2023-11-28T16:58:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.240+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78814dc60 con 0x7fe7880a8470 2023-11-28T16:58:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.244+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78804e890 con 0x7fe7880a8470 2023-11-28T16:58:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.244+0000 7fe784ff9640 1 -- 172.21.15.26:0/3189441545 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe77c0b2040 con 0x7fe7880a8470 2023-11-28T16:58:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.244+0000 7fe784ff9640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7740668d0 0x7fe774068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.244+0000 7fe784ff9640 1 -- 172.21.15.26:0/3189441545 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe77c11e3e0 con 0x7fe7880a8470 2023-11-28T16:58:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.244+0000 7fe787fff640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7740668d0 0x7fe774068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.244+0000 7fe787fff640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7740668d0 0x7fe774068d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe778005890 tx=0x7fe778009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.248+0000 7fe784ff9640 1 -- 172.21.15.26:0/3189441545 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe77c0eb700 con 0x7fe7880a8470 2023-11-28T16:58:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.408+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7880700a0 con 0x7fe7880a8470 2023-11-28T16:58:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.408+0000 7fe784ff9640 1 -- 172.21.15.26:0/3189441545 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fe77c0eed20 con 0x7fe7880a8470 2023-11-28T16:58:44.412 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:44.412 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":57,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:38.739534+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:58:07.830332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:58:08.744612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/3225309020":"2023-11-29T16:58:35.732005+0000","172.21.15.26:6834/3225309020":"2023-11-29T16:58:35.732005+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7740668d0 msgr2=0x7fe774068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7740668d0 0x7fe774068d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe778005890 tx=0x7fe778009040 comp rx=0 tx=0).stop 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7880a8470 msgr2=0x7fe788149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7880a8470 0x7fe788149f00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe77c019000 tx=0x7fe77c019190 comp rx=0 tx=0).stop 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 shutdown_connections 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe78814e9d0 0x7fe78814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7880a8470 0x7fe788149f00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe7740668d0 0x7fe774068d90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 --2- 172.21.15.26:0/3189441545 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe788070b80 0x7fe7880c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 >> 172.21.15.26:0/3189441545 conn(0x7fe7880c2ad0 msgr2=0x7fe7880c1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 shutdown_connections 2023-11-28T16:58:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.412+0000 7fe78e279640 1 -- 172.21.15.26:0/3189441545 wait complete. 2023-11-28T16:58:44.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-28T16:58:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c0449a640 1 Processor -- start 2023-11-28T16:58:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c0449a640 1 -- start start 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c0449a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bfc0bd720 0x7f8bfc158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c0449a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8bfc06cd90 0x7f8bfc158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c0449a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc155790 con 0x7f8bfc0ca610 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c0449a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0c4b00 con 0x7f8bfc0bd720 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c0449a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0c4de0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c01a35640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bfc0bd720 0x7f8bfc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c01a35640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bfc0bd720 0x7f8bfc158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52040/0 (socket says 172.21.15.26:52040) 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c01a35640 1 -- 172.21.15.26:0/4267185720 learned_addr learned my addr 172.21.15.26:0/4267185720 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c02a37640 1 --2- 172.21.15.26:0/4267185720 >> v2:172.21.15.79:3300/0 conn(0x7f8bfc06cd90 0x7f8bfc158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c01a35640 1 -- 172.21.15.26:0/4267185720 >> v2:172.21.15.79:3300/0 conn(0x7f8bfc06cd90 msgr2=0x7f8bfc158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c01a35640 1 --2- 172.21.15.26:0/4267185720 >> v2:172.21.15.79:3300/0 conn(0x7f8bfc06cd90 0x7f8bfc158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c01a35640 1 -- 172.21.15.26:0/4267185720 >> v1:172.21.15.79:6789/0 conn(0x7f8bfc0ca610 legacy=0x7f8bfc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.576+0000 7f8c01a35640 1 -- 172.21.15.26:0/4267185720 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc157e30 con 0x7f8bfc0bd720 2023-11-28T16:58:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c01a35640 1 --2- 172.21.15.26:0/4267185720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0bd720 0x7f8bfc158350 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc1547a0 tx=0x7f8bec01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6a5ca85a2b6d2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c01234640 1 -- 172.21.15.26:0/4267185720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0c52d0 con 0x7f8bfc0bd720 2023-11-28T16:58:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c01234640 1 -- 172.21.15.26:0/4267185720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec0a7050 con 0x7f8bfc0bd720 2023-11-28T16:58:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c01234640 1 -- 172.21.15.26:0/4267185720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0ab820 con 0x7f8bfc0bd720 2023-11-28T16:58:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 -- 172.21.15.26:0/4267185720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0bd720 msgr2=0x7f8bfc158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 --2- 172.21.15.26:0/4267185720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0bd720 0x7f8bfc158350 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc1547a0 tx=0x7f8bec01c3e0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 -- 172.21.15.26:0/4267185720 shutdown_connections 2023-11-28T16:58:44.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 --2- 172.21.15.26:0/4267185720 >> v2:172.21.15.79:3300/0 conn(0x7f8bfc06cd90 0x7f8bfc158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 --2- 172.21.15.26:0/4267185720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0bd720 0x7f8bfc158350 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 -- 172.21.15.26:0/4267185720 >> 172.21.15.26:0/4267185720 conn(0x7f8bfc071ea0 msgr2=0x7f8bfc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 -- 172.21.15.26:0/4267185720 shutdown_connections 2023-11-28T16:58:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.580+0000 7f8c0449a640 1 -- 172.21.15.26:0/4267185720 wait complete. 2023-11-28T16:58:44.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 Processor -- start 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 -- start start 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc06cd90 0x7f8bfc1f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bfc0bd720 0x7f8bfc156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bfc0ca610 0x7f8bfc156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc1469d0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc146e60 con 0x7f8bfc0ca610 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc1f1360 con 0x7f8bfc0bd720 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc06cd90 0x7f8bfc1f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc06cd90 0x7f8bfc1f06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52056/0 (socket says 172.21.15.26:52056) 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 -- 172.21.15.26:0/3301557661 learned_addr learned my addr 172.21.15.26:0/3301557661 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02a37640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bfc0ca610 0x7f8bfc156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c01a35640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bfc0bd720 0x7f8bfc156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 -- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bfc0bd720 msgr2=0x7f8bfc156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bfc0bd720 0x7f8bfc156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 -- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bfc0ca610 msgr2=0x7f8bfc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bfc0ca610 0x7f8bfc156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 -- 172.21.15.26:0/3301557661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0094d0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c02236640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc06cd90 0x7f8bfc1f06f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c3c0 tx=0x7f8bf800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8bf2ffd640 1 -- 172.21.15.26:0/3301557661 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80052d0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8bf2ffd640 1 -- 172.21.15.26:0/3301557661 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8005430 con 0x7f8bfc06cd90 2023-11-28T16:58:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8bf2ffd640 1 -- 172.21.15.26:0/3301557661 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8003840 con 0x7f8bfc06cd90 2023-11-28T16:58:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc1f1080 con 0x7f8bfc06cd90 2023-11-28T16:58:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.584+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc147c10 con 0x7f8bfc06cd90 2023-11-28T16:58:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.588+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc0c9de0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.588+0000 7f8bf2ffd640 1 -- 172.21.15.26:0/3301557661 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8bf80039a0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.588+0000 7f8bf2ffd640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8be0066900 0x7f8be0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.588+0000 7f8bf2ffd640 1 -- 172.21.15.26:0/3301557661 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f8bf8083950 con 0x7f8bfc06cd90 2023-11-28T16:58:44.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.588+0000 7f8c01a35640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8be0066900 0x7f8be0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.588+0000 7f8c01a35640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8be0066900 0x7f8be0068dc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0ad000 tx=0x7f8bec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.592+0000 7f8bf2ffd640 1 -- 172.21.15.26:0/3301557661 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bf8050bd0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.784+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f8bfc04e890 con 0x7f8bfc06cd90 2023-11-28T16:58:44.787 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-11-28T16:58:44.784+0000 7fcd77275640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T16:58:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8bf2ffd640 1 -- 172.21.15.26:0/3301557661 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8bf80541f0 con 0x7f8bfc06cd90 2023-11-28T16:58:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T16:58:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8be0066900 msgr2=0x7f8be0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8be0066900 0x7f8be0068dc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0ad000 tx=0x7f8bec008040 comp rx=0 tx=0).stop 2023-11-28T16:58:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc06cd90 msgr2=0x7f8bfc1f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc06cd90 0x7f8bfc1f06f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c3c0 tx=0x7f8bf800c880 comp rx=0 tx=0).stop 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 shutdown_connections 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bfc0ca610 0x7f8bfc156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8be0066900 0x7f8be0068dc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8bfc0bd720 0x7f8bfc156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 --2- 172.21.15.26:0/3301557661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc06cd90 0x7f8bfc1f06f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 >> 172.21.15.26:0/3301557661 conn(0x7f8bfc071ea0 msgr2=0x7f8bfc154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 shutdown_connections 2023-11-28T16:58:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.788+0000 7f8c0449a640 1 -- 172.21.15.26:0/3301557661 wait complete. 2023-11-28T16:58:44.799 INFO:tasks.ceph.mds.c.smithi026.stderr: -2192> 2023-11-28T16:58:13.245+0000 7f4ef69ec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:58:44.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-28T16:58:44.845 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-11-28T16:58:44.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.956+0000 7f9abf25a640 1 Processor -- start 2023-11-28T16:58:44.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.956+0000 7f9abf25a640 1 -- start start 2023-11-28T16:58:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abf25a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab80c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abf25a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ab80c2a60 0x7f9ab806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abf25a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab8073710 con 0x7f9ab806b810 2023-11-28T16:58:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abf25a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab81589f0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abf25a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81586e0 con 0x7f9ab806f0d0 2023-11-28T16:58:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ab80c2a60 0x7f9ab806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ab80c2a60 0x7f9ab806e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52076/0 (socket says 172.21.15.26:52076) 2023-11-28T16:58:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 -- 172.21.15.26:0/2905528777 learned_addr learned my addr 172.21.15.26:0/2905528777 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9ab7fff640 1 --2- 172.21.15.26:0/2905528777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab80c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 -- 172.21.15.26:0/2905528777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 msgr2=0x7f9ab80c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 --2- 172.21.15.26:0/2905528777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab80c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 -- 172.21.15.26:0/2905528777 >> v1:172.21.15.79:6789/0 conn(0x7f9ab806b810 legacy=0x7f9ab80bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 -- 172.21.15.26:0/2905528777 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab80a6010 con 0x7f9ab80c2a60 2023-11-28T16:58:44.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.960+0000 7f9abd7f7640 1 --2- 172.21.15.26:0/2905528777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab806e550 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009e50 tx=0x7f9ab001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4777eed287e21041 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9ab77fe640 1 -- 172.21.15.26:0/2905528777 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00a56e0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9ab77fe640 1 -- 172.21.15.26:0/2905528777 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab00a5840 con 0x7f9ab80c2a60 2023-11-28T16:58:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9ab77fe640 1 -- 172.21.15.26:0/2905528777 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00a5bd0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- 172.21.15.26:0/2905528777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 msgr2=0x7f9ab806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 --2- 172.21.15.26:0/2905528777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab806e550 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009e50 tx=0x7f9ab001ca10 comp rx=0 tx=0).stop 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- 172.21.15.26:0/2905528777 shutdown_connections 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 --2- 172.21.15.26:0/2905528777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab806e550 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 --2- 172.21.15.26:0/2905528777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab80c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- 172.21.15.26:0/2905528777 >> 172.21.15.26:0/2905528777 conn(0x7f9ab80c3240 msgr2=0x7f9ab80c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- 172.21.15.26:0/2905528777 shutdown_connections 2023-11-28T16:58:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- 172.21.15.26:0/2905528777 wait complete. 2023-11-28T16:58:44.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 Processor -- start 2023-11-28T16:58:44.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- start start 2023-11-28T16:58:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ab806b810 0x7f9ab8159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8067850 con 0x7f9ab80c2a60 2023-11-28T16:58:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81ee000 con 0x7f9ab806b810 2023-11-28T16:58:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abf25a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80aa5d0 con 0x7f9ab806f0d0 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abd7f7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abcff6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ab806b810 0x7f9ab8159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abd7f7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab814e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52092/0 (socket says 172.21.15.26:52092) 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9abd7f7640 1 -- 172.21.15.26:0/3060614922 learned_addr learned my addr 172.21.15.26:0/3060614922 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.964+0000 7f9ab7fff640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abd7f7640 1 -- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 msgr2=0x7f9ab814e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abd7f7640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab814e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abd7f7640 1 -- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ab806b810 msgr2=0x7f9ab8159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abd7f7640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ab806b810 0x7f9ab8159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abd7f7640 1 -- 172.21.15.26:0/3060614922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0009b30 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abd7f7640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab814e5b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00af040 tx=0x7f9ab00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9ab57fa640 1 -- 172.21.15.26:0/3060614922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00b8670 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9ab57fa640 1 -- 172.21.15.26:0/3060614922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab00b87d0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9ab57fa640 1 -- 172.21.15.26:0/3060614922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00b8b60 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab80aa8b0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81597d0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8154560 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9ab57fa640 1 -- 172.21.15.26:0/3060614922 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ab00b8cc0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9ab57fa640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a9c0668d0 0x7f9a9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.968+0000 7f9ab57fa640 1 -- 172.21.15.26:0/3060614922 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f9ab011f8d0 con 0x7f9ab80c2a60 2023-11-28T16:58:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.972+0000 7f9abcff6640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a9c0668d0 0x7f9a9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.972+0000 7f9abcff6640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a9c0668d0 0x7f9a9c068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80c06f0 tx=0x7f9aac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:44.972+0000 7f9ab57fa640 1 -- 172.21.15.26:0/3060614922 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ab8154560 con 0x7f9ab80c2a60 2023-11-28T16:58:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.164+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9ab8154560 con 0x7f9ab80c2a60 2023-11-28T16:58:45.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.788+0000 7f9ab57fa640 1 -- 172.21.15.26:0/3060614922 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9ab8154560 con 0x7f9ab80c2a60 2023-11-28T16:58:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a9c0668d0 msgr2=0x7f9a9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a9c0668d0 0x7f9a9c068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80c06f0 tx=0x7f9aac009040 comp rx=0 tx=0).stop 2023-11-28T16:58:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 msgr2=0x7f9ab814e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab814e5b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00af040 tx=0x7f9ab00197b0 comp rx=0 tx=0).stop 2023-11-28T16:58:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 shutdown_connections 2023-11-28T16:58:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab80c2a60 0x7f9ab814e5b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9a9c0668d0 0x7f9a9c068d90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ab806f0d0 0x7f9ab814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 --2- 172.21.15.26:0/3060614922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ab806b810 0x7f9ab8159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 >> 172.21.15.26:0/3060614922 conn(0x7f9ab80c3240 msgr2=0x7f9ab80a6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 shutdown_connections 2023-11-28T16:58:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:45.792+0000 7f9abf25a640 1 -- 172.21.15.26:0/3060614922 wait complete. 2023-11-28T16:58:45.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-28T16:58:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.008+0000 7f2ea4efe640 1 Processor -- start 2023-11-28T16:58:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.008+0000 7f2ea4efe640 1 -- start start 2023-11-28T16:58:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2ea4efe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ea006a980 0x7f2ea0160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2ea4efe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea01556d0 con 0x7f2ea006a5a0 2023-11-28T16:58:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2ea4efe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea0154ac0 con 0x7f2ea0072280 2023-11-28T16:58:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2ea4efe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea006e290 con 0x7f2ea006a980 2023-11-28T16:58:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9e59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2ea006a5a0 0x7f2ea00c0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36176/0 (socket says 172.21.15.26:36176) 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9e59c640 1 -- 172.21.15.26:0/3205252931 learned_addr learned my addr 172.21.15.26:0/3205252931 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9ed9d640 1 --2- 172.21.15.26:0/3205252931 >> v2:172.21.15.79:3300/0 conn(0x7f2ea006a980 0x7f2ea0160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9dd9b640 1 -- 172.21.15.26:0/3205252931 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579332201 0 0) 0x7f2ea01556d0 con 0x7f2ea006a5a0 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9dd9b640 1 -- 172.21.15.26:0/3205252931 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e8c003530 con 0x7f2ea006a5a0 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9ed9d640 1 -- 172.21.15.26:0/3205252931 >> v1:172.21.15.79:6789/0 conn(0x7f2ea0072280 legacy=0x7f2ea00c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9dd9b640 1 -- 172.21.15.26:0/3205252931 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575963189 0 0) 0x7f2ea0154ac0 con 0x7f2ea0072280 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9ed9d640 1 -- 172.21.15.26:0/3205252931 >> v1:172.21.15.26:6789/0 conn(0x7f2ea006a5a0 legacy=0x7f2ea00c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.012+0000 7f2e9ed9d640 1 -- 172.21.15.26:0/3205252931 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0154da0 con 0x7f2ea006a980 2023-11-28T16:58:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2e9ed9d640 1 --2- 172.21.15.26:0/3205252931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 0x7f2ea0160100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2e9801c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b192a5995f25768 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2e9dd9b640 1 -- 172.21.15.26:0/3205252931 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90001600 con 0x7f2ea006a980 2023-11-28T16:58:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2e9dd9b640 1 -- 172.21.15.26:0/3205252931 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e980a6480 con 0x7f2ea006a980 2023-11-28T16:58:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2e9dd9b640 1 -- 172.21.15.26:0/3205252931 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980a6810 con 0x7f2ea006a980 2023-11-28T16:58:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 -- 172.21.15.26:0/3205252931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 msgr2=0x7f2ea0160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/3205252931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 0x7f2ea0160100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2e9801c700 comp rx=0 tx=0).stop 2023-11-28T16:58:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 -- 172.21.15.26:0/3205252931 shutdown_connections 2023-11-28T16:58:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/3205252931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 0x7f2ea0160100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 -- 172.21.15.26:0/3205252931 >> 172.21.15.26:0/3205252931 conn(0x7f2ea00c3c60 msgr2=0x7f2ea00c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 -- 172.21.15.26:0/3205252931 shutdown_connections 2023-11-28T16:58:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 -- 172.21.15.26:0/3205252931 wait complete. 2023-11-28T16:58:46.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 Processor -- start 2023-11-28T16:58:46.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.016+0000 7f2ea4efe640 1 -- start start 2023-11-28T16:58:46.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ea006a5a0 0x7f2ea00aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 0x7f2ea01ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea0072280 0x7f2ea01ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea01424d0 con 0x7f2ea0072280 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0141a50 con 0x7f2ea006a980 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0141770 con 0x7f2ea006a5a0 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea0072280 0x7f2ea01ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea0072280 0x7f2ea01ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52096/0 (socket says 172.21.15.26:52096) 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 -- 172.21.15.26:0/763628762 learned_addr learned my addr 172.21.15.26:0/763628762 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9e59c640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ea006a5a0 0x7f2ea00aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e97fff640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 0x7f2ea01ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 -- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ea006a5a0 msgr2=0x7f2ea00aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ea006a5a0 0x7f2ea00aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 -- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 msgr2=0x7f2ea01ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 0x7f2ea01ed190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 -- 172.21.15.26:0/763628762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98009a70 con 0x7f2ea0072280 2023-11-28T16:58:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e9ed9d640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea0072280 0x7f2ea01ed6d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2e9801a330 tx=0x7f2e980194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e96ffd640 1 -- 172.21.15.26:0/763628762 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980b4070 con 0x7f2ea0072280 2023-11-28T16:58:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e96ffd640 1 -- 172.21.15.26:0/763628762 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e980b5040 con 0x7f2ea0072280 2023-11-28T16:58:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2e96ffd640 1 -- 172.21.15.26:0/763628762 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980a7880 con 0x7f2ea0072280 2023-11-28T16:58:46.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea00ab8d0 con 0x7f2ea0072280 2023-11-28T16:58:46.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea01edf90 con 0x7f2ea0072280 2023-11-28T16:58:46.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.020+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea0147630 con 0x7f2ea0072280 2023-11-28T16:58:46.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.024+0000 7f2e96ffd640 1 -- 172.21.15.26:0/763628762 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2e980a79e0 con 0x7f2ea0072280 2023-11-28T16:58:46.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.024+0000 7f2e96ffd640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2e80066900 0x7f2e80068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.024+0000 7f2e96ffd640 1 -- 172.21.15.26:0/763628762 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f2e9811eff0 con 0x7f2ea0072280 2023-11-28T16:58:46.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.024+0000 7f2e9e59c640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2e80066900 0x7f2e80068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.024+0000 7f2e9e59c640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2e80066900 0x7f2e80068dc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2ea01477f0 tx=0x7f2e90001aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.028+0000 7f2e96ffd640 1 -- 172.21.15.26:0/763628762 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2e980ec2c0 con 0x7f2ea0072280 2023-11-28T16:58:46.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.188+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ea0141c00 con 0x7f2ea0072280 2023-11-28T16:58:46.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.792+0000 7f2e96ffd640 1 -- 172.21.15.26:0/763628762 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2ea0141c00 con 0x7f2ea0072280 2023-11-28T16:58:46.794 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_metadata' removed 2023-11-28T16:58:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.792+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2e80066900 msgr2=0x7f2e80068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.792+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2e80066900 0x7f2e80068dc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2ea01477f0 tx=0x7f2e90001aa0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.792+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea0072280 msgr2=0x7f2ea01ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.792+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea0072280 0x7f2ea01ed6d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2e9801a330 tx=0x7f2e980194a0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 shutdown_connections 2023-11-28T16:58:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ea0072280 0x7f2ea01ed6d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ea006a980 0x7f2ea01ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2e80066900 0x7f2e80068dc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 --2- 172.21.15.26:0/763628762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ea006a5a0 0x7f2ea00aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 >> 172.21.15.26:0/763628762 conn(0x7f2ea00c3c60 msgr2=0x7f2ea00c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 shutdown_connections 2023-11-28T16:58:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.796+0000 7f2ea4efe640 1 -- 172.21.15.26:0/763628762 wait complete. 2023-11-28T16:58:46.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-28T16:58:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b69aa640 1 Processor -- start 2023-11-28T16:58:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b69aa640 1 -- start start 2023-11-28T16:58:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b69aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9b006b0c0 0x7fb9b0155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b69aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b0070260 0x7fb9b00706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b69aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b01559d0 con 0x7fb9b0154ea0 2023-11-28T16:58:46.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b69aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b01557c0 con 0x7fb9b006b0c0 2023-11-28T16:58:46.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b69aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b006d910 con 0x7fb9b0070260 2023-11-28T16:58:46.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9b006b0c0 0x7fb9b0155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9b006b0c0 0x7fb9b0155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52108/0 (socket says 172.21.15.26:52108) 2023-11-28T16:58:46.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3053913821 learned_addr learned my addr 172.21.15.26:0/3053913821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:46.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9b4f47640 1 --2- 172.21.15.26:0/3053913821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b0070260 0x7fb9b00706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3053913821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b0070260 msgr2=0x7fb9b00706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:46.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9af7fe640 1 --2- 172.21.15.26:0/3053913821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b0070260 0x7fb9b00706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3053913821 >> v1:172.21.15.79:6789/0 conn(0x7fb9b0154ea0 legacy=0x7fb9b014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.968+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3053913821 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b00c1230 con 0x7fb9b006b0c0 2023-11-28T16:58:46.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9af7fe640 1 --2- 172.21.15.26:0/3053913821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b006b0c0 0x7fb9b0155280 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009870 tx=0x7fb9a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7805aa8598313a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:46.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9aeffd640 1 -- 172.21.15.26:0/3053913821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40ab680 con 0x7fb9b006b0c0 2023-11-28T16:58:46.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9aeffd640 1 -- 172.21.15.26:0/3053913821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a40ab7e0 con 0x7fb9b006b0c0 2023-11-28T16:58:46.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9aeffd640 1 -- 172.21.15.26:0/3053913821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40abb70 con 0x7fb9b006b0c0 2023-11-28T16:58:46.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3053913821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b006b0c0 msgr2=0x7fb9b0155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3053913821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b006b0c0 0x7fb9b0155280 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009870 tx=0x7fb9a401c480 comp rx=0 tx=0).stop 2023-11-28T16:58:46.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3053913821 shutdown_connections 2023-11-28T16:58:46.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3053913821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b0070260 0x7fb9b00706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3053913821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b006b0c0 0x7fb9b0155280 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3053913821 >> 172.21.15.26:0/3053913821 conn(0x7fb9b006a5a0 msgr2=0x7fb9b006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:46.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3053913821 shutdown_connections 2023-11-28T16:58:46.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.972+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3053913821 wait complete. 2023-11-28T16:58:46.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 Processor -- start 2023-11-28T16:58:46.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 -- start start 2023-11-28T16:58:46.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b006b0c0 0x7fb9b014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b0070260 0x7fb9b0144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9b0154ea0 0x7fb9b01f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0148d90 con 0x7fb9b0070260 2023-11-28T16:58:46.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01ed970 con 0x7fb9b0154ea0 2023-11-28T16:58:46.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01ede00 con 0x7fb9b006b0c0 2023-11-28T16:58:46.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b0070260 0x7fb9b0144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b0070260 0x7fb9b0144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52120/0 (socket says 172.21.15.26:52120) 2023-11-28T16:58:46.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3018833870 learned_addr learned my addr 172.21.15.26:0/3018833870 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:46.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b4f47640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9b0154ea0 0x7fb9b01f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9affff640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b006b0c0 0x7fb9b014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b006b0c0 msgr2=0x7fb9b014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b006b0c0 0x7fb9b014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9b0154ea0 msgr2=0x7fb9b01f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:46.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9b0154ea0 0x7fb9b01f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:46.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 -- 172.21.15.26:0/3018833870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40094d0 con 0x7fb9b0070260 2023-11-28T16:58:46.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9af7fe640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b0070260 0x7fb9b0144a00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401a0b0 tx=0x7fb9a401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:46.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9acff9640 1 -- 172.21.15.26:0/3018833870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40b4800 con 0x7fb9b0070260 2023-11-28T16:58:46.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9acff9640 1 -- 172.21.15.26:0/3018833870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a40b4980 con 0x7fb9b0070260 2023-11-28T16:58:46.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b01ed040 con 0x7fb9b0070260 2023-11-28T16:58:46.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9acff9640 1 -- 172.21.15.26:0/3018833870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40b4d30 con 0x7fb9b0070260 2023-11-28T16:58:46.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.976+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b01ed600 con 0x7fb9b0070260 2023-11-28T16:58:46.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.980+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b00a98e0 con 0x7fb9b0070260 2023-11-28T16:58:46.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.980+0000 7fb9acff9640 1 -- 172.21.15.26:0/3018833870 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb9a40c7440 con 0x7fb9b0070260 2023-11-28T16:58:46.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.980+0000 7fb9acff9640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb99c066900 0x7fb99c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:46.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.980+0000 7fb9acff9640 1 -- 172.21.15.26:0/3018833870 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5445+0+0 (secure 0 0 0) 0x7fb9a411f1b0 con 0x7fb9b0070260 2023-11-28T16:58:46.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.980+0000 7fb9affff640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb99c066900 0x7fb99c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:46.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.980+0000 7fb9affff640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb99c066900 0x7fb99c068dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0007fd0 tx=0x7fb9a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:46.984+0000 7fb9acff9640 1 -- 172.21.15.26:0/3018833870 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9a40ec590 con 0x7fb9b0070260 2023-11-28T16:58:47.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.144+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9b004e890 con 0x7fb9b0070260 2023-11-28T16:58:47.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.792+0000 7fb9acff9640 1 -- 172.21.15.26:0/3018833870 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v60) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb9a40efbb0 con 0x7fb9b0070260 2023-11-28T16:58:47.797 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_data' removed 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb99c066900 msgr2=0x7fb99c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb99c066900 0x7fb99c068dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0007fd0 tx=0x7fb9a0009040 comp rx=0 tx=0).stop 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b0070260 msgr2=0x7fb9b0144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b0070260 0x7fb9b0144a00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401a0b0 tx=0x7fb9a401acc0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 shutdown_connections 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9b0154ea0 0x7fb9b01f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9b0070260 0x7fb9b0144a00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb99c066900 0x7fb99c068dc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 --2- 172.21.15.26:0/3018833870 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb9b006b0c0 0x7fb9b014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 >> 172.21.15.26:0/3018833870 conn(0x7fb9b006a5a0 msgr2=0x7fb9b00bf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:47.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.796+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 shutdown_connections 2023-11-28T16:58:47.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.800+0000 7fb9b69aa640 1 -- 172.21.15.26:0/3018833870 wait complete. 2023-11-28T16:58:47.828 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T16:58:47.914 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:58:47.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:58:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d76fe640 1 Processor -- start 2023-11-28T16:58:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d76fe640 1 -- start start 2023-11-28T16:58:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d76fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66d0070760 0x7f66d00701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d76fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d0071020 con 0x7f66d01561d0 2023-11-28T16:58:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d76fe640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d0071300 con 0x7f66d0158ff0 2023-11-28T16:58:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d76fe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00715e0 con 0x7f66d0070760 2023-11-28T16:58:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d549a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f66d01561d0 0x7f66d006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36182/0 (socket says 172.21.15.26:36182) 2023-11-28T16:58:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d549a640 1 -- 172.21.15.26:0/379544785 learned_addr learned my addr 172.21.15.26:0/379544785 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d4c99640 1 --2- 172.21.15.26:0/379544785 >> v2:172.21.15.79:3300/0 conn(0x7f66d0070760 0x7f66d00701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:47.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429805527 0 0) 0x7f66d0071020 con 0x7f66d01561d0 2023-11-28T16:58:47.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66bc003530 con 0x7f66d01561d0 2023-11-28T16:58:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236119125 0 0) 0x7f66d0071300 con 0x7f66d0158ff0 2023-11-28T16:58:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d0071020 con 0x7f66d0158ff0 2023-11-28T16:58:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d4c99640 1 -- 172.21.15.26:0/379544785 >> v1:172.21.15.79:6789/0 conn(0x7f66d0158ff0 legacy=0x7f66d0159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d4c99640 1 -- 172.21.15.26:0/379544785 >> v1:172.21.15.26:6789/0 conn(0x7f66d01561d0 legacy=0x7f66d006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2557818314 0 0) 0x7f66bc003530 con 0x7f66d01561d0 2023-11-28T16:58:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.972+0000 7f66d4c99640 1 -- 172.21.15.26:0/379544785 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d00718c0 con 0x7f66d0070760 2023-11-28T16:58:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d4c99640 1 --2- 172.21.15.26:0/379544785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d0070760 0x7f66d00701f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f66c00097c0 tx=0x7f66c001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=847fa9b120bef39e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc001680 con 0x7f66d0070760 2023-11-28T16:58:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c00a7050 con 0x7f66d0070760 2023-11-28T16:58:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66c7fff640 1 -- 172.21.15.26:0/379544785 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00ab620 con 0x7f66d0070760 2023-11-28T16:58:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d76fe640 1 -- 172.21.15.26:0/379544785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d0070760 msgr2=0x7f66d00701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d76fe640 1 --2- 172.21.15.26:0/379544785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d0070760 0x7f66d00701f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f66c00097c0 tx=0x7f66c001c310 comp rx=0 tx=0).stop 2023-11-28T16:58:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d76fe640 1 -- 172.21.15.26:0/379544785 shutdown_connections 2023-11-28T16:58:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d76fe640 1 --2- 172.21.15.26:0/379544785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d0070760 0x7f66d00701f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d76fe640 1 -- 172.21.15.26:0/379544785 >> 172.21.15.26:0/379544785 conn(0x7f66d00c2a60 msgr2=0x7f66d00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d76fe640 1 -- 172.21.15.26:0/379544785 shutdown_connections 2023-11-28T16:58:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.976+0000 7f66d76fe640 1 -- 172.21.15.26:0/379544785 wait complete. 2023-11-28T16:58:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 Processor -- start 2023-11-28T16:58:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 -- start start 2023-11-28T16:58:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66d0070760 0x7f66d00a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d01561d0 0x7f66d0148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d0158ff0 0x7f66d00c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d015cd20 con 0x7f66d0158ff0 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00aa470 con 0x7f66d01561d0 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d01f4640 con 0x7f66d0070760 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d5c9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d0158ff0 0x7f66d00c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d4c99640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d01561d0 0x7f66d0148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d549a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66d0070760 0x7f66d00a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d5c9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d0158ff0 0x7f66d00c4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52132/0 (socket says 172.21.15.26:52132) 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d5c9b640 1 -- 172.21.15.26:0/2102161241 learned_addr learned my addr 172.21.15.26:0/2102161241 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d4c99640 1 -- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66d0070760 msgr2=0x7f66d00a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d4c99640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66d0070760 0x7f66d00a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d4c99640 1 -- 172.21.15.26:0/2102161241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d0158ff0 msgr2=0x7f66d00c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d4c99640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d0158ff0 0x7f66d00c4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d4c99640 1 -- 172.21.15.26:0/2102161241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009420 con 0x7f66d01561d0 2023-11-28T16:58:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d5c9b640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d0158ff0 0x7f66d00c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d4c99640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d01561d0 0x7f66d0148b00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f66d00743b0 tx=0x7f66c001ab50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66c5ffb640 1 -- 172.21.15.26:0/2102161241 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00b7450 con 0x7f66d01561d0 2023-11-28T16:58:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66c5ffb640 1 -- 172.21.15.26:0/2102161241 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c00b75b0 con 0x7f66d01561d0 2023-11-28T16:58:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66c5ffb640 1 -- 172.21.15.26:0/2102161241 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00b7940 con 0x7f66d01561d0 2023-11-28T16:58:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d01f4ee0 con 0x7f66d01561d0 2023-11-28T16:58:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.980+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d01f4890 con 0x7f66d01561d0 2023-11-28T16:58:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.984+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d01f5070 con 0x7f66d01561d0 2023-11-28T16:58:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.984+0000 7f66c5ffb640 1 -- 172.21.15.26:0/2102161241 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f66c00b7aa0 con 0x7f66d01561d0 2023-11-28T16:58:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.984+0000 7f66c5ffb640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66b40668d0 0x7f66b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.984+0000 7f66c5ffb640 1 -- 172.21.15.26:0/2102161241 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f66c011e8d0 con 0x7f66d01561d0 2023-11-28T16:58:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.984+0000 7f66d549a640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66b40668d0 0x7f66b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.984+0000 7f66d549a640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66b40668d0 0x7f66b4068d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66cc001ec0 tx=0x7f66cc000fa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:47.988+0000 7f66c5ffb640 1 -- 172.21.15.26:0/2102161241 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66c00ebf70 con 0x7f66d01561d0 2023-11-28T16:58:48.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.152+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f66d00c07e0 con 0x7f66d01561d0 2023-11-28T16:58:48.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66c5ffb640 1 -- 172.21.15.26:0/2102161241 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f66c00ef590 con 0x7f66d01561d0 2023-11-28T16:58:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66b40668d0 msgr2=0x7f66b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66b40668d0 0x7f66b4068d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66cc001ec0 tx=0x7f66cc000fa0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d01561d0 msgr2=0x7f66d0148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d01561d0 0x7f66d0148b00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f66d00743b0 tx=0x7f66c001ab50 comp rx=0 tx=0).stop 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 shutdown_connections 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d0158ff0 0x7f66d00c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66d01561d0 0x7f66d0148b00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f66b40668d0 0x7f66b4068d90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 --2- 172.21.15.26:0/2102161241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66d0070760 0x7f66d00a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 >> 172.21.15.26:0/2102161241 conn(0x7f66d00c2a60 msgr2=0x7f66d01580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 shutdown_connections 2023-11-28T16:58:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.160+0000 7f66d76fe640 1 -- 172.21.15.26:0/2102161241 wait complete. 2023-11-28T16:58:48.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-28T16:58:48.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a63417640 1 Processor -- start 2023-11-28T16:58:48.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a63417640 1 -- start start 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a63417640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a63417640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a5c0c4890 0x7f1a5c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a63417640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c06b7d0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a63417640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c155160 con 0x7f1a5c0c4890 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a63417640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c06b180 con 0x7f1a5c0ca620 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a62c16640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1a5c0bd5a0 0x7f1a5c0c8450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36192/0 (socket says 172.21.15.26:36192) 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a62c16640 1 -- 172.21.15.26:0/3524240165 learned_addr learned my addr 172.21.15.26:0/3524240165 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a62415640 1 --2- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a61c14640 1 --2- 172.21.15.26:0/3524240165 >> v2:172.21.15.79:3300/0 conn(0x7f1a5c0c4890 0x7f1a5c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a61413640 1 -- 172.21.15.26:0/3524240165 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821711892 0 0) 0x7f1a5c06b7d0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a61413640 1 -- 172.21.15.26:0/3524240165 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a48003530 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a61c14640 1 -- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 msgr2=0x7f1a5c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a61c14640 1 --2- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a61c14640 1 -- 172.21.15.26:0/3524240165 >> v1:172.21.15.26:6789/0 conn(0x7f1a5c0bd5a0 legacy=0x7f1a5c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a61c14640 1 -- 172.21.15.26:0/3524240165 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c06b460 con 0x7f1a5c0c4890 2023-11-28T16:58:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.368+0000 7f1a62415640 1 --2- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a61c14640 1 --2- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c0c7f10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0097c0 tx=0x7f1a4c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78417c77c5a12649 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a61413640 1 -- 172.21.15.26:0/3524240165 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0ab600 con 0x7f1a5c0c4890 2023-11-28T16:58:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a61413640 1 -- 172.21.15.26:0/3524240165 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0a7050 con 0x7f1a5c0c4890 2023-11-28T16:58:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a61413640 1 -- 172.21.15.26:0/3524240165 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0ab980 con 0x7f1a5c0c4890 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 -- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 msgr2=0x7f1a5c0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 --2- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c0c7f10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0097c0 tx=0x7f1a4c01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 -- 172.21.15.26:0/3524240165 shutdown_connections 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 --2- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c0c7f10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 --2- 172.21.15.26:0/3524240165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 -- 172.21.15.26:0/3524240165 >> 172.21.15.26:0/3524240165 conn(0x7f1a5c0ac0a0 msgr2=0x7f1a5c0c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 -- 172.21.15.26:0/3524240165 shutdown_connections 2023-11-28T16:58:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.372+0000 7f1a63417640 1 -- 172.21.15.26:0/3524240165 wait complete. 2023-11-28T16:58:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 Processor -- start 2023-11-28T16:58:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 -- start start 2023-11-28T16:58:48.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a5c0bd5a0 0x7f1a5c0c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c1ed2b0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c156660 con 0x7f1a5c0c4890 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c1ecc60 con 0x7f1a5c0ca620 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a5c0bd5a0 0x7f1a5c0c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a5c0bd5a0 0x7f1a5c0c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52142/0 (socket says 172.21.15.26:52142) 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 -- 172.21.15.26:0/2267406701 learned_addr learned my addr 172.21.15.26:0/2267406701 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a61c14640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62c16640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 -- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 msgr2=0x7f1a5c14e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c14e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 -- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 msgr2=0x7f1a5c14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 -- 172.21.15.26:0/2267406701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a58009420 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a61c14640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a62415640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a5c0bd5a0 0x7f1a5c0c3780 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ebe0 tx=0x7f1a5800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a52ffd640 1 -- 172.21.15.26:0/2267406701 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800eee0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a52ffd640 1 -- 172.21.15.26:0/2267406701 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5800cc30 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a52ffd640 1 -- 172.21.15.26:0/2267406701 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58013470 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c009420 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c158930 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.376+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c04e890 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.380+0000 7f1a52ffd640 1 -- 172.21.15.26:0/2267406701 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1a580135d0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.380+0000 7f1a52ffd640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1a40066900 0x7f1a40068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.380+0000 7f1a52ffd640 1 -- 172.21.15.26:0/2267406701 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1a580844b0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.380+0000 7f1a61c14640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1a40066900 0x7f1a40068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.380+0000 7f1a61c14640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1a40066900 0x7f1a40068dc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0c98b0 tx=0x7f1a4c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.384+0000 7f1a52ffd640 1 -- 172.21.15.26:0/2267406701 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a58051980 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.596+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f1a5c0c98e0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a52ffd640 1 -- 172.21.15.26:0/2267406701 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v165) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1a58054fa0 con 0x7f1a5c0bd5a0 2023-11-28T16:58:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1a40066900 msgr2=0x7f1a40068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1a40066900 0x7f1a40068dc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0c98b0 tx=0x7f1a4c0a6000 comp rx=0 tx=0).stop 2023-11-28T16:58:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a5c0bd5a0 msgr2=0x7f1a5c0c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a5c0bd5a0 0x7f1a5c0c3780 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ebe0 tx=0x7f1a5800c520 comp rx=0 tx=0).stop 2023-11-28T16:58:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 shutdown_connections 2023-11-28T16:58:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1a40066900 0x7f1a40068dc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a5c0ca620 0x7f1a5c14e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5c0c4890 0x7f1a5c14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 --2- 172.21.15.26:0/2267406701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a5c0bd5a0 0x7f1a5c0c3780 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 >> 172.21.15.26:0/2267406701 conn(0x7f1a5c0ac0a0 msgr2=0x7f1a5c153050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 shutdown_connections 2023-11-28T16:58:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.796+0000 7f1a63417640 1 -- 172.21.15.26:0/2267406701 wait complete. 2023-11-28T16:58:48.821 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-28T16:58:48.821 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T16:58:48.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:48.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.960+0000 7f95d0b8d640 1 Processor -- start 2023-11-28T16:58:48.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.960+0000 7f95d0b8d640 1 -- start start 2023-11-28T16:58:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95d0b8d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95cc14e9d0 0x7f95cc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95d0b8d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc06d320 con 0x7f95cc070b80 2023-11-28T16:58:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95d0b8d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc0721b0 con 0x7f95cc0a8470 2023-11-28T16:58:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95d0b8d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0c2830 con 0x7f95cc14e9d0 2023-11-28T16:58:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f95cc070b80 0x7f95cc0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36204/0 (socket says 172.21.15.26:36204) 2023-11-28T16:58:48.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 -- 172.21.15.26:0/726188840 learned_addr learned my addr 172.21.15.26:0/726188840 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:48.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401262674 0 0) 0x7f95cc06d320 con 0x7f95cc070b80 2023-11-28T16:58:48.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b8005740 con 0x7f95cc070b80 2023-11-28T16:58:48.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95ca59c640 1 --2- 172.21.15.26:0/726188840 >> v2:172.21.15.79:3300/0 conn(0x7f95cc14e9d0 0x7f95cc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1918618205 0 0) 0x7f95b8005740 con 0x7f95cc070b80 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 >> v2:172.21.15.79:3300/0 conn(0x7f95cc14e9d0 msgr2=0x7f95cc151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 --2- 172.21.15.26:0/726188840 >> v2:172.21.15.79:3300/0 conn(0x7f95cc14e9d0 0x7f95cc151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 >> v1:172.21.15.79:6789/0 conn(0x7f95cc0a8470 legacy=0x7f95cc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc072450 con 0x7f95cc070b80 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f95b4001680 con 0x7f95cc070b80 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95ca59c640 1 --2- 172.21.15.26:0/726188840 >> v2:172.21.15.79:3300/0 conn(0x7f95cc14e9d0 0x7f95cc151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 >> v1:172.21.15.26:6789/0 conn(0x7f95cc070b80 legacy=0x7f95cc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b8005be0 0x7f95b8006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95b80069e0 0x7f95b8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80074c0 0x7f95b800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0c2830 con 0x7f95b80069e0 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b800e3e0 con 0x7f95b8005be0 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b800e5a0 con 0x7f95b80074c0 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95b80069e0 0x7f95b8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95ca59c640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b8005be0 0x7f95b8006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95cad9d640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80074c0 0x7f95b800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 -- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80074c0 msgr2=0x7f95b800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80074c0 0x7f95b800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 -- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b8005be0 msgr2=0x7f95b8006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b8005be0 0x7f95b8006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95cad9d640 1 -- 172.21.15.26:0/726188840 reap_dead start 2023-11-28T16:58:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.964+0000 7f95c3fff640 1 -- 172.21.15.26:0/726188840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8005740 con 0x7f95b80069e0 2023-11-28T16:58:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95c3fff640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95b80069e0 0x7f95b8006e60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f95b4007fc0 tx=0x7f95b401cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1265227611deaca1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40058e0 con 0x7f95b80069e0 2023-11-28T16:58:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4005a40 con 0x7f95b80069e0 2023-11-28T16:58:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95c9d9b640 1 -- 172.21.15.26:0/726188840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4005df0 con 0x7f95b80069e0 2023-11-28T16:58:48.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95d0b8d640 1 -- 172.21.15.26:0/726188840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95b80069e0 msgr2=0x7f95b8006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95b80069e0 0x7f95b8006e60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f95b4007fc0 tx=0x7f95b401cb00 comp rx=0 tx=0).stop 2023-11-28T16:58:48.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95d0b8d640 1 -- 172.21.15.26:0/726188840 shutdown_connections 2023-11-28T16:58:48.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/726188840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95b80069e0 0x7f95b8006e60 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95d0b8d640 1 -- 172.21.15.26:0/726188840 >> 172.21.15.26:0/726188840 conn(0x7f95cc0c2ad0 msgr2=0x7f95cc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:48.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95d0b8d640 1 -- 172.21.15.26:0/726188840 shutdown_connections 2023-11-28T16:58:48.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.968+0000 7f95d0b8d640 1 -- 172.21.15.26:0/726188840 wait complete. 2023-11-28T16:58:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 Processor -- start 2023-11-28T16:58:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 -- start start 2023-11-28T16:58:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80069e0 0x7f95cc0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc1f07e0 0x7f95cc1ece50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95cc154310 0x7f95cc1ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc153220 con 0x7f95cc1f07e0 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc1eca00 con 0x7f95cc154310 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc1f0c70 con 0x7f95b80069e0 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc1f07e0 0x7f95cc1ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc1f07e0 0x7f95cc1ece50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52162/0 (socket says 172.21.15.26:52162) 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 -- 172.21.15.26:0/3579924201 learned_addr learned my addr 172.21.15.26:0/3579924201 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95ca59c640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80069e0 0x7f95cc0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95cad9d640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95cc154310 0x7f95cc1ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 -- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80069e0 msgr2=0x7f95cc0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80069e0 0x7f95cc0711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 -- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95cc154310 msgr2=0x7f95cc1ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95cc154310 0x7f95cc1ed390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 -- 172.21.15.26:0/3579924201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc152740 con 0x7f95cc1f07e0 2023-11-28T16:58:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c3fff640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc1f07e0 0x7f95cc1ece50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f95b40983f0 tx=0x7f95b8007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c2ffd640 1 -- 172.21.15.26:0/3579924201 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40b4070 con 0x7f95cc1f07e0 2023-11-28T16:58:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c2ffd640 1 -- 172.21.15.26:0/3579924201 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4001480 con 0x7f95cc1f07e0 2023-11-28T16:58:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc152a20 con 0x7f95cc1f07e0 2023-11-28T16:58:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95c2ffd640 1 -- 172.21.15.26:0/3579924201 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4005dd0 con 0x7f95cc1f07e0 2023-11-28T16:58:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc152d00 con 0x7f95cc1f07e0 2023-11-28T16:58:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.972+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc067a40 con 0x7f95cc1f07e0 2023-11-28T16:58:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.976+0000 7f95c2ffd640 1 -- 172.21.15.26:0/3579924201 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f95b40a5ba0 con 0x7f95cc1f07e0 2023-11-28T16:58:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.976+0000 7f95c2ffd640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95ac0668d0 0x7f95ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.976+0000 7f95c2ffd640 1 -- 172.21.15.26:0/3579924201 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f95b411d590 con 0x7f95cc1f07e0 2023-11-28T16:58:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.976+0000 7f95ca59c640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95ac0668d0 0x7f95ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.976+0000 7f95ca59c640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95ac0668d0 0x7f95ac068d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0682a0 tx=0x7f95bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:48.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:48.980+0000 7f95c2ffd640 1 -- 172.21.15.26:0/3579924201 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95b40eaa80 con 0x7f95cc1f07e0 2023-11-28T16:58:49.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.136+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95cc1ecb70 con 0x7f95cc1f07e0 2023-11-28T16:58:49.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.136+0000 7f95c2ffd640 1 -- 172.21.15.26:0/3579924201 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13041 (secure 0 0 0) 0x7f95cc1ecb70 con 0x7f95cc1f07e0 2023-11-28T16:58:49.140 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:49.140 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":60,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:47.793974+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6833/50257293":"2023-11-29T16:58:44.787148+0000","172.21.15.26:6832/50257293":"2023-11-29T16:58:44.787148+0000","172.21.15.26:6835/3225309020":"2023-11-29T16:58:35.732005+0000","172.21.15.26:6834/3225309020":"2023-11-29T16:58:35.732005+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:49.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95ac0668d0 msgr2=0x7f95ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95ac0668d0 0x7f95ac068d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0682a0 tx=0x7f95bc008040 comp rx=0 tx=0).stop 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc1f07e0 msgr2=0x7f95cc1ece50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc1f07e0 0x7f95cc1ece50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f95b40983f0 tx=0x7f95b8007a10 comp rx=0 tx=0).stop 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 shutdown_connections 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95cc154310 0x7f95cc1ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc1f07e0 0x7f95cc1ece50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95ac0668d0 0x7f95ac068d90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 --2- 172.21.15.26:0/3579924201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95b80069e0 0x7f95cc0711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 >> 172.21.15.26:0/3579924201 conn(0x7f95cc0c2ad0 msgr2=0x7f95cc14c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 shutdown_connections 2023-11-28T16:58:49.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.140+0000 7f95d0b8d640 1 -- 172.21.15.26:0/3579924201 wait complete. 2023-11-28T16:58:49.162 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:49.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:49.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744ced6640 1 Processor -- start 2023-11-28T16:58:49.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744ced6640 1 -- start start 2023-11-28T16:58:49.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744ced6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74480700f0 0x7f7448070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744ced6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7448071be0 con 0x7f7448154000 2023-11-28T16:58:49.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744ced6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7448154b90 con 0x7f744806df30 2023-11-28T16:58:49.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744ced6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480a8710 con 0x7f74480700f0 2023-11-28T16:58:49.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7448154000 0x7f74481543e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36214/0 (socket says 172.21.15.26:36214) 2023-11-28T16:58:49.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f744659c640 1 -- 172.21.15.26:0/630095055 learned_addr learned my addr 172.21.15.26:0/630095055 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:49.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f743ffff640 1 --2- 172.21.15.26:0/630095055 >> v2:172.21.15.26:3300/0 conn(0x7f74480700f0 0x7f7448070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.304+0000 7f7445d9b640 1 -- 172.21.15.26:0/630095055 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754659059 0 0) 0x7f7448071be0 con 0x7f7448154000 2023-11-28T16:58:49.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f7445d9b640 1 -- 172.21.15.26:0/630095055 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7434003530 con 0x7f7448154000 2023-11-28T16:58:49.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f743ffff640 1 -- 172.21.15.26:0/630095055 >> v1:172.21.15.79:6789/0 conn(0x7f744806df30 legacy=0x7f74480714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f743ffff640 1 -- 172.21.15.26:0/630095055 >> v1:172.21.15.26:6789/0 conn(0x7f7448154000 legacy=0x7f74481543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f743ffff640 1 -- 172.21.15.26:0/630095055 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480abd70 con 0x7f74480700f0 2023-11-28T16:58:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f743ffff640 1 --2- 172.21.15.26:0/630095055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74480700f0 0x7f7448070f90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b9333de0c55a29 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f7445d9b640 1 -- 172.21.15.26:0/630095055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300a7610 con 0x7f74480700f0 2023-11-28T16:58:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f7445d9b640 1 -- 172.21.15.26:0/630095055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300a7770 con 0x7f74480700f0 2023-11-28T16:58:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f7445d9b640 1 -- 172.21.15.26:0/630095055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300a7b00 con 0x7f74480700f0 2023-11-28T16:58:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f744ced6640 1 -- 172.21.15.26:0/630095055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74480700f0 msgr2=0x7f7448070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f744ced6640 1 --2- 172.21.15.26:0/630095055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74480700f0 0x7f7448070f90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001d590 comp rx=0 tx=0).stop 2023-11-28T16:58:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f744ced6640 1 -- 172.21.15.26:0/630095055 shutdown_connections 2023-11-28T16:58:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f744ced6640 1 --2- 172.21.15.26:0/630095055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74480700f0 0x7f7448070f90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f744ced6640 1 -- 172.21.15.26:0/630095055 >> 172.21.15.26:0/630095055 conn(0x7f74480c2a60 msgr2=0x7f74480c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f744ced6640 1 -- 172.21.15.26:0/630095055 shutdown_connections 2023-11-28T16:58:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.308+0000 7f744ced6640 1 -- 172.21.15.26:0/630095055 wait complete. 2023-11-28T16:58:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 Processor -- start 2023-11-28T16:58:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 -- start start 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744806df30 0x7f7448149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74480700f0 0x7f74481522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7448154000 0x7f7448152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c3b30 con 0x7f7448154000 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74481eba90 con 0x7f744806df30 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7448148540 con 0x7f74480700f0 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7448154000 0x7f7448152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7448154000 0x7f7448152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52182/0 (socket says 172.21.15.26:52182) 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 -- 172.21.15.26:0/3297593295 learned_addr learned my addr 172.21.15.26:0/3297593295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744659c640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744806df30 0x7f7448149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f743ffff640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74480700f0 0x7f74481522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 -- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74480700f0 msgr2=0x7f74481522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74480700f0 0x7f74481522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 -- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744806df30 msgr2=0x7f7448149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744806df30 0x7f7448149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 -- 172.21.15.26:0/3297593295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009420 con 0x7f7448154000 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f7446d9d640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7448154000 0x7f7448152820 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f744000c730 tx=0x7f744000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f743effd640 1 -- 172.21.15.26:0/3297593295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440003b80 con 0x7f7448154000 2023-11-28T16:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f743effd640 1 -- 172.21.15.26:0/3297593295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440003ce0 con 0x7f7448154000 2023-11-28T16:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f743effd640 1 -- 172.21.15.26:0/3297593295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000aa30 con 0x7f7448154000 2023-11-28T16:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.312+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7448148820 con 0x7f7448154000 2023-11-28T16:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.316+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7448151dc0 con 0x7f7448154000 2023-11-28T16:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.316+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744804e890 con 0x7f7448154000 2023-11-28T16:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.316+0000 7f743effd640 1 -- 172.21.15.26:0/3297593295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f744000ab90 con 0x7f7448154000 2023-11-28T16:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.316+0000 7f743effd640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74280668d0 0x7f7428068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.316+0000 7f743effd640 1 -- 172.21.15.26:0/3297593295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7440083fd0 con 0x7f7448154000 2023-11-28T16:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.316+0000 7f744659c640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74280668d0 0x7f7428068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.316+0000 7f744659c640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74280668d0 0x7f7428068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f74380011f0 tx=0x7f7438009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.320+0000 7f743effd640 1 -- 172.21.15.26:0/3297593295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74400514a0 con 0x7f7448154000 2023-11-28T16:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.480+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7448151fb0 con 0x7f7448154000 2023-11-28T16:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.480+0000 7f743effd640 1 -- 172.21.15.26:0/3297593295 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7440054ac0 con 0x7f7448154000 2023-11-28T16:58:49.489 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74280668d0 msgr2=0x7f7428068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74280668d0 0x7f7428068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f74380011f0 tx=0x7f7438009040 comp rx=0 tx=0).stop 2023-11-28T16:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7448154000 msgr2=0x7f7448152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7448154000 0x7f7448152820 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f744000c730 tx=0x7f744000cbf0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 shutdown_connections 2023-11-28T16:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7448154000 0x7f7448152820 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74280668d0 0x7f7428068d90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74480700f0 0x7f74481522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 --2- 172.21.15.26:0/3297593295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744806df30 0x7f7448149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 >> 172.21.15.26:0/3297593295 conn(0x7f74480c2a60 msgr2=0x7f7448151290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 shutdown_connections 2023-11-28T16:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.484+0000 7f744ced6640 1 -- 172.21.15.26:0/3297593295 wait complete. 2023-11-28T16:58:49.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-28T16:58:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fed3d8640 1 Processor -- start 2023-11-28T16:58:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fed3d8640 1 -- start start 2023-11-28T16:58:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fed3d8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fe80ca610 0x7f2fe80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fed3d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fed3d8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe8155790 con 0x7f2fe80bd720 2023-11-28T16:58:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fed3d8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80c4b00 con 0x7f2fe80ca610 2023-11-28T16:58:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fed3d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80c4de0 con 0x7f2fe806cd90 2023-11-28T16:58:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fe80ca610 0x7f2fe80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fe80ca610 0x7f2fe80c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52190/0 (socket says 172.21.15.26:52190) 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe6ffd640 1 -- 172.21.15.26:0/105449284 learned_addr learned my addr 172.21.15.26:0/105449284 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe77fe640 1 --2- 172.21.15.26:0/105449284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe6ffd640 1 -- 172.21.15.26:0/105449284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 msgr2=0x7f2fe80c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe6ffd640 1 --2- 172.21.15.26:0/105449284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe6ffd640 1 -- 172.21.15.26:0/105449284 >> v1:172.21.15.79:6789/0 conn(0x7f2fe80bd720 legacy=0x7f2fe8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe6ffd640 1 -- 172.21.15.26:0/105449284 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8157e30 con 0x7f2fe80ca610 2023-11-28T16:58:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.648+0000 7f2fe77fe640 1 --2- 172.21.15.26:0/105449284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:58:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fe6ffd640 1 --2- 172.21.15.26:0/105449284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80c94c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd801c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2359d1882e2fd0df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fe67fc640 1 -- 172.21.15.26:0/105449284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80c52d0 con 0x7f2fe80ca610 2023-11-28T16:58:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fe67fc640 1 -- 172.21.15.26:0/105449284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80a4940 con 0x7f2fe80ca610 2023-11-28T16:58:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fe67fc640 1 -- 172.21.15.26:0/105449284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80a4cd0 con 0x7f2fe80ca610 2023-11-28T16:58:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 -- 172.21.15.26:0/105449284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 msgr2=0x7f2fe80c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/105449284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80c94c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd801c100 comp rx=0 tx=0).stop 2023-11-28T16:58:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 -- 172.21.15.26:0/105449284 shutdown_connections 2023-11-28T16:58:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/105449284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/105449284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80c94c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 -- 172.21.15.26:0/105449284 >> 172.21.15.26:0/105449284 conn(0x7f2fe8071ea0 msgr2=0x7f2fe80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 -- 172.21.15.26:0/105449284 shutdown_connections 2023-11-28T16:58:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.652+0000 7f2fed3d8640 1 -- 172.21.15.26:0/105449284 wait complete. 2023-11-28T16:58:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 Processor -- start 2023-11-28T16:58:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 -- start start 2023-11-28T16:58:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fe80bd720 0x7f2fe814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80af260 con 0x7f2fe80ca610 2023-11-28T16:58:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80a9ca0 con 0x7f2fe80bd720 2023-11-28T16:58:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80aed30 con 0x7f2fe806cd90 2023-11-28T16:58:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52204/0 (socket says 172.21.15.26:52204) 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 -- 172.21.15.26:0/3127703081 learned_addr learned my addr 172.21.15.26:0/3127703081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe6ffd640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fdffff640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fe80bd720 0x7f2fe814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 -- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 msgr2=0x7f2fe80abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 -- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fe80bd720 msgr2=0x7f2fe814cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fe80bd720 0x7f2fe814cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 -- 172.21.15.26:0/3127703081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80094d0 con 0x7f2fe80ca610 2023-11-28T16:58:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fdffff640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fe80bd720 0x7f2fe814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fe77fe640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80aa130 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000cef0 tx=0x7f2fe000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fdf7fe640 1 -- 172.21.15.26:0/3127703081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000d840 con 0x7f2fe80ca610 2023-11-28T16:58:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fdf7fe640 1 -- 172.21.15.26:0/3127703081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe000d9c0 con 0x7f2fe80ca610 2023-11-28T16:58:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fdf7fe640 1 -- 172.21.15.26:0/3127703081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000dd70 con 0x7f2fe80ca610 2023-11-28T16:58:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80ac210 con 0x7f2fe80ca610 2023-11-28T16:58:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.656+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80aef80 con 0x7f2fe80ca610 2023-11-28T16:58:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.660+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe80a9a70 con 0x7f2fe80ca610 2023-11-28T16:58:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.660+0000 7f2fdf7fe640 1 -- 172.21.15.26:0/3127703081 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2fe001e3b0 con 0x7f2fe80ca610 2023-11-28T16:58:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.660+0000 7f2fdf7fe640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc8066900 0x7f2fc8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.660+0000 7f2fdf7fe640 1 -- 172.21.15.26:0/3127703081 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2fe0084b70 con 0x7f2fe80ca610 2023-11-28T16:58:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.660+0000 7f2fe6ffd640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc8066900 0x7f2fc8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.664+0000 7f2fe6ffd640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc8066900 0x7f2fc8068dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ae000 tx=0x7f2fd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:49.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.664+0000 7f2fdf7fe640 1 -- 172.21.15.26:0/3127703081 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fe80a9a70 con 0x7f2fe80ca610 2023-11-28T16:58:49.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:49.876+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f2fe80a9a70 con 0x7f2fe80ca610 2023-11-28T16:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fdf7fe640 1 -- 172.21.15.26:0/3127703081 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v167) v1 ==== 162+0+0 (secure 0 0 0) 0x7f2fe80a9a70 con 0x7f2fe80ca610 2023-11-28T16:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc8066900 msgr2=0x7f2fc8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc8066900 0x7f2fc8068dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ae000 tx=0x7f2fd8009040 comp rx=0 tx=0).stop 2023-11-28T16:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 msgr2=0x7f2fe80aa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80aa130 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000cef0 tx=0x7f2fe000a710 comp rx=0 tx=0).stop 2023-11-28T16:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 shutdown_connections 2023-11-28T16:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe80ca610 0x7f2fe80aa130 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fe80bd720 0x7f2fe814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2fc8066900 0x7f2fc8068dc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 --2- 172.21.15.26:0/3127703081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fe806cd90 0x7f2fe80abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.804+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 >> 172.21.15.26:0/3127703081 conn(0x7f2fe8071ea0 msgr2=0x7f2fe80c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.808+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 shutdown_connections 2023-11-28T16:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.808+0000 7f2fed3d8640 1 -- 172.21.15.26:0/3127703081 wait complete. 2023-11-28T16:58:50.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T16:58:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e59879640 1 Processor -- start 2023-11-28T16:58:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e59879640 1 -- start start 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e59879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e54072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e59879640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e540c09c0 0x7f5e540c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e59879640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e541522c0 con 0x7f5e540c1ae0 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e59879640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e54072870 con 0x7f5e540c09c0 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e59879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54155040 con 0x7f5e54151ee0 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.980+0000 7f5e537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e540c09c0 0x7f5e540c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e540c09c0 0x7f5e540c0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52212/0 (socket says 172.21.15.26:52212) 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e537fe640 1 -- 172.21.15.26:0/3682020251 learned_addr learned my addr 172.21.15.26:0/3682020251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e52ffd640 1 --2- 172.21.15.26:0/3682020251 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e54072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e527fc640 1 -- 172.21.15.26:0/3682020251 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198423997 0 0) 0x7f5e541522c0 con 0x7f5e540c1ae0 2023-11-28T16:58:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e537fe640 1 -- 172.21.15.26:0/3682020251 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 msgr2=0x7f5e54072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e537fe640 1 --2- 172.21.15.26:0/3682020251 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e54072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e537fe640 1 -- 172.21.15.26:0/3682020251 >> v1:172.21.15.79:6789/0 conn(0x7f5e540c1ae0 legacy=0x7f5e5406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e537fe640 1 -- 172.21.15.26:0/3682020251 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e541555c0 con 0x7f5e540c09c0 2023-11-28T16:58:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e537fe640 1 --2- 172.21.15.26:0/3682020251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e540c0e30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009e50 tx=0x7f5e4c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a319d21d5c1e97a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e527fc640 1 -- 172.21.15.26:0/3682020251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0a5840 con 0x7f5e540c09c0 2023-11-28T16:58:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e527fc640 1 -- 172.21.15.26:0/3682020251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c0a59a0 con 0x7f5e540c09c0 2023-11-28T16:58:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.984+0000 7f5e527fc640 1 -- 172.21.15.26:0/3682020251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0a5d30 con 0x7f5e540c09c0 2023-11-28T16:58:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- 172.21.15.26:0/3682020251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 msgr2=0x7f5e540c0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 --2- 172.21.15.26:0/3682020251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e540c0e30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009e50 tx=0x7f5e4c01c980 comp rx=0 tx=0).stop 2023-11-28T16:58:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- 172.21.15.26:0/3682020251 shutdown_connections 2023-11-28T16:58:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 --2- 172.21.15.26:0/3682020251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e540c0e30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 --2- 172.21.15.26:0/3682020251 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e54072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- 172.21.15.26:0/3682020251 >> 172.21.15.26:0/3682020251 conn(0x7f5e540c3b70 msgr2=0x7f5e540c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- 172.21.15.26:0/3682020251 shutdown_connections 2023-11-28T16:58:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- 172.21.15.26:0/3682020251 wait complete. 2023-11-28T16:58:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 Processor -- start 2023-11-28T16:58:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- start start 2023-11-28T16:58:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e541ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e540c1ae0 0x7f5e5414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e541ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54152480 con 0x7f5e540c09c0 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e541edd30 con 0x7f5e540c1ae0 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e59879640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54152ce0 con 0x7f5e54151ee0 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e541ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e541ed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52218/0 (socket says 172.21.15.26:52218) 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 -- 172.21.15.26:0/1661794942 learned_addr learned my addr 172.21.15.26:0/1661794942 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e537fe640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e541ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e4bfff640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e540c1ae0 0x7f5e5414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 -- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 msgr2=0x7f5e541ee1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e541ee1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 -- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e540c1ae0 msgr2=0x7f5e5414e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e540c1ae0 0x7f5e5414e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.988+0000 7f5e52ffd640 1 -- 172.21.15.26:0/1661794942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c009b30 con 0x7f5e540c09c0 2023-11-28T16:58:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e52ffd640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e541ed7f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400e870 tx=0x7f5e4400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e50ff9640 1 -- 172.21.15.26:0/1661794942 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44009510 con 0x7f5e540c09c0 2023-11-28T16:58:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e50ff9640 1 -- 172.21.15.26:0/1661794942 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400eec0 con 0x7f5e540c09c0 2023-11-28T16:58:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e50ff9640 1 -- 172.21.15.26:0/1661794942 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400cb40 con 0x7f5e540c09c0 2023-11-28T16:58:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e54154380 con 0x7f5e540c09c0 2023-11-28T16:58:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e54152970 con 0x7f5e540c09c0 2023-11-28T16:58:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5404e890 con 0x7f5e540c09c0 2023-11-28T16:58:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e50ff9640 1 -- 172.21.15.26:0/1661794942 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5e4400cca0 con 0x7f5e540c09c0 2023-11-28T16:58:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e50ff9640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5e34066900 0x7f5e34068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e50ff9640 1 -- 172.21.15.26:0/1661794942 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5e44084130 con 0x7f5e540c09c0 2023-11-28T16:58:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.992+0000 7f5e4bfff640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5e34066900 0x7f5e34068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.996+0000 7f5e4bfff640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5e34066900 0x7f5e34068dc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c000f70 tx=0x7f5e3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:50.996+0000 7f5e50ff9640 1 -- 172.21.15.26:0/1661794942 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e44051750 con 0x7f5e540c09c0 2023-11-28T16:58:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.152+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5e5406eeb0 con 0x7f5e540c09c0 2023-11-28T16:58:51.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e50ff9640 1 -- 172.21.15.26:0/1661794942 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e44054d70 con 0x7f5e540c09c0 2023-11-28T16:58:51.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5e34066900 msgr2=0x7f5e34068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5e34066900 0x7f5e34068dc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c000f70 tx=0x7f5e3c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:51.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 msgr2=0x7f5e541ed7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e541ed7f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400e870 tx=0x7f5e4400ec70 comp rx=0 tx=0).stop 2023-11-28T16:58:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 shutdown_connections 2023-11-28T16:58:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5e34066900 0x7f5e34068dc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e54151ee0 0x7f5e541ee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e540c1ae0 0x7f5e5414e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 --2- 172.21.15.26:0/1661794942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e540c09c0 0x7f5e541ed7f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 >> 172.21.15.26:0/1661794942 conn(0x7f5e540c3b70 msgr2=0x7f5e5406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 shutdown_connections 2023-11-28T16:58:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.160+0000 7f5e59879640 1 -- 172.21.15.26:0/1661794942 wait complete. 2023-11-28T16:58:51.184 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T16:58:51.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:58:51.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:58:51.337 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T16:58:51.337 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:58:51.337 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:51.347 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:58:51.347 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:58:51.347 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:58:51.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:58:51.357 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-28T16:58:51.357 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:58:51.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035f017640 1 Processor -- start 2023-11-28T16:58:51.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035f017640 1 -- start start 2023-11-28T16:58:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035f017640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0358070b80 0x7f0358151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035f017640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03580a8470 0x7f035806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035f017640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035806d320 con 0x7f035814e9d0 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035f017640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03580721b0 con 0x7f03580a8470 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035f017640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03580c2830 con 0x7f0358070b80 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035d5b4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03580a8470 0x7f035806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035d5b4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03580a8470 0x7f035806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59456/0 (socket says 172.21.15.26:59456) 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f035d5b4640 1 -- 172.21.15.26:0/276052514 learned_addr learned my addr 172.21.15.26:0/276052514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.528+0000 7f0357fff640 1 --2- 172.21.15.26:0/276052514 >> v2:172.21.15.79:3300/0 conn(0x7f0358070b80 0x7f0358151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035d5b4640 1 -- 172.21.15.26:0/276052514 >> v2:172.21.15.79:3300/0 conn(0x7f0358070b80 msgr2=0x7f0358151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035d5b4640 1 --2- 172.21.15.26:0/276052514 >> v2:172.21.15.79:3300/0 conn(0x7f0358070b80 0x7f0358151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035d5b4640 1 -- 172.21.15.26:0/276052514 >> v1:172.21.15.79:6789/0 conn(0x7f035814e9d0 legacy=0x7f03580c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035d5b4640 1 -- 172.21.15.26:0/276052514 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358072450 con 0x7f03580a8470 2023-11-28T16:58:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035d5b4640 1 --2- 172.21.15.26:0/276052514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03580a8470 0x7f035806d7b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f035806e420 tx=0x7f035001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f14b1ad12e78630 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f03577fe640 1 -- 172.21.15.26:0/276052514 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035000b2d0 con 0x7f03580a8470 2023-11-28T16:58:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f03577fe640 1 -- 172.21.15.26:0/276052514 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035000b430 con 0x7f03580a8470 2023-11-28T16:58:51.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f03577fe640 1 -- 172.21.15.26:0/276052514 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500a7a40 con 0x7f03580a8470 2023-11-28T16:58:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035f017640 1 -- 172.21.15.26:0/276052514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03580a8470 msgr2=0x7f035806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035f017640 1 --2- 172.21.15.26:0/276052514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03580a8470 0x7f035806d7b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f035806e420 tx=0x7f035001eb40 comp rx=0 tx=0).stop 2023-11-28T16:58:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035f017640 1 -- 172.21.15.26:0/276052514 shutdown_connections 2023-11-28T16:58:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035f017640 1 --2- 172.21.15.26:0/276052514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03580a8470 0x7f035806d7b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035f017640 1 --2- 172.21.15.26:0/276052514 >> v2:172.21.15.79:3300/0 conn(0x7f0358070b80 0x7f0358151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.532+0000 7f035f017640 1 -- 172.21.15.26:0/276052514 >> 172.21.15.26:0/276052514 conn(0x7f03580c2ad0 msgr2=0x7f03580c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 -- 172.21.15.26:0/276052514 shutdown_connections 2023-11-28T16:58:51.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 -- 172.21.15.26:0/276052514 wait complete. 2023-11-28T16:58:51.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 Processor -- start 2023-11-28T16:58:51.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 -- start start 2023-11-28T16:58:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0358070b80 0x7f03581479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03580a8470 0x7f0358144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f035814e9d0 0x7f03581450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358149450 con 0x7f035814e9d0 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358145630 con 0x7f03580a8470 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035f017640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0358145b50 con 0x7f0358070b80 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f035814e9d0 0x7f03581450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f035814e9d0 0x7f03581450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59470/0 (socket says 172.21.15.26:59470) 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 -- 172.21.15.26:0/2159707792 learned_addr learned my addr 172.21.15.26:0/2159707792 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035cdb3640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0358070b80 0x7f03581479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f0357fff640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03580a8470 0x7f0358144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 -- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0358070b80 msgr2=0x7f03581479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0358070b80 0x7f03581479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 -- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03580a8470 msgr2=0x7f0358144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03580a8470 0x7f0358144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 -- 172.21.15.26:0/2159707792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035000bd40 con 0x7f035814e9d0 2023-11-28T16:58:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.536+0000 7f035d5b4640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f035814e9d0 0x7f03581450f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f03500b1040 tx=0x7f035001b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f03557fa640 1 -- 172.21.15.26:0/2159707792 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500bd070 con 0x7f035814e9d0 2023-11-28T16:58:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f03557fa640 1 -- 172.21.15.26:0/2159707792 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035000b720 con 0x7f035814e9d0 2023-11-28T16:58:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f03557fa640 1 -- 172.21.15.26:0/2159707792 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350009840 con 0x7f035814e9d0 2023-11-28T16:58:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03581f1410 con 0x7f035814e9d0 2023-11-28T16:58:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03581f0930 con 0x7f035814e9d0 2023-11-28T16:58:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035804e890 con 0x7f035814e9d0 2023-11-28T16:58:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f03557fa640 1 -- 172.21.15.26:0/2159707792 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f03500099a0 con 0x7f035814e9d0 2023-11-28T16:58:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f03557fa640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f033c0668d0 0x7f033c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f03557fa640 1 -- 172.21.15.26:0/2159707792 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f035011f060 con 0x7f035814e9d0 2023-11-28T16:58:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f035cdb3640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f033c0668d0 0x7f033c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.540+0000 7f035cdb3640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f033c0668d0 0x7f033c068d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0358067170 tx=0x7f034c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.544+0000 7f03557fa640 1 -- 172.21.15.26:0/2159707792 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0350150280 con 0x7f035814e9d0 2023-11-28T16:58:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.736+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03580c1600 con 0x7f035814e9d0 2023-11-28T16:58:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.736+0000 7f03557fa640 1 -- 172.21.15.26:0/2159707792 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f03500ec6a0 con 0x7f035814e9d0 2023-11-28T16:58:51.740 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:51.741 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2457276507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2457276507},{"type":"v1","addr":"172.21.15.79:6836","nonce":2457276507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/894537520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":894537520},{"type":"v1","addr":"172.21.15.26:6835","nonce":894537520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2602983117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2602983117},{"type":"v1","addr":"172.21.15.79:6837","nonce":2602983117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1595070161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1595070161},{"type":"v1","addr":"172.21.15.26:6833","nonce":1595070161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[]} 2023-11-28T16:58:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 41 2023-11-28T16:58:51.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f033c0668d0 msgr2=0x7f033c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f033c0668d0 0x7f033c068d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0358067170 tx=0x7f034c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:51.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f035814e9d0 msgr2=0x7f03581450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f035814e9d0 0x7f03581450f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f03500b1040 tx=0x7f035001b8e0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 shutdown_connections 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f035814e9d0 0x7f03581450f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03580a8470 0x7f0358144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f033c0668d0 0x7f033c068d90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 --2- 172.21.15.26:0/2159707792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0358070b80 0x7f03581479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 >> 172.21.15.26:0/2159707792 conn(0x7f03580c2ad0 msgr2=0x7f03580abe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 shutdown_connections 2023-11-28T16:58:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.740+0000 7f035f017640 1 -- 172.21.15.26:0/2159707792 wait complete. 2023-11-28T16:58:51.762 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T16:58:51.762 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T16:58:51.762 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T16:58:51.763 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:58:51.763 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T16:58:51.763 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T16:58:51.763 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T16:58:51.763 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:58:51.764 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T16:58:51.764 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T16:58:51.764 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T16:58:51.764 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:58:51.764 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T16:58:51.764 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T16:58:51.765 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T16:58:51.765 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T16:58:51.776 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T16:58:51.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T16:58:51.777 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T16:58:51.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T16:58:51.779 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T16:58:51.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T16:58:51.781 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T16:58:51.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T16:58:51.820 INFO:tasks.ceph.mds.a:Started 2023-11-28T16:58:51.821 DEBUG:teuthology.parallel:result is None 2023-11-28T16:58:51.823 INFO:tasks.ceph.mds.c:Started 2023-11-28T16:58:51.823 DEBUG:teuthology.parallel:result is None 2023-11-28T16:58:51.825 INFO:tasks.ceph.mds.b:Started 2023-11-28T16:58:51.825 DEBUG:teuthology.parallel:result is None 2023-11-28T16:58:51.827 INFO:tasks.ceph.mds.d:Started 2023-11-28T16:58:51.827 DEBUG:teuthology.parallel:result is None 2023-11-28T16:58:51.828 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T16:58:51.910 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-11-28T16:58:51.911 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-11-28T16:58:51.911 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-11-28T16:58:51.912 INFO:tasks.ceph.mds.d.smithi079.stdout:starting mds.d at 2023-11-28T16:58:51.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.972+0000 7fe86bd57640 1 Processor -- start 2023-11-28T16:58:51.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.972+0000 7fe86bd57640 1 -- start start 2023-11-28T16:58:51.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86bd57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe86406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86bd57640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8640c19e0 0x7fe8640c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86bd57640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86406dec0 con 0x7fe86414fcc0 2023-11-28T16:58:51.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86bd57640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8640aa340 con 0x7fe8640c19e0 2023-11-28T16:58:51.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86bd57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe864156980 con 0x7fe864156500 2023-11-28T16:58:51.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe869af3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe86414fcc0 0x7fe8640aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55436/0 (socket says 172.21.15.26:55436) 2023-11-28T16:58:51.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe869af3640 1 -- 172.21.15.26:0/1840125676 learned_addr learned my addr 172.21.15.26:0/1840125676 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:51.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86a2f4640 1 --2- 172.21.15.26:0/1840125676 >> v2:172.21.15.26:3300/0 conn(0x7fe8640c19e0 0x7fe8640c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe8692f2640 1 --2- 172.21.15.26:0/1840125676 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe86406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe868af1640 1 -- 172.21.15.26:0/1840125676 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17706397 0 0) 0x7fe86406dec0 con 0x7fe86414fcc0 2023-11-28T16:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe868af1640 1 -- 172.21.15.26:0/1840125676 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe850003530 con 0x7fe86414fcc0 2023-11-28T16:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86a2f4640 1 -- 172.21.15.26:0/1840125676 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 msgr2=0x7fe86406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86a2f4640 1 --2- 172.21.15.26:0/1840125676 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe86406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86a2f4640 1 -- 172.21.15.26:0/1840125676 >> v1:172.21.15.26:6789/0 conn(0x7fe86414fcc0 legacy=0x7fe8640aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86a2f4640 1 -- 172.21.15.26:0/1840125676 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640ab580 con 0x7fe8640c19e0 2023-11-28T16:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.976+0000 7fe86a2f4640 1 --2- 172.21.15.26:0/1840125676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c19e0 0x7fe8640c1e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009d90 tx=0x7fe85c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2723b05c93c8a17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe868af1640 1 -- 172.21.15.26:0/1840125676 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0a58f0 con 0x7fe8640c19e0 2023-11-28T16:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe868af1640 1 -- 172.21.15.26:0/1840125676 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c0a5a50 con 0x7fe8640c19e0 2023-11-28T16:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe868af1640 1 -- 172.21.15.26:0/1840125676 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0a5de0 con 0x7fe8640c19e0 2023-11-28T16:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- 172.21.15.26:0/1840125676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c19e0 msgr2=0x7fe8640c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 --2- 172.21.15.26:0/1840125676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c19e0 0x7fe8640c1e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009d90 tx=0x7fe85c01c920 comp rx=0 tx=0).stop 2023-11-28T16:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- 172.21.15.26:0/1840125676 shutdown_connections 2023-11-28T16:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 --2- 172.21.15.26:0/1840125676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c19e0 0x7fe8640c1e70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 --2- 172.21.15.26:0/1840125676 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe86406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- 172.21.15.26:0/1840125676 >> 172.21.15.26:0/1840125676 conn(0x7fe8640c2ad0 msgr2=0x7fe8640c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- 172.21.15.26:0/1840125676 shutdown_connections 2023-11-28T16:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- 172.21.15.26:0/1840125676 wait complete. 2023-11-28T16:58:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 Processor -- start 2023-11-28T16:58:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- start start 2023-11-28T16:58:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c19e0 0x7fe8640700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe8641435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe864071c60 0x7fe864150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe864143b10 con 0x7fe864071c60 2023-11-28T16:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641ed5a0 con 0x7fe8640c19e0 2023-11-28T16:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86bd57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641edad0 con 0x7fe864156500 2023-11-28T16:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86a2f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe864071c60 0x7fe864150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86a2f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe864071c60 0x7fe864150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59502/0 (socket says 172.21.15.26:59502) 2023-11-28T16:58:51.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.980+0000 7fe86a2f4640 1 -- 172.21.15.26:0/3925999333 learned_addr learned my addr 172.21.15.26:0/3925999333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:51.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe869af3640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c19e0 0x7fe8640700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe8692f2640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe8641435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86a2f4640 1 -- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 msgr2=0x7fe8641435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86a2f4640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe8641435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86a2f4640 1 -- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c19e0 msgr2=0x7fe8640700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86a2f4640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c19e0 0x7fe8640700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86a2f4640 1 -- 172.21.15.26:0/3925999333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c009a70 con 0x7fe864071c60 2023-11-28T16:58:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86a2f4640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe864071c60 0x7fe864150320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0b0040 tx=0x7fe85c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe85a7fc640 1 -- 172.21.15.26:0/3925999333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0b9860 con 0x7fe864071c60 2023-11-28T16:58:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe85a7fc640 1 -- 172.21.15.26:0/3925999333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c0b99c0 con 0x7fe864071c60 2023-11-28T16:58:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe85a7fc640 1 -- 172.21.15.26:0/3925999333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0b9d70 con 0x7fe864071c60 2023-11-28T16:58:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe864152410 con 0x7fe864071c60 2023-11-28T16:58:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8641520a0 con 0x7fe864071c60 2023-11-28T16:58:51.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe864151ee0 con 0x7fe864071c60 2023-11-28T16:58:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.984+0000 7fe85a7fc640 1 -- 172.21.15.26:0/3925999333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe85c0ad440 con 0x7fe864071c60 2023-11-28T16:58:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.988+0000 7fe85a7fc640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe848066900 0x7fe848068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:51.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.988+0000 7fe85a7fc640 1 -- 172.21.15.26:0/3925999333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe85c11ecc0 con 0x7fe864071c60 2023-11-28T16:58:51.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.988+0000 7fe869af3640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe848066900 0x7fe848068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:51.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.988+0000 7fe869af3640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe848066900 0x7fe848068dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe8600011f0 tx=0x7fe860007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:51.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:51.992+0000 7fe85a7fc640 1 -- 172.21.15.26:0/3925999333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe85c125080 con 0x7fe864071c60 2023-11-28T16:58:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:52.160+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe8641525a0 con 0x7fe864071c60 2023-11-28T16:58:53.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe85a7fc640 1 -- 172.21.15.26:0/3925999333 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe85c0ec360 con 0x7fe864071c60 2023-11-28T16:58:53.181 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe848066900 msgr2=0x7fe848068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe848066900 0x7fe848068dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe8600011f0 tx=0x7fe860007d40 comp rx=0 tx=0).stop 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe864071c60 msgr2=0x7fe864150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe864071c60 0x7fe864150320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0b0040 tx=0x7fe85c0196c0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 shutdown_connections 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe864071c60 0x7fe864150320 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe848066900 0x7fe848068dc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe864156500 0x7fe8641435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 --2- 172.21.15.26:0/3925999333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c19e0 0x7fe8640700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 >> 172.21.15.26:0/3925999333 conn(0x7fe8640c2ad0 msgr2=0x7fe8640a90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 shutdown_connections 2023-11-28T16:58:53.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.176+0000 7fe86bd57640 1 -- 172.21.15.26:0/3925999333 wait complete. 2023-11-28T16:58:53.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T16:58:53.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecff356640 1 Processor -- start 2023-11-28T16:58:53.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecff356640 1 -- start start 2023-11-28T16:58:53.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecff356640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 0x7fecf80caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecff356640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf806b7d0 con 0x7fecf80c4890 2023-11-28T16:58:53.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecff356640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf8155160 con 0x7fecf80bd5a0 2023-11-28T16:58:53.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecff356640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf806b180 con 0x7fecf80ca620 2023-11-28T16:58:53.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfdb53640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fecf80c4890 0x7fecf80c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55438/0 (socket says 172.21.15.26:55438) 2023-11-28T16:58:53.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfdb53640 1 -- 172.21.15.26:0/2577377059 learned_addr learned my addr 172.21.15.26:0/2577377059 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfe354640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 0x7fecf80caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253021771 0 0) 0x7fecf806b7d0 con 0x7fecf80c4890 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece4003530 con 0x7fecf80c4890 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 530502997 0 0) 0x7fece4003530 con 0x7fecf80c4890 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 msgr2=0x7fecf80caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 0x7fecf80caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 >> v1:172.21.15.79:6789/0 conn(0x7fecf80bd5a0 legacy=0x7fecf80c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf806b460 con 0x7fecf80c4890 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fece8001680 con 0x7fecf80c4890 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 >> v1:172.21.15.26:6789/0 conn(0x7fecf80c4890 legacy=0x7fecf80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece40039b0 0x7fece4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 0x7fece40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fece4004d10 0x7fece4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf806b180 con 0x7fece4004d10 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece400bb20 con 0x7fece40039b0 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece400bce0 con 0x7fecf80ca620 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfe354640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece40039b0 0x7fece4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfeb55640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fece4004d10 0x7fece4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfdb53640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 0x7fece40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfe354640 1 -- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 msgr2=0x7fece40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfe354640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80ca620 0x7fece40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfe354640 1 -- 172.21.15.26:0/2577377059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fece4004d10 msgr2=0x7fece4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfe354640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fece4004d10 0x7fece4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.352+0000 7fecfe354640 1 -- 172.21.15.26:0/2577377059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4003530 con 0x7fece40039b0 2023-11-28T16:58:53.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecfe354640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece40039b0 0x7fece4003d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009ae0 tx=0x7fecf401ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=458bce7fa5163d4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:53.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40a5640 con 0x7fece40039b0 2023-11-28T16:58:53.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40a57a0 con 0x7fece40039b0 2023-11-28T16:58:53.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecfd352640 1 -- 172.21.15.26:0/2577377059 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40a5b50 con 0x7fece40039b0 2023-11-28T16:58:53.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecff356640 1 -- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece40039b0 msgr2=0x7fece4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecff356640 1 --2- 172.21.15.26:0/2577377059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece40039b0 0x7fece4003d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009ae0 tx=0x7fecf401ca50 comp rx=0 tx=0).stop 2023-11-28T16:58:53.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecfeb55640 1 -- 172.21.15.26:0/2577377059 reap_dead start 2023-11-28T16:58:53.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecff356640 1 -- 172.21.15.26:0/2577377059 shutdown_connections 2023-11-28T16:58:53.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecff356640 1 -- 172.21.15.26:0/2577377059 >> 172.21.15.26:0/2577377059 conn(0x7fecf80ac0a0 msgr2=0x7fecf80c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecff356640 1 -- 172.21.15.26:0/2577377059 shutdown_connections 2023-11-28T16:58:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.356+0000 7fecff356640 1 -- 172.21.15.26:0/2577377059 wait complete. 2023-11-28T16:58:53.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 Processor -- start 2023-11-28T16:58:53.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 -- start start 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fece40039b0 0x7fecf81ec650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8156200 0x7fecf80c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf80c3990 0x7fecf81e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf8156b20 con 0x7fecf80c3990 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81eab60 con 0x7fecf8156200 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf814dea0 con 0x7fece40039b0 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf80c3990 0x7fecf81e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf80c3990 0x7fecf81e9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59526/0 (socket says 172.21.15.26:59526) 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 -- 172.21.15.26:0/83622137 learned_addr learned my addr 172.21.15.26:0/83622137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfdb53640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8156200 0x7fecf80c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfe354640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fece40039b0 0x7fecf81ec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 -- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fece40039b0 msgr2=0x7fecf81ec650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fece40039b0 0x7fecf81ec650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 -- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8156200 msgr2=0x7fecf80c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8156200 0x7fecf80c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 -- 172.21.15.26:0/83622137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8157c10 con 0x7fecf80c3990 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfe354640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fece40039b0 0x7fecf81ec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecfeb55640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf80c3990 0x7fecf81e9ad0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fecf0007fd0 tx=0x7fecf0011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7feceeffd640 1 -- 172.21.15.26:0/83622137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0006d70 con 0x7fecf80c3990 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7feceeffd640 1 -- 172.21.15.26:0/83622137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0003980 con 0x7fecf80c3990 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7feceeffd640 1 -- 172.21.15.26:0/83622137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0003d30 con 0x7fecf80c3990 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf8157ef0 con 0x7fecf80c3990 2023-11-28T16:58:53.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.360+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf81584b0 con 0x7fecf80c3990 2023-11-28T16:58:53.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.364+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf804e890 con 0x7fecf80c3990 2023-11-28T16:58:53.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.364+0000 7feceeffd640 1 -- 172.21.15.26:0/83622137 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fecf0005110 con 0x7fecf80c3990 2023-11-28T16:58:53.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.364+0000 7feceeffd640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fecdc0668d0 0x7fecdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.364+0000 7feceeffd640 1 -- 172.21.15.26:0/83622137 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fecf0086f70 con 0x7fecf80c3990 2023-11-28T16:58:53.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.364+0000 7fecfe354640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fecdc0668d0 0x7fecdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.364+0000 7fecfe354640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fecdc0668d0 0x7fecdc068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fecf40af000 tx=0x7fecf40046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:53.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.368+0000 7feceeffd640 1 -- 172.21.15.26:0/83622137 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fecf00544f0 con 0x7fecf80c3990 2023-11-28T16:58:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.580+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fecf80c98e0 con 0x7fecf80c3990 2023-11-28T16:58:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.580+0000 7feceeffd640 1 -- 172.21.15.26:0/83622137 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5081 (secure 0 0 0) 0x7fecf0057b10 con 0x7fecf80c3990 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlAikwBRAAQ6/impgMsMbDuSaqtxHLAg==", 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:58:53.586 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlGkK2ERAAvgQCl4mK38H2G8IG10WC8g==", 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.587 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlN8GNDBAA3+w1QxhoXQo54UQV/ogQ5Q==", 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-11-28T16:58:53.588 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlCZg+GRAADDsRVkfdQ4/R/d3auYuQLQ==", 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB5G2Zlm75jMhAAfBhoHD0wXNlVoDshO3cpeg==", 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.589 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB8G2ZlFdNYORAAN6gs23w6ngpwiGxRH9wdqA==", 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.590 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCAG2ZlPWo/BBAAhIuajQHDwNtFJhJECKL0HA==", 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCDG2ZltllfCxAAqpT3R2HyGu+P4MKWVo9haA==", 2023-11-28T16:58:53.591 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCJG2Zl86hXEhAAVn3jysp8SF3VujHFQXdJZA==", 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCMG2Zldu2MGBAAK/nOy8WbKhJ/e91PhwY4Jg==", 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.593 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCPG2ZlMzrZHxAAgwVfHNVLyId5CNs6/llC2w==", 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCSG2ZlzlL/JRAAXY00dUMMj9nNXUjTVsMBQQ==", 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-11-28T16:58:53.594 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw==", 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.595 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg==", 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB3G2ZlBP0bIRAA91R862EjTamLWS36tcdt9g==", 2023-11-28T16:58:53.596 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.testuser", 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQAvHGZl3K7vOBAAZ1K0naJd5Vgb5lYjY6X4+g==", 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow rw fsname=cephfs", 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-11-28T16:58:53.597 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB4G2ZldwN4ABAAk2OXnh0lwdB6ER6KsTUp+w==", 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:53.598 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB3G2ZlahcsOBAA/pu4L5dOusqC3KpdoJVbiQ==", 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:53.599 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-11-28T16:58:53.601 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:58:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fecdc0668d0 msgr2=0x7fecdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fecdc0668d0 0x7fecdc068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fecf40af000 tx=0x7fecf40046d0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf80c3990 msgr2=0x7fecf81e9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf80c3990 0x7fecf81e9ad0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fecf0007fd0 tx=0x7fecf0011dc0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 shutdown_connections 2023-11-28T16:58:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf80c3990 0x7fecf81e9ad0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8156200 0x7fecf80c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fecdc0668d0 0x7fecdc068d90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 --2- 172.21.15.26:0/83622137 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fece40039b0 0x7fecf81ec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 >> 172.21.15.26:0/83622137 conn(0x7fecf80ac0a0 msgr2=0x7fecf8153280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 shutdown_connections 2023-11-28T16:58:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.584+0000 7fecff356640 1 -- 172.21.15.26:0/83622137 wait complete. 2023-11-28T16:58:53.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-28T16:58:53.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff4105f640 1 Processor -- start 2023-11-28T16:58:53.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff4105f640 1 -- start start 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff4105f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff3c156500 0x7eff3c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff4105f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff3c0c19e0 0x7eff3c0c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff4105f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c06dec0 con 0x7eff3c14fcc0 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff4105f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0aa340 con 0x7eff3c156500 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff4105f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c156980 con 0x7eff3c0c19e0 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff33fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff3c156500 0x7eff3c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff33fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff3c156500 0x7eff3c06d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59528/0 (socket says 172.21.15.26:59528) 2023-11-28T16:58:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.748+0000 7eff33fff640 1 -- 172.21.15.26:0/2598342822 learned_addr learned my addr 172.21.15.26:0/2598342822 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:53.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff3b59e640 1 --2- 172.21.15.26:0/2598342822 >> v2:172.21.15.79:3300/0 conn(0x7eff3c0c19e0 0x7eff3c0c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff33fff640 1 -- 172.21.15.26:0/2598342822 >> v2:172.21.15.79:3300/0 conn(0x7eff3c0c19e0 msgr2=0x7eff3c0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:53.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff33fff640 1 --2- 172.21.15.26:0/2598342822 >> v2:172.21.15.79:3300/0 conn(0x7eff3c0c19e0 0x7eff3c0c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff33fff640 1 -- 172.21.15.26:0/2598342822 >> v1:172.21.15.79:6789/0 conn(0x7eff3c14fcc0 legacy=0x7eff3c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:53.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff33fff640 1 -- 172.21.15.26:0/2598342822 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0ab580 con 0x7eff3c156500 2023-11-28T16:58:53.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff33fff640 1 --2- 172.21.15.26:0/2598342822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c06d980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0c3b30 tx=0x7eff2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fce372637d506e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:53.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff3a59c640 1 -- 172.21.15.26:0/2598342822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240ac640 con 0x7eff3c156500 2023-11-28T16:58:53.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff3a59c640 1 -- 172.21.15.26:0/2598342822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff240ac7a0 con 0x7eff3c156500 2023-11-28T16:58:53.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff3a59c640 1 -- 172.21.15.26:0/2598342822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240acb30 con 0x7eff3c156500 2023-11-28T16:58:53.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff4105f640 1 -- 172.21.15.26:0/2598342822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 msgr2=0x7eff3c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.752+0000 7eff4105f640 1 --2- 172.21.15.26:0/2598342822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c06d980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0c3b30 tx=0x7eff2401c4d0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- 172.21.15.26:0/2598342822 shutdown_connections 2023-11-28T16:58:53.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 --2- 172.21.15.26:0/2598342822 >> v2:172.21.15.79:3300/0 conn(0x7eff3c0c19e0 0x7eff3c0c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 --2- 172.21.15.26:0/2598342822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c06d980 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- 172.21.15.26:0/2598342822 >> 172.21.15.26:0/2598342822 conn(0x7eff3c0c2ad0 msgr2=0x7eff3c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:53.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- 172.21.15.26:0/2598342822 shutdown_connections 2023-11-28T16:58:53.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- 172.21.15.26:0/2598342822 wait complete. 2023-11-28T16:58:53.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 Processor -- start 2023-11-28T16:58:53.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- start start 2023-11-28T16:58:53.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff3c0c19e0 0x7eff3c14e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff3c14b380 0x7eff3c146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c157140 con 0x7eff3c156500 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1497a0 con 0x7eff3c14b380 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff4105f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c158330 con 0x7eff3c0c19e0 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c1463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59534/0 (socket says 172.21.15.26:59534) 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 -- 172.21.15.26:0/1935365125 learned_addr learned my addr 172.21.15.26:0/1935365125 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff3ad9d640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff3c0c19e0 0x7eff3c14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff3b59e640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff3c14b380 0x7eff3c146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 -- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff3c0c19e0 msgr2=0x7eff3c14e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff3c0c19e0 0x7eff3c14e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 -- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff3c14b380 msgr2=0x7eff3c146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff3c14b380 0x7eff3c146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 -- 172.21.15.26:0/1935365125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240094d0 con 0x7eff3c156500 2023-11-28T16:58:53.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff3ad9d640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff3c0c19e0 0x7eff3c14e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:53.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff3b59e640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff3c14b380 0x7eff3c146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:58:53.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.756+0000 7eff33fff640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c1463c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7eff240190e0 tx=0x7eff2401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:53.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff337fe640 1 -- 172.21.15.26:0/1935365125 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240b7860 con 0x7eff3c156500 2023-11-28T16:58:53.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff337fe640 1 -- 172.21.15.26:0/1935365125 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff240b79e0 con 0x7eff3c156500 2023-11-28T16:58:53.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c149470 con 0x7eff3c156500 2023-11-28T16:58:53.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff337fe640 1 -- 172.21.15.26:0/1935365125 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240b7d90 con 0x7eff3c156500 2023-11-28T16:58:53.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c1ebc10 con 0x7eff3c156500 2023-11-28T16:58:53.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c149950 con 0x7eff3c156500 2023-11-28T16:58:53.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff337fe640 1 -- 172.21.15.26:0/1935365125 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff240b3070 con 0x7eff3c156500 2023-11-28T16:58:53.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff337fe640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c0668d0 0x7eff1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:53.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff337fe640 1 -- 172.21.15.26:0/1935365125 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff2411ead0 con 0x7eff3c156500 2023-11-28T16:58:53.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.760+0000 7eff3ad9d640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c0668d0 0x7eff1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.764+0000 7eff3ad9d640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c0668d0 0x7eff1c068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7eff2c000f70 tx=0x7eff2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.764+0000 7eff337fe640 1 -- 172.21.15.26:0/1935365125 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff3c149950 con 0x7eff3c156500 2023-11-28T16:58:53.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.980+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7eff3c149950 con 0x7eff3c156500 2023-11-28T16:58:53.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff337fe640 1 -- 172.21.15.26:0/1935365125 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v20) v1 ==== 85+0+0 (secure 0 0 0) 0x7eff3c149950 con 0x7eff3c156500 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c0668d0 msgr2=0x7eff1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c0668d0 0x7eff1c068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7eff2c000f70 tx=0x7eff2c009040 comp rx=0 tx=0).stop 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 msgr2=0x7eff3c1463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c1463c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7eff240190e0 tx=0x7eff2401ad10 comp rx=0 tx=0).stop 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 shutdown_connections 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff3c14b380 0x7eff3c146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff3c156500 0x7eff3c1463c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7eff1c0668d0 0x7eff1c068d90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 --2- 172.21.15.26:0/1935365125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff3c0c19e0 0x7eff3c14e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 >> 172.21.15.26:0/1935365125 conn(0x7eff3c0c2ad0 msgr2=0x7eff3c14ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:53.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 shutdown_connections 2023-11-28T16:58:53.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:53.984+0000 7eff4105f640 1 -- 172.21.15.26:0/1935365125 wait complete. 2023-11-28T16:58:54.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:54.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b8f9d640 1 Processor -- start 2023-11-28T16:58:54.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b8f9d640 1 -- start start 2023-11-28T16:58:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b8f9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85b40ca610 0x7f85b40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b8f9d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b4155790 con 0x7f85b40bd720 2023-11-28T16:58:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b8f9d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b40c4b00 con 0x7f85b406cd90 2023-11-28T16:58:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b8f9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b40c4de0 con 0x7f85b40ca610 2023-11-28T16:58:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85abfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85b40bd720 0x7f85b4158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55450/0 (socket says 172.21.15.26:55450) 2023-11-28T16:58:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85abfff640 1 -- 172.21.15.26:0/1848608859 learned_addr learned my addr 172.21.15.26:0/1848608859 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b259c640 1 --2- 172.21.15.26:0/1848608859 >> v2:172.21.15.79:3300/0 conn(0x7f85b40ca610 0x7f85b40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450324647 0 0) 0x7f85b4155790 con 0x7f85b40bd720 2023-11-28T16:58:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a0003530 con 0x7f85b40bd720 2023-11-28T16:58:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42184895 0 0) 0x7f85b40c4b00 con 0x7f85b406cd90 2023-11-28T16:58:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b4155790 con 0x7f85b406cd90 2023-11-28T16:58:54.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b259c640 1 -- 172.21.15.26:0/1848608859 >> v1:172.21.15.79:6789/0 conn(0x7f85b406cd90 legacy=0x7f85b40c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346932293 0 0) 0x7f85a0003530 con 0x7f85b40bd720 2023-11-28T16:58:54.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b259c640 1 -- 172.21.15.26:0/1848608859 >> v1:172.21.15.26:6789/0 conn(0x7f85b40bd720 legacy=0x7f85b4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.152+0000 7f85b259c640 1 -- 172.21.15.26:0/1848608859 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4157e30 con 0x7f85b40ca610 2023-11-28T16:58:54.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b259c640 1 --2- 172.21.15.26:0/1848608859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b40ca610 0x7f85b40c94c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f85a40097c0 tx=0x7f85a401bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d243f8c20ff4963f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40c52d0 con 0x7f85b40ca610 2023-11-28T16:58:54.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40a5420 con 0x7f85b40ca610 2023-11-28T16:58:54.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b1d9b640 1 -- 172.21.15.26:0/1848608859 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c001680 con 0x7f85b40ca610 2023-11-28T16:58:54.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b8f9d640 1 -- 172.21.15.26:0/1848608859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b40ca610 msgr2=0x7f85b40c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/1848608859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b40ca610 0x7f85b40c94c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f85a40097c0 tx=0x7f85a401bf60 comp rx=0 tx=0).stop 2023-11-28T16:58:54.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b8f9d640 1 -- 172.21.15.26:0/1848608859 shutdown_connections 2023-11-28T16:58:54.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/1848608859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b40ca610 0x7f85b40c94c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b8f9d640 1 -- 172.21.15.26:0/1848608859 >> 172.21.15.26:0/1848608859 conn(0x7f85b4071ea0 msgr2=0x7f85b40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:54.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b8f9d640 1 -- 172.21.15.26:0/1848608859 shutdown_connections 2023-11-28T16:58:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.156+0000 7f85b8f9d640 1 -- 172.21.15.26:0/1848608859 wait complete. 2023-11-28T16:58:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 Processor -- start 2023-11-28T16:58:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 -- start start 2023-11-28T16:58:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b406cd90 0x7f85b40a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85b40bd720 0x7f85b414a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85b40ca610 0x7f85b41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b4154180 con 0x7f85b40ca610 2023-11-28T16:58:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b4153ea0 con 0x7f85b406cd90 2023-11-28T16:58:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b414fb00 con 0x7f85b40bd720 2023-11-28T16:58:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85b40ca610 0x7f85b41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85b40ca610 0x7f85b41508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59538/0 (socket says 172.21.15.26:59538) 2023-11-28T16:58:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 -- 172.21.15.26:0/441585357 learned_addr learned my addr 172.21.15.26:0/441585357 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b259c640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b406cd90 0x7f85b40a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85abfff640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85b40bd720 0x7f85b414a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 -- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85b40bd720 msgr2=0x7f85b414a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85b40bd720 0x7f85b414a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 -- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b406cd90 msgr2=0x7f85b40a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b406cd90 0x7f85b40a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 -- 172.21.15.26:0/441585357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4009420 con 0x7f85b40ca610 2023-11-28T16:58:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b259c640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b406cd90 0x7f85b40a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b2d9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85b40ca610 0x7f85b41508c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c790 tx=0x7f85ac00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85aaffd640 1 -- 172.21.15.26:0/441585357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac00cea0 con 0x7f85b40ca610 2023-11-28T16:58:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85aaffd640 1 -- 172.21.15.26:0/441585357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac003b80 con 0x7f85b40ca610 2023-11-28T16:58:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b414fde0 con 0x7f85b40ca610 2023-11-28T16:58:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85aaffd640 1 -- 172.21.15.26:0/441585357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac00a850 con 0x7f85b40ca610 2023-11-28T16:58:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.160+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b414a870 con 0x7f85b40ca610 2023-11-28T16:58:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.164+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b41505e0 con 0x7f85b40ca610 2023-11-28T16:58:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.164+0000 7f85aaffd640 1 -- 172.21.15.26:0/441585357 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f85ac00a9b0 con 0x7f85b40ca610 2023-11-28T16:58:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.164+0000 7f85aaffd640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85940668d0 0x7f8594068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.164+0000 7f85aaffd640 1 -- 172.21.15.26:0/441585357 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85ac083ea0 con 0x7f85b40ca610 2023-11-28T16:58:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.164+0000 7f85b259c640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85940668d0 0x7f8594068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.168+0000 7f85b259c640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85940668d0 0x7f8594068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85a40ae000 tx=0x7f85a40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.168+0000 7f85aaffd640 1 -- 172.21.15.26:0/441585357 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85b41505e0 con 0x7f85b40ca610 2023-11-28T16:58:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.328+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85b41505e0 con 0x7f85b40ca610 2023-11-28T16:58:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.328+0000 7f85aaffd640 1 -- 172.21.15.26:0/441585357 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+12786 (secure 0 0 0) 0x7f85b41505e0 con 0x7f85b40ca610 2023-11-28T16:58:54.334 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:54.334 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":65,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:53.175445+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85940668d0 msgr2=0x7f8594068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85940668d0 0x7f8594068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85a40ae000 tx=0x7f85a40a6000 comp rx=0 tx=0).stop 2023-11-28T16:58:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85b40ca610 msgr2=0x7f85b41508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85b40ca610 0x7f85b41508c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c790 tx=0x7f85ac00cc50 comp rx=0 tx=0).stop 2023-11-28T16:58:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 shutdown_connections 2023-11-28T16:58:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85b40ca610 0x7f85b41508c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85940668d0 0x7f8594068d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85b40bd720 0x7f85b414a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 --2- 172.21.15.26:0/441585357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85b406cd90 0x7f85b40a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 >> 172.21.15.26:0/441585357 conn(0x7f85b4071ea0 msgr2=0x7f85b40ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 shutdown_connections 2023-11-28T16:58:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.332+0000 7f85b8f9d640 1 -- 172.21.15.26:0/441585357 wait complete. 2023-11-28T16:58:54.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:58:54.357 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a9356640 1 Processor -- start 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a9356640 1 -- start start 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a9356640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f94a40c7de0 0x7f94a41546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a9356640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a415f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a9356640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a4157ca0 con 0x7f94a4151df0 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a9356640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a41521d0 con 0x7f94a40c7de0 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a9356640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40c55f0 con 0x7f94a4154bf0 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a8b55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a8b55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a415f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:55364/0 (socket says 172.21.15.26:55364) 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a8b55640 1 -- 172.21.15.26:0/2853739822 learned_addr learned my addr 172.21.15.26:0/2853739822 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a3fff640 1 --1- 172.21.15.26:0/2853739822 >> v1:172.21.15.79:6789/0 conn(0x7f94a4151df0 0x7f94a40c4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:37482/0 (socket says 172.21.15.26:37482) 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f949bfff640 1 --2- 172.21.15.26:0/2853739822 >> v2:172.21.15.79:3300/0 conn(0x7f94a40c7de0 0x7f94a41546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a8b55640 1 -- 172.21.15.26:0/2853739822 >> v2:172.21.15.79:3300/0 conn(0x7f94a40c7de0 msgr2=0x7f94a41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a8b55640 1 --2- 172.21.15.26:0/2853739822 >> v2:172.21.15.79:3300/0 conn(0x7f94a40c7de0 0x7f94a41546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a8b55640 1 -- 172.21.15.26:0/2853739822 >> v1:172.21.15.79:6789/0 conn(0x7f94a4151df0 legacy=0x7f94a40c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a37fe640 1 -- 172.21.15.26:0/2853739822 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022510386 0 0) 0x7f94a4157ca0 con 0x7f94a4151df0 2023-11-28T16:58:54.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.500+0000 7f94a8b55640 1 -- 172.21.15.26:0/2853739822 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4157ef0 con 0x7f94a4154bf0 2023-11-28T16:58:54.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a8b55640 1 --2- 172.21.15.26:0/2853739822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a415f030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f949c009e50 tx=0x7f949c01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b4f483496e61de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a37fe640 1 -- 172.21.15.26:0/2853739822 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0a5640 con 0x7f94a4154bf0 2023-11-28T16:58:54.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a37fe640 1 -- 172.21.15.26:0/2853739822 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0a57a0 con 0x7f94a4154bf0 2023-11-28T16:58:54.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a37fe640 1 -- 172.21.15.26:0/2853739822 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0a5b30 con 0x7f94a4154bf0 2023-11-28T16:58:54.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 -- 172.21.15.26:0/2853739822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 msgr2=0x7f94a415f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 --2- 172.21.15.26:0/2853739822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a415f030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f949c009e50 tx=0x7f949c01c980 comp rx=0 tx=0).stop 2023-11-28T16:58:54.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 -- 172.21.15.26:0/2853739822 shutdown_connections 2023-11-28T16:58:54.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 --2- 172.21.15.26:0/2853739822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a415f030 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 --2- 172.21.15.26:0/2853739822 >> v2:172.21.15.79:3300/0 conn(0x7f94a40c7de0 0x7f94a41546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 -- 172.21.15.26:0/2853739822 >> 172.21.15.26:0/2853739822 conn(0x7f94a40abab0 msgr2=0x7f94a40abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:54.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 -- 172.21.15.26:0/2853739822 shutdown_connections 2023-11-28T16:58:54.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.504+0000 7f94a9356640 1 -- 172.21.15.26:0/2853739822 wait complete. 2023-11-28T16:58:54.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 Processor -- start 2023-11-28T16:58:54.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 -- start start 2023-11-28T16:58:54.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94a40c7de0 0x7f94a4145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a4151df0 0x7f94a414a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4155aa0 con 0x7f94a40c7de0 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a414bc80 con 0x7f94a4151df0 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a41ed360 con 0x7f94a4154bf0 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94a40c7de0 0x7f94a4145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94a40c7de0 0x7f94a4145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59546/0 (socket says 172.21.15.26:59546) 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 -- 172.21.15.26:0/576657280 learned_addr learned my addr 172.21.15.26:0/576657280 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f949bfff640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a4151df0 0x7f94a414a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a8b55640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 -- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 msgr2=0x7f94a414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a414aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 -- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a4151df0 msgr2=0x7f94a414a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a4151df0 0x7f94a414a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 -- 172.21.15.26:0/576657280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009b30 con 0x7f94a40c7de0 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a3fff640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94a40c7de0 0x7f94a4145f40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f94940011f0 tx=0x7f949400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a17fa640 1 -- 172.21.15.26:0/576657280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940074e0 con 0x7f94a40c7de0 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a17fa640 1 -- 172.21.15.26:0/576657280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494007640 con 0x7f94a40c7de0 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a41ed640 con 0x7f94a40c7de0 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a17fa640 1 -- 172.21.15.26:0/576657280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494004a10 con 0x7f94a40c7de0 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a41edc00 con 0x7f94a40c7de0 2023-11-28T16:58:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.508+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a4067a40 con 0x7f94a40c7de0 2023-11-28T16:58:54.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.512+0000 7f94a17fa640 1 -- 172.21.15.26:0/576657280 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9494004b70 con 0x7f94a40c7de0 2023-11-28T16:58:54.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.512+0000 7f94a17fa640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94840668d0 0x7f9484068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.512+0000 7f94a17fa640 1 -- 172.21.15.26:0/576657280 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9494083500 con 0x7f94a40c7de0 2023-11-28T16:58:54.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.512+0000 7f949bfff640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94840668d0 0x7f9484068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.512+0000 7f949bfff640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94840668d0 0x7f9484068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f94a41525d0 tx=0x7f948c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.516+0000 7f94a17fa640 1 -- 172.21.15.26:0/576657280 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9494050bd0 con 0x7f94a40c7de0 2023-11-28T16:58:54.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94a41ede20 con 0x7f94a40c7de0 2023-11-28T16:58:54.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a17fa640 1 -- 172.21.15.26:0/576657280 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9494018020 con 0x7f94a40c7de0 2023-11-28T16:58:54.679 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94840668d0 msgr2=0x7f9484068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94840668d0 0x7f9484068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f94a41525d0 tx=0x7f948c009190 comp rx=0 tx=0).stop 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94a40c7de0 msgr2=0x7f94a4145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94a40c7de0 0x7f94a4145f40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f94940011f0 tx=0x7f949400c9b0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 shutdown_connections 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f94840668d0 0x7f9484068d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94a4154bf0 0x7f94a414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a4151df0 0x7f94a414a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 --2- 172.21.15.26:0/576657280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94a40c7de0 0x7f94a4145f40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 >> 172.21.15.26:0/576657280 conn(0x7f94a40abab0 msgr2=0x7f94a4151020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 shutdown_connections 2023-11-28T16:58:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.676+0000 7f94a9356640 1 -- 172.21.15.26:0/576657280 wait complete. 2023-11-28T16:58:54.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T16:58:54.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.840+0000 7fca83d3e640 1 Processor -- start 2023-11-28T16:58:54.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.840+0000 7fca83d3e640 1 -- start start 2023-11-28T16:58:54.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.840+0000 7fca83d3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.840+0000 7fca83d3e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca7c06d100 0x7fca7c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.840+0000 7fca83d3e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c06bea0 con 0x7fca7c152ce0 2023-11-28T16:58:54.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.840+0000 7fca83d3e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c159b10 con 0x7fca7c06d100 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.840+0000 7fca83d3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c159550 con 0x7fca7c06db80 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca7c06d100 0x7fca7c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca812d9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca7c06d100 0x7fca7c0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59552/0 (socket says 172.21.15.26:59552) 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 -- 172.21.15.26:0/2338801314 learned_addr learned my addr 172.21.15.26:0/2338801314 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 -- 172.21.15.26:0/2338801314 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 msgr2=0x7fca7c06c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 --2- 172.21.15.26:0/2338801314 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c06c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 -- 172.21.15.26:0/2338801314 >> v1:172.21.15.79:6789/0 conn(0x7fca7c152ce0 legacy=0x7fca7c0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 -- 172.21.15.26:0/2338801314 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c159830 con 0x7fca7c06d100 2023-11-28T16:58:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca822db640 1 --2- 172.21.15.26:0/2338801314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c0c19e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fca74009e50 tx=0x7fca7401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb545828cf814432 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca80ad8640 1 -- 172.21.15.26:0/2338801314 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740a5840 con 0x7fca7c06d100 2023-11-28T16:58:54.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca80ad8640 1 -- 172.21.15.26:0/2338801314 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca740a59a0 con 0x7fca7c06d100 2023-11-28T16:58:54.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.844+0000 7fca80ad8640 1 -- 172.21.15.26:0/2338801314 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740a5d30 con 0x7fca7c06d100 2023-11-28T16:58:54.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- 172.21.15.26:0/2338801314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 msgr2=0x7fca7c0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 --2- 172.21.15.26:0/2338801314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c0c19e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fca74009e50 tx=0x7fca7401c980 comp rx=0 tx=0).stop 2023-11-28T16:58:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- 172.21.15.26:0/2338801314 shutdown_connections 2023-11-28T16:58:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 --2- 172.21.15.26:0/2338801314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c0c19e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 --2- 172.21.15.26:0/2338801314 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c06c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- 172.21.15.26:0/2338801314 >> 172.21.15.26:0/2338801314 conn(0x7fca7c0c2ad0 msgr2=0x7fca7c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- 172.21.15.26:0/2338801314 shutdown_connections 2023-11-28T16:58:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- 172.21.15.26:0/2338801314 wait complete. 2023-11-28T16:58:54.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 Processor -- start 2023-11-28T16:58:54.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- start start 2023-11-28T16:58:54.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c1f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7c152ce0 0x7fca7c0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c149ad0 con 0x7fca7c06d100 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c14c6f0 con 0x7fca7c152ce0 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca83d3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c1f4c50 con 0x7fca7c06db80 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c14eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59558/0 (socket says 172.21.15.26:59558) 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 -- 172.21.15.26:0/400206499 learned_addr learned my addr 172.21.15.26:0/400206499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca822db640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7c152ce0 0x7fca7c0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca812d9640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c1f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 -- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 msgr2=0x7fca7c1f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c1f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 -- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7c152ce0 msgr2=0x7fca7c0c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7c152ce0 0x7fca7c0c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:54.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.848+0000 7fca81ada640 1 -- 172.21.15.26:0/400206499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74009b30 con 0x7fca7c06d100 2023-11-28T16:58:54.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca81ada640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c14eca0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c500 tx=0x7fca7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca727fc640 1 -- 172.21.15.26:0/400206499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78005220 con 0x7fca7c06d100 2023-11-28T16:58:54.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca727fc640 1 -- 172.21.15.26:0/400206499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78005380 con 0x7fca7c06d100 2023-11-28T16:58:54.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c14c410 con 0x7fca7c06d100 2023-11-28T16:58:54.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca727fc640 1 -- 172.21.15.26:0/400206499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78007270 con 0x7fca7c06d100 2023-11-28T16:58:54.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c1f51d0 con 0x7fca7c06d100 2023-11-28T16:58:54.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c04e890 con 0x7fca7c06d100 2023-11-28T16:58:54.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca727fc640 1 -- 172.21.15.26:0/400206499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fca780073d0 con 0x7fca7c06d100 2023-11-28T16:58:54.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca727fc640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca60066900 0x7fca60068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:54.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca727fc640 1 -- 172.21.15.26:0/400206499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca78083420 con 0x7fca7c06d100 2023-11-28T16:58:54.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.852+0000 7fca812d9640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca60066900 0x7fca60068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:54.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.856+0000 7fca812d9640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca60066900 0x7fca60068dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca7c067a70 tx=0x7fca6c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:54.856+0000 7fca727fc640 1 -- 172.21.15.26:0/400206499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca780509d0 con 0x7fca7c06d100 2023-11-28T16:58:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.016+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fca7c06cee0 con 0x7fca7c06d100 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.016+0000 7fca727fc640 1 -- 172.21.15.26:0/400206499 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) v1 ==== 84+0+65 (secure 0 0 0) 0x7fca78053ff0 con 0x7fca7c06d100 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:58:55.021 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca60066900 msgr2=0x7fca60068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca60066900 0x7fca60068dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca7c067a70 tx=0x7fca6c009190 comp rx=0 tx=0).stop 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 msgr2=0x7fca7c14eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c14eca0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c500 tx=0x7fca7800c9c0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 shutdown_connections 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca7c152ce0 0x7fca7c0c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fca60066900 0x7fca60068dc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca7c06db80 0x7fca7c1f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 --2- 172.21.15.26:0/400206499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca7c06d100 0x7fca7c14eca0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 >> 172.21.15.26:0/400206499 conn(0x7fca7c0c2ad0 msgr2=0x7fca7c0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 shutdown_connections 2023-11-28T16:58:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.020+0000 7fca83d3e640 1 -- 172.21.15.26:0/400206499 wait complete. 2023-11-28T16:58:55.045 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T16:58:55.045 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T16:58:55.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cddb8d640 1 Processor -- start 2023-11-28T16:58:55.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cddb8d640 1 -- start start 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cddb8d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cd8154ea0 0x7f6cd8155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cddb8d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd8070260 0x7f6cd80706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cddb8d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd81559d0 con 0x7f6cd806b0c0 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cddb8d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd81557c0 con 0x7f6cd8154ea0 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cddb8d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd806d910 con 0x7f6cd8070260 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cd8154ea0 0x7f6cd8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cd8154ea0 0x7f6cd8155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59570/0 (socket says 172.21.15.26:59570) 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd77fe640 1 -- 172.21.15.26:0/1062536066 learned_addr learned my addr 172.21.15.26:0/1062536066 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:55.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd6ffd640 1 --1- 172.21.15.26:0/1062536066 >> v1:172.21.15.79:6789/0 conn(0x7f6cd806b0c0 0x7f6cd814e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:37488/0 (socket says 172.21.15.26:37488) 2023-11-28T16:58:55.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd7fff640 1 --2- 172.21.15.26:0/1062536066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd8070260 0x7f6cd80706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:55.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd77fe640 1 -- 172.21.15.26:0/1062536066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd8070260 msgr2=0x7f6cd80706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:55.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd77fe640 1 --2- 172.21.15.26:0/1062536066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd8070260 0x7f6cd80706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd77fe640 1 -- 172.21.15.26:0/1062536066 >> v1:172.21.15.79:6789/0 conn(0x7f6cd806b0c0 legacy=0x7f6cd814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.188+0000 7f6cd77fe640 1 -- 172.21.15.26:0/1062536066 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80c1230 con 0x7f6cd8154ea0 2023-11-28T16:58:55.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cd77fe640 1 --2- 172.21.15.26:0/1062536066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd8155280 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800bb10 tx=0x7f6cc801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2878fcea1c658674 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:55.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cd67fc640 1 -- 172.21.15.26:0/1062536066 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80a7c50 con 0x7f6cd8154ea0 2023-11-28T16:58:55.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cd67fc640 1 -- 172.21.15.26:0/1062536066 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc80a7db0 con 0x7f6cd8154ea0 2023-11-28T16:58:55.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cd67fc640 1 -- 172.21.15.26:0/1062536066 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80af660 con 0x7f6cd8154ea0 2023-11-28T16:58:55.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 -- 172.21.15.26:0/1062536066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 msgr2=0x7f6cd8155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/1062536066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd8155280 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800bb10 tx=0x7f6cc801eb80 comp rx=0 tx=0).stop 2023-11-28T16:58:55.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 -- 172.21.15.26:0/1062536066 shutdown_connections 2023-11-28T16:58:55.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/1062536066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd8070260 0x7f6cd80706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/1062536066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd8155280 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 -- 172.21.15.26:0/1062536066 >> 172.21.15.26:0/1062536066 conn(0x7f6cd806a5a0 msgr2=0x7f6cd806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:55.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 -- 172.21.15.26:0/1062536066 shutdown_connections 2023-11-28T16:58:55.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.192+0000 7f6cddb8d640 1 -- 172.21.15.26:0/1062536066 wait complete. 2023-11-28T16:58:55.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 Processor -- start 2023-11-28T16:58:55.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 -- start start 2023-11-28T16:58:55.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd806b0c0 0x7f6cd814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:55.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cd8070260 0x7f6cd8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd80ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80abd80 con 0x7f6cd8154ea0 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8150430 con 0x7f6cd8070260 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80aa1d0 con 0x7f6cd806b0c0 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd80ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd77fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd806b0c0 0x7f6cd814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd80ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59576/0 (socket says 172.21.15.26:59576) 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 -- 172.21.15.26:0/4113072386 learned_addr learned my addr 172.21.15.26:0/4113072386 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd6ffd640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cd8070260 0x7f6cd8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 -- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd806b0c0 msgr2=0x7f6cd814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd806b0c0 0x7f6cd814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 -- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cd8070260 msgr2=0x7f6cd8153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cd8070260 0x7f6cd8153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 -- 172.21.15.26:0/4113072386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc800b770 con 0x7f6cd8154ea0 2023-11-28T16:58:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cd7fff640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd80ab270 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000efc0 tx=0x7f6cd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cbffff640 1 -- 172.21.15.26:0/4113072386 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0014480 con 0x7f6cd8154ea0 2023-11-28T16:58:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cbffff640 1 -- 172.21.15.26:0/4113072386 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd000f040 con 0x7f6cd8154ea0 2023-11-28T16:58:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd80aa4b0 con 0x7f6cd8154ea0 2023-11-28T16:58:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cbffff640 1 -- 172.21.15.26:0/4113072386 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0014820 con 0x7f6cd8154ea0 2023-11-28T16:58:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.196+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd80aaa70 con 0x7f6cd8154ea0 2023-11-28T16:58:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.200+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd80a98e0 con 0x7f6cd8154ea0 2023-11-28T16:58:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.200+0000 7f6cbffff640 1 -- 172.21.15.26:0/4113072386 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6cd0014980 con 0x7f6cd8154ea0 2023-11-28T16:58:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.200+0000 7f6cbffff640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6cc40668d0 0x7f6cc4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.200+0000 7f6cbffff640 1 -- 172.21.15.26:0/4113072386 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6cd0084b90 con 0x7f6cd8154ea0 2023-11-28T16:58:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.200+0000 7f6cd77fe640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6cc40668d0 0x7f6cc4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.200+0000 7f6cd77fe640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6cc40668d0 0x7f6cc4068d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80b1000 tx=0x7f6cc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.204+0000 7f6cbffff640 1 -- 172.21.15.26:0/4113072386 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cd0052130 con 0x7f6cd8154ea0 2023-11-28T16:58:55.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.364+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6cd806dd80 con 0x7f6cd8154ea0 2023-11-28T16:58:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.824+0000 7f6cbffff640 1 -- 172.21.15.26:0/4113072386 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6cd806dd80 con 0x7f6cd8154ea0 2023-11-28T16:58:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-11-28T16:58:55.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6cc40668d0 msgr2=0x7f6cc4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6cc40668d0 0x7f6cc4068d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80b1000 tx=0x7f6cc8008040 comp rx=0 tx=0).stop 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 msgr2=0x7f6cd80ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd80ab270 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000efc0 tx=0x7f6cd000c490 comp rx=0 tx=0).stop 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 shutdown_connections 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd8154ea0 0x7f6cd80ab270 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cd8070260 0x7f6cd8153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6cc40668d0 0x7f6cc4068d90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 --2- 172.21.15.26:0/4113072386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6cd806b0c0 0x7f6cd814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 >> 172.21.15.26:0/4113072386 conn(0x7f6cd806a5a0 msgr2=0x7f6cd8143fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 shutdown_connections 2023-11-28T16:58:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:55.828+0000 7f6cddb8d640 1 -- 172.21.15.26:0/4113072386 wait complete. 2023-11-28T16:58:55.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T16:58:56.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e201e6640 1 Processor -- start 2023-11-28T16:58:56.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e201e6640 1 -- start start 2023-11-28T16:58:56.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e201e6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:56.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e201e6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1e18158ff0 0x7f1e18159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:56.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e201e6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e181599c0 con 0x7f1e181561d0 2023-11-28T16:58:56.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e201e6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e18071020 con 0x7f1e18158ff0 2023-11-28T16:58:56.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e201e6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18071300 con 0x7f1e18070760 2023-11-28T16:58:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1d781640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1d781640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:55414/0 (socket says 172.21.15.26:55414) 2023-11-28T16:58:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1d781640 1 -- 172.21.15.26:0/3808659490 learned_addr learned my addr 172.21.15.26:0/3808659490 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1e783640 1 --2- 172.21.15.26:0/3808659490 >> v2:172.21.15.79:3300/0 conn(0x7f1e18158ff0 0x7f1e18159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1d781640 1 -- 172.21.15.26:0/3808659490 >> v2:172.21.15.79:3300/0 conn(0x7f1e18158ff0 msgr2=0x7f1e18159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1d781640 1 --2- 172.21.15.26:0/3808659490 >> v2:172.21.15.79:3300/0 conn(0x7f1e18158ff0 0x7f1e18159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1d781640 1 -- 172.21.15.26:0/3808659490 >> v1:172.21.15.79:6789/0 conn(0x7f1e181561d0 legacy=0x7f1e1806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:56.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.004+0000 7f1e1d781640 1 -- 172.21.15.26:0/3808659490 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180715e0 con 0x7f1e18070760 2023-11-28T16:58:56.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e1d781640 1 --2- 172.21.15.26:0/3808659490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180701f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009870 tx=0x7f1e0801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7cb96902efaa75 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:56.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e1cf80640 1 -- 172.21.15.26:0/3808659490 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080ac620 con 0x7f1e18070760 2023-11-28T16:58:56.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e1cf80640 1 -- 172.21.15.26:0/3808659490 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e080ac780 con 0x7f1e18070760 2023-11-28T16:58:56.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e1cf80640 1 -- 172.21.15.26:0/3808659490 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080acb10 con 0x7f1e18070760 2023-11-28T16:58:56.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 -- 172.21.15.26:0/3808659490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 msgr2=0x7f1e180701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:56.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3808659490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180701f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009870 tx=0x7f1e0801c4b0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 -- 172.21.15.26:0/3808659490 shutdown_connections 2023-11-28T16:58:56.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3808659490 >> v2:172.21.15.79:3300/0 conn(0x7f1e18158ff0 0x7f1e18159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3808659490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180701f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 -- 172.21.15.26:0/3808659490 >> 172.21.15.26:0/3808659490 conn(0x7f1e180c2a60 msgr2=0x7f1e180c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:56.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 -- 172.21.15.26:0/3808659490 shutdown_connections 2023-11-28T16:58:56.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.008+0000 7f1e201e6640 1 -- 172.21.15.26:0/3808659490 wait complete. 2023-11-28T16:58:56.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 Processor -- start 2023-11-28T16:58:56.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 -- start start 2023-11-28T16:58:56.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e181561d0 0x7f1e180a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e18158ff0 0x7f1e181f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18149480 con 0x7f1e181561d0 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180c5e00 con 0x7f1e18158ff0 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180ab620 con 0x7f1e18070760 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e181561d0 0x7f1e180a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e181561d0 0x7f1e180a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59590/0 (socket says 172.21.15.26:59590) 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 -- 172.21.15.26:0/3256804368 learned_addr learned my addr 172.21.15.26:0/3256804368 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1e783640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e18158ff0 0x7f1e181f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1df82640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 -- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 msgr2=0x7f1e180ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 -- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e18158ff0 msgr2=0x7f1e181f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e18158ff0 0x7f1e181f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 -- 172.21.15.26:0/3256804368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080094d0 con 0x7f1e181561d0 2023-11-28T16:58:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e1d781640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e181561d0 0x7f1e180a96d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1e0801a0e0 tx=0x7f1e0801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e0e7fc640 1 -- 172.21.15.26:0/3256804368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080b7420 con 0x7f1e181561d0 2023-11-28T16:58:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e0e7fc640 1 -- 172.21.15.26:0/3256804368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e080b7580 con 0x7f1e181561d0 2023-11-28T16:58:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e0e7fc640 1 -- 172.21.15.26:0/3256804368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080b7930 con 0x7f1e181561d0 2023-11-28T16:58:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e180abe30 con 0x7f1e181561d0 2023-11-28T16:58:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.012+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e181f5880 con 0x7f1e181561d0 2023-11-28T16:58:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.016+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e180aae00 con 0x7f1e181561d0 2023-11-28T16:58:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.016+0000 7f1e0e7fc640 1 -- 172.21.15.26:0/3256804368 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1e080b3040 con 0x7f1e181561d0 2023-11-28T16:58:56.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.016+0000 7f1e0e7fc640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1dfc0668d0 0x7f1dfc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:56.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.016+0000 7f1e0e7fc640 1 -- 172.21.15.26:0/3256804368 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1e0811e400 con 0x7f1e181561d0 2023-11-28T16:58:56.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.016+0000 7f1e1df82640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1dfc0668d0 0x7f1dfc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:56.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.016+0000 7f1e1df82640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1dfc0668d0 0x7f1dfc068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1e14007fd0 tx=0x7f1e14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:56.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.020+0000 7f1e0e7fc640 1 -- 172.21.15.26:0/3256804368 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e180aae00 con 0x7f1e181561d0 2023-11-28T16:58:56.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.180+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1e180aae00 con 0x7f1e181561d0 2023-11-28T16:58:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.828+0000 7f1e0e7fc640 1 -- 172.21.15.26:0/3256804368 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1e180aae00 con 0x7f1e181561d0 2023-11-28T16:58:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-11-28T16:58:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1dfc0668d0 msgr2=0x7f1dfc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1dfc0668d0 0x7f1dfc068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1e14007fd0 tx=0x7f1e14009040 comp rx=0 tx=0).stop 2023-11-28T16:58:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e181561d0 msgr2=0x7f1e180a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e181561d0 0x7f1e180a96d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1e0801a0e0 tx=0x7f1e0801acf0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 shutdown_connections 2023-11-28T16:58:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e18158ff0 0x7f1e181f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e181561d0 0x7f1e180a96d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1dfc0668d0 0x7f1dfc068d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 --2- 172.21.15.26:0/3256804368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1e18070760 0x7f1e180ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 >> 172.21.15.26:0/3256804368 conn(0x7f1e180c2a60 msgr2=0x7f1e18156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.832+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 shutdown_connections 2023-11-28T16:58:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:56.836+0000 7f1e201e6640 1 -- 172.21.15.26:0/3256804368 wait complete. 2023-11-28T16:58:56.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T16:58:57.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.020+0000 7fbbe326b640 1 Processor -- start 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe326b640 1 -- start start 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe326b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbdc06b810 0x7fbbdc0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe326b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbdc0c2a60 0x7fbbdc06e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe326b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc073710 con 0x7fbbdc06f0d0 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe326b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc1589f0 con 0x7fbbdc0c2a60 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe326b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc1586e0 con 0x7fbbdc06b810 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1808640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbdc0c2a60 0x7fbbdc06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1808640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbdc0c2a60 0x7fbbdc06e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59598/0 (socket says 172.21.15.26:59598) 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1808640 1 -- 172.21.15.26:0/2576185540 learned_addr learned my addr 172.21.15.26:0/2576185540 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1007640 1 --2- 172.21.15.26:0/2576185540 >> v2:172.21.15.79:3300/0 conn(0x7fbbdc06b810 0x7fbbdc0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1808640 1 -- 172.21.15.26:0/2576185540 >> v2:172.21.15.79:3300/0 conn(0x7fbbdc06b810 msgr2=0x7fbbdc0c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1808640 1 --2- 172.21.15.26:0/2576185540 >> v2:172.21.15.79:3300/0 conn(0x7fbbdc06b810 0x7fbbdc0c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1808640 1 -- 172.21.15.26:0/2576185540 >> v1:172.21.15.79:6789/0 conn(0x7fbbdc06f0d0 legacy=0x7fbbdc0bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:57.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.024+0000 7fbbe1808640 1 -- 172.21.15.26:0/2576185540 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0a6010 con 0x7fbbdc0c2a60 2023-11-28T16:58:57.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe1808640 1 --2- 172.21.15.26:0/2576185540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc06e550 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0aca70 tx=0x7fbbd401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5d88c48609ea46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbd3fff640 1 -- 172.21.15.26:0/2576185540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40a5690 con 0x7fbbdc0c2a60 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbd3fff640 1 -- 172.21.15.26:0/2576185540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd40a57f0 con 0x7fbbdc0c2a60 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbd3fff640 1 -- 172.21.15.26:0/2576185540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40a5b80 con 0x7fbbdc0c2a60 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 -- 172.21.15.26:0/2576185540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 msgr2=0x7fbbdc06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 --2- 172.21.15.26:0/2576185540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc06e550 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0aca70 tx=0x7fbbd401c9d0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 -- 172.21.15.26:0/2576185540 shutdown_connections 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 --2- 172.21.15.26:0/2576185540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc06e550 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 --2- 172.21.15.26:0/2576185540 >> v2:172.21.15.79:3300/0 conn(0x7fbbdc06b810 0x7fbbdc0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 -- 172.21.15.26:0/2576185540 >> 172.21.15.26:0/2576185540 conn(0x7fbbdc0c3240 msgr2=0x7fbbdc0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:57.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 -- 172.21.15.26:0/2576185540 shutdown_connections 2023-11-28T16:58:57.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 -- 172.21.15.26:0/2576185540 wait complete. 2023-11-28T16:58:57.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.028+0000 7fbbe326b640 1 Processor -- start 2023-11-28T16:58:57.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 -- start start 2023-11-28T16:58:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc06b810 0x7fbbdc149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbdc06f0d0 0x7fbbdc156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc14c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc148650 con 0x7fbbdc0c2a60 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1ed100 con 0x7fbbdc06b810 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1ed960 con 0x7fbbdc06f0d0 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1808640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc06b810 0x7fbbdc149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc06b810 0x7fbbdc149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:35428/0 (socket says 172.21.15.26:35428) 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 -- 172.21.15.26:0/1399742368 learned_addr learned my addr 172.21.15.26:0/1399742368 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe0806640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbdc06f0d0 0x7fbbdc156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 -- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbdc06f0d0 msgr2=0x7fbbdc156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbdc06f0d0 0x7fbbdc156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 -- 172.21.15.26:0/1399742368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 msgr2=0x7fbbdc14c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc14c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 -- 172.21.15.26:0/1399742368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4009b30 con 0x7fbbdc06b810 2023-11-28T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1808640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe1007640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc06b810 0x7fbbdc149960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800d800 tx=0x7fbbd800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbd1ffb640 1 -- 172.21.15.26:0/1399742368 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800b6c0 con 0x7fbbdc06b810 2023-11-28T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbd1ffb640 1 -- 172.21.15.26:0/1399742368 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800b860 con 0x7fbbdc06b810 2023-11-28T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc1570d0 con 0x7fbbdc06b810 2023-11-28T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbd1ffb640 1 -- 172.21.15.26:0/1399742368 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800bc10 con 0x7fbbdc06b810 2023-11-28T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc1ed5f0 con 0x7fbbdc06b810 2023-11-28T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.032+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc04e890 con 0x7fbbdc06b810 2023-11-28T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.036+0000 7fbbd1ffb640 1 -- 172.21.15.26:0/1399742368 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbbd801e460 con 0x7fbbdc06b810 2023-11-28T16:58:57.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.036+0000 7fbbd1ffb640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbc00668d0 0x7fbbc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:57.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.036+0000 7fbbd1ffb640 1 -- 172.21.15.26:0/1399742368 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbbd8084870 con 0x7fbbdc06b810 2023-11-28T16:58:57.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.036+0000 7fbbe0806640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbc00668d0 0x7fbbc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:57.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.036+0000 7fbbe0806640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbc00668d0 0x7fbbc0068d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc148aa0 tx=0x7fbbcc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.040+0000 7fbbd1ffb640 1 -- 172.21.15.26:0/1399742368 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbd8051bb0 con 0x7fbbdc06b810 2023-11-28T16:58:57.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.228+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbbdc0abcf0 con 0x7fbbdc06b810 2023-11-28T16:58:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.848+0000 7fbbd1ffb640 1 -- 172.21.15.26:0/1399742368 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbbd80551d0 con 0x7fbbdc06b810 2023-11-28T16:58:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 12 and data pool 13 2023-11-28T16:58:57.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.856+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbc00668d0 msgr2=0x7fbbc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:57.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.856+0000 7fbbe326b640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbc00668d0 0x7fbbc0068d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc148aa0 tx=0x7fbbcc009040 comp rx=0 tx=0).stop 2023-11-28T16:58:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.856+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc06b810 msgr2=0x7fbbdc149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.856+0000 7fbbe326b640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc06b810 0x7fbbdc149960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800d800 tx=0x7fbbd800dcc0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 shutdown_connections 2023-11-28T16:58:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbdc0c2a60 0x7fbbdc14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbbc00668d0 0x7fbbc0068d90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbdc06f0d0 0x7fbbdc156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 --2- 172.21.15.26:0/1399742368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc06b810 0x7fbbdc149960 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 >> 172.21.15.26:0/1399742368 conn(0x7fbbdc0c3240 msgr2=0x7fbbdc0bfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 shutdown_connections 2023-11-28T16:58:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:57.860+0000 7fbbe326b640 1 -- 172.21.15.26:0/1399742368 wait complete. 2023-11-28T16:58:57.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34b5a32640 1 Processor -- start 2023-11-28T16:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34b5a32640 1 -- start start 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34b5a32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 0x7f34b0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34b5a32640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b006d320 con 0x7f34b0070b80 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34b5a32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00721b0 con 0x7f34b014e9d0 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34b5a32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00c2830 con 0x7f34b00a8470 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34a7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f34b0070b80 0x7f34b006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55462/0 (socket says 172.21.15.26:55462) 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34a7fff640 1 -- 172.21.15.26:0/319740487 learned_addr learned my addr 172.21.15.26:0/319740487 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34af7fe640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 0x7f34b0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605865311 0 0) 0x7f34b006d320 con 0x7f34b0070b80 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f349c003530 con 0x7f34b0070b80 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679370847 0 0) 0x7f34b00721b0 con 0x7f34b014e9d0 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b006d320 con 0x7f34b014e9d0 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097856927 0 0) 0x7f349c003530 con 0x7f34b0070b80 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 msgr2=0x7f34b0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 0x7f34b0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 >> v1:172.21.15.79:6789/0 conn(0x7f34b014e9d0 legacy=0x7f34b00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b0072450 con 0x7f34b0070b80 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f3498001680 con 0x7f34b0070b80 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 >> v1:172.21.15.26:6789/0 conn(0x7f34b0070b80 legacy=0x7f34b006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 0x7f349c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c0040a0 0x7f349c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f349c004d10 0x7f349c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00c2830 con 0x7f349c004d10 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c00bb20 con 0x7f349c0040a0 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c00bcb0 con 0x7f34b00a8470 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34af7fe640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f349c004d10 0x7f349c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34a7fff640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c0040a0 0x7f349c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.032+0000 7f34aeffd640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 0x7f349c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34af7fe640 1 -- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 msgr2=0x7f349c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34af7fe640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b00a8470 0x7f349c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34af7fe640 1 -- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c0040a0 msgr2=0x7f349c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34af7fe640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c0040a0 0x7f349c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34af7fe640 1 -- 172.21.15.26:0/319740487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c003530 con 0x7f349c004d10 2023-11-28T16:58:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34a7fff640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c0040a0 0x7f349c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34af7fe640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f349c004d10 0x7f349c005190 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f34a8010450 tx=0x7f34a801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33bd0d9ab2d1488 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80af600 con 0x7f349c004d10 2023-11-28T16:58:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a80ab050 con 0x7f349c004d10 2023-11-28T16:58:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34ae7fc640 1 -- 172.21.15.26:0/319740487 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80af9a0 con 0x7f349c004d10 2023-11-28T16:58:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34b5a32640 1 -- 172.21.15.26:0/319740487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f349c004d10 msgr2=0x7f349c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34b5a32640 1 --2- 172.21.15.26:0/319740487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f349c004d10 0x7f349c005190 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f34a8010450 tx=0x7f34a801f350 comp rx=0 tx=0).stop 2023-11-28T16:58:58.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34af7fe640 1 -- 172.21.15.26:0/319740487 reap_dead start 2023-11-28T16:58:58.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34b5a32640 1 -- 172.21.15.26:0/319740487 shutdown_connections 2023-11-28T16:58:58.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.036+0000 7f34b5a32640 1 -- 172.21.15.26:0/319740487 >> 172.21.15.26:0/319740487 conn(0x7f34b00c2ad0 msgr2=0x7f34b00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:58.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 -- 172.21.15.26:0/319740487 shutdown_connections 2023-11-28T16:58:58.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 -- 172.21.15.26:0/319740487 wait complete. 2023-11-28T16:58:58.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 Processor -- start 2023-11-28T16:58:58.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 -- start start 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f349c004d10 0x7f34b00c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b0155310 0x7f34b0148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34b0149170 0x7f34b01ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00c57e0 con 0x7f34b0149170 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00a9e60 con 0x7f34b0155310 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34b5a32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00aa700 con 0x7f349c004d10 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34b0149170 0x7f34b01ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34b0149170 0x7f34b01ed060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59620/0 (socket says 172.21.15.26:59620) 2023-11-28T16:58:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 -- 172.21.15.26:0/3760690935 learned_addr learned my addr 172.21.15.26:0/3760690935 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34a7fff640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b0155310 0x7f34b0148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34aeffd640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f349c004d10 0x7f34b00c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 -- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f349c004d10 msgr2=0x7f34b00c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f349c004d10 0x7f34b00c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 -- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b0155310 msgr2=0x7f34b0148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b0155310 0x7f34b0148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 -- 172.21.15.26:0/3760690935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b01557a0 con 0x7f34b0149170 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.040+0000 7f34af7fe640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34b0149170 0x7f34b01ed060 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f34a8002240 tx=0x7f34a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34acff9640 1 -- 172.21.15.26:0/3760690935 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80afb10 con 0x7f34b0149170 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34acff9640 1 -- 172.21.15.26:0/3760690935 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a80afc70 con 0x7f34b0149170 2023-11-28T16:58:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34acff9640 1 -- 172.21.15.26:0/3760690935 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80b8460 con 0x7f34b0149170 2023-11-28T16:58:58.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b00aa0b0 con 0x7f34b0149170 2023-11-28T16:58:58.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00c5360 con 0x7f34b0149170 2023-11-28T16:58:58.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b004e890 con 0x7f34b0149170 2023-11-28T16:58:58.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34acff9640 1 -- 172.21.15.26:0/3760690935 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f34a80b6070 con 0x7f34b0149170 2023-11-28T16:58:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34acff9640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f34900668d0 0x7f3490068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34acff9640 1 -- 172.21.15.26:0/3760690935 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34a0001d30 con 0x7f34b0149170 2023-11-28T16:58:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.044+0000 7f34aeffd640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f34900668d0 0x7f3490068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.048+0000 7f34aeffd640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f34900668d0 0x7f3490068d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f34b0146fb0 tx=0x7f34a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.048+0000 7f34acff9640 1 -- 172.21.15.26:0/3760690935 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34a80ecbe0 con 0x7f34b0149170 2023-11-28T16:58:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.204+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34b00700a0 con 0x7f34b0149170 2023-11-28T16:58:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34acff9640 1 -- 172.21.15.26:0/3760690935 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16501 (secure 0 0 0) 0x7f34a80f0200 con 0x7f34b0149170 2023-11-28T16:58:58.211 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:58.211 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":68,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:57.234848+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f34900668d0 msgr2=0x7f3490068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f34900668d0 0x7f3490068d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f34b0146fb0 tx=0x7f34a0009040 comp rx=0 tx=0).stop 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34b0149170 msgr2=0x7f34b01ed060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34b0149170 0x7f34b01ed060 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f34a8002240 tx=0x7f34a8009750 comp rx=0 tx=0).stop 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 shutdown_connections 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34b0149170 0x7f34b01ed060 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b0155310 0x7f34b0148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f34900668d0 0x7f3490068d90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 --2- 172.21.15.26:0/3760690935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f349c004d10 0x7f34b00c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 >> 172.21.15.26:0/3760690935 conn(0x7f34b00c2ad0 msgr2=0x7f34b014b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:58.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 shutdown_connections 2023-11-28T16:58:58.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.208+0000 7f34b5a32640 1 -- 172.21.15.26:0/3760690935 wait complete. 2023-11-28T16:58:58.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:58:58.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb734ba7640 1 Processor -- start 2023-11-28T16:58:58.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb734ba7640 1 -- start start 2023-11-28T16:58:58.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb734ba7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 0x7fb73006d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb734ba7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb730070940 con 0x7fb73006bf00 2023-11-28T16:58:58.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb734ba7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73006d790 con 0x7fb730151770 2023-11-28T16:58:58.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb734ba7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300c1bd0 con 0x7fb730070dd0 2023-11-28T16:58:58.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb73006bf00 0x7fb7300c09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55472/0 (socket says 172.21.15.26:55472) 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72ffff640 1 -- 172.21.15.26:0/888176156 learned_addr learned my addr 172.21.15.26:0/888176156 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 0x7fb73006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341761685 0 0) 0x7fb730070940 con 0x7fb73006bf00 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb718005740 con 0x7fb73006bf00 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085339048 0 0) 0x7fb73006d790 con 0x7fb730151770 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb730070940 con 0x7fb730151770 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3868424984 0 0) 0x7fb718005740 con 0x7fb73006bf00 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 msgr2=0x7fb73006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 0x7fb73006d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 >> v1:172.21.15.79:6789/0 conn(0x7fb730151770 legacy=0x7fb730071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb730070010 con 0x7fb73006bf00 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fb728001a00 con 0x7fb73006bf00 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 0x7fb73006d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 >> v1:172.21.15.26:6789/0 conn(0x7fb73006bf00 legacy=0x7fb7300c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb718005d50 0x7fb718006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7180069e0 0x7fb718006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 0x7fb7180073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300c1bd0 con 0x7fb7180069e0 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71800dc80 con 0x7fb718005d50 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71800de40 con 0x7fb730070dd0 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72effd640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7180069e0 0x7fb718006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb718005d50 0x7fb718006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72ffff640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 0x7fb7180073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72effd640 1 -- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 msgr2=0x7fb7180073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72effd640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb730070dd0 0x7fb7180073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72effd640 1 -- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb718005d50 msgr2=0x7fb718006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72effd640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb718005d50 0x7fb718006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.376+0000 7fb72effd640 1 -- 172.21.15.26:0/888176156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009420 con 0x7fb7180069e0 2023-11-28T16:58:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb72effd640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7180069e0 0x7fb718006e60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb724007fd0 tx=0x7fb72401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa28d7d3367429a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240052d0 con 0x7fb7180069e0 2023-11-28T16:58:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240a7050 con 0x7fb7180069e0 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb72e7fc640 1 -- 172.21.15.26:0/888176156 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724003600 con 0x7fb7180069e0 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb734ba7640 1 -- 172.21.15.26:0/888176156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7180069e0 msgr2=0x7fb718006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb734ba7640 1 --2- 172.21.15.26:0/888176156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7180069e0 0x7fb718006e60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb724007fd0 tx=0x7fb72401c4f0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb72ffff640 1 -- 172.21.15.26:0/888176156 reap_dead start 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb734ba7640 1 -- 172.21.15.26:0/888176156 shutdown_connections 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb734ba7640 1 -- 172.21.15.26:0/888176156 >> 172.21.15.26:0/888176156 conn(0x7fb7300c5fd0 msgr2=0x7fb7300c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb734ba7640 1 -- 172.21.15.26:0/888176156 shutdown_connections 2023-11-28T16:58:58.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.380+0000 7fb734ba7640 1 -- 172.21.15.26:0/888176156 wait complete. 2023-11-28T16:58:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 Processor -- start 2023-11-28T16:58:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 -- start start 2023-11-28T16:58:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7180069e0 0x7fb730148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb73014ab80 0x7fb7301473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb73014b000 0x7fb730147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73014b5e0 con 0x7fb73014ab80 2023-11-28T16:58:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301487b0 con 0x7fb73014b000 2023-11-28T16:58:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb730149500 con 0x7fb7180069e0 2023-11-28T16:58:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb73014ab80 0x7fb7301473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb73014ab80 0x7fb7301473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59638/0 (socket says 172.21.15.26:59638) 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 -- 172.21.15.26:0/3693410304 learned_addr learned my addr 172.21.15.26:0/3693410304 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7180069e0 0x7fb730148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72ffff640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb73014b000 0x7fb730147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 -- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7180069e0 msgr2=0x7fb730148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7180069e0 0x7fb730148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 -- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb73014b000 msgr2=0x7fb730147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb73014b000 0x7fb730147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 -- 172.21.15.26:0/3693410304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7301de450 con 0x7fb73014ab80 2023-11-28T16:58:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb72effd640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb73014ab80 0x7fb7301473d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb72401c9d0 tx=0x7fb718007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb717fff640 1 -- 172.21.15.26:0/3693410304 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240069e0 con 0x7fb73014ab80 2023-11-28T16:58:58.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb717fff640 1 -- 172.21.15.26:0/3693410304 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724006b40 con 0x7fb73014ab80 2023-11-28T16:58:58.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb717fff640 1 -- 172.21.15.26:0/3693410304 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724007030 con 0x7fb73014ab80 2023-11-28T16:58:58.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7301de730 con 0x7fb73014ab80 2023-11-28T16:58:58.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.384+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb730148a30 con 0x7fb73014ab80 2023-11-28T16:58:58.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.388+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73004e890 con 0x7fb73014ab80 2023-11-28T16:58:58.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.388+0000 7fb717fff640 1 -- 172.21.15.26:0/3693410304 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb724007190 con 0x7fb73014ab80 2023-11-28T16:58:58.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.388+0000 7fb717fff640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb71c0668d0 0x7fb71c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.388+0000 7fb717fff640 1 -- 172.21.15.26:0/3693410304 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb72411e580 con 0x7fb73014ab80 2023-11-28T16:58:58.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.388+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb71c0668d0 0x7fb71c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.388+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb71c0668d0 0x7fb71c068d90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb730150a00 tx=0x7fb720009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.392+0000 7fb717fff640 1 -- 172.21.15.26:0/3693410304 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7240eb980 con 0x7fb73014ab80 2023-11-28T16:58:58.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7300c6630 con 0x7fb73014ab80 2023-11-28T16:58:58.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb717fff640 1 -- 172.21.15.26:0/3693410304 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16488 (secure 0 0 0) 0x7fb7240c4090 con 0x7fb73014ab80 2023-11-28T16:58:58.555 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:58:58.555 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":69,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:58.284206+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:58:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb71c0668d0 msgr2=0x7fb71c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb71c0668d0 0x7fb71c068d90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb730150a00 tx=0x7fb720009190 comp rx=0 tx=0).stop 2023-11-28T16:58:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb73014ab80 msgr2=0x7fb7301473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb73014ab80 0x7fb7301473d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb72401c9d0 tx=0x7fb718007a10 comp rx=0 tx=0).stop 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 shutdown_connections 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb73014b000 0x7fb730147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb73014ab80 0x7fb7301473d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb71c0668d0 0x7fb71c068d90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 --2- 172.21.15.26:0/3693410304 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7180069e0 0x7fb730148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 >> 172.21.15.26:0/3693410304 conn(0x7fb7300c5fd0 msgr2=0x7fb7300c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 shutdown_connections 2023-11-28T16:58:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.552+0000 7fb734ba7640 1 -- 172.21.15.26:0/3693410304 wait complete. 2023-11-28T16:58:58.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T16:58:58.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4c580640 1 Processor -- start 2023-11-28T16:58:58.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4c580640 1 -- start start 2023-11-28T16:58:58.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4c580640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e440a86d0 0x7f9e440a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4c580640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e44156600 0x7f9e4414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4c580640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e44152d90 con 0x7f9e4414fb30 2023-11-28T16:58:58.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4c580640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4414ffa0 con 0x7f9e440a86d0 2023-11-28T16:58:58.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4c580640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e44152480 con 0x7f9e44156600 2023-11-28T16:58:58.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4a31c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e440a86d0 0x7f9e440a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4a31c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e440a86d0 0x7f9e440a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59650/0 (socket says 172.21.15.26:59650) 2023-11-28T16:58:58.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4a31c640 1 -- 172.21.15.26:0/20782706 learned_addr learned my addr 172.21.15.26:0/20782706 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:58.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e49b1b640 1 --2- 172.21.15.26:0/20782706 >> v2:172.21.15.79:3300/0 conn(0x7f9e44156600 0x7f9e4414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4a31c640 1 -- 172.21.15.26:0/20782706 >> v2:172.21.15.79:3300/0 conn(0x7f9e44156600 msgr2=0x7f9e4414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:58:58.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.720+0000 7f9e4a31c640 1 --2- 172.21.15.26:0/20782706 >> v2:172.21.15.79:3300/0 conn(0x7f9e44156600 0x7f9e4414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4a31c640 1 -- 172.21.15.26:0/20782706 >> v1:172.21.15.79:6789/0 conn(0x7f9e4414fb30 legacy=0x7f9e440aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4a31c640 1 -- 172.21.15.26:0/20782706 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440a9760 con 0x7f9e440a86d0 2023-11-28T16:58:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4a31c640 1 --2- 172.21.15.26:0/20782706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e440a8f30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009870 tx=0x7f9e4001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e7bbc5981509d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4931a640 1 -- 172.21.15.26:0/20782706 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400ab5f0 con 0x7f9e440a86d0 2023-11-28T16:58:58.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4931a640 1 -- 172.21.15.26:0/20782706 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e400ab750 con 0x7f9e440a86d0 2023-11-28T16:58:58.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4931a640 1 -- 172.21.15.26:0/20782706 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400abae0 con 0x7f9e440a86d0 2023-11-28T16:58:58.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4c580640 1 -- 172.21.15.26:0/20782706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 msgr2=0x7f9e440a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4c580640 1 --2- 172.21.15.26:0/20782706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e440a8f30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009870 tx=0x7f9e4001c500 comp rx=0 tx=0).stop 2023-11-28T16:58:58.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4c580640 1 -- 172.21.15.26:0/20782706 shutdown_connections 2023-11-28T16:58:58.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4c580640 1 --2- 172.21.15.26:0/20782706 >> v2:172.21.15.79:3300/0 conn(0x7f9e44156600 0x7f9e4414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4c580640 1 --2- 172.21.15.26:0/20782706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e440a8f30 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.724+0000 7f9e4c580640 1 -- 172.21.15.26:0/20782706 >> 172.21.15.26:0/20782706 conn(0x7f9e440c2a60 msgr2=0x7f9e440c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:58.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 -- 172.21.15.26:0/20782706 shutdown_connections 2023-11-28T16:58:58.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 -- 172.21.15.26:0/20782706 wait complete. 2023-11-28T16:58:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 Processor -- start 2023-11-28T16:58:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 -- start start 2023-11-28T16:58:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e4406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4414fb30 0x7f9e441ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e44156600 0x7f9e441ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44153aa0 con 0x7f9e440a86d0 2023-11-28T16:58:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441f1490 con 0x7f9e4414fb30 2023-11-28T16:58:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441f1920 con 0x7f9e44156600 2023-11-28T16:58:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e4406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e4406d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59654/0 (socket says 172.21.15.26:59654) 2023-11-28T16:58:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 -- 172.21.15.26:0/1566766969 learned_addr learned my addr 172.21.15.26:0/1566766969 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:58:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4ab1d640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e44156600 0x7f9e441ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e49b1b640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4414fb30 0x7f9e441ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 -- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e44156600 msgr2=0x7f9e441ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e44156600 0x7f9e441ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 -- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4414fb30 msgr2=0x7f9e441ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4414fb30 0x7f9e441ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 -- 172.21.15.26:0/1566766969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400094d0 con 0x7f9e440a86d0 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4a31c640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e4406d290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9e400ad040 tx=0x7f9e4001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e3affd640 1 -- 172.21.15.26:0/1566766969 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400be5f0 con 0x7f9e440a86d0 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e3affd640 1 -- 172.21.15.26:0/1566766969 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e400be750 con 0x7f9e440a86d0 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e3affd640 1 -- 172.21.15.26:0/1566766969 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400beae0 con 0x7f9e440a86d0 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.728+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e441533a0 con 0x7f9e440a86d0 2023-11-28T16:58:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.732+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e441f0e40 con 0x7f9e440a86d0 2023-11-28T16:58:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.732+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4404e890 con 0x7f9e440a86d0 2023-11-28T16:58:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.732+0000 7f9e3affd640 1 -- 172.21.15.26:0/1566766969 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e400b4600 con 0x7f9e440a86d0 2023-11-28T16:58:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.732+0000 7f9e3affd640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e28066900 0x7f9e28068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:58:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.732+0000 7f9e3affd640 1 -- 172.21.15.26:0/1566766969 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e400a8050 con 0x7f9e440a86d0 2023-11-28T16:58:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.732+0000 7f9e49b1b640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e28066900 0x7f9e28068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:58:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.732+0000 7f9e49b1b640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e28066900 0x7f9e28068dc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9e4414b830 tx=0x7f9e34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:58:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.736+0000 7f9e3affd640 1 -- 172.21.15.26:0/1566766969 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e400ec540 con 0x7f9e440a86d0 2023-11-28T16:58:58.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:58.932+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9e440c3150 con 0x7f9e440a86d0 2023-11-28T16:58:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e3affd640 1 -- 172.21.15.26:0/1566766969 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9e400efb60 con 0x7f9e440a86d0 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e28066900 msgr2=0x7f9e28068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e28066900 0x7f9e28068dc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9e4414b830 tx=0x7f9e34008040 comp rx=0 tx=0).stop 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 msgr2=0x7f9e4406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e4406d290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9e400ad040 tx=0x7f9e4001ad40 comp rx=0 tx=0).stop 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 shutdown_connections 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9e28066900 0x7f9e28068dc0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e44156600 0x7f9e441ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4414fb30 0x7f9e441ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:59.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 --2- 172.21.15.26:0/1566766969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440a86d0 0x7f9e4406d290 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:58:59.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.868+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 >> 172.21.15.26:0/1566766969 conn(0x7f9e440c2a60 msgr2=0x7f9e440c5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:58:59.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.872+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 shutdown_connections 2023-11-28T16:58:59.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:58:59.872+0000 7f9e4c580640 1 -- 172.21.15.26:0/1566766969 wait complete. 2023-11-28T16:58:59.897 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T16:58:59.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T16:59:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57e2b57640 1 Processor -- start 2023-11-28T16:59:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57e2b57640 1 -- start start 2023-11-28T16:59:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57e2b57640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57dc0c8430 0x7f57dc06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57e2b57640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57dc0c7f20 0x7f57dc06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57e2b57640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc06cf70 con 0x7f57dc151d80 2023-11-28T16:59:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57e2b57640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc152160 con 0x7f57dc0c8430 2023-11-28T16:59:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57e2b57640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc0c6a30 con 0x7f57dc0c7f20 2023-11-28T16:59:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.044+0000 7f57dbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57dc0c8430 0x7f57dc06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57dbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57dc0c8430 0x7f57dc06b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59662/0 (socket says 172.21.15.26:59662) 2023-11-28T16:59:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57dbfff640 1 -- 172.21.15.26:0/2167879265 learned_addr learned my addr 172.21.15.26:0/2167879265 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57e10f4640 1 --2- 172.21.15.26:0/2167879265 >> v2:172.21.15.79:3300/0 conn(0x7f57dc0c7f20 0x7f57dc06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57dbfff640 1 -- 172.21.15.26:0/2167879265 >> v2:172.21.15.79:3300/0 conn(0x7f57dc0c7f20 msgr2=0x7f57dc06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57dbfff640 1 --2- 172.21.15.26:0/2167879265 >> v2:172.21.15.79:3300/0 conn(0x7f57dc0c7f20 0x7f57dc06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57dbfff640 1 -- 172.21.15.26:0/2167879265 >> v1:172.21.15.79:6789/0 conn(0x7f57dc151d80 legacy=0x7f57dc0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57dbfff640 1 -- 172.21.15.26:0/2167879265 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0c72d0 con 0x7f57dc0c8430 2023-11-28T16:59:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57e10f4640 1 --2- 172.21.15.26:0/2167879265 >> v2:172.21.15.79:3300/0 conn(0x7f57dc0c7f20 0x7f57dc06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57dbfff640 1 --2- 172.21.15.26:0/2167879265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c8430 0x7f57dc06b720 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0c7a40 tx=0x7f57c801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10295d0a569196c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57db7fe640 1 -- 172.21.15.26:0/2167879265 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80ac640 con 0x7f57dc0c8430 2023-11-28T16:59:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57db7fe640 1 -- 172.21.15.26:0/2167879265 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c80ac7a0 con 0x7f57dc0c8430 2023-11-28T16:59:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.048+0000 7f57db7fe640 1 -- 172.21.15.26:0/2167879265 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80acb30 con 0x7f57dc0c8430 2023-11-28T16:59:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- 172.21.15.26:0/2167879265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c8430 msgr2=0x7f57dc06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 --2- 172.21.15.26:0/2167879265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c8430 0x7f57dc06b720 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0c7a40 tx=0x7f57c801c3e0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- 172.21.15.26:0/2167879265 shutdown_connections 2023-11-28T16:59:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 --2- 172.21.15.26:0/2167879265 >> v2:172.21.15.79:3300/0 conn(0x7f57dc0c7f20 0x7f57dc06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 --2- 172.21.15.26:0/2167879265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c8430 0x7f57dc06b720 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- 172.21.15.26:0/2167879265 >> 172.21.15.26:0/2167879265 conn(0x7f57dc0abd00 msgr2=0x7f57dc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- 172.21.15.26:0/2167879265 shutdown_connections 2023-11-28T16:59:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- 172.21.15.26:0/2167879265 wait complete. 2023-11-28T16:59:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 Processor -- start 2023-11-28T16:59:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- start start 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c7f20 0x7f57dc148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57dc0c8430 0x7f57dc0c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57dc151d80 0x7f57dc0c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc156b90 con 0x7f57dc0c7f20 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc157260 con 0x7f57dc151d80 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e2b57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc156610 con 0x7f57dc0c8430 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c7f20 0x7f57dc148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c7f20 0x7f57dc148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59672/0 (socket says 172.21.15.26:59672) 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 -- 172.21.15.26:0/3734473138 learned_addr learned my addr 172.21.15.26:0/3734473138 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57dbfff640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57dc0c8430 0x7f57dc0c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 -- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57dc0c8430 msgr2=0x7f57dc0c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57dc0c8430 0x7f57dc0c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 -- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57dc151d80 msgr2=0x7f57dc0c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57dc151d80 0x7f57dc0c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57e08f3640 1 -- 172.21.15.26:0/3734473138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80094d0 con 0x7f57dc0c7f20 2023-11-28T16:59:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.052+0000 7f57dbfff640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57dc0c8430 0x7f57dc0c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57e08f3640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c7f20 0x7f57dc148dd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f57d000c580 tx=0x7f57d000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57d97fa640 1 -- 172.21.15.26:0/3734473138 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0012830 con 0x7f57dc0c7f20 2023-11-28T16:59:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57d97fa640 1 -- 172.21.15.26:0/3734473138 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d00129b0 con 0x7f57dc0c7f20 2023-11-28T16:59:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57d97fa640 1 -- 172.21.15.26:0/3734473138 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0012d60 con 0x7f57dc0c7f20 2023-11-28T16:59:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc1568b0 con 0x7f57dc0c7f20 2023-11-28T16:59:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc0aaca0 con 0x7f57dc0c7f20 2023-11-28T16:59:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc04e890 con 0x7f57dc0c7f20 2023-11-28T16:59:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.056+0000 7f57d97fa640 1 -- 172.21.15.26:0/3734473138 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f57d001b400 con 0x7f57dc0c7f20 2023-11-28T16:59:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.060+0000 7f57d97fa640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57c0066900 0x7f57c0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.060+0000 7f57d97fa640 1 -- 172.21.15.26:0/3734473138 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57d0084620 con 0x7f57dc0c7f20 2023-11-28T16:59:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.060+0000 7f57dbfff640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57c0066900 0x7f57c0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.060+0000 7f57dbfff640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57c0066900 0x7f57c0068dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f57c80ae000 tx=0x7f57c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:00.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.060+0000 7f57d97fa640 1 -- 172.21.15.26:0/3734473138 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57d00518f0 con 0x7f57dc0c7f20 2023-11-28T16:59:00.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.252+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f57dc06cb00 con 0x7f57dc0c7f20 2023-11-28T16:59:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.868+0000 7f57d97fa640 1 -- 172.21.15.26:0/3734473138 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f57d00160c0 con 0x7f57dc0c7f20 2023-11-28T16:59:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57c0066900 msgr2=0x7f57c0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57c0066900 0x7f57c0068dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f57c80ae000 tx=0x7f57c8008040 comp rx=0 tx=0).stop 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c7f20 msgr2=0x7f57dc148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c7f20 0x7f57dc148dd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f57d000c580 tx=0x7f57d000ca40 comp rx=0 tx=0).stop 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 shutdown_connections 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57dc151d80 0x7f57dc0c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57c0066900 0x7f57c0068dc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57dc0c8430 0x7f57dc0c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 --2- 172.21.15.26:0/3734473138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57dc0c7f20 0x7f57dc148dd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 >> 172.21.15.26:0/3734473138 conn(0x7f57dc0abd00 msgr2=0x7f57dc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 shutdown_connections 2023-11-28T16:59:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:00.872+0000 7f57e2b57640 1 -- 172.21.15.26:0/3734473138 wait complete. 2023-11-28T16:59:00.902 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T16:59:00.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.044+0000 7f4e5c52a640 1 Processor -- start 2023-11-28T16:59:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5c52a640 1 -- start start 2023-11-28T16:59:01.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5c52a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e540c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5c52a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e540bd720 0x7f4e540c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5c52a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e54155790 con 0x7f4e5406cd90 2023-11-28T16:59:01.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5c52a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540c4b00 con 0x7f4e540bd720 2023-11-28T16:59:01.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5c52a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c4de0 con 0x7f4e540ca610 2023-11-28T16:59:01.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5a2c6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e540c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5a2c6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e540c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:55508/0 (socket says 172.21.15.26:55508) 2023-11-28T16:59:01.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/3297555 learned_addr learned my addr 172.21.15.26:0/3297555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:01.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e59ac5640 1 --2- 172.21.15.26:0/3297555 >> v2:172.21.15.79:3300/0 conn(0x7f4e540bd720 0x7f4e540c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/3297555 >> v2:172.21.15.79:3300/0 conn(0x7f4e540bd720 msgr2=0x7f4e540c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:01.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5a2c6640 1 --2- 172.21.15.26:0/3297555 >> v2:172.21.15.79:3300/0 conn(0x7f4e540bd720 0x7f4e540c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/3297555 >> v1:172.21.15.79:6789/0 conn(0x7f4e5406cd90 legacy=0x7f4e54158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/3297555 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54157e30 con 0x7f4e540ca610 2023-11-28T16:59:01.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.048+0000 7f4e59ac5640 1 --2- 172.21.15.26:0/3297555 >> v2:172.21.15.79:3300/0 conn(0x7f4e540bd720 0x7f4e540c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5a2c6640 1 --2- 172.21.15.26:0/3297555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e540c94c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5001c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=118b708e6ce7c857 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e592c4640 1 -- 172.21.15.26:0/3297555 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540c52d0 con 0x7f4e540ca610 2023-11-28T16:59:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e592c4640 1 -- 172.21.15.26:0/3297555 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500a4940 con 0x7f4e540ca610 2023-11-28T16:59:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e592c4640 1 -- 172.21.15.26:0/3297555 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500a4cd0 con 0x7f4e540ca610 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 -- 172.21.15.26:0/3297555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 msgr2=0x7f4e540c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/3297555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e540c94c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5001c100 comp rx=0 tx=0).stop 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 -- 172.21.15.26:0/3297555 shutdown_connections 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/3297555 >> v2:172.21.15.79:3300/0 conn(0x7f4e540bd720 0x7f4e540c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/3297555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e540c94c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 -- 172.21.15.26:0/3297555 >> 172.21.15.26:0/3297555 conn(0x7f4e54071ea0 msgr2=0x7f4e540722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 -- 172.21.15.26:0/3297555 shutdown_connections 2023-11-28T16:59:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 -- 172.21.15.26:0/3297555 wait complete. 2023-11-28T16:59:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.052+0000 7f4e5c52a640 1 Processor -- start 2023-11-28T16:59:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 -- start start 2023-11-28T16:59:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e5406cd90 0x7f4e54154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e540bd720 0x7f4e54153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e54152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541f1830 con 0x7f4e5406cd90 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540aca80 con 0x7f4e540bd720 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540ac7a0 con 0x7f4e540ca610 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e5406cd90 0x7f4e54154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e5406cd90 0x7f4e54154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59684/0 (socket says 172.21.15.26:59684) 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/433856588 learned_addr learned my addr 172.21.15.26:0/433856588 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e59ac5640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e540bd720 0x7f4e54153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5aac7640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e54152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 msgr2=0x7f4e54152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e54152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e540bd720 msgr2=0x7f4e54153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e540bd720 0x7f4e54153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 -- 172.21.15.26:0/433856588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009420 con 0x7f4e5406cd90 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5a2c6640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e5406cd90 0x7f4e54154540 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4e500af040 tx=0x7f4e500191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e4affd640 1 -- 172.21.15.26:0/433856588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500ac910 con 0x7f4e5406cd90 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e4affd640 1 -- 172.21.15.26:0/433856588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500aca90 con 0x7f4e5406cd90 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e4affd640 1 -- 172.21.15.26:0/433856588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500ace40 con 0x7f4e5406cd90 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e500094d0 con 0x7f4e5406cd90 2023-11-28T16:59:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e54154b70 con 0x7f4e5406cd90 2023-11-28T16:59:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.056+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e54154f60 con 0x7f4e5406cd90 2023-11-28T16:59:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.060+0000 7f4e4affd640 1 -- 172.21.15.26:0/433856588 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e500b3040 con 0x7f4e5406cd90 2023-11-28T16:59:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.060+0000 7f4e4affd640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e380668d0 0x7f4e38068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.060+0000 7f4e4affd640 1 -- 172.21.15.26:0/433856588 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e540cac00 con 0x7f4e5406cd90 2023-11-28T16:59:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.060+0000 7f4e59ac5640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e380668d0 0x7f4e38068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.060+0000 7f4e59ac5640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e380668d0 0x7f4e38068d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e54157560 tx=0x7f4e44009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.064+0000 7f4e4affd640 1 -- 172.21.15.26:0/433856588 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e500eb380 con 0x7f4e5406cd90 2023-11-28T16:59:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.252+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e54066ba0 con 0x7f4e5406cd90 2023-11-28T16:59:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.252+0000 7f4e4affd640 1 -- 172.21.15.26:0/433856588 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f4e54066ba0 con 0x7f4e5406cd90 2023-11-28T16:59:01.256 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:01.257 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:57.235192+0000","modified":"2023-11-28T16:59:00.256436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3229750931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3229750931},{"type":"v1","addr":"172.21.15.26:6835","nonce":3229750931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-28T16:59:01.257 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 47 2023-11-28T16:59:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e380668d0 msgr2=0x7f4e38068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e380668d0 0x7f4e38068d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e54157560 tx=0x7f4e44009190 comp rx=0 tx=0).stop 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e5406cd90 msgr2=0x7f4e54154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e5406cd90 0x7f4e54154540 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4e500af040 tx=0x7f4e500191c0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 shutdown_connections 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4e380668d0 0x7f4e38068d90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e540ca610 0x7f4e54152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e540bd720 0x7f4e54153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 --2- 172.21.15.26:0/433856588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e5406cd90 0x7f4e54154540 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 >> 172.21.15.26:0/433856588 conn(0x7f4e54071ea0 msgr2=0x7f4e540ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 shutdown_connections 2023-11-28T16:59:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.256+0000 7f4e5c52a640 1 -- 172.21.15.26:0/433856588 wait complete. 2023-11-28T16:59:01.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.416+0000 7f9606cd6640 1 Processor -- start 2023-11-28T16:59:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.416+0000 7f9606cd6640 1 -- start start 2023-11-28T16:59:01.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9606cd6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 0x7f9600155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9606cd6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f960006bd00 0x7f96000700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9606cd6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96000bf400 0x7f96000c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9606cd6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960006c440 con 0x7f960006bd00 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9606cd6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9600154790 con 0x7f96000bf400 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9606cd6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960006c6e0 con 0x7f960014ea60 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f960006bd00 0x7f96000700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f960006bd00 0x7f96000700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47804/0 (socket says 172.21.15.26:47804) 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 -- 172.21.15.26:0/775427843 learned_addr learned my addr 172.21.15.26:0/775427843 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9605273640 1 --2- 172.21.15.26:0/775427843 >> v2:172.21.15.79:3300/0 conn(0x7f96000bf400 0x7f96000c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9604a72640 1 --2- 172.21.15.26:0/775427843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 0x7f9600155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 -- 172.21.15.26:0/775427843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 msgr2=0x7f9600155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 --2- 172.21.15.26:0/775427843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 0x7f9600155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 -- 172.21.15.26:0/775427843 >> v2:172.21.15.79:3300/0 conn(0x7f96000bf400 msgr2=0x7f96000c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 --2- 172.21.15.26:0/775427843 >> v2:172.21.15.79:3300/0 conn(0x7f96000bf400 0x7f96000c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 -- 172.21.15.26:0/775427843 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600154a50 con 0x7f960006bd00 2023-11-28T16:59:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f9605273640 1 --2- 172.21.15.26:0/775427843 >> v2:172.21.15.79:3300/0 conn(0x7f96000bf400 0x7f96000c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.420+0000 7f95fffff640 1 --2- 172.21.15.26:0/775427843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96000700a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9600070050 tx=0x7f95ec01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23c5e2e49aacc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f95ff7fe640 1 -- 172.21.15.26:0/775427843 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec004230 con 0x7f960006bd00 2023-11-28T16:59:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f95ff7fe640 1 -- 172.21.15.26:0/775427843 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec0a7050 con 0x7f960006bd00 2023-11-28T16:59:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f95ff7fe640 1 -- 172.21.15.26:0/775427843 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec003620 con 0x7f960006bd00 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- 172.21.15.26:0/775427843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 msgr2=0x7f96000700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 --2- 172.21.15.26:0/775427843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96000700a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9600070050 tx=0x7f95ec01c3b0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- 172.21.15.26:0/775427843 shutdown_connections 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 --2- 172.21.15.26:0/775427843 >> v2:172.21.15.79:3300/0 conn(0x7f96000bf400 0x7f96000c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 --2- 172.21.15.26:0/775427843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96000700a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 --2- 172.21.15.26:0/775427843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 0x7f9600155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- 172.21.15.26:0/775427843 >> 172.21.15.26:0/775427843 conn(0x7f96000c2ad0 msgr2=0x7f96000c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:01.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- 172.21.15.26:0/775427843 shutdown_connections 2023-11-28T16:59:01.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- 172.21.15.26:0/775427843 wait complete. 2023-11-28T16:59:01.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 Processor -- start 2023-11-28T16:59:01.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- start start 2023-11-28T16:59:01.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96001ee770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000bf400 0x7f9600156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 0x7f96001f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9600136a90 con 0x7f960006bd00 2023-11-28T16:59:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960014e230 con 0x7f96000bf400 2023-11-28T16:59:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9606cd6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960013a8c0 con 0x7f960014ea60 2023-11-28T16:59:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.424+0000 7f9604a72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96001ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96001ee770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47818/0 (socket says 172.21.15.26:47818) 2023-11-28T16:59:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 -- 172.21.15.26:0/4041990876 learned_addr learned my addr 172.21.15.26:0/4041990876 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f95fffff640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000bf400 0x7f9600156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 -- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 msgr2=0x7f96001f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 0x7f96001f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 -- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000bf400 msgr2=0x7f9600156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000bf400 0x7f9600156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 -- 172.21.15.26:0/4041990876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec0094d0 con 0x7f960006bd00 2023-11-28T16:59:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f95fffff640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000bf400 0x7f9600156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9604a72640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96001ee770 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f95f400e870 tx=0x7f95f400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f95fd7fa640 1 -- 172.21.15.26:0/4041990876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4009510 con 0x7f960006bd00 2023-11-28T16:59:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f95fd7fa640 1 -- 172.21.15.26:0/4041990876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f400eec0 con 0x7f960006bd00 2023-11-28T16:59:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f95fd7fa640 1 -- 172.21.15.26:0/4041990876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400cb40 con 0x7f960006bd00 2023-11-28T16:59:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960014df50 con 0x7f960006bd00 2023-11-28T16:59:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96001edf70 con 0x7f960006bd00 2023-11-28T16:59:01.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96001eddd0 con 0x7f960006bd00 2023-11-28T16:59:01.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f95fd7fa640 1 -- 172.21.15.26:0/4041990876 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f95f400cca0 con 0x7f960006bd00 2023-11-28T16:59:01.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.428+0000 7f95fd7fa640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95e40668d0 0x7f95e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.432+0000 7f95fd7fa640 1 -- 172.21.15.26:0/4041990876 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95f4084500 con 0x7f960006bd00 2023-11-28T16:59:01.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.432+0000 7f95fffff640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95e40668d0 0x7f95e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.432+0000 7f95fffff640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95e40668d0 0x7f95e4068d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0ad000 tx=0x7f95ec0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.436+0000 7f95fd7fa640 1 -- 172.21.15.26:0/4041990876 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96001eddd0 con 0x7f960006bd00 2023-11-28T16:59:01.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.596+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96001eddd0 con 0x7f960006bd00 2023-11-28T16:59:01.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f95fd7fa640 1 -- 172.21.15.26:0/4041990876 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16488 (secure 0 0 0) 0x7f96001eddd0 con 0x7f960006bd00 2023-11-28T16:59:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:01.603 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":69,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:58.284206+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:01.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95e40668d0 msgr2=0x7f95e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95e40668d0 0x7f95e4068d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0ad000 tx=0x7f95ec0a6000 comp rx=0 tx=0).stop 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 msgr2=0x7f96001ee770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96001ee770 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f95f400e870 tx=0x7f95f400ec70 comp rx=0 tx=0).stop 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 shutdown_connections 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95e40668d0 0x7f95e4068d90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f960014ea60 0x7f96001f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000bf400 0x7f9600156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 --2- 172.21.15.26:0/4041990876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006bd00 0x7f96001ee770 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 >> 172.21.15.26:0/4041990876 conn(0x7f96000c2ad0 msgr2=0x7f9600155150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 shutdown_connections 2023-11-28T16:59:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.600+0000 7f9606cd6640 1 -- 172.21.15.26:0/4041990876 wait complete. 2023-11-28T16:59:01.624 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T16:59:01.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:01.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a76cc9640 1 Processor -- start 2023-11-28T16:59:01.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a76cc9640 1 -- start start 2023-11-28T16:59:01.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a76cc9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a700ca610 0x7f8a700c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a76cc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a7006cd90 0x7f8a700c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a76cc9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a70155790 con 0x7f8a700bd720 2023-11-28T16:59:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a76cc9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700c4b00 con 0x7f8a7006cd90 2023-11-28T16:59:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a76cc9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700c4de0 con 0x7f8a700ca610 2023-11-28T16:59:01.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a75266640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a7006cd90 0x7f8a700c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a75266640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a7006cd90 0x7f8a700c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47834/0 (socket says 172.21.15.26:47834) 2023-11-28T16:59:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a75266640 1 -- 172.21.15.26:0/3002558519 learned_addr learned my addr 172.21.15.26:0/3002558519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a74a65640 1 --2- 172.21.15.26:0/3002558519 >> v2:172.21.15.79:3300/0 conn(0x7f8a700ca610 0x7f8a700c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a75266640 1 -- 172.21.15.26:0/3002558519 >> v2:172.21.15.79:3300/0 conn(0x7f8a700ca610 msgr2=0x7f8a700c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a75266640 1 --2- 172.21.15.26:0/3002558519 >> v2:172.21.15.79:3300/0 conn(0x7f8a700ca610 0x7f8a700c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a75266640 1 -- 172.21.15.26:0/3002558519 >> v1:172.21.15.79:6789/0 conn(0x7f8a700bd720 legacy=0x7f8a70158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.764+0000 7f8a75266640 1 -- 172.21.15.26:0/3002558519 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70157e30 con 0x7f8a7006cd90 2023-11-28T16:59:01.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a75266640 1 --2- 172.21.15.26:0/3002558519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a7006cd90 0x7f8a700c9a00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a700acc80 tx=0x7f8a6801c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e7d8fa830eaa1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a6f7fe640 1 -- 172.21.15.26:0/3002558519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700c52d0 con 0x7f8a7006cd90 2023-11-28T16:59:01.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a6f7fe640 1 -- 172.21.15.26:0/3002558519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680090d0 con 0x7f8a7006cd90 2023-11-28T16:59:01.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a6f7fe640 1 -- 172.21.15.26:0/3002558519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680ac610 con 0x7f8a7006cd90 2023-11-28T16:59:01.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3002558519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a7006cd90 msgr2=0x7f8a700c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3002558519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a7006cd90 0x7f8a700c9a00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a700acc80 tx=0x7f8a6801c590 comp rx=0 tx=0).stop 2023-11-28T16:59:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3002558519 shutdown_connections 2023-11-28T16:59:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3002558519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a7006cd90 0x7f8a700c9a00 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3002558519 >> v2:172.21.15.79:3300/0 conn(0x7f8a700ca610 0x7f8a700c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3002558519 >> 172.21.15.26:0/3002558519 conn(0x7f8a70071ea0 msgr2=0x7f8a700722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3002558519 shutdown_connections 2023-11-28T16:59:01.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.768+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3002558519 wait complete. 2023-11-28T16:59:01.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 Processor -- start 2023-11-28T16:59:01.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 -- start start 2023-11-28T16:59:01.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a7006cd90 0x7f8a70157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a700bd720 0x7f8a701520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a700ca610 0x7f8a70149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700aa8d0 con 0x7f8a700ca610 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700aa440 con 0x7f8a700bd720 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a70157b50 con 0x7f8a7006cd90 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a700ca610 0x7f8a70149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a700ca610 0x7f8a70149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47846/0 (socket says 172.21.15.26:47846) 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 -- 172.21.15.26:0/3965926098 learned_addr learned my addr 172.21.15.26:0/3965926098 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a74a65640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a7006cd90 0x7f8a70157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a6ffff640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a700bd720 0x7f8a701520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 -- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a7006cd90 msgr2=0x7f8a70157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a7006cd90 0x7f8a70157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 -- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a700bd720 msgr2=0x7f8a701520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a700bd720 0x7f8a701520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 -- 172.21.15.26:0/3965926098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009b30 con 0x7f8a700ca610 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a74a65640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a7006cd90 0x7f8a70157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a75266640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a700ca610 0x7f8a70149610 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8a680194c0 tx=0x7f8a68019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a6d7fa640 1 -- 172.21.15.26:0/3965926098 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68009510 con 0x7f8a700ca610 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a6d7fa640 1 -- 172.21.15.26:0/3965926098 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68009240 con 0x7f8a700ca610 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a6d7fa640 1 -- 172.21.15.26:0/3965926098 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680b76b0 con 0x7f8a700ca610 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a700a9b10 con 0x7f8a700ca610 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.772+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a700aa0d0 con 0x7f8a700ca610 2023-11-28T16:59:01.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.776+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a700aa5b0 con 0x7f8a700ca610 2023-11-28T16:59:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.776+0000 7f8a6d7fa640 1 -- 172.21.15.26:0/3965926098 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8a680b7810 con 0x7f8a700ca610 2023-11-28T16:59:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.776+0000 7f8a6d7fa640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8a540668d0 0x7f8a54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.776+0000 7f8a6d7fa640 1 -- 172.21.15.26:0/3965926098 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a700cac00 con 0x7f8a700ca610 2023-11-28T16:59:01.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.776+0000 7f8a74a65640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8a540668d0 0x7f8a54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:01.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.776+0000 7f8a74a65640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8a540668d0 0x7f8a54068d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009b10 tx=0x7f8a64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.780+0000 7f8a6d7fa640 1 -- 172.21.15.26:0/3965926098 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a680ec400 con 0x7f8a700ca610 2023-11-28T16:59:01.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.936+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a7006c360 con 0x7f8a540668d0 2023-11-28T16:59:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.944+0000 7f8a6d7fa640 1 -- 172.21.15.26:0/3965926098 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288889 (secure 0 0 0) 0x7f8a7006c360 con 0x7f8a540668d0 2023-11-28T16:59:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:01.954 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8a540668d0 msgr2=0x7f8a54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8a540668d0 0x7f8a54068d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009b10 tx=0x7f8a64008040 comp rx=0 tx=0).stop 2023-11-28T16:59:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a700ca610 msgr2=0x7f8a70149610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a700ca610 0x7f8a70149610 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8a680194c0 tx=0x7f8a68019650 comp rx=0 tx=0).stop 2023-11-28T16:59:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 shutdown_connections 2023-11-28T16:59:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a700ca610 0x7f8a70149610 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a700bd720 0x7f8a701520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8a540668d0 0x7f8a54068d90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 --2- 172.21.15.26:0/3965926098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a7006cd90 0x7f8a70157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 >> 172.21.15.26:0/3965926098 conn(0x7f8a70071ea0 msgr2=0x7f8a70072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:01.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 shutdown_connections 2023-11-28T16:59:01.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:01.948+0000 7f8a76cc9640 1 -- 172.21.15.26:0/3965926098 wait complete. 2023-11-28T16:59:01.973 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-11-28T16:59:01.615243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248940,"kb_used_data":7800,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725780,"statfs":{"total":773094113280,"available":772839198720,"internally_reserved":0,"allocated":7987200,"data_stored":4119060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.785430"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221343+0000","last_change":"2023-11-28T16:58:57.314088+0000","last_active":"2023-11-28T16:58:59.221343+0000","last_peered":"2023-11-28T16:58:59.221343+0000","last_clean":"2023-11-28T16:58:59.221343+0000","last_became_active":"2023-11-28T16:58:57.312523+0000","last_became_peered":"2023-11-28T16:58:57.312523+0000","last_unstale":"2023-11-28T16:58:59.221343+0000","last_undegraded":"2023-11-28T16:58:59.221343+0000","last_fullsized":"2023-11-28T16:58:59.221343+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.313198+0000","last_change":"2023-11-28T16:58:57.310945+0000","last_active":"2023-11-28T16:58:57.313198+0000","last_peered":"2023-11-28T16:58:57.313198+0000","last_clean":"2023-11-28T16:58:57.313198+0000","last_became_active":"2023-11-28T16:58:57.310682+0000","last_became_peered":"2023-11-28T16:58:57.310682+0000","last_unstale":"2023-11-28T16:58:57.313198+0000","last_undegraded":"2023-11-28T16:58:57.313198+0000","last_fullsized":"2023-11-28T16:58:57.313198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:58.918711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.316993+0000","last_change":"2023-11-28T16:58:57.309345+0000","last_active":"2023-11-28T16:58:57.316993+0000","last_peered":"2023-11-28T16:58:57.316993+0000","last_clean":"2023-11-28T16:58:57.316993+0000","last_became_active":"2023-11-28T16:58:57.308923+0000","last_became_peered":"2023-11-28T16:58:57.308923+0000","last_unstale":"2023-11-28T16:58:57.316993+0000","last_undegraded":"2023-11-28T16:58:57.316993+0000","last_fullsized":"2023-11-28T16:58:57.316993+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293144+0000","last_change":"2023-11-28T16:58:57.304932+0000","last_active":"2023-11-28T16:58:58.293144+0000","last_peered":"2023-11-28T16:58:58.293144+0000","last_clean":"2023-11-28T16:58:58.293144+0000","last_became_active":"2023-11-28T16:58:57.304401+0000","last_became_peered":"2023-11-28T16:58:57.304401+0000","last_unstale":"2023-11-28T16:58:58.293144+0000","last_undegraded":"2023-11-28T16:58:58.293144+0000","last_fullsized":"2023-11-28T16:58:58.293144+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:08.489709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294455+0000","last_change":"2023-11-28T16:58:57.312192+0000","last_active":"2023-11-28T16:58:58.294455+0000","last_peered":"2023-11-28T16:58:58.294455+0000","last_clean":"2023-11-28T16:58:58.294455+0000","last_became_active":"2023-11-28T16:58:57.311963+0000","last_became_peered":"2023-11-28T16:58:57.311963+0000","last_unstale":"2023-11-28T16:58:58.294455+0000","last_undegraded":"2023-11-28T16:58:58.294455+0000","last_fullsized":"2023-11-28T16:58:58.294455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.320663+0000","last_change":"2023-11-28T16:58:57.318754+0000","last_active":"2023-11-28T16:58:57.320663+0000","last_peered":"2023-11-28T16:58:57.320663+0000","last_clean":"2023-11-28T16:58:57.320663+0000","last_became_active":"2023-11-28T16:58:57.318472+0000","last_became_peered":"2023-11-28T16:58:57.318472+0000","last_unstale":"2023-11-28T16:58:57.320663+0000","last_undegraded":"2023-11-28T16:58:57.320663+0000","last_fullsized":"2023-11-28T16:58:57.320663+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:42.587204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292678+0000","last_change":"2023-11-28T16:58:57.305646+0000","last_active":"2023-11-28T16:58:58.292678+0000","last_peered":"2023-11-28T16:58:58.292678+0000","last_clean":"2023-11-28T16:58:58.292678+0000","last_became_active":"2023-11-28T16:58:57.305348+0000","last_became_peered":"2023-11-28T16:58:57.305348+0000","last_unstale":"2023-11-28T16:58:58.292678+0000","last_undegraded":"2023-11-28T16:58:58.292678+0000","last_fullsized":"2023-11-28T16:58:58.292678+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:10.412723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.317392+0000","last_change":"2023-11-28T16:58:57.313508+0000","last_active":"2023-11-28T16:58:57.317392+0000","last_peered":"2023-11-28T16:58:57.317392+0000","last_clean":"2023-11-28T16:58:57.317392+0000","last_became_active":"2023-11-28T16:58:57.311907+0000","last_became_peered":"2023-11-28T16:58:57.311907+0000","last_unstale":"2023-11-28T16:58:57.317392+0000","last_undegraded":"2023-11-28T16:58:57.317392+0000","last_fullsized":"2023-11-28T16:58:57.317392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:28.805091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.317981+0000","last_change":"2023-11-28T16:58:57.315988+0000","last_active":"2023-11-28T16:58:57.317981+0000","last_peered":"2023-11-28T16:58:57.317981+0000","last_clean":"2023-11-28T16:58:57.317981+0000","last_became_active":"2023-11-28T16:58:57.315705+0000","last_became_peered":"2023-11-28T16:58:57.315705+0000","last_unstale":"2023-11-28T16:58:57.317981+0000","last_undegraded":"2023-11-28T16:58:57.317981+0000","last_fullsized":"2023-11-28T16:58:57.317981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:05.122019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221503+0000","last_change":"2023-11-28T16:58:57.307177+0000","last_active":"2023-11-28T16:58:59.221503+0000","last_peered":"2023-11-28T16:58:59.221503+0000","last_clean":"2023-11-28T16:58:59.221503+0000","last_became_active":"2023-11-28T16:58:57.305697+0000","last_became_peered":"2023-11-28T16:58:57.305697+0000","last_unstale":"2023-11-28T16:58:59.221503+0000","last_undegraded":"2023-11-28T16:58:59.221503+0000","last_fullsized":"2023-11-28T16:58:59.221503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.308975+0000","last_change":"2023-11-28T16:58:57.301869+0000","last_active":"2023-11-28T16:58:57.308975+0000","last_peered":"2023-11-28T16:58:57.308975+0000","last_clean":"2023-11-28T16:58:57.308975+0000","last_became_active":"2023-11-28T16:58:57.299043+0000","last_became_peered":"2023-11-28T16:58:57.299043+0000","last_unstale":"2023-11-28T16:58:57.308975+0000","last_undegraded":"2023-11-28T16:58:57.308975+0000","last_fullsized":"2023-11-28T16:58:57.308975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:26.863725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.220984+0000","last_change":"2023-11-28T16:58:57.304835+0000","last_active":"2023-11-28T16:58:59.220984+0000","last_peered":"2023-11-28T16:58:59.220984+0000","last_clean":"2023-11-28T16:58:59.220984+0000","last_became_active":"2023-11-28T16:58:57.304529+0000","last_became_peered":"2023-11-28T16:58:57.304529+0000","last_unstale":"2023-11-28T16:58:59.220984+0000","last_undegraded":"2023-11-28T16:58:59.220984+0000","last_fullsized":"2023-11-28T16:58:59.220984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.306478+0000","last_change":"2023-11-28T16:58:57.304288+0000","last_active":"2023-11-28T16:58:57.306478+0000","last_peered":"2023-11-28T16:58:57.306478+0000","last_clean":"2023-11-28T16:58:57.306478+0000","last_became_active":"2023-11-28T16:58:57.303979+0000","last_became_peered":"2023-11-28T16:58:57.303979+0000","last_unstale":"2023-11-28T16:58:57.306478+0000","last_undegraded":"2023-11-28T16:58:57.306478+0000","last_fullsized":"2023-11-28T16:58:57.306478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292677+0000","last_change":"2023-11-28T16:58:57.309909+0000","last_active":"2023-11-28T16:58:58.292677+0000","last_peered":"2023-11-28T16:58:58.292677+0000","last_clean":"2023-11-28T16:58:58.292677+0000","last_became_active":"2023-11-28T16:58:57.309581+0000","last_became_peered":"2023-11-28T16:58:57.309581+0000","last_unstale":"2023-11-28T16:58:58.292677+0000","last_undegraded":"2023-11-28T16:58:58.292677+0000","last_fullsized":"2023-11-28T16:58:58.292677+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:44.715872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312327+0000","last_change":"2023-11-28T16:58:57.305318+0000","last_active":"2023-11-28T16:58:58.312327+0000","last_peered":"2023-11-28T16:58:58.312327+0000","last_clean":"2023-11-28T16:58:58.312327+0000","last_became_active":"2023-11-28T16:58:57.300492+0000","last_became_peered":"2023-11-28T16:58:57.300492+0000","last_unstale":"2023-11-28T16:58:58.312327+0000","last_undegraded":"2023-11-28T16:58:58.312327+0000","last_fullsized":"2023-11-28T16:58:58.312327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294266+0000","last_change":"2023-11-28T16:58:57.309435+0000","last_active":"2023-11-28T16:58:58.294266+0000","last_peered":"2023-11-28T16:58:58.294266+0000","last_clean":"2023-11-28T16:58:58.294266+0000","last_became_active":"2023-11-28T16:58:57.308962+0000","last_became_peered":"2023-11-28T16:58:57.308962+0000","last_unstale":"2023-11-28T16:58:58.294266+0000","last_undegraded":"2023-11-28T16:58:58.294266+0000","last_fullsized":"2023-11-28T16:58:58.294266+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294973+0000","last_change":"2023-11-28T16:58:57.302600+0000","last_active":"2023-11-28T16:58:58.294973+0000","last_peered":"2023-11-28T16:58:58.294973+0000","last_clean":"2023-11-28T16:58:58.294973+0000","last_became_active":"2023-11-28T16:58:57.302328+0000","last_became_peered":"2023-11-28T16:58:57.302328+0000","last_unstale":"2023-11-28T16:58:58.294973+0000","last_undegraded":"2023-11-28T16:58:58.294973+0000","last_fullsized":"2023-11-28T16:58:58.294973+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292893+0000","last_change":"2023-11-28T16:58:57.307084+0000","last_active":"2023-11-28T16:58:58.292893+0000","last_peered":"2023-11-28T16:58:58.292893+0000","last_clean":"2023-11-28T16:58:58.292893+0000","last_became_active":"2023-11-28T16:58:57.306795+0000","last_became_peered":"2023-11-28T16:58:57.306795+0000","last_unstale":"2023-11-28T16:58:58.292893+0000","last_undegraded":"2023-11-28T16:58:58.292893+0000","last_fullsized":"2023-11-28T16:58:58.292893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:45:36.527998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294066+0000","last_change":"2023-11-28T16:58:57.301492+0000","last_active":"2023-11-28T16:58:58.294066+0000","last_peered":"2023-11-28T16:58:58.294066+0000","last_clean":"2023-11-28T16:58:58.294066+0000","last_became_active":"2023-11-28T16:58:57.301143+0000","last_became_peered":"2023-11-28T16:58:57.301143+0000","last_unstale":"2023-11-28T16:58:58.294066+0000","last_undegraded":"2023-11-28T16:58:58.294066+0000","last_fullsized":"2023-11-28T16:58:58.294066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293234+0000","last_change":"2023-11-28T16:58:57.305035+0000","last_active":"2023-11-28T16:58:58.293234+0000","last_peered":"2023-11-28T16:58:58.293234+0000","last_clean":"2023-11-28T16:58:58.293234+0000","last_became_active":"2023-11-28T16:58:57.304747+0000","last_became_peered":"2023-11-28T16:58:57.304747+0000","last_unstale":"2023-11-28T16:58:58.293234+0000","last_undegraded":"2023-11-28T16:58:58.293234+0000","last_fullsized":"2023-11-28T16:58:58.293234+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:59:37.707020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292990+0000","last_change":"2023-11-28T16:58:57.313873+0000","last_active":"2023-11-28T16:58:58.292990+0000","last_peered":"2023-11-28T16:58:58.292990+0000","last_clean":"2023-11-28T16:58:58.292990+0000","last_became_active":"2023-11-28T16:58:57.313545+0000","last_became_peered":"2023-11-28T16:58:57.313545+0000","last_unstale":"2023-11-28T16:58:58.292990+0000","last_undegraded":"2023-11-28T16:58:58.292990+0000","last_fullsized":"2023-11-28T16:58:58.292990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:19.647634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.309684+0000","last_change":"2023-11-28T16:58:57.299061+0000","last_active":"2023-11-28T16:58:57.309684+0000","last_peered":"2023-11-28T16:58:57.309684+0000","last_clean":"2023-11-28T16:58:57.309684+0000","last_became_active":"2023-11-28T16:58:57.298785+0000","last_became_peered":"2023-11-28T16:58:57.298785+0000","last_unstale":"2023-11-28T16:58:57.309684+0000","last_undegraded":"2023-11-28T16:58:57.309684+0000","last_fullsized":"2023-11-28T16:58:57.309684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:59.565164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.220995+0000","last_change":"2023-11-28T16:58:57.315028+0000","last_active":"2023-11-28T16:58:59.220995+0000","last_peered":"2023-11-28T16:58:59.220995+0000","last_clean":"2023-11-28T16:58:59.220995+0000","last_became_active":"2023-11-28T16:58:57.314688+0000","last_became_peered":"2023-11-28T16:58:57.314688+0000","last_unstale":"2023-11-28T16:58:59.220995+0000","last_undegraded":"2023-11-28T16:58:59.220995+0000","last_fullsized":"2023-11-28T16:58:59.220995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292684+0000","last_change":"2023-11-28T16:58:57.313407+0000","last_active":"2023-11-28T16:58:58.292684+0000","last_peered":"2023-11-28T16:58:58.292684+0000","last_clean":"2023-11-28T16:58:58.292684+0000","last_became_active":"2023-11-28T16:58:57.313195+0000","last_became_peered":"2023-11-28T16:58:57.313195+0000","last_unstale":"2023-11-28T16:58:58.292684+0000","last_undegraded":"2023-11-28T16:58:58.292684+0000","last_fullsized":"2023-11-28T16:58:58.292684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:41:36.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310161+0000","last_change":"2023-11-28T16:58:57.306497+0000","last_active":"2023-11-28T16:58:57.310161+0000","last_peered":"2023-11-28T16:58:57.310161+0000","last_clean":"2023-11-28T16:58:57.310161+0000","last_became_active":"2023-11-28T16:58:57.306200+0000","last_became_peered":"2023-11-28T16:58:57.306200+0000","last_unstale":"2023-11-28T16:58:57.310161+0000","last_undegraded":"2023-11-28T16:58:57.310161+0000","last_fullsized":"2023-11-28T16:58:57.310161+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:34.591413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.305177+0000","last_change":"2023-11-28T16:58:57.299393+0000","last_active":"2023-11-28T16:58:57.305177+0000","last_peered":"2023-11-28T16:58:57.305177+0000","last_clean":"2023-11-28T16:58:57.305177+0000","last_became_active":"2023-11-28T16:58:57.299079+0000","last_became_peered":"2023-11-28T16:58:57.299079+0000","last_unstale":"2023-11-28T16:58:57.305177+0000","last_undegraded":"2023-11-28T16:58:57.305177+0000","last_fullsized":"2023-11-28T16:58:57.305177+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:16.960155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294648+0000","last_change":"2023-11-28T16:58:57.304447+0000","last_active":"2023-11-28T16:58:58.294648+0000","last_peered":"2023-11-28T16:58:58.294648+0000","last_clean":"2023-11-28T16:58:58.294648+0000","last_became_active":"2023-11-28T16:58:57.301404+0000","last_became_peered":"2023-11-28T16:58:57.301404+0000","last_unstale":"2023-11-28T16:58:58.294648+0000","last_undegraded":"2023-11-28T16:58:58.294648+0000","last_fullsized":"2023-11-28T16:58:58.294648+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221310+0000","last_change":"2023-11-28T16:58:57.315464+0000","last_active":"2023-11-28T16:58:59.221310+0000","last_peered":"2023-11-28T16:58:59.221310+0000","last_clean":"2023-11-28T16:58:59.221310+0000","last_became_active":"2023-11-28T16:58:57.314425+0000","last_became_peered":"2023-11-28T16:58:57.314425+0000","last_unstale":"2023-11-28T16:58:59.221310+0000","last_undegraded":"2023-11-28T16:58:59.221310+0000","last_fullsized":"2023-11-28T16:58:59.221310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.308218+0000","last_change":"2023-11-28T16:58:57.299772+0000","last_active":"2023-11-28T16:58:57.308218+0000","last_peered":"2023-11-28T16:58:57.308218+0000","last_clean":"2023-11-28T16:58:57.308218+0000","last_became_active":"2023-11-28T16:58:57.299523+0000","last_became_peered":"2023-11-28T16:58:57.299523+0000","last_unstale":"2023-11-28T16:58:57.308218+0000","last_undegraded":"2023-11-28T16:58:57.308218+0000","last_fullsized":"2023-11-28T16:58:57.308218+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:50.808519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.309673+0000","last_change":"2023-11-28T16:58:57.299039+0000","last_active":"2023-11-28T16:58:57.309673+0000","last_peered":"2023-11-28T16:58:57.309673+0000","last_clean":"2023-11-28T16:58:57.309673+0000","last_became_active":"2023-11-28T16:58:57.298773+0000","last_became_peered":"2023-11-28T16:58:57.298773+0000","last_unstale":"2023-11-28T16:58:57.309673+0000","last_undegraded":"2023-11-28T16:58:57.309673+0000","last_fullsized":"2023-11-28T16:58:57.309673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:32.981926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294431+0000","last_change":"2023-11-28T16:58:57.299925+0000","last_active":"2023-11-28T16:58:58.294431+0000","last_peered":"2023-11-28T16:58:58.294431+0000","last_clean":"2023-11-28T16:58:58.294431+0000","last_became_active":"2023-11-28T16:58:57.299627+0000","last_became_peered":"2023-11-28T16:58:57.299627+0000","last_unstale":"2023-11-28T16:58:58.294431+0000","last_undegraded":"2023-11-28T16:58:58.294431+0000","last_fullsized":"2023-11-28T16:58:58.294431+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.220960+0000","last_change":"2023-11-28T16:58:57.313636+0000","last_active":"2023-11-28T16:58:59.220960+0000","last_peered":"2023-11-28T16:58:59.220960+0000","last_clean":"2023-11-28T16:58:59.220960+0000","last_became_active":"2023-11-28T16:58:57.313257+0000","last_became_peered":"2023-11-28T16:58:57.313257+0000","last_unstale":"2023-11-28T16:58:59.220960+0000","last_undegraded":"2023-11-28T16:58:59.220960+0000","last_fullsized":"2023-11-28T16:58:59.220960+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294869+0000","last_change":"2023-11-28T16:58:57.310866+0000","last_active":"2023-11-28T16:58:58.294869+0000","last_peered":"2023-11-28T16:58:58.294869+0000","last_clean":"2023-11-28T16:58:58.294869+0000","last_became_active":"2023-11-28T16:58:57.310515+0000","last_became_peered":"2023-11-28T16:58:57.310515+0000","last_unstale":"2023-11-28T16:58:58.294869+0000","last_undegraded":"2023-11-28T16:58:58.294869+0000","last_fullsized":"2023-11-28T16:58:58.294869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221488+0000","last_change":"2023-11-28T16:58:56.862978+0000","last_active":"2023-11-28T16:58:59.221488+0000","last_peered":"2023-11-28T16:58:59.221488+0000","last_clean":"2023-11-28T16:58:59.221488+0000","last_became_active":"2023-11-28T16:58:56.862677+0000","last_became_peered":"2023-11-28T16:58:56.862677+0000","last_unstale":"2023-11-28T16:58:59.221488+0000","last_undegraded":"2023-11-28T16:58:59.221488+0000","last_fullsized":"2023-11-28T16:58:59.221488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221387+0000","last_change":"2023-11-28T16:58:57.315127+0000","last_active":"2023-11-28T16:58:59.221387+0000","last_peered":"2023-11-28T16:58:59.221387+0000","last_clean":"2023-11-28T16:58:59.221387+0000","last_became_active":"2023-11-28T16:58:57.314836+0000","last_became_peered":"2023-11-28T16:58:57.314836+0000","last_unstale":"2023-11-28T16:58:59.221387+0000","last_undegraded":"2023-11-28T16:58:59.221387+0000","last_fullsized":"2023-11-28T16:58:59.221387+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294951+0000","last_change":"2023-11-28T16:58:56.852728+0000","last_active":"2023-11-28T16:58:58.294951+0000","last_peered":"2023-11-28T16:58:58.294951+0000","last_clean":"2023-11-28T16:58:58.294951+0000","last_became_active":"2023-11-28T16:58:56.852468+0000","last_became_peered":"2023-11-28T16:58:56.852468+0000","last_unstale":"2023-11-28T16:58:58.294951+0000","last_undegraded":"2023-11-28T16:58:58.294951+0000","last_fullsized":"2023-11-28T16:58:58.294951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221207+0000","last_change":"2023-11-28T16:58:57.314042+0000","last_active":"2023-11-28T16:58:59.221207+0000","last_peered":"2023-11-28T16:58:59.221207+0000","last_clean":"2023-11-28T16:58:59.221207+0000","last_became_active":"2023-11-28T16:58:57.313749+0000","last_became_peered":"2023-11-28T16:58:57.313749+0000","last_unstale":"2023-11-28T16:58:59.221207+0000","last_undegraded":"2023-11-28T16:58:59.221207+0000","last_fullsized":"2023-11-28T16:58:59.221207+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294017+0000","last_change":"2023-11-28T16:58:56.861860+0000","last_active":"2023-11-28T16:58:58.294017+0000","last_peered":"2023-11-28T16:58:58.294017+0000","last_clean":"2023-11-28T16:58:58.294017+0000","last_became_active":"2023-11-28T16:58:56.861575+0000","last_became_peered":"2023-11-28T16:58:56.861575+0000","last_unstale":"2023-11-28T16:58:58.294017+0000","last_undegraded":"2023-11-28T16:58:58.294017+0000","last_fullsized":"2023-11-28T16:58:58.294017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:01.116893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.318071+0000","last_change":"2023-11-28T16:58:57.316847+0000","last_active":"2023-11-28T16:58:57.318071+0000","last_peered":"2023-11-28T16:58:57.318071+0000","last_clean":"2023-11-28T16:58:57.318071+0000","last_became_active":"2023-11-28T16:58:57.315129+0000","last_became_peered":"2023-11-28T16:58:57.315129+0000","last_unstale":"2023-11-28T16:58:57.318071+0000","last_undegraded":"2023-11-28T16:58:57.318071+0000","last_fullsized":"2023-11-28T16:58:57.318071+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293857+0000","last_change":"2023-11-28T16:58:56.857953+0000","last_active":"2023-11-28T16:58:58.293857+0000","last_peered":"2023-11-28T16:58:58.293857+0000","last_clean":"2023-11-28T16:58:58.293857+0000","last_became_active":"2023-11-28T16:58:56.857667+0000","last_became_peered":"2023-11-28T16:58:56.857667+0000","last_unstale":"2023-11-28T16:58:58.293857+0000","last_undegraded":"2023-11-28T16:58:58.293857+0000","last_fullsized":"2023-11-28T16:58:58.293857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:40.543279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.301807+0000","last_change":"2023-11-28T16:58:57.297598+0000","last_active":"2023-11-28T16:58:57.301807+0000","last_peered":"2023-11-28T16:58:57.301807+0000","last_clean":"2023-11-28T16:58:57.301807+0000","last_became_active":"2023-11-28T16:58:57.297333+0000","last_became_peered":"2023-11-28T16:58:57.297333+0000","last_unstale":"2023-11-28T16:58:57.301807+0000","last_undegraded":"2023-11-28T16:58:57.301807+0000","last_fullsized":"2023-11-28T16:58:57.301807+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:37:37.395510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294582+0000","last_change":"2023-11-28T16:58:56.846299+0000","last_active":"2023-11-28T16:58:58.294582+0000","last_peered":"2023-11-28T16:58:58.294582+0000","last_clean":"2023-11-28T16:58:58.294582+0000","last_became_active":"2023-11-28T16:58:56.845923+0000","last_became_peered":"2023-11-28T16:58:56.845923+0000","last_unstale":"2023-11-28T16:58:58.294582+0000","last_undegraded":"2023-11-28T16:58:58.294582+0000","last_fullsized":"2023-11-28T16:58:58.294582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294475+0000","last_change":"2023-11-28T16:58:57.302610+0000","last_active":"2023-11-28T16:58:58.294475+0000","last_peered":"2023-11-28T16:58:58.294475+0000","last_clean":"2023-11-28T16:58:58.294475+0000","last_became_active":"2023-11-28T16:58:57.301748+0000","last_became_peered":"2023-11-28T16:58:57.301748+0000","last_unstale":"2023-11-28T16:58:58.294475+0000","last_undegraded":"2023-11-28T16:58:58.294475+0000","last_fullsized":"2023-11-28T16:58:58.294475+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294381+0000","last_change":"2023-11-28T16:58:56.849775+0000","last_active":"2023-11-28T16:58:58.294381+0000","last_peered":"2023-11-28T16:58:58.294381+0000","last_clean":"2023-11-28T16:58:58.294381+0000","last_became_active":"2023-11-28T16:58:56.849503+0000","last_became_peered":"2023-11-28T16:58:56.849503+0000","last_unstale":"2023-11-28T16:58:58.294381+0000","last_undegraded":"2023-11-28T16:58:58.294381+0000","last_fullsized":"2023-11-28T16:58:58.294381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.315367+0000","last_change":"2023-11-28T16:58:57.305447+0000","last_active":"2023-11-28T16:58:57.315367+0000","last_peered":"2023-11-28T16:58:57.315367+0000","last_clean":"2023-11-28T16:58:57.315367+0000","last_became_active":"2023-11-28T16:58:57.303738+0000","last_became_peered":"2023-11-28T16:58:57.303738+0000","last_unstale":"2023-11-28T16:58:57.315367+0000","last_undegraded":"2023-11-28T16:58:57.315367+0000","last_fullsized":"2023-11-28T16:58:57.315367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293515+0000","last_change":"2023-11-28T16:58:56.851226+0000","last_active":"2023-11-28T16:58:58.293515+0000","last_peered":"2023-11-28T16:58:58.293515+0000","last_clean":"2023-11-28T16:58:58.293515+0000","last_became_active":"2023-11-28T16:58:56.850870+0000","last_became_peered":"2023-11-28T16:58:56.850870+0000","last_unstale":"2023-11-28T16:58:58.293515+0000","last_undegraded":"2023-11-28T16:58:58.293515+0000","last_fullsized":"2023-11-28T16:58:58.293515+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312398+0000","last_change":"2023-11-28T16:58:57.305573+0000","last_active":"2023-11-28T16:58:58.312398+0000","last_peered":"2023-11-28T16:58:58.312398+0000","last_clean":"2023-11-28T16:58:58.312398+0000","last_became_active":"2023-11-28T16:58:57.299574+0000","last_became_peered":"2023-11-28T16:58:57.299574+0000","last_unstale":"2023-11-28T16:58:58.312398+0000","last_undegraded":"2023-11-28T16:58:58.312398+0000","last_fullsized":"2023-11-28T16:58:58.312398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.292359+0000","last_change":"2023-11-28T16:58:56.849113+0000","last_active":"2023-11-28T16:58:57.292359+0000","last_peered":"2023-11-28T16:58:57.292359+0000","last_clean":"2023-11-28T16:58:57.292359+0000","last_became_active":"2023-11-28T16:58:56.848817+0000","last_became_peered":"2023-11-28T16:58:56.848817+0000","last_unstale":"2023-11-28T16:58:57.292359+0000","last_undegraded":"2023-11-28T16:58:57.292359+0000","last_fullsized":"2023-11-28T16:58:57.292359+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:29.256426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312702+0000","last_change":"2023-11-28T16:58:57.308897+0000","last_active":"2023-11-28T16:58:58.312702+0000","last_peered":"2023-11-28T16:58:58.312702+0000","last_clean":"2023-11-28T16:58:58.312702+0000","last_became_active":"2023-11-28T16:58:57.308635+0000","last_became_peered":"2023-11-28T16:58:57.308635+0000","last_unstale":"2023-11-28T16:58:58.312702+0000","last_undegraded":"2023-11-28T16:58:58.312702+0000","last_fullsized":"2023-11-28T16:58:58.312702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221551+0000","last_change":"2023-11-28T16:58:56.859941+0000","last_active":"2023-11-28T16:58:59.221551+0000","last_peered":"2023-11-28T16:58:59.221551+0000","last_clean":"2023-11-28T16:58:59.221551+0000","last_became_active":"2023-11-28T16:58:56.859614+0000","last_became_peered":"2023-11-28T16:58:56.859614+0000","last_unstale":"2023-11-28T16:58:59.221551+0000","last_undegraded":"2023-11-28T16:58:59.221551+0000","last_fullsized":"2023-11-28T16:58:59.221551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.320680+0000","last_change":"2023-11-28T16:58:57.318731+0000","last_active":"2023-11-28T16:58:57.320680+0000","last_peered":"2023-11-28T16:58:57.320680+0000","last_clean":"2023-11-28T16:58:57.320680+0000","last_became_active":"2023-11-28T16:58:57.318407+0000","last_became_peered":"2023-11-28T16:58:57.318407+0000","last_unstale":"2023-11-28T16:58:57.320680+0000","last_undegraded":"2023-11-28T16:58:57.320680+0000","last_fullsized":"2023-11-28T16:58:57.320680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:04.422227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221512+0000","last_change":"2023-11-28T16:58:56.851849+0000","last_active":"2023-11-28T16:58:59.221512+0000","last_peered":"2023-11-28T16:58:59.221512+0000","last_clean":"2023-11-28T16:58:59.221512+0000","last_became_active":"2023-11-28T16:58:56.851487+0000","last_became_peered":"2023-11-28T16:58:56.851487+0000","last_unstale":"2023-11-28T16:58:59.221512+0000","last_undegraded":"2023-11-28T16:58:59.221512+0000","last_fullsized":"2023-11-28T16:58:59.221512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:15.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293802+0000","last_change":"2023-11-28T16:58:57.308250+0000","last_active":"2023-11-28T16:58:58.293802+0000","last_peered":"2023-11-28T16:58:58.293802+0000","last_clean":"2023-11-28T16:58:58.293802+0000","last_became_active":"2023-11-28T16:58:57.307951+0000","last_became_peered":"2023-11-28T16:58:57.307951+0000","last_unstale":"2023-11-28T16:58:58.293802+0000","last_undegraded":"2023-11-28T16:58:58.293802+0000","last_fullsized":"2023-11-28T16:58:58.293802+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221087+0000","last_change":"2023-11-28T16:58:56.858285+0000","last_active":"2023-11-28T16:58:59.221087+0000","last_peered":"2023-11-28T16:58:59.221087+0000","last_clean":"2023-11-28T16:58:59.221087+0000","last_became_active":"2023-11-28T16:58:56.857956+0000","last_became_peered":"2023-11-28T16:58:56.857956+0000","last_unstale":"2023-11-28T16:58:59.221087+0000","last_undegraded":"2023-11-28T16:58:59.221087+0000","last_fullsized":"2023-11-28T16:58:59.221087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294653+0000","last_change":"2023-11-28T16:58:57.305562+0000","last_active":"2023-11-28T16:58:58.294653+0000","last_peered":"2023-11-28T16:58:58.294653+0000","last_clean":"2023-11-28T16:58:58.294653+0000","last_became_active":"2023-11-28T16:58:57.305130+0000","last_became_peered":"2023-11-28T16:58:57.305130+0000","last_unstale":"2023-11-28T16:58:58.294653+0000","last_undegraded":"2023-11-28T16:58:58.294653+0000","last_fullsized":"2023-11-28T16:58:58.294653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'6","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.866614+0000","last_change":"2023-11-28T16:58:56.856203+0000","last_active":"2023-11-28T16:58:57.866614+0000","last_peered":"2023-11-28T16:58:57.866614+0000","last_clean":"2023-11-28T16:58:57.866614+0000","last_became_active":"2023-11-28T16:58:56.855887+0000","last_became_peered":"2023-11-28T16:58:56.855887+0000","last_unstale":"2023-11-28T16:58:57.866614+0000","last_undegraded":"2023-11-28T16:58:57.866614+0000","last_fullsized":"2023-11-28T16:58:57.866614+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293472+0000","last_change":"2023-11-28T16:58:57.302777+0000","last_active":"2023-11-28T16:58:58.293472+0000","last_peered":"2023-11-28T16:58:58.293472+0000","last_clean":"2023-11-28T16:58:58.293472+0000","last_became_active":"2023-11-28T16:58:57.302479+0000","last_became_peered":"2023-11-28T16:58:57.302479+0000","last_unstale":"2023-11-28T16:58:58.293472+0000","last_undegraded":"2023-11-28T16:58:58.293472+0000","last_fullsized":"2023-11-28T16:58:58.293472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.864244+0000","last_change":"2023-11-28T16:58:56.846727+0000","last_active":"2023-11-28T16:58:57.864244+0000","last_peered":"2023-11-28T16:58:57.864244+0000","last_clean":"2023-11-28T16:58:57.864244+0000","last_became_active":"2023-11-28T16:58:56.846403+0000","last_became_peered":"2023-11-28T16:58:56.846403+0000","last_unstale":"2023-11-28T16:58:57.864244+0000","last_undegraded":"2023-11-28T16:58:57.864244+0000","last_fullsized":"2023-11-28T16:58:57.864244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:42.852604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.305308+0000","last_change":"2023-11-28T16:58:57.301185+0000","last_active":"2023-11-28T16:58:57.305308+0000","last_peered":"2023-11-28T16:58:57.305308+0000","last_clean":"2023-11-28T16:58:57.305308+0000","last_became_active":"2023-11-28T16:58:57.300882+0000","last_became_peered":"2023-11-28T16:58:57.300882+0000","last_unstale":"2023-11-28T16:58:57.305308+0000","last_undegraded":"2023-11-28T16:58:57.305308+0000","last_fullsized":"2023-11-28T16:58:57.305308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312411+0000","last_change":"2023-11-28T16:58:56.855489+0000","last_active":"2023-11-28T16:58:58.312411+0000","last_peered":"2023-11-28T16:58:58.312411+0000","last_clean":"2023-11-28T16:58:58.312411+0000","last_became_active":"2023-11-28T16:58:56.855127+0000","last_became_peered":"2023-11-28T16:58:56.855127+0000","last_unstale":"2023-11-28T16:58:58.312411+0000","last_undegraded":"2023-11-28T16:58:58.312411+0000","last_fullsized":"2023-11-28T16:58:58.312411+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:03.854671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310066+0000","last_change":"2023-11-28T16:58:57.297734+0000","last_active":"2023-11-28T16:58:57.310066+0000","last_peered":"2023-11-28T16:58:57.310066+0000","last_clean":"2023-11-28T16:58:57.310066+0000","last_became_active":"2023-11-28T16:58:57.297456+0000","last_became_peered":"2023-11-28T16:58:57.297456+0000","last_unstale":"2023-11-28T16:58:57.310066+0000","last_undegraded":"2023-11-28T16:58:57.310066+0000","last_fullsized":"2023-11-28T16:58:57.310066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:22.083052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.302273+0000","last_change":"2023-11-28T16:58:56.852318+0000","last_active":"2023-11-28T16:58:57.302273+0000","last_peered":"2023-11-28T16:58:57.302273+0000","last_clean":"2023-11-28T16:58:57.302273+0000","last_became_active":"2023-11-28T16:58:56.851992+0000","last_became_peered":"2023-11-28T16:58:56.851992+0000","last_unstale":"2023-11-28T16:58:57.302273+0000","last_undegraded":"2023-11-28T16:58:57.302273+0000","last_fullsized":"2023-11-28T16:58:57.302273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310226+0000","last_change":"2023-11-28T16:58:57.307166+0000","last_active":"2023-11-28T16:58:57.310226+0000","last_peered":"2023-11-28T16:58:57.310226+0000","last_clean":"2023-11-28T16:58:57.310226+0000","last_became_active":"2023-11-28T16:58:57.306917+0000","last_became_peered":"2023-11-28T16:58:57.306917+0000","last_unstale":"2023-11-28T16:58:57.310226+0000","last_undegraded":"2023-11-28T16:58:57.310226+0000","last_fullsized":"2023-11-28T16:58:57.310226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:00.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":20,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293400+0000","last_change":"2023-11-28T16:58:56.858590+0000","last_active":"2023-11-28T16:58:58.293400+0000","last_peered":"2023-11-28T16:58:58.293400+0000","last_clean":"2023-11-28T16:58:58.293400+0000","last_became_active":"2023-11-28T16:58:56.858306+0000","last_became_peered":"2023-11-28T16:58:56.858306+0000","last_unstale":"2023-11-28T16:58:58.293400+0000","last_undegraded":"2023-11-28T16:58:58.293400+0000","last_fullsized":"2023-11-28T16:58:58.293400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.316391+0000","last_change":"2023-11-28T16:58:57.310263+0000","last_active":"2023-11-28T16:58:57.316391+0000","last_peered":"2023-11-28T16:58:57.316391+0000","last_clean":"2023-11-28T16:58:57.316391+0000","last_became_active":"2023-11-28T16:58:57.309857+0000","last_became_peered":"2023-11-28T16:58:57.309857+0000","last_unstale":"2023-11-28T16:58:57.316391+0000","last_undegraded":"2023-11-28T16:58:57.316391+0000","last_fullsized":"2023-11-28T16:58:57.316391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221609+0000","last_change":"2023-11-28T16:58:56.858637+0000","last_active":"2023-11-28T16:58:59.221609+0000","last_peered":"2023-11-28T16:58:59.221609+0000","last_clean":"2023-11-28T16:58:59.221609+0000","last_became_active":"2023-11-28T16:58:56.858330+0000","last_became_peered":"2023-11-28T16:58:56.858330+0000","last_unstale":"2023-11-28T16:58:59.221609+0000","last_undegraded":"2023-11-28T16:58:59.221609+0000","last_fullsized":"2023-11-28T16:58:59.221609+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221515+0000","last_change":"2023-11-28T16:58:57.306363+0000","last_active":"2023-11-28T16:58:59.221515+0000","last_peered":"2023-11-28T16:58:59.221515+0000","last_clean":"2023-11-28T16:58:59.221515+0000","last_became_active":"2023-11-28T16:58:57.305727+0000","last_became_peered":"2023-11-28T16:58:57.305727+0000","last_unstale":"2023-11-28T16:58:59.221515+0000","last_undegraded":"2023-11-28T16:58:59.221515+0000","last_fullsized":"2023-11-28T16:58:59.221515+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293889+0000","last_change":"2023-11-28T16:58:56.849263+0000","last_active":"2023-11-28T16:58:58.293889+0000","last_peered":"2023-11-28T16:58:58.293889+0000","last_clean":"2023-11-28T16:58:58.293889+0000","last_became_active":"2023-11-28T16:58:56.848949+0000","last_became_peered":"2023-11-28T16:58:56.848949+0000","last_unstale":"2023-11-28T16:58:58.293889+0000","last_undegraded":"2023-11-28T16:58:58.293889+0000","last_fullsized":"2023-11-28T16:58:58.293889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294748+0000","last_change":"2023-11-28T16:58:57.306164+0000","last_active":"2023-11-28T16:58:58.294748+0000","last_peered":"2023-11-28T16:58:58.294748+0000","last_clean":"2023-11-28T16:58:58.294748+0000","last_became_active":"2023-11-28T16:58:57.300959+0000","last_became_peered":"2023-11-28T16:58:57.300959+0000","last_unstale":"2023-11-28T16:58:58.294748+0000","last_undegraded":"2023-11-28T16:58:58.294748+0000","last_fullsized":"2023-11-28T16:58:58.294748+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293904+0000","last_change":"2023-11-28T16:58:56.850381+0000","last_active":"2023-11-28T16:58:58.293904+0000","last_peered":"2023-11-28T16:58:58.293904+0000","last_clean":"2023-11-28T16:58:58.293904+0000","last_became_active":"2023-11-28T16:58:56.850116+0000","last_became_peered":"2023-11-28T16:58:56.850116+0000","last_unstale":"2023-11-28T16:58:58.293904+0000","last_undegraded":"2023-11-28T16:58:58.293904+0000","last_fullsized":"2023-11-28T16:58:58.293904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292773+0000","last_change":"2023-11-28T16:58:57.309597+0000","last_active":"2023-11-28T16:58:58.292773+0000","last_peered":"2023-11-28T16:58:58.292773+0000","last_clean":"2023-11-28T16:58:58.292773+0000","last_became_active":"2023-11-28T16:58:57.309372+0000","last_became_peered":"2023-11-28T16:58:57.309372+0000","last_unstale":"2023-11-28T16:58:58.292773+0000","last_undegraded":"2023-11-28T16:58:58.292773+0000","last_fullsized":"2023-11-28T16:58:58.292773+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:35.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312487+0000","last_change":"2023-11-28T16:58:56.861806+0000","last_active":"2023-11-28T16:58:58.312487+0000","last_peered":"2023-11-28T16:58:58.312487+0000","last_clean":"2023-11-28T16:58:58.312487+0000","last_became_active":"2023-11-28T16:58:56.861498+0000","last_became_peered":"2023-11-28T16:58:56.861498+0000","last_unstale":"2023-11-28T16:58:58.312487+0000","last_undegraded":"2023-11-28T16:58:58.312487+0000","last_fullsized":"2023-11-28T16:58:58.312487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.312361+0000","last_change":"2023-11-28T16:58:57.306140+0000","last_active":"2023-11-28T16:58:57.312361+0000","last_peered":"2023-11-28T16:58:57.312361+0000","last_clean":"2023-11-28T16:58:57.312361+0000","last_became_active":"2023-11-28T16:58:57.305865+0000","last_became_peered":"2023-11-28T16:58:57.305865+0000","last_unstale":"2023-11-28T16:58:57.312361+0000","last_undegraded":"2023-11-28T16:58:57.312361+0000","last_fullsized":"2023-11-28T16:58:57.312361+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:21.987730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292781+0000","last_change":"2023-11-28T16:58:56.855751+0000","last_active":"2023-11-28T16:58:58.292781+0000","last_peered":"2023-11-28T16:58:58.292781+0000","last_clean":"2023-11-28T16:58:58.292781+0000","last_became_active":"2023-11-28T16:58:56.855432+0000","last_became_peered":"2023-11-28T16:58:56.855432+0000","last_unstale":"2023-11-28T16:58:58.292781+0000","last_undegraded":"2023-11-28T16:58:58.292781+0000","last_fullsized":"2023-11-28T16:58:58.292781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:24:24.546921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292742+0000","last_change":"2023-11-28T16:58:57.307399+0000","last_active":"2023-11-28T16:58:58.292742+0000","last_peered":"2023-11-28T16:58:58.292742+0000","last_clean":"2023-11-28T16:58:58.292742+0000","last_became_active":"2023-11-28T16:58:57.307122+0000","last_became_peered":"2023-11-28T16:58:57.307122+0000","last_unstale":"2023-11-28T16:58:58.292742+0000","last_undegraded":"2023-11-28T16:58:58.292742+0000","last_fullsized":"2023-11-28T16:58:58.292742+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:56:08.650099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292779+0000","last_change":"2023-11-28T16:58:56.863311+0000","last_active":"2023-11-28T16:58:58.292779+0000","last_peered":"2023-11-28T16:58:58.292779+0000","last_clean":"2023-11-28T16:58:58.292779+0000","last_became_active":"2023-11-28T16:58:56.863048+0000","last_became_peered":"2023-11-28T16:58:56.863048+0000","last_unstale":"2023-11-28T16:58:58.292779+0000","last_undegraded":"2023-11-28T16:58:58.292779+0000","last_fullsized":"2023-11-28T16:58:58.292779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:51.407849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.318041+0000","last_change":"2023-11-28T16:58:57.316056+0000","last_active":"2023-11-28T16:58:57.318041+0000","last_peered":"2023-11-28T16:58:57.318041+0000","last_clean":"2023-11-28T16:58:57.318041+0000","last_became_active":"2023-11-28T16:58:57.315754+0000","last_became_peered":"2023-11-28T16:58:57.315754+0000","last_unstale":"2023-11-28T16:58:57.318041+0000","last_undegraded":"2023-11-28T16:58:57.318041+0000","last_fullsized":"2023-11-28T16:58:57.318041+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:14.149272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312252+0000","last_change":"2023-11-28T16:58:56.862068+0000","last_active":"2023-11-28T16:58:58.312252+0000","last_peered":"2023-11-28T16:58:58.312252+0000","last_clean":"2023-11-28T16:58:58.312252+0000","last_became_active":"2023-11-28T16:58:56.861701+0000","last_became_peered":"2023-11-28T16:58:56.861701+0000","last_unstale":"2023-11-28T16:58:58.312252+0000","last_undegraded":"2023-11-28T16:58:58.312252+0000","last_fullsized":"2023-11-28T16:58:58.312252+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:32.676826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294860+0000","last_change":"2023-11-28T16:58:57.310885+0000","last_active":"2023-11-28T16:58:58.294860+0000","last_peered":"2023-11-28T16:58:58.294860+0000","last_clean":"2023-11-28T16:58:58.294860+0000","last_became_active":"2023-11-28T16:58:57.310590+0000","last_became_peered":"2023-11-28T16:58:57.310590+0000","last_unstale":"2023-11-28T16:58:58.294860+0000","last_undegraded":"2023-11-28T16:58:58.294860+0000","last_fullsized":"2023-11-28T16:58:58.294860+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.862374+0000","last_change":"2023-11-28T16:58:56.859076+0000","last_active":"2023-11-28T16:58:57.862374+0000","last_peered":"2023-11-28T16:58:57.862374+0000","last_clean":"2023-11-28T16:58:57.862374+0000","last_became_active":"2023-11-28T16:58:56.858792+0000","last_became_peered":"2023-11-28T16:58:56.858792+0000","last_unstale":"2023-11-28T16:58:57.862374+0000","last_undegraded":"2023-11-28T16:58:57.862374+0000","last_fullsized":"2023-11-28T16:58:57.862374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:46.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.317749+0000","last_change":"2023-11-28T16:58:57.310281+0000","last_active":"2023-11-28T16:58:57.317749+0000","last_peered":"2023-11-28T16:58:57.317749+0000","last_clean":"2023-11-28T16:58:57.317749+0000","last_became_active":"2023-11-28T16:58:57.308492+0000","last_became_peered":"2023-11-28T16:58:57.308492+0000","last_unstale":"2023-11-28T16:58:57.317749+0000","last_undegraded":"2023-11-28T16:58:57.317749+0000","last_fullsized":"2023-11-28T16:58:57.317749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.291822+0000","last_change":"2023-11-28T16:58:56.848509+0000","last_active":"2023-11-28T16:58:57.291822+0000","last_peered":"2023-11-28T16:58:57.291822+0000","last_clean":"2023-11-28T16:58:57.291822+0000","last_became_active":"2023-11-28T16:58:56.847800+0000","last_became_peered":"2023-11-28T16:58:56.847800+0000","last_unstale":"2023-11-28T16:58:57.291822+0000","last_undegraded":"2023-11-28T16:58:57.291822+0000","last_fullsized":"2023-11-28T16:58:57.291822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:56.437961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221374+0000","last_change":"2023-11-28T16:58:57.316240+0000","last_active":"2023-11-28T16:58:59.221374+0000","last_peered":"2023-11-28T16:58:59.221374+0000","last_clean":"2023-11-28T16:58:59.221374+0000","last_became_active":"2023-11-28T16:58:57.315895+0000","last_became_peered":"2023-11-28T16:58:57.315895+0000","last_unstale":"2023-11-28T16:58:59.221374+0000","last_undegraded":"2023-11-28T16:58:59.221374+0000","last_fullsized":"2023-11-28T16:58:59.221374+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:01.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221195+0000","last_change":"2023-11-28T16:58:56.862862+0000","last_active":"2023-11-28T16:58:59.221195+0000","last_peered":"2023-11-28T16:58:59.221195+0000","last_clean":"2023-11-28T16:58:59.221195+0000","last_became_active":"2023-11-28T16:58:56.862564+0000","last_became_peered":"2023-11-28T16:58:56.862564+0000","last_unstale":"2023-11-28T16:58:59.221195+0000","last_undegraded":"2023-11-28T16:58:59.221195+0000","last_fullsized":"2023-11-28T16:58:59.221195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294818+0000","last_change":"2023-11-28T16:58:57.305378+0000","last_active":"2023-11-28T16:58:58.294818+0000","last_peered":"2023-11-28T16:58:58.294818+0000","last_clean":"2023-11-28T16:58:58.294818+0000","last_became_active":"2023-11-28T16:58:57.304738+0000","last_became_peered":"2023-11-28T16:58:57.304738+0000","last_unstale":"2023-11-28T16:58:58.294818+0000","last_undegraded":"2023-11-28T16:58:58.294818+0000","last_fullsized":"2023-11-28T16:58:58.294818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221450+0000","last_change":"2023-11-28T16:58:56.860344+0000","last_active":"2023-11-28T16:58:59.221450+0000","last_peered":"2023-11-28T16:58:59.221450+0000","last_clean":"2023-11-28T16:58:59.221450+0000","last_became_active":"2023-11-28T16:58:56.859853+0000","last_became_peered":"2023-11-28T16:58:56.859853+0000","last_unstale":"2023-11-28T16:58:59.221450+0000","last_undegraded":"2023-11-28T16:58:59.221450+0000","last_fullsized":"2023-11-28T16:58:59.221450+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.312436+0000","last_change":"2023-11-28T16:58:57.306938+0000","last_active":"2023-11-28T16:58:57.312436+0000","last_peered":"2023-11-28T16:58:57.312436+0000","last_clean":"2023-11-28T16:58:57.312436+0000","last_became_active":"2023-11-28T16:58:57.306452+0000","last_became_peered":"2023-11-28T16:58:57.306452+0000","last_unstale":"2023-11-28T16:58:57.312436+0000","last_undegraded":"2023-11-28T16:58:57.312436+0000","last_fullsized":"2023-11-28T16:58:57.312436+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:45.387902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293740+0000","last_change":"2023-11-28T16:58:56.858723+0000","last_active":"2023-11-28T16:58:58.293740+0000","last_peered":"2023-11-28T16:58:58.293740+0000","last_clean":"2023-11-28T16:58:58.293740+0000","last_became_active":"2023-11-28T16:58:56.858282+0000","last_became_peered":"2023-11-28T16:58:56.858282+0000","last_unstale":"2023-11-28T16:58:58.293740+0000","last_undegraded":"2023-11-28T16:58:58.293740+0000","last_fullsized":"2023-11-28T16:58:58.293740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293872+0000","last_change":"2023-11-28T16:58:57.305002+0000","last_active":"2023-11-28T16:58:58.293872+0000","last_peered":"2023-11-28T16:58:58.293872+0000","last_clean":"2023-11-28T16:58:58.293872+0000","last_became_active":"2023-11-28T16:58:57.304759+0000","last_became_peered":"2023-11-28T16:58:57.304759+0000","last_unstale":"2023-11-28T16:58:58.293872+0000","last_undegraded":"2023-11-28T16:58:58.293872+0000","last_fullsized":"2023-11-28T16:58:58.293872+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294388+0000","last_change":"2023-11-28T16:58:56.848645+0000","last_active":"2023-11-28T16:58:58.294388+0000","last_peered":"2023-11-28T16:58:58.294388+0000","last_clean":"2023-11-28T16:58:58.294388+0000","last_became_active":"2023-11-28T16:58:56.848300+0000","last_became_peered":"2023-11-28T16:58:56.848300+0000","last_unstale":"2023-11-28T16:58:58.294388+0000","last_undegraded":"2023-11-28T16:58:58.294388+0000","last_fullsized":"2023-11-28T16:58:58.294388+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.306233+0000","last_change":"2023-11-28T16:58:57.299433+0000","last_active":"2023-11-28T16:58:57.306233+0000","last_peered":"2023-11-28T16:58:57.306233+0000","last_clean":"2023-11-28T16:58:57.306233+0000","last_became_active":"2023-11-28T16:58:57.299098+0000","last_became_peered":"2023-11-28T16:58:57.299098+0000","last_unstale":"2023-11-28T16:58:57.306233+0000","last_undegraded":"2023-11-28T16:58:57.306233+0000","last_fullsized":"2023-11-28T16:58:57.306233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221381+0000","last_change":"2023-11-28T16:58:56.855829+0000","last_active":"2023-11-28T16:58:59.221381+0000","last_peered":"2023-11-28T16:58:59.221381+0000","last_clean":"2023-11-28T16:58:59.221381+0000","last_became_active":"2023-11-28T16:58:56.855381+0000","last_became_peered":"2023-11-28T16:58:56.855381+0000","last_unstale":"2023-11-28T16:58:59.221381+0000","last_undegraded":"2023-11-28T16:58:59.221381+0000","last_fullsized":"2023-11-28T16:58:59.221381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:41.581251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221056+0000","last_change":"2023-11-28T16:58:57.316272+0000","last_active":"2023-11-28T16:58:59.221056+0000","last_peered":"2023-11-28T16:58:59.221056+0000","last_clean":"2023-11-28T16:58:59.221056+0000","last_became_active":"2023-11-28T16:58:57.315990+0000","last_became_peered":"2023-11-28T16:58:57.315990+0000","last_unstale":"2023-11-28T16:58:59.221056+0000","last_undegraded":"2023-11-28T16:58:59.221056+0000","last_fullsized":"2023-11-28T16:58:59.221056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294271+0000","last_change":"2023-11-28T16:58:56.847748+0000","last_active":"2023-11-28T16:58:58.294271+0000","last_peered":"2023-11-28T16:58:58.294271+0000","last_clean":"2023-11-28T16:58:58.294271+0000","last_became_active":"2023-11-28T16:58:56.847459+0000","last_became_peered":"2023-11-28T16:58:56.847459+0000","last_unstale":"2023-11-28T16:58:58.294271+0000","last_undegraded":"2023-11-28T16:58:58.294271+0000","last_fullsized":"2023-11-28T16:58:58.294271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:03.416274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310193+0000","last_change":"2023-11-28T16:58:57.306584+0000","last_active":"2023-11-28T16:58:57.310193+0000","last_peered":"2023-11-28T16:58:57.310193+0000","last_clean":"2023-11-28T16:58:57.310193+0000","last_became_active":"2023-11-28T16:58:57.306137+0000","last_became_peered":"2023-11-28T16:58:57.306137+0000","last_unstale":"2023-11-28T16:58:57.310193+0000","last_undegraded":"2023-11-28T16:58:57.310193+0000","last_fullsized":"2023-11-28T16:58:57.310193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:51.059755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.868504+0000","last_change":"2023-11-28T16:58:56.863771+0000","last_active":"2023-11-28T16:58:57.868504+0000","last_peered":"2023-11-28T16:58:57.868504+0000","last_clean":"2023-11-28T16:58:57.868504+0000","last_became_active":"2023-11-28T16:58:56.863302+0000","last_became_peered":"2023-11-28T16:58:56.863302+0000","last_unstale":"2023-11-28T16:58:57.868504+0000","last_undegraded":"2023-11-28T16:58:57.868504+0000","last_fullsized":"2023-11-28T16:58:57.868504+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:26.909196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T16:58:56.854499+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:56.854499+0000","last_peered":"2023-11-28T16:58:56.854499+0000","last_clean":"2023-11-28T16:58:56.854499+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:56.854499+0000","last_undegraded":"2023-11-28T16:58:56.854499+0000","last_fullsized":"2023-11-28T16:58:56.854499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":953976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.505},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65300000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.44},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.61899999999999999}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":847872,"data_stored":364232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.82299999999999995,"5min":1.474,"15min":1.474},"last":0.623},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.72799999999999998,"15min":0.753},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":1.0209999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92300000000000004,"5min":1.071,"15min":1.071},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.84399999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.95099999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.52900000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.341,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4019999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.89900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":851968,"data_stored":365172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.53800000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.52100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58199999999999996}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.626},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89200000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96199999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":369838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.234,"15min":1.234},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.871,"5min":1.964,"15min":1.964},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.704,"15min":1.704},"last":0.84599999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88400000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.254,"15min":1.254},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88,"5min":1.548,"15min":1.548},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90800000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.218,"15min":1.218},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.593,"15min":1.593},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":371450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.56100000000000005,"5min":0.745,"15min":0.745},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.874,"15min":0.874},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.089,"5min":1.21,"15min":1.21},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91900000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.83899999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0049999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0309999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.022,"5min":1.25,"15min":1.25},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.423,"15min":1.423},"last":0.92500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":370420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48099999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71499999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.65800000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371}]},{"osd":4,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.81599999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92500000000000004,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.877},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.94499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":363732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52700000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.315},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.34699999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.56000000000000005,"5min":0.746,"15min":0.746},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.55600000000000005,"5min":1.04,"15min":1.04},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.625,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.98699999999999999,"5min":1.446,"15min":1.446},"last":0.623},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.034,"5min":1.47,"15min":1.47},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1180000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0820000000000001,"5min":1.327,"15min":1.327},"last":0.73099999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94599999999999995,"5min":1.3,"15min":1.3},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.167,"5min":1.526,"15min":1.526},"last":0.746}]},{"osd":7,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1459999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1445888,"data_stored":960240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.57699999999999996}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.86399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:01.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:02.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fc0cea640 1 Processor -- start 2023-11-28T16:59:02.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fc0cea640 1 -- start start 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fc0cea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fbc1520f0 0x7f1fbc0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fc0cea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fc0cea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0c5520 con 0x7f1fbc155660 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fc0cea640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc06c020 con 0x7f1fbc1520f0 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fc0cea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc1524d0 con 0x7f1fbc0c7f70 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fb3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1fbc155660 0x7f1fbc06b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44890/0 (socket says 172.21.15.26:44890) 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fb3fff640 1 -- 172.21.15.26:0/1674717379 learned_addr learned my addr 172.21.15.26:0/1674717379 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fba59c640 1 --2- 172.21.15.26:0/1674717379 >> v2:172.21.15.79:3300/0 conn(0x7f1fbc1520f0 0x7f1fbc0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fbad9d640 1 --2- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fb9d9b640 1 -- 172.21.15.26:0/1674717379 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346252753 0 0) 0x7f1fbc0c5520 con 0x7f1fbc155660 2023-11-28T16:59:02.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fb9d9b640 1 -- 172.21.15.26:0/1674717379 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa8003530 con 0x7f1fbc155660 2023-11-28T16:59:02.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fba59c640 1 -- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 msgr2=0x7f1fbc0c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:02.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fba59c640 1 --2- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fba59c640 1 -- 172.21.15.26:0/1674717379 >> v1:172.21.15.26:6789/0 conn(0x7f1fbc155660 legacy=0x7f1fbc06b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fba59c640 1 -- 172.21.15.26:0/1674717379 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0c9a80 con 0x7f1fbc1520f0 2023-11-28T16:59:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.152+0000 7f1fbad9d640 1 --2- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fba59c640 1 --2- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0c49f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0097c0 tx=0x7f1fac01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a940061cafa4d2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fb9d9b640 1 -- 172.21.15.26:0/1674717379 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0ac620 con 0x7f1fbc1520f0 2023-11-28T16:59:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fb9d9b640 1 -- 172.21.15.26:0/1674717379 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0ac780 con 0x7f1fbc1520f0 2023-11-28T16:59:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fb9d9b640 1 -- 172.21.15.26:0/1674717379 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0acb10 con 0x7f1fbc1520f0 2023-11-28T16:59:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 -- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc1520f0 msgr2=0x7f1fbc0c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0c49f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0097c0 tx=0x7f1fac01c3c0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 -- 172.21.15.26:0/1674717379 shutdown_connections 2023-11-28T16:59:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/1674717379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0c49f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 -- 172.21.15.26:0/1674717379 >> 172.21.15.26:0/1674717379 conn(0x7f1fbc0ca070 msgr2=0x7f1fbc0ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 -- 172.21.15.26:0/1674717379 shutdown_connections 2023-11-28T16:59:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.156+0000 7f1fc0cea640 1 -- 172.21.15.26:0/1674717379 wait complete. 2023-11-28T16:59:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 Processor -- start 2023-11-28T16:59:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 -- start start 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc155660 0x7f1fbc0bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc1f1160 con 0x7f1fbc1520f0 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc148810 con 0x7f1fbc155660 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0af770 con 0x7f1fbc0c7f70 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47862/0 (socket says 172.21.15.26:47862) 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 -- 172.21.15.26:0/930414534 learned_addr learned my addr 172.21.15.26:0/930414534 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fba59c640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fbad9d640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc155660 0x7f1fbc0bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 -- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 msgr2=0x7f1fbc0aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 -- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc155660 msgr2=0x7f1fbc0bebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc155660 0x7f1fbc0bebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 -- 172.21.15.26:0/930414534 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb4009a70 con 0x7f1fbc1520f0 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fbad9d640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc155660 0x7f1fbc0bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb3fff640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0af230 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c430 tx=0x7f1fa400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb2ffd640 1 -- 172.21.15.26:0/930414534 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4005cf0 con 0x7f1fbc1520f0 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb2ffd640 1 -- 172.21.15.26:0/930414534 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4005e50 con 0x7f1fbc1520f0 2023-11-28T16:59:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fb2ffd640 1 -- 172.21.15.26:0/930414534 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40072f0 con 0x7f1fbc1520f0 2023-11-28T16:59:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.160+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac009420 con 0x7f1fbc1520f0 2023-11-28T16:59:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.164+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc0c3be0 con 0x7f1fbc1520f0 2023-11-28T16:59:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.164+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fbc04e890 con 0x7f1fbc1520f0 2023-11-28T16:59:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.164+0000 7f1fb2ffd640 1 -- 172.21.15.26:0/930414534 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1fa4007450 con 0x7f1fbc1520f0 2023-11-28T16:59:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.164+0000 7f1fb2ffd640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1f9c0668d0 0x7f1f9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.164+0000 7f1fb2ffd640 1 -- 172.21.15.26:0/930414534 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fa40836c0 con 0x7f1fbc1520f0 2023-11-28T16:59:02.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.164+0000 7f1fba59c640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1f9c0668d0 0x7f1f9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.168+0000 7f1fba59c640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1f9c0668d0 0x7f1f9c068d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0ae000 tx=0x7f1fac0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.168+0000 7f1fb2ffd640 1 -- 172.21.15.26:0/930414534 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fa4050910 con 0x7f1fbc1520f0 2023-11-28T16:59:02.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.324+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fbc0c4f30 con 0x7f1f9c0668d0 2023-11-28T16:59:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.332+0000 7f1fb2ffd640 1 -- 172.21.15.26:0/930414534 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288889 (secure 0 0 0) 0x7f1fac0ac8f0 con 0x7f1f9c0668d0 2023-11-28T16:59:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:02.340 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1f9c0668d0 msgr2=0x7f1f9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1f9c0668d0 0x7f1f9c068d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0ae000 tx=0x7f1fac0a7000 comp rx=0 tx=0).stop 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fbc1520f0 msgr2=0x7f1fbc0af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0af230 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c430 tx=0x7f1fa400c8f0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 shutdown_connections 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc155660 0x7f1fbc0bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fbc1520f0 0x7f1fbc0af230 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1f9c0668d0 0x7f1f9c068d90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 --2- 172.21.15.26:0/930414534 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1fbc0c7f70 0x7f1fbc0aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 >> 172.21.15.26:0/930414534 conn(0x7f1fbc0ca070 msgr2=0x7f1fbc0c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 shutdown_connections 2023-11-28T16:59:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.336+0000 7f1fc0cea640 1 -- 172.21.15.26:0/930414534 wait complete. 2023-11-28T16:59:02.359 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-11-28T16:59:01.615243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248940,"kb_used_data":7800,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725780,"statfs":{"total":773094113280,"available":772839198720,"internally_reserved":0,"allocated":7987200,"data_stored":4119060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.785430"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221343+0000","last_change":"2023-11-28T16:58:57.314088+0000","last_active":"2023-11-28T16:58:59.221343+0000","last_peered":"2023-11-28T16:58:59.221343+0000","last_clean":"2023-11-28T16:58:59.221343+0000","last_became_active":"2023-11-28T16:58:57.312523+0000","last_became_peered":"2023-11-28T16:58:57.312523+0000","last_unstale":"2023-11-28T16:58:59.221343+0000","last_undegraded":"2023-11-28T16:58:59.221343+0000","last_fullsized":"2023-11-28T16:58:59.221343+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.313198+0000","last_change":"2023-11-28T16:58:57.310945+0000","last_active":"2023-11-28T16:58:57.313198+0000","last_peered":"2023-11-28T16:58:57.313198+0000","last_clean":"2023-11-28T16:58:57.313198+0000","last_became_active":"2023-11-28T16:58:57.310682+0000","last_became_peered":"2023-11-28T16:58:57.310682+0000","last_unstale":"2023-11-28T16:58:57.313198+0000","last_undegraded":"2023-11-28T16:58:57.313198+0000","last_fullsized":"2023-11-28T16:58:57.313198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:58.918711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.316993+0000","last_change":"2023-11-28T16:58:57.309345+0000","last_active":"2023-11-28T16:58:57.316993+0000","last_peered":"2023-11-28T16:58:57.316993+0000","last_clean":"2023-11-28T16:58:57.316993+0000","last_became_active":"2023-11-28T16:58:57.308923+0000","last_became_peered":"2023-11-28T16:58:57.308923+0000","last_unstale":"2023-11-28T16:58:57.316993+0000","last_undegraded":"2023-11-28T16:58:57.316993+0000","last_fullsized":"2023-11-28T16:58:57.316993+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293144+0000","last_change":"2023-11-28T16:58:57.304932+0000","last_active":"2023-11-28T16:58:58.293144+0000","last_peered":"2023-11-28T16:58:58.293144+0000","last_clean":"2023-11-28T16:58:58.293144+0000","last_became_active":"2023-11-28T16:58:57.304401+0000","last_became_peered":"2023-11-28T16:58:57.304401+0000","last_unstale":"2023-11-28T16:58:58.293144+0000","last_undegraded":"2023-11-28T16:58:58.293144+0000","last_fullsized":"2023-11-28T16:58:58.293144+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:08.489709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294455+0000","last_change":"2023-11-28T16:58:57.312192+0000","last_active":"2023-11-28T16:58:58.294455+0000","last_peered":"2023-11-28T16:58:58.294455+0000","last_clean":"2023-11-28T16:58:58.294455+0000","last_became_active":"2023-11-28T16:58:57.311963+0000","last_became_peered":"2023-11-28T16:58:57.311963+0000","last_unstale":"2023-11-28T16:58:58.294455+0000","last_undegraded":"2023-11-28T16:58:58.294455+0000","last_fullsized":"2023-11-28T16:58:58.294455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.320663+0000","last_change":"2023-11-28T16:58:57.318754+0000","last_active":"2023-11-28T16:58:57.320663+0000","last_peered":"2023-11-28T16:58:57.320663+0000","last_clean":"2023-11-28T16:58:57.320663+0000","last_became_active":"2023-11-28T16:58:57.318472+0000","last_became_peered":"2023-11-28T16:58:57.318472+0000","last_unstale":"2023-11-28T16:58:57.320663+0000","last_undegraded":"2023-11-28T16:58:57.320663+0000","last_fullsized":"2023-11-28T16:58:57.320663+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:42.587204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292678+0000","last_change":"2023-11-28T16:58:57.305646+0000","last_active":"2023-11-28T16:58:58.292678+0000","last_peered":"2023-11-28T16:58:58.292678+0000","last_clean":"2023-11-28T16:58:58.292678+0000","last_became_active":"2023-11-28T16:58:57.305348+0000","last_became_peered":"2023-11-28T16:58:57.305348+0000","last_unstale":"2023-11-28T16:58:58.292678+0000","last_undegraded":"2023-11-28T16:58:58.292678+0000","last_fullsized":"2023-11-28T16:58:58.292678+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:10.412723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.317392+0000","last_change":"2023-11-28T16:58:57.313508+0000","last_active":"2023-11-28T16:58:57.317392+0000","last_peered":"2023-11-28T16:58:57.317392+0000","last_clean":"2023-11-28T16:58:57.317392+0000","last_became_active":"2023-11-28T16:58:57.311907+0000","last_became_peered":"2023-11-28T16:58:57.311907+0000","last_unstale":"2023-11-28T16:58:57.317392+0000","last_undegraded":"2023-11-28T16:58:57.317392+0000","last_fullsized":"2023-11-28T16:58:57.317392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:28.805091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.317981+0000","last_change":"2023-11-28T16:58:57.315988+0000","last_active":"2023-11-28T16:58:57.317981+0000","last_peered":"2023-11-28T16:58:57.317981+0000","last_clean":"2023-11-28T16:58:57.317981+0000","last_became_active":"2023-11-28T16:58:57.315705+0000","last_became_peered":"2023-11-28T16:58:57.315705+0000","last_unstale":"2023-11-28T16:58:57.317981+0000","last_undegraded":"2023-11-28T16:58:57.317981+0000","last_fullsized":"2023-11-28T16:58:57.317981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:05.122019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221503+0000","last_change":"2023-11-28T16:58:57.307177+0000","last_active":"2023-11-28T16:58:59.221503+0000","last_peered":"2023-11-28T16:58:59.221503+0000","last_clean":"2023-11-28T16:58:59.221503+0000","last_became_active":"2023-11-28T16:58:57.305697+0000","last_became_peered":"2023-11-28T16:58:57.305697+0000","last_unstale":"2023-11-28T16:58:59.221503+0000","last_undegraded":"2023-11-28T16:58:59.221503+0000","last_fullsized":"2023-11-28T16:58:59.221503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.308975+0000","last_change":"2023-11-28T16:58:57.301869+0000","last_active":"2023-11-28T16:58:57.308975+0000","last_peered":"2023-11-28T16:58:57.308975+0000","last_clean":"2023-11-28T16:58:57.308975+0000","last_became_active":"2023-11-28T16:58:57.299043+0000","last_became_peered":"2023-11-28T16:58:57.299043+0000","last_unstale":"2023-11-28T16:58:57.308975+0000","last_undegraded":"2023-11-28T16:58:57.308975+0000","last_fullsized":"2023-11-28T16:58:57.308975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:26.863725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.220984+0000","last_change":"2023-11-28T16:58:57.304835+0000","last_active":"2023-11-28T16:58:59.220984+0000","last_peered":"2023-11-28T16:58:59.220984+0000","last_clean":"2023-11-28T16:58:59.220984+0000","last_became_active":"2023-11-28T16:58:57.304529+0000","last_became_peered":"2023-11-28T16:58:57.304529+0000","last_unstale":"2023-11-28T16:58:59.220984+0000","last_undegraded":"2023-11-28T16:58:59.220984+0000","last_fullsized":"2023-11-28T16:58:59.220984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.306478+0000","last_change":"2023-11-28T16:58:57.304288+0000","last_active":"2023-11-28T16:58:57.306478+0000","last_peered":"2023-11-28T16:58:57.306478+0000","last_clean":"2023-11-28T16:58:57.306478+0000","last_became_active":"2023-11-28T16:58:57.303979+0000","last_became_peered":"2023-11-28T16:58:57.303979+0000","last_unstale":"2023-11-28T16:58:57.306478+0000","last_undegraded":"2023-11-28T16:58:57.306478+0000","last_fullsized":"2023-11-28T16:58:57.306478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292677+0000","last_change":"2023-11-28T16:58:57.309909+0000","last_active":"2023-11-28T16:58:58.292677+0000","last_peered":"2023-11-28T16:58:58.292677+0000","last_clean":"2023-11-28T16:58:58.292677+0000","last_became_active":"2023-11-28T16:58:57.309581+0000","last_became_peered":"2023-11-28T16:58:57.309581+0000","last_unstale":"2023-11-28T16:58:58.292677+0000","last_undegraded":"2023-11-28T16:58:58.292677+0000","last_fullsized":"2023-11-28T16:58:58.292677+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:44.715872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312327+0000","last_change":"2023-11-28T16:58:57.305318+0000","last_active":"2023-11-28T16:58:58.312327+0000","last_peered":"2023-11-28T16:58:58.312327+0000","last_clean":"2023-11-28T16:58:58.312327+0000","last_became_active":"2023-11-28T16:58:57.300492+0000","last_became_peered":"2023-11-28T16:58:57.300492+0000","last_unstale":"2023-11-28T16:58:58.312327+0000","last_undegraded":"2023-11-28T16:58:58.312327+0000","last_fullsized":"2023-11-28T16:58:58.312327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294266+0000","last_change":"2023-11-28T16:58:57.309435+0000","last_active":"2023-11-28T16:58:58.294266+0000","last_peered":"2023-11-28T16:58:58.294266+0000","last_clean":"2023-11-28T16:58:58.294266+0000","last_became_active":"2023-11-28T16:58:57.308962+0000","last_became_peered":"2023-11-28T16:58:57.308962+0000","last_unstale":"2023-11-28T16:58:58.294266+0000","last_undegraded":"2023-11-28T16:58:58.294266+0000","last_fullsized":"2023-11-28T16:58:58.294266+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294973+0000","last_change":"2023-11-28T16:58:57.302600+0000","last_active":"2023-11-28T16:58:58.294973+0000","last_peered":"2023-11-28T16:58:58.294973+0000","last_clean":"2023-11-28T16:58:58.294973+0000","last_became_active":"2023-11-28T16:58:57.302328+0000","last_became_peered":"2023-11-28T16:58:57.302328+0000","last_unstale":"2023-11-28T16:58:58.294973+0000","last_undegraded":"2023-11-28T16:58:58.294973+0000","last_fullsized":"2023-11-28T16:58:58.294973+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292893+0000","last_change":"2023-11-28T16:58:57.307084+0000","last_active":"2023-11-28T16:58:58.292893+0000","last_peered":"2023-11-28T16:58:58.292893+0000","last_clean":"2023-11-28T16:58:58.292893+0000","last_became_active":"2023-11-28T16:58:57.306795+0000","last_became_peered":"2023-11-28T16:58:57.306795+0000","last_unstale":"2023-11-28T16:58:58.292893+0000","last_undegraded":"2023-11-28T16:58:58.292893+0000","last_fullsized":"2023-11-28T16:58:58.292893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:45:36.527998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294066+0000","last_change":"2023-11-28T16:58:57.301492+0000","last_active":"2023-11-28T16:58:58.294066+0000","last_peered":"2023-11-28T16:58:58.294066+0000","last_clean":"2023-11-28T16:58:58.294066+0000","last_became_active":"2023-11-28T16:58:57.301143+0000","last_became_peered":"2023-11-28T16:58:57.301143+0000","last_unstale":"2023-11-28T16:58:58.294066+0000","last_undegraded":"2023-11-28T16:58:58.294066+0000","last_fullsized":"2023-11-28T16:58:58.294066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293234+0000","last_change":"2023-11-28T16:58:57.305035+0000","last_active":"2023-11-28T16:58:58.293234+0000","last_peered":"2023-11-28T16:58:58.293234+0000","last_clean":"2023-11-28T16:58:58.293234+0000","last_became_active":"2023-11-28T16:58:57.304747+0000","last_became_peered":"2023-11-28T16:58:57.304747+0000","last_unstale":"2023-11-28T16:58:58.293234+0000","last_undegraded":"2023-11-28T16:58:58.293234+0000","last_fullsized":"2023-11-28T16:58:58.293234+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:59:37.707020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292990+0000","last_change":"2023-11-28T16:58:57.313873+0000","last_active":"2023-11-28T16:58:58.292990+0000","last_peered":"2023-11-28T16:58:58.292990+0000","last_clean":"2023-11-28T16:58:58.292990+0000","last_became_active":"2023-11-28T16:58:57.313545+0000","last_became_peered":"2023-11-28T16:58:57.313545+0000","last_unstale":"2023-11-28T16:58:58.292990+0000","last_undegraded":"2023-11-28T16:58:58.292990+0000","last_fullsized":"2023-11-28T16:58:58.292990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:19.647634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.309684+0000","last_change":"2023-11-28T16:58:57.299061+0000","last_active":"2023-11-28T16:58:57.309684+0000","last_peered":"2023-11-28T16:58:57.309684+0000","last_clean":"2023-11-28T16:58:57.309684+0000","last_became_active":"2023-11-28T16:58:57.298785+0000","last_became_peered":"2023-11-28T16:58:57.298785+0000","last_unstale":"2023-11-28T16:58:57.309684+0000","last_undegraded":"2023-11-28T16:58:57.309684+0000","last_fullsized":"2023-11-28T16:58:57.309684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:59.565164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.220995+0000","last_change":"2023-11-28T16:58:57.315028+0000","last_active":"2023-11-28T16:58:59.220995+0000","last_peered":"2023-11-28T16:58:59.220995+0000","last_clean":"2023-11-28T16:58:59.220995+0000","last_became_active":"2023-11-28T16:58:57.314688+0000","last_became_peered":"2023-11-28T16:58:57.314688+0000","last_unstale":"2023-11-28T16:58:59.220995+0000","last_undegraded":"2023-11-28T16:58:59.220995+0000","last_fullsized":"2023-11-28T16:58:59.220995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292684+0000","last_change":"2023-11-28T16:58:57.313407+0000","last_active":"2023-11-28T16:58:58.292684+0000","last_peered":"2023-11-28T16:58:58.292684+0000","last_clean":"2023-11-28T16:58:58.292684+0000","last_became_active":"2023-11-28T16:58:57.313195+0000","last_became_peered":"2023-11-28T16:58:57.313195+0000","last_unstale":"2023-11-28T16:58:58.292684+0000","last_undegraded":"2023-11-28T16:58:58.292684+0000","last_fullsized":"2023-11-28T16:58:58.292684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:41:36.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310161+0000","last_change":"2023-11-28T16:58:57.306497+0000","last_active":"2023-11-28T16:58:57.310161+0000","last_peered":"2023-11-28T16:58:57.310161+0000","last_clean":"2023-11-28T16:58:57.310161+0000","last_became_active":"2023-11-28T16:58:57.306200+0000","last_became_peered":"2023-11-28T16:58:57.306200+0000","last_unstale":"2023-11-28T16:58:57.310161+0000","last_undegraded":"2023-11-28T16:58:57.310161+0000","last_fullsized":"2023-11-28T16:58:57.310161+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:34.591413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.305177+0000","last_change":"2023-11-28T16:58:57.299393+0000","last_active":"2023-11-28T16:58:57.305177+0000","last_peered":"2023-11-28T16:58:57.305177+0000","last_clean":"2023-11-28T16:58:57.305177+0000","last_became_active":"2023-11-28T16:58:57.299079+0000","last_became_peered":"2023-11-28T16:58:57.299079+0000","last_unstale":"2023-11-28T16:58:57.305177+0000","last_undegraded":"2023-11-28T16:58:57.305177+0000","last_fullsized":"2023-11-28T16:58:57.305177+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:16.960155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294648+0000","last_change":"2023-11-28T16:58:57.304447+0000","last_active":"2023-11-28T16:58:58.294648+0000","last_peered":"2023-11-28T16:58:58.294648+0000","last_clean":"2023-11-28T16:58:58.294648+0000","last_became_active":"2023-11-28T16:58:57.301404+0000","last_became_peered":"2023-11-28T16:58:57.301404+0000","last_unstale":"2023-11-28T16:58:58.294648+0000","last_undegraded":"2023-11-28T16:58:58.294648+0000","last_fullsized":"2023-11-28T16:58:58.294648+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221310+0000","last_change":"2023-11-28T16:58:57.315464+0000","last_active":"2023-11-28T16:58:59.221310+0000","last_peered":"2023-11-28T16:58:59.221310+0000","last_clean":"2023-11-28T16:58:59.221310+0000","last_became_active":"2023-11-28T16:58:57.314425+0000","last_became_peered":"2023-11-28T16:58:57.314425+0000","last_unstale":"2023-11-28T16:58:59.221310+0000","last_undegraded":"2023-11-28T16:58:59.221310+0000","last_fullsized":"2023-11-28T16:58:59.221310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.308218+0000","last_change":"2023-11-28T16:58:57.299772+0000","last_active":"2023-11-28T16:58:57.308218+0000","last_peered":"2023-11-28T16:58:57.308218+0000","last_clean":"2023-11-28T16:58:57.308218+0000","last_became_active":"2023-11-28T16:58:57.299523+0000","last_became_peered":"2023-11-28T16:58:57.299523+0000","last_unstale":"2023-11-28T16:58:57.308218+0000","last_undegraded":"2023-11-28T16:58:57.308218+0000","last_fullsized":"2023-11-28T16:58:57.308218+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:50.808519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.309673+0000","last_change":"2023-11-28T16:58:57.299039+0000","last_active":"2023-11-28T16:58:57.309673+0000","last_peered":"2023-11-28T16:58:57.309673+0000","last_clean":"2023-11-28T16:58:57.309673+0000","last_became_active":"2023-11-28T16:58:57.298773+0000","last_became_peered":"2023-11-28T16:58:57.298773+0000","last_unstale":"2023-11-28T16:58:57.309673+0000","last_undegraded":"2023-11-28T16:58:57.309673+0000","last_fullsized":"2023-11-28T16:58:57.309673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:32.981926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294431+0000","last_change":"2023-11-28T16:58:57.299925+0000","last_active":"2023-11-28T16:58:58.294431+0000","last_peered":"2023-11-28T16:58:58.294431+0000","last_clean":"2023-11-28T16:58:58.294431+0000","last_became_active":"2023-11-28T16:58:57.299627+0000","last_became_peered":"2023-11-28T16:58:57.299627+0000","last_unstale":"2023-11-28T16:58:58.294431+0000","last_undegraded":"2023-11-28T16:58:58.294431+0000","last_fullsized":"2023-11-28T16:58:58.294431+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.220960+0000","last_change":"2023-11-28T16:58:57.313636+0000","last_active":"2023-11-28T16:58:59.220960+0000","last_peered":"2023-11-28T16:58:59.220960+0000","last_clean":"2023-11-28T16:58:59.220960+0000","last_became_active":"2023-11-28T16:58:57.313257+0000","last_became_peered":"2023-11-28T16:58:57.313257+0000","last_unstale":"2023-11-28T16:58:59.220960+0000","last_undegraded":"2023-11-28T16:58:59.220960+0000","last_fullsized":"2023-11-28T16:58:59.220960+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294869+0000","last_change":"2023-11-28T16:58:57.310866+0000","last_active":"2023-11-28T16:58:58.294869+0000","last_peered":"2023-11-28T16:58:58.294869+0000","last_clean":"2023-11-28T16:58:58.294869+0000","last_became_active":"2023-11-28T16:58:57.310515+0000","last_became_peered":"2023-11-28T16:58:57.310515+0000","last_unstale":"2023-11-28T16:58:58.294869+0000","last_undegraded":"2023-11-28T16:58:58.294869+0000","last_fullsized":"2023-11-28T16:58:58.294869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221488+0000","last_change":"2023-11-28T16:58:56.862978+0000","last_active":"2023-11-28T16:58:59.221488+0000","last_peered":"2023-11-28T16:58:59.221488+0000","last_clean":"2023-11-28T16:58:59.221488+0000","last_became_active":"2023-11-28T16:58:56.862677+0000","last_became_peered":"2023-11-28T16:58:56.862677+0000","last_unstale":"2023-11-28T16:58:59.221488+0000","last_undegraded":"2023-11-28T16:58:59.221488+0000","last_fullsized":"2023-11-28T16:58:59.221488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221387+0000","last_change":"2023-11-28T16:58:57.315127+0000","last_active":"2023-11-28T16:58:59.221387+0000","last_peered":"2023-11-28T16:58:59.221387+0000","last_clean":"2023-11-28T16:58:59.221387+0000","last_became_active":"2023-11-28T16:58:57.314836+0000","last_became_peered":"2023-11-28T16:58:57.314836+0000","last_unstale":"2023-11-28T16:58:59.221387+0000","last_undegraded":"2023-11-28T16:58:59.221387+0000","last_fullsized":"2023-11-28T16:58:59.221387+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294951+0000","last_change":"2023-11-28T16:58:56.852728+0000","last_active":"2023-11-28T16:58:58.294951+0000","last_peered":"2023-11-28T16:58:58.294951+0000","last_clean":"2023-11-28T16:58:58.294951+0000","last_became_active":"2023-11-28T16:58:56.852468+0000","last_became_peered":"2023-11-28T16:58:56.852468+0000","last_unstale":"2023-11-28T16:58:58.294951+0000","last_undegraded":"2023-11-28T16:58:58.294951+0000","last_fullsized":"2023-11-28T16:58:58.294951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221207+0000","last_change":"2023-11-28T16:58:57.314042+0000","last_active":"2023-11-28T16:58:59.221207+0000","last_peered":"2023-11-28T16:58:59.221207+0000","last_clean":"2023-11-28T16:58:59.221207+0000","last_became_active":"2023-11-28T16:58:57.313749+0000","last_became_peered":"2023-11-28T16:58:57.313749+0000","last_unstale":"2023-11-28T16:58:59.221207+0000","last_undegraded":"2023-11-28T16:58:59.221207+0000","last_fullsized":"2023-11-28T16:58:59.221207+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294017+0000","last_change":"2023-11-28T16:58:56.861860+0000","last_active":"2023-11-28T16:58:58.294017+0000","last_peered":"2023-11-28T16:58:58.294017+0000","last_clean":"2023-11-28T16:58:58.294017+0000","last_became_active":"2023-11-28T16:58:56.861575+0000","last_became_peered":"2023-11-28T16:58:56.861575+0000","last_unstale":"2023-11-28T16:58:58.294017+0000","last_undegraded":"2023-11-28T16:58:58.294017+0000","last_fullsized":"2023-11-28T16:58:58.294017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:01.116893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.318071+0000","last_change":"2023-11-28T16:58:57.316847+0000","last_active":"2023-11-28T16:58:57.318071+0000","last_peered":"2023-11-28T16:58:57.318071+0000","last_clean":"2023-11-28T16:58:57.318071+0000","last_became_active":"2023-11-28T16:58:57.315129+0000","last_became_peered":"2023-11-28T16:58:57.315129+0000","last_unstale":"2023-11-28T16:58:57.318071+0000","last_undegraded":"2023-11-28T16:58:57.318071+0000","last_fullsized":"2023-11-28T16:58:57.318071+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293857+0000","last_change":"2023-11-28T16:58:56.857953+0000","last_active":"2023-11-28T16:58:58.293857+0000","last_peered":"2023-11-28T16:58:58.293857+0000","last_clean":"2023-11-28T16:58:58.293857+0000","last_became_active":"2023-11-28T16:58:56.857667+0000","last_became_peered":"2023-11-28T16:58:56.857667+0000","last_unstale":"2023-11-28T16:58:58.293857+0000","last_undegraded":"2023-11-28T16:58:58.293857+0000","last_fullsized":"2023-11-28T16:58:58.293857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:40.543279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.301807+0000","last_change":"2023-11-28T16:58:57.297598+0000","last_active":"2023-11-28T16:58:57.301807+0000","last_peered":"2023-11-28T16:58:57.301807+0000","last_clean":"2023-11-28T16:58:57.301807+0000","last_became_active":"2023-11-28T16:58:57.297333+0000","last_became_peered":"2023-11-28T16:58:57.297333+0000","last_unstale":"2023-11-28T16:58:57.301807+0000","last_undegraded":"2023-11-28T16:58:57.301807+0000","last_fullsized":"2023-11-28T16:58:57.301807+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:37:37.395510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294582+0000","last_change":"2023-11-28T16:58:56.846299+0000","last_active":"2023-11-28T16:58:58.294582+0000","last_peered":"2023-11-28T16:58:58.294582+0000","last_clean":"2023-11-28T16:58:58.294582+0000","last_became_active":"2023-11-28T16:58:56.845923+0000","last_became_peered":"2023-11-28T16:58:56.845923+0000","last_unstale":"2023-11-28T16:58:58.294582+0000","last_undegraded":"2023-11-28T16:58:58.294582+0000","last_fullsized":"2023-11-28T16:58:58.294582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294475+0000","last_change":"2023-11-28T16:58:57.302610+0000","last_active":"2023-11-28T16:58:58.294475+0000","last_peered":"2023-11-28T16:58:58.294475+0000","last_clean":"2023-11-28T16:58:58.294475+0000","last_became_active":"2023-11-28T16:58:57.301748+0000","last_became_peered":"2023-11-28T16:58:57.301748+0000","last_unstale":"2023-11-28T16:58:58.294475+0000","last_undegraded":"2023-11-28T16:58:58.294475+0000","last_fullsized":"2023-11-28T16:58:58.294475+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294381+0000","last_change":"2023-11-28T16:58:56.849775+0000","last_active":"2023-11-28T16:58:58.294381+0000","last_peered":"2023-11-28T16:58:58.294381+0000","last_clean":"2023-11-28T16:58:58.294381+0000","last_became_active":"2023-11-28T16:58:56.849503+0000","last_became_peered":"2023-11-28T16:58:56.849503+0000","last_unstale":"2023-11-28T16:58:58.294381+0000","last_undegraded":"2023-11-28T16:58:58.294381+0000","last_fullsized":"2023-11-28T16:58:58.294381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.315367+0000","last_change":"2023-11-28T16:58:57.305447+0000","last_active":"2023-11-28T16:58:57.315367+0000","last_peered":"2023-11-28T16:58:57.315367+0000","last_clean":"2023-11-28T16:58:57.315367+0000","last_became_active":"2023-11-28T16:58:57.303738+0000","last_became_peered":"2023-11-28T16:58:57.303738+0000","last_unstale":"2023-11-28T16:58:57.315367+0000","last_undegraded":"2023-11-28T16:58:57.315367+0000","last_fullsized":"2023-11-28T16:58:57.315367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293515+0000","last_change":"2023-11-28T16:58:56.851226+0000","last_active":"2023-11-28T16:58:58.293515+0000","last_peered":"2023-11-28T16:58:58.293515+0000","last_clean":"2023-11-28T16:58:58.293515+0000","last_became_active":"2023-11-28T16:58:56.850870+0000","last_became_peered":"2023-11-28T16:58:56.850870+0000","last_unstale":"2023-11-28T16:58:58.293515+0000","last_undegraded":"2023-11-28T16:58:58.293515+0000","last_fullsized":"2023-11-28T16:58:58.293515+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312398+0000","last_change":"2023-11-28T16:58:57.305573+0000","last_active":"2023-11-28T16:58:58.312398+0000","last_peered":"2023-11-28T16:58:58.312398+0000","last_clean":"2023-11-28T16:58:58.312398+0000","last_became_active":"2023-11-28T16:58:57.299574+0000","last_became_peered":"2023-11-28T16:58:57.299574+0000","last_unstale":"2023-11-28T16:58:58.312398+0000","last_undegraded":"2023-11-28T16:58:58.312398+0000","last_fullsized":"2023-11-28T16:58:58.312398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.292359+0000","last_change":"2023-11-28T16:58:56.849113+0000","last_active":"2023-11-28T16:58:57.292359+0000","last_peered":"2023-11-28T16:58:57.292359+0000","last_clean":"2023-11-28T16:58:57.292359+0000","last_became_active":"2023-11-28T16:58:56.848817+0000","last_became_peered":"2023-11-28T16:58:56.848817+0000","last_unstale":"2023-11-28T16:58:57.292359+0000","last_undegraded":"2023-11-28T16:58:57.292359+0000","last_fullsized":"2023-11-28T16:58:57.292359+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:29.256426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312702+0000","last_change":"2023-11-28T16:58:57.308897+0000","last_active":"2023-11-28T16:58:58.312702+0000","last_peered":"2023-11-28T16:58:58.312702+0000","last_clean":"2023-11-28T16:58:58.312702+0000","last_became_active":"2023-11-28T16:58:57.308635+0000","last_became_peered":"2023-11-28T16:58:57.308635+0000","last_unstale":"2023-11-28T16:58:58.312702+0000","last_undegraded":"2023-11-28T16:58:58.312702+0000","last_fullsized":"2023-11-28T16:58:58.312702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221551+0000","last_change":"2023-11-28T16:58:56.859941+0000","last_active":"2023-11-28T16:58:59.221551+0000","last_peered":"2023-11-28T16:58:59.221551+0000","last_clean":"2023-11-28T16:58:59.221551+0000","last_became_active":"2023-11-28T16:58:56.859614+0000","last_became_peered":"2023-11-28T16:58:56.859614+0000","last_unstale":"2023-11-28T16:58:59.221551+0000","last_undegraded":"2023-11-28T16:58:59.221551+0000","last_fullsized":"2023-11-28T16:58:59.221551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.320680+0000","last_change":"2023-11-28T16:58:57.318731+0000","last_active":"2023-11-28T16:58:57.320680+0000","last_peered":"2023-11-28T16:58:57.320680+0000","last_clean":"2023-11-28T16:58:57.320680+0000","last_became_active":"2023-11-28T16:58:57.318407+0000","last_became_peered":"2023-11-28T16:58:57.318407+0000","last_unstale":"2023-11-28T16:58:57.320680+0000","last_undegraded":"2023-11-28T16:58:57.320680+0000","last_fullsized":"2023-11-28T16:58:57.320680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:04.422227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221512+0000","last_change":"2023-11-28T16:58:56.851849+0000","last_active":"2023-11-28T16:58:59.221512+0000","last_peered":"2023-11-28T16:58:59.221512+0000","last_clean":"2023-11-28T16:58:59.221512+0000","last_became_active":"2023-11-28T16:58:56.851487+0000","last_became_peered":"2023-11-28T16:58:56.851487+0000","last_unstale":"2023-11-28T16:58:59.221512+0000","last_undegraded":"2023-11-28T16:58:59.221512+0000","last_fullsized":"2023-11-28T16:58:59.221512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:15.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293802+0000","last_change":"2023-11-28T16:58:57.308250+0000","last_active":"2023-11-28T16:58:58.293802+0000","last_peered":"2023-11-28T16:58:58.293802+0000","last_clean":"2023-11-28T16:58:58.293802+0000","last_became_active":"2023-11-28T16:58:57.307951+0000","last_became_peered":"2023-11-28T16:58:57.307951+0000","last_unstale":"2023-11-28T16:58:58.293802+0000","last_undegraded":"2023-11-28T16:58:58.293802+0000","last_fullsized":"2023-11-28T16:58:58.293802+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221087+0000","last_change":"2023-11-28T16:58:56.858285+0000","last_active":"2023-11-28T16:58:59.221087+0000","last_peered":"2023-11-28T16:58:59.221087+0000","last_clean":"2023-11-28T16:58:59.221087+0000","last_became_active":"2023-11-28T16:58:56.857956+0000","last_became_peered":"2023-11-28T16:58:56.857956+0000","last_unstale":"2023-11-28T16:58:59.221087+0000","last_undegraded":"2023-11-28T16:58:59.221087+0000","last_fullsized":"2023-11-28T16:58:59.221087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294653+0000","last_change":"2023-11-28T16:58:57.305562+0000","last_active":"2023-11-28T16:58:58.294653+0000","last_peered":"2023-11-28T16:58:58.294653+0000","last_clean":"2023-11-28T16:58:58.294653+0000","last_became_active":"2023-11-28T16:58:57.305130+0000","last_became_peered":"2023-11-28T16:58:57.305130+0000","last_unstale":"2023-11-28T16:58:58.294653+0000","last_undegraded":"2023-11-28T16:58:58.294653+0000","last_fullsized":"2023-11-28T16:58:58.294653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'6","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.866614+0000","last_change":"2023-11-28T16:58:56.856203+0000","last_active":"2023-11-28T16:58:57.866614+0000","last_peered":"2023-11-28T16:58:57.866614+0000","last_clean":"2023-11-28T16:58:57.866614+0000","last_became_active":"2023-11-28T16:58:56.855887+0000","last_became_peered":"2023-11-28T16:58:56.855887+0000","last_unstale":"2023-11-28T16:58:57.866614+0000","last_undegraded":"2023-11-28T16:58:57.866614+0000","last_fullsized":"2023-11-28T16:58:57.866614+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293472+0000","last_change":"2023-11-28T16:58:57.302777+0000","last_active":"2023-11-28T16:58:58.293472+0000","last_peered":"2023-11-28T16:58:58.293472+0000","last_clean":"2023-11-28T16:58:58.293472+0000","last_became_active":"2023-11-28T16:58:57.302479+0000","last_became_peered":"2023-11-28T16:58:57.302479+0000","last_unstale":"2023-11-28T16:58:58.293472+0000","last_undegraded":"2023-11-28T16:58:58.293472+0000","last_fullsized":"2023-11-28T16:58:58.293472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.864244+0000","last_change":"2023-11-28T16:58:56.846727+0000","last_active":"2023-11-28T16:58:57.864244+0000","last_peered":"2023-11-28T16:58:57.864244+0000","last_clean":"2023-11-28T16:58:57.864244+0000","last_became_active":"2023-11-28T16:58:56.846403+0000","last_became_peered":"2023-11-28T16:58:56.846403+0000","last_unstale":"2023-11-28T16:58:57.864244+0000","last_undegraded":"2023-11-28T16:58:57.864244+0000","last_fullsized":"2023-11-28T16:58:57.864244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:42.852604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.305308+0000","last_change":"2023-11-28T16:58:57.301185+0000","last_active":"2023-11-28T16:58:57.305308+0000","last_peered":"2023-11-28T16:58:57.305308+0000","last_clean":"2023-11-28T16:58:57.305308+0000","last_became_active":"2023-11-28T16:58:57.300882+0000","last_became_peered":"2023-11-28T16:58:57.300882+0000","last_unstale":"2023-11-28T16:58:57.305308+0000","last_undegraded":"2023-11-28T16:58:57.305308+0000","last_fullsized":"2023-11-28T16:58:57.305308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312411+0000","last_change":"2023-11-28T16:58:56.855489+0000","last_active":"2023-11-28T16:58:58.312411+0000","last_peered":"2023-11-28T16:58:58.312411+0000","last_clean":"2023-11-28T16:58:58.312411+0000","last_became_active":"2023-11-28T16:58:56.855127+0000","last_became_peered":"2023-11-28T16:58:56.855127+0000","last_unstale":"2023-11-28T16:58:58.312411+0000","last_undegraded":"2023-11-28T16:58:58.312411+0000","last_fullsized":"2023-11-28T16:58:58.312411+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:03.854671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310066+0000","last_change":"2023-11-28T16:58:57.297734+0000","last_active":"2023-11-28T16:58:57.310066+0000","last_peered":"2023-11-28T16:58:57.310066+0000","last_clean":"2023-11-28T16:58:57.310066+0000","last_became_active":"2023-11-28T16:58:57.297456+0000","last_became_peered":"2023-11-28T16:58:57.297456+0000","last_unstale":"2023-11-28T16:58:57.310066+0000","last_undegraded":"2023-11-28T16:58:57.310066+0000","last_fullsized":"2023-11-28T16:58:57.310066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:22.083052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.302273+0000","last_change":"2023-11-28T16:58:56.852318+0000","last_active":"2023-11-28T16:58:57.302273+0000","last_peered":"2023-11-28T16:58:57.302273+0000","last_clean":"2023-11-28T16:58:57.302273+0000","last_became_active":"2023-11-28T16:58:56.851992+0000","last_became_peered":"2023-11-28T16:58:56.851992+0000","last_unstale":"2023-11-28T16:58:57.302273+0000","last_undegraded":"2023-11-28T16:58:57.302273+0000","last_fullsized":"2023-11-28T16:58:57.302273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310226+0000","last_change":"2023-11-28T16:58:57.307166+0000","last_active":"2023-11-28T16:58:57.310226+0000","last_peered":"2023-11-28T16:58:57.310226+0000","last_clean":"2023-11-28T16:58:57.310226+0000","last_became_active":"2023-11-28T16:58:57.306917+0000","last_became_peered":"2023-11-28T16:58:57.306917+0000","last_unstale":"2023-11-28T16:58:57.310226+0000","last_undegraded":"2023-11-28T16:58:57.310226+0000","last_fullsized":"2023-11-28T16:58:57.310226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:00.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":20,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293400+0000","last_change":"2023-11-28T16:58:56.858590+0000","last_active":"2023-11-28T16:58:58.293400+0000","last_peered":"2023-11-28T16:58:58.293400+0000","last_clean":"2023-11-28T16:58:58.293400+0000","last_became_active":"2023-11-28T16:58:56.858306+0000","last_became_peered":"2023-11-28T16:58:56.858306+0000","last_unstale":"2023-11-28T16:58:58.293400+0000","last_undegraded":"2023-11-28T16:58:58.293400+0000","last_fullsized":"2023-11-28T16:58:58.293400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.316391+0000","last_change":"2023-11-28T16:58:57.310263+0000","last_active":"2023-11-28T16:58:57.316391+0000","last_peered":"2023-11-28T16:58:57.316391+0000","last_clean":"2023-11-28T16:58:57.316391+0000","last_became_active":"2023-11-28T16:58:57.309857+0000","last_became_peered":"2023-11-28T16:58:57.309857+0000","last_unstale":"2023-11-28T16:58:57.316391+0000","last_undegraded":"2023-11-28T16:58:57.316391+0000","last_fullsized":"2023-11-28T16:58:57.316391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221609+0000","last_change":"2023-11-28T16:58:56.858637+0000","last_active":"2023-11-28T16:58:59.221609+0000","last_peered":"2023-11-28T16:58:59.221609+0000","last_clean":"2023-11-28T16:58:59.221609+0000","last_became_active":"2023-11-28T16:58:56.858330+0000","last_became_peered":"2023-11-28T16:58:56.858330+0000","last_unstale":"2023-11-28T16:58:59.221609+0000","last_undegraded":"2023-11-28T16:58:59.221609+0000","last_fullsized":"2023-11-28T16:58:59.221609+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221515+0000","last_change":"2023-11-28T16:58:57.306363+0000","last_active":"2023-11-28T16:58:59.221515+0000","last_peered":"2023-11-28T16:58:59.221515+0000","last_clean":"2023-11-28T16:58:59.221515+0000","last_became_active":"2023-11-28T16:58:57.305727+0000","last_became_peered":"2023-11-28T16:58:57.305727+0000","last_unstale":"2023-11-28T16:58:59.221515+0000","last_undegraded":"2023-11-28T16:58:59.221515+0000","last_fullsized":"2023-11-28T16:58:59.221515+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293889+0000","last_change":"2023-11-28T16:58:56.849263+0000","last_active":"2023-11-28T16:58:58.293889+0000","last_peered":"2023-11-28T16:58:58.293889+0000","last_clean":"2023-11-28T16:58:58.293889+0000","last_became_active":"2023-11-28T16:58:56.848949+0000","last_became_peered":"2023-11-28T16:58:56.848949+0000","last_unstale":"2023-11-28T16:58:58.293889+0000","last_undegraded":"2023-11-28T16:58:58.293889+0000","last_fullsized":"2023-11-28T16:58:58.293889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294748+0000","last_change":"2023-11-28T16:58:57.306164+0000","last_active":"2023-11-28T16:58:58.294748+0000","last_peered":"2023-11-28T16:58:58.294748+0000","last_clean":"2023-11-28T16:58:58.294748+0000","last_became_active":"2023-11-28T16:58:57.300959+0000","last_became_peered":"2023-11-28T16:58:57.300959+0000","last_unstale":"2023-11-28T16:58:58.294748+0000","last_undegraded":"2023-11-28T16:58:58.294748+0000","last_fullsized":"2023-11-28T16:58:58.294748+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293904+0000","last_change":"2023-11-28T16:58:56.850381+0000","last_active":"2023-11-28T16:58:58.293904+0000","last_peered":"2023-11-28T16:58:58.293904+0000","last_clean":"2023-11-28T16:58:58.293904+0000","last_became_active":"2023-11-28T16:58:56.850116+0000","last_became_peered":"2023-11-28T16:58:56.850116+0000","last_unstale":"2023-11-28T16:58:58.293904+0000","last_undegraded":"2023-11-28T16:58:58.293904+0000","last_fullsized":"2023-11-28T16:58:58.293904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292773+0000","last_change":"2023-11-28T16:58:57.309597+0000","last_active":"2023-11-28T16:58:58.292773+0000","last_peered":"2023-11-28T16:58:58.292773+0000","last_clean":"2023-11-28T16:58:58.292773+0000","last_became_active":"2023-11-28T16:58:57.309372+0000","last_became_peered":"2023-11-28T16:58:57.309372+0000","last_unstale":"2023-11-28T16:58:58.292773+0000","last_undegraded":"2023-11-28T16:58:58.292773+0000","last_fullsized":"2023-11-28T16:58:58.292773+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:35.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312487+0000","last_change":"2023-11-28T16:58:56.861806+0000","last_active":"2023-11-28T16:58:58.312487+0000","last_peered":"2023-11-28T16:58:58.312487+0000","last_clean":"2023-11-28T16:58:58.312487+0000","last_became_active":"2023-11-28T16:58:56.861498+0000","last_became_peered":"2023-11-28T16:58:56.861498+0000","last_unstale":"2023-11-28T16:58:58.312487+0000","last_undegraded":"2023-11-28T16:58:58.312487+0000","last_fullsized":"2023-11-28T16:58:58.312487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.312361+0000","last_change":"2023-11-28T16:58:57.306140+0000","last_active":"2023-11-28T16:58:57.312361+0000","last_peered":"2023-11-28T16:58:57.312361+0000","last_clean":"2023-11-28T16:58:57.312361+0000","last_became_active":"2023-11-28T16:58:57.305865+0000","last_became_peered":"2023-11-28T16:58:57.305865+0000","last_unstale":"2023-11-28T16:58:57.312361+0000","last_undegraded":"2023-11-28T16:58:57.312361+0000","last_fullsized":"2023-11-28T16:58:57.312361+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:21.987730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292781+0000","last_change":"2023-11-28T16:58:56.855751+0000","last_active":"2023-11-28T16:58:58.292781+0000","last_peered":"2023-11-28T16:58:58.292781+0000","last_clean":"2023-11-28T16:58:58.292781+0000","last_became_active":"2023-11-28T16:58:56.855432+0000","last_became_peered":"2023-11-28T16:58:56.855432+0000","last_unstale":"2023-11-28T16:58:58.292781+0000","last_undegraded":"2023-11-28T16:58:58.292781+0000","last_fullsized":"2023-11-28T16:58:58.292781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:24:24.546921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292742+0000","last_change":"2023-11-28T16:58:57.307399+0000","last_active":"2023-11-28T16:58:58.292742+0000","last_peered":"2023-11-28T16:58:58.292742+0000","last_clean":"2023-11-28T16:58:58.292742+0000","last_became_active":"2023-11-28T16:58:57.307122+0000","last_became_peered":"2023-11-28T16:58:57.307122+0000","last_unstale":"2023-11-28T16:58:58.292742+0000","last_undegraded":"2023-11-28T16:58:58.292742+0000","last_fullsized":"2023-11-28T16:58:58.292742+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:56:08.650099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.292779+0000","last_change":"2023-11-28T16:58:56.863311+0000","last_active":"2023-11-28T16:58:58.292779+0000","last_peered":"2023-11-28T16:58:58.292779+0000","last_clean":"2023-11-28T16:58:58.292779+0000","last_became_active":"2023-11-28T16:58:56.863048+0000","last_became_peered":"2023-11-28T16:58:56.863048+0000","last_unstale":"2023-11-28T16:58:58.292779+0000","last_undegraded":"2023-11-28T16:58:58.292779+0000","last_fullsized":"2023-11-28T16:58:58.292779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:51.407849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.318041+0000","last_change":"2023-11-28T16:58:57.316056+0000","last_active":"2023-11-28T16:58:57.318041+0000","last_peered":"2023-11-28T16:58:57.318041+0000","last_clean":"2023-11-28T16:58:57.318041+0000","last_became_active":"2023-11-28T16:58:57.315754+0000","last_became_peered":"2023-11-28T16:58:57.315754+0000","last_unstale":"2023-11-28T16:58:57.318041+0000","last_undegraded":"2023-11-28T16:58:57.318041+0000","last_fullsized":"2023-11-28T16:58:57.318041+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:14.149272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.312252+0000","last_change":"2023-11-28T16:58:56.862068+0000","last_active":"2023-11-28T16:58:58.312252+0000","last_peered":"2023-11-28T16:58:58.312252+0000","last_clean":"2023-11-28T16:58:58.312252+0000","last_became_active":"2023-11-28T16:58:56.861701+0000","last_became_peered":"2023-11-28T16:58:56.861701+0000","last_unstale":"2023-11-28T16:58:58.312252+0000","last_undegraded":"2023-11-28T16:58:58.312252+0000","last_fullsized":"2023-11-28T16:58:58.312252+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:32.676826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294860+0000","last_change":"2023-11-28T16:58:57.310885+0000","last_active":"2023-11-28T16:58:58.294860+0000","last_peered":"2023-11-28T16:58:58.294860+0000","last_clean":"2023-11-28T16:58:58.294860+0000","last_became_active":"2023-11-28T16:58:57.310590+0000","last_became_peered":"2023-11-28T16:58:57.310590+0000","last_unstale":"2023-11-28T16:58:58.294860+0000","last_undegraded":"2023-11-28T16:58:58.294860+0000","last_fullsized":"2023-11-28T16:58:58.294860+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.862374+0000","last_change":"2023-11-28T16:58:56.859076+0000","last_active":"2023-11-28T16:58:57.862374+0000","last_peered":"2023-11-28T16:58:57.862374+0000","last_clean":"2023-11-28T16:58:57.862374+0000","last_became_active":"2023-11-28T16:58:56.858792+0000","last_became_peered":"2023-11-28T16:58:56.858792+0000","last_unstale":"2023-11-28T16:58:57.862374+0000","last_undegraded":"2023-11-28T16:58:57.862374+0000","last_fullsized":"2023-11-28T16:58:57.862374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:46.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.317749+0000","last_change":"2023-11-28T16:58:57.310281+0000","last_active":"2023-11-28T16:58:57.317749+0000","last_peered":"2023-11-28T16:58:57.317749+0000","last_clean":"2023-11-28T16:58:57.317749+0000","last_became_active":"2023-11-28T16:58:57.308492+0000","last_became_peered":"2023-11-28T16:58:57.308492+0000","last_unstale":"2023-11-28T16:58:57.317749+0000","last_undegraded":"2023-11-28T16:58:57.317749+0000","last_fullsized":"2023-11-28T16:58:57.317749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.291822+0000","last_change":"2023-11-28T16:58:56.848509+0000","last_active":"2023-11-28T16:58:57.291822+0000","last_peered":"2023-11-28T16:58:57.291822+0000","last_clean":"2023-11-28T16:58:57.291822+0000","last_became_active":"2023-11-28T16:58:56.847800+0000","last_became_peered":"2023-11-28T16:58:56.847800+0000","last_unstale":"2023-11-28T16:58:57.291822+0000","last_undegraded":"2023-11-28T16:58:57.291822+0000","last_fullsized":"2023-11-28T16:58:57.291822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:56.437961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221374+0000","last_change":"2023-11-28T16:58:57.316240+0000","last_active":"2023-11-28T16:58:59.221374+0000","last_peered":"2023-11-28T16:58:59.221374+0000","last_clean":"2023-11-28T16:58:59.221374+0000","last_became_active":"2023-11-28T16:58:57.315895+0000","last_became_peered":"2023-11-28T16:58:57.315895+0000","last_unstale":"2023-11-28T16:58:59.221374+0000","last_undegraded":"2023-11-28T16:58:59.221374+0000","last_fullsized":"2023-11-28T16:58:59.221374+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:01.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221195+0000","last_change":"2023-11-28T16:58:56.862862+0000","last_active":"2023-11-28T16:58:59.221195+0000","last_peered":"2023-11-28T16:58:59.221195+0000","last_clean":"2023-11-28T16:58:59.221195+0000","last_became_active":"2023-11-28T16:58:56.862564+0000","last_became_peered":"2023-11-28T16:58:56.862564+0000","last_unstale":"2023-11-28T16:58:59.221195+0000","last_undegraded":"2023-11-28T16:58:59.221195+0000","last_fullsized":"2023-11-28T16:58:59.221195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294818+0000","last_change":"2023-11-28T16:58:57.305378+0000","last_active":"2023-11-28T16:58:58.294818+0000","last_peered":"2023-11-28T16:58:58.294818+0000","last_clean":"2023-11-28T16:58:58.294818+0000","last_became_active":"2023-11-28T16:58:57.304738+0000","last_became_peered":"2023-11-28T16:58:57.304738+0000","last_unstale":"2023-11-28T16:58:58.294818+0000","last_undegraded":"2023-11-28T16:58:58.294818+0000","last_fullsized":"2023-11-28T16:58:58.294818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221450+0000","last_change":"2023-11-28T16:58:56.860344+0000","last_active":"2023-11-28T16:58:59.221450+0000","last_peered":"2023-11-28T16:58:59.221450+0000","last_clean":"2023-11-28T16:58:59.221450+0000","last_became_active":"2023-11-28T16:58:56.859853+0000","last_became_peered":"2023-11-28T16:58:56.859853+0000","last_unstale":"2023-11-28T16:58:59.221450+0000","last_undegraded":"2023-11-28T16:58:59.221450+0000","last_fullsized":"2023-11-28T16:58:59.221450+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.312436+0000","last_change":"2023-11-28T16:58:57.306938+0000","last_active":"2023-11-28T16:58:57.312436+0000","last_peered":"2023-11-28T16:58:57.312436+0000","last_clean":"2023-11-28T16:58:57.312436+0000","last_became_active":"2023-11-28T16:58:57.306452+0000","last_became_peered":"2023-11-28T16:58:57.306452+0000","last_unstale":"2023-11-28T16:58:57.312436+0000","last_undegraded":"2023-11-28T16:58:57.312436+0000","last_fullsized":"2023-11-28T16:58:57.312436+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:45.387902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293740+0000","last_change":"2023-11-28T16:58:56.858723+0000","last_active":"2023-11-28T16:58:58.293740+0000","last_peered":"2023-11-28T16:58:58.293740+0000","last_clean":"2023-11-28T16:58:58.293740+0000","last_became_active":"2023-11-28T16:58:56.858282+0000","last_became_peered":"2023-11-28T16:58:56.858282+0000","last_unstale":"2023-11-28T16:58:58.293740+0000","last_undegraded":"2023-11-28T16:58:58.293740+0000","last_fullsized":"2023-11-28T16:58:58.293740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.293872+0000","last_change":"2023-11-28T16:58:57.305002+0000","last_active":"2023-11-28T16:58:58.293872+0000","last_peered":"2023-11-28T16:58:58.293872+0000","last_clean":"2023-11-28T16:58:58.293872+0000","last_became_active":"2023-11-28T16:58:57.304759+0000","last_became_peered":"2023-11-28T16:58:57.304759+0000","last_unstale":"2023-11-28T16:58:58.293872+0000","last_undegraded":"2023-11-28T16:58:58.293872+0000","last_fullsized":"2023-11-28T16:58:58.293872+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294388+0000","last_change":"2023-11-28T16:58:56.848645+0000","last_active":"2023-11-28T16:58:58.294388+0000","last_peered":"2023-11-28T16:58:58.294388+0000","last_clean":"2023-11-28T16:58:58.294388+0000","last_became_active":"2023-11-28T16:58:56.848300+0000","last_became_peered":"2023-11-28T16:58:56.848300+0000","last_unstale":"2023-11-28T16:58:58.294388+0000","last_undegraded":"2023-11-28T16:58:58.294388+0000","last_fullsized":"2023-11-28T16:58:58.294388+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.306233+0000","last_change":"2023-11-28T16:58:57.299433+0000","last_active":"2023-11-28T16:58:57.306233+0000","last_peered":"2023-11-28T16:58:57.306233+0000","last_clean":"2023-11-28T16:58:57.306233+0000","last_became_active":"2023-11-28T16:58:57.299098+0000","last_became_peered":"2023-11-28T16:58:57.299098+0000","last_unstale":"2023-11-28T16:58:57.306233+0000","last_undegraded":"2023-11-28T16:58:57.306233+0000","last_fullsized":"2023-11-28T16:58:57.306233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221381+0000","last_change":"2023-11-28T16:58:56.855829+0000","last_active":"2023-11-28T16:58:59.221381+0000","last_peered":"2023-11-28T16:58:59.221381+0000","last_clean":"2023-11-28T16:58:59.221381+0000","last_became_active":"2023-11-28T16:58:56.855381+0000","last_became_peered":"2023-11-28T16:58:56.855381+0000","last_unstale":"2023-11-28T16:58:59.221381+0000","last_undegraded":"2023-11-28T16:58:59.221381+0000","last_fullsized":"2023-11-28T16:58:59.221381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:41.581251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.221056+0000","last_change":"2023-11-28T16:58:57.316272+0000","last_active":"2023-11-28T16:58:59.221056+0000","last_peered":"2023-11-28T16:58:59.221056+0000","last_clean":"2023-11-28T16:58:59.221056+0000","last_became_active":"2023-11-28T16:58:57.315990+0000","last_became_peered":"2023-11-28T16:58:57.315990+0000","last_unstale":"2023-11-28T16:58:59.221056+0000","last_undegraded":"2023-11-28T16:58:59.221056+0000","last_fullsized":"2023-11-28T16:58:59.221056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:58.294271+0000","last_change":"2023-11-28T16:58:56.847748+0000","last_active":"2023-11-28T16:58:58.294271+0000","last_peered":"2023-11-28T16:58:58.294271+0000","last_clean":"2023-11-28T16:58:58.294271+0000","last_became_active":"2023-11-28T16:58:56.847459+0000","last_became_peered":"2023-11-28T16:58:56.847459+0000","last_unstale":"2023-11-28T16:58:58.294271+0000","last_undegraded":"2023-11-28T16:58:58.294271+0000","last_fullsized":"2023-11-28T16:58:58.294271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:03.416274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.310193+0000","last_change":"2023-11-28T16:58:57.306584+0000","last_active":"2023-11-28T16:58:57.310193+0000","last_peered":"2023-11-28T16:58:57.310193+0000","last_clean":"2023-11-28T16:58:57.310193+0000","last_became_active":"2023-11-28T16:58:57.306137+0000","last_became_peered":"2023-11-28T16:58:57.306137+0000","last_unstale":"2023-11-28T16:58:57.310193+0000","last_undegraded":"2023-11-28T16:58:57.310193+0000","last_fullsized":"2023-11-28T16:58:57.310193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:51.059755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T16:58:57.868504+0000","last_change":"2023-11-28T16:58:56.863771+0000","last_active":"2023-11-28T16:58:57.868504+0000","last_peered":"2023-11-28T16:58:57.868504+0000","last_clean":"2023-11-28T16:58:57.868504+0000","last_became_active":"2023-11-28T16:58:56.863302+0000","last_became_peered":"2023-11-28T16:58:56.863302+0000","last_unstale":"2023-11-28T16:58:57.868504+0000","last_undegraded":"2023-11-28T16:58:57.868504+0000","last_fullsized":"2023-11-28T16:58:57.868504+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:26.909196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T16:58:56.854499+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:56.854499+0000","last_peered":"2023-11-28T16:58:56.854499+0000","last_clean":"2023-11-28T16:58:56.854499+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:56.854499+0000","last_undegraded":"2023-11-28T16:58:56.854499+0000","last_fullsized":"2023-11-28T16:58:56.854499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":953976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.505},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65300000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.44},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.61899999999999999}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":847872,"data_stored":364232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.82299999999999995,"5min":1.474,"15min":1.474},"last":0.623},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.72799999999999998,"15min":0.753},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":1.0209999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92300000000000004,"5min":1.071,"15min":1.071},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.84399999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.95099999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.52900000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.341,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4019999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.89900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":851968,"data_stored":365172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.53800000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.52100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58199999999999996}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.626},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89200000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96199999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":369838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.234,"15min":1.234},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.871,"5min":1.964,"15min":1.964},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.704,"15min":1.704},"last":0.84599999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88400000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.254,"15min":1.254},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88,"5min":1.548,"15min":1.548},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90800000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.218,"15min":1.218},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.593,"15min":1.593},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":371450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.56100000000000005,"5min":0.745,"15min":0.745},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.874,"15min":0.874},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.089,"5min":1.21,"15min":1.21},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91900000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.83899999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0049999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0309999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.022,"5min":1.25,"15min":1.25},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.423,"15min":1.423},"last":0.92500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":370420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48099999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71499999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.65800000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371}]},{"osd":4,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.81599999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92500000000000004,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.877},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.94499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":363732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52700000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.315},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.34699999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.56000000000000005,"5min":0.746,"15min":0.746},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.55600000000000005,"5min":1.04,"15min":1.04},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.625,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.98699999999999999,"5min":1.446,"15min":1.446},"last":0.623},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.034,"5min":1.47,"15min":1.47},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1180000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0820000000000001,"5min":1.327,"15min":1.327},"last":0.73099999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94599999999999995,"5min":1.3,"15min":1.3},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.167,"5min":1.526,"15min":1.526},"last":0.746}]},{"osd":7,"last update":"Tue Nov 28 16:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1459999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1445888,"data_stored":960240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.57699999999999996}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.86399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:02.364 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T16:59:02.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T16:59:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc37b8d640 1 Processor -- start 2023-11-28T16:59:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc37b8d640 1 -- start start 2023-11-28T16:59:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc37b8d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc300a86d0 0x7fdc300a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc37b8d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc300aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc37b8d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc30152d90 con 0x7fdc30156600 2023-11-28T16:59:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc37b8d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc30152480 con 0x7fdc300a86d0 2023-11-28T16:59:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc37b8d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300a9760 con 0x7fdc3014fd00 2023-11-28T16:59:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc35128640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdc30156600 0x7fdc3014f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44900/0 (socket says 172.21.15.26:44900) 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc35128640 1 -- 172.21.15.26:0/650886561 learned_addr learned my addr 172.21.15.26:0/650886561 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc35929640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc300a86d0 0x7fdc300a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc3612a640 1 --2- 172.21.15.26:0/650886561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc300aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc34927640 1 -- 172.21.15.26:0/650886561 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345238506 0 0) 0x7fdc30152d90 con 0x7fdc30156600 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc35929640 1 -- 172.21.15.26:0/650886561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 msgr2=0x7fdc300aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc35929640 1 --2- 172.21.15.26:0/650886561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc300aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc35929640 1 -- 172.21.15.26:0/650886561 >> v1:172.21.15.26:6789/0 conn(0x7fdc30156600 legacy=0x7fdc3014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.548+0000 7fdc35929640 1 -- 172.21.15.26:0/650886561 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30152740 con 0x7fdc300a86d0 2023-11-28T16:59:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc35929640 1 --2- 172.21.15.26:0/650886561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc300a86d0 0x7fdc300a8f30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0097f0 tx=0x7fdc2c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68382fb6e0aa230c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc34927640 1 -- 172.21.15.26:0/650886561 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0ab600 con 0x7fdc300a86d0 2023-11-28T16:59:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc34927640 1 -- 172.21.15.26:0/650886561 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c0a7050 con 0x7fdc300a86d0 2023-11-28T16:59:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc34927640 1 -- 172.21.15.26:0/650886561 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0ab980 con 0x7fdc300a86d0 2023-11-28T16:59:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 -- 172.21.15.26:0/650886561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc300a86d0 msgr2=0x7fdc300a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/650886561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc300a86d0 0x7fdc300a8f30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0097f0 tx=0x7fdc2c01c480 comp rx=0 tx=0).stop 2023-11-28T16:59:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 -- 172.21.15.26:0/650886561 shutdown_connections 2023-11-28T16:59:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/650886561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc300aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/650886561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc300a86d0 0x7fdc300a8f30 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 -- 172.21.15.26:0/650886561 >> 172.21.15.26:0/650886561 conn(0x7fdc300c2a60 msgr2=0x7fdc300c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 -- 172.21.15.26:0/650886561 shutdown_connections 2023-11-28T16:59:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.552+0000 7fdc37b8d640 1 -- 172.21.15.26:0/650886561 wait complete. 2023-11-28T16:59:02.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 Processor -- start 2023-11-28T16:59:02.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 -- start start 2023-11-28T16:59:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300a86d0 0x7fdc301f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc30154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc30156600 0x7fdc300bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3006dcc0 con 0x7fdc30156600 2023-11-28T16:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30155890 con 0x7fdc300a86d0 2023-11-28T16:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3006d830 con 0x7fdc3014fd00 2023-11-28T16:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc30156600 0x7fdc300bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc30156600 0x7fdc300bfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47876/0 (socket says 172.21.15.26:47876) 2023-11-28T16:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 -- 172.21.15.26:0/2320933604 learned_addr learned my addr 172.21.15.26:0/2320933604 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc35128640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc30154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc35929640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300a86d0 0x7fdc301f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 -- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 msgr2=0x7fdc30154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc30154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 -- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300a86d0 msgr2=0x7fdc301f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300a86d0 0x7fdc301f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 -- 172.21.15.26:0/2320933604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c009420 con 0x7fdc30156600 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc35128640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc30154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc35929640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300a86d0 0x7fdc301f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc3612a640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc30156600 0x7fdc300bfe00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdc28007e10 tx=0x7fdc2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc267fc640 1 -- 172.21.15.26:0/2320933604 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28014620 con 0x7fdc30156600 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc267fc640 1 -- 172.21.15.26:0/2320933604 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc280147a0 con 0x7fdc30156600 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc301533a0 con 0x7fdc30156600 2023-11-28T16:59:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc267fc640 1 -- 172.21.15.26:0/2320933604 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28014b50 con 0x7fdc30156600 2023-11-28T16:59:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.556+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc301f1340 con 0x7fdc30156600 2023-11-28T16:59:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.560+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc30153200 con 0x7fdc30156600 2023-11-28T16:59:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.560+0000 7fdc267fc640 1 -- 172.21.15.26:0/2320933604 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc28014cb0 con 0x7fdc30156600 2023-11-28T16:59:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.560+0000 7fdc267fc640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc14066900 0x7fdc14068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.560+0000 7fdc267fc640 1 -- 172.21.15.26:0/2320933604 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc28084bf0 con 0x7fdc30156600 2023-11-28T16:59:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.560+0000 7fdc35929640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc14066900 0x7fdc14068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.560+0000 7fdc35929640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc14066900 0x7fdc14068dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0ad000 tx=0x7fdc2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.564+0000 7fdc267fc640 1 -- 172.21.15.26:0/2320933604 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc30153200 con 0x7fdc30156600 2023-11-28T16:59:02.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.780+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdc3006d9e0 con 0x7fdc30156600 2023-11-28T16:59:02.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc267fc640 1 -- 172.21.15.26:0/2320933604 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7fdc3006d9e0 con 0x7fdc30156600 2023-11-28T16:59:02.786 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-11-28T16:59:02.786 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2ZlmP6sIBAAg3tbteR2LtXGlvBgyniXDw== 2023-11-28T16:59:02.787 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-11-28T16:59:02.787 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-11-28T16:59:02.787 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T16:59:02.787 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-11-28T16:59:02.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc14066900 msgr2=0x7fdc14068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc14066900 0x7fdc14068dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0ad000 tx=0x7fdc2c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc30156600 msgr2=0x7fdc300bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc30156600 0x7fdc300bfe00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdc28007e10 tx=0x7fdc2800e4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 shutdown_connections 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc30156600 0x7fdc300bfe00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdc14066900 0x7fdc14068dc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc3014fd00 0x7fdc30154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 --2- 172.21.15.26:0/2320933604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300a86d0 0x7fdc301f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 >> 172.21.15.26:0/2320933604 conn(0x7fdc300c2a60 msgr2=0x7fdc300c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 shutdown_connections 2023-11-28T16:59:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.784+0000 7fdc37b8d640 1 -- 172.21.15.26:0/2320933604 wait complete. 2023-11-28T16:59:02.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:02.825 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-11-28T16:59:02.820+0000 7feff6a7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:59:02.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf74a17640 1 Processor -- start 2023-11-28T16:59:02.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf74a17640 1 -- start start 2023-11-28T16:59:02.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf74a17640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf700c2ac0 0x7fbf70070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf74a17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf700c1290 0x7fbf700c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf74a17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf70158b20 con 0x7fbf700c5f20 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf74a17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf70070ba0 con 0x7fbf700c1290 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf74a17640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf70157f10 con 0x7fbf700c2ac0 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf67fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbf700c5f20 0x7fbf70151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44906/0 (socket says 172.21.15.26:44906) 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf67fff640 1 -- 172.21.15.26:0/1328990658 learned_addr learned my addr 172.21.15.26:0/1328990658 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6ed9d640 1 --2- 172.21.15.26:0/1328990658 >> v2:172.21.15.26:3300/0 conn(0x7fbf700c1290 0x7fbf700c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6e59c640 1 --2- 172.21.15.26:0/1328990658 >> v2:172.21.15.79:3300/0 conn(0x7fbf700c2ac0 0x7fbf70070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6dd9b640 1 -- 172.21.15.26:0/1328990658 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148792972 0 0) 0x7fbf70158b20 con 0x7fbf700c5f20 2023-11-28T16:59:02.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6dd9b640 1 -- 172.21.15.26:0/1328990658 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf5c003530 con 0x7fbf700c5f20 2023-11-28T16:59:02.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6ed9d640 1 -- 172.21.15.26:0/1328990658 >> v2:172.21.15.79:3300/0 conn(0x7fbf700c2ac0 msgr2=0x7fbf70070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:02.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6ed9d640 1 --2- 172.21.15.26:0/1328990658 >> v2:172.21.15.79:3300/0 conn(0x7fbf700c2ac0 0x7fbf70070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6ed9d640 1 -- 172.21.15.26:0/1328990658 >> v1:172.21.15.26:6789/0 conn(0x7fbf700c5f20 legacy=0x7fbf70151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.948+0000 7fbf6ed9d640 1 -- 172.21.15.26:0/1328990658 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf701581f0 con 0x7fbf700c1290 2023-11-28T16:59:02.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf6ed9d640 1 --2- 172.21.15.26:0/1328990658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c1290 0x7fbf700c16e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbf700c5ef0 tx=0x7fbf6801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d76b2b8e1f956c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf6dd9b640 1 -- 172.21.15.26:0/1328990658 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680a5820 con 0x7fbf700c1290 2023-11-28T16:59:02.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf6dd9b640 1 -- 172.21.15.26:0/1328990658 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680a5980 con 0x7fbf700c1290 2023-11-28T16:59:02.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf6dd9b640 1 -- 172.21.15.26:0/1328990658 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680a5cf0 con 0x7fbf700c1290 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 -- 172.21.15.26:0/1328990658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c1290 msgr2=0x7fbf700c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1328990658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c1290 0x7fbf700c16e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbf700c5ef0 tx=0x7fbf6801c850 comp rx=0 tx=0).stop 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 -- 172.21.15.26:0/1328990658 shutdown_connections 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1328990658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c1290 0x7fbf700c16e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1328990658 >> v2:172.21.15.79:3300/0 conn(0x7fbf700c2ac0 0x7fbf70070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 -- 172.21.15.26:0/1328990658 >> 172.21.15.26:0/1328990658 conn(0x7fbf700a9c10 msgr2=0x7fbf700aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 -- 172.21.15.26:0/1328990658 shutdown_connections 2023-11-28T16:59:02.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.952+0000 7fbf74a17640 1 -- 172.21.15.26:0/1328990658 wait complete. 2023-11-28T16:59:02.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 Processor -- start 2023-11-28T16:59:02.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 -- start start 2023-11-28T16:59:02.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf700c1290 0x7fbf7006f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c2ac0 0x7fbf701f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf700c5f20 0x7fbf70147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf701f15b0 con 0x7fbf700c2ac0 2023-11-28T16:59:02.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf700abee0 con 0x7fbf700c5f20 2023-11-28T16:59:02.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf700ac1c0 con 0x7fbf700c1290 2023-11-28T16:59:02.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c2ac0 0x7fbf701f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c2ac0 0x7fbf701f1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47896/0 (socket says 172.21.15.26:47896) 2023-11-28T16:59:02.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 -- 172.21.15.26:0/1715081984 learned_addr learned my addr 172.21.15.26:0/1715081984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:02.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 -- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf700c1290 msgr2=0x7fbf7006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf700c1290 0x7fbf7006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf6ed9d640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf700c5f20 0x7fbf70147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 -- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf700c5f20 msgr2=0x7fbf70147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:02.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf700c5f20 0x7fbf70147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:02.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 -- 172.21.15.26:0/1715081984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68009a70 con 0x7fbf700c2ac0 2023-11-28T16:59:02.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf6ed9d640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf700c5f20 0x7fbf70147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:02.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf67fff640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c2ac0 0x7fbf701f1070 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c450 tx=0x7fbf5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf66ffd640 1 -- 172.21.15.26:0/1715081984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58005cf0 con 0x7fbf700c2ac0 2023-11-28T16:59:02.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf66ffd640 1 -- 172.21.15.26:0/1715081984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58005e50 con 0x7fbf700c2ac0 2023-11-28T16:59:02.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf66ffd640 1 -- 172.21.15.26:0/1715081984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58007290 con 0x7fbf700c2ac0 2023-11-28T16:59:02.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf701ed200 con 0x7fbf700c2ac0 2023-11-28T16:59:02.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.956+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf70147eb0 con 0x7fbf700c2ac0 2023-11-28T16:59:02.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.960+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf701ed720 con 0x7fbf700c2ac0 2023-11-28T16:59:02.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.960+0000 7fbf66ffd640 1 -- 172.21.15.26:0/1715081984 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbf580073f0 con 0x7fbf700c2ac0 2023-11-28T16:59:02.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.960+0000 7fbf66ffd640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbf50066900 0x7fbf50068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:02.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.960+0000 7fbf66ffd640 1 -- 172.21.15.26:0/1715081984 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf580839d0 con 0x7fbf700c2ac0 2023-11-28T16:59:02.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.960+0000 7fbf6e59c640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbf50066900 0x7fbf50068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:02.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.960+0000 7fbf6e59c640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbf50066900 0x7fbf50068dc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbf60006aa0 tx=0x7fbf60006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:02.964+0000 7fbf66ffd640 1 -- 172.21.15.26:0/1715081984 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf701ed720 con 0x7fbf700c2ac0 2023-11-28T16:59:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.152+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf701ed720 con 0x7fbf700c2ac0 2023-11-28T16:59:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.152+0000 7fbf66ffd640 1 -- 172.21.15.26:0/1715081984 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4909 (secure 0 0 0) 0x7fbf701ed720 con 0x7fbf700c2ac0 2023-11-28T16:59:03.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:03.158 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:57.235192+0000","modified":"2023-11-28T16:59:00.256436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3229750931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3229750931},{"type":"v1","addr":"172.21.15.26:6835","nonce":3229750931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-28T16:59:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 47 2023-11-28T16:59:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbf50066900 msgr2=0x7fbf50068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbf50066900 0x7fbf50068dc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbf60006aa0 tx=0x7fbf60006a30 comp rx=0 tx=0).stop 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c2ac0 msgr2=0x7fbf701f1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c2ac0 0x7fbf701f1070 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c450 tx=0x7fbf5800c910 comp rx=0 tx=0).stop 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 shutdown_connections 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf700c5f20 0x7fbf70147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf700c2ac0 0x7fbf701f1070 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbf50066900 0x7fbf50068dc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 --2- 172.21.15.26:0/1715081984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf700c1290 0x7fbf7006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 >> 172.21.15.26:0/1715081984 conn(0x7fbf700a9c10 msgr2=0x7fbf700c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 shutdown_connections 2023-11-28T16:59:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.156+0000 7fbf74a17640 1 -- 172.21.15.26:0/1715081984 wait complete. 2023-11-28T16:59:03.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T16:58:57.235192+0000', 'modified': '2023-11-28T16:59:00.256436+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6444}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6444': {'gid': 6444, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/3229750931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 3229750931}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 3229750931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T16:59:03.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T16:59:03.583 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T16:59:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd60cf84640 1 Processor -- start 2023-11-28T16:59:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd60cf84640 1 -- start start 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd60cf84640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6080bd5e0 0x7fd6080c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd60cf84640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd60806b4e0 0x7fd60815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd60cf84640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6081559f0 con 0x7fd60806b100 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd60cf84640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd608157930 con 0x7fd6080bd5e0 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd60cf84640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd608151f20 con 0x7fd60806b4e0 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd606ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6080bd5e0 0x7fd6080c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd606ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6080bd5e0 0x7fd6080c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47912/0 (socket says 172.21.15.26:47912) 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd606ffd640 1 -- 172.21.15.26:0/2050770377 learned_addr learned my addr 172.21.15.26:0/2050770377 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd607fff640 1 --2- 172.21.15.26:0/2050770377 >> v2:172.21.15.79:3300/0 conn(0x7fd60806b4e0 0x7fd60815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd606ffd640 1 -- 172.21.15.26:0/2050770377 >> v2:172.21.15.79:3300/0 conn(0x7fd60806b4e0 msgr2=0x7fd60815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2050770377 >> v2:172.21.15.79:3300/0 conn(0x7fd60806b4e0 0x7fd60815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd606ffd640 1 -- 172.21.15.26:0/2050770377 >> v1:172.21.15.79:6789/0 conn(0x7fd60806b100 legacy=0x7fd6080c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.728+0000 7fd606ffd640 1 -- 172.21.15.26:0/2050770377 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080aff20 con 0x7fd6080bd5e0 2023-11-28T16:59:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2050770377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6080bd5e0 0x7fd6080c93c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd6080c0fb0 tx=0x7fd5fc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25044fefe82752ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd6067fc640 1 -- 172.21.15.26:0/2050770377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0ab610 con 0x7fd6080bd5e0 2023-11-28T16:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd6067fc640 1 -- 172.21.15.26:0/2050770377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc0ab770 con 0x7fd6080bd5e0 2023-11-28T16:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd6067fc640 1 -- 172.21.15.26:0/2050770377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0abb00 con 0x7fd6080bd5e0 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 -- 172.21.15.26:0/2050770377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6080bd5e0 msgr2=0x7fd6080c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2050770377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6080bd5e0 0x7fd6080c93c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd6080c0fb0 tx=0x7fd5fc01c500 comp rx=0 tx=0).stop 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 -- 172.21.15.26:0/2050770377 shutdown_connections 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2050770377 >> v2:172.21.15.79:3300/0 conn(0x7fd60806b4e0 0x7fd60815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2050770377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6080bd5e0 0x7fd6080c93c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 -- 172.21.15.26:0/2050770377 >> 172.21.15.26:0/2050770377 conn(0x7fd6080ca550 msgr2=0x7fd6080abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 -- 172.21.15.26:0/2050770377 shutdown_connections 2023-11-28T16:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.732+0000 7fd60cf84640 1 -- 172.21.15.26:0/2050770377 wait complete. 2023-11-28T16:59:03.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 Processor -- start 2023-11-28T16:59:03.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 -- start start 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60806b100 0x7fd60814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd60806b4e0 0x7fd60814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080bd5e0 0x7fd60814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608148f90 con 0x7fd60806b100 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608151a60 con 0x7fd6080bd5e0 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd608150050 con 0x7fd60806b4e0 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60806b100 0x7fd60814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60806b100 0x7fd60814dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47926/0 (socket says 172.21.15.26:47926) 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 -- 172.21.15.26:0/2564737136 learned_addr learned my addr 172.21.15.26:0/2564737136 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd607fff640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080bd5e0 0x7fd60814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd60806b4e0 0x7fd60814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 -- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd60806b4e0 msgr2=0x7fd60814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd60806b4e0 0x7fd60814c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 -- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080bd5e0 msgr2=0x7fd60814cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080bd5e0 0x7fd60814cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 -- 172.21.15.26:0/2564737136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc0094d0 con 0x7fd60806b100 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd60806b4e0 0x7fd60814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd6077fe640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60806b100 0x7fd60814dfa0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c530 tx=0x7fd5f800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd5effff640 1 -- 172.21.15.26:0/2564737136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8005220 con 0x7fd60806b100 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd5effff640 1 -- 172.21.15.26:0/2564737136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8005380 con 0x7fd60806b100 2023-11-28T16:59:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6081ed600 con 0x7fd60806b100 2023-11-28T16:59:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd5effff640 1 -- 172.21.15.26:0/2564737136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8007270 con 0x7fd60806b100 2023-11-28T16:59:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.736+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6081516f0 con 0x7fd60806b100 2023-11-28T16:59:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd5effff640 1 -- 172.21.15.26:0/2564737136 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd5f80073d0 con 0x7fd60806b100 2023-11-28T16:59:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd5effff640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5f4066900 0x7fd5f4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd5effff640 1 -- 172.21.15.26:0/2564737136 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5f8083cb0 con 0x7fd60806b100 2023-11-28T16:59:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 Processor -- start 2023-11-28T16:59:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5f4066900 0x7fd5f4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 -- start start 2023-11-28T16:59:03.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5f4066900 0x7fd5f4068dc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0af000 tx=0x7fd5fc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352640fc0 0x55d3526413a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d352641cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352642200 0x55d35268bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35250a110 con 0x55d352640fc0 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35249a9a0 con 0x55d3526418e0 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d352497ed0 con 0x55d352642200 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352640fc0 0x55d3526413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352640fc0 0x55d3526413a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47936/0 (socket says 172.21.15.26:47936) 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd6077fe640 1 -- 172.21.15.26:0/107352782 learned_addr learned my addr 172.21.15.26:0/107352782 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd606ffd640 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d352641cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.740+0000 7fd607fff640 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352642200 0x55d35268bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd6077fe640 1 -- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352642200 msgr2=0x55d35268bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd6077fe640 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352642200 0x55d35268bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd6077fe640 1 -- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 msgr2=0x55d352641cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd6077fe640 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d352641cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd6077fe640 1 -- 172.21.15.26:0/107352782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35218b890 con 0x55d352640fc0 2023-11-28T16:59:03.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd6077fe640 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352640fc0 0x55d3526413a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd5f805c970 tx=0x7fd5f80547e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb896a3207141c9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd5ed7fa640 1 -- 172.21.15.26:0/107352782 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8054ba0 con 0x55d352640fc0 2023-11-28T16:59:03.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd5ed7fa640 1 -- 172.21.15.26:0/107352782 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8058cf0 con 0x55d352640fc0 2023-11-28T16:59:03.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd5ed7fa640 1 -- 172.21.15.26:0/107352782 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f805cea0 con 0x55d352640fc0 2023-11-28T16:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- 172.21.15.26:0/107352782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352640fc0 msgr2=0x55d3526413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352640fc0 0x55d3526413a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd5f805c970 tx=0x7fd5f80547e0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- 172.21.15.26:0/107352782 shutdown_connections 2023-11-28T16:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352642200 0x55d35268bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d352641cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 --2- 172.21.15.26:0/107352782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352640fc0 0x55d3526413a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- 172.21.15.26:0/107352782 >> 172.21.15.26:0/107352782 conn(0x55d35267f830 msgr2=0x55d352681c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- 172.21.15.26:0/107352782 shutdown_connections 2023-11-28T16:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- 172.21.15.26:0/107352782 wait complete. 2023-11-28T16:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- start start 2023-11-28T16:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 Processor -- start 2023-11-28T16:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d352648220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d352648760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352648ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3524937c0 con 0x55d352642200 2023-11-28T16:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35244bbf0 con 0x55d352640fc0 2023-11-28T16:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d352451a90 con 0x55d3526418e0 2023-11-28T16:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd611558000 10 client.0 _ll_register_callbacks cb 0x55d35262ee20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352648ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352648ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47942/0 (socket says 172.21.15.26:47942) 2023-11-28T16:59:03.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd607fff640 1 -- 172.21.15.26:0/1976613790 learned_addr learned my addr 172.21.15.26:0/1976613790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:03.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd606ffd640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d352648760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd6077fe640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d352648220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd607fff640 1 -- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 msgr2=0x55d352648760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd607fff640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d352648760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.744+0000 7fd607fff640 1 -- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 msgr2=0x55d352648220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd607fff640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d352648220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd607fff640 1 -- 172.21.15.26:0/1976613790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6081516f0 con 0x55d352642200 2023-11-28T16:59:03.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd606ffd640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d352648760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:03.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd607fff640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352648ca0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd600007da0 tx=0x7fd600013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7671b0aa6a7f008 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 1 -- 172.21.15.26:0/1976613790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000e040 con 0x55d352642200 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 1 -- 172.21.15.26:0/1976613790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd600016630 con 0x55d352642200 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d352455470 con 0x55d352642200 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 1 -- 172.21.15.26:0/1976613790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6000167f0 con 0x55d352642200 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 10 client.6573 fetch_fsmap learned FSMap version 47 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55d352454190 con 0x55d352642200 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 1 -- 172.21.15.26:0/1976613790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d352455470 con 0x55d352642200 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 1 -- 172.21.15.26:0/1976613790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd600014040 con 0x55d352642200 2023-11-28T16:59:03.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 10 client.6573 fetch_fsmap finished waiting for FSMap version 47 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 10 client.6573 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 20 client.6573 populate_metadata read hostname 'smithi026' 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d352695310 0x55d352697700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 4 client.6573 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 --> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d352458b50 con 0x55d352695310 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd6077fe640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d352695310 0x55d352697700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd6077fe640 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d352695310 0x55d352697700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e2ec5f608d371e7 server_cookie=7af11d0f6b931b55 in_seq=0 out_seq=0 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 10 client.6573 ms_handle_connect on v2:172.21.15.26:6833/3229750931 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 1 -- 172.21.15.26:0/1976613790 <== mds.0 v2:172.21.15.26:6833/3229750931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d352458b50 con 0x55d352695310 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 10 client.6573 handle_command_reply: tid=0 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 client.6573 shutdown 2023-11-28T16:59:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 msgr2=0x55d352648ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352648ca0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd600007da0 tx=0x7fd600013680 comp rx=0 tx=0).stop 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 shutdown_connections 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d352695310 0x55d352697700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352648ca0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d352648760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 --2- 172.21.15.26:0/1976613790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d352648220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 >> 172.21.15.26:0/1976613790 conn(0x55d35267f830 msgr2=0x55d352681c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd5e67fc640 0 client.6573 ms_handle_reset on v2:172.21.15.26:6833/3229750931 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 shutdown_connections 2023-11-28T16:59:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 1 -- 172.21.15.26:0/1976613790 wait complete. 2023-11-28T16:59:03.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.748+0000 7fd611558000 20 client.6573 trim_cache size 0 max 16384 2023-11-28T16:59:03.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 Processor -- start 2023-11-28T16:59:03.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 -- start start 2023-11-28T16:59:03.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352640fc0 0x55d352647100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d35263f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352697320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35214c940 con 0x55d352642200 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35248f130 con 0x55d3526418e0 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.764+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3524977c0 con 0x55d352640fc0 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352697320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352697320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47944/0 (socket says 172.21.15.26:47944) 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 -- 172.21.15.26:0/3435387444 learned_addr learned my addr 172.21.15.26:0/3435387444 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd6077fe640 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352640fc0 0x55d352647100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd606ffd640 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d35263f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 -- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352640fc0 msgr2=0x55d352647100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352640fc0 0x55d352647100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 -- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 msgr2=0x55d35263f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d35263f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 -- 172.21.15.26:0/3435387444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35243a490 con 0x55d352642200 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352697320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd6000136c0 tx=0x7fd600019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa3b6c119da5303 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd5edffb640 1 -- 172.21.15.26:0/3435387444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000e040 con 0x55d352642200 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd5edffb640 1 -- 172.21.15.26:0/3435387444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60000f040 con 0x55d352642200 2023-11-28T16:59:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd5edffb640 1 -- 172.21.15.26:0/3435387444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600016ac0 con 0x55d352642200 2023-11-28T16:59:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- 172.21.15.26:0/3435387444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 msgr2=0x55d352697320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352697320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd6000136c0 tx=0x7fd600019000 comp rx=0 tx=0).stop 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- 172.21.15.26:0/3435387444 shutdown_connections 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d352697320 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3526418e0 0x55d35263f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 --2- 172.21.15.26:0/3435387444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d352640fc0 0x55d352647100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- 172.21.15.26:0/3435387444 >> 172.21.15.26:0/3435387444 conn(0x55d35267f830 msgr2=0x55d3526469f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- 172.21.15.26:0/3435387444 shutdown_connections 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- 172.21.15.26:0/3435387444 wait complete. 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- start start 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 Processor -- start 2023-11-28T16:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d3526de720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d3526dec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d3526e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d352468b70 con 0x55d352642200 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35244cd60 con 0x55d352640fc0 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d352644820 con 0x55d3526418e0 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd611558000 10 client.0 _ll_register_callbacks cb 0x55d35249e8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d3526e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d3526e3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47958/0 (socket says 172.21.15.26:47958) 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd607fff640 1 -- 172.21.15.26:0/2478865796 learned_addr learned my addr 172.21.15.26:0/2478865796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd6077fe640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d3526de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.768+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d3526dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd607fff640 1 -- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 msgr2=0x55d3526dec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd607fff640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d3526dec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd607fff640 1 -- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 msgr2=0x55d3526de720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd607fff640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d3526de720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd607fff640 1 -- 172.21.15.26:0/2478865796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d352454190 con 0x55d352642200 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd606ffd640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d3526dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd607fff640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d3526e3b90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd600007750 tx=0x7fd600004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73857f35b4b1265a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 1 -- 172.21.15.26:0/2478865796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000e040 con 0x55d352642200 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 1 -- 172.21.15.26:0/2478865796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd600016630 con 0x55d352642200 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d352645f60 con 0x55d352642200 2023-11-28T16:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 1 -- 172.21.15.26:0/2478865796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd600007b50 con 0x55d352642200 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 10 client.6579 fetch_fsmap learned FSMap version 47 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55d35218bcc0 con 0x55d352642200 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 1 -- 172.21.15.26:0/2478865796 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d352645f60 con 0x55d352642200 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 1 -- 172.21.15.26:0/2478865796 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd60003b020 con 0x55d352642200 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 10 client.6579 fetch_fsmap finished waiting for FSMap version 47 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 10 client.6579 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 20 client.6579 populate_metadata read hostname 'smithi026' 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d3526e40d0 0x55d3526e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 4 client.6579 mds_command: new command op to 6444 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 --> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d352492110 con 0x55d3526e40d0 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd6077fe640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d3526e40d0 0x55d3526e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 10 client.6579 ms_handle_connect on v2:172.21.15.26:6833/3229750931 2023-11-28T16:59:03.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd6077fe640 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d3526e40d0 0x55d3526e44b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=934976d72b0ec1c5 server_cookie=9aacfcc73b5d925f in_seq=0 out_seq=0 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 1 -- 172.21.15.26:0/2478865796 <== mds.0 v2:172.21.15.26:6833/3229750931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d352492110 con 0x55d3526e40d0 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 10 client.6579 handle_command_reply: tid=0 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 client.6579 shutdown 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 msgr2=0x55d3526e3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d3526e3b90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd600007750 tx=0x7fd600004a50 comp rx=0 tx=0).stop 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 shutdown_connections 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:6833/3229750931,v1:172.21.15.26:6835/3229750931] conn(0x55d3526e40d0 0x55d3526e44b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d352642200 0x55d3526e3b90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d3526418e0 0x55d3526dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 --2- 172.21.15.26:0/2478865796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d352640fc0 0x55d3526de720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd5e67fc640 0 client.6579 ms_handle_reset on v2:172.21.15.26:6833/3229750931 2023-11-28T16:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 >> 172.21.15.26:0/2478865796 conn(0x55d35267f830 msgr2=0x55d3526469f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 shutdown_connections 2023-11-28T16:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 1 -- 172.21.15.26:0/2478865796 wait complete. 2023-11-28T16:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd611558000 20 client.6579 trim_cache size 0 max 16384 2023-11-28T16:59:03.782 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee", 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6444, 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9275163239999999, 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 47, 2023-11-28T16:59:03.783 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 69, 2023-11-28T16:59:03.784 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 69, 2023-11-28T16:59:03.784 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 11.860362480999999 2023-11-28T16:59:03.784 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5f4066900 msgr2=0x7fd5f4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5f4066900 0x7fd5f4068dc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0af000 tx=0x7fd5fc0a7000 comp rx=0 tx=0).stop 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60806b100 msgr2=0x7fd60814dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60806b100 0x7fd60814dfa0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c530 tx=0x7fd5f800c9f0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 shutdown_connections 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080bd5e0 0x7fd60814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd5f4066900 0x7fd5f4068dc0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd60806b4e0 0x7fd60814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 --2- 172.21.15.26:0/2564737136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60806b100 0x7fd60814dfa0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 >> 172.21.15.26:0/2564737136 conn(0x7fd6080ca550 msgr2=0x7fd608154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 shutdown_connections 2023-11-28T16:59:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.772+0000 7fd60cf84640 1 -- 172.21.15.26:0/2564737136 wait complete. 2023-11-28T16:59:03.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:59:03.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16f61aa640 1 Processor -- start 2023-11-28T16:59:03.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16f61aa640 1 -- start start 2023-11-28T16:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16f61aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f0070b80 0x7f16f0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16f61aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16f00a8470 0x7f16f006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16f61aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f006d320 con 0x7f16f014e9d0 2023-11-28T16:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16f61aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f00721b0 con 0x7f16f00a8470 2023-11-28T16:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16f61aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00c2830 con 0x7f16f0070b80 2023-11-28T16:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16eeffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f0070b80 0x7f16f0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16effff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16f00a8470 0x7f16f006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16ef7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f16f014e9d0 0x7f16f00c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:47640/0 (socket says 172.21.15.26:47640) 2023-11-28T16:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16ef7fe640 1 -- 172.21.15.26:0/102489947 learned_addr learned my addr 172.21.15.26:0/102489947 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16effff640 1 -- 172.21.15.26:0/102489947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f0070b80 msgr2=0x7f16f0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16effff640 1 --2- 172.21.15.26:0/102489947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f0070b80 0x7f16f0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.936+0000 7f16effff640 1 -- 172.21.15.26:0/102489947 >> v1:172.21.15.79:6789/0 conn(0x7f16f014e9d0 legacy=0x7f16f00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16effff640 1 -- 172.21.15.26:0/102489947 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0072450 con 0x7f16f00a8470 2023-11-28T16:59:03.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16effff640 1 --2- 172.21.15.26:0/102489947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f00a8470 0x7f16f006d7b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009d90 tx=0x7f16e801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a46a636bf7b9419 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16ee7fc640 1 -- 172.21.15.26:0/102489947 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80a5790 con 0x7f16f00a8470 2023-11-28T16:59:03.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16ee7fc640 1 -- 172.21.15.26:0/102489947 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e80a58f0 con 0x7f16f00a8470 2023-11-28T16:59:03.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16ee7fc640 1 -- 172.21.15.26:0/102489947 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80a5c80 con 0x7f16f00a8470 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 -- 172.21.15.26:0/102489947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f00a8470 msgr2=0x7f16f006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 --2- 172.21.15.26:0/102489947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f00a8470 0x7f16f006d7b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009d90 tx=0x7f16e801c8c0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 -- 172.21.15.26:0/102489947 shutdown_connections 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 --2- 172.21.15.26:0/102489947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f00a8470 0x7f16f006d7b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 --2- 172.21.15.26:0/102489947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f0070b80 0x7f16f0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 -- 172.21.15.26:0/102489947 >> 172.21.15.26:0/102489947 conn(0x7f16f00c2ad0 msgr2=0x7f16f00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 -- 172.21.15.26:0/102489947 shutdown_connections 2023-11-28T16:59:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.940+0000 7f16f61aa640 1 -- 172.21.15.26:0/102489947 wait complete. 2023-11-28T16:59:03.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 Processor -- start 2023-11-28T16:59:03.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 -- start start 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f0070b80 0x7f16f00c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f00a8470 0x7f16f01ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f014e9d0 0x7f16f0148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f014f390 con 0x7f16f014e9d0 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01507e0 con 0x7f16f0070b80 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16f61aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00ab6e0 con 0x7f16f00a8470 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f014e9d0 0x7f16f0148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f014e9d0 0x7f16f0148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47960/0 (socket says 172.21.15.26:47960) 2023-11-28T16:59:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 -- 172.21.15.26:0/1340543003 learned_addr learned my addr 172.21.15.26:0/1340543003 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16ef7fe640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f0070b80 0x7f16f00c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16eeffd640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f00a8470 0x7f16f01ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 -- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f00a8470 msgr2=0x7f16f01ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f00a8470 0x7f16f01ecde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 -- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f0070b80 msgr2=0x7f16f00c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f0070b80 0x7f16f00c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 -- 172.21.15.26:0/1340543003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8009a70 con 0x7f16f014e9d0 2023-11-28T16:59:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16effff640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f014e9d0 0x7f16f0148040 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f16e80b0040 tx=0x7f16e8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16d7fff640 1 -- 172.21.15.26:0/1340543003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80b9650 con 0x7f16f014e9d0 2023-11-28T16:59:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16d7fff640 1 -- 172.21.15.26:0/1340543003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e80b97b0 con 0x7f16f014e9d0 2023-11-28T16:59:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.944+0000 7f16d7fff640 1 -- 172.21.15.26:0/1340543003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80b9b20 con 0x7f16f014e9d0 2023-11-28T16:59:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.948+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f00ab480 con 0x7f16f014e9d0 2023-11-28T16:59:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.948+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f00abc10 con 0x7f16f014e9d0 2023-11-28T16:59:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.948+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f004e890 con 0x7f16f014e9d0 2023-11-28T16:59:03.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.948+0000 7f16d7fff640 1 -- 172.21.15.26:0/1340543003 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f16e80b9c80 con 0x7f16f014e9d0 2023-11-28T16:59:03.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.948+0000 7f16d7fff640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16dc066900 0x7f16dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:03.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.948+0000 7f16d7fff640 1 -- 172.21.15.26:0/1340543003 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e811f210 con 0x7f16f014e9d0 2023-11-28T16:59:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.948+0000 7f16ef7fe640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16dc066900 0x7f16dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.952+0000 7f16ef7fe640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16dc066900 0x7f16dc068dc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f16e0005890 tx=0x7f16e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:03.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:03.952+0000 7f16d7fff640 1 -- 172.21.15.26:0/1340543003 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16e80ec470 con 0x7f16f014e9d0 2023-11-28T16:59:04.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.144+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f16f015bb40 con 0x7f16f014e9d0 2023-11-28T16:59:04.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.144+0000 7f16d7fff640 1 -- 172.21.15.26:0/1340543003 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f16e80efa90 con 0x7f16f014e9d0 2023-11-28T16:59:04.149 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:59:04.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16dc066900 msgr2=0x7f16dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:04.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16dc066900 0x7f16dc068dc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f16e0005890 tx=0x7f16e0009040 comp rx=0 tx=0).stop 2023-11-28T16:59:04.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f014e9d0 msgr2=0x7f16f0148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:04.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f014e9d0 0x7f16f0148040 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f16e80b0040 tx=0x7f16e8019660 comp rx=0 tx=0).stop 2023-11-28T16:59:04.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 shutdown_connections 2023-11-28T16:59:04.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f014e9d0 0x7f16f0148040 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:04.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16dc066900 0x7f16dc068dc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:04.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16f00a8470 0x7f16f01ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:04.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 --2- 172.21.15.26:0/1340543003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16f0070b80 0x7f16f00c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:04.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 >> 172.21.15.26:0/1340543003 conn(0x7f16f00c2ad0 msgr2=0x7f16f014c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:04.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 shutdown_connections 2023-11-28T16:59:04.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:04.148+0000 7f16f61aa640 1 -- 172.21.15.26:0/1340543003 wait complete. 2023-11-28T16:59:04.170 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T16:59:04.171 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:59:04.171 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-11-28T16:59:04.171 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T16:59:04.171 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:04.171 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T16:59:04.172 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:59:04.172 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:59:04.172 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:59:04.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.173 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-11-28T16:59:04.184 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:59:04.184 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:59:04.184 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:59:04.184 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:04.184 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-11-28T16:59:04.184 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:04.185 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:04.185 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:04.185 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-11-28T16:59:04.185 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:04.185 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:04.185 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-11-28T16:59:04.185 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:59:04.186 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:04.186 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-11-28T16:59:04.186 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T16:59:04.186 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42231sec preferred_lft 42231sec 2023-11-28T16:59:04.186 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-11-28T16:59:04.186 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:04.186 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-11-28T16:59:04.187 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:59:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:1b:cd:da:6f brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:59:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:04.187 INFO:teuthology.orchestra.run.smithi026.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:59:04.188 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:04.188 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:59:04.188 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:04.188 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:59:04.188 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:04.188 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:59:04.189 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:59:04.189 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:59:04.189 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:04.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.189 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:59:04.244 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-11-28T16:59:04.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.247 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-11-28T16:59:04.301 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-11-28T16:59:04.301 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:59:04.301 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T16:59:04.301 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:59:04.302 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T16:59:04.302 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:59:04.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.302 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:59:04.302 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:59:04.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T16:59:04.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T16:59:04.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T16:59:04.303 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:59:04.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.398 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:59:04.407 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T16:59:04.408 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:59:04.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-11-28T16:59:04.470 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:04.471 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:04.522 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:04.523 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:04.578 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T16:59:04.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:04.673 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:04.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:04.686 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:04.686 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:04.686 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:59:04.687 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:59:04.687 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:59:04.690 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:59:04.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:04.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:04.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:59:04.775 INFO:teuthology.orchestra.run.smithi026.stdout:client6585 2023-11-28T16:59:04.776 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:04.776 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:04.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:59:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c3c9a640 1 Processor -- start 2023-11-28T16:59:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c3c9a640 1 -- start start 2023-11-28T16:59:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c3c9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63bc070b80 0x7f63bc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c3c9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c3c9a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63bc06d320 con 0x7f63bc14e9d0 2023-11-28T16:59:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c3c9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63bc0721b0 con 0x7f63bc070b80 2023-11-28T16:59:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c3c9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0c2830 con 0x7f63bc0a8470 2023-11-28T16:59:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c1a36640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f63bc14e9d0 0x7f63bc0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44910/0 (socket says 172.21.15.26:44910) 2023-11-28T16:59:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c1a36640 1 -- 172.21.15.26:0/3716588458 learned_addr learned my addr 172.21.15.26:0/3716588458 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.008+0000 7f63c1235640 1 --2- 172.21.15.26:0/3716588458 >> v2:172.21.15.26:3300/0 conn(0x7f63bc070b80 0x7f63bc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c2237640 1 --2- 172.21.15.26:0/3716588458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c0a34640 1 -- 172.21.15.26:0/3716588458 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5126955 0 0) 0x7f63bc06d320 con 0x7f63bc14e9d0 2023-11-28T16:59:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c0a34640 1 -- 172.21.15.26:0/3716588458 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a8003530 con 0x7f63bc14e9d0 2023-11-28T16:59:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c1235640 1 -- 172.21.15.26:0/3716588458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 msgr2=0x7f63bc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c1235640 1 --2- 172.21.15.26:0/3716588458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c1235640 1 -- 172.21.15.26:0/3716588458 >> v1:172.21.15.26:6789/0 conn(0x7f63bc14e9d0 legacy=0x7f63bc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:05.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c1235640 1 -- 172.21.15.26:0/3716588458 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc072450 con 0x7f63bc070b80 2023-11-28T16:59:05.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c2237640 1 --2- 172.21.15.26:0/3716588458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:05.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c1235640 1 --2- 172.21.15.26:0/3716588458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc151e60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0097c0 tx=0x7f63ac01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1740c86ee318ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:05.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c0a34640 1 -- 172.21.15.26:0/3716588458 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0ab600 con 0x7f63bc070b80 2023-11-28T16:59:05.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c0a34640 1 -- 172.21.15.26:0/3716588458 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac0a7050 con 0x7f63bc070b80 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c0a34640 1 -- 172.21.15.26:0/3716588458 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0ab980 con 0x7f63bc070b80 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c3c9a640 1 -- 172.21.15.26:0/3716588458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 msgr2=0x7f63bc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/3716588458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc151e60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0097c0 tx=0x7f63ac01c3f0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c3c9a640 1 -- 172.21.15.26:0/3716588458 shutdown_connections 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/3716588458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/3716588458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc151e60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.012+0000 7f63c3c9a640 1 -- 172.21.15.26:0/3716588458 >> 172.21.15.26:0/3716588458 conn(0x7f63bc0c2ad0 msgr2=0x7f63bc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- 172.21.15.26:0/3716588458 shutdown_connections 2023-11-28T16:59:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- 172.21.15.26:0/3716588458 wait complete. 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 Processor -- start 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- start start 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc14e9d0 0x7f63bc15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc152ec0 con 0x7f63bc070b80 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc143b30 con 0x7f63bc14e9d0 2023-11-28T16:59:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc152900 con 0x7f63bc0a8470 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47980/0 (socket says 172.21.15.26:47980) 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 -- 172.21.15.26:0/2065392172 learned_addr learned my addr 172.21.15.26:0/2065392172 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c2237640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc14e9d0 0x7f63bc15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1235640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 -- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 msgr2=0x7f63bc15e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc15e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 -- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc14e9d0 msgr2=0x7f63bc15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc14e9d0 0x7f63bc15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 -- 172.21.15.26:0/2065392172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac009420 con 0x7f63bc070b80 2023-11-28T16:59:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c1a36640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc154810 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c420 tx=0x7f63b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63b27fc640 1 -- 172.21.15.26:0/2065392172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8005cf0 con 0x7f63bc070b80 2023-11-28T16:59:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63b27fc640 1 -- 172.21.15.26:0/2065392172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8005e50 con 0x7f63bc070b80 2023-11-28T16:59:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63b27fc640 1 -- 172.21.15.26:0/2065392172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80072d0 con 0x7f63bc070b80 2023-11-28T16:59:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63bc152be0 con 0x7f63bc070b80 2023-11-28T16:59:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.016+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63bc1531e0 con 0x7f63bc070b80 2023-11-28T16:59:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.020+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63bc15d0e0 con 0x7f63bc070b80 2023-11-28T16:59:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.020+0000 7f63b27fc640 1 -- 172.21.15.26:0/2065392172 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63b8007430 con 0x7f63bc070b80 2023-11-28T16:59:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.020+0000 7f63b27fc640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.020+0000 7f63b27fc640 1 -- 172.21.15.26:0/2065392172 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63b8083960 con 0x7f63bc070b80 2023-11-28T16:59:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.020+0000 7f63c1235640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.024+0000 7f63c1235640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0ad000 tx=0x7f63ac0a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.024+0000 7f63b27fc640 1 -- 172.21.15.26:0/2065392172 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63b8050c40 con 0x7f63bc070b80 2023-11-28T16:59:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63bc04e890 con 0x7f63bc070b80 2023-11-28T16:59:05.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63b27fc640 1 -- 172.21.15.26:0/2065392172 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f63b8017020 con 0x7f63bc070b80 2023-11-28T16:59:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 msgr2=0x7f63a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0ad000 tx=0x7f63ac0a4f90 comp rx=0 tx=0).stop 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 msgr2=0x7f63bc154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc154810 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c420 tx=0x7f63b800c8e0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 shutdown_connections 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc14e9d0 0x7f63bc15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f63a00668d0 0x7f63a0068d90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f63bc0a8470 0x7f63bc15e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 --2- 172.21.15.26:0/2065392172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc070b80 0x7f63bc154810 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 >> 172.21.15.26:0/2065392172 conn(0x7f63bc0c2ad0 msgr2=0x7f63bc14d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 shutdown_connections 2023-11-28T16:59:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:05.220+0000 7f63c3c9a640 1 -- 172.21.15.26:0/2065392172 wait complete. 2023-11-28T16:59:05.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T16:59:05.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:59:05.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:59:05.245 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T16:59:05.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:05.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T16:59:05.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:59:05.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:59:05.245 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:05.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.245 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:59:05.256 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:59:05.256 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:59:05.257 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42221sec preferred_lft 42221sec 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:59:05.258 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:05.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.260 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:59:05.326 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:59:05.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.328 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:59:05.385 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:05.386 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:59:05.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.387 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:59:05.387 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:59:05.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:59:05.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:59:05.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:59:05.387 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:59:05.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.483 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:59:05.493 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:59:05.493 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:05.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:59:05.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:05.556 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:05.607 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:05.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:05.607 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:05.658 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T16:59:05.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:05.747 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:05.747 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:05.760 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:05.760 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:05.760 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:59:05.760 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:59:05.760 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:59:05.764 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:59:05.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:05.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:05.785 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:59:05.838 INFO:teuthology.orchestra.run.smithi079.stdout:client5828 2023-11-28T16:59:05.838 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:05.839 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:05.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-28T16:59:06.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.032+0000 7f55a8f2a640 1 Processor -- start 2023-11-28T16:59:06.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.032+0000 7f55a8f2a640 1 -- start start 2023-11-28T16:59:06.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a8f2a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55a4155360 0x7f55a406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a8f2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a406baf0 0x7f55a406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a8f2a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a406e280 con 0x7f55a406ed00 2023-11-28T16:59:06.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a8f2a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40c2150 con 0x7f55a4155360 2023-11-28T16:59:06.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a8f2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4157c60 con 0x7f55a406baf0 2023-11-28T16:59:06.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a2d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f55a406ed00 0x7f55a41580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44912/0 (socket says 172.21.15.26:44912) 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a2d9d640 1 -- 172.21.15.26:0/1081927460 learned_addr learned my addr 172.21.15.26:0/1081927460 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a259c640 1 --2- 172.21.15.26:0/1081927460 >> v2:172.21.15.79:3300/0 conn(0x7f55a4155360 0x7f55a406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f559bfff640 1 --2- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a406baf0 0x7f55a406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a1d9b640 1 -- 172.21.15.26:0/1081927460 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255364432 0 0) 0x7f55a406e280 con 0x7f55a406ed00 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a1d9b640 1 -- 172.21.15.26:0/1081927460 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5590003530 con 0x7f55a406ed00 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a259c640 1 -- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a406baf0 msgr2=0x7f55a406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a259c640 1 --2- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a406baf0 0x7f55a406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a259c640 1 -- 172.21.15.26:0/1081927460 >> v1:172.21.15.26:6789/0 conn(0x7f55a406ed00 legacy=0x7f55a41580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a259c640 1 -- 172.21.15.26:0/1081927460 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40c1bd0 con 0x7f55a4155360 2023-11-28T16:59:06.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f559bfff640 1 --2- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a406baf0 0x7f55a406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:06.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.036+0000 7f55a259c640 1 --2- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a4155360 0x7f55a406b5b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f55940097c0 tx=0x7f559401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db88ea2385674a70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a1d9b640 1 -- 172.21.15.26:0/1081927460 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940ab600 con 0x7f55a4155360 2023-11-28T16:59:06.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a1d9b640 1 -- 172.21.15.26:0/1081927460 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55940a7050 con 0x7f55a4155360 2023-11-28T16:59:06.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a1d9b640 1 -- 172.21.15.26:0/1081927460 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940ab980 con 0x7f55a4155360 2023-11-28T16:59:06.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a4155360 msgr2=0x7f55a406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a4155360 0x7f55a406b5b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f55940097c0 tx=0x7f559401c3f0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- 172.21.15.26:0/1081927460 shutdown_connections 2023-11-28T16:59:06.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a406baf0 0x7f55a406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/1081927460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a4155360 0x7f55a406b5b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- 172.21.15.26:0/1081927460 >> 172.21.15.26:0/1081927460 conn(0x7f55a40c3240 msgr2=0x7f55a40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:06.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- 172.21.15.26:0/1081927460 shutdown_connections 2023-11-28T16:59:06.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- 172.21.15.26:0/1081927460 wait complete. 2023-11-28T16:59:06.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 Processor -- start 2023-11-28T16:59:06.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- start start 2023-11-28T16:59:06.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a406baf0 0x7f55a41f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55a406ed00 0x7f55a414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a4155360 0x7f55a414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40a9aa0 con 0x7f55a406ed00 2023-11-28T16:59:06.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41ecf70 con 0x7f55a406baf0 2023-11-28T16:59:06.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.040+0000 7f55a8f2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4071c00 con 0x7f55a4155360 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55a406ed00 0x7f55a414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55a406ed00 0x7f55a414a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47990/0 (socket says 172.21.15.26:47990) 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 -- 172.21.15.26:0/915857580 learned_addr learned my addr 172.21.15.26:0/915857580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f55a259c640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a406baf0 0x7f55a41f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f55a2d9d640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a4155360 0x7f55a414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 -- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a4155360 msgr2=0x7f55a414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a4155360 0x7f55a414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 -- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a406baf0 msgr2=0x7f55a41f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a406baf0 0x7f55a41f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 -- 172.21.15.26:0/915857580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c009420 con 0x7f55a406ed00 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f55a259c640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a406baf0 0x7f55a41f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559bfff640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55a406ed00 0x7f55a414a4e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f558c00e980 tx=0x7f558c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559affd640 1 -- 172.21.15.26:0/915857580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c00ca00 con 0x7f55a406ed00 2023-11-28T16:59:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559affd640 1 -- 172.21.15.26:0/915857580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c00cb60 con 0x7f55a406ed00 2023-11-28T16:59:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5594009420 con 0x7f55a406ed00 2023-11-28T16:59:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559affd640 1 -- 172.21.15.26:0/915857580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c013470 con 0x7f55a406ed00 2023-11-28T16:59:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a40721c0 con 0x7f55a406ed00 2023-11-28T16:59:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a404e890 con 0x7f55a406ed00 2023-11-28T16:59:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559affd640 1 -- 172.21.15.26:0/915857580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f558c0135d0 con 0x7f55a406ed00 2023-11-28T16:59:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559affd640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55840668d0 0x7f5584068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.044+0000 7f559affd640 1 -- 172.21.15.26:0/915857580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f558c084670 con 0x7f55a406ed00 2023-11-28T16:59:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.048+0000 7f55a259c640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55840668d0 0x7f5584068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.048+0000 7f55a259c640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55840668d0 0x7f5584068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f55940ad000 tx=0x7f55940a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.052+0000 7f559affd640 1 -- 172.21.15.26:0/915857580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f558c0518a0 con 0x7f55a406ed00 2023-11-28T16:59:06.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.264+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f55a40c4780 con 0x7f55a406ed00 2023-11-28T16:59:06.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.264+0000 7f559affd640 1 -- 172.21.15.26:0/915857580 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v21) v1 ==== 84+0+0 (secure 0 0 0) 0x7f558c054ec0 con 0x7f55a406ed00 2023-11-28T16:59:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55840668d0 msgr2=0x7f5584068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55840668d0 0x7f5584068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f55940ad000 tx=0x7f55940a6000 comp rx=0 tx=0).stop 2023-11-28T16:59:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55a406ed00 msgr2=0x7f55a414a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55a406ed00 0x7f55a414a4e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f558c00e980 tx=0x7f558c00ee40 comp rx=0 tx=0).stop 2023-11-28T16:59:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 shutdown_connections 2023-11-28T16:59:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f55840668d0 0x7f5584068d90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a4155360 0x7f55a414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55a406ed00 0x7f55a414a4e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 --2- 172.21.15.26:0/915857580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a406baf0 0x7f55a41f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 >> 172.21.15.26:0/915857580 conn(0x7f55a40c3240 msgr2=0x7f55a41580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 shutdown_connections 2023-11-28T16:59:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.268+0000 7f55a8f2a640 1 -- 172.21.15.26:0/915857580 wait complete. 2023-11-28T16:59:06.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:06.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca90d6640 1 Processor -- start 2023-11-28T16:59:06.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca90d6640 1 -- start start 2023-11-28T16:59:06.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca90d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ca40ca610 0x7f3ca40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca90d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca90d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca4155790 con 0x7f3ca406cd90 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca90d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40c4b00 con 0x7f3ca40ca610 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca90d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40c4de0 con 0x7f3ca40bd720 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ca40ca610 0x7f3ca40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ca40ca610 0x7f3ca40c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48000/0 (socket says 172.21.15.26:48000) 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca2d9d640 1 -- 172.21.15.26:0/864982557 learned_addr learned my addr 172.21.15.26:0/864982557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca259c640 1 --2- 172.21.15.26:0/864982557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca2d9d640 1 -- 172.21.15.26:0/864982557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 msgr2=0x7f3ca40c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca2d9d640 1 --2- 172.21.15.26:0/864982557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca40c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca2d9d640 1 -- 172.21.15.26:0/864982557 >> v1:172.21.15.79:6789/0 conn(0x7f3ca406cd90 legacy=0x7f3ca4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca2d9d640 1 -- 172.21.15.26:0/864982557 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4157e30 con 0x7f3ca40ca610 2023-11-28T16:59:06.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.432+0000 7f3ca1d9b640 1 -- 172.21.15.26:0/864982557 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101476743 0 0) 0x7f3ca4155790 con 0x7f3ca406cd90 2023-11-28T16:59:06.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca2d9d640 1 --2- 172.21.15.26:0/864982557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca40c94c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009870 tx=0x7f3c9401c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76749213e4ac609 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca1d9b640 1 -- 172.21.15.26:0/864982557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40c52d0 con 0x7f3ca40ca610 2023-11-28T16:59:06.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca1d9b640 1 -- 172.21.15.26:0/864982557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940a4940 con 0x7f3ca40ca610 2023-11-28T16:59:06.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca1d9b640 1 -- 172.21.15.26:0/864982557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940a4cd0 con 0x7f3ca40ca610 2023-11-28T16:59:06.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 -- 172.21.15.26:0/864982557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 msgr2=0x7f3ca40c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/864982557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca40c94c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009870 tx=0x7f3c9401c100 comp rx=0 tx=0).stop 2023-11-28T16:59:06.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 -- 172.21.15.26:0/864982557 shutdown_connections 2023-11-28T16:59:06.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/864982557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/864982557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca40c94c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 -- 172.21.15.26:0/864982557 >> 172.21.15.26:0/864982557 conn(0x7f3ca4071ea0 msgr2=0x7f3ca40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:06.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 -- 172.21.15.26:0/864982557 shutdown_connections 2023-11-28T16:59:06.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.436+0000 7f3ca90d6640 1 -- 172.21.15.26:0/864982557 wait complete. 2023-11-28T16:59:06.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 Processor -- start 2023-11-28T16:59:06.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 -- start start 2023-11-28T16:59:06.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ca406cd90 0x7f3ca41568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca414bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41f12b0 con 0x7f3ca40ca610 2023-11-28T16:59:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca414c020 con 0x7f3ca406cd90 2023-11-28T16:59:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40c2120 con 0x7f3ca40bd720 2023-11-28T16:59:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca414bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca414bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48006/0 (socket says 172.21.15.26:48006) 2023-11-28T16:59:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 -- 172.21.15.26:0/4073866862 learned_addr learned my addr 172.21.15.26:0/4073866862 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca259c640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca2d9d640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ca406cd90 0x7f3ca41568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 -- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 msgr2=0x7f3ca414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 -- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ca406cd90 msgr2=0x7f3ca41568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ca406cd90 0x7f3ca41568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 -- 172.21.15.26:0/4073866862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c940094d0 con 0x7f3ca40ca610 2023-11-28T16:59:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca359e640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca414bae0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c7c0 tx=0x7f3c9c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3c8b7fe640 1 -- 172.21.15.26:0/4073866862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c003db0 con 0x7f3ca40ca610 2023-11-28T16:59:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3c8b7fe640 1 -- 172.21.15.26:0/4073866862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c005070 con 0x7f3ca40ca610 2023-11-28T16:59:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3c8b7fe640 1 -- 172.21.15.26:0/4073866862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c005420 con 0x7f3ca40ca610 2023-11-28T16:59:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca40c2400 con 0x7f3ca40ca610 2023-11-28T16:59:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca40c29c0 con 0x7f3ca40ca610 2023-11-28T16:59:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.440+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca40c2bb0 con 0x7f3ca40ca610 2023-11-28T16:59:06.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.444+0000 7f3c8b7fe640 1 -- 172.21.15.26:0/4073866862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3c9c005580 con 0x7f3ca40ca610 2023-11-28T16:59:06.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.444+0000 7f3c8b7fe640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c900668d0 0x7f3c90068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.444+0000 7f3c8b7fe640 1 -- 172.21.15.26:0/4073866862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c9c083c10 con 0x7f3ca40ca610 2023-11-28T16:59:06.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.444+0000 7f3ca2d9d640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c900668d0 0x7f3c90068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.444+0000 7f3ca2d9d640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c900668d0 0x7f3c90068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c940ae000 tx=0x7f3c94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.448+0000 7f3c8b7fe640 1 -- 172.21.15.26:0/4073866862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c9c050f00 con 0x7f3ca40ca610 2023-11-28T16:59:06.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.608+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ca404e890 con 0x7f3ca40ca610 2023-11-28T16:59:06.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.608+0000 7f3c8b7fe640 1 -- 172.21.15.26:0/4073866862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16488 (secure 0 0 0) 0x7f3c9c017070 con 0x7f3ca40ca610 2023-11-28T16:59:06.612 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:06.613 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":69,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:58:58.284206+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:06.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c900668d0 msgr2=0x7f3c90068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c900668d0 0x7f3c90068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c940ae000 tx=0x7f3c94008040 comp rx=0 tx=0).stop 2023-11-28T16:59:06.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 msgr2=0x7f3ca414bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca414bae0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c7c0 tx=0x7f3c9c00cc80 comp rx=0 tx=0).stop 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 shutdown_connections 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ca40ca610 0x7f3ca414bae0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c900668d0 0x7f3c90068d90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ca40bd720 0x7f3ca414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 --2- 172.21.15.26:0/4073866862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ca406cd90 0x7f3ca41568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 >> 172.21.15.26:0/4073866862 conn(0x7f3ca4071ea0 msgr2=0x7f3ca4072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 shutdown_connections 2023-11-28T16:59:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.612+0000 7f3ca90d6640 1 -- 172.21.15.26:0/4073866862 wait complete. 2023-11-28T16:59:06.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:58:55.413723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:58:56.230719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:06.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.776+0000 7f65647d1640 1 Processor -- start 2023-11-28T16:59:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.776+0000 7f65647d1640 1 -- start start 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f65647d1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f655c0a86d0 0x7f655c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f65647d1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f655c156600 0x7f655c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f65647d1640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c152d90 con 0x7f655c14fb30 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f65647d1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c14ffa0 con 0x7f655c156600 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f65647d1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c152480 con 0x7f655c0a86d0 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6561d6c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f655c156600 0x7f655c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6562d6e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f655c14fb30 0x7f655c0aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44922/0 (socket says 172.21.15.26:44922) 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6561d6c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f655c156600 0x7f655c14f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48014/0 (socket says 172.21.15.26:48014) 2023-11-28T16:59:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6562d6e640 1 -- 172.21.15.26:0/78761294 learned_addr learned my addr 172.21.15.26:0/78761294 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f656256d640 1 --2- 172.21.15.26:0/78761294 >> v2:172.21.15.79:3300/0 conn(0x7f655c0a86d0 0x7f655c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6561d6c640 1 -- 172.21.15.26:0/78761294 >> v2:172.21.15.79:3300/0 conn(0x7f655c0a86d0 msgr2=0x7f655c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6561d6c640 1 --2- 172.21.15.26:0/78761294 >> v2:172.21.15.79:3300/0 conn(0x7f655c0a86d0 0x7f655c0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6561d6c640 1 -- 172.21.15.26:0/78761294 >> v1:172.21.15.26:6789/0 conn(0x7f655c14fb30 legacy=0x7f655c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f6561d6c640 1 -- 172.21.15.26:0/78761294 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0a9760 con 0x7f655c156600 2023-11-28T16:59:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.780+0000 7f656156b640 1 -- 172.21.15.26:0/78761294 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245564983 0 0) 0x7f655c152d90 con 0x7f655c14fb30 2023-11-28T16:59:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f6561d6c640 1 --2- 172.21.15.26:0/78761294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c156600 0x7f655c14f5f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f654c0097c0 tx=0x7f654c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562845a403486c61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f656156b640 1 -- 172.21.15.26:0/78761294 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0ab600 con 0x7f655c156600 2023-11-28T16:59:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f656156b640 1 -- 172.21.15.26:0/78761294 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c0a7050 con 0x7f655c156600 2023-11-28T16:59:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f656156b640 1 -- 172.21.15.26:0/78761294 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0ab980 con 0x7f655c156600 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 -- 172.21.15.26:0/78761294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c156600 msgr2=0x7f655c14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 --2- 172.21.15.26:0/78761294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c156600 0x7f655c14f5f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f654c0097c0 tx=0x7f654c01c440 comp rx=0 tx=0).stop 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 -- 172.21.15.26:0/78761294 shutdown_connections 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 --2- 172.21.15.26:0/78761294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c156600 0x7f655c14f5f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 --2- 172.21.15.26:0/78761294 >> v2:172.21.15.79:3300/0 conn(0x7f655c0a86d0 0x7f655c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 -- 172.21.15.26:0/78761294 >> 172.21.15.26:0/78761294 conn(0x7f655c0c2a60 msgr2=0x7f655c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 -- 172.21.15.26:0/78761294 shutdown_connections 2023-11-28T16:59:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 -- 172.21.15.26:0/78761294 wait complete. 2023-11-28T16:59:06.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 Processor -- start 2023-11-28T16:59:06.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.784+0000 7f65647d1640 1 -- start start 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c0a86d0 0x7f655c1ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c14fb30 0x7f655c0bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f655c156600 0x7f655c1416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c1edba0 con 0x7f655c14fb30 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c070260 con 0x7f655c0a86d0 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c1ed300 con 0x7f655c156600 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c14fb30 0x7f655c0bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f656256d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c0a86d0 0x7f655c1ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c14fb30 0x7f655c0bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48016/0 (socket says 172.21.15.26:48016) 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f656256d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c0a86d0 0x7f655c1ecc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:37452/0 (socket says 172.21.15.26:37452) 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 -- 172.21.15.26:0/2424336892 learned_addr learned my addr 172.21.15.26:0/2424336892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6562d6e640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f655c156600 0x7f655c1416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 -- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f655c156600 msgr2=0x7f655c1416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f655c156600 0x7f655c1416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 -- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c0a86d0 msgr2=0x7f655c1ecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c0a86d0 0x7f655c1ecc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 -- 172.21.15.26:0/2424336892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009420 con 0x7f655c14fb30 2023-11-28T16:59:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f656256d640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c0a86d0 0x7f655c1ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6561d6c640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c14fb30 0x7f655c0bf5f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f654c019050 tx=0x7f654c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6552ffd640 1 -- 172.21.15.26:0/2424336892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0b5470 con 0x7f655c14fb30 2023-11-28T16:59:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6552ffd640 1 -- 172.21.15.26:0/2424336892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c0b55f0 con 0x7f655c14fb30 2023-11-28T16:59:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f6552ffd640 1 -- 172.21.15.26:0/2424336892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0b59a0 con 0x7f655c14fb30 2023-11-28T16:59:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c1ed5e0 con 0x7f655c14fb30 2023-11-28T16:59:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c070f20 con 0x7f655c14fb30 2023-11-28T16:59:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.788+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c04e890 con 0x7f655c14fb30 2023-11-28T16:59:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.792+0000 7f6552ffd640 1 -- 172.21.15.26:0/2424336892 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f654c0b2040 con 0x7f655c14fb30 2023-11-28T16:59:06.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.792+0000 7f6552ffd640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65400668d0 0x7f6540068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:06.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.792+0000 7f6552ffd640 1 -- 172.21.15.26:0/2424336892 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f654c11e700 con 0x7f655c14fb30 2023-11-28T16:59:06.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.792+0000 7f656256d640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65400668d0 0x7f6540068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:06.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.792+0000 7f656256d640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65400668d0 0x7f6540068d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f655c070b80 tx=0x7f6558009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.796+0000 7f6552ffd640 1 -- 172.21.15.26:0/2424336892 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f654c0eb9e0 con 0x7f655c14fb30 2023-11-28T16:59:06.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.952+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f655c0c31c0 con 0x7f655c14fb30 2023-11-28T16:59:06.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f6552ffd640 1 -- 172.21.15.26:0/2424336892 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f654c0bc0a0 con 0x7f655c14fb30 2023-11-28T16:59:06.958 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:06.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65400668d0 msgr2=0x7f6540068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65400668d0 0x7f6540068d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f655c070b80 tx=0x7f6558009190 comp rx=0 tx=0).stop 2023-11-28T16:59:06.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c14fb30 msgr2=0x7f655c0bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:06.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c14fb30 0x7f655c0bf5f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f654c019050 tx=0x7f654c0191e0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 shutdown_connections 2023-11-28T16:59:06.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65400668d0 0x7f6540068d90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f655c156600 0x7f655c1416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f655c14fb30 0x7f655c0bf5f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 --2- 172.21.15.26:0/2424336892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c0a86d0 0x7f655c1ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:06.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 >> 172.21.15.26:0/2424336892 conn(0x7f655c0c2a60 msgr2=0x7f655c14eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:06.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 shutdown_connections 2023-11-28T16:59:06.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:06.956+0000 7f65647d1640 1 -- 172.21.15.26:0/2424336892 wait complete. 2023-11-28T16:59:06.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:59:07.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.120+0000 7f6aa889a640 1 Processor -- start 2023-11-28T16:59:07.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.120+0000 7f6aa889a640 1 -- start start 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa889a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6aa4151ee0 0x7f6aa4072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa889a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa889a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6aa406aae0 0x7f6aa40c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa889a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa4072870 con 0x7f6aa4151ee0 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa889a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa41522c0 con 0x7f6aa406aae0 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa889a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4155040 con 0x7f6aa40c1ae0 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6aa4151ee0 0x7f6aa4072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6aa4151ee0 0x7f6aa4072330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48028/0 (socket says 172.21.15.26:48028) 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 -- 172.21.15.26:0/1795138315 learned_addr learned my addr 172.21.15.26:0/1795138315 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6a9bfff640 1 --2- 172.21.15.26:0/1795138315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa2d9d640 1 --2- 172.21.15.26:0/1795138315 >> v2:172.21.15.79:3300/0 conn(0x7f6aa406aae0 0x7f6aa40c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 -- 172.21.15.26:0/1795138315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 msgr2=0x7f6aa406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 --2- 172.21.15.26:0/1795138315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 -- 172.21.15.26:0/1795138315 >> v2:172.21.15.79:3300/0 conn(0x7f6aa406aae0 msgr2=0x7f6aa40c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 --2- 172.21.15.26:0/1795138315 >> v2:172.21.15.79:3300/0 conn(0x7f6aa406aae0 0x7f6aa40c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa259c640 1 -- 172.21.15.26:0/1795138315 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa41555c0 con 0x7f6aa4151ee0 2023-11-28T16:59:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.124+0000 7f6aa2d9d640 1 --2- 172.21.15.26:0/1795138315 >> v2:172.21.15.79:3300/0 conn(0x7f6aa406aae0 0x7f6aa40c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa259c640 1 --2- 172.21.15.26:0/1795138315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa4151ee0 0x7f6aa4072330 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4071190 tx=0x7f6a9401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9031835f04c62c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa1d9b640 1 -- 172.21.15.26:0/1795138315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940ac410 con 0x7f6aa4151ee0 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa1d9b640 1 -- 172.21.15.26:0/1795138315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a940ac570 con 0x7f6aa4151ee0 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa1d9b640 1 -- 172.21.15.26:0/1795138315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940ac900 con 0x7f6aa4151ee0 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 -- 172.21.15.26:0/1795138315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa4151ee0 msgr2=0x7f6aa4072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1795138315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa4151ee0 0x7f6aa4072330 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4071190 tx=0x7f6a9401c470 comp rx=0 tx=0).stop 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 -- 172.21.15.26:0/1795138315 shutdown_connections 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1795138315 >> v2:172.21.15.79:3300/0 conn(0x7f6aa406aae0 0x7f6aa40c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1795138315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1795138315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa4151ee0 0x7f6aa4072330 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 -- 172.21.15.26:0/1795138315 >> 172.21.15.26:0/1795138315 conn(0x7f6aa40c3b70 msgr2=0x7f6aa40c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 -- 172.21.15.26:0/1795138315 shutdown_connections 2023-11-28T16:59:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 -- 172.21.15.26:0/1795138315 wait complete. 2023-11-28T16:59:07.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 Processor -- start 2023-11-28T16:59:07.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.128+0000 7f6aa889a640 1 -- start start 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa406aae0 0x7f6aa40c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa40c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4151ee0 0x7f6aa4147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40c6d80 con 0x7f6aa406aae0 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41571d0 con 0x7f6aa4151ee0 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41574b0 con 0x7f6aa40c1ae0 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa406aae0 0x7f6aa40c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa406aae0 0x7f6aa40c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48042/0 (socket says 172.21.15.26:48042) 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 -- 172.21.15.26:0/1290609326 learned_addr learned my addr 172.21.15.26:0/1290609326 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6a9bfff640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa40c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa2d9d640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4151ee0 0x7f6aa4147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 -- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 msgr2=0x7f6aa40c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa40c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 -- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4151ee0 msgr2=0x7f6aa4147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4151ee0 0x7f6aa4147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 -- 172.21.15.26:0/1290609326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a940094d0 con 0x7f6aa406aae0 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa259c640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa406aae0 0x7f6aa40c6840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6a940af040 tx=0x7f6a94019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6a9affd640 1 -- 172.21.15.26:0/1290609326 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940ac410 con 0x7f6aa406aae0 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6a9affd640 1 -- 172.21.15.26:0/1290609326 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a940b7470 con 0x7f6aa406aae0 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6a9affd640 1 -- 172.21.15.26:0/1290609326 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940b7840 con 0x7f6aa406aae0 2023-11-28T16:59:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa4157790 con 0x7f6aa406aae0 2023-11-28T16:59:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa4156060 con 0x7f6aa406aae0 2023-11-28T16:59:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.132+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa4155be0 con 0x7f6aa406aae0 2023-11-28T16:59:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.136+0000 7f6a9affd640 1 -- 172.21.15.26:0/1290609326 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6a940b3070 con 0x7f6aa406aae0 2023-11-28T16:59:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.136+0000 7f6a9affd640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a84066900 0x7f6a84068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.136+0000 7f6a9affd640 1 -- 172.21.15.26:0/1290609326 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a9411e7c0 con 0x7f6aa406aae0 2023-11-28T16:59:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.136+0000 7f6a9bfff640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a84066900 0x7f6a84068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.136+0000 7f6a9bfff640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a84066900 0x7f6a84068dc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6aa415e1b0 tx=0x7f6a8c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.140+0000 7f6a9affd640 1 -- 172.21.15.26:0/1290609326 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6aa4155be0 con 0x7f6aa406aae0 2023-11-28T16:59:07.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.296+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6aa4155be0 con 0x7f6aa406aae0 2023-11-28T16:59:07.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.296+0000 7f6a9affd640 1 -- 172.21.15.26:0/1290609326 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6aa4155be0 con 0x7f6aa406aae0 2023-11-28T16:59:07.300 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a84066900 msgr2=0x7f6a84068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a84066900 0x7f6a84068dc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6aa415e1b0 tx=0x7f6a8c009190 comp rx=0 tx=0).stop 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa406aae0 msgr2=0x7f6aa40c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa406aae0 0x7f6aa40c6840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6a940af040 tx=0x7f6a94019210 comp rx=0 tx=0).stop 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 shutdown_connections 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4151ee0 0x7f6aa4147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f6a84066900 0x7f6a84068dc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aa40c1ae0 0x7f6aa40c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 --2- 172.21.15.26:0/1290609326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6aa406aae0 0x7f6aa40c6840 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 >> 172.21.15.26:0/1290609326 conn(0x7f6aa40c3b70 msgr2=0x7f6aa4066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:07.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 shutdown_connections 2023-11-28T16:59:07.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.300+0000 7f6aa889a640 1 -- 172.21.15.26:0/1290609326 wait complete. 2023-11-28T16:59:07.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:59:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb081d65640 1 Processor -- start 2023-11-28T16:59:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb081d65640 1 -- start start 2023-11-28T16:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb081d65640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb07c0a8470 0x7fb07c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb081d65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c06de00 con 0x7fb07c0c0370 2023-11-28T16:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb081d65640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c070390 con 0x7fb07c14eaf0 2023-11-28T16:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb081d65640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c14eed0 con 0x7fb07c0a8470 2023-11-28T16:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb07c0c0370 0x7fb07c06d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44930/0 (socket says 172.21.15.26:44930) 2023-11-28T16:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07affd640 1 -- 172.21.15.26:0/152416173 learned_addr learned my addr 172.21.15.26:0/152416173 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07bfff640 1 --2- 172.21.15.26:0/152416173 >> v2:172.21.15.79:3300/0 conn(0x7fb07c0a8470 0x7fb07c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07a7fc640 1 -- 172.21.15.26:0/152416173 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272067189 0 0) 0x7fb07c06de00 con 0x7fb07c0c0370 2023-11-28T16:59:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07a7fc640 1 -- 172.21.15.26:0/152416173 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb064003530 con 0x7fb07c0c0370 2023-11-28T16:59:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07bfff640 1 -- 172.21.15.26:0/152416173 >> v1:172.21.15.79:6789/0 conn(0x7fb07c14eaf0 legacy=0x7fb07c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07bfff640 1 -- 172.21.15.26:0/152416173 >> v1:172.21.15.26:6789/0 conn(0x7fb07c0c0370 legacy=0x7fb07c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.464+0000 7fb07bfff640 1 -- 172.21.15.26:0/152416173 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c151270 con 0x7fb07c0a8470 2023-11-28T16:59:07.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb07bfff640 1 --2- 172.21.15.26:0/152416173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c06d820 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb074009d90 tx=0x7fb07401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4abed30441255e6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb07a7fc640 1 -- 172.21.15.26:0/152416173 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740a58f0 con 0x7fb07c0a8470 2023-11-28T16:59:07.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb07a7fc640 1 -- 172.21.15.26:0/152416173 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740a5a50 con 0x7fb07c0a8470 2023-11-28T16:59:07.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb07a7fc640 1 -- 172.21.15.26:0/152416173 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740a5dc0 con 0x7fb07c0a8470 2023-11-28T16:59:07.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb081d65640 1 -- 172.21.15.26:0/152416173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 msgr2=0x7fb07c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb081d65640 1 --2- 172.21.15.26:0/152416173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c06d820 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb074009d90 tx=0x7fb07401c830 comp rx=0 tx=0).stop 2023-11-28T16:59:07.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb081d65640 1 -- 172.21.15.26:0/152416173 shutdown_connections 2023-11-28T16:59:07.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb081d65640 1 --2- 172.21.15.26:0/152416173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c06d820 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb081d65640 1 -- 172.21.15.26:0/152416173 >> 172.21.15.26:0/152416173 conn(0x7fb07c0c2a60 msgr2=0x7fb07c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:07.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb081d65640 1 -- 172.21.15.26:0/152416173 shutdown_connections 2023-11-28T16:59:07.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.468+0000 7fb081d65640 1 -- 172.21.15.26:0/152416173 wait complete. 2023-11-28T16:59:07.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 Processor -- start 2023-11-28T16:59:07.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 -- start start 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb07c0c0370 0x7fb07c0c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c14eaf0 0x7fb07c0bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0c2810 con 0x7fb07c14eaf0 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0c2270 con 0x7fb07c0a8470 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1f0de0 con 0x7fb07c0c0370 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c14eaf0 0x7fb07c0bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c14eaf0 0x7fb07c0bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48052/0 (socket says 172.21.15.26:48052) 2023-11-28T16:59:07.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 -- 172.21.15.26:0/3761948121 learned_addr learned my addr 172.21.15.26:0/3761948121 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07b7fe640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07affd640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb07c0c0370 0x7fb07c0c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 -- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb07c0c0370 msgr2=0x7fb07c0c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb07c0c0370 0x7fb07c0c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 -- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 msgr2=0x7fb07c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 -- 172.21.15.26:0/3761948121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009a70 con 0x7fb07c14eaf0 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07b7fe640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb07bfff640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c14eaf0 0x7fb07c0bf5f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb074009d90 tx=0x7fb0740195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb063fff640 1 -- 172.21.15.26:0/3761948121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740ad790 con 0x7fb07c14eaf0 2023-11-28T16:59:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb063fff640 1 -- 172.21.15.26:0/3761948121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740ad8f0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb063fff640 1 -- 172.21.15.26:0/3761948121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740adce0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c1f10c0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.472+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0bfb30 con 0x7fb07c14eaf0 2023-11-28T16:59:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.476+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c0c10e0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.476+0000 7fb063fff640 1 -- 172.21.15.26:0/3761948121 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb0740c1460 con 0x7fb07c14eaf0 2023-11-28T16:59:07.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.476+0000 7fb063fff640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0680668d0 0x7fb068068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.476+0000 7fb063fff640 1 -- 172.21.15.26:0/3761948121 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb07411f7d0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.476+0000 7fb07b7fe640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0680668d0 0x7fb068068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.480+0000 7fb07b7fe640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0680668d0 0x7fb068068d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0c5f10 tx=0x7fb06c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.480+0000 7fb063fff640 1 -- 172.21.15.26:0/3761948121 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb07c0c10e0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb07c0c10e0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb063fff640 1 -- 172.21.15.26:0/3761948121 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb07c0c10e0 con 0x7fb07c14eaf0 2023-11-28T16:59:07.644 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0680668d0 msgr2=0x7fb068068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb081d65640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0680668d0 0x7fb068068d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0c5f10 tx=0x7fb06c009040 comp rx=0 tx=0).stop 2023-11-28T16:59:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c14eaf0 msgr2=0x7fb07c0bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb081d65640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c14eaf0 0x7fb07c0bf5f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb074009d90 tx=0x7fb0740195d0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 shutdown_connections 2023-11-28T16:59:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.640+0000 7fb081d65640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c14eaf0 0x7fb07c0bf5f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.644+0000 7fb081d65640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb0680668d0 0x7fb068068d90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.644+0000 7fb081d65640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb07c0c0370 0x7fb07c0c13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.644+0000 7fb081d65640 1 --2- 172.21.15.26:0/3761948121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb07c0a8470 0x7fb07c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.644+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 >> 172.21.15.26:0/3761948121 conn(0x7fb07c0c2a60 msgr2=0x7fb07c0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.644+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 shutdown_connections 2023-11-28T16:59:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.644+0000 7fb081d65640 1 -- 172.21.15.26:0/3761948121 wait complete. 2023-11-28T16:59:07.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T16:59:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.804+0000 7f61ff25f640 1 Processor -- start 2023-11-28T16:59:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.804+0000 7f61ff25f640 1 -- start start 2023-11-28T16:59:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61ff25f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80ca610 0x7f61f80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61ff25f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61f806cd90 0x7f61f80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61ff25f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f8155790 con 0x7f61f80bd720 2023-11-28T16:59:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61ff25f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80c4b00 con 0x7f61f806cd90 2023-11-28T16:59:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61ff25f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80c4de0 con 0x7f61f80ca610 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61fd7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61f806cd90 0x7f61f80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61f7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f61f80bd720 0x7f61f8158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44946/0 (socket says 172.21.15.26:44946) 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61f7fff640 1 -- 172.21.15.26:0/2168790361 learned_addr learned my addr 172.21.15.26:0/2168790361 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61fcffb640 1 --2- 172.21.15.26:0/2168790361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80ca610 0x7f61f80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61fd7fc640 1 -- 172.21.15.26:0/2168790361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80ca610 msgr2=0x7f61f80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61fd7fc640 1 --2- 172.21.15.26:0/2168790361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80ca610 0x7f61f80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61fd7fc640 1 -- 172.21.15.26:0/2168790361 >> v1:172.21.15.26:6789/0 conn(0x7f61f80bd720 legacy=0x7f61f8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61fd7fc640 1 -- 172.21.15.26:0/2168790361 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8157e30 con 0x7f61f806cd90 2023-11-28T16:59:07.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61fd7fc640 1 --2- 172.21.15.26:0/2168790361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f806cd90 0x7f61f80c9a00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009d90 tx=0x7f61f001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f24c93093c14f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.808+0000 7f61f77fe640 1 -- 172.21.15.26:0/2168790361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f80c52d0 con 0x7f61f806cd90 2023-11-28T16:59:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61f77fe640 1 -- 172.21.15.26:0/2168790361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00a4e60 con 0x7f61f806cd90 2023-11-28T16:59:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61f77fe640 1 -- 172.21.15.26:0/2168790361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00ac660 con 0x7f61f806cd90 2023-11-28T16:59:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- 172.21.15.26:0/2168790361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f806cd90 msgr2=0x7f61f80c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 --2- 172.21.15.26:0/2168790361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f806cd90 0x7f61f80c9a00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009d90 tx=0x7f61f001c510 comp rx=0 tx=0).stop 2023-11-28T16:59:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- 172.21.15.26:0/2168790361 shutdown_connections 2023-11-28T16:59:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 --2- 172.21.15.26:0/2168790361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f806cd90 0x7f61f80c9a00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 --2- 172.21.15.26:0/2168790361 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80ca610 0x7f61f80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- 172.21.15.26:0/2168790361 >> 172.21.15.26:0/2168790361 conn(0x7f61f8071ea0 msgr2=0x7f61f80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- 172.21.15.26:0/2168790361 shutdown_connections 2023-11-28T16:59:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- 172.21.15.26:0/2168790361 wait complete. 2023-11-28T16:59:07.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 Processor -- start 2023-11-28T16:59:07.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- start start 2023-11-28T16:59:07.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f806cd90 0x7f61f814bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80bd720 0x7f61f8155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f80ca610 0x7f61f8156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80ac600 con 0x7f61f80ca610 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81f1b90 con 0x7f61f806cd90 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61ff25f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f814c190 con 0x7f61f80bd720 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61fd7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f80ca610 0x7f61f8156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61fd7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f80ca610 0x7f61f8156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48066/0 (socket says 172.21.15.26:48066) 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61fd7fc640 1 -- 172.21.15.26:0/970758932 learned_addr learned my addr 172.21.15.26:0/970758932 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.812+0000 7f61fcffb640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f806cd90 0x7f61f814bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61f7fff640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80bd720 0x7f61f8155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61fd7fc640 1 -- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80bd720 msgr2=0x7f61f8155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61fd7fc640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80bd720 0x7f61f8155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61fd7fc640 1 -- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f806cd90 msgr2=0x7f61f814bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61fd7fc640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f806cd90 0x7f61f814bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61fd7fc640 1 -- 172.21.15.26:0/970758932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0009a70 con 0x7f61f80ca610 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61fcffb640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f806cd90 0x7f61f814bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61fd7fc640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f80ca610 0x7f61f8156510 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f61f00af040 tx=0x7f61f00195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61f57fa640 1 -- 172.21.15.26:0/970758932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0009450 con 0x7f61f80ca610 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61f57fa640 1 -- 172.21.15.26:0/970758932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00a4c60 con 0x7f61f80ca610 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f8156a50 con 0x7f61f80ca610 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61f57fa640 1 -- 172.21.15.26:0/970758932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00b5400 con 0x7f61f80ca610 2023-11-28T16:59:07.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f80ac220 con 0x7f61f80ca610 2023-11-28T16:59:07.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f8149f80 con 0x7f61f80ca610 2023-11-28T16:59:07.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61f57fa640 1 -- 172.21.15.26:0/970758932 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f61f00b3040 con 0x7f61f80ca610 2023-11-28T16:59:07.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61f57fa640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61dc0668d0 0x7f61dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:07.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.816+0000 7f61f57fa640 1 -- 172.21.15.26:0/970758932 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61f80cac00 con 0x7f61f80ca610 2023-11-28T16:59:07.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.820+0000 7f61fcffb640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61dc0668d0 0x7f61dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:07.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.820+0000 7f61fcffb640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61dc0668d0 0x7f61dc068d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009b10 tx=0x7f61ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.824+0000 7f61f57fa640 1 -- 172.21.15.26:0/970758932 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61f014f280 con 0x7f61f80ca610 2023-11-28T16:59:07.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.980+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f61f80ac740 con 0x7f61f80ca610 2023-11-28T16:59:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61f57fa640 1 -- 172.21.15.26:0/970758932 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+209 (secure 0 0 0) 0x7f61f80ac740 con 0x7f61f80ca610 2023-11-28T16:59:07.986 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:07.986 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-11-28T16:59:07.986 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:59:07.987 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-11-28T16:59:07.987 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-11-28T16:59:07.987 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:59:07.987 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:59:07.987 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 12, 2023-11-28T16:59:07.987 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "cephfs_metadata" 2023-11-28T16:59:07.987 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-11-28T16:59:07.988 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-11-28T16:59:07.988 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 13, 2023-11-28T16:59:07.988 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "cephfs_data" 2023-11-28T16:59:07.988 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-11-28T16:59:07.988 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61dc0668d0 msgr2=0x7f61dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61dc0668d0 0x7f61dc068d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009b10 tx=0x7f61ec008040 comp rx=0 tx=0).stop 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f80ca610 msgr2=0x7f61f8156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f80ca610 0x7f61f8156510 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f61f00af040 tx=0x7f61f00195d0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 shutdown_connections 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f80ca610 0x7f61f8156510 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61dc0668d0 0x7f61dc068d90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61f80bd720 0x7f61f8155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 --2- 172.21.15.26:0/970758932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f806cd90 0x7f61f814bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:07.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 >> 172.21.15.26:0/970758932 conn(0x7f61f8071ea0 msgr2=0x7f61f80adc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:07.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 shutdown_connections 2023-11-28T16:59:07.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:07.984+0000 7f61ff25f640 1 -- 172.21.15.26:0/970758932 wait complete. 2023-11-28T16:59:08.007 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-28T16:59:08.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-28T16:59:08.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb6848c9640 1 Processor -- start 2023-11-28T16:59:08.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb6848c9640 1 -- start start 2023-11-28T16:59:08.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb6848c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6800a9770 0x7fb68006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:08.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb6848c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6801569f0 con 0x7fb680155f00 2023-11-28T16:59:08.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb6848c9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6800abb60 con 0x7fb6800c2070 2023-11-28T16:59:08.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb6848c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68006c7a0 con 0x7fb6800a9770 2023-11-28T16:59:08.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67e59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb680155f00 0x7fb6801562e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44948/0 (socket says 172.21.15.26:44948) 2023-11-28T16:59:08.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67e59c640 1 -- 172.21.15.26:0/754423719 learned_addr learned my addr 172.21.15.26:0/754423719 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:08.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67dd9b640 1 --2- 172.21.15.26:0/754423719 >> v2:172.21.15.26:3300/0 conn(0x7fb6800a9770 0x7fb68006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:08.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67d59a640 1 -- 172.21.15.26:0/754423719 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678243653 0 0) 0x7fb670001120 con 0x7fb680155f00 2023-11-28T16:59:08.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67d59a640 1 -- 172.21.15.26:0/754423719 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb668003530 con 0x7fb680155f00 2023-11-28T16:59:08.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67dd9b640 1 -- 172.21.15.26:0/754423719 >> v1:172.21.15.79:6789/0 conn(0x7fb6800c2070 legacy=0x7fb68015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:08.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67dd9b640 1 -- 172.21.15.26:0/754423719 >> v1:172.21.15.26:6789/0 conn(0x7fb680155f00 legacy=0x7fb6801562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:08.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.152+0000 7fb67dd9b640 1 -- 172.21.15.26:0/754423719 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800abdb0 con 0x7fb6800a9770 2023-11-28T16:59:08.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb67dd9b640 1 --2- 172.21.15.26:0/754423719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb68006cf10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb6740097f0 tx=0x7fb67401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bdffb598c92543 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb67d59a640 1 -- 172.21.15.26:0/754423719 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740ab600 con 0x7fb6800a9770 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb67d59a640 1 -- 172.21.15.26:0/754423719 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6740a7050 con 0x7fb6800a9770 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb67d59a640 1 -- 172.21.15.26:0/754423719 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740ab960 con 0x7fb6800a9770 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb6848c9640 1 -- 172.21.15.26:0/754423719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 msgr2=0x7fb68006cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb6848c9640 1 --2- 172.21.15.26:0/754423719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb68006cf10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb6740097f0 tx=0x7fb67401c3f0 comp rx=0 tx=0).stop 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb6848c9640 1 -- 172.21.15.26:0/754423719 shutdown_connections 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb6848c9640 1 --2- 172.21.15.26:0/754423719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb68006cf10 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb6848c9640 1 -- 172.21.15.26:0/754423719 >> 172.21.15.26:0/754423719 conn(0x7fb68006a5a0 msgr2=0x7fb68006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb6848c9640 1 -- 172.21.15.26:0/754423719 shutdown_connections 2023-11-28T16:59:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.156+0000 7fb6848c9640 1 -- 172.21.15.26:0/754423719 wait complete. 2023-11-28T16:59:08.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 Processor -- start 2023-11-28T16:59:08.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 -- start start 2023-11-28T16:59:08.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb680149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:08.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6800c2070 0x7fb6800bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:08.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb680155f00 0x7fb680151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb680153310 con 0x7fb6800a9770 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68014ab50 con 0x7fb6800c2070 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6801515c0 con 0x7fb680155f00 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb680149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb680149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48078/0 (socket says 172.21.15.26:48078) 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 -- 172.21.15.26:0/1525823625 learned_addr learned my addr 172.21.15.26:0/1525823625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67dd9b640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6800c2070 0x7fb6800bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67ed9d640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb680155f00 0x7fb680151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 -- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb680155f00 msgr2=0x7fb680151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb680155f00 0x7fb680151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 -- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6800c2070 msgr2=0x7fb6800bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6800c2070 0x7fb6800bf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 -- 172.21.15.26:0/1525823625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674009420 con 0x7fb6800a9770 2023-11-28T16:59:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67ed9d640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb680155f00 0x7fb680151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67dd9b640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6800c2070 0x7fb6800bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb67e59c640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb680149700 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c4d0 tx=0x7fb67000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb66effd640 1 -- 172.21.15.26:0/1525823625 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670005cf0 con 0x7fb6800a9770 2023-11-28T16:59:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb66effd640 1 -- 172.21.15.26:0/1525823625 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670005e50 con 0x7fb6800a9770 2023-11-28T16:59:08.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb680153030 con 0x7fb6800a9770 2023-11-28T16:59:08.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb66effd640 1 -- 172.21.15.26:0/1525823625 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670007290 con 0x7fb6800a9770 2023-11-28T16:59:08.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.160+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6801ee2d0 con 0x7fb6800a9770 2023-11-28T16:59:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.164+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6801ede50 con 0x7fb6800a9770 2023-11-28T16:59:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.164+0000 7fb66effd640 1 -- 172.21.15.26:0/1525823625 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb6700073f0 con 0x7fb6800a9770 2023-11-28T16:59:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.164+0000 7fb66effd640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb660066900 0x7fb660068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.164+0000 7fb66effd640 1 -- 172.21.15.26:0/1525823625 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6700838d0 con 0x7fb6800a9770 2023-11-28T16:59:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.164+0000 7fb67dd9b640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb660066900 0x7fb660068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.164+0000 7fb67dd9b640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb660066900 0x7fb660068dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb6740ad000 tx=0x7fb6740a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:08.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.168+0000 7fb66effd640 1 -- 172.21.15.26:0/1525823625 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6801ede50 con 0x7fb6800a9770 2023-11-28T16:59:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:08.332+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb6801569f0 con 0x7fb6800a9770 2023-11-28T16:59:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.316+0000 7fb66effd640 1 -- 172.21.15.26:0/1525823625 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v70) v1 ==== 140+0+0 (secure 0 0 0) 0x7fb6801569f0 con 0x7fb6800a9770 2023-11-28T16:59:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_metadata' created 2023-11-28T16:59:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb660066900 msgr2=0x7fb660068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb660066900 0x7fb660068dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb6740ad000 tx=0x7fb6740a4f90 comp rx=0 tx=0).stop 2023-11-28T16:59:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 msgr2=0x7fb680149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb680149700 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c4d0 tx=0x7fb67000c990 comp rx=0 tx=0).stop 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 shutdown_connections 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb660066900 0x7fb660068dc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb680155f00 0x7fb680151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6800c2070 0x7fb6800bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 --2- 172.21.15.26:0/1525823625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6800a9770 0x7fb680149700 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 >> 172.21.15.26:0/1525823625 conn(0x7fb68006a5a0 msgr2=0x7fb6800c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 shutdown_connections 2023-11-28T16:59:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.320+0000 7fb6848c9640 1 -- 172.21.15.26:0/1525823625 wait complete. 2023-11-28T16:59:09.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T16:59:09.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f8560101640 1 Processor -- start 2023-11-28T16:59:09.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f8560101640 1 -- start start 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f8560101640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85580c0370 0x7f855806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f8560101640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855806de00 con 0x7f855814eaf0 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f8560101640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8558070390 con 0x7f85580a8470 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f8560101640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855814eed0 con 0x7f85580c0370 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855de9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f855814eaf0 0x7f8558151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44964/0 (socket says 172.21.15.26:44964) 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855de9d640 1 -- 172.21.15.26:0/1649953301 learned_addr learned my addr 172.21.15.26:0/1649953301 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855d69c640 1 --2- 172.21.15.26:0/1649953301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85580c0370 0x7f855806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901008503 0 0) 0x7f855806de00 con 0x7f855814eaf0 2023-11-28T16:59:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8544005740 con 0x7f855814eaf0 2023-11-28T16:59:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486088187 0 0) 0x7f8558070390 con 0x7f85580a8470 2023-11-28T16:59:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f855806de00 con 0x7f85580a8470 2023-11-28T16:59:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855d69c640 1 -- 172.21.15.26:0/1649953301 >> v1:172.21.15.79:6789/0 conn(0x7f85580a8470 legacy=0x7f855806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2566569409 0 0) 0x7f8544005740 con 0x7f855814eaf0 2023-11-28T16:59:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855d69c640 1 -- 172.21.15.26:0/1649953301 >> v1:172.21.15.26:6789/0 conn(0x7f855814eaf0 legacy=0x7f8558151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.504+0000 7f855d69c640 1 -- 172.21.15.26:0/1649953301 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558151270 con 0x7f85580c0370 2023-11-28T16:59:09.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f855d69c640 1 --2- 172.21.15.26:0/1649953301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85580c0370 0x7f855806d110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f85480097f0 tx=0x7f854801c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=281cc341503b603b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:09.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554001680 con 0x7f85580c0370 2023-11-28T16:59:09.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85480a7050 con 0x7f85580c0370 2023-11-28T16:59:09.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f855ce9b640 1 -- 172.21.15.26:0/1649953301 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480ab620 con 0x7f85580c0370 2023-11-28T16:59:09.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f8560101640 1 -- 172.21.15.26:0/1649953301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85580c0370 msgr2=0x7f855806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:09.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f8560101640 1 --2- 172.21.15.26:0/1649953301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85580c0370 0x7f855806d110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f85480097f0 tx=0x7f854801c2c0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f8560101640 1 -- 172.21.15.26:0/1649953301 shutdown_connections 2023-11-28T16:59:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f8560101640 1 --2- 172.21.15.26:0/1649953301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85580c0370 0x7f855806d110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f8560101640 1 -- 172.21.15.26:0/1649953301 >> 172.21.15.26:0/1649953301 conn(0x7f85580c2a60 msgr2=0x7f85580c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f8560101640 1 -- 172.21.15.26:0/1649953301 shutdown_connections 2023-11-28T16:59:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.508+0000 7f8560101640 1 -- 172.21.15.26:0/1649953301 wait complete. 2023-11-28T16:59:09.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 Processor -- start 2023-11-28T16:59:09.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 -- start start 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580a8470 0x7f85580c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85580c0370 0x7f85580bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855814eaf0 0x7f85581417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580c3b50 con 0x7f85580a8470 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855814d5d0 con 0x7f85580c0370 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580c1e70 con 0x7f855814eaf0 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580a8470 0x7f85580c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:09.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580a8470 0x7f85580c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48088/0 (socket says 172.21.15.26:48088) 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 -- 172.21.15.26:0/734541790 learned_addr learned my addr 172.21.15.26:0/734541790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 -- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855814eaf0 msgr2=0x7f85581417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855814eaf0 0x7f85581417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 -- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85580c0370 msgr2=0x7f85580bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85580c0370 0x7f85580bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 -- 172.21.15.26:0/734541790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009420 con 0x7f85580a8470 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f855de9d640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580a8470 0x7f85580c1930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f855400c750 tx=0x7f855400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f854e7fc640 1 -- 172.21.15.26:0/734541790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554005ae0 con 0x7f85580a8470 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f854e7fc640 1 -- 172.21.15.26:0/734541790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8554005c40 con 0x7f85580a8470 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f854e7fc640 1 -- 172.21.15.26:0/734541790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554007070 con 0x7f85580a8470 2023-11-28T16:59:09.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85580c3da0 con 0x7f85580a8470 2023-11-28T16:59:09.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.512+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85580c0ef0 con 0x7f85580a8470 2023-11-28T16:59:09.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.516+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85580c0d50 con 0x7f85580a8470 2023-11-28T16:59:09.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.516+0000 7f854e7fc640 1 -- 172.21.15.26:0/734541790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f85540071d0 con 0x7f85580a8470 2023-11-28T16:59:09.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.516+0000 7f854e7fc640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f853c0668d0 0x7f853c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:09.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.516+0000 7f854e7fc640 1 -- 172.21.15.26:0/734541790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f8554084c10 con 0x7f85580a8470 2023-11-28T16:59:09.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.516+0000 7f855d69c640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f853c0668d0 0x7f853c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:09.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.516+0000 7f855d69c640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f853c0668d0 0x7f853c068d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f85480ad000 tx=0x7f8548008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:09.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.520+0000 7f854e7fc640 1 -- 172.21.15.26:0/734541790 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8554051d70 con 0x7f85580a8470 2023-11-28T16:59:09.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:09.680+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f85580c0d50 con 0x7f85580a8470 2023-11-28T16:59:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.324+0000 7f854e7fc640 1 -- 172.21.15.26:0/734541790 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v71) v1 ==== 172+0+0 (secure 0 0 0) 0x7f85580c0d50 con 0x7f85580a8470 2023-11-28T16:59:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_data' created 2023-11-28T16:59:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f853c0668d0 msgr2=0x7f853c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f853c0668d0 0x7f853c068d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f85480ad000 tx=0x7f8548008040 comp rx=0 tx=0).stop 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580a8470 msgr2=0x7f85580c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580a8470 0x7f85580c1930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f855400c750 tx=0x7f855400cc10 comp rx=0 tx=0).stop 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 shutdown_connections 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f853c0668d0 0x7f853c068d90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855814eaf0 0x7f85581417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85580c0370 0x7f85580bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 --2- 172.21.15.26:0/734541790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580a8470 0x7f85580c1930 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.328+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 >> 172.21.15.26:0/734541790 conn(0x7f85580c2a60 msgr2=0x7f855814fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.332+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 shutdown_connections 2023-11-28T16:59:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.332+0000 7f8560101640 1 -- 172.21.15.26:0/734541790 wait complete. 2023-11-28T16:59:10.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-28T16:59:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.516+0000 7f3400ff5640 1 Processor -- start 2023-11-28T16:59:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.516+0000 7f3400ff5640 1 -- start start 2023-11-28T16:59:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.516+0000 7f3400ff5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33fc0a86d0 0x7f33fc0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.516+0000 7f3400ff5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33fc156600 0x7f33fc14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.516+0000 7f3400ff5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc152d90 con 0x7f33fc14fb30 2023-11-28T16:59:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.516+0000 7f3400ff5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc14ffa0 con 0x7f33fc156600 2023-11-28T16:59:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.516+0000 7f3400ff5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc152480 con 0x7f33fc0a86d0 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33fc156600 0x7f33fc14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33fc156600 0x7f33fc14f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48104/0 (socket says 172.21.15.26:48104) 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 -- 172.21.15.26:0/256651052 learned_addr learned my addr 172.21.15.26:0/256651052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33fa59c640 1 --2- 172.21.15.26:0/256651052 >> v2:172.21.15.79:3300/0 conn(0x7f33fc0a86d0 0x7f33fc0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 -- 172.21.15.26:0/256651052 >> v2:172.21.15.79:3300/0 conn(0x7f33fc0a86d0 msgr2=0x7f33fc0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 --2- 172.21.15.26:0/256651052 >> v2:172.21.15.79:3300/0 conn(0x7f33fc0a86d0 0x7f33fc0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 -- 172.21.15.26:0/256651052 >> v1:172.21.15.79:6789/0 conn(0x7f33fc14fb30 legacy=0x7f33fc0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 -- 172.21.15.26:0/256651052 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc0a9760 con 0x7f33fc156600 2023-11-28T16:59:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f3fff640 1 --2- 172.21.15.26:0/256651052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc156600 0x7f33fc14f5f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009870 tx=0x7f33e401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e03c57d1b26af38 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f9d9b640 1 -- 172.21.15.26:0/256651052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40ab5f0 con 0x7f33fc156600 2023-11-28T16:59:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f9d9b640 1 -- 172.21.15.26:0/256651052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e40ab750 con 0x7f33fc156600 2023-11-28T16:59:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.520+0000 7f33f9d9b640 1 -- 172.21.15.26:0/256651052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40abae0 con 0x7f33fc156600 2023-11-28T16:59:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- 172.21.15.26:0/256651052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc156600 msgr2=0x7f33fc14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 --2- 172.21.15.26:0/256651052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc156600 0x7f33fc14f5f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009870 tx=0x7f33e401c500 comp rx=0 tx=0).stop 2023-11-28T16:59:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- 172.21.15.26:0/256651052 shutdown_connections 2023-11-28T16:59:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 --2- 172.21.15.26:0/256651052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc156600 0x7f33fc14f5f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 --2- 172.21.15.26:0/256651052 >> v2:172.21.15.79:3300/0 conn(0x7f33fc0a86d0 0x7f33fc0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- 172.21.15.26:0/256651052 >> 172.21.15.26:0/256651052 conn(0x7f33fc0c2a60 msgr2=0x7f33fc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- 172.21.15.26:0/256651052 shutdown_connections 2023-11-28T16:59:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- 172.21.15.26:0/256651052 wait complete. 2023-11-28T16:59:10.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 Processor -- start 2023-11-28T16:59:10.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- start start 2023-11-28T16:59:10.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33fc0a86d0 0x7f33fc1ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc14fb30 0x7f33fc14dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33fc156600 0x7f33fc1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1edd30 con 0x7f33fc14fb30 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc149740 con 0x7f33fc0a86d0 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f3400ff5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc14afc0 con 0x7f33fc156600 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc14fb30 0x7f33fc14dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc14fb30 0x7f33fc14dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48106/0 (socket says 172.21.15.26:48106) 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 -- 172.21.15.26:0/2228457378 learned_addr learned my addr 172.21.15.26:0/2228457378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33fa59c640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33fc0a86d0 0x7f33fc1ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33fad9d640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33fc156600 0x7f33fc1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 -- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33fc156600 msgr2=0x7f33fc1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33fc156600 0x7f33fc1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 -- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33fc0a86d0 msgr2=0x7f33fc1ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33fc0a86d0 0x7f33fc1ed7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33f3fff640 1 -- 172.21.15.26:0/2228457378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40094d0 con 0x7f33fc14fb30 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.524+0000 7f33fad9d640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33fc156600 0x7f33fc1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f33f3fff640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc14fb30 0x7f33fc14dc30 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f33e40ad040 tx=0x7f33e40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f33f2ffd640 1 -- 172.21.15.26:0/2228457378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b5810 con 0x7f33fc14fb30 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f33f2ffd640 1 -- 172.21.15.26:0/2228457378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e40b5990 con 0x7f33fc14fb30 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc14b2a0 con 0x7f33fc14fb30 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f33f2ffd640 1 -- 172.21.15.26:0/2228457378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b5d40 con 0x7f33fc14fb30 2023-11-28T16:59:10.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc154ae0 con 0x7f33fc14fb30 2023-11-28T16:59:10.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc04e890 con 0x7f33fc14fb30 2023-11-28T16:59:10.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f33f2ffd640 1 -- 172.21.15.26:0/2228457378 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f33e40c83f0 con 0x7f33fc14fb30 2023-11-28T16:59:10.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f33f2ffd640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33dc0668d0 0x7f33dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:10.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.528+0000 7f33f2ffd640 1 -- 172.21.15.26:0/2228457378 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f33e40a8050 con 0x7f33fc14fb30 2023-11-28T16:59:10.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.532+0000 7f33fa59c640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33dc0668d0 0x7f33dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:10.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.532+0000 7f33fa59c640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33dc0668d0 0x7f33dc068d90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b930 tx=0x7f33ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:10.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.536+0000 7f33f2ffd640 1 -- 172.21.15.26:0/2228457378 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33e40ec390 con 0x7f33fc14fb30 2023-11-28T16:59:10.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:10.724+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f33fc0c1430 con 0x7f33fc14fb30 2023-11-28T16:59:11.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f33f2ffd640 1 -- 172.21.15.26:0/2228457378 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v48) v1 ==== 177+0+0 (secure 0 0 0) 0x7f33e40ef9b0 con 0x7f33fc14fb30 2023-11-28T16:59:11.331 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 14 and data pool 15 2023-11-28T16:59:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33dc0668d0 msgr2=0x7f33dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33dc0668d0 0x7f33dc068d90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b930 tx=0x7f33ec008040 comp rx=0 tx=0).stop 2023-11-28T16:59:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc14fb30 msgr2=0x7f33fc14dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc14fb30 0x7f33fc14dc30 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f33e40ad040 tx=0x7f33e40192a0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 shutdown_connections 2023-11-28T16:59:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33dc0668d0 0x7f33dc068d90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33fc156600 0x7f33fc1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33fc14fb30 0x7f33fc14dc30 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 --2- 172.21.15.26:0/2228457378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33fc0a86d0 0x7f33fc1ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 >> 172.21.15.26:0/2228457378 conn(0x7f33fc0c2a60 msgr2=0x7f33fc0c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 shutdown_connections 2023-11-28T16:59:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.328+0000 7f3400ff5640 1 -- 172.21.15.26:0/2228457378 wait complete. 2023-11-28T16:59:11.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:11.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572e9d1640 1 Processor -- start 2023-11-28T16:59:11.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572e9d1640 1 -- start start 2023-11-28T16:59:11.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572e9d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57280ca610 0x7f57280c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572e9d1640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5728155790 con 0x7f572806cd90 2023-11-28T16:59:11.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572e9d1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280c4b00 con 0x7f57280bd720 2023-11-28T16:59:11.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572e9d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57280c4de0 con 0x7f57280ca610 2023-11-28T16:59:11.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572cf6e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f572806cd90 0x7f57280c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41046/0 (socket says 172.21.15.26:41046) 2023-11-28T16:59:11.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f572cf6e640 1 -- 172.21.15.26:0/1061856795 learned_addr learned my addr 172.21.15.26:0/1061856795 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:11.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5727fff640 1 --2- 172.21.15.26:0/1061856795 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57280ca610 0x7f57280c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191231505 0 0) 0x7f5728155790 con 0x7f572806cd90 2023-11-28T16:59:11.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5710003530 con 0x7f572806cd90 2023-11-28T16:59:11.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618386319 0 0) 0x7f57280c4b00 con 0x7f57280bd720 2023-11-28T16:59:11.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5728155790 con 0x7f57280bd720 2023-11-28T16:59:11.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5727fff640 1 -- 172.21.15.26:0/1061856795 >> v1:172.21.15.79:6789/0 conn(0x7f57280bd720 legacy=0x7f5728158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5727fff640 1 -- 172.21.15.26:0/1061856795 >> v1:172.21.15.26:6789/0 conn(0x7f572806cd90 legacy=0x7f57280c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595735017 0 0) 0x7f5710003530 con 0x7f572806cd90 2023-11-28T16:59:11.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.528+0000 7f5727fff640 1 -- 172.21.15.26:0/1061856795 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728157e30 con 0x7f57280ca610 2023-11-28T16:59:11.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f5727fff640 1 --2- 172.21.15.26:0/1061856795 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57280ca610 0x7f57280c94c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f57180097f0 tx=0x7f571801bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f093a79f1991fd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:11.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280c52d0 con 0x7f57280ca610 2023-11-28T16:59:11.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57180a5460 con 0x7f57280ca610 2023-11-28T16:59:11.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f5726ffd640 1 -- 172.21.15.26:0/1061856795 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720001a00 con 0x7f57280ca610 2023-11-28T16:59:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f572e9d1640 1 -- 172.21.15.26:0/1061856795 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57280ca610 msgr2=0x7f57280c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f572e9d1640 1 --2- 172.21.15.26:0/1061856795 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57280ca610 0x7f57280c94c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f57180097f0 tx=0x7f571801bfa0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f572e9d1640 1 -- 172.21.15.26:0/1061856795 shutdown_connections 2023-11-28T16:59:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f572e9d1640 1 --2- 172.21.15.26:0/1061856795 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57280ca610 0x7f57280c94c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.532+0000 7f572e9d1640 1 -- 172.21.15.26:0/1061856795 >> 172.21.15.26:0/1061856795 conn(0x7f5728071ea0 msgr2=0x7f57280722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 -- 172.21.15.26:0/1061856795 shutdown_connections 2023-11-28T16:59:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 -- 172.21.15.26:0/1061856795 wait complete. 2023-11-28T16:59:11.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 Processor -- start 2023-11-28T16:59:11.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 -- start start 2023-11-28T16:59:11.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f572806cd90 0x7f5728151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57280bd720 0x7f5728145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57280ca610 0x7f57281508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57281480a0 con 0x7f57280ca610 2023-11-28T16:59:11.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280a9c00 con 0x7f57280bd720 2023-11-28T16:59:11.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572e9d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5728154ba0 con 0x7f572806cd90 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57280ca610 0x7f57281508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57280ca610 0x7f57281508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36796/0 (socket says 172.21.15.26:36796) 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 -- 172.21.15.26:0/4150943605 learned_addr learned my addr 172.21.15.26:0/4150943605 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f5727fff640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f572806cd90 0x7f5728151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f57277fe640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57280bd720 0x7f5728145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 -- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f572806cd90 msgr2=0x7f5728151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f572806cd90 0x7f5728151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 -- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57280bd720 msgr2=0x7f5728145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57280bd720 0x7f5728145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 -- 172.21.15.26:0/4150943605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009420 con 0x7f57280ca610 2023-11-28T16:59:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f572cf6e640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57280ca610 0x7f57281508a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5720001f70 tx=0x7f572000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.536+0000 7f5724ff9640 1 -- 172.21.15.26:0/4150943605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720012400 con 0x7f57280ca610 2023-11-28T16:59:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f5724ff9640 1 -- 172.21.15.26:0/4150943605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720012560 con 0x7f57280ca610 2023-11-28T16:59:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f5724ff9640 1 -- 172.21.15.26:0/4150943605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720012910 con 0x7f57280ca610 2023-11-28T16:59:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5728155090 con 0x7f57280ca610 2023-11-28T16:59:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5728154db0 con 0x7f57280ca610 2023-11-28T16:59:11.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572804e890 con 0x7f57280ca610 2023-11-28T16:59:11.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f5724ff9640 1 -- 172.21.15.26:0/4150943605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5720012a70 con 0x7f57280ca610 2023-11-28T16:59:11.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f5724ff9640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57140668d0 0x7f5714068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f5724ff9640 1 -- 172.21.15.26:0/4150943605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5720085960 con 0x7f57280ca610 2023-11-28T16:59:11.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.540+0000 7f5727fff640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57140668d0 0x7f5714068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.544+0000 7f5727fff640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57140668d0 0x7f5714068d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57180ad000 tx=0x7f57180a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:11.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.544+0000 7f5724ff9640 1 -- 172.21.15.26:0/4150943605 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57200528d0 con 0x7f57280ca610 2023-11-28T16:59:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.700+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f572806cb70 con 0x7f57280ca610 2023-11-28T16:59:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f5724ff9640 1 -- 172.21.15.26:0/4150943605 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f5720055ef0 con 0x7f57280ca610 2023-11-28T16:59:11.707 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:11.707 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":72,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:10.726169+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57140668d0 msgr2=0x7f5714068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57140668d0 0x7f5714068d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57180ad000 tx=0x7f57180a6000 comp rx=0 tx=0).stop 2023-11-28T16:59:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57280ca610 msgr2=0x7f57281508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57280ca610 0x7f57281508a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5720001f70 tx=0x7f572000a430 comp rx=0 tx=0).stop 2023-11-28T16:59:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 shutdown_connections 2023-11-28T16:59:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57280ca610 0x7f57281508a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57280bd720 0x7f5728145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f57140668d0 0x7f5714068d90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 --2- 172.21.15.26:0/4150943605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f572806cd90 0x7f5728151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 >> 172.21.15.26:0/4150943605 conn(0x7f5728071ea0 msgr2=0x7f5728158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 shutdown_connections 2023-11-28T16:59:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.704+0000 7f572e9d1640 1 -- 172.21.15.26:0/4150943605 wait complete. 2023-11-28T16:59:11.729 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:11.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 Processor -- start 2023-11-28T16:59:11.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 -- start start 2023-11-28T16:59:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c9c14e9d0 0x7f4c9c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c9c070b80 0x7f4c9c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c06d320 con 0x7f4c9c14e9d0 2023-11-28T16:59:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c0721b0 con 0x7f4c9c070b80 2023-11-28T16:59:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca2faa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0c2830 con 0x7f4c9c0c1f20 2023-11-28T16:59:11.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c9c14e9d0 0x7f4c9c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c9c14e9d0 0x7f4c9c151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36806/0 (socket says 172.21.15.26:36806) 2023-11-28T16:59:11.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 -- 172.21.15.26:0/505880713 learned_addr learned my addr 172.21.15.26:0/505880713 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:11.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca1547640 1 --2- 172.21.15.26:0/505880713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4c9bfff640 1 --2- 172.21.15.26:0/505880713 >> v2:172.21.15.79:3300/0 conn(0x7f4c9c070b80 0x7f4c9c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 -- 172.21.15.26:0/505880713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 msgr2=0x7f4c9c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:11.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 --2- 172.21.15.26:0/505880713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 -- 172.21.15.26:0/505880713 >> v2:172.21.15.79:3300/0 conn(0x7f4c9c070b80 msgr2=0x7f4c9c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:11.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 --2- 172.21.15.26:0/505880713 >> v2:172.21.15.79:3300/0 conn(0x7f4c9c070b80 0x7f4c9c0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.868+0000 7f4ca0d46640 1 -- 172.21.15.26:0/505880713 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c072450 con 0x7f4c9c14e9d0 2023-11-28T16:59:11.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca0d46640 1 --2- 172.21.15.26:0/505880713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c14e9d0 0x7f4c9c151e60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c06e420 tx=0x7f4c9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc640dec28191c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:11.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4c9b7fe640 1 -- 172.21.15.26:0/505880713 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900ab600 con 0x7f4c9c14e9d0 2023-11-28T16:59:11.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4c9b7fe640 1 -- 172.21.15.26:0/505880713 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c900a7050 con 0x7f4c9c14e9d0 2023-11-28T16:59:11.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4c9b7fe640 1 -- 172.21.15.26:0/505880713 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900ab980 con 0x7f4c9c14e9d0 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 -- 172.21.15.26:0/505880713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c14e9d0 msgr2=0x7f4c9c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/505880713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c14e9d0 0x7f4c9c151e60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c06e420 tx=0x7f4c9001c470 comp rx=0 tx=0).stop 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 -- 172.21.15.26:0/505880713 shutdown_connections 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/505880713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/505880713 >> v2:172.21.15.79:3300/0 conn(0x7f4c9c070b80 0x7f4c9c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/505880713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c14e9d0 0x7f4c9c151e60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 -- 172.21.15.26:0/505880713 >> 172.21.15.26:0/505880713 conn(0x7f4c9c0c2ad0 msgr2=0x7f4c9c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 -- 172.21.15.26:0/505880713 shutdown_connections 2023-11-28T16:59:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.872+0000 7f4ca2faa640 1 -- 172.21.15.26:0/505880713 wait complete. 2023-11-28T16:59:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 Processor -- start 2023-11-28T16:59:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 -- start start 2023-11-28T16:59:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c070b80 0x7f4c9c0ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c9c14e9d0 0x7f4c9c147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c153f70 con 0x7f4c9c070b80 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0c56e0 con 0x7f4c9c14e9d0 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c148450 con 0x7f4c9c0c1f20 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c070b80 0x7f4c9c0ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c070b80 0x7f4c9c0ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36820/0 (socket says 172.21.15.26:36820) 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 -- 172.21.15.26:0/2969997399 learned_addr learned my addr 172.21.15.26:0/2969997399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4c9bfff640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca1547640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c9c14e9d0 0x7f4c9c147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 -- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 msgr2=0x7f4c9c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c1479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 -- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c9c14e9d0 msgr2=0x7f4c9c147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c9c14e9d0 0x7f4c9c147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 -- 172.21.15.26:0/2969997399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900094d0 con 0x7f4c9c070b80 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca0d46640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c070b80 0x7f4c9c0ab750 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4c9001c950 tx=0x7f4c90019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4c997fa640 1 -- 172.21.15.26:0/2969997399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900b6440 con 0x7f4c9c070b80 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4c997fa640 1 -- 172.21.15.26:0/2969997399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c900b65a0 con 0x7f4c9c070b80 2023-11-28T16:59:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4c997fa640 1 -- 172.21.15.26:0/2969997399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900b6910 con 0x7f4c9c070b80 2023-11-28T16:59:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.876+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c1f17e0 con 0x7f4c9c070b80 2023-11-28T16:59:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.880+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c154460 con 0x7f4c9c070b80 2023-11-28T16:59:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.880+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c1ed5a0 con 0x7f4c9c070b80 2023-11-28T16:59:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.880+0000 7f4c997fa640 1 -- 172.21.15.26:0/2969997399 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4c900b2040 con 0x7f4c9c070b80 2023-11-28T16:59:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.880+0000 7f4c997fa640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c800668d0 0x7f4c80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.880+0000 7f4c997fa640 1 -- 172.21.15.26:0/2969997399 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4c9011e5d0 con 0x7f4c9c070b80 2023-11-28T16:59:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.880+0000 7f4c9bfff640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c800668d0 0x7f4c80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.880+0000 7f4c9bfff640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c800668d0 0x7f4c80068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c1eb370 tx=0x7f4c88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:11.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:11.884+0000 7f4c997fa640 1 -- 172.21.15.26:0/2969997399 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c9c1ed5a0 con 0x7f4c9c070b80 2023-11-28T16:59:12.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.044+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c9c1ed5a0 con 0x7f4c9c070b80 2023-11-28T16:59:12.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.044+0000 7f4c997fa640 1 -- 172.21.15.26:0/2969997399 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f4c9c1ed5a0 con 0x7f4c9c070b80 2023-11-28T16:59:12.049 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:12.049 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":72,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:10.726169+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c800668d0 msgr2=0x7f4c80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c800668d0 0x7f4c80068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c1eb370 tx=0x7f4c88008040 comp rx=0 tx=0).stop 2023-11-28T16:59:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c070b80 msgr2=0x7f4c9c0ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c070b80 0x7f4c9c0ab750 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4c9001c950 tx=0x7f4c90019210 comp rx=0 tx=0).stop 2023-11-28T16:59:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 shutdown_connections 2023-11-28T16:59:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c9c14e9d0 0x7f4c9c147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4c800668d0 0x7f4c80068d90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c9c0c1f20 0x7f4c9c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 --2- 172.21.15.26:0/2969997399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c070b80 0x7f4c9c0ab750 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 >> 172.21.15.26:0/2969997399 conn(0x7f4c9c0c2ad0 msgr2=0x7f4c9c14dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 shutdown_connections 2023-11-28T16:59:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.048+0000 7f4ca2faa640 1 -- 172.21.15.26:0/2969997399 wait complete. 2023-11-28T16:59:12.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-28T16:59:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.212+0000 7f397e09c640 1 Processor -- start 2023-11-28T16:59:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.212+0000 7f397e09c640 1 -- start start 2023-11-28T16:59:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f397e09c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f397814eaf0 0x7f3978151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f397e09c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39780c0370 0x7f397806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f397e09c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397806de00 con 0x7f3978151f90 2023-11-28T16:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f397e09c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3978070390 con 0x7f397814eaf0 2023-11-28T16:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f397e09c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397814eed0 con 0x7f39780c0370 2023-11-28T16:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f39777fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f397814eaf0 0x7f3978151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f39777fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f397814eaf0 0x7f3978151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36832/0 (socket says 172.21.15.26:36832) 2023-11-28T16:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f39777fe640 1 -- 172.21.15.26:0/2706592421 learned_addr learned my addr 172.21.15.26:0/2706592421 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f3977fff640 1 --2- 172.21.15.26:0/2706592421 >> v2:172.21.15.79:3300/0 conn(0x7f39780c0370 0x7f397806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f39777fe640 1 -- 172.21.15.26:0/2706592421 >> v2:172.21.15.79:3300/0 conn(0x7f39780c0370 msgr2=0x7f397806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f39777fe640 1 --2- 172.21.15.26:0/2706592421 >> v2:172.21.15.79:3300/0 conn(0x7f39780c0370 0x7f397806d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f39777fe640 1 -- 172.21.15.26:0/2706592421 >> v1:172.21.15.79:6789/0 conn(0x7f3978151f90 legacy=0x7f397806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f39777fe640 1 -- 172.21.15.26:0/2706592421 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978151270 con 0x7f397814eaf0 2023-11-28T16:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.216+0000 7f3977fff640 1 --2- 172.21.15.26:0/2706592421 >> v2:172.21.15.79:3300/0 conn(0x7f39780c0370 0x7f397806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f39777fe640 1 --2- 172.21.15.26:0/2706592421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978151a50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3978066cc0 tx=0x7f396801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdb3a25442157da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f39767fc640 1 -- 172.21.15.26:0/2706592421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39680ab600 con 0x7f397814eaf0 2023-11-28T16:59:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f39767fc640 1 -- 172.21.15.26:0/2706592421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39680a7050 con 0x7f397814eaf0 2023-11-28T16:59:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f39767fc640 1 -- 172.21.15.26:0/2706592421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39680ab980 con 0x7f397814eaf0 2023-11-28T16:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 -- 172.21.15.26:0/2706592421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 msgr2=0x7f3978151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 --2- 172.21.15.26:0/2706592421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978151a50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3978066cc0 tx=0x7f396801c370 comp rx=0 tx=0).stop 2023-11-28T16:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 -- 172.21.15.26:0/2706592421 shutdown_connections 2023-11-28T16:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 --2- 172.21.15.26:0/2706592421 >> v2:172.21.15.79:3300/0 conn(0x7f39780c0370 0x7f397806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 --2- 172.21.15.26:0/2706592421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978151a50 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 -- 172.21.15.26:0/2706592421 >> 172.21.15.26:0/2706592421 conn(0x7f39780c2a60 msgr2=0x7f39780c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 -- 172.21.15.26:0/2706592421 shutdown_connections 2023-11-28T16:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 -- 172.21.15.26:0/2706592421 wait complete. 2023-11-28T16:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 Processor -- start 2023-11-28T16:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 -- start start 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39780c0370 0x7f397813e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3978142920 0x7f397813b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.220+0000 7f397e09c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39780c1270 con 0x7f397814eaf0 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f397e09c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39780c1e60 con 0x7f39780c0370 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f397e09c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39780c1b80 con 0x7f3978142920 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36840/0 (socket says 172.21.15.26:36840) 2023-11-28T16:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 -- 172.21.15.26:0/3315023313 learned_addr learned my addr 172.21.15.26:0/3315023313 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:12.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3977fff640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3978142920 0x7f397813b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:12.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f39777fe640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39780c0370 0x7f397813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 -- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3978142920 msgr2=0x7f397813b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3978142920 0x7f397813b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 -- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39780c0370 msgr2=0x7f397813e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39780c0370 0x7f397813e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 -- 172.21.15.26:0/3315023313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680094d0 con 0x7f397814eaf0 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f3976ffd640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978144130 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f396c00b410 tx=0x7f396c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f395ffff640 1 -- 172.21.15.26:0/3315023313 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c004020 con 0x7f397814eaf0 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f395ffff640 1 -- 172.21.15.26:0/3315023313 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c004180 con 0x7f397814eaf0 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f395ffff640 1 -- 172.21.15.26:0/3315023313 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c011630 con 0x7f397814eaf0 2023-11-28T16:59:12.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397814a900 con 0x7f397814eaf0 2023-11-28T16:59:12.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39780c14c0 con 0x7f397814eaf0 2023-11-28T16:59:12.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39780c16e0 con 0x7f397814eaf0 2023-11-28T16:59:12.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.224+0000 7f395ffff640 1 -- 172.21.15.26:0/3315023313 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f396c011790 con 0x7f397814eaf0 2023-11-28T16:59:12.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.228+0000 7f395ffff640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3964066900 0x7f3964068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:12.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.228+0000 7f395ffff640 1 -- 172.21.15.26:0/3315023313 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f396c084380 con 0x7f397814eaf0 2023-11-28T16:59:12.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.228+0000 7f39777fe640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3964066900 0x7f3964068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:12.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.228+0000 7f39777fe640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3964066900 0x7f3964068dc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f39680ad000 tx=0x7f3968008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:12.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.228+0000 7f395ffff640 1 -- 172.21.15.26:0/3315023313 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f396c051300 con 0x7f397814eaf0 2023-11-28T16:59:12.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:12.428+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f397804e890 con 0x7f397814eaf0 2023-11-28T16:59:12.826 INFO:tasks.ceph.mds.b.smithi079.stderr:2023-11-28T16:59:12.825+0000 7f9577396640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:59:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.356+0000 7f395ffff640 1 -- 172.21.15.26:0/3315023313 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 119+0+0 (secure 0 0 0) 0x7f396c054920 con 0x7f397814eaf0 2023-11-28T16:59:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3964066900 msgr2=0x7f3964068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3964066900 0x7f3964068dc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f39680ad000 tx=0x7f3968008040 comp rx=0 tx=0).stop 2023-11-28T16:59:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 msgr2=0x7f3978144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978144130 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f396c00b410 tx=0x7f396c00b8d0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 shutdown_connections 2023-11-28T16:59:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3964066900 0x7f3964068dc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3978142920 0x7f397813b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397814eaf0 0x7f3978144130 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 --2- 172.21.15.26:0/3315023313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39780c0370 0x7f397813e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 >> 172.21.15.26:0/3315023313 conn(0x7f39780c2a60 msgr2=0x7f3978070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 shutdown_connections 2023-11-28T16:59:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.360+0000 7f397e09c640 1 -- 172.21.15.26:0/3315023313 wait complete. 2023-11-28T16:59:13.388 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T16:59:13.388 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-28T16:59:13.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f423a032640 1 Processor -- start 2023-11-28T16:59:13.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f423a032640 1 -- start start 2023-11-28T16:59:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f423a032640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f423406b810 0x7f42340c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f423a032640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42340c2a60 0x7f423406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f423a032640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4234073710 con 0x7f423406f0d0 2023-11-28T16:59:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f423a032640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42341589f0 con 0x7f42340c2a60 2023-11-28T16:59:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f423a032640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42341586e0 con 0x7f423406b810 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f4233fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42340c2a60 0x7f423406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f4233fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42340c2a60 0x7f423406e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36842/0 (socket says 172.21.15.26:36842) 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f4233fff640 1 -- 172.21.15.26:0/834976175 learned_addr learned my addr 172.21.15.26:0/834976175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f42337fe640 1 --2- 172.21.15.26:0/834976175 >> v2:172.21.15.79:3300/0 conn(0x7f423406b810 0x7f42340c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f4233fff640 1 -- 172.21.15.26:0/834976175 >> v2:172.21.15.79:3300/0 conn(0x7f423406b810 msgr2=0x7f42340c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f4233fff640 1 --2- 172.21.15.26:0/834976175 >> v2:172.21.15.79:3300/0 conn(0x7f423406b810 0x7f42340c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f4233fff640 1 -- 172.21.15.26:0/834976175 >> v1:172.21.15.79:6789/0 conn(0x7f423406f0d0 legacy=0x7f42340bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f4233fff640 1 -- 172.21.15.26:0/834976175 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340a6010 con 0x7f42340c2a60 2023-11-28T16:59:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.536+0000 7f42337fe640 1 --2- 172.21.15.26:0/834976175 >> v2:172.21.15.79:3300/0 conn(0x7f423406b810 0x7f42340c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f4233fff640 1 --2- 172.21.15.26:0/834976175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42340c2a60 0x7f423406e550 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f42340aca70 tx=0x7f422c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c428da219b718be2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f42327fc640 1 -- 172.21.15.26:0/834976175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0a5690 con 0x7f42340c2a60 2023-11-28T16:59:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f42327fc640 1 -- 172.21.15.26:0/834976175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0a57f0 con 0x7f42340c2a60 2023-11-28T16:59:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f42327fc640 1 -- 172.21.15.26:0/834976175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0a5b80 con 0x7f42340c2a60 2023-11-28T16:59:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 -- 172.21.15.26:0/834976175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42340c2a60 msgr2=0x7f423406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 --2- 172.21.15.26:0/834976175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42340c2a60 0x7f423406e550 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f42340aca70 tx=0x7f422c01c9d0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 -- 172.21.15.26:0/834976175 shutdown_connections 2023-11-28T16:59:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 --2- 172.21.15.26:0/834976175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42340c2a60 0x7f423406e550 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 --2- 172.21.15.26:0/834976175 >> v2:172.21.15.79:3300/0 conn(0x7f423406b810 0x7f42340c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 -- 172.21.15.26:0/834976175 >> 172.21.15.26:0/834976175 conn(0x7f42340c3240 msgr2=0x7f42340c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 -- 172.21.15.26:0/834976175 shutdown_connections 2023-11-28T16:59:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.540+0000 7f423a032640 1 -- 172.21.15.26:0/834976175 wait complete. 2023-11-28T16:59:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 Processor -- start 2023-11-28T16:59:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 -- start start 2023-11-28T16:59:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423406b810 0x7f42340a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423406f0d0 0x7f4234147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42340c2a60 0x7f4234148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423414dca0 con 0x7f423406b810 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340a8120 con 0x7f423406f0d0 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340a77f0 con 0x7f42340c2a60 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423406b810 0x7f42340a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423406b810 0x7f42340a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36846/0 (socket says 172.21.15.26:36846) 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 -- 172.21.15.26:0/2582176251 learned_addr learned my addr 172.21.15.26:0/2582176251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 -- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42340c2a60 msgr2=0x7f4234148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42340c2a60 0x7f4234148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 -- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423406f0d0 msgr2=0x7f4234147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f4232ffd640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423406f0d0 0x7f4234147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423406f0d0 0x7f4234147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 -- 172.21.15.26:0/2582176251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009b30 con 0x7f423406b810 2023-11-28T16:59:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f4232ffd640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423406f0d0 0x7f4234147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f42337fe640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423406b810 0x7f42340a6df0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f422400e810 tx=0x7f422400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f421bfff640 1 -- 172.21.15.26:0/2582176251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400c8d0 con 0x7f423406b810 2023-11-28T16:59:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f421bfff640 1 -- 172.21.15.26:0/2582176251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400ca30 con 0x7f423406b810 2023-11-28T16:59:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f421bfff640 1 -- 172.21.15.26:0/2582176251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400cdc0 con 0x7f423406b810 2023-11-28T16:59:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42340a7ad0 con 0x7f423406b810 2023-11-28T16:59:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42341486b0 con 0x7f423406b810 2023-11-28T16:59:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.544+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423404e890 con 0x7f423406b810 2023-11-28T16:59:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.548+0000 7f421bfff640 1 -- 172.21.15.26:0/2582176251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4224013410 con 0x7f423406b810 2023-11-28T16:59:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.548+0000 7f421bfff640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42200668d0 0x7f4220068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.548+0000 7f421bfff640 1 -- 172.21.15.26:0/2582176251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f42240844e0 con 0x7f423406b810 2023-11-28T16:59:13.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.548+0000 7f4232ffd640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42200668d0 0x7f4220068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:13.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.548+0000 7f4232ffd640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42200668d0 0x7f4220068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4234155860 tx=0x7f4228009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:13.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.552+0000 7f421bfff640 1 -- 172.21.15.26:0/2582176251 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4224051450 con 0x7f423406b810 2023-11-28T16:59:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:13.740+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42340734f0 con 0x7f423406b810 2023-11-28T16:59:14.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f421bfff640 1 -- 172.21.15.26:0/2582176251 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4224009480 con 0x7f423406b810 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42200668d0 msgr2=0x7f4220068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42200668d0 0x7f4220068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4234155860 tx=0x7f4228009040 comp rx=0 tx=0).stop 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423406b810 msgr2=0x7f42340a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423406b810 0x7f42340a6df0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f422400e810 tx=0x7f422400ecd0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 shutdown_connections 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42200668d0 0x7f4220068d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42340c2a60 0x7f4234148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423406f0d0 0x7f4234147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 --2- 172.21.15.26:0/2582176251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423406b810 0x7f42340a6df0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 >> 172.21.15.26:0/2582176251 conn(0x7f42340c3240 msgr2=0x7f42340bfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:14.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 shutdown_connections 2023-11-28T16:59:14.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.368+0000 7f423a032640 1 -- 172.21.15.26:0/2582176251 wait complete. 2023-11-28T16:59:14.396 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-28T16:59:14.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:14.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f549105f640 1 Processor -- start 2023-11-28T16:59:14.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f549105f640 1 -- start start 2023-11-28T16:59:14.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f549105f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f548c0aacd0 0x7f548c154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f549105f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f549105f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c072780 con 0x7f548c0700a0 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f549105f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0ac160 con 0x7f548c0aacd0 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f549105f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0abe80 con 0x7f548c0ab7a0 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f548ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f548c0aacd0 0x7f548c154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f548ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f548c0aacd0 0x7f548c154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36856/0 (socket says 172.21.15.26:36856) 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f548ad9d640 1 -- 172.21.15.26:0/2777099417 learned_addr learned my addr 172.21.15.26:0/2777099417 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.540+0000 7f548b59e640 1 --2- 172.21.15.26:0/2777099417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548ad9d640 1 -- 172.21.15.26:0/2777099417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 msgr2=0x7f548c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548ad9d640 1 --2- 172.21.15.26:0/2777099417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548ad9d640 1 -- 172.21.15.26:0/2777099417 >> v1:172.21.15.79:6789/0 conn(0x7f548c0700a0 legacy=0x7f548c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548ad9d640 1 -- 172.21.15.26:0/2777099417 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c154cf0 con 0x7f548c0aacd0 2023-11-28T16:59:14.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548ad9d640 1 --2- 172.21.15.26:0/2777099417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0aacd0 0x7f548c154160 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f547c009870 tx=0x7f547c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d96857873eafe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:14.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548a59c640 1 -- 172.21.15.26:0/2777099417 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0ab600 con 0x7f548c0aacd0 2023-11-28T16:59:14.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548a59c640 1 -- 172.21.15.26:0/2777099417 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0a7050 con 0x7f548c0aacd0 2023-11-28T16:59:14.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f548a59c640 1 -- 172.21.15.26:0/2777099417 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0ab980 con 0x7f548c0aacd0 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 -- 172.21.15.26:0/2777099417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0aacd0 msgr2=0x7f548c154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 --2- 172.21.15.26:0/2777099417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0aacd0 0x7f548c154160 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f547c009870 tx=0x7f547c01c480 comp rx=0 tx=0).stop 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 -- 172.21.15.26:0/2777099417 shutdown_connections 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 --2- 172.21.15.26:0/2777099417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 --2- 172.21.15.26:0/2777099417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0aacd0 0x7f548c154160 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 -- 172.21.15.26:0/2777099417 >> 172.21.15.26:0/2777099417 conn(0x7f548c0c2ad0 msgr2=0x7f548c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 -- 172.21.15.26:0/2777099417 shutdown_connections 2023-11-28T16:59:14.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.544+0000 7f549105f640 1 -- 172.21.15.26:0/2777099417 wait complete. 2023-11-28T16:59:14.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 Processor -- start 2023-11-28T16:59:14.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 -- start start 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0700a0 0x7f548c15e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c0aacd0 0x7f548c1edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c15ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15ddc0 con 0x7f548c0700a0 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1ee440 con 0x7f548c0aacd0 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15f0f0 con 0x7f548c0ab7a0 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0700a0 0x7f548c15e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0700a0 0x7f548c15e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36860/0 (socket says 172.21.15.26:36860) 2023-11-28T16:59:14.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 -- 172.21.15.26:0/3040502071 learned_addr learned my addr 172.21.15.26:0/3040502071 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f5483fff640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c0aacd0 0x7f548c1edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548b59e640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c15ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 -- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 msgr2=0x7f548c15ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c15ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 -- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c0aacd0 msgr2=0x7f548c1edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c0aacd0 0x7f548c1edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 -- 172.21.15.26:0/3040502071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0094d0 con 0x7f548c0700a0 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548b59e640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c15ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f548ad9d640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0700a0 0x7f548c15e1e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f547c0ae040 tx=0x7f547c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f54837fe640 1 -- 172.21.15.26:0/3040502071 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0b4440 con 0x7f548c0700a0 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f54837fe640 1 -- 172.21.15.26:0/3040502071 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0b45c0 con 0x7f548c0700a0 2023-11-28T16:59:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f54837fe640 1 -- 172.21.15.26:0/3040502071 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0b4970 con 0x7f548c0700a0 2023-11-28T16:59:14.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.548+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c15f320 con 0x7f548c0700a0 2023-11-28T16:59:14.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.552+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c15d700 con 0x7f548c0700a0 2023-11-28T16:59:14.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.552+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c04e890 con 0x7f548c0700a0 2023-11-28T16:59:14.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.552+0000 7f54837fe640 1 -- 172.21.15.26:0/3040502071 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f547c0b2070 con 0x7f548c0700a0 2023-11-28T16:59:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.552+0000 7f54837fe640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f546c0668d0 0x7f546c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.552+0000 7f54837fe640 1 -- 172.21.15.26:0/3040502071 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f547c11e670 con 0x7f548c0700a0 2023-11-28T16:59:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.552+0000 7f5483fff640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f546c0668d0 0x7f546c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.552+0000 7f5483fff640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f546c0668d0 0x7f546c068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f548c147020 tx=0x7f5474009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:14.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.556+0000 7f54837fe640 1 -- 172.21.15.26:0/3040502071 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f547c0eb540 con 0x7f548c0700a0 2023-11-28T16:59:14.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.748+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f548c06ce20 con 0x7f548c0700a0 2023-11-28T16:59:14.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.748+0000 7f54837fe640 1 -- 172.21.15.26:0/3040502071 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6128 (secure 0 0 0) 0x7f547c0eeb60 con 0x7f548c0700a0 2023-11-28T16:59:14.753 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:14.753 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:57.235192+0000","modified":"2023-11-28T16:59:00.256436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3229750931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3229750931},{"type":"v1","addr":"172.21.15.26:6835","nonce":3229750931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:14.753 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 51 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f546c0668d0 msgr2=0x7f546c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f546c0668d0 0x7f546c068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f548c147020 tx=0x7f5474009040 comp rx=0 tx=0).stop 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0700a0 msgr2=0x7f548c15e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0700a0 0x7f548c15e1e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f547c0ae040 tx=0x7f547c019220 comp rx=0 tx=0).stop 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 shutdown_connections 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f546c0668d0 0x7f546c068d90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f548c0ab7a0 0x7f548c15ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c0aacd0 0x7f548c1edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 --2- 172.21.15.26:0/3040502071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f548c0700a0 0x7f548c15e1e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 >> 172.21.15.26:0/3040502071 conn(0x7f548c0c2ad0 msgr2=0x7f548c071600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:14.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 shutdown_connections 2023-11-28T16:59:14.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.752+0000 7f549105f640 1 -- 172.21.15.26:0/3040502071 wait complete. 2023-11-28T16:59:14.774 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:14.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.912+0000 7fbed1f72640 1 Processor -- start 2023-11-28T16:59:14.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.912+0000 7fbed1f72640 1 -- start start 2023-11-28T16:59:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbed1f72640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbecc070b80 0x7fbecc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbed1f72640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc06d320 con 0x7fbecc0a8470 2023-11-28T16:59:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbed1f72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0721b0 con 0x7fbecc14e9d0 2023-11-28T16:59:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbed1f72640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0c2830 con 0x7fbecc070b80 2023-11-28T16:59:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbecaffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbecc070b80 0x7fbecc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbecbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbecc0a8470 0x7fbecc06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41052/0 (socket says 172.21.15.26:41052) 2023-11-28T16:59:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbecaffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbecc070b80 0x7fbecc151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36864/0 (socket says 172.21.15.26:36864) 2023-11-28T16:59:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbecbfff640 1 -- 172.21.15.26:0/3361966229 learned_addr learned my addr 172.21.15.26:0/3361966229 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbecaffd640 1 -- 172.21.15.26:0/3361966229 >> v1:172.21.15.79:6789/0 conn(0x7fbecc14e9d0 legacy=0x7fbecc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbecaffd640 1 -- 172.21.15.26:0/3361966229 >> v1:172.21.15.26:6789/0 conn(0x7fbecc0a8470 legacy=0x7fbecc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbeca7fc640 1 -- 172.21.15.26:0/3361966229 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504121656 0 0) 0x7fbecc0721b0 con 0x7fbecc14e9d0 2023-11-28T16:59:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.916+0000 7fbecaffd640 1 -- 172.21.15.26:0/3361966229 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc072450 con 0x7fbecc070b80 2023-11-28T16:59:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbecaffd640 1 --2- 172.21.15.26:0/3361966229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc151e60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097c0 tx=0x7fbec001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35693dbe4b3badd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbeca7fc640 1 -- 172.21.15.26:0/3361966229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00ab600 con 0x7fbecc070b80 2023-11-28T16:59:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbeca7fc640 1 -- 172.21.15.26:0/3361966229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec00a7050 con 0x7fbecc070b80 2023-11-28T16:59:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbeca7fc640 1 -- 172.21.15.26:0/3361966229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00ab980 con 0x7fbecc070b80 2023-11-28T16:59:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 -- 172.21.15.26:0/3361966229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 msgr2=0x7fbecc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 --2- 172.21.15.26:0/3361966229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc151e60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097c0 tx=0x7fbec001c280 comp rx=0 tx=0).stop 2023-11-28T16:59:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 -- 172.21.15.26:0/3361966229 shutdown_connections 2023-11-28T16:59:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 --2- 172.21.15.26:0/3361966229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc151e60 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 -- 172.21.15.26:0/3361966229 >> 172.21.15.26:0/3361966229 conn(0x7fbecc0c2ad0 msgr2=0x7fbecc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 -- 172.21.15.26:0/3361966229 shutdown_connections 2023-11-28T16:59:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 -- 172.21.15.26:0/3361966229 wait complete. 2023-11-28T16:59:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 Processor -- start 2023-11-28T16:59:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 -- start start 2023-11-28T16:59:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc0c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.920+0000 7fbed1f72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbecc0a8470 0x7fbecc0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbed1f72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbecc14e9d0 0x7fbecc150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbed1f72640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc146b30 con 0x7fbecc070b80 2023-11-28T16:59:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbed1f72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc14b3f0 con 0x7fbecc0a8470 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbed1f72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1eacd0 con 0x7fbecc14e9d0 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc0c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc0c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36870/0 (socket says 172.21.15.26:36870) 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 -- 172.21.15.26:0/2397263148 learned_addr learned my addr 172.21.15.26:0/2397263148 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecaffd640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbecc0a8470 0x7fbecc0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecbfff640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbecc14e9d0 0x7fbecc150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 -- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbecc14e9d0 msgr2=0x7fbecc150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbecc14e9d0 0x7fbecc150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 -- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbecc0a8470 msgr2=0x7fbecc0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbecc0a8470 0x7fbecc0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 -- 172.21.15.26:0/2397263148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009420 con 0x7fbecc070b80 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecaffd640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbecc0a8470 0x7fbecc0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecbfff640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbecc14e9d0 0x7fbecc150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbecb7fe640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc0c51f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbebc001ec0 tx=0x7fbebc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbeb3fff640 1 -- 172.21.15.26:0/2397263148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0054e0 con 0x7fbecc070b80 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbeb3fff640 1 -- 172.21.15.26:0/2397263148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc003600 con 0x7fbecc070b80 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbeb3fff640 1 -- 172.21.15.26:0/2397263148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0039b0 con 0x7fbecc070b80 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc0c5730 con 0x7fbecc070b80 2023-11-28T16:59:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1ea960 con 0x7fbecc070b80 2023-11-28T16:59:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc1ea7c0 con 0x7fbecc070b80 2023-11-28T16:59:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.924+0000 7fbeb3fff640 1 -- 172.21.15.26:0/2397263148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbebc003b10 con 0x7fbecc070b80 2023-11-28T16:59:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.928+0000 7fbeb3fff640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbeb80668d0 0x7fbeb8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.928+0000 7fbeb3fff640 1 -- 172.21.15.26:0/2397263148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbebc083d10 con 0x7fbecc070b80 2023-11-28T16:59:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.928+0000 7fbecaffd640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbeb80668d0 0x7fbeb8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.928+0000 7fbecaffd640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbeb80668d0 0x7fbeb8068d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ad000 tx=0x7fbec0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:14.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:14.928+0000 7fbeb3fff640 1 -- 172.21.15.26:0/2397263148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbecc1ea7c0 con 0x7fbecc070b80 2023-11-28T16:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.092+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbecc1ea7c0 con 0x7fbecc070b80 2023-11-28T16:59:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.092+0000 7fbeb3fff640 1 -- 172.21.15.26:0/2397263148 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7fbecc1ea7c0 con 0x7fbecc070b80 2023-11-28T16:59:15.096 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:15.097 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbeb80668d0 msgr2=0x7fbeb8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbeb80668d0 0x7fbeb8068d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ad000 tx=0x7fbec0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 msgr2=0x7fbecc0c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc0c51f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbebc001ec0 tx=0x7fbebc00c8e0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 shutdown_connections 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fbeb80668d0 0x7fbeb8068d90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbecc14e9d0 0x7fbecc150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbecc0a8470 0x7fbecc0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 --2- 172.21.15.26:0/2397263148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc070b80 0x7fbecc0c51f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 >> 172.21.15.26:0/2397263148 conn(0x7fbecc0c2ad0 msgr2=0x7fbecc06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 shutdown_connections 2023-11-28T16:59:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.096+0000 7fbed1f72640 1 -- 172.21.15.26:0/2397263148 wait complete. 2023-11-28T16:59:15.118 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T16:59:15.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:15.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.256+0000 7f5655b9d640 1 Processor -- start 2023-11-28T16:59:15.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.256+0000 7f5655b9d640 1 -- start start 2023-11-28T16:59:15.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f5655b9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f565006d980 0x7f56500c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f5655b9d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5650156980 con 0x7f5650156500 2023-11-28T16:59:15.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f5655b9d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500ab580 con 0x7f565014fcc0 2023-11-28T16:59:15.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f5655b9d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56500aa340 con 0x7f565006d980 2023-11-28T16:59:15.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f565006d980 0x7f56500c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5650156500 0x7f56500c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41060/0 (socket says 172.21.15.26:41060) 2023-11-28T16:59:15.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564effd640 1 -- 172.21.15.26:0/3194252039 learned_addr learned my addr 172.21.15.26:0/3194252039 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:15.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564ffff640 1 -- 172.21.15.26:0/3194252039 >> v1:172.21.15.79:6789/0 conn(0x7f565014fcc0 legacy=0x7f56500aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564ffff640 1 -- 172.21.15.26:0/3194252039 >> v1:172.21.15.26:6789/0 conn(0x7f5650156500 legacy=0x7f56500c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564ffff640 1 -- 172.21.15.26:0/3194252039 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650152fe0 con 0x7f565006d980 2023-11-28T16:59:15.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564e7fc640 1 -- 172.21.15.26:0/3194252039 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163517367 0 0) 0x7f5644001120 con 0x7f5650156500 2023-11-28T16:59:15.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.260+0000 7f564ffff640 1 --2- 172.21.15.26:0/3194252039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565006d980 0x7f56500c20f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabe1044fd4773cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:15.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f564e7fc640 1 -- 172.21.15.26:0/3194252039 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480a59e0 con 0x7f565006d980 2023-11-28T16:59:15.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f564e7fc640 1 -- 172.21.15.26:0/3194252039 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56480a5b40 con 0x7f565006d980 2023-11-28T16:59:15.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f564e7fc640 1 -- 172.21.15.26:0/3194252039 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480ad440 con 0x7f565006d980 2023-11-28T16:59:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- 172.21.15.26:0/3194252039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565006d980 msgr2=0x7f56500c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3194252039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565006d980 0x7f56500c20f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564801c920 comp rx=0 tx=0).stop 2023-11-28T16:59:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- 172.21.15.26:0/3194252039 shutdown_connections 2023-11-28T16:59:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3194252039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565006d980 0x7f56500c20f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- 172.21.15.26:0/3194252039 >> 172.21.15.26:0/3194252039 conn(0x7f56500c2ad0 msgr2=0x7f56500c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- 172.21.15.26:0/3194252039 shutdown_connections 2023-11-28T16:59:15.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- 172.21.15.26:0/3194252039 wait complete. 2023-11-28T16:59:15.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 Processor -- start 2023-11-28T16:59:15.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- start start 2023-11-28T16:59:15.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f565006d980 0x7f56500c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5650156500 0x7f56501f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565014dbd0 0x7f565014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5650151f50 con 0x7f565014dbd0 2023-11-28T16:59:15.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500c44e0 con 0x7f5650156500 2023-11-28T16:59:15.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.264+0000 7f5655b9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56500c46f0 con 0x7f565006d980 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565014dbd0 0x7f565014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5650156500 0x7f56501f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564f7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f565006d980 0x7f56500c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5650156500 0x7f56501f4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:40602/0 (socket says 172.21.15.26:40602) 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564effd640 1 -- 172.21.15.26:0/3938315105 learned_addr learned my addr 172.21.15.26:0/3938315105 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564ffff640 1 -- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f565006d980 msgr2=0x7f56500c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564ffff640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f565006d980 0x7f56500c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564ffff640 1 -- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5650156500 msgr2=0x7f56501f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564ffff640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5650156500 0x7f56501f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564ffff640 1 -- 172.21.15.26:0/3938315105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648009a70 con 0x7f565014dbd0 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f564ffff640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565014dbd0 0x7f565014e040 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f56480ac000 tx=0x7f56480196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:15.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5637fff640 1 -- 172.21.15.26:0/3938315105 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480aee50 con 0x7f565014dbd0 2023-11-28T16:59:15.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5637fff640 1 -- 172.21.15.26:0/3938315105 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56480039a0 con 0x7f565014dbd0 2023-11-28T16:59:15.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5637fff640 1 -- 172.21.15.26:0/3938315105 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648003d10 con 0x7f565014dbd0 2023-11-28T16:59:15.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56500c49d0 con 0x7f565014dbd0 2023-11-28T16:59:15.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56500c5730 con 0x7f565014dbd0 2023-11-28T16:59:15.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565004e890 con 0x7f565014dbd0 2023-11-28T16:59:15.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5637fff640 1 -- 172.21.15.26:0/3938315105 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f56480b4050 con 0x7f565014dbd0 2023-11-28T16:59:15.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.268+0000 7f5637fff640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f563c0668d0 0x7f563c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.272+0000 7f5637fff640 1 -- 172.21.15.26:0/3938315105 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f564811f4e0 con 0x7f565014dbd0 2023-11-28T16:59:15.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.272+0000 7f564f7fe640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f563c0668d0 0x7f563c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.272+0000 7f564f7fe640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f563c0668d0 0x7f563c068d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5640007fd0 tx=0x7f5640009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:15.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.272+0000 7f5637fff640 1 -- 172.21.15.26:0/3938315105 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56480ec500 con 0x7f565014dbd0 2023-11-28T16:59:15.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.428+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f565006ddf0 con 0x7f563c0668d0 2023-11-28T16:59:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.444+0000 7f5637fff640 1 -- 172.21.15.26:0/3938315105 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+515559 (secure 0 0 0) 0x7f56400014f0 con 0x7f563c0668d0 2023-11-28T16:59:15.452 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f563c0668d0 msgr2=0x7f563c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f563c0668d0 0x7f563c068d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5640007fd0 tx=0x7f5640009040 comp rx=0 tx=0).stop 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565014dbd0 msgr2=0x7f565014e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565014dbd0 0x7f565014e040 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f56480ac000 tx=0x7f56480196c0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 shutdown_connections 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565014dbd0 0x7f565014e040 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5650156500 0x7f56501f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f563c0668d0 0x7f563c068d90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 --2- 172.21.15.26:0/3938315105 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f565006d980 0x7f56500c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 >> 172.21.15.26:0/3938315105 conn(0x7f56500c2ad0 msgr2=0x7f565014ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 shutdown_connections 2023-11-28T16:59:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.448+0000 7f5655b9d640 1 -- 172.21.15.26:0/3938315105 wait complete. 2023-11-28T16:59:15.471 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2023-11-28T16:59:13.618204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248972,"kb_used_data":7848,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725748,"statfs":{"total":773094113280,"available":772839165952,"internally_reserved":0,"allocated":8036352,"data_stored":4147250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.296971"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613830+0000","last_change":"2023-11-28T16:58:57.314088+0000","last_active":"2023-11-28T16:58:59.613830+0000","last_peered":"2023-11-28T16:58:59.613830+0000","last_clean":"2023-11-28T16:58:59.613830+0000","last_became_active":"2023-11-28T16:58:57.312523+0000","last_became_peered":"2023-11-28T16:58:57.312523+0000","last_unstale":"2023-11-28T16:58:59.613830+0000","last_undegraded":"2023-11-28T16:58:59.613830+0000","last_fullsized":"2023-11-28T16:58:59.613830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625838+0000","last_change":"2023-11-28T16:58:57.310945+0000","last_active":"2023-11-28T16:58:59.625838+0000","last_peered":"2023-11-28T16:58:59.625838+0000","last_clean":"2023-11-28T16:58:59.625838+0000","last_became_active":"2023-11-28T16:58:57.310682+0000","last_became_peered":"2023-11-28T16:58:57.310682+0000","last_unstale":"2023-11-28T16:58:59.625838+0000","last_undegraded":"2023-11-28T16:58:59.625838+0000","last_fullsized":"2023-11-28T16:58:59.625838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:28.805091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.627115+0000","last_change":"2023-11-28T16:58:57.309345+0000","last_active":"2023-11-28T16:58:59.627115+0000","last_peered":"2023-11-28T16:58:59.627115+0000","last_clean":"2023-11-28T16:58:59.627115+0000","last_became_active":"2023-11-28T16:58:57.308923+0000","last_became_peered":"2023-11-28T16:58:57.308923+0000","last_unstale":"2023-11-28T16:58:59.627115+0000","last_undegraded":"2023-11-28T16:58:59.627115+0000","last_fullsized":"2023-11-28T16:58:59.627115+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:16.895584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618465+0000","last_change":"2023-11-28T16:58:57.304932+0000","last_active":"2023-11-28T16:58:59.618465+0000","last_peered":"2023-11-28T16:58:59.618465+0000","last_clean":"2023-11-28T16:58:59.618465+0000","last_became_active":"2023-11-28T16:58:57.304401+0000","last_became_peered":"2023-11-28T16:58:57.304401+0000","last_unstale":"2023-11-28T16:58:59.618465+0000","last_undegraded":"2023-11-28T16:58:59.618465+0000","last_fullsized":"2023-11-28T16:58:59.618465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:08.489709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613954+0000","last_change":"2023-11-28T16:58:57.312192+0000","last_active":"2023-11-28T16:58:59.613954+0000","last_peered":"2023-11-28T16:58:59.613954+0000","last_clean":"2023-11-28T16:58:59.613954+0000","last_became_active":"2023-11-28T16:58:57.311963+0000","last_became_peered":"2023-11-28T16:58:57.311963+0000","last_unstale":"2023-11-28T16:58:59.613954+0000","last_undegraded":"2023-11-28T16:58:59.613954+0000","last_fullsized":"2023-11-28T16:58:59.613954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626612+0000","last_change":"2023-11-28T16:58:57.318754+0000","last_active":"2023-11-28T16:58:59.626612+0000","last_peered":"2023-11-28T16:58:59.626612+0000","last_clean":"2023-11-28T16:58:59.626612+0000","last_became_active":"2023-11-28T16:58:57.318472+0000","last_became_peered":"2023-11-28T16:58:57.318472+0000","last_unstale":"2023-11-28T16:58:59.626612+0000","last_undegraded":"2023-11-28T16:58:59.626612+0000","last_fullsized":"2023-11-28T16:58:59.626612+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618405+0000","last_change":"2023-11-28T16:58:57.305646+0000","last_active":"2023-11-28T16:58:59.618405+0000","last_peered":"2023-11-28T16:58:59.618405+0000","last_clean":"2023-11-28T16:58:59.618405+0000","last_became_active":"2023-11-28T16:58:57.305348+0000","last_became_peered":"2023-11-28T16:58:57.305348+0000","last_unstale":"2023-11-28T16:58:59.618405+0000","last_undegraded":"2023-11-28T16:58:59.618405+0000","last_fullsized":"2023-11-28T16:58:59.618405+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:10.412723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626884+0000","last_change":"2023-11-28T16:58:57.313508+0000","last_active":"2023-11-28T16:58:59.626884+0000","last_peered":"2023-11-28T16:58:59.626884+0000","last_clean":"2023-11-28T16:58:59.626884+0000","last_became_active":"2023-11-28T16:58:57.311907+0000","last_became_peered":"2023-11-28T16:58:57.311907+0000","last_unstale":"2023-11-28T16:58:59.626884+0000","last_undegraded":"2023-11-28T16:58:59.626884+0000","last_fullsized":"2023-11-28T16:58:59.626884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626484+0000","last_change":"2023-11-28T16:58:57.315988+0000","last_active":"2023-11-28T16:58:59.626484+0000","last_peered":"2023-11-28T16:58:59.626484+0000","last_clean":"2023-11-28T16:58:59.626484+0000","last_became_active":"2023-11-28T16:58:57.315705+0000","last_became_peered":"2023-11-28T16:58:57.315705+0000","last_unstale":"2023-11-28T16:58:59.626484+0000","last_undegraded":"2023-11-28T16:58:59.626484+0000","last_fullsized":"2023-11-28T16:58:59.626484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:16.960155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613803+0000","last_change":"2023-11-28T16:58:57.307177+0000","last_active":"2023-11-28T16:58:59.613803+0000","last_peered":"2023-11-28T16:58:59.613803+0000","last_clean":"2023-11-28T16:58:59.613803+0000","last_became_active":"2023-11-28T16:58:57.305697+0000","last_became_peered":"2023-11-28T16:58:57.305697+0000","last_unstale":"2023-11-28T16:58:59.613803+0000","last_undegraded":"2023-11-28T16:58:59.613803+0000","last_fullsized":"2023-11-28T16:58:59.613803+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625817+0000","last_change":"2023-11-28T16:58:57.301869+0000","last_active":"2023-11-28T16:58:59.625817+0000","last_peered":"2023-11-28T16:58:59.625817+0000","last_clean":"2023-11-28T16:58:59.625817+0000","last_became_active":"2023-11-28T16:58:57.299043+0000","last_became_peered":"2023-11-28T16:58:57.299043+0000","last_unstale":"2023-11-28T16:58:59.625817+0000","last_undegraded":"2023-11-28T16:58:59.625817+0000","last_fullsized":"2023-11-28T16:58:59.625817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:27.650178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613698+0000","last_change":"2023-11-28T16:58:57.304835+0000","last_active":"2023-11-28T16:58:59.613698+0000","last_peered":"2023-11-28T16:58:59.613698+0000","last_clean":"2023-11-28T16:58:59.613698+0000","last_became_active":"2023-11-28T16:58:57.304529+0000","last_became_peered":"2023-11-28T16:58:57.304529+0000","last_unstale":"2023-11-28T16:58:59.613698+0000","last_undegraded":"2023-11-28T16:58:59.613698+0000","last_fullsized":"2023-11-28T16:58:59.613698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626700+0000","last_change":"2023-11-28T16:58:57.304288+0000","last_active":"2023-11-28T16:58:59.626700+0000","last_peered":"2023-11-28T16:58:59.626700+0000","last_clean":"2023-11-28T16:58:59.626700+0000","last_became_active":"2023-11-28T16:58:57.303979+0000","last_became_peered":"2023-11-28T16:58:57.303979+0000","last_unstale":"2023-11-28T16:58:59.626700+0000","last_undegraded":"2023-11-28T16:58:59.626700+0000","last_fullsized":"2023-11-28T16:58:59.626700+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:01.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618427+0000","last_change":"2023-11-28T16:58:57.309909+0000","last_active":"2023-11-28T16:58:59.618427+0000","last_peered":"2023-11-28T16:58:59.618427+0000","last_clean":"2023-11-28T16:58:59.618427+0000","last_became_active":"2023-11-28T16:58:57.309581+0000","last_became_peered":"2023-11-28T16:58:57.309581+0000","last_unstale":"2023-11-28T16:58:59.618427+0000","last_undegraded":"2023-11-28T16:58:59.618427+0000","last_fullsized":"2023-11-28T16:58:59.618427+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:44.715872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.609324+0000","last_change":"2023-11-28T16:58:57.305318+0000","last_active":"2023-11-28T16:58:59.609324+0000","last_peered":"2023-11-28T16:58:59.609324+0000","last_clean":"2023-11-28T16:58:59.609324+0000","last_became_active":"2023-11-28T16:58:57.300492+0000","last_became_peered":"2023-11-28T16:58:57.300492+0000","last_unstale":"2023-11-28T16:58:59.609324+0000","last_undegraded":"2023-11-28T16:58:59.609324+0000","last_fullsized":"2023-11-28T16:58:59.609324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613843+0000","last_change":"2023-11-28T16:58:57.309435+0000","last_active":"2023-11-28T16:58:59.613843+0000","last_peered":"2023-11-28T16:58:59.613843+0000","last_clean":"2023-11-28T16:58:59.613843+0000","last_became_active":"2023-11-28T16:58:57.308962+0000","last_became_peered":"2023-11-28T16:58:57.308962+0000","last_unstale":"2023-11-28T16:58:59.613843+0000","last_undegraded":"2023-11-28T16:58:59.613843+0000","last_fullsized":"2023-11-28T16:58:59.613843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614192+0000","last_change":"2023-11-28T16:58:57.302600+0000","last_active":"2023-11-28T16:58:59.614192+0000","last_peered":"2023-11-28T16:58:59.614192+0000","last_clean":"2023-11-28T16:58:59.614192+0000","last_became_active":"2023-11-28T16:58:57.302328+0000","last_became_peered":"2023-11-28T16:58:57.302328+0000","last_unstale":"2023-11-28T16:58:59.614192+0000","last_undegraded":"2023-11-28T16:58:59.614192+0000","last_fullsized":"2023-11-28T16:58:59.614192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618488+0000","last_change":"2023-11-28T16:58:57.307084+0000","last_active":"2023-11-28T16:58:59.618488+0000","last_peered":"2023-11-28T16:58:59.618488+0000","last_clean":"2023-11-28T16:58:59.618488+0000","last_became_active":"2023-11-28T16:58:57.306795+0000","last_became_peered":"2023-11-28T16:58:57.306795+0000","last_unstale":"2023-11-28T16:58:59.618488+0000","last_undegraded":"2023-11-28T16:58:59.618488+0000","last_fullsized":"2023-11-28T16:58:59.618488+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:45:36.527998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610969+0000","last_change":"2023-11-28T16:58:57.301492+0000","last_active":"2023-11-28T16:58:59.610969+0000","last_peered":"2023-11-28T16:58:59.610969+0000","last_clean":"2023-11-28T16:58:59.610969+0000","last_became_active":"2023-11-28T16:58:57.301143+0000","last_became_peered":"2023-11-28T16:58:57.301143+0000","last_unstale":"2023-11-28T16:58:59.610969+0000","last_undegraded":"2023-11-28T16:58:59.610969+0000","last_fullsized":"2023-11-28T16:58:59.610969+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618474+0000","last_change":"2023-11-28T16:58:57.305035+0000","last_active":"2023-11-28T16:58:59.618474+0000","last_peered":"2023-11-28T16:58:59.618474+0000","last_clean":"2023-11-28T16:58:59.618474+0000","last_became_active":"2023-11-28T16:58:57.304747+0000","last_became_peered":"2023-11-28T16:58:57.304747+0000","last_unstale":"2023-11-28T16:58:59.618474+0000","last_undegraded":"2023-11-28T16:58:59.618474+0000","last_fullsized":"2023-11-28T16:58:59.618474+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:59:37.707020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618455+0000","last_change":"2023-11-28T16:58:57.313873+0000","last_active":"2023-11-28T16:58:59.618455+0000","last_peered":"2023-11-28T16:58:59.618455+0000","last_clean":"2023-11-28T16:58:59.618455+0000","last_became_active":"2023-11-28T16:58:57.313545+0000","last_became_peered":"2023-11-28T16:58:57.313545+0000","last_unstale":"2023-11-28T16:58:59.618455+0000","last_undegraded":"2023-11-28T16:58:59.618455+0000","last_fullsized":"2023-11-28T16:58:59.618455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:19.647634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625423+0000","last_change":"2023-11-28T16:58:57.299061+0000","last_active":"2023-11-28T16:58:59.625423+0000","last_peered":"2023-11-28T16:58:59.625423+0000","last_clean":"2023-11-28T16:58:59.625423+0000","last_became_active":"2023-11-28T16:58:57.298785+0000","last_became_peered":"2023-11-28T16:58:57.298785+0000","last_unstale":"2023-11-28T16:58:59.625423+0000","last_undegraded":"2023-11-28T16:58:59.625423+0000","last_fullsized":"2023-11-28T16:58:59.625423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:40:09.962992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613652+0000","last_change":"2023-11-28T16:58:57.315028+0000","last_active":"2023-11-28T16:58:59.613652+0000","last_peered":"2023-11-28T16:58:59.613652+0000","last_clean":"2023-11-28T16:58:59.613652+0000","last_became_active":"2023-11-28T16:58:57.314688+0000","last_became_peered":"2023-11-28T16:58:57.314688+0000","last_unstale":"2023-11-28T16:58:59.613652+0000","last_undegraded":"2023-11-28T16:58:59.613652+0000","last_fullsized":"2023-11-28T16:58:59.613652+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618362+0000","last_change":"2023-11-28T16:58:57.313407+0000","last_active":"2023-11-28T16:58:59.618362+0000","last_peered":"2023-11-28T16:58:59.618362+0000","last_clean":"2023-11-28T16:58:59.618362+0000","last_became_active":"2023-11-28T16:58:57.313195+0000","last_became_peered":"2023-11-28T16:58:57.313195+0000","last_unstale":"2023-11-28T16:58:59.618362+0000","last_undegraded":"2023-11-28T16:58:59.618362+0000","last_fullsized":"2023-11-28T16:58:59.618362+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:41:36.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625910+0000","last_change":"2023-11-28T16:58:57.306497+0000","last_active":"2023-11-28T16:58:59.625910+0000","last_peered":"2023-11-28T16:58:59.625910+0000","last_clean":"2023-11-28T16:58:59.625910+0000","last_became_active":"2023-11-28T16:58:57.306200+0000","last_became_peered":"2023-11-28T16:58:57.306200+0000","last_unstale":"2023-11-28T16:58:59.625910+0000","last_undegraded":"2023-11-28T16:58:59.625910+0000","last_fullsized":"2023-11-28T16:58:59.625910+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:21.987730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.627183+0000","last_change":"2023-11-28T16:58:57.299393+0000","last_active":"2023-11-28T16:58:59.627183+0000","last_peered":"2023-11-28T16:58:59.627183+0000","last_clean":"2023-11-28T16:58:59.627183+0000","last_became_active":"2023-11-28T16:58:57.299079+0000","last_became_peered":"2023-11-28T16:58:57.299079+0000","last_unstale":"2023-11-28T16:58:59.627183+0000","last_undegraded":"2023-11-28T16:58:59.627183+0000","last_fullsized":"2023-11-28T16:58:59.627183+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:08.500949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614019+0000","last_change":"2023-11-28T16:58:57.304447+0000","last_active":"2023-11-28T16:58:59.614019+0000","last_peered":"2023-11-28T16:58:59.614019+0000","last_clean":"2023-11-28T16:58:59.614019+0000","last_became_active":"2023-11-28T16:58:57.301404+0000","last_became_peered":"2023-11-28T16:58:57.301404+0000","last_unstale":"2023-11-28T16:58:59.614019+0000","last_undegraded":"2023-11-28T16:58:59.614019+0000","last_fullsized":"2023-11-28T16:58:59.614019+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613712+0000","last_change":"2023-11-28T16:58:57.315464+0000","last_active":"2023-11-28T16:58:59.613712+0000","last_peered":"2023-11-28T16:58:59.613712+0000","last_clean":"2023-11-28T16:58:59.613712+0000","last_became_active":"2023-11-28T16:58:57.314425+0000","last_became_peered":"2023-11-28T16:58:57.314425+0000","last_unstale":"2023-11-28T16:58:59.613712+0000","last_undegraded":"2023-11-28T16:58:59.613712+0000","last_fullsized":"2023-11-28T16:58:59.613712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625511+0000","last_change":"2023-11-28T16:58:57.299772+0000","last_active":"2023-11-28T16:58:59.625511+0000","last_peered":"2023-11-28T16:58:59.625511+0000","last_clean":"2023-11-28T16:58:59.625511+0000","last_became_active":"2023-11-28T16:58:57.299523+0000","last_became_peered":"2023-11-28T16:58:57.299523+0000","last_unstale":"2023-11-28T16:58:59.625511+0000","last_undegraded":"2023-11-28T16:58:59.625511+0000","last_fullsized":"2023-11-28T16:58:59.625511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:37.921612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625455+0000","last_change":"2023-11-28T16:58:57.299039+0000","last_active":"2023-11-28T16:58:59.625455+0000","last_peered":"2023-11-28T16:58:59.625455+0000","last_clean":"2023-11-28T16:58:59.625455+0000","last_became_active":"2023-11-28T16:58:57.298773+0000","last_became_peered":"2023-11-28T16:58:57.298773+0000","last_unstale":"2023-11-28T16:58:59.625455+0000","last_undegraded":"2023-11-28T16:58:59.625455+0000","last_fullsized":"2023-11-28T16:58:59.625455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:32.086836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613888+0000","last_change":"2023-11-28T16:58:57.299925+0000","last_active":"2023-11-28T16:58:59.613888+0000","last_peered":"2023-11-28T16:58:59.613888+0000","last_clean":"2023-11-28T16:58:59.613888+0000","last_became_active":"2023-11-28T16:58:57.299627+0000","last_became_peered":"2023-11-28T16:58:57.299627+0000","last_unstale":"2023-11-28T16:58:59.613888+0000","last_undegraded":"2023-11-28T16:58:59.613888+0000","last_fullsized":"2023-11-28T16:58:59.613888+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613615+0000","last_change":"2023-11-28T16:58:57.313636+0000","last_active":"2023-11-28T16:58:59.613615+0000","last_peered":"2023-11-28T16:58:59.613615+0000","last_clean":"2023-11-28T16:58:59.613615+0000","last_became_active":"2023-11-28T16:58:57.313257+0000","last_became_peered":"2023-11-28T16:58:57.313257+0000","last_unstale":"2023-11-28T16:58:59.613615+0000","last_undegraded":"2023-11-28T16:58:59.613615+0000","last_fullsized":"2023-11-28T16:58:59.613615+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.323306+0000","last_change":"2023-11-28T16:59:09.323306+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.323306+0000","last_undegraded":"2023-11-28T16:59:09.323306+0000","last_fullsized":"2023-11-28T16:59:09.323306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614097+0000","last_change":"2023-11-28T16:58:57.310866+0000","last_active":"2023-11-28T16:58:59.614097+0000","last_peered":"2023-11-28T16:58:59.614097+0000","last_clean":"2023-11-28T16:58:59.614097+0000","last_became_active":"2023-11-28T16:58:57.310515+0000","last_became_peered":"2023-11-28T16:58:57.310515+0000","last_unstale":"2023-11-28T16:58:59.614097+0000","last_undegraded":"2023-11-28T16:58:59.614097+0000","last_fullsized":"2023-11-28T16:58:59.614097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613875+0000","last_change":"2023-11-28T16:58:56.862978+0000","last_active":"2023-11-28T16:58:59.613875+0000","last_peered":"2023-11-28T16:58:59.613875+0000","last_clean":"2023-11-28T16:58:59.613875+0000","last_became_active":"2023-11-28T16:58:56.862677+0000","last_became_peered":"2023-11-28T16:58:56.862677+0000","last_unstale":"2023-11-28T16:58:59.613875+0000","last_undegraded":"2023-11-28T16:58:59.613875+0000","last_fullsized":"2023-11-28T16:58:59.613875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324087+0000","last_change":"2023-11-28T16:59:09.324087+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324087+0000","last_undegraded":"2023-11-28T16:59:09.324087+0000","last_fullsized":"2023-11-28T16:59:09.324087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613844+0000","last_change":"2023-11-28T16:58:57.315127+0000","last_active":"2023-11-28T16:58:59.613844+0000","last_peered":"2023-11-28T16:58:59.613844+0000","last_clean":"2023-11-28T16:58:59.613844+0000","last_became_active":"2023-11-28T16:58:57.314836+0000","last_became_peered":"2023-11-28T16:58:57.314836+0000","last_unstale":"2023-11-28T16:58:59.613844+0000","last_undegraded":"2023-11-28T16:58:59.613844+0000","last_fullsized":"2023-11-28T16:58:59.613844+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614171+0000","last_change":"2023-11-28T16:58:56.852728+0000","last_active":"2023-11-28T16:58:59.614171+0000","last_peered":"2023-11-28T16:58:59.614171+0000","last_clean":"2023-11-28T16:58:59.614171+0000","last_became_active":"2023-11-28T16:58:56.852468+0000","last_became_peered":"2023-11-28T16:58:56.852468+0000","last_unstale":"2023-11-28T16:58:59.614171+0000","last_undegraded":"2023-11-28T16:58:59.614171+0000","last_fullsized":"2023-11-28T16:58:59.614171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.323604+0000","last_change":"2023-11-28T16:59:09.323604+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.323604+0000","last_undegraded":"2023-11-28T16:59:09.323604+0000","last_fullsized":"2023-11-28T16:59:09.323604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613725+0000","last_change":"2023-11-28T16:58:57.314042+0000","last_active":"2023-11-28T16:58:59.613725+0000","last_peered":"2023-11-28T16:58:59.613725+0000","last_clean":"2023-11-28T16:58:59.613725+0000","last_became_active":"2023-11-28T16:58:57.313749+0000","last_became_peered":"2023-11-28T16:58:57.313749+0000","last_unstale":"2023-11-28T16:58:59.613725+0000","last_undegraded":"2023-11-28T16:58:59.613725+0000","last_fullsized":"2023-11-28T16:58:59.613725+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610990+0000","last_change":"2023-11-28T16:58:56.861860+0000","last_active":"2023-11-28T16:58:59.610990+0000","last_peered":"2023-11-28T16:58:59.610990+0000","last_clean":"2023-11-28T16:58:59.610990+0000","last_became_active":"2023-11-28T16:58:56.861575+0000","last_became_peered":"2023-11-28T16:58:56.861575+0000","last_unstale":"2023-11-28T16:58:59.610990+0000","last_undegraded":"2023-11-28T16:58:59.610990+0000","last_fullsized":"2023-11-28T16:58:59.610990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:01.116893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324456+0000","last_change":"2023-11-28T16:59:09.324456+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324456+0000","last_undegraded":"2023-11-28T16:59:09.324456+0000","last_fullsized":"2023-11-28T16:59:09.324456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.627109+0000","last_change":"2023-11-28T16:58:57.316847+0000","last_active":"2023-11-28T16:58:59.627109+0000","last_peered":"2023-11-28T16:58:59.627109+0000","last_clean":"2023-11-28T16:58:59.627109+0000","last_became_active":"2023-11-28T16:58:57.315129+0000","last_became_peered":"2023-11-28T16:58:57.315129+0000","last_unstale":"2023-11-28T16:58:59.627109+0000","last_undegraded":"2023-11-28T16:58:59.627109+0000","last_fullsized":"2023-11-28T16:58:59.627109+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610931+0000","last_change":"2023-11-28T16:58:56.857953+0000","last_active":"2023-11-28T16:58:59.610931+0000","last_peered":"2023-11-28T16:58:59.610931+0000","last_clean":"2023-11-28T16:58:59.610931+0000","last_became_active":"2023-11-28T16:58:56.857667+0000","last_became_peered":"2023-11-28T16:58:56.857667+0000","last_unstale":"2023-11-28T16:58:59.610931+0000","last_undegraded":"2023-11-28T16:58:59.610931+0000","last_fullsized":"2023-11-28T16:58:59.610931+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:40.543279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327475+0000","last_change":"2023-11-28T16:59:09.327475+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327475+0000","last_undegraded":"2023-11-28T16:59:09.327475+0000","last_fullsized":"2023-11-28T16:59:09.327475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625704+0000","last_change":"2023-11-28T16:58:57.297598+0000","last_active":"2023-11-28T16:58:59.625704+0000","last_peered":"2023-11-28T16:58:59.625704+0000","last_clean":"2023-11-28T16:58:59.625704+0000","last_became_active":"2023-11-28T16:58:57.297333+0000","last_became_peered":"2023-11-28T16:58:57.297333+0000","last_unstale":"2023-11-28T16:58:59.625704+0000","last_undegraded":"2023-11-28T16:58:59.625704+0000","last_fullsized":"2023-11-28T16:58:59.625704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:53.515630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613993+0000","last_change":"2023-11-28T16:58:56.846299+0000","last_active":"2023-11-28T16:58:59.613993+0000","last_peered":"2023-11-28T16:58:59.613993+0000","last_clean":"2023-11-28T16:58:59.613993+0000","last_became_active":"2023-11-28T16:58:56.845923+0000","last_became_peered":"2023-11-28T16:58:56.845923+0000","last_unstale":"2023-11-28T16:58:59.613993+0000","last_undegraded":"2023-11-28T16:58:59.613993+0000","last_fullsized":"2023-11-28T16:58:59.613993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327838+0000","last_change":"2023-11-28T16:59:09.327838+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327838+0000","last_undegraded":"2023-11-28T16:59:09.327838+0000","last_fullsized":"2023-11-28T16:59:09.327838+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613974+0000","last_change":"2023-11-28T16:58:57.302610+0000","last_active":"2023-11-28T16:58:59.613974+0000","last_peered":"2023-11-28T16:58:59.613974+0000","last_clean":"2023-11-28T16:58:59.613974+0000","last_became_active":"2023-11-28T16:58:57.301748+0000","last_became_peered":"2023-11-28T16:58:57.301748+0000","last_unstale":"2023-11-28T16:58:59.613974+0000","last_undegraded":"2023-11-28T16:58:59.613974+0000","last_fullsized":"2023-11-28T16:58:59.613974+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613910+0000","last_change":"2023-11-28T16:58:56.849775+0000","last_active":"2023-11-28T16:58:59.613910+0000","last_peered":"2023-11-28T16:58:59.613910+0000","last_clean":"2023-11-28T16:58:59.613910+0000","last_became_active":"2023-11-28T16:58:56.849503+0000","last_became_peered":"2023-11-28T16:58:56.849503+0000","last_unstale":"2023-11-28T16:58:59.613910+0000","last_undegraded":"2023-11-28T16:58:59.613910+0000","last_fullsized":"2023-11-28T16:58:59.613910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327407+0000","last_change":"2023-11-28T16:59:09.327407+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327407+0000","last_undegraded":"2023-11-28T16:59:09.327407+0000","last_fullsized":"2023-11-28T16:59:09.327407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626696+0000","last_change":"2023-11-28T16:58:57.305447+0000","last_active":"2023-11-28T16:58:59.626696+0000","last_peered":"2023-11-28T16:58:59.626696+0000","last_clean":"2023-11-28T16:58:59.626696+0000","last_became_active":"2023-11-28T16:58:57.303738+0000","last_became_peered":"2023-11-28T16:58:57.303738+0000","last_unstale":"2023-11-28T16:58:59.626696+0000","last_undegraded":"2023-11-28T16:58:59.626696+0000","last_fullsized":"2023-11-28T16:58:59.626696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610838+0000","last_change":"2023-11-28T16:58:56.851226+0000","last_active":"2023-11-28T16:58:59.610838+0000","last_peered":"2023-11-28T16:58:59.610838+0000","last_clean":"2023-11-28T16:58:59.610838+0000","last_became_active":"2023-11-28T16:58:56.850870+0000","last_became_peered":"2023-11-28T16:58:56.850870+0000","last_unstale":"2023-11-28T16:58:59.610838+0000","last_undegraded":"2023-11-28T16:58:59.610838+0000","last_fullsized":"2023-11-28T16:58:59.610838+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.323304+0000","last_change":"2023-11-28T16:59:09.323304+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.323304+0000","last_undegraded":"2023-11-28T16:59:09.323304+0000","last_fullsized":"2023-11-28T16:59:09.323304+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.609334+0000","last_change":"2023-11-28T16:58:57.305573+0000","last_active":"2023-11-28T16:58:59.609334+0000","last_peered":"2023-11-28T16:58:59.609334+0000","last_clean":"2023-11-28T16:58:59.609334+0000","last_became_active":"2023-11-28T16:58:57.299574+0000","last_became_peered":"2023-11-28T16:58:57.299574+0000","last_unstale":"2023-11-28T16:58:59.609334+0000","last_undegraded":"2023-11-28T16:58:59.609334+0000","last_fullsized":"2023-11-28T16:58:59.609334+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625377+0000","last_change":"2023-11-28T16:58:56.849113+0000","last_active":"2023-11-28T16:58:59.625377+0000","last_peered":"2023-11-28T16:58:59.625377+0000","last_clean":"2023-11-28T16:58:59.625377+0000","last_became_active":"2023-11-28T16:58:56.848817+0000","last_became_peered":"2023-11-28T16:58:56.848817+0000","last_unstale":"2023-11-28T16:58:59.625377+0000","last_undegraded":"2023-11-28T16:58:59.625377+0000","last_fullsized":"2023-11-28T16:58:59.625377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:29.256426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324476+0000","last_change":"2023-11-28T16:59:09.324476+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324476+0000","last_undegraded":"2023-11-28T16:59:09.324476+0000","last_fullsized":"2023-11-28T16:59:09.324476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.609368+0000","last_change":"2023-11-28T16:58:57.308897+0000","last_active":"2023-11-28T16:58:59.609368+0000","last_peered":"2023-11-28T16:58:59.609368+0000","last_clean":"2023-11-28T16:58:59.609368+0000","last_became_active":"2023-11-28T16:58:57.308635+0000","last_became_peered":"2023-11-28T16:58:57.308635+0000","last_unstale":"2023-11-28T16:58:59.609368+0000","last_undegraded":"2023-11-28T16:58:59.609368+0000","last_fullsized":"2023-11-28T16:58:59.609368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613892+0000","last_change":"2023-11-28T16:58:56.859941+0000","last_active":"2023-11-28T16:58:59.613892+0000","last_peered":"2023-11-28T16:58:59.613892+0000","last_clean":"2023-11-28T16:58:59.613892+0000","last_became_active":"2023-11-28T16:58:56.859614+0000","last_became_peered":"2023-11-28T16:58:56.859614+0000","last_unstale":"2023-11-28T16:58:59.613892+0000","last_undegraded":"2023-11-28T16:58:59.613892+0000","last_fullsized":"2023-11-28T16:58:59.613892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324167+0000","last_change":"2023-11-28T16:59:09.324167+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324167+0000","last_undegraded":"2023-11-28T16:59:09.324167+0000","last_fullsized":"2023-11-28T16:59:09.324167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.627005+0000","last_change":"2023-11-28T16:58:57.318731+0000","last_active":"2023-11-28T16:58:59.627005+0000","last_peered":"2023-11-28T16:58:59.627005+0000","last_clean":"2023-11-28T16:58:59.627005+0000","last_became_active":"2023-11-28T16:58:57.318407+0000","last_became_peered":"2023-11-28T16:58:57.318407+0000","last_unstale":"2023-11-28T16:58:59.627005+0000","last_undegraded":"2023-11-28T16:58:59.627005+0000","last_fullsized":"2023-11-28T16:58:59.627005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613816+0000","last_change":"2023-11-28T16:58:56.851849+0000","last_active":"2023-11-28T16:58:59.613816+0000","last_peered":"2023-11-28T16:58:59.613816+0000","last_clean":"2023-11-28T16:58:59.613816+0000","last_became_active":"2023-11-28T16:58:56.851487+0000","last_became_peered":"2023-11-28T16:58:56.851487+0000","last_unstale":"2023-11-28T16:58:59.613816+0000","last_undegraded":"2023-11-28T16:58:59.613816+0000","last_fullsized":"2023-11-28T16:58:59.613816+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:15.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327873+0000","last_change":"2023-11-28T16:59:09.327873+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327873+0000","last_undegraded":"2023-11-28T16:59:09.327873+0000","last_fullsized":"2023-11-28T16:59:09.327873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610909+0000","last_change":"2023-11-28T16:58:57.308250+0000","last_active":"2023-11-28T16:58:59.610909+0000","last_peered":"2023-11-28T16:58:59.610909+0000","last_clean":"2023-11-28T16:58:59.610909+0000","last_became_active":"2023-11-28T16:58:57.307951+0000","last_became_peered":"2023-11-28T16:58:57.307951+0000","last_unstale":"2023-11-28T16:58:59.610909+0000","last_undegraded":"2023-11-28T16:58:59.610909+0000","last_fullsized":"2023-11-28T16:58:59.610909+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613771+0000","last_change":"2023-11-28T16:58:56.858285+0000","last_active":"2023-11-28T16:58:59.613771+0000","last_peered":"2023-11-28T16:58:59.613771+0000","last_clean":"2023-11-28T16:58:59.613771+0000","last_became_active":"2023-11-28T16:58:56.857956+0000","last_became_peered":"2023-11-28T16:58:56.857956+0000","last_unstale":"2023-11-28T16:58:59.613771+0000","last_undegraded":"2023-11-28T16:58:59.613771+0000","last_fullsized":"2023-11-28T16:58:59.613771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327577+0000","last_change":"2023-11-28T16:59:09.327577+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327577+0000","last_undegraded":"2023-11-28T16:59:09.327577+0000","last_fullsized":"2023-11-28T16:59:09.327577+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614041+0000","last_change":"2023-11-28T16:58:57.305562+0000","last_active":"2023-11-28T16:58:59.614041+0000","last_peered":"2023-11-28T16:58:59.614041+0000","last_clean":"2023-11-28T16:58:59.614041+0000","last_became_active":"2023-11-28T16:58:57.305130+0000","last_became_peered":"2023-11-28T16:58:57.305130+0000","last_unstale":"2023-11-28T16:58:59.614041+0000","last_undegraded":"2023-11-28T16:58:59.614041+0000","last_fullsized":"2023-11-28T16:58:59.614041+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"69'8","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:59:05.759352+0000","last_change":"2023-11-28T16:58:56.856203+0000","last_active":"2023-11-28T16:59:05.759352+0000","last_peered":"2023-11-28T16:59:05.759352+0000","last_clean":"2023-11-28T16:59:05.759352+0000","last_became_active":"2023-11-28T16:58:56.855887+0000","last_became_peered":"2023-11-28T16:58:56.855887+0000","last_unstale":"2023-11-28T16:59:05.759352+0000","last_undegraded":"2023-11-28T16:59:05.759352+0000","last_fullsized":"2023-11-28T16:59:05.759352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324407+0000","last_change":"2023-11-28T16:59:09.324407+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324407+0000","last_undegraded":"2023-11-28T16:59:09.324407+0000","last_fullsized":"2023-11-28T16:59:09.324407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610859+0000","last_change":"2023-11-28T16:58:57.302777+0000","last_active":"2023-11-28T16:58:59.610859+0000","last_peered":"2023-11-28T16:58:59.610859+0000","last_clean":"2023-11-28T16:58:59.610859+0000","last_became_active":"2023-11-28T16:58:57.302479+0000","last_became_peered":"2023-11-28T16:58:57.302479+0000","last_unstale":"2023-11-28T16:58:59.610859+0000","last_undegraded":"2023-11-28T16:58:59.610859+0000","last_fullsized":"2023-11-28T16:58:59.610859+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625547+0000","last_change":"2023-11-28T16:58:56.846727+0000","last_active":"2023-11-28T16:58:59.625547+0000","last_peered":"2023-11-28T16:58:59.625547+0000","last_clean":"2023-11-28T16:58:59.625547+0000","last_became_active":"2023-11-28T16:58:56.846403+0000","last_became_peered":"2023-11-28T16:58:56.846403+0000","last_unstale":"2023-11-28T16:58:59.625547+0000","last_undegraded":"2023-11-28T16:58:59.625547+0000","last_fullsized":"2023-11-28T16:58:59.625547+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:42.852604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327307+0000","last_change":"2023-11-28T16:59:09.327307+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327307+0000","last_undegraded":"2023-11-28T16:59:09.327307+0000","last_fullsized":"2023-11-28T16:59:09.327307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626977+0000","last_change":"2023-11-28T16:58:57.301185+0000","last_active":"2023-11-28T16:58:59.626977+0000","last_peered":"2023-11-28T16:58:59.626977+0000","last_clean":"2023-11-28T16:58:59.626977+0000","last_became_active":"2023-11-28T16:58:57.300882+0000","last_became_peered":"2023-11-28T16:58:57.300882+0000","last_unstale":"2023-11-28T16:58:59.626977+0000","last_undegraded":"2023-11-28T16:58:59.626977+0000","last_fullsized":"2023-11-28T16:58:59.626977+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.609346+0000","last_change":"2023-11-28T16:58:56.855489+0000","last_active":"2023-11-28T16:58:59.609346+0000","last_peered":"2023-11-28T16:58:59.609346+0000","last_clean":"2023-11-28T16:58:59.609346+0000","last_became_active":"2023-11-28T16:58:56.855127+0000","last_became_peered":"2023-11-28T16:58:56.855127+0000","last_unstale":"2023-11-28T16:58:59.609346+0000","last_undegraded":"2023-11-28T16:58:59.609346+0000","last_fullsized":"2023-11-28T16:58:59.609346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:03.854671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.329567+0000","last_change":"2023-11-28T16:59:09.329567+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.329567+0000","last_undegraded":"2023-11-28T16:59:09.329567+0000","last_fullsized":"2023-11-28T16:59:09.329567+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625326+0000","last_change":"2023-11-28T16:58:57.297734+0000","last_active":"2023-11-28T16:58:59.625326+0000","last_peered":"2023-11-28T16:58:59.625326+0000","last_clean":"2023-11-28T16:58:59.625326+0000","last_became_active":"2023-11-28T16:58:57.297456+0000","last_became_peered":"2023-11-28T16:58:57.297456+0000","last_unstale":"2023-11-28T16:58:59.625326+0000","last_undegraded":"2023-11-28T16:58:59.625326+0000","last_fullsized":"2023-11-28T16:58:59.625326+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:40:26.259309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626479+0000","last_change":"2023-11-28T16:58:56.852318+0000","last_active":"2023-11-28T16:58:59.626479+0000","last_peered":"2023-11-28T16:58:59.626479+0000","last_clean":"2023-11-28T16:58:59.626479+0000","last_became_active":"2023-11-28T16:58:56.851992+0000","last_became_peered":"2023-11-28T16:58:56.851992+0000","last_unstale":"2023-11-28T16:58:59.626479+0000","last_undegraded":"2023-11-28T16:58:59.626479+0000","last_fullsized":"2023-11-28T16:58:59.626479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.328131+0000","last_change":"2023-11-28T16:59:09.328131+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.328131+0000","last_undegraded":"2023-11-28T16:59:09.328131+0000","last_fullsized":"2023-11-28T16:59:09.328131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625278+0000","last_change":"2023-11-28T16:58:57.307166+0000","last_active":"2023-11-28T16:58:59.625278+0000","last_peered":"2023-11-28T16:58:59.625278+0000","last_clean":"2023-11-28T16:58:59.625278+0000","last_became_active":"2023-11-28T16:58:57.306917+0000","last_became_peered":"2023-11-28T16:58:57.306917+0000","last_unstale":"2023-11-28T16:58:59.625278+0000","last_undegraded":"2023-11-28T16:58:59.625278+0000","last_fullsized":"2023-11-28T16:58:59.625278+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:09.266608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610811+0000","last_change":"2023-11-28T16:58:56.858590+0000","last_active":"2023-11-28T16:58:59.610811+0000","last_peered":"2023-11-28T16:58:59.610811+0000","last_clean":"2023-11-28T16:58:59.610811+0000","last_became_active":"2023-11-28T16:58:56.858306+0000","last_became_peered":"2023-11-28T16:58:56.858306+0000","last_unstale":"2023-11-28T16:58:59.610811+0000","last_undegraded":"2023-11-28T16:58:59.610811+0000","last_fullsized":"2023-11-28T16:58:59.610811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327505+0000","last_change":"2023-11-28T16:59:09.327505+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327505+0000","last_undegraded":"2023-11-28T16:59:09.327505+0000","last_fullsized":"2023-11-28T16:59:09.327505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.627126+0000","last_change":"2023-11-28T16:58:57.310263+0000","last_active":"2023-11-28T16:58:59.627126+0000","last_peered":"2023-11-28T16:58:59.627126+0000","last_clean":"2023-11-28T16:58:59.627126+0000","last_became_active":"2023-11-28T16:58:57.309857+0000","last_became_peered":"2023-11-28T16:58:57.309857+0000","last_unstale":"2023-11-28T16:58:59.627126+0000","last_undegraded":"2023-11-28T16:58:59.627126+0000","last_fullsized":"2023-11-28T16:58:59.627126+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:06.013018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613908+0000","last_change":"2023-11-28T16:58:56.858637+0000","last_active":"2023-11-28T16:58:59.613908+0000","last_peered":"2023-11-28T16:58:59.613908+0000","last_clean":"2023-11-28T16:58:59.613908+0000","last_became_active":"2023-11-28T16:58:56.858330+0000","last_became_peered":"2023-11-28T16:58:56.858330+0000","last_unstale":"2023-11-28T16:58:59.613908+0000","last_undegraded":"2023-11-28T16:58:59.613908+0000","last_fullsized":"2023-11-28T16:58:59.613908+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.323572+0000","last_change":"2023-11-28T16:59:09.323572+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.323572+0000","last_undegraded":"2023-11-28T16:59:09.323572+0000","last_fullsized":"2023-11-28T16:59:09.323572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613859+0000","last_change":"2023-11-28T16:58:57.306363+0000","last_active":"2023-11-28T16:58:59.613859+0000","last_peered":"2023-11-28T16:58:59.613859+0000","last_clean":"2023-11-28T16:58:59.613859+0000","last_became_active":"2023-11-28T16:58:57.305727+0000","last_became_peered":"2023-11-28T16:58:57.305727+0000","last_unstale":"2023-11-28T16:58:59.613859+0000","last_undegraded":"2023-11-28T16:58:59.613859+0000","last_fullsized":"2023-11-28T16:58:59.613859+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.611013+0000","last_change":"2023-11-28T16:58:56.849263+0000","last_active":"2023-11-28T16:58:59.611013+0000","last_peered":"2023-11-28T16:58:59.611013+0000","last_clean":"2023-11-28T16:58:59.611013+0000","last_became_active":"2023-11-28T16:58:56.848949+0000","last_became_peered":"2023-11-28T16:58:56.848949+0000","last_unstale":"2023-11-28T16:58:59.611013+0000","last_undegraded":"2023-11-28T16:58:59.611013+0000","last_fullsized":"2023-11-28T16:58:59.611013+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324059+0000","last_change":"2023-11-28T16:59:09.324059+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324059+0000","last_undegraded":"2023-11-28T16:59:09.324059+0000","last_fullsized":"2023-11-28T16:59:09.324059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614060+0000","last_change":"2023-11-28T16:58:57.306164+0000","last_active":"2023-11-28T16:58:59.614060+0000","last_peered":"2023-11-28T16:58:59.614060+0000","last_clean":"2023-11-28T16:58:59.614060+0000","last_became_active":"2023-11-28T16:58:57.300959+0000","last_became_peered":"2023-11-28T16:58:57.300959+0000","last_unstale":"2023-11-28T16:58:59.614060+0000","last_undegraded":"2023-11-28T16:58:59.614060+0000","last_fullsized":"2023-11-28T16:58:59.614060+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610952+0000","last_change":"2023-11-28T16:58:56.850381+0000","last_active":"2023-11-28T16:58:59.610952+0000","last_peered":"2023-11-28T16:58:59.610952+0000","last_clean":"2023-11-28T16:58:59.610952+0000","last_became_active":"2023-11-28T16:58:56.850116+0000","last_became_peered":"2023-11-28T16:58:56.850116+0000","last_unstale":"2023-11-28T16:58:59.610952+0000","last_undegraded":"2023-11-28T16:58:59.610952+0000","last_fullsized":"2023-11-28T16:58:59.610952+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.330642+0000","last_change":"2023-11-28T16:59:09.330642+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.330642+0000","last_undegraded":"2023-11-28T16:59:09.330642+0000","last_fullsized":"2023-11-28T16:59:09.330642+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618436+0000","last_change":"2023-11-28T16:58:57.309597+0000","last_active":"2023-11-28T16:58:59.618436+0000","last_peered":"2023-11-28T16:58:59.618436+0000","last_clean":"2023-11-28T16:58:59.618436+0000","last_became_active":"2023-11-28T16:58:57.309372+0000","last_became_peered":"2023-11-28T16:58:57.309372+0000","last_unstale":"2023-11-28T16:58:59.618436+0000","last_undegraded":"2023-11-28T16:58:59.618436+0000","last_fullsized":"2023-11-28T16:58:59.618436+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:35.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.609357+0000","last_change":"2023-11-28T16:58:56.861806+0000","last_active":"2023-11-28T16:58:59.609357+0000","last_peered":"2023-11-28T16:58:59.609357+0000","last_clean":"2023-11-28T16:58:59.609357+0000","last_became_active":"2023-11-28T16:58:56.861498+0000","last_became_peered":"2023-11-28T16:58:56.861498+0000","last_unstale":"2023-11-28T16:58:59.609357+0000","last_undegraded":"2023-11-28T16:58:59.609357+0000","last_fullsized":"2023-11-28T16:58:59.609357+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.323267+0000","last_change":"2023-11-28T16:59:09.323267+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.323267+0000","last_undegraded":"2023-11-28T16:59:09.323267+0000","last_fullsized":"2023-11-28T16:59:09.323267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626570+0000","last_change":"2023-11-28T16:58:57.306140+0000","last_active":"2023-11-28T16:58:59.626570+0000","last_peered":"2023-11-28T16:58:59.626570+0000","last_clean":"2023-11-28T16:58:59.626570+0000","last_became_active":"2023-11-28T16:58:57.305865+0000","last_became_peered":"2023-11-28T16:58:57.305865+0000","last_unstale":"2023-11-28T16:58:59.626570+0000","last_undegraded":"2023-11-28T16:58:59.626570+0000","last_fullsized":"2023-11-28T16:58:59.626570+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618445+0000","last_change":"2023-11-28T16:58:56.855751+0000","last_active":"2023-11-28T16:58:59.618445+0000","last_peered":"2023-11-28T16:58:59.618445+0000","last_clean":"2023-11-28T16:58:59.618445+0000","last_became_active":"2023-11-28T16:58:56.855432+0000","last_became_peered":"2023-11-28T16:58:56.855432+0000","last_unstale":"2023-11-28T16:58:59.618445+0000","last_undegraded":"2023-11-28T16:58:59.618445+0000","last_fullsized":"2023-11-28T16:58:59.618445+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:24:24.546921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.323344+0000","last_change":"2023-11-28T16:59:09.323344+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.323344+0000","last_undegraded":"2023-11-28T16:59:09.323344+0000","last_fullsized":"2023-11-28T16:59:09.323344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618385+0000","last_change":"2023-11-28T16:58:57.307399+0000","last_active":"2023-11-28T16:58:59.618385+0000","last_peered":"2023-11-28T16:58:59.618385+0000","last_clean":"2023-11-28T16:58:59.618385+0000","last_became_active":"2023-11-28T16:58:57.307122+0000","last_became_peered":"2023-11-28T16:58:57.307122+0000","last_unstale":"2023-11-28T16:58:59.618385+0000","last_undegraded":"2023-11-28T16:58:59.618385+0000","last_fullsized":"2023-11-28T16:58:59.618385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:56:08.650099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.618417+0000","last_change":"2023-11-28T16:58:56.863311+0000","last_active":"2023-11-28T16:58:59.618417+0000","last_peered":"2023-11-28T16:58:59.618417+0000","last_clean":"2023-11-28T16:58:59.618417+0000","last_became_active":"2023-11-28T16:58:56.863048+0000","last_became_peered":"2023-11-28T16:58:56.863048+0000","last_unstale":"2023-11-28T16:58:59.618417+0000","last_undegraded":"2023-11-28T16:58:59.618417+0000","last_fullsized":"2023-11-28T16:58:59.618417+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:51.407849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.330706+0000","last_change":"2023-11-28T16:59:09.330706+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.330706+0000","last_undegraded":"2023-11-28T16:59:09.330706+0000","last_fullsized":"2023-11-28T16:59:09.330706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626373+0000","last_change":"2023-11-28T16:58:57.316056+0000","last_active":"2023-11-28T16:58:59.626373+0000","last_peered":"2023-11-28T16:58:59.626373+0000","last_clean":"2023-11-28T16:58:59.626373+0000","last_became_active":"2023-11-28T16:58:57.315754+0000","last_became_peered":"2023-11-28T16:58:57.315754+0000","last_unstale":"2023-11-28T16:58:59.626373+0000","last_undegraded":"2023-11-28T16:58:59.626373+0000","last_fullsized":"2023-11-28T16:58:59.626373+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:42.886026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.609310+0000","last_change":"2023-11-28T16:58:56.862068+0000","last_active":"2023-11-28T16:58:59.609310+0000","last_peered":"2023-11-28T16:58:59.609310+0000","last_clean":"2023-11-28T16:58:59.609310+0000","last_became_active":"2023-11-28T16:58:56.861701+0000","last_became_peered":"2023-11-28T16:58:56.861701+0000","last_unstale":"2023-11-28T16:58:59.609310+0000","last_undegraded":"2023-11-28T16:58:59.609310+0000","last_fullsized":"2023-11-28T16:58:59.609310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:32.676826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.325525+0000","last_change":"2023-11-28T16:59:09.325525+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.325525+0000","last_undegraded":"2023-11-28T16:59:09.325525+0000","last_fullsized":"2023-11-28T16:59:09.325525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614116+0000","last_change":"2023-11-28T16:58:57.310885+0000","last_active":"2023-11-28T16:58:59.614116+0000","last_peered":"2023-11-28T16:58:59.614116+0000","last_clean":"2023-11-28T16:58:59.614116+0000","last_became_active":"2023-11-28T16:58:57.310590+0000","last_became_peered":"2023-11-28T16:58:57.310590+0000","last_unstale":"2023-11-28T16:58:59.614116+0000","last_undegraded":"2023-11-28T16:58:59.614116+0000","last_fullsized":"2023-11-28T16:58:59.614116+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625912+0000","last_change":"2023-11-28T16:58:56.859076+0000","last_active":"2023-11-28T16:58:59.625912+0000","last_peered":"2023-11-28T16:58:59.625912+0000","last_clean":"2023-11-28T16:58:59.625912+0000","last_became_active":"2023-11-28T16:58:56.858792+0000","last_became_peered":"2023-11-28T16:58:56.858792+0000","last_unstale":"2023-11-28T16:58:59.625912+0000","last_undegraded":"2023-11-28T16:58:59.625912+0000","last_fullsized":"2023-11-28T16:58:59.625912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:46.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327501+0000","last_change":"2023-11-28T16:59:09.327501+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327501+0000","last_undegraded":"2023-11-28T16:59:09.327501+0000","last_fullsized":"2023-11-28T16:59:09.327501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.627188+0000","last_change":"2023-11-28T16:58:57.310281+0000","last_active":"2023-11-28T16:58:59.627188+0000","last_peered":"2023-11-28T16:58:59.627188+0000","last_clean":"2023-11-28T16:58:59.627188+0000","last_became_active":"2023-11-28T16:58:57.308492+0000","last_became_peered":"2023-11-28T16:58:57.308492+0000","last_unstale":"2023-11-28T16:58:59.627188+0000","last_undegraded":"2023-11-28T16:58:59.627188+0000","last_fullsized":"2023-11-28T16:58:59.627188+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:25:13.583829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"69'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:59:01.920991+0000","last_change":"2023-11-28T16:58:56.848509+0000","last_active":"2023-11-28T16:59:01.920991+0000","last_peered":"2023-11-28T16:59:01.920991+0000","last_clean":"2023-11-28T16:59:01.920991+0000","last_became_active":"2023-11-28T16:58:56.847800+0000","last_became_peered":"2023-11-28T16:58:56.847800+0000","last_unstale":"2023-11-28T16:59:01.920991+0000","last_undegraded":"2023-11-28T16:59:01.920991+0000","last_fullsized":"2023-11-28T16:59:01.920991+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:56.437961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.330680+0000","last_change":"2023-11-28T16:59:09.330680+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.330680+0000","last_undegraded":"2023-11-28T16:59:09.330680+0000","last_fullsized":"2023-11-28T16:59:09.330680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613738+0000","last_change":"2023-11-28T16:58:57.316240+0000","last_active":"2023-11-28T16:58:59.613738+0000","last_peered":"2023-11-28T16:58:59.613738+0000","last_clean":"2023-11-28T16:58:59.613738+0000","last_became_active":"2023-11-28T16:58:57.315895+0000","last_became_peered":"2023-11-28T16:58:57.315895+0000","last_unstale":"2023-11-28T16:58:59.613738+0000","last_undegraded":"2023-11-28T16:58:59.613738+0000","last_fullsized":"2023-11-28T16:58:59.613738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:01.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613789+0000","last_change":"2023-11-28T16:58:56.862862+0000","last_active":"2023-11-28T16:58:59.613789+0000","last_peered":"2023-11-28T16:58:59.613789+0000","last_clean":"2023-11-28T16:58:59.613789+0000","last_became_active":"2023-11-28T16:58:56.862564+0000","last_became_peered":"2023-11-28T16:58:56.862564+0000","last_unstale":"2023-11-28T16:58:59.613789+0000","last_undegraded":"2023-11-28T16:58:59.613789+0000","last_fullsized":"2023-11-28T16:58:59.613789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324498+0000","last_change":"2023-11-28T16:59:09.324498+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324498+0000","last_undegraded":"2023-11-28T16:59:09.324498+0000","last_fullsized":"2023-11-28T16:59:09.324498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.614079+0000","last_change":"2023-11-28T16:58:57.305378+0000","last_active":"2023-11-28T16:58:59.614079+0000","last_peered":"2023-11-28T16:58:59.614079+0000","last_clean":"2023-11-28T16:58:59.614079+0000","last_became_active":"2023-11-28T16:58:57.304738+0000","last_became_peered":"2023-11-28T16:58:57.304738+0000","last_unstale":"2023-11-28T16:58:59.614079+0000","last_undegraded":"2023-11-28T16:58:59.614079+0000","last_fullsized":"2023-11-28T16:58:59.614079+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613753+0000","last_change":"2023-11-28T16:58:56.860344+0000","last_active":"2023-11-28T16:58:59.613753+0000","last_peered":"2023-11-28T16:58:59.613753+0000","last_clean":"2023-11-28T16:58:59.613753+0000","last_became_active":"2023-11-28T16:58:56.859853+0000","last_became_peered":"2023-11-28T16:58:56.859853+0000","last_unstale":"2023-11-28T16:58:59.613753+0000","last_undegraded":"2023-11-28T16:58:59.613753+0000","last_fullsized":"2023-11-28T16:58:59.613753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.326975+0000","last_change":"2023-11-28T16:59:09.326975+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.326975+0000","last_undegraded":"2023-11-28T16:59:09.326975+0000","last_fullsized":"2023-11-28T16:59:09.326975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626584+0000","last_change":"2023-11-28T16:58:57.306938+0000","last_active":"2023-11-28T16:58:59.626584+0000","last_peered":"2023-11-28T16:58:59.626584+0000","last_clean":"2023-11-28T16:58:59.626584+0000","last_became_active":"2023-11-28T16:58:57.306452+0000","last_became_peered":"2023-11-28T16:58:57.306452+0000","last_unstale":"2023-11-28T16:58:59.626584+0000","last_undegraded":"2023-11-28T16:58:59.626584+0000","last_fullsized":"2023-11-28T16:58:59.626584+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610892+0000","last_change":"2023-11-28T16:58:56.858723+0000","last_active":"2023-11-28T16:58:59.610892+0000","last_peered":"2023-11-28T16:58:59.610892+0000","last_clean":"2023-11-28T16:58:59.610892+0000","last_became_active":"2023-11-28T16:58:56.858282+0000","last_became_peered":"2023-11-28T16:58:56.858282+0000","last_unstale":"2023-11-28T16:58:59.610892+0000","last_undegraded":"2023-11-28T16:58:59.610892+0000","last_fullsized":"2023-11-28T16:58:59.610892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327465+0000","last_change":"2023-11-28T16:59:09.327465+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327465+0000","last_undegraded":"2023-11-28T16:59:09.327465+0000","last_fullsized":"2023-11-28T16:59:09.327465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.610876+0000","last_change":"2023-11-28T16:58:57.305002+0000","last_active":"2023-11-28T16:58:59.610876+0000","last_peered":"2023-11-28T16:58:59.610876+0000","last_clean":"2023-11-28T16:58:59.610876+0000","last_became_active":"2023-11-28T16:58:57.304759+0000","last_became_peered":"2023-11-28T16:58:57.304759+0000","last_unstale":"2023-11-28T16:58:59.610876+0000","last_undegraded":"2023-11-28T16:58:59.610876+0000","last_fullsized":"2023-11-28T16:58:59.610876+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613933+0000","last_change":"2023-11-28T16:58:56.848645+0000","last_active":"2023-11-28T16:58:59.613933+0000","last_peered":"2023-11-28T16:58:59.613933+0000","last_clean":"2023-11-28T16:58:59.613933+0000","last_became_active":"2023-11-28T16:58:56.848300+0000","last_became_peered":"2023-11-28T16:58:56.848300+0000","last_unstale":"2023-11-28T16:58:59.613933+0000","last_undegraded":"2023-11-28T16:58:59.613933+0000","last_fullsized":"2023-11-28T16:58:59.613933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.323938+0000","last_change":"2023-11-28T16:59:09.323938+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.323938+0000","last_undegraded":"2023-11-28T16:59:09.323938+0000","last_fullsized":"2023-11-28T16:59:09.323938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626801+0000","last_change":"2023-11-28T16:58:57.299433+0000","last_active":"2023-11-28T16:58:59.626801+0000","last_peered":"2023-11-28T16:58:59.626801+0000","last_clean":"2023-11-28T16:58:59.626801+0000","last_became_active":"2023-11-28T16:58:57.299098+0000","last_became_peered":"2023-11-28T16:58:57.299098+0000","last_unstale":"2023-11-28T16:58:59.626801+0000","last_undegraded":"2023-11-28T16:58:59.626801+0000","last_fullsized":"2023-11-28T16:58:59.626801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613683+0000","last_change":"2023-11-28T16:58:56.855829+0000","last_active":"2023-11-28T16:58:59.613683+0000","last_peered":"2023-11-28T16:58:59.613683+0000","last_clean":"2023-11-28T16:58:59.613683+0000","last_became_active":"2023-11-28T16:58:56.855381+0000","last_became_peered":"2023-11-28T16:58:56.855381+0000","last_unstale":"2023-11-28T16:58:59.613683+0000","last_undegraded":"2023-11-28T16:58:59.613683+0000","last_fullsized":"2023-11-28T16:58:59.613683+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:41.581251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.327503+0000","last_change":"2023-11-28T16:59:09.327503+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.327503+0000","last_undegraded":"2023-11-28T16:59:09.327503+0000","last_fullsized":"2023-11-28T16:59:09.327503+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613666+0000","last_change":"2023-11-28T16:58:57.316272+0000","last_active":"2023-11-28T16:58:59.613666+0000","last_peered":"2023-11-28T16:58:59.613666+0000","last_clean":"2023-11-28T16:58:59.613666+0000","last_became_active":"2023-11-28T16:58:57.315990+0000","last_became_peered":"2023-11-28T16:58:57.315990+0000","last_unstale":"2023-11-28T16:58:59.613666+0000","last_undegraded":"2023-11-28T16:58:59.613666+0000","last_fullsized":"2023-11-28T16:58:59.613666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.613868+0000","last_change":"2023-11-28T16:58:56.847748+0000","last_active":"2023-11-28T16:58:59.613868+0000","last_peered":"2023-11-28T16:58:59.613868+0000","last_clean":"2023-11-28T16:58:59.613868+0000","last_became_active":"2023-11-28T16:58:56.847459+0000","last_became_peered":"2023-11-28T16:58:56.847459+0000","last_unstale":"2023-11-28T16:58:59.613868+0000","last_undegraded":"2023-11-28T16:58:59.613868+0000","last_fullsized":"2023-11-28T16:58:59.613868+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:03.416274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T16:59:10.319344+0000","last_change":"2023-11-28T16:59:10.319344+0000","last_active":"2023-11-28T16:59:10.319344+0000","last_peered":"2023-11-28T16:59:10.319344+0000","last_clean":"2023-11-28T16:59:10.319344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:10.319344+0000","last_undegraded":"2023-11-28T16:59:10.319344+0000","last_fullsized":"2023-11-28T16:59:10.319344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-11-28T16:59:09.324881+0000","last_change":"2023-11-28T16:59:09.324881+0000","last_active":"2023-11-28T16:59:09.310075+0000","last_peered":"2023-11-28T16:59:09.310075+0000","last_clean":"2023-11-28T16:59:09.310075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T16:59:09.324881+0000","last_undegraded":"2023-11-28T16:59:09.324881+0000","last_fullsized":"2023-11-28T16:59:09.324881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.625651+0000","last_change":"2023-11-28T16:58:57.306584+0000","last_active":"2023-11-28T16:58:59.625651+0000","last_peered":"2023-11-28T16:58:59.625651+0000","last_clean":"2023-11-28T16:58:59.625651+0000","last_became_active":"2023-11-28T16:58:57.306137+0000","last_became_peered":"2023-11-28T16:58:57.306137+0000","last_unstale":"2023-11-28T16:58:59.625651+0000","last_undegraded":"2023-11-28T16:58:59.625651+0000","last_fullsized":"2023-11-28T16:58:59.625651+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:50.842606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.627194+0000","last_change":"2023-11-28T16:58:56.863771+0000","last_active":"2023-11-28T16:58:59.627194+0000","last_peered":"2023-11-28T16:58:59.627194+0000","last_clean":"2023-11-28T16:58:59.627194+0000","last_became_active":"2023-11-28T16:58:56.863302+0000","last_became_peered":"2023-11-28T16:58:56.863302+0000","last_unstale":"2023-11-28T16:58:59.627194+0000","last_undegraded":"2023-11-28T16:58:59.627194+0000","last_fullsized":"2023-11-28T16:58:59.627194+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:26.909196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T16:58:59.626910+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:58:59.626910+0000","last_peered":"2023-11-28T16:58:59.626910+0000","last_clean":"2023-11-28T16:58:59.626910+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:58:59.626910+0000","last_undegraded":"2023-11-28T16:58:59.626910+0000","last_fullsized":"2023-11-28T16:58:59.626910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1445888,"data_stored":960276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83099999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51500000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89600000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.62},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.85199999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81999999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.52100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.179,"15min":1.179},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.407,"15min":1.407},"last":0.84399999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91900000000000004,"5min":1.204,"15min":1.204},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.554,"15min":1.554},"last":0.75700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":370532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.69699999999999995},"min":{"1min":0.46200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.84699999999999998,"5min":1.474,"15min":1.474},"last":0.63},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.749,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.754,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.88,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91300000000000003,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":1.038,"15min":1.038},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.071,"15min":1.071},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85999999999999999,"5min":1.367,"15min":1.367},"last":0.58999999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.022,"5min":1.401,"15min":1.401},"last":0.747}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.82299999999999995,"15min":0.873},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86399999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":372967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51100000000000001}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.503,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65100000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82599999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72699999999999998}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.876,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64800000000000002,"15min":0.67500000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.55900000000000005}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":369838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.66800000000000004},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70599999999999996,"15min":0.73499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.234,"15min":1.234},"last":0.752}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.964,"15min":1.964},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0449999999999999,"5min":1.704,"15min":1.704},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92000000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.79600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98199999999999998,"5min":1.254,"15min":1.254},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98399999999999999,"5min":1.548,"15min":1.548},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.498},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.81699999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.755},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89500000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":1.218,"15min":1.218},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.0780000000000001,"5min":1.593,"15min":1.593},"last":0.80500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":860160,"data_stored":372945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.626,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.626},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64600000000000002,"5min":0.745,"15min":0.745},"last":0.59899999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57999999999999996,"5min":0.874,"15min":0.874},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.5,"15min":0.505},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.304,"15min":1.304},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":1.502,"15min":1.502},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":1.21,"15min":1.21},"last":0.66200000000000003}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.018}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.05},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97099999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.97099999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94999999999999996,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.94999999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80100000000000005,"15min":0.82799999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.25,"15min":1.25},"last":0.999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0720000000000001,"5min":1.423,"15min":1.423},"last":1.0720000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":370420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.44},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.41499999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71499999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.65800000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.872},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83099999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92500000000000004,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":370032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.439}]},{"osd":2,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78300000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.446,"15min":1.446},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0980000000000001,"5min":1.47,"15min":1.47},"last":0.74299999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.056,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.57399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.327,"15min":1.327},"last":0.84299999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98299999999999998,"5min":1.3,"15min":1.3},"last":0.752},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.526,"15min":1.526},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80600000000000005,"15min":0.83399999999999996},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95399999999999996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1445888,"data_stored":960240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.55100000000000005,"5min":1.085,"15min":1.085},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.436}]},{"osd":2,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71599999999999997,"15min":0.75900000000000001},"min":{"1min":0.318,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.39300000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52200000000000002,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.63100000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7290000000000001,"5min":1.859,"15min":1.859},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":1.462,"15min":1.462},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77100000000000002,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6060000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.038,"5min":1.323,"15min":1.323},"last":0.67500000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.069,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6619999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.61899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:15.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.652+0000 7f01e433e640 1 Processor -- start 2023-11-28T16:59:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.652+0000 7f01e433e640 1 -- start start 2023-11-28T16:59:15.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e433e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01dc14e9d0 0x7f01dc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e433e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc0a8470 0x7f01dc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e433e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc06d320 con 0x7f01dc070b80 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e433e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc0721b0 con 0x7f01dc14e9d0 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e433e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0c2830 con 0x7f01dc0a8470 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01dc14e9d0 0x7f01dc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01dc14e9d0 0x7f01dc151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36916/0 (socket says 172.21.15.26:36916) 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 -- 172.21.15.26:0/4037723073 learned_addr learned my addr 172.21.15.26:0/4037723073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e28db640 1 --2- 172.21.15.26:0/4037723073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc0a8470 0x7f01dc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 -- 172.21.15.26:0/4037723073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc0a8470 msgr2=0x7f01dc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 --2- 172.21.15.26:0/4037723073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc0a8470 0x7f01dc06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 -- 172.21.15.26:0/4037723073 >> v1:172.21.15.79:6789/0 conn(0x7f01dc070b80 legacy=0x7f01dc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 -- 172.21.15.26:0/4037723073 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc072450 con 0x7f01dc14e9d0 2023-11-28T16:59:15.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.656+0000 7f01e20da640 1 --2- 172.21.15.26:0/4037723073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc14e9d0 0x7f01dc151e60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009870 tx=0x7f01d801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d9ca5fc1871f16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:15.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e10d8640 1 -- 172.21.15.26:0/4037723073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80ac620 con 0x7f01dc14e9d0 2023-11-28T16:59:15.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e10d8640 1 -- 172.21.15.26:0/4037723073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80ac780 con 0x7f01dc14e9d0 2023-11-28T16:59:15.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e10d8640 1 -- 172.21.15.26:0/4037723073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80acb10 con 0x7f01dc14e9d0 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- 172.21.15.26:0/4037723073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc14e9d0 msgr2=0x7f01dc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 --2- 172.21.15.26:0/4037723073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc14e9d0 0x7f01dc151e60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009870 tx=0x7f01d801c4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- 172.21.15.26:0/4037723073 shutdown_connections 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 --2- 172.21.15.26:0/4037723073 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc0a8470 0x7f01dc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 --2- 172.21.15.26:0/4037723073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc14e9d0 0x7f01dc151e60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- 172.21.15.26:0/4037723073 >> 172.21.15.26:0/4037723073 conn(0x7f01dc0c2ad0 msgr2=0x7f01dc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- 172.21.15.26:0/4037723073 shutdown_connections 2023-11-28T16:59:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- 172.21.15.26:0/4037723073 wait complete. 2023-11-28T16:59:15.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 Processor -- start 2023-11-28T16:59:15.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- start start 2023-11-28T16:59:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc070b80 0x7f01dc15e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0a8470 0x7f01dc1f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc14e9d0 0x7f01dc1f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc146ab0 con 0x7f01dc0a8470 2023-11-28T16:59:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0abea0 con 0x7f01dc070b80 2023-11-28T16:59:15.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e433e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0ac180 con 0x7f01dc14e9d0 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e18d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0a8470 0x7f01dc1f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e18d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0a8470 0x7f01dc1f0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36928/0 (socket says 172.21.15.26:36928) 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.660+0000 7f01e18d9640 1 -- 172.21.15.26:0/1665258851 learned_addr learned my addr 172.21.15.26:0/1665258851 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e20da640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc070b80 0x7f01dc15e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e28db640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc14e9d0 0x7f01dc1f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e18d9640 1 -- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc14e9d0 msgr2=0x7f01dc1f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e18d9640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc14e9d0 0x7f01dc1f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e18d9640 1 -- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc070b80 msgr2=0x7f01dc15e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e18d9640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc070b80 0x7f01dc15e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e18d9640 1 -- 172.21.15.26:0/1665258851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80094d0 con 0x7f01dc0a8470 2023-11-28T16:59:15.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e18d9640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0a8470 0x7f01dc1f0a60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c4d0 tx=0x7f01cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:15.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01d2ffd640 1 -- 172.21.15.26:0/1665258851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0052d0 con 0x7f01dc0a8470 2023-11-28T16:59:15.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01d2ffd640 1 -- 172.21.15.26:0/1665258851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc005430 con 0x7f01dc0a8470 2023-11-28T16:59:15.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01d2ffd640 1 -- 172.21.15.26:0/1665258851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc012830 con 0x7f01dc0a8470 2023-11-28T16:59:15.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc146d00 con 0x7f01dc0a8470 2023-11-28T16:59:15.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc0c5ba0 con 0x7f01dc0a8470 2023-11-28T16:59:15.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc147220 con 0x7f01dc0a8470 2023-11-28T16:59:15.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.664+0000 7f01d2ffd640 1 -- 172.21.15.26:0/1665258851 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f01cc012990 con 0x7f01dc0a8470 2023-11-28T16:59:15.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.668+0000 7f01d2ffd640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c0066900 0x7f01c0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:15.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.668+0000 7f01d2ffd640 1 -- 172.21.15.26:0/1665258851 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f01cc084180 con 0x7f01dc0a8470 2023-11-28T16:59:15.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.668+0000 7f01e20da640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c0066900 0x7f01c0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:15.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.668+0000 7f01e20da640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c0066900 0x7f01c0068dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f01d80ae000 tx=0x7f01d80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:15.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.672+0000 7f01d2ffd640 1 -- 172.21.15.26:0/1665258851 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01dc147220 con 0x7f01dc0a8470 2023-11-28T16:59:15.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.824+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01dc15c570 con 0x7f01c0066900 2023-11-28T16:59:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.840+0000 7f01d2ffd640 1 -- 172.21.15.26:0/1665258851 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527226 (secure 0 0 0) 0x7f01d80ac8f0 con 0x7f01c0066900 2023-11-28T16:59:15.848 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:15.853 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c0066900 msgr2=0x7f01c0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c0066900 0x7f01c0068dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f01d80ae000 tx=0x7f01d80a7000 comp rx=0 tx=0).stop 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0a8470 msgr2=0x7f01dc1f0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0a8470 0x7f01dc1f0a60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c4d0 tx=0x7f01cc00c990 comp rx=0 tx=0).stop 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 shutdown_connections 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01c0066900 0x7f01c0068dc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01dc14e9d0 0x7f01dc1f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0a8470 0x7f01dc1f0a60 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 --2- 172.21.15.26:0/1665258851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc070b80 0x7f01dc15e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:15.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 >> 172.21.15.26:0/1665258851 conn(0x7f01dc0c2ad0 msgr2=0x7f01dc142890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:15.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 shutdown_connections 2023-11-28T16:59:15.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:15.844+0000 7f01e433e640 1 -- 172.21.15.26:0/1665258851 wait complete. 2023-11-28T16:59:15.867 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-11-28T16:59:15.618756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":342,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249432,"kb_used_data":8296,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725288,"statfs":{"total":773094113280,"available":772838694912,"internally_reserved":0,"allocated":8495104,"data_stored":4380798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001705"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.425809+0000","last_change":"2023-11-28T16:59:11.368458+0000","last_active":"2023-11-28T16:59:12.425809+0000","last_peered":"2023-11-28T16:59:12.425809+0000","last_clean":"2023-11-28T16:59:12.425809+0000","last_became_active":"2023-11-28T16:59:11.368191+0000","last_became_peered":"2023-11-28T16:59:11.368191+0000","last_unstale":"2023-11-28T16:59:12.425809+0000","last_undegraded":"2023-11-28T16:59:12.425809+0000","last_fullsized":"2023-11-28T16:59:12.425809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:27.977687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348498+0000","last_change":"2023-11-28T16:58:57.314088+0000","last_active":"2023-11-28T16:59:11.348498+0000","last_peered":"2023-11-28T16:59:11.348498+0000","last_clean":"2023-11-28T16:59:11.348498+0000","last_became_active":"2023-11-28T16:58:57.312523+0000","last_became_peered":"2023-11-28T16:58:57.312523+0000","last_unstale":"2023-11-28T16:59:11.348498+0000","last_undegraded":"2023-11-28T16:59:11.348498+0000","last_fullsized":"2023-11-28T16:59:11.348498+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423818+0000","last_change":"2023-11-28T16:59:11.368562+0000","last_active":"2023-11-28T16:59:12.423818+0000","last_peered":"2023-11-28T16:59:12.423818+0000","last_clean":"2023-11-28T16:59:12.423818+0000","last_became_active":"2023-11-28T16:59:11.366494+0000","last_became_peered":"2023-11-28T16:59:11.366494+0000","last_unstale":"2023-11-28T16:59:12.423818+0000","last_undegraded":"2023-11-28T16:59:12.423818+0000","last_fullsized":"2023-11-28T16:59:12.423818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:30.288758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338737+0000","last_change":"2023-11-28T16:58:57.310945+0000","last_active":"2023-11-28T16:59:11.338737+0000","last_peered":"2023-11-28T16:59:11.338737+0000","last_clean":"2023-11-28T16:59:11.338737+0000","last_became_active":"2023-11-28T16:58:57.310682+0000","last_became_peered":"2023-11-28T16:58:57.310682+0000","last_unstale":"2023-11-28T16:59:11.338737+0000","last_undegraded":"2023-11-28T16:59:11.338737+0000","last_fullsized":"2023-11-28T16:59:11.338737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:28.805091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.426133+0000","last_change":"2023-11-28T16:59:11.370670+0000","last_active":"2023-11-28T16:59:12.426133+0000","last_peered":"2023-11-28T16:59:12.426133+0000","last_clean":"2023-11-28T16:59:12.426133+0000","last_became_active":"2023-11-28T16:59:11.368727+0000","last_became_peered":"2023-11-28T16:59:11.368727+0000","last_unstale":"2023-11-28T16:59:12.426133+0000","last_undegraded":"2023-11-28T16:59:12.426133+0000","last_fullsized":"2023-11-28T16:59:12.426133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:30.387543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341840+0000","last_change":"2023-11-28T16:58:57.309345+0000","last_active":"2023-11-28T16:59:11.341840+0000","last_peered":"2023-11-28T16:59:11.341840+0000","last_clean":"2023-11-28T16:59:11.341840+0000","last_became_active":"2023-11-28T16:58:57.308923+0000","last_became_peered":"2023-11-28T16:58:57.308923+0000","last_unstale":"2023-11-28T16:59:11.341840+0000","last_undegraded":"2023-11-28T16:59:11.341840+0000","last_fullsized":"2023-11-28T16:59:11.341840+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:16.895584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.359166+0000","last_change":"2023-11-28T16:59:11.365196+0000","last_active":"2023-11-28T16:59:12.359166+0000","last_peered":"2023-11-28T16:59:12.359166+0000","last_clean":"2023-11-28T16:59:12.359166+0000","last_became_active":"2023-11-28T16:59:11.364429+0000","last_became_peered":"2023-11-28T16:59:11.364429+0000","last_unstale":"2023-11-28T16:59:12.359166+0000","last_undegraded":"2023-11-28T16:59:12.359166+0000","last_fullsized":"2023-11-28T16:59:12.359166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:46.233685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348911+0000","last_change":"2023-11-28T16:58:57.304932+0000","last_active":"2023-11-28T16:59:11.348911+0000","last_peered":"2023-11-28T16:59:11.348911+0000","last_clean":"2023-11-28T16:59:11.348911+0000","last_became_active":"2023-11-28T16:58:57.304401+0000","last_became_peered":"2023-11-28T16:58:57.304401+0000","last_unstale":"2023-11-28T16:59:11.348911+0000","last_undegraded":"2023-11-28T16:59:11.348911+0000","last_fullsized":"2023-11-28T16:59:11.348911+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:08.489709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358403+0000","last_change":"2023-11-28T16:59:11.360322+0000","last_active":"2023-11-28T16:59:12.358403+0000","last_peered":"2023-11-28T16:59:12.358403+0000","last_clean":"2023-11-28T16:59:12.358403+0000","last_became_active":"2023-11-28T16:59:11.360071+0000","last_became_peered":"2023-11-28T16:59:11.360071+0000","last_unstale":"2023-11-28T16:59:12.358403+0000","last_undegraded":"2023-11-28T16:59:12.358403+0000","last_fullsized":"2023-11-28T16:59:12.358403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:04:54.451544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338654+0000","last_change":"2023-11-28T16:58:57.312192+0000","last_active":"2023-11-28T16:59:11.338654+0000","last_peered":"2023-11-28T16:59:11.338654+0000","last_clean":"2023-11-28T16:59:11.338654+0000","last_became_active":"2023-11-28T16:58:57.311963+0000","last_became_peered":"2023-11-28T16:58:57.311963+0000","last_unstale":"2023-11-28T16:59:11.338654+0000","last_undegraded":"2023-11-28T16:59:11.338654+0000","last_fullsized":"2023-11-28T16:59:11.338654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358161+0000","last_change":"2023-11-28T16:59:11.363386+0000","last_active":"2023-11-28T16:59:12.358161+0000","last_peered":"2023-11-28T16:59:12.358161+0000","last_clean":"2023-11-28T16:59:12.358161+0000","last_became_active":"2023-11-28T16:59:11.363033+0000","last_became_peered":"2023-11-28T16:59:11.363033+0000","last_unstale":"2023-11-28T16:59:12.358161+0000","last_undegraded":"2023-11-28T16:59:12.358161+0000","last_fullsized":"2023-11-28T16:59:12.358161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:57.039647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352350+0000","last_change":"2023-11-28T16:58:57.318754+0000","last_active":"2023-11-28T16:59:11.352350+0000","last_peered":"2023-11-28T16:59:11.352350+0000","last_clean":"2023-11-28T16:59:11.352350+0000","last_became_active":"2023-11-28T16:58:57.318472+0000","last_became_peered":"2023-11-28T16:58:57.318472+0000","last_unstale":"2023-11-28T16:59:11.352350+0000","last_undegraded":"2023-11-28T16:59:11.352350+0000","last_fullsized":"2023-11-28T16:59:11.352350+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:57.528259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.360413+0000","last_change":"2023-11-28T16:59:11.378807+0000","last_active":"2023-11-28T16:59:12.360413+0000","last_peered":"2023-11-28T16:59:12.360413+0000","last_clean":"2023-11-28T16:59:12.360413+0000","last_became_active":"2023-11-28T16:59:11.378519+0000","last_became_peered":"2023-11-28T16:59:11.378519+0000","last_unstale":"2023-11-28T16:59:12.360413+0000","last_undegraded":"2023-11-28T16:59:12.360413+0000","last_fullsized":"2023-11-28T16:59:12.360413+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:56.869141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348040+0000","last_change":"2023-11-28T16:58:57.305646+0000","last_active":"2023-11-28T16:59:11.348040+0000","last_peered":"2023-11-28T16:59:11.348040+0000","last_clean":"2023-11-28T16:59:11.348040+0000","last_became_active":"2023-11-28T16:58:57.305348+0000","last_became_peered":"2023-11-28T16:58:57.305348+0000","last_unstale":"2023-11-28T16:59:11.348040+0000","last_undegraded":"2023-11-28T16:59:11.348040+0000","last_fullsized":"2023-11-28T16:59:11.348040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:10.412723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358588+0000","last_change":"2023-11-28T16:59:11.364805+0000","last_active":"2023-11-28T16:59:12.358588+0000","last_peered":"2023-11-28T16:59:12.358588+0000","last_clean":"2023-11-28T16:59:12.358588+0000","last_became_active":"2023-11-28T16:59:11.364529+0000","last_became_peered":"2023-11-28T16:59:11.364529+0000","last_unstale":"2023-11-28T16:59:12.358588+0000","last_undegraded":"2023-11-28T16:59:12.358588+0000","last_fullsized":"2023-11-28T16:59:12.358588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:01.391878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.351760+0000","last_change":"2023-11-28T16:58:57.313508+0000","last_active":"2023-11-28T16:59:11.351760+0000","last_peered":"2023-11-28T16:59:11.351760+0000","last_clean":"2023-11-28T16:59:11.351760+0000","last_became_active":"2023-11-28T16:58:57.311907+0000","last_became_peered":"2023-11-28T16:58:57.311907+0000","last_unstale":"2023-11-28T16:59:11.351760+0000","last_undegraded":"2023-11-28T16:59:11.351760+0000","last_fullsized":"2023-11-28T16:59:11.351760+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358869+0000","last_change":"2023-11-28T16:59:11.356655+0000","last_active":"2023-11-28T16:59:12.358869+0000","last_peered":"2023-11-28T16:59:12.358869+0000","last_clean":"2023-11-28T16:59:12.358869+0000","last_became_active":"2023-11-28T16:59:11.356312+0000","last_became_peered":"2023-11-28T16:59:11.356312+0000","last_unstale":"2023-11-28T16:59:12.358869+0000","last_undegraded":"2023-11-28T16:59:12.358869+0000","last_fullsized":"2023-11-28T16:59:12.358869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:25:39.260292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352428+0000","last_change":"2023-11-28T16:58:57.315988+0000","last_active":"2023-11-28T16:59:11.352428+0000","last_peered":"2023-11-28T16:59:11.352428+0000","last_clean":"2023-11-28T16:59:11.352428+0000","last_became_active":"2023-11-28T16:58:57.315705+0000","last_became_peered":"2023-11-28T16:58:57.315705+0000","last_unstale":"2023-11-28T16:59:11.352428+0000","last_undegraded":"2023-11-28T16:59:11.352428+0000","last_fullsized":"2023-11-28T16:59:11.352428+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:16.960155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424889+0000","last_change":"2023-11-28T16:59:11.348444+0000","last_active":"2023-11-28T16:59:12.424889+0000","last_peered":"2023-11-28T16:59:12.424889+0000","last_clean":"2023-11-28T16:59:12.424889+0000","last_became_active":"2023-11-28T16:59:11.347101+0000","last_became_peered":"2023-11-28T16:59:11.347101+0000","last_unstale":"2023-11-28T16:59:12.424889+0000","last_undegraded":"2023-11-28T16:59:12.424889+0000","last_fullsized":"2023-11-28T16:59:12.424889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:22.255540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.350317+0000","last_change":"2023-11-28T16:58:57.307177+0000","last_active":"2023-11-28T16:59:11.350317+0000","last_peered":"2023-11-28T16:59:11.350317+0000","last_clean":"2023-11-28T16:59:11.350317+0000","last_became_active":"2023-11-28T16:58:57.305697+0000","last_became_peered":"2023-11-28T16:58:57.305697+0000","last_unstale":"2023-11-28T16:59:11.350317+0000","last_undegraded":"2023-11-28T16:59:11.350317+0000","last_fullsized":"2023-11-28T16:59:11.350317+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424264+0000","last_change":"2023-11-28T16:59:11.361443+0000","last_active":"2023-11-28T16:59:12.424264+0000","last_peered":"2023-11-28T16:59:12.424264+0000","last_clean":"2023-11-28T16:59:12.424264+0000","last_became_active":"2023-11-28T16:59:11.361157+0000","last_became_peered":"2023-11-28T16:59:11.361157+0000","last_unstale":"2023-11-28T16:59:12.424264+0000","last_undegraded":"2023-11-28T16:59:12.424264+0000","last_fullsized":"2023-11-28T16:59:12.424264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:16.960100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337565+0000","last_change":"2023-11-28T16:58:57.301869+0000","last_active":"2023-11-28T16:59:11.337565+0000","last_peered":"2023-11-28T16:59:11.337565+0000","last_clean":"2023-11-28T16:59:11.337565+0000","last_became_active":"2023-11-28T16:58:57.299043+0000","last_became_peered":"2023-11-28T16:58:57.299043+0000","last_unstale":"2023-11-28T16:59:11.337565+0000","last_undegraded":"2023-11-28T16:59:11.337565+0000","last_fullsized":"2023-11-28T16:59:11.337565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:27.650178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.360861+0000","last_change":"2023-11-28T16:59:11.359964+0000","last_active":"2023-11-28T16:59:12.360861+0000","last_peered":"2023-11-28T16:59:12.360861+0000","last_clean":"2023-11-28T16:59:12.360861+0000","last_became_active":"2023-11-28T16:59:11.359608+0000","last_became_peered":"2023-11-28T16:59:11.359608+0000","last_unstale":"2023-11-28T16:59:12.360861+0000","last_undegraded":"2023-11-28T16:59:12.360861+0000","last_fullsized":"2023-11-28T16:59:12.360861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:01.391878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352411+0000","last_change":"2023-11-28T16:58:57.304835+0000","last_active":"2023-11-28T16:59:11.352411+0000","last_peered":"2023-11-28T16:59:11.352411+0000","last_clean":"2023-11-28T16:59:11.352411+0000","last_became_active":"2023-11-28T16:58:57.304529+0000","last_became_peered":"2023-11-28T16:58:57.304529+0000","last_unstale":"2023-11-28T16:59:11.352411+0000","last_undegraded":"2023-11-28T16:59:11.352411+0000","last_fullsized":"2023-11-28T16:59:11.352411+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423239+0000","last_change":"2023-11-28T16:59:11.357989+0000","last_active":"2023-11-28T16:59:12.423239+0000","last_peered":"2023-11-28T16:59:12.423239+0000","last_clean":"2023-11-28T16:59:12.423239+0000","last_became_active":"2023-11-28T16:59:11.357472+0000","last_became_peered":"2023-11-28T16:59:11.357472+0000","last_unstale":"2023-11-28T16:59:12.423239+0000","last_undegraded":"2023-11-28T16:59:12.423239+0000","last_fullsized":"2023-11-28T16:59:12.423239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:50.329040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341904+0000","last_change":"2023-11-28T16:58:57.304288+0000","last_active":"2023-11-28T16:59:11.341904+0000","last_peered":"2023-11-28T16:59:11.341904+0000","last_clean":"2023-11-28T16:59:11.341904+0000","last_became_active":"2023-11-28T16:58:57.303979+0000","last_became_peered":"2023-11-28T16:58:57.303979+0000","last_unstale":"2023-11-28T16:59:11.341904+0000","last_undegraded":"2023-11-28T16:59:11.341904+0000","last_fullsized":"2023-11-28T16:59:11.341904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:01.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358164+0000","last_change":"2023-11-28T16:59:11.354971+0000","last_active":"2023-11-28T16:59:12.358164+0000","last_peered":"2023-11-28T16:59:12.358164+0000","last_clean":"2023-11-28T16:59:12.358164+0000","last_became_active":"2023-11-28T16:59:11.354649+0000","last_became_peered":"2023-11-28T16:59:11.354649+0000","last_unstale":"2023-11-28T16:59:12.358164+0000","last_undegraded":"2023-11-28T16:59:12.358164+0000","last_fullsized":"2023-11-28T16:59:12.358164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:30.288758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348636+0000","last_change":"2023-11-28T16:58:57.309909+0000","last_active":"2023-11-28T16:59:11.348636+0000","last_peered":"2023-11-28T16:59:11.348636+0000","last_clean":"2023-11-28T16:59:11.348636+0000","last_became_active":"2023-11-28T16:58:57.309581+0000","last_became_peered":"2023-11-28T16:58:57.309581+0000","last_unstale":"2023-11-28T16:59:11.348636+0000","last_undegraded":"2023-11-28T16:59:11.348636+0000","last_fullsized":"2023-11-28T16:59:11.348636+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:44.715872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423710+0000","last_change":"2023-11-28T16:59:11.356920+0000","last_active":"2023-11-28T16:59:12.423710+0000","last_peered":"2023-11-28T16:59:12.423710+0000","last_clean":"2023-11-28T16:59:12.423710+0000","last_became_active":"2023-11-28T16:59:11.354835+0000","last_became_peered":"2023-11-28T16:59:11.354835+0000","last_unstale":"2023-11-28T16:59:12.423710+0000","last_undegraded":"2023-11-28T16:59:12.423710+0000","last_fullsized":"2023-11-28T16:59:12.423710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:22.082038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341583+0000","last_change":"2023-11-28T16:58:57.305318+0000","last_active":"2023-11-28T16:59:11.341583+0000","last_peered":"2023-11-28T16:59:11.341583+0000","last_clean":"2023-11-28T16:59:11.341583+0000","last_became_active":"2023-11-28T16:58:57.300492+0000","last_became_peered":"2023-11-28T16:58:57.300492+0000","last_unstale":"2023-11-28T16:59:11.341583+0000","last_undegraded":"2023-11-28T16:59:11.341583+0000","last_fullsized":"2023-11-28T16:59:11.341583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424571+0000","last_change":"2023-11-28T16:59:11.365448+0000","last_active":"2023-11-28T16:59:12.424571+0000","last_peered":"2023-11-28T16:59:12.424571+0000","last_clean":"2023-11-28T16:59:12.424571+0000","last_became_active":"2023-11-28T16:59:11.365170+0000","last_became_peered":"2023-11-28T16:59:11.365170+0000","last_unstale":"2023-11-28T16:59:12.424571+0000","last_undegraded":"2023-11-28T16:59:12.424571+0000","last_fullsized":"2023-11-28T16:59:12.424571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:22.758566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338591+0000","last_change":"2023-11-28T16:58:57.309435+0000","last_active":"2023-11-28T16:59:11.338591+0000","last_peered":"2023-11-28T16:59:11.338591+0000","last_clean":"2023-11-28T16:59:11.338591+0000","last_became_active":"2023-11-28T16:58:57.308962+0000","last_became_peered":"2023-11-28T16:58:57.308962+0000","last_unstale":"2023-11-28T16:59:11.338591+0000","last_undegraded":"2023-11-28T16:59:11.338591+0000","last_fullsized":"2023-11-28T16:59:11.338591+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.425366+0000","last_change":"2023-11-28T16:59:11.371081+0000","last_active":"2023-11-28T16:59:12.425366+0000","last_peered":"2023-11-28T16:59:12.425366+0000","last_clean":"2023-11-28T16:59:12.425366+0000","last_became_active":"2023-11-28T16:59:11.370810+0000","last_became_peered":"2023-11-28T16:59:11.370810+0000","last_unstale":"2023-11-28T16:59:12.425366+0000","last_undegraded":"2023-11-28T16:59:12.425366+0000","last_fullsized":"2023-11-28T16:59:12.425366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:41:07.007589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339221+0000","last_change":"2023-11-28T16:58:57.302600+0000","last_active":"2023-11-28T16:59:11.339221+0000","last_peered":"2023-11-28T16:59:11.339221+0000","last_clean":"2023-11-28T16:59:11.339221+0000","last_became_active":"2023-11-28T16:58:57.302328+0000","last_became_peered":"2023-11-28T16:58:57.302328+0000","last_unstale":"2023-11-28T16:59:11.339221+0000","last_undegraded":"2023-11-28T16:59:11.339221+0000","last_fullsized":"2023-11-28T16:59:11.339221+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424950+0000","last_change":"2023-11-28T16:59:11.356082+0000","last_active":"2023-11-28T16:59:12.424950+0000","last_peered":"2023-11-28T16:59:12.424950+0000","last_clean":"2023-11-28T16:59:12.424950+0000","last_became_active":"2023-11-28T16:59:11.355725+0000","last_became_peered":"2023-11-28T16:59:11.355725+0000","last_unstale":"2023-11-28T16:59:12.424950+0000","last_undegraded":"2023-11-28T16:59:12.424950+0000","last_fullsized":"2023-11-28T16:59:12.424950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:25.781357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.350595+0000","last_change":"2023-11-28T16:58:57.307084+0000","last_active":"2023-11-28T16:59:11.350595+0000","last_peered":"2023-11-28T16:59:11.350595+0000","last_clean":"2023-11-28T16:59:11.350595+0000","last_became_active":"2023-11-28T16:58:57.306795+0000","last_became_peered":"2023-11-28T16:58:57.306795+0000","last_unstale":"2023-11-28T16:59:11.350595+0000","last_undegraded":"2023-11-28T16:59:11.350595+0000","last_fullsized":"2023-11-28T16:59:11.350595+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:45:36.527998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.359233+0000","last_change":"2023-11-28T16:59:11.363758+0000","last_active":"2023-11-28T16:59:12.359233+0000","last_peered":"2023-11-28T16:59:12.359233+0000","last_clean":"2023-11-28T16:59:12.359233+0000","last_became_active":"2023-11-28T16:59:11.363466+0000","last_became_peered":"2023-11-28T16:59:11.363466+0000","last_unstale":"2023-11-28T16:59:12.359233+0000","last_undegraded":"2023-11-28T16:59:12.359233+0000","last_fullsized":"2023-11-28T16:59:12.359233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:58.001683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339926+0000","last_change":"2023-11-28T16:58:57.301492+0000","last_active":"2023-11-28T16:59:11.339926+0000","last_peered":"2023-11-28T16:59:11.339926+0000","last_clean":"2023-11-28T16:59:11.339926+0000","last_became_active":"2023-11-28T16:58:57.301143+0000","last_became_peered":"2023-11-28T16:58:57.301143+0000","last_unstale":"2023-11-28T16:59:11.339926+0000","last_undegraded":"2023-11-28T16:59:11.339926+0000","last_fullsized":"2023-11-28T16:59:11.339926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424040+0000","last_change":"2023-11-28T16:59:11.365801+0000","last_active":"2023-11-28T16:59:12.424040+0000","last_peered":"2023-11-28T16:59:12.424040+0000","last_clean":"2023-11-28T16:59:12.424040+0000","last_became_active":"2023-11-28T16:59:11.365475+0000","last_became_peered":"2023-11-28T16:59:11.365475+0000","last_unstale":"2023-11-28T16:59:12.424040+0000","last_undegraded":"2023-11-28T16:59:12.424040+0000","last_fullsized":"2023-11-28T16:59:12.424040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:56.869141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349200+0000","last_change":"2023-11-28T16:58:57.305035+0000","last_active":"2023-11-28T16:59:11.349200+0000","last_peered":"2023-11-28T16:59:11.349200+0000","last_clean":"2023-11-28T16:59:11.349200+0000","last_became_active":"2023-11-28T16:58:57.304747+0000","last_became_peered":"2023-11-28T16:58:57.304747+0000","last_unstale":"2023-11-28T16:59:11.349200+0000","last_undegraded":"2023-11-28T16:59:11.349200+0000","last_fullsized":"2023-11-28T16:59:11.349200+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:59:37.707020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358221+0000","last_change":"2023-11-28T16:59:11.361021+0000","last_active":"2023-11-28T16:59:12.358221+0000","last_peered":"2023-11-28T16:59:12.358221+0000","last_clean":"2023-11-28T16:59:12.358221+0000","last_became_active":"2023-11-28T16:59:11.360706+0000","last_became_peered":"2023-11-28T16:59:11.360706+0000","last_unstale":"2023-11-28T16:59:12.358221+0000","last_undegraded":"2023-11-28T16:59:12.358221+0000","last_fullsized":"2023-11-28T16:59:12.358221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:19.050220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348572+0000","last_change":"2023-11-28T16:58:57.313873+0000","last_active":"2023-11-28T16:59:11.348572+0000","last_peered":"2023-11-28T16:59:11.348572+0000","last_clean":"2023-11-28T16:59:11.348572+0000","last_became_active":"2023-11-28T16:58:57.313545+0000","last_became_peered":"2023-11-28T16:58:57.313545+0000","last_unstale":"2023-11-28T16:59:11.348572+0000","last_undegraded":"2023-11-28T16:59:11.348572+0000","last_fullsized":"2023-11-28T16:59:11.348572+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:19.647634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358313+0000","last_change":"2023-11-28T16:59:11.356901+0000","last_active":"2023-11-28T16:59:12.358313+0000","last_peered":"2023-11-28T16:59:12.358313+0000","last_clean":"2023-11-28T16:59:12.358313+0000","last_became_active":"2023-11-28T16:59:11.355230+0000","last_became_peered":"2023-11-28T16:59:11.355230+0000","last_unstale":"2023-11-28T16:59:12.358313+0000","last_undegraded":"2023-11-28T16:59:12.358313+0000","last_fullsized":"2023-11-28T16:59:12.358313+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:56.869141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.336585+0000","last_change":"2023-11-28T16:58:57.299061+0000","last_active":"2023-11-28T16:59:11.336585+0000","last_peered":"2023-11-28T16:59:11.336585+0000","last_clean":"2023-11-28T16:59:11.336585+0000","last_became_active":"2023-11-28T16:58:57.298785+0000","last_became_peered":"2023-11-28T16:58:57.298785+0000","last_unstale":"2023-11-28T16:59:11.336585+0000","last_undegraded":"2023-11-28T16:59:11.336585+0000","last_fullsized":"2023-11-28T16:59:11.336585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:40:09.962992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424704+0000","last_change":"2023-11-28T16:59:11.366696+0000","last_active":"2023-11-28T16:59:12.424704+0000","last_peered":"2023-11-28T16:59:12.424704+0000","last_clean":"2023-11-28T16:59:12.424704+0000","last_became_active":"2023-11-28T16:59:11.366420+0000","last_became_peered":"2023-11-28T16:59:11.366420+0000","last_unstale":"2023-11-28T16:59:12.424704+0000","last_undegraded":"2023-11-28T16:59:12.424704+0000","last_fullsized":"2023-11-28T16:59:12.424704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:40:23.454950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349517+0000","last_change":"2023-11-28T16:58:57.315028+0000","last_active":"2023-11-28T16:59:11.349517+0000","last_peered":"2023-11-28T16:59:11.349517+0000","last_clean":"2023-11-28T16:59:11.349517+0000","last_became_active":"2023-11-28T16:58:57.314688+0000","last_became_peered":"2023-11-28T16:58:57.314688+0000","last_unstale":"2023-11-28T16:59:11.349517+0000","last_undegraded":"2023-11-28T16:59:11.349517+0000","last_fullsized":"2023-11-28T16:59:11.349517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358309+0000","last_change":"2023-11-28T16:59:11.363530+0000","last_active":"2023-11-28T16:59:12.358309+0000","last_peered":"2023-11-28T16:59:12.358309+0000","last_clean":"2023-11-28T16:59:12.358309+0000","last_became_active":"2023-11-28T16:59:11.363223+0000","last_became_peered":"2023-11-28T16:59:11.363223+0000","last_unstale":"2023-11-28T16:59:12.358309+0000","last_undegraded":"2023-11-28T16:59:12.358309+0000","last_fullsized":"2023-11-28T16:59:12.358309+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:59.328491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349806+0000","last_change":"2023-11-28T16:58:57.313407+0000","last_active":"2023-11-28T16:59:11.349806+0000","last_peered":"2023-11-28T16:59:11.349806+0000","last_clean":"2023-11-28T16:59:11.349806+0000","last_became_active":"2023-11-28T16:58:57.313195+0000","last_became_peered":"2023-11-28T16:58:57.313195+0000","last_unstale":"2023-11-28T16:59:11.349806+0000","last_undegraded":"2023-11-28T16:59:11.349806+0000","last_fullsized":"2023-11-28T16:59:11.349806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:41:36.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.359144+0000","last_change":"2023-11-28T16:59:11.369380+0000","last_active":"2023-11-28T16:59:12.359144+0000","last_peered":"2023-11-28T16:59:12.359144+0000","last_clean":"2023-11-28T16:59:12.359144+0000","last_became_active":"2023-11-28T16:59:11.369039+0000","last_became_peered":"2023-11-28T16:59:11.369039+0000","last_unstale":"2023-11-28T16:59:12.359144+0000","last_undegraded":"2023-11-28T16:59:12.359144+0000","last_fullsized":"2023-11-28T16:59:12.359144+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:59.328491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337577+0000","last_change":"2023-11-28T16:58:57.306497+0000","last_active":"2023-11-28T16:59:11.337577+0000","last_peered":"2023-11-28T16:59:11.337577+0000","last_clean":"2023-11-28T16:59:11.337577+0000","last_became_active":"2023-11-28T16:58:57.306200+0000","last_became_peered":"2023-11-28T16:58:57.306200+0000","last_unstale":"2023-11-28T16:59:11.337577+0000","last_undegraded":"2023-11-28T16:59:11.337577+0000","last_fullsized":"2023-11-28T16:59:11.337577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:21.987730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.360934+0000","last_change":"2023-11-28T16:59:11.381840+0000","last_active":"2023-11-28T16:59:12.360934+0000","last_peered":"2023-11-28T16:59:12.360934+0000","last_clean":"2023-11-28T16:59:12.360934+0000","last_became_active":"2023-11-28T16:59:11.381422+0000","last_became_peered":"2023-11-28T16:59:11.381422+0000","last_unstale":"2023-11-28T16:59:12.360934+0000","last_undegraded":"2023-11-28T16:59:12.360934+0000","last_fullsized":"2023-11-28T16:59:12.360934+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:25:39.260292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.342638+0000","last_change":"2023-11-28T16:58:57.299393+0000","last_active":"2023-11-28T16:59:11.342638+0000","last_peered":"2023-11-28T16:59:11.342638+0000","last_clean":"2023-11-28T16:59:11.342638+0000","last_became_active":"2023-11-28T16:58:57.299079+0000","last_became_peered":"2023-11-28T16:58:57.299079+0000","last_unstale":"2023-11-28T16:59:11.342638+0000","last_undegraded":"2023-11-28T16:59:11.342638+0000","last_fullsized":"2023-11-28T16:59:11.342638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:08.500949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.361291+0000","last_change":"2023-11-28T16:59:11.371579+0000","last_active":"2023-11-28T16:59:12.361291+0000","last_peered":"2023-11-28T16:59:12.361291+0000","last_clean":"2023-11-28T16:59:12.361291+0000","last_became_active":"2023-11-28T16:59:11.370153+0000","last_became_peered":"2023-11-28T16:59:11.370153+0000","last_unstale":"2023-11-28T16:59:12.361291+0000","last_undegraded":"2023-11-28T16:59:12.361291+0000","last_fullsized":"2023-11-28T16:59:12.361291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:19.050220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.340099+0000","last_change":"2023-11-28T16:58:57.304447+0000","last_active":"2023-11-28T16:59:11.340099+0000","last_peered":"2023-11-28T16:59:11.340099+0000","last_clean":"2023-11-28T16:59:11.340099+0000","last_became_active":"2023-11-28T16:58:57.301404+0000","last_became_peered":"2023-11-28T16:58:57.301404+0000","last_unstale":"2023-11-28T16:59:11.340099+0000","last_undegraded":"2023-11-28T16:59:11.340099+0000","last_fullsized":"2023-11-28T16:59:11.340099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.359169+0000","last_change":"2023-11-28T16:59:11.351044+0000","last_active":"2023-11-28T16:59:12.359169+0000","last_peered":"2023-11-28T16:59:12.359169+0000","last_clean":"2023-11-28T16:59:12.359169+0000","last_became_active":"2023-11-28T16:59:11.350715+0000","last_became_peered":"2023-11-28T16:59:11.350715+0000","last_unstale":"2023-11-28T16:59:12.359169+0000","last_undegraded":"2023-11-28T16:59:12.359169+0000","last_fullsized":"2023-11-28T16:59:12.359169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:14.375033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352491+0000","last_change":"2023-11-28T16:58:57.315464+0000","last_active":"2023-11-28T16:59:11.352491+0000","last_peered":"2023-11-28T16:59:11.352491+0000","last_clean":"2023-11-28T16:59:11.352491+0000","last_became_active":"2023-11-28T16:58:57.314425+0000","last_became_peered":"2023-11-28T16:58:57.314425+0000","last_unstale":"2023-11-28T16:59:11.352491+0000","last_undegraded":"2023-11-28T16:59:11.352491+0000","last_fullsized":"2023-11-28T16:59:11.352491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423493+0000","last_change":"2023-11-28T16:59:11.372801+0000","last_active":"2023-11-28T16:59:12.423493+0000","last_peered":"2023-11-28T16:59:12.423493+0000","last_clean":"2023-11-28T16:59:12.423493+0000","last_became_active":"2023-11-28T16:59:11.372316+0000","last_became_peered":"2023-11-28T16:59:11.372316+0000","last_unstale":"2023-11-28T16:59:12.423493+0000","last_undegraded":"2023-11-28T16:59:12.423493+0000","last_fullsized":"2023-11-28T16:59:12.423493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:25.781357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337161+0000","last_change":"2023-11-28T16:58:57.299772+0000","last_active":"2023-11-28T16:59:11.337161+0000","last_peered":"2023-11-28T16:59:11.337161+0000","last_clean":"2023-11-28T16:59:11.337161+0000","last_became_active":"2023-11-28T16:58:57.299523+0000","last_became_peered":"2023-11-28T16:58:57.299523+0000","last_unstale":"2023-11-28T16:59:11.337161+0000","last_undegraded":"2023-11-28T16:59:11.337161+0000","last_fullsized":"2023-11-28T16:59:11.337161+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:37.921612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423849+0000","last_change":"2023-11-28T16:59:11.354564+0000","last_active":"2023-11-28T16:59:12.423849+0000","last_peered":"2023-11-28T16:59:12.423849+0000","last_clean":"2023-11-28T16:59:12.423849+0000","last_became_active":"2023-11-28T16:59:11.354239+0000","last_became_peered":"2023-11-28T16:59:11.354239+0000","last_unstale":"2023-11-28T16:59:12.423849+0000","last_undegraded":"2023-11-28T16:59:12.423849+0000","last_fullsized":"2023-11-28T16:59:12.423849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:08.978847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.336661+0000","last_change":"2023-11-28T16:58:57.299039+0000","last_active":"2023-11-28T16:59:11.336661+0000","last_peered":"2023-11-28T16:59:11.336661+0000","last_clean":"2023-11-28T16:59:11.336661+0000","last_became_active":"2023-11-28T16:58:57.298773+0000","last_became_peered":"2023-11-28T16:58:57.298773+0000","last_unstale":"2023-11-28T16:59:11.336661+0000","last_undegraded":"2023-11-28T16:59:11.336661+0000","last_fullsized":"2023-11-28T16:59:11.336661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:32.086836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.359035+0000","last_change":"2023-11-28T16:59:11.351678+0000","last_active":"2023-11-28T16:59:12.359035+0000","last_peered":"2023-11-28T16:59:12.359035+0000","last_clean":"2023-11-28T16:59:12.359035+0000","last_became_active":"2023-11-28T16:59:11.351400+0000","last_became_peered":"2023-11-28T16:59:11.351400+0000","last_unstale":"2023-11-28T16:59:12.359035+0000","last_undegraded":"2023-11-28T16:59:12.359035+0000","last_fullsized":"2023-11-28T16:59:12.359035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:36:16.084935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337844+0000","last_change":"2023-11-28T16:58:57.299925+0000","last_active":"2023-11-28T16:59:11.337844+0000","last_peered":"2023-11-28T16:59:11.337844+0000","last_clean":"2023-11-28T16:59:11.337844+0000","last_became_active":"2023-11-28T16:58:57.299627+0000","last_became_peered":"2023-11-28T16:58:57.299627+0000","last_unstale":"2023-11-28T16:59:11.337844+0000","last_undegraded":"2023-11-28T16:59:11.337844+0000","last_fullsized":"2023-11-28T16:59:11.337844+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.425276+0000","last_change":"2023-11-28T16:59:11.360223+0000","last_active":"2023-11-28T16:59:12.425276+0000","last_peered":"2023-11-28T16:59:12.425276+0000","last_clean":"2023-11-28T16:59:12.425276+0000","last_became_active":"2023-11-28T16:59:11.359920+0000","last_became_peered":"2023-11-28T16:59:11.359920+0000","last_unstale":"2023-11-28T16:59:12.425276+0000","last_undegraded":"2023-11-28T16:59:12.425276+0000","last_fullsized":"2023-11-28T16:59:12.425276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:41:04.334565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.346657+0000","last_change":"2023-11-28T16:58:57.313636+0000","last_active":"2023-11-28T16:59:11.346657+0000","last_peered":"2023-11-28T16:59:11.346657+0000","last_clean":"2023-11-28T16:59:11.346657+0000","last_became_active":"2023-11-28T16:58:57.313257+0000","last_became_peered":"2023-11-28T16:58:57.313257+0000","last_unstale":"2023-11-28T16:59:11.346657+0000","last_undegraded":"2023-11-28T16:59:11.346657+0000","last_fullsized":"2023-11-28T16:59:11.346657+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.425450+0000","last_change":"2023-11-28T16:59:11.349184+0000","last_active":"2023-11-28T16:59:12.425450+0000","last_peered":"2023-11-28T16:59:12.425450+0000","last_clean":"2023-11-28T16:59:12.425450+0000","last_became_active":"2023-11-28T16:59:11.348636+0000","last_became_peered":"2023-11-28T16:59:11.348636+0000","last_unstale":"2023-11-28T16:59:12.425450+0000","last_undegraded":"2023-11-28T16:59:12.425450+0000","last_fullsized":"2023-11-28T16:59:12.425450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:55.128093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.367538+0000","last_change":"2023-11-28T16:59:10.360579+0000","last_active":"2023-11-28T16:59:11.367538+0000","last_peered":"2023-11-28T16:59:11.367538+0000","last_clean":"2023-11-28T16:59:11.367538+0000","last_became_active":"2023-11-28T16:59:10.360329+0000","last_became_peered":"2023-11-28T16:59:10.360329+0000","last_unstale":"2023-11-28T16:59:11.367538+0000","last_undegraded":"2023-11-28T16:59:11.367538+0000","last_fullsized":"2023-11-28T16:59:11.367538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:55.859872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337609+0000","last_change":"2023-11-28T16:58:57.310866+0000","last_active":"2023-11-28T16:59:11.337609+0000","last_peered":"2023-11-28T16:59:11.337609+0000","last_clean":"2023-11-28T16:59:11.337609+0000","last_became_active":"2023-11-28T16:58:57.310515+0000","last_became_peered":"2023-11-28T16:58:57.310515+0000","last_unstale":"2023-11-28T16:59:11.337609+0000","last_undegraded":"2023-11-28T16:59:11.337609+0000","last_fullsized":"2023-11-28T16:59:11.337609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348903+0000","last_change":"2023-11-28T16:58:56.862978+0000","last_active":"2023-11-28T16:59:11.348903+0000","last_peered":"2023-11-28T16:59:11.348903+0000","last_clean":"2023-11-28T16:59:11.348903+0000","last_became_active":"2023-11-28T16:58:56.862677+0000","last_became_peered":"2023-11-28T16:58:56.862677+0000","last_unstale":"2023-11-28T16:59:11.348903+0000","last_undegraded":"2023-11-28T16:59:11.348903+0000","last_fullsized":"2023-11-28T16:59:11.348903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424510+0000","last_change":"2023-11-28T16:59:11.364471+0000","last_active":"2023-11-28T16:59:12.424510+0000","last_peered":"2023-11-28T16:59:12.424510+0000","last_clean":"2023-11-28T16:59:12.424510+0000","last_became_active":"2023-11-28T16:59:11.364218+0000","last_became_peered":"2023-11-28T16:59:11.364218+0000","last_unstale":"2023-11-28T16:59:12.424510+0000","last_undegraded":"2023-11-28T16:59:12.424510+0000","last_fullsized":"2023-11-28T16:59:12.424510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:50.329040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.373924+0000","last_change":"2023-11-28T16:59:10.349008+0000","last_active":"2023-11-28T16:59:11.373924+0000","last_peered":"2023-11-28T16:59:11.373924+0000","last_clean":"2023-11-28T16:59:11.373924+0000","last_became_active":"2023-11-28T16:59:10.348642+0000","last_became_peered":"2023-11-28T16:59:10.348642+0000","last_unstale":"2023-11-28T16:59:11.373924+0000","last_undegraded":"2023-11-28T16:59:11.373924+0000","last_fullsized":"2023-11-28T16:59:11.373924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:20:27.083092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348584+0000","last_change":"2023-11-28T16:58:57.315127+0000","last_active":"2023-11-28T16:59:11.348584+0000","last_peered":"2023-11-28T16:59:11.348584+0000","last_clean":"2023-11-28T16:59:11.348584+0000","last_became_active":"2023-11-28T16:58:57.314836+0000","last_became_peered":"2023-11-28T16:58:57.314836+0000","last_unstale":"2023-11-28T16:59:11.348584+0000","last_undegraded":"2023-11-28T16:59:11.348584+0000","last_fullsized":"2023-11-28T16:59:11.348584+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337808+0000","last_change":"2023-11-28T16:58:56.852728+0000","last_active":"2023-11-28T16:59:11.337808+0000","last_peered":"2023-11-28T16:59:11.337808+0000","last_clean":"2023-11-28T16:59:11.337808+0000","last_became_active":"2023-11-28T16:58:56.852468+0000","last_became_peered":"2023-11-28T16:58:56.852468+0000","last_unstale":"2023-11-28T16:59:11.337808+0000","last_undegraded":"2023-11-28T16:59:11.337808+0000","last_fullsized":"2023-11-28T16:59:11.337808+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.425920+0000","last_change":"2023-11-28T16:59:11.364698+0000","last_active":"2023-11-28T16:59:12.425920+0000","last_peered":"2023-11-28T16:59:12.425920+0000","last_clean":"2023-11-28T16:59:12.425920+0000","last_became_active":"2023-11-28T16:59:11.362745+0000","last_became_peered":"2023-11-28T16:59:11.362745+0000","last_unstale":"2023-11-28T16:59:12.425920+0000","last_undegraded":"2023-11-28T16:59:12.425920+0000","last_fullsized":"2023-11-28T16:59:12.425920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:41.142137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"72'4","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.375354+0000","last_change":"2023-11-28T16:59:10.359449+0000","last_active":"2023-11-28T16:59:11.375354+0000","last_peered":"2023-11-28T16:59:11.375354+0000","last_clean":"2023-11-28T16:59:11.375354+0000","last_became_active":"2023-11-28T16:59:10.359188+0000","last_became_peered":"2023-11-28T16:59:10.359188+0000","last_unstale":"2023-11-28T16:59:11.375354+0000","last_undegraded":"2023-11-28T16:59:11.375354+0000","last_fullsized":"2023-11-28T16:59:11.375354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:28:00.382609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352587+0000","last_change":"2023-11-28T16:58:57.314042+0000","last_active":"2023-11-28T16:59:11.352587+0000","last_peered":"2023-11-28T16:59:11.352587+0000","last_clean":"2023-11-28T16:59:11.352587+0000","last_became_active":"2023-11-28T16:58:57.313749+0000","last_became_peered":"2023-11-28T16:58:57.313749+0000","last_unstale":"2023-11-28T16:59:11.352587+0000","last_undegraded":"2023-11-28T16:59:11.352587+0000","last_fullsized":"2023-11-28T16:59:11.352587+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.340021+0000","last_change":"2023-11-28T16:58:56.861860+0000","last_active":"2023-11-28T16:59:11.340021+0000","last_peered":"2023-11-28T16:59:11.340021+0000","last_clean":"2023-11-28T16:59:11.340021+0000","last_became_active":"2023-11-28T16:58:56.861575+0000","last_became_peered":"2023-11-28T16:58:56.861575+0000","last_unstale":"2023-11-28T16:59:11.340021+0000","last_undegraded":"2023-11-28T16:59:11.340021+0000","last_fullsized":"2023-11-28T16:59:11.340021+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:01.116893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424286+0000","last_change":"2023-11-28T16:59:11.369617+0000","last_active":"2023-11-28T16:59:12.424286+0000","last_peered":"2023-11-28T16:59:12.424286+0000","last_clean":"2023-11-28T16:59:12.424286+0000","last_became_active":"2023-11-28T16:59:11.369195+0000","last_became_peered":"2023-11-28T16:59:11.369195+0000","last_unstale":"2023-11-28T16:59:12.424286+0000","last_undegraded":"2023-11-28T16:59:12.424286+0000","last_fullsized":"2023-11-28T16:59:12.424286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:04:54.451544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.369224+0000","last_change":"2023-11-28T16:59:10.351798+0000","last_active":"2023-11-28T16:59:11.369224+0000","last_peered":"2023-11-28T16:59:11.369224+0000","last_clean":"2023-11-28T16:59:11.369224+0000","last_became_active":"2023-11-28T16:59:10.351474+0000","last_became_peered":"2023-11-28T16:59:10.351474+0000","last_unstale":"2023-11-28T16:59:11.369224+0000","last_undegraded":"2023-11-28T16:59:11.369224+0000","last_fullsized":"2023-11-28T16:59:11.369224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:21.246271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.343022+0000","last_change":"2023-11-28T16:58:57.316847+0000","last_active":"2023-11-28T16:59:11.343022+0000","last_peered":"2023-11-28T16:59:11.343022+0000","last_clean":"2023-11-28T16:59:11.343022+0000","last_became_active":"2023-11-28T16:58:57.315129+0000","last_became_peered":"2023-11-28T16:58:57.315129+0000","last_unstale":"2023-11-28T16:59:11.343022+0000","last_undegraded":"2023-11-28T16:59:11.343022+0000","last_fullsized":"2023-11-28T16:59:11.343022+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338482+0000","last_change":"2023-11-28T16:58:56.857953+0000","last_active":"2023-11-28T16:59:11.338482+0000","last_peered":"2023-11-28T16:59:11.338482+0000","last_clean":"2023-11-28T16:59:11.338482+0000","last_became_active":"2023-11-28T16:58:56.857667+0000","last_became_peered":"2023-11-28T16:58:56.857667+0000","last_unstale":"2023-11-28T16:59:11.338482+0000","last_undegraded":"2023-11-28T16:59:11.338482+0000","last_fullsized":"2023-11-28T16:59:11.338482+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:40.543279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.422954+0000","last_change":"2023-11-28T16:59:11.356378+0000","last_active":"2023-11-28T16:59:12.422954+0000","last_peered":"2023-11-28T16:59:12.422954+0000","last_clean":"2023-11-28T16:59:12.422954+0000","last_became_active":"2023-11-28T16:59:11.355813+0000","last_became_peered":"2023-11-28T16:59:11.355813+0000","last_unstale":"2023-11-28T16:59:12.422954+0000","last_undegraded":"2023-11-28T16:59:12.422954+0000","last_fullsized":"2023-11-28T16:59:12.422954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:48.925964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349427+0000","last_change":"2023-11-28T16:59:10.352304+0000","last_active":"2023-11-28T16:59:11.349427+0000","last_peered":"2023-11-28T16:59:11.349427+0000","last_clean":"2023-11-28T16:59:11.349427+0000","last_became_active":"2023-11-28T16:59:10.351771+0000","last_became_peered":"2023-11-28T16:59:10.351771+0000","last_unstale":"2023-11-28T16:59:11.349427+0000","last_undegraded":"2023-11-28T16:59:11.349427+0000","last_fullsized":"2023-11-28T16:59:11.349427+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:47.916695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.336745+0000","last_change":"2023-11-28T16:58:57.297598+0000","last_active":"2023-11-28T16:59:11.336745+0000","last_peered":"2023-11-28T16:59:11.336745+0000","last_clean":"2023-11-28T16:59:11.336745+0000","last_became_active":"2023-11-28T16:58:57.297333+0000","last_became_peered":"2023-11-28T16:58:57.297333+0000","last_unstale":"2023-11-28T16:59:11.336745+0000","last_undegraded":"2023-11-28T16:59:11.336745+0000","last_fullsized":"2023-11-28T16:59:11.336745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:53.515630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338642+0000","last_change":"2023-11-28T16:58:56.846299+0000","last_active":"2023-11-28T16:59:11.338642+0000","last_peered":"2023-11-28T16:59:11.338642+0000","last_clean":"2023-11-28T16:59:11.338642+0000","last_became_active":"2023-11-28T16:58:56.845923+0000","last_became_peered":"2023-11-28T16:58:56.845923+0000","last_unstale":"2023-11-28T16:59:11.338642+0000","last_undegraded":"2023-11-28T16:59:11.338642+0000","last_fullsized":"2023-11-28T16:59:11.338642+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423866+0000","last_change":"2023-11-28T16:59:11.361273+0000","last_active":"2023-11-28T16:59:12.423866+0000","last_peered":"2023-11-28T16:59:12.423866+0000","last_clean":"2023-11-28T16:59:12.423866+0000","last_became_active":"2023-11-28T16:59:11.358771+0000","last_became_peered":"2023-11-28T16:59:11.358771+0000","last_unstale":"2023-11-28T16:59:12.423866+0000","last_undegraded":"2023-11-28T16:59:12.423866+0000","last_fullsized":"2023-11-28T16:59:12.423866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:48.225111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.334147+0000","last_change":"2023-11-28T16:59:10.354024+0000","last_active":"2023-11-28T16:59:11.334147+0000","last_peered":"2023-11-28T16:59:11.334147+0000","last_clean":"2023-11-28T16:59:11.334147+0000","last_became_active":"2023-11-28T16:59:10.353729+0000","last_became_peered":"2023-11-28T16:59:10.353729+0000","last_unstale":"2023-11-28T16:59:11.334147+0000","last_undegraded":"2023-11-28T16:59:11.334147+0000","last_fullsized":"2023-11-28T16:59:11.334147+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:55.368716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338447+0000","last_change":"2023-11-28T16:58:57.302610+0000","last_active":"2023-11-28T16:59:11.338447+0000","last_peered":"2023-11-28T16:59:11.338447+0000","last_clean":"2023-11-28T16:59:11.338447+0000","last_became_active":"2023-11-28T16:58:57.301748+0000","last_became_peered":"2023-11-28T16:58:57.301748+0000","last_unstale":"2023-11-28T16:59:11.338447+0000","last_undegraded":"2023-11-28T16:59:11.338447+0000","last_fullsized":"2023-11-28T16:59:11.338447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:41.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.336960+0000","last_change":"2023-11-28T16:58:56.849775+0000","last_active":"2023-11-28T16:59:11.336960+0000","last_peered":"2023-11-28T16:59:11.336960+0000","last_clean":"2023-11-28T16:59:11.336960+0000","last_became_active":"2023-11-28T16:58:56.849503+0000","last_became_peered":"2023-11-28T16:58:56.849503+0000","last_unstale":"2023-11-28T16:59:11.336960+0000","last_undegraded":"2023-11-28T16:59:11.336960+0000","last_fullsized":"2023-11-28T16:59:11.336960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424236+0000","last_change":"2023-11-28T16:59:11.370156+0000","last_active":"2023-11-28T16:59:12.424236+0000","last_peered":"2023-11-28T16:59:12.424236+0000","last_clean":"2023-11-28T16:59:12.424236+0000","last_became_active":"2023-11-28T16:59:11.369879+0000","last_became_peered":"2023-11-28T16:59:11.369879+0000","last_unstale":"2023-11-28T16:59:12.424236+0000","last_undegraded":"2023-11-28T16:59:12.424236+0000","last_fullsized":"2023-11-28T16:59:12.424236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:30.387543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.374190+0000","last_change":"2023-11-28T16:59:10.356604+0000","last_active":"2023-11-28T16:59:11.374190+0000","last_peered":"2023-11-28T16:59:11.374190+0000","last_clean":"2023-11-28T16:59:11.374190+0000","last_became_active":"2023-11-28T16:59:10.356338+0000","last_became_peered":"2023-11-28T16:59:10.356338+0000","last_unstale":"2023-11-28T16:59:11.374190+0000","last_undegraded":"2023-11-28T16:59:11.374190+0000","last_fullsized":"2023-11-28T16:59:11.374190+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:20.624402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.340568+0000","last_change":"2023-11-28T16:58:57.305447+0000","last_active":"2023-11-28T16:59:11.340568+0000","last_peered":"2023-11-28T16:59:11.340568+0000","last_clean":"2023-11-28T16:59:11.340568+0000","last_became_active":"2023-11-28T16:58:57.303738+0000","last_became_peered":"2023-11-28T16:58:57.303738+0000","last_unstale":"2023-11-28T16:59:11.340568+0000","last_undegraded":"2023-11-28T16:59:11.340568+0000","last_fullsized":"2023-11-28T16:59:11.340568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:55.486888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338748+0000","last_change":"2023-11-28T16:58:56.851226+0000","last_active":"2023-11-28T16:59:11.338748+0000","last_peered":"2023-11-28T16:59:11.338748+0000","last_clean":"2023-11-28T16:59:11.338748+0000","last_became_active":"2023-11-28T16:58:56.850870+0000","last_became_peered":"2023-11-28T16:58:56.850870+0000","last_unstale":"2023-11-28T16:59:11.338748+0000","last_undegraded":"2023-11-28T16:59:11.338748+0000","last_fullsized":"2023-11-28T16:59:11.338748+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358576+0000","last_change":"2023-11-28T16:59:11.366065+0000","last_active":"2023-11-28T16:59:12.358576+0000","last_peered":"2023-11-28T16:59:12.358576+0000","last_clean":"2023-11-28T16:59:12.358576+0000","last_became_active":"2023-11-28T16:59:11.365708+0000","last_became_peered":"2023-11-28T16:59:11.365708+0000","last_unstale":"2023-11-28T16:59:12.358576+0000","last_undegraded":"2023-11-28T16:59:12.358576+0000","last_fullsized":"2023-11-28T16:59:12.358576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:28.948241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.374654+0000","last_change":"2023-11-28T16:59:10.346621+0000","last_active":"2023-11-28T16:59:11.374654+0000","last_peered":"2023-11-28T16:59:11.374654+0000","last_clean":"2023-11-28T16:59:11.374654+0000","last_became_active":"2023-11-28T16:59:10.346293+0000","last_became_peered":"2023-11-28T16:59:10.346293+0000","last_unstale":"2023-11-28T16:59:11.374654+0000","last_undegraded":"2023-11-28T16:59:11.374654+0000","last_fullsized":"2023-11-28T16:59:11.374654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:24.772088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341788+0000","last_change":"2023-11-28T16:58:57.305573+0000","last_active":"2023-11-28T16:59:11.341788+0000","last_peered":"2023-11-28T16:59:11.341788+0000","last_clean":"2023-11-28T16:59:11.341788+0000","last_became_active":"2023-11-28T16:58:57.299574+0000","last_became_peered":"2023-11-28T16:58:57.299574+0000","last_unstale":"2023-11-28T16:59:11.341788+0000","last_undegraded":"2023-11-28T16:59:11.341788+0000","last_fullsized":"2023-11-28T16:59:11.341788+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.334677+0000","last_change":"2023-11-28T16:58:56.849113+0000","last_active":"2023-11-28T16:59:11.334677+0000","last_peered":"2023-11-28T16:59:11.334677+0000","last_clean":"2023-11-28T16:59:11.334677+0000","last_became_active":"2023-11-28T16:58:56.848817+0000","last_became_peered":"2023-11-28T16:58:56.848817+0000","last_unstale":"2023-11-28T16:59:11.334677+0000","last_undegraded":"2023-11-28T16:59:11.334677+0000","last_fullsized":"2023-11-28T16:59:11.334677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:29.256426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.360600+0000","last_change":"2023-11-28T16:59:11.369436+0000","last_active":"2023-11-28T16:59:12.360600+0000","last_peered":"2023-11-28T16:59:12.360600+0000","last_clean":"2023-11-28T16:59:12.360600+0000","last_became_active":"2023-11-28T16:59:11.369145+0000","last_became_peered":"2023-11-28T16:59:11.369145+0000","last_unstale":"2023-11-28T16:59:12.360600+0000","last_undegraded":"2023-11-28T16:59:12.360600+0000","last_fullsized":"2023-11-28T16:59:12.360600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:04:54.451544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"72'3","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.376030+0000","last_change":"2023-11-28T16:59:10.353276+0000","last_active":"2023-11-28T16:59:11.376030+0000","last_peered":"2023-11-28T16:59:11.376030+0000","last_clean":"2023-11-28T16:59:11.376030+0000","last_became_active":"2023-11-28T16:59:10.350942+0000","last_became_peered":"2023-11-28T16:59:10.350942+0000","last_unstale":"2023-11-28T16:59:11.376030+0000","last_undegraded":"2023-11-28T16:59:11.376030+0000","last_fullsized":"2023-11-28T16:59:11.376030+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:21.072769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.346241+0000","last_change":"2023-11-28T16:58:57.308897+0000","last_active":"2023-11-28T16:59:11.346241+0000","last_peered":"2023-11-28T16:59:11.346241+0000","last_clean":"2023-11-28T16:59:11.346241+0000","last_became_active":"2023-11-28T16:58:57.308635+0000","last_became_peered":"2023-11-28T16:58:57.308635+0000","last_unstale":"2023-11-28T16:59:11.346241+0000","last_undegraded":"2023-11-28T16:59:11.346241+0000","last_fullsized":"2023-11-28T16:59:11.346241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349020+0000","last_change":"2023-11-28T16:58:56.859941+0000","last_active":"2023-11-28T16:59:11.349020+0000","last_peered":"2023-11-28T16:59:11.349020+0000","last_clean":"2023-11-28T16:59:11.349020+0000","last_became_active":"2023-11-28T16:58:56.859614+0000","last_became_peered":"2023-11-28T16:58:56.859614+0000","last_unstale":"2023-11-28T16:59:11.349020+0000","last_undegraded":"2023-11-28T16:59:11.349020+0000","last_fullsized":"2023-11-28T16:59:11.349020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358964+0000","last_change":"2023-11-28T16:59:11.366163+0000","last_active":"2023-11-28T16:59:12.358964+0000","last_peered":"2023-11-28T16:59:12.358964+0000","last_clean":"2023-11-28T16:59:12.358964+0000","last_became_active":"2023-11-28T16:59:11.365344+0000","last_became_peered":"2023-11-28T16:59:11.365344+0000","last_unstale":"2023-11-28T16:59:12.358964+0000","last_undegraded":"2023-11-28T16:59:12.358964+0000","last_fullsized":"2023-11-28T16:59:12.358964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:57.039647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"72'6","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.382664+0000","last_change":"2023-11-28T16:59:10.358405+0000","last_active":"2023-11-28T16:59:11.382664+0000","last_peered":"2023-11-28T16:59:11.382664+0000","last_clean":"2023-11-28T16:59:11.382664+0000","last_became_active":"2023-11-28T16:59:10.358127+0000","last_became_peered":"2023-11-28T16:59:10.358127+0000","last_unstale":"2023-11-28T16:59:11.382664+0000","last_undegraded":"2023-11-28T16:59:11.382664+0000","last_fullsized":"2023-11-28T16:59:11.382664+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:23.990228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352510+0000","last_change":"2023-11-28T16:58:57.318731+0000","last_active":"2023-11-28T16:59:11.352510+0000","last_peered":"2023-11-28T16:59:11.352510+0000","last_clean":"2023-11-28T16:59:11.352510+0000","last_became_active":"2023-11-28T16:58:57.318407+0000","last_became_peered":"2023-11-28T16:58:57.318407+0000","last_unstale":"2023-11-28T16:59:11.352510+0000","last_undegraded":"2023-11-28T16:59:11.352510+0000","last_fullsized":"2023-11-28T16:59:11.352510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:02.122846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352986+0000","last_change":"2023-11-28T16:58:56.851849+0000","last_active":"2023-11-28T16:59:11.352986+0000","last_peered":"2023-11-28T16:59:11.352986+0000","last_clean":"2023-11-28T16:59:11.352986+0000","last_became_active":"2023-11-28T16:58:56.851487+0000","last_became_peered":"2023-11-28T16:58:56.851487+0000","last_unstale":"2023-11-28T16:59:11.352986+0000","last_undegraded":"2023-11-28T16:59:11.352986+0000","last_fullsized":"2023-11-28T16:59:11.352986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:15.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358863+0000","last_change":"2023-11-28T16:59:11.353720+0000","last_active":"2023-11-28T16:59:12.358863+0000","last_peered":"2023-11-28T16:59:12.358863+0000","last_clean":"2023-11-28T16:59:12.358863+0000","last_became_active":"2023-11-28T16:59:11.353417+0000","last_became_peered":"2023-11-28T16:59:11.353417+0000","last_unstale":"2023-11-28T16:59:12.358863+0000","last_undegraded":"2023-11-28T16:59:12.358863+0000","last_fullsized":"2023-11-28T16:59:12.358863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:56:06.225260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337491+0000","last_change":"2023-11-28T16:59:10.350544+0000","last_active":"2023-11-28T16:59:11.337491+0000","last_peered":"2023-11-28T16:59:11.337491+0000","last_clean":"2023-11-28T16:59:11.337491+0000","last_became_active":"2023-11-28T16:59:10.350269+0000","last_became_peered":"2023-11-28T16:59:10.350269+0000","last_unstale":"2023-11-28T16:59:11.337491+0000","last_undegraded":"2023-11-28T16:59:11.337491+0000","last_fullsized":"2023-11-28T16:59:11.337491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:17.343314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338386+0000","last_change":"2023-11-28T16:58:57.308250+0000","last_active":"2023-11-28T16:59:11.338386+0000","last_peered":"2023-11-28T16:59:11.338386+0000","last_clean":"2023-11-28T16:59:11.338386+0000","last_became_active":"2023-11-28T16:58:57.307951+0000","last_became_peered":"2023-11-28T16:58:57.307951+0000","last_unstale":"2023-11-28T16:59:11.338386+0000","last_undegraded":"2023-11-28T16:59:11.338386+0000","last_fullsized":"2023-11-28T16:59:11.338386+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.351595+0000","last_change":"2023-11-28T16:58:56.858285+0000","last_active":"2023-11-28T16:59:11.351595+0000","last_peered":"2023-11-28T16:59:11.351595+0000","last_clean":"2023-11-28T16:59:11.351595+0000","last_became_active":"2023-11-28T16:58:56.857956+0000","last_became_peered":"2023-11-28T16:58:56.857956+0000","last_unstale":"2023-11-28T16:59:11.351595+0000","last_undegraded":"2023-11-28T16:59:11.351595+0000","last_fullsized":"2023-11-28T16:59:11.351595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424411+0000","last_change":"2023-11-28T16:59:11.363341+0000","last_active":"2023-11-28T16:59:12.424411+0000","last_peered":"2023-11-28T16:59:12.424411+0000","last_clean":"2023-11-28T16:59:12.424411+0000","last_became_active":"2023-11-28T16:59:11.363074+0000","last_became_peered":"2023-11-28T16:59:11.363074+0000","last_unstale":"2023-11-28T16:59:12.424411+0000","last_undegraded":"2023-11-28T16:59:12.424411+0000","last_fullsized":"2023-11-28T16:59:12.424411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:48.925964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.346075+0000","last_change":"2023-11-28T16:59:10.361775+0000","last_active":"2023-11-28T16:59:11.346075+0000","last_peered":"2023-11-28T16:59:11.346075+0000","last_clean":"2023-11-28T16:59:11.346075+0000","last_became_active":"2023-11-28T16:59:10.360411+0000","last_became_peered":"2023-11-28T16:59:10.360411+0000","last_unstale":"2023-11-28T16:59:11.346075+0000","last_undegraded":"2023-11-28T16:59:11.346075+0000","last_fullsized":"2023-11-28T16:59:11.346075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:04.597944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.340279+0000","last_change":"2023-11-28T16:58:57.305562+0000","last_active":"2023-11-28T16:59:11.340279+0000","last_peered":"2023-11-28T16:59:11.340279+0000","last_clean":"2023-11-28T16:59:11.340279+0000","last_became_active":"2023-11-28T16:58:57.305130+0000","last_became_peered":"2023-11-28T16:58:57.305130+0000","last_unstale":"2023-11-28T16:59:11.340279+0000","last_undegraded":"2023-11-28T16:59:11.340279+0000","last_fullsized":"2023-11-28T16:59:11.340279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:33.682779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"69'8","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.351978+0000","last_change":"2023-11-28T16:58:56.856203+0000","last_active":"2023-11-28T16:59:11.351978+0000","last_peered":"2023-11-28T16:59:11.351978+0000","last_clean":"2023-11-28T16:59:11.351978+0000","last_became_active":"2023-11-28T16:58:56.855887+0000","last_became_peered":"2023-11-28T16:58:56.855887+0000","last_unstale":"2023-11-28T16:59:11.351978+0000","last_undegraded":"2023-11-28T16:59:11.351978+0000","last_fullsized":"2023-11-28T16:59:11.351978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423759+0000","last_change":"2023-11-28T16:59:11.359134+0000","last_active":"2023-11-28T16:59:12.423759+0000","last_peered":"2023-11-28T16:59:12.423759+0000","last_clean":"2023-11-28T16:59:12.423759+0000","last_became_active":"2023-11-28T16:59:11.358824+0000","last_became_peered":"2023-11-28T16:59:11.358824+0000","last_unstale":"2023-11-28T16:59:12.423759+0000","last_undegraded":"2023-11-28T16:59:12.423759+0000","last_fullsized":"2023-11-28T16:59:12.423759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:05.645793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337763+0000","last_change":"2023-11-28T16:59:10.354078+0000","last_active":"2023-11-28T16:59:11.337763+0000","last_peered":"2023-11-28T16:59:11.337763+0000","last_clean":"2023-11-28T16:59:11.337763+0000","last_became_active":"2023-11-28T16:59:10.353724+0000","last_became_peered":"2023-11-28T16:59:10.353724+0000","last_unstale":"2023-11-28T16:59:11.337763+0000","last_undegraded":"2023-11-28T16:59:11.337763+0000","last_fullsized":"2023-11-28T16:59:11.337763+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:51.226844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339610+0000","last_change":"2023-11-28T16:58:57.302777+0000","last_active":"2023-11-28T16:59:11.339610+0000","last_peered":"2023-11-28T16:59:11.339610+0000","last_clean":"2023-11-28T16:59:11.339610+0000","last_became_active":"2023-11-28T16:58:57.302479+0000","last_became_peered":"2023-11-28T16:58:57.302479+0000","last_unstale":"2023-11-28T16:59:11.339610+0000","last_undegraded":"2023-11-28T16:59:11.339610+0000","last_fullsized":"2023-11-28T16:59:11.339610+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337262+0000","last_change":"2023-11-28T16:58:56.846727+0000","last_active":"2023-11-28T16:59:11.337262+0000","last_peered":"2023-11-28T16:59:11.337262+0000","last_clean":"2023-11-28T16:59:11.337262+0000","last_became_active":"2023-11-28T16:58:56.846403+0000","last_became_peered":"2023-11-28T16:58:56.846403+0000","last_unstale":"2023-11-28T16:59:11.337262+0000","last_undegraded":"2023-11-28T16:59:11.337262+0000","last_fullsized":"2023-11-28T16:59:11.337262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:42.852604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424258+0000","last_change":"2023-11-28T16:59:11.363300+0000","last_active":"2023-11-28T16:59:12.424258+0000","last_peered":"2023-11-28T16:59:12.424258+0000","last_clean":"2023-11-28T16:59:12.424258+0000","last_became_active":"2023-11-28T16:59:11.362960+0000","last_became_peered":"2023-11-28T16:59:11.362960+0000","last_unstale":"2023-11-28T16:59:12.424258+0000","last_undegraded":"2023-11-28T16:59:12.424258+0000","last_fullsized":"2023-11-28T16:59:12.424258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:43.754338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"72'8","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.377590+0000","last_change":"2023-11-28T16:59:10.351225+0000","last_active":"2023-11-28T16:59:11.377590+0000","last_peered":"2023-11-28T16:59:11.377590+0000","last_clean":"2023-11-28T16:59:11.377590+0000","last_became_active":"2023-11-28T16:59:10.350982+0000","last_became_peered":"2023-11-28T16:59:10.350982+0000","last_unstale":"2023-11-28T16:59:11.377590+0000","last_undegraded":"2023-11-28T16:59:11.377590+0000","last_fullsized":"2023-11-28T16:59:11.377590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:09:29.442845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341984+0000","last_change":"2023-11-28T16:58:57.301185+0000","last_active":"2023-11-28T16:59:11.341984+0000","last_peered":"2023-11-28T16:59:11.341984+0000","last_clean":"2023-11-28T16:59:11.341984+0000","last_became_active":"2023-11-28T16:58:57.300882+0000","last_became_peered":"2023-11-28T16:58:57.300882+0000","last_unstale":"2023-11-28T16:59:11.341984+0000","last_undegraded":"2023-11-28T16:59:11.341984+0000","last_fullsized":"2023-11-28T16:59:11.341984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:24.918792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.344891+0000","last_change":"2023-11-28T16:58:56.855489+0000","last_active":"2023-11-28T16:59:11.344891+0000","last_peered":"2023-11-28T16:59:11.344891+0000","last_clean":"2023-11-28T16:59:11.344891+0000","last_became_active":"2023-11-28T16:58:56.855127+0000","last_became_peered":"2023-11-28T16:58:56.855127+0000","last_unstale":"2023-11-28T16:59:11.344891+0000","last_undegraded":"2023-11-28T16:59:11.344891+0000","last_fullsized":"2023-11-28T16:59:11.344891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:03.854671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423388+0000","last_change":"2023-11-28T16:59:11.368359+0000","last_active":"2023-11-28T16:59:12.423388+0000","last_peered":"2023-11-28T16:59:12.423388+0000","last_clean":"2023-11-28T16:59:12.423388+0000","last_became_active":"2023-11-28T16:59:11.368056+0000","last_became_peered":"2023-11-28T16:59:11.368056+0000","last_unstale":"2023-11-28T16:59:12.423388+0000","last_undegraded":"2023-11-28T16:59:12.423388+0000","last_fullsized":"2023-11-28T16:59:12.423388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:22.255540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.374005+0000","last_change":"2023-11-28T16:59:10.359324+0000","last_active":"2023-11-28T16:59:11.374005+0000","last_peered":"2023-11-28T16:59:11.374005+0000","last_clean":"2023-11-28T16:59:11.374005+0000","last_became_active":"2023-11-28T16:59:10.358915+0000","last_became_peered":"2023-11-28T16:59:10.358915+0000","last_unstale":"2023-11-28T16:59:11.374005+0000","last_undegraded":"2023-11-28T16:59:11.374005+0000","last_fullsized":"2023-11-28T16:59:11.374005+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:45.464615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.334643+0000","last_change":"2023-11-28T16:58:57.297734+0000","last_active":"2023-11-28T16:59:11.334643+0000","last_peered":"2023-11-28T16:59:11.334643+0000","last_clean":"2023-11-28T16:59:11.334643+0000","last_became_active":"2023-11-28T16:58:57.297456+0000","last_became_peered":"2023-11-28T16:58:57.297456+0000","last_unstale":"2023-11-28T16:59:11.334643+0000","last_undegraded":"2023-11-28T16:59:11.334643+0000","last_fullsized":"2023-11-28T16:59:11.334643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:40:26.259309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.353350+0000","last_change":"2023-11-28T16:58:56.852318+0000","last_active":"2023-11-28T16:59:11.353350+0000","last_peered":"2023-11-28T16:59:11.353350+0000","last_clean":"2023-11-28T16:59:11.353350+0000","last_became_active":"2023-11-28T16:58:56.851992+0000","last_became_peered":"2023-11-28T16:58:56.851992+0000","last_unstale":"2023-11-28T16:59:11.353350+0000","last_undegraded":"2023-11-28T16:59:11.353350+0000","last_fullsized":"2023-11-28T16:59:11.353350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424660+0000","last_change":"2023-11-28T16:59:11.350978+0000","last_active":"2023-11-28T16:59:12.424660+0000","last_peered":"2023-11-28T16:59:12.424660+0000","last_clean":"2023-11-28T16:59:12.424660+0000","last_became_active":"2023-11-28T16:59:11.350661+0000","last_became_peered":"2023-11-28T16:59:11.350661+0000","last_unstale":"2023-11-28T16:59:12.424660+0000","last_undegraded":"2023-11-28T16:59:12.424660+0000","last_fullsized":"2023-11-28T16:59:12.424660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:14.842081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348347+0000","last_change":"2023-11-28T16:59:10.356550+0000","last_active":"2023-11-28T16:59:11.348347+0000","last_peered":"2023-11-28T16:59:11.348347+0000","last_clean":"2023-11-28T16:59:11.348347+0000","last_became_active":"2023-11-28T16:59:10.356290+0000","last_became_peered":"2023-11-28T16:59:10.356290+0000","last_unstale":"2023-11-28T16:59:11.348347+0000","last_undegraded":"2023-11-28T16:59:11.348347+0000","last_fullsized":"2023-11-28T16:59:11.348347+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:03.291209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.335108+0000","last_change":"2023-11-28T16:58:57.307166+0000","last_active":"2023-11-28T16:59:11.335108+0000","last_peered":"2023-11-28T16:59:11.335108+0000","last_clean":"2023-11-28T16:59:11.335108+0000","last_became_active":"2023-11-28T16:58:57.306917+0000","last_became_peered":"2023-11-28T16:58:57.306917+0000","last_unstale":"2023-11-28T16:59:11.335108+0000","last_undegraded":"2023-11-28T16:59:11.335108+0000","last_fullsized":"2023-11-28T16:59:11.335108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:09.266608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339360+0000","last_change":"2023-11-28T16:58:56.858590+0000","last_active":"2023-11-28T16:59:11.339360+0000","last_peered":"2023-11-28T16:59:11.339360+0000","last_clean":"2023-11-28T16:59:11.339360+0000","last_became_active":"2023-11-28T16:58:56.858306+0000","last_became_peered":"2023-11-28T16:58:56.858306+0000","last_unstale":"2023-11-28T16:59:11.339360+0000","last_undegraded":"2023-11-28T16:59:11.339360+0000","last_fullsized":"2023-11-28T16:59:11.339360+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:45.917863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.425013+0000","last_change":"2023-11-28T16:59:11.366479+0000","last_active":"2023-11-28T16:59:12.425013+0000","last_peered":"2023-11-28T16:59:12.425013+0000","last_clean":"2023-11-28T16:59:12.425013+0000","last_became_active":"2023-11-28T16:59:11.366212+0000","last_became_peered":"2023-11-28T16:59:11.366212+0000","last_unstale":"2023-11-28T16:59:12.425013+0000","last_undegraded":"2023-11-28T16:59:12.425013+0000","last_fullsized":"2023-11-28T16:59:12.425013+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:19.504977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.365408+0000","last_change":"2023-11-28T16:59:10.356051+0000","last_active":"2023-11-28T16:59:11.365408+0000","last_peered":"2023-11-28T16:59:11.365408+0000","last_clean":"2023-11-28T16:59:11.365408+0000","last_became_active":"2023-11-28T16:59:10.355771+0000","last_became_peered":"2023-11-28T16:59:10.355771+0000","last_unstale":"2023-11-28T16:59:11.365408+0000","last_undegraded":"2023-11-28T16:59:11.365408+0000","last_fullsized":"2023-11-28T16:59:11.365408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:21.246271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.342864+0000","last_change":"2023-11-28T16:58:57.310263+0000","last_active":"2023-11-28T16:59:11.342864+0000","last_peered":"2023-11-28T16:59:11.342864+0000","last_clean":"2023-11-28T16:59:11.342864+0000","last_became_active":"2023-11-28T16:58:57.309857+0000","last_became_peered":"2023-11-28T16:58:57.309857+0000","last_unstale":"2023-11-28T16:59:11.342864+0000","last_undegraded":"2023-11-28T16:59:11.342864+0000","last_fullsized":"2023-11-28T16:59:11.342864+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:06.013018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349201+0000","last_change":"2023-11-28T16:58:56.858637+0000","last_active":"2023-11-28T16:59:11.349201+0000","last_peered":"2023-11-28T16:59:11.349201+0000","last_clean":"2023-11-28T16:59:11.349201+0000","last_became_active":"2023-11-28T16:58:56.858330+0000","last_became_peered":"2023-11-28T16:58:56.858330+0000","last_unstale":"2023-11-28T16:59:11.349201+0000","last_undegraded":"2023-11-28T16:59:11.349201+0000","last_fullsized":"2023-11-28T16:59:11.349201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:41.880073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.358997+0000","last_change":"2023-11-28T16:59:11.362922+0000","last_active":"2023-11-28T16:59:12.358997+0000","last_peered":"2023-11-28T16:59:12.358997+0000","last_clean":"2023-11-28T16:59:12.358997+0000","last_became_active":"2023-11-28T16:59:11.362629+0000","last_became_peered":"2023-11-28T16:59:11.362629+0000","last_unstale":"2023-11-28T16:59:12.358997+0000","last_undegraded":"2023-11-28T16:59:12.358997+0000","last_fullsized":"2023-11-28T16:59:12.358997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:19.050220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337903+0000","last_change":"2023-11-28T16:59:10.349325+0000","last_active":"2023-11-28T16:59:11.337903+0000","last_peered":"2023-11-28T16:59:11.337903+0000","last_clean":"2023-11-28T16:59:11.337903+0000","last_became_active":"2023-11-28T16:59:10.348989+0000","last_became_peered":"2023-11-28T16:59:10.348989+0000","last_unstale":"2023-11-28T16:59:11.337903+0000","last_undegraded":"2023-11-28T16:59:11.337903+0000","last_fullsized":"2023-11-28T16:59:11.337903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:23.990228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348797+0000","last_change":"2023-11-28T16:58:57.306363+0000","last_active":"2023-11-28T16:59:11.348797+0000","last_peered":"2023-11-28T16:59:11.348797+0000","last_clean":"2023-11-28T16:59:11.348797+0000","last_became_active":"2023-11-28T16:58:57.305727+0000","last_became_peered":"2023-11-28T16:58:57.305727+0000","last_unstale":"2023-11-28T16:59:11.348797+0000","last_undegraded":"2023-11-28T16:59:11.348797+0000","last_fullsized":"2023-11-28T16:59:11.348797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:14.485729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.343582+0000","last_change":"2023-11-28T16:58:56.849263+0000","last_active":"2023-11-28T16:59:11.343582+0000","last_peered":"2023-11-28T16:59:11.343582+0000","last_clean":"2023-11-28T16:59:11.343582+0000","last_became_active":"2023-11-28T16:58:56.848949+0000","last_became_peered":"2023-11-28T16:58:56.848949+0000","last_unstale":"2023-11-28T16:59:11.343582+0000","last_undegraded":"2023-11-28T16:59:11.343582+0000","last_fullsized":"2023-11-28T16:59:11.343582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:07.135759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.360947+0000","last_change":"2023-11-28T16:59:11.371149+0000","last_active":"2023-11-28T16:59:12.360947+0000","last_peered":"2023-11-28T16:59:12.360947+0000","last_clean":"2023-11-28T16:59:12.360947+0000","last_became_active":"2023-11-28T16:59:11.370880+0000","last_became_peered":"2023-11-28T16:59:11.370880+0000","last_unstale":"2023-11-28T16:59:12.360947+0000","last_undegraded":"2023-11-28T16:59:12.360947+0000","last_fullsized":"2023-11-28T16:59:12.360947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:57.039647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.377691+0000","last_change":"2023-11-28T16:59:10.351060+0000","last_active":"2023-11-28T16:59:11.377691+0000","last_peered":"2023-11-28T16:59:11.377691+0000","last_clean":"2023-11-28T16:59:11.377691+0000","last_became_active":"2023-11-28T16:59:10.350492+0000","last_became_peered":"2023-11-28T16:59:10.350492+0000","last_unstale":"2023-11-28T16:59:11.377691+0000","last_undegraded":"2023-11-28T16:59:11.377691+0000","last_fullsized":"2023-11-28T16:59:11.377691+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:49.318481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.340367+0000","last_change":"2023-11-28T16:58:57.306164+0000","last_active":"2023-11-28T16:59:11.340367+0000","last_peered":"2023-11-28T16:59:11.340367+0000","last_clean":"2023-11-28T16:59:11.340367+0000","last_became_active":"2023-11-28T16:58:57.300959+0000","last_became_peered":"2023-11-28T16:58:57.300959+0000","last_unstale":"2023-11-28T16:59:11.340367+0000","last_undegraded":"2023-11-28T16:59:11.340367+0000","last_fullsized":"2023-11-28T16:59:11.340367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:28.580383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338579+0000","last_change":"2023-11-28T16:58:56.850381+0000","last_active":"2023-11-28T16:59:11.338579+0000","last_peered":"2023-11-28T16:59:11.338579+0000","last_clean":"2023-11-28T16:59:11.338579+0000","last_became_active":"2023-11-28T16:58:56.850116+0000","last_became_peered":"2023-11-28T16:58:56.850116+0000","last_unstale":"2023-11-28T16:59:11.338579+0000","last_undegraded":"2023-11-28T16:59:11.338579+0000","last_fullsized":"2023-11-28T16:59:11.338579+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423220+0000","last_change":"2023-11-28T16:59:11.362028+0000","last_active":"2023-11-28T16:59:12.423220+0000","last_peered":"2023-11-28T16:59:12.423220+0000","last_clean":"2023-11-28T16:59:12.423220+0000","last_became_active":"2023-11-28T16:59:11.361069+0000","last_became_peered":"2023-11-28T16:59:11.361069+0000","last_unstale":"2023-11-28T16:59:12.423220+0000","last_undegraded":"2023-11-28T16:59:12.423220+0000","last_fullsized":"2023-11-28T16:59:12.423220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:10.935873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.353118+0000","last_change":"2023-11-28T16:59:10.359711+0000","last_active":"2023-11-28T16:59:11.353118+0000","last_peered":"2023-11-28T16:59:11.353118+0000","last_clean":"2023-11-28T16:59:11.353118+0000","last_became_active":"2023-11-28T16:59:10.359423+0000","last_became_peered":"2023-11-28T16:59:10.359423+0000","last_unstale":"2023-11-28T16:59:11.353118+0000","last_undegraded":"2023-11-28T16:59:11.353118+0000","last_fullsized":"2023-11-28T16:59:11.353118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:26.968418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348720+0000","last_change":"2023-11-28T16:58:57.309597+0000","last_active":"2023-11-28T16:59:11.348720+0000","last_peered":"2023-11-28T16:59:11.348720+0000","last_clean":"2023-11-28T16:59:11.348720+0000","last_became_active":"2023-11-28T16:58:57.309372+0000","last_became_peered":"2023-11-28T16:58:57.309372+0000","last_unstale":"2023-11-28T16:59:11.348720+0000","last_undegraded":"2023-11-28T16:59:11.348720+0000","last_fullsized":"2023-11-28T16:59:11.348720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:35.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.342598+0000","last_change":"2023-11-28T16:58:56.861806+0000","last_active":"2023-11-28T16:59:11.342598+0000","last_peered":"2023-11-28T16:59:11.342598+0000","last_clean":"2023-11-28T16:59:11.342598+0000","last_became_active":"2023-11-28T16:58:56.861498+0000","last_became_peered":"2023-11-28T16:58:56.861498+0000","last_unstale":"2023-11-28T16:59:11.342598+0000","last_undegraded":"2023-11-28T16:59:11.342598+0000","last_fullsized":"2023-11-28T16:59:11.342598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.359975+0000","last_change":"2023-11-28T16:59:11.364593+0000","last_active":"2023-11-28T16:59:12.359975+0000","last_peered":"2023-11-28T16:59:12.359975+0000","last_clean":"2023-11-28T16:59:12.359975+0000","last_became_active":"2023-11-28T16:59:11.363804+0000","last_became_peered":"2023-11-28T16:59:11.363804+0000","last_unstale":"2023-11-28T16:59:12.359975+0000","last_undegraded":"2023-11-28T16:59:12.359975+0000","last_fullsized":"2023-11-28T16:59:12.359975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:22.082038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339127+0000","last_change":"2023-11-28T16:59:10.341641+0000","last_active":"2023-11-28T16:59:11.339127+0000","last_peered":"2023-11-28T16:59:11.339127+0000","last_clean":"2023-11-28T16:59:11.339127+0000","last_became_active":"2023-11-28T16:59:10.341280+0000","last_became_peered":"2023-11-28T16:59:10.341280+0000","last_unstale":"2023-11-28T16:59:11.339127+0000","last_undegraded":"2023-11-28T16:59:11.339127+0000","last_fullsized":"2023-11-28T16:59:11.339127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:50:21.246271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352620+0000","last_change":"2023-11-28T16:58:57.306140+0000","last_active":"2023-11-28T16:59:11.352620+0000","last_peered":"2023-11-28T16:59:11.352620+0000","last_clean":"2023-11-28T16:59:11.352620+0000","last_became_active":"2023-11-28T16:58:57.305865+0000","last_became_peered":"2023-11-28T16:58:57.305865+0000","last_unstale":"2023-11-28T16:59:11.352620+0000","last_undegraded":"2023-11-28T16:59:11.352620+0000","last_fullsized":"2023-11-28T16:59:11.352620+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:37.435102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348831+0000","last_change":"2023-11-28T16:58:56.855751+0000","last_active":"2023-11-28T16:59:11.348831+0000","last_peered":"2023-11-28T16:59:11.348831+0000","last_clean":"2023-11-28T16:59:11.348831+0000","last_became_active":"2023-11-28T16:58:56.855432+0000","last_became_peered":"2023-11-28T16:58:56.855432+0000","last_unstale":"2023-11-28T16:59:11.348831+0000","last_undegraded":"2023-11-28T16:59:11.348831+0000","last_fullsized":"2023-11-28T16:59:11.348831+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:24:24.546921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424696+0000","last_change":"2023-11-28T16:59:11.378798+0000","last_active":"2023-11-28T16:59:12.424696+0000","last_peered":"2023-11-28T16:59:12.424696+0000","last_clean":"2023-11-28T16:59:12.424696+0000","last_became_active":"2023-11-28T16:59:11.378472+0000","last_became_peered":"2023-11-28T16:59:11.378472+0000","last_unstale":"2023-11-28T16:59:12.424696+0000","last_undegraded":"2023-11-28T16:59:12.424696+0000","last_fullsized":"2023-11-28T16:59:12.424696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:40:39.751268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.365730+0000","last_change":"2023-11-28T16:59:10.363613+0000","last_active":"2023-11-28T16:59:11.365730+0000","last_peered":"2023-11-28T16:59:11.365730+0000","last_clean":"2023-11-28T16:59:11.365730+0000","last_became_active":"2023-11-28T16:59:10.361615+0000","last_became_peered":"2023-11-28T16:59:10.361615+0000","last_unstale":"2023-11-28T16:59:11.365730+0000","last_undegraded":"2023-11-28T16:59:11.365730+0000","last_fullsized":"2023-11-28T16:59:11.365730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:04.597944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349935+0000","last_change":"2023-11-28T16:58:57.307399+0000","last_active":"2023-11-28T16:59:11.349935+0000","last_peered":"2023-11-28T16:59:11.349935+0000","last_clean":"2023-11-28T16:59:11.349935+0000","last_became_active":"2023-11-28T16:58:57.307122+0000","last_became_peered":"2023-11-28T16:58:57.307122+0000","last_unstale":"2023-11-28T16:59:11.349935+0000","last_undegraded":"2023-11-28T16:59:11.349935+0000","last_fullsized":"2023-11-28T16:59:11.349935+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:56:08.650099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.348129+0000","last_change":"2023-11-28T16:58:56.863311+0000","last_active":"2023-11-28T16:59:11.348129+0000","last_peered":"2023-11-28T16:59:11.348129+0000","last_clean":"2023-11-28T16:59:11.348129+0000","last_became_active":"2023-11-28T16:58:56.863048+0000","last_became_peered":"2023-11-28T16:58:56.863048+0000","last_unstale":"2023-11-28T16:59:11.348129+0000","last_undegraded":"2023-11-28T16:59:11.348129+0000","last_fullsized":"2023-11-28T16:59:11.348129+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:51.407849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424825+0000","last_change":"2023-11-28T16:59:11.365033+0000","last_active":"2023-11-28T16:59:12.424825+0000","last_peered":"2023-11-28T16:59:12.424825+0000","last_clean":"2023-11-28T16:59:12.424825+0000","last_became_active":"2023-11-28T16:59:11.364656+0000","last_became_peered":"2023-11-28T16:59:11.364656+0000","last_unstale":"2023-11-28T16:59:12.424825+0000","last_undegraded":"2023-11-28T16:59:12.424825+0000","last_fullsized":"2023-11-28T16:59:12.424825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:51.413571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352265+0000","last_change":"2023-11-28T16:59:10.354339+0000","last_active":"2023-11-28T16:59:11.352265+0000","last_peered":"2023-11-28T16:59:11.352265+0000","last_clean":"2023-11-28T16:59:11.352265+0000","last_became_active":"2023-11-28T16:59:10.354021+0000","last_became_peered":"2023-11-28T16:59:10.354021+0000","last_unstale":"2023-11-28T16:59:11.352265+0000","last_undegraded":"2023-11-28T16:59:11.352265+0000","last_fullsized":"2023-11-28T16:59:11.352265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:37.401482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.353207+0000","last_change":"2023-11-28T16:58:57.316056+0000","last_active":"2023-11-28T16:59:11.353207+0000","last_peered":"2023-11-28T16:59:11.353207+0000","last_clean":"2023-11-28T16:59:11.353207+0000","last_became_active":"2023-11-28T16:58:57.315754+0000","last_became_peered":"2023-11-28T16:58:57.315754+0000","last_unstale":"2023-11-28T16:59:11.353207+0000","last_undegraded":"2023-11-28T16:59:11.353207+0000","last_fullsized":"2023-11-28T16:59:11.353207+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:42.886026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341118+0000","last_change":"2023-11-28T16:58:56.862068+0000","last_active":"2023-11-28T16:59:11.341118+0000","last_peered":"2023-11-28T16:59:11.341118+0000","last_clean":"2023-11-28T16:59:11.341118+0000","last_became_active":"2023-11-28T16:58:56.861701+0000","last_became_peered":"2023-11-28T16:58:56.861701+0000","last_unstale":"2023-11-28T16:59:11.341118+0000","last_undegraded":"2023-11-28T16:59:11.341118+0000","last_fullsized":"2023-11-28T16:59:11.341118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:32.676826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.425585+0000","last_change":"2023-11-28T16:59:11.369313+0000","last_active":"2023-11-28T16:59:12.425585+0000","last_peered":"2023-11-28T16:59:12.425585+0000","last_clean":"2023-11-28T16:59:12.425585+0000","last_became_active":"2023-11-28T16:59:11.369030+0000","last_became_peered":"2023-11-28T16:59:11.369030+0000","last_unstale":"2023-11-28T16:59:12.425585+0000","last_undegraded":"2023-11-28T16:59:12.425585+0000","last_fullsized":"2023-11-28T16:59:12.425585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:38.410750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339551+0000","last_change":"2023-11-28T16:59:10.348634+0000","last_active":"2023-11-28T16:59:11.339551+0000","last_peered":"2023-11-28T16:59:11.339551+0000","last_clean":"2023-11-28T16:59:11.339551+0000","last_became_active":"2023-11-28T16:59:10.347746+0000","last_became_peered":"2023-11-28T16:59:10.347746+0000","last_unstale":"2023-11-28T16:59:11.339551+0000","last_undegraded":"2023-11-28T16:59:11.339551+0000","last_fullsized":"2023-11-28T16:59:11.339551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:29.279489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337713+0000","last_change":"2023-11-28T16:58:57.310885+0000","last_active":"2023-11-28T16:59:11.337713+0000","last_peered":"2023-11-28T16:59:11.337713+0000","last_clean":"2023-11-28T16:59:11.337713+0000","last_became_active":"2023-11-28T16:58:57.310590+0000","last_became_peered":"2023-11-28T16:58:57.310590+0000","last_unstale":"2023-11-28T16:59:11.337713+0000","last_undegraded":"2023-11-28T16:59:11.337713+0000","last_fullsized":"2023-11-28T16:59:11.337713+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:27.915149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337711+0000","last_change":"2023-11-28T16:58:56.859076+0000","last_active":"2023-11-28T16:59:11.337711+0000","last_peered":"2023-11-28T16:59:11.337711+0000","last_clean":"2023-11-28T16:59:11.337711+0000","last_became_active":"2023-11-28T16:58:56.858792+0000","last_became_peered":"2023-11-28T16:58:56.858792+0000","last_unstale":"2023-11-28T16:59:11.337711+0000","last_undegraded":"2023-11-28T16:59:11.337711+0000","last_fullsized":"2023-11-28T16:59:11.337711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:46.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.360747+0000","last_change":"2023-11-28T16:59:11.378921+0000","last_active":"2023-11-28T16:59:12.360747+0000","last_peered":"2023-11-28T16:59:12.360747+0000","last_clean":"2023-11-28T16:59:12.360747+0000","last_became_active":"2023-11-28T16:59:11.378609+0000","last_became_peered":"2023-11-28T16:59:11.378609+0000","last_unstale":"2023-11-28T16:59:12.360747+0000","last_undegraded":"2023-11-28T16:59:12.360747+0000","last_fullsized":"2023-11-28T16:59:12.360747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:28.948241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352267+0000","last_change":"2023-11-28T16:59:10.353734+0000","last_active":"2023-11-28T16:59:11.352267+0000","last_peered":"2023-11-28T16:59:11.352267+0000","last_clean":"2023-11-28T16:59:11.352267+0000","last_became_active":"2023-11-28T16:59:10.353369+0000","last_became_peered":"2023-11-28T16:59:10.353369+0000","last_unstale":"2023-11-28T16:59:11.352267+0000","last_undegraded":"2023-11-28T16:59:11.352267+0000","last_fullsized":"2023-11-28T16:59:11.352267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:24.772088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341378+0000","last_change":"2023-11-28T16:58:57.310281+0000","last_active":"2023-11-28T16:59:11.341378+0000","last_peered":"2023-11-28T16:59:11.341378+0000","last_clean":"2023-11-28T16:59:11.341378+0000","last_became_active":"2023-11-28T16:58:57.308492+0000","last_became_peered":"2023-11-28T16:58:57.308492+0000","last_unstale":"2023-11-28T16:59:11.341378+0000","last_undegraded":"2023-11-28T16:59:11.341378+0000","last_fullsized":"2023-11-28T16:59:11.341378+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:25:13.583829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"69'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337501+0000","last_change":"2023-11-28T16:58:56.848509+0000","last_active":"2023-11-28T16:59:11.337501+0000","last_peered":"2023-11-28T16:59:11.337501+0000","last_clean":"2023-11-28T16:59:11.337501+0000","last_became_active":"2023-11-28T16:58:56.847800+0000","last_became_peered":"2023-11-28T16:58:56.847800+0000","last_unstale":"2023-11-28T16:59:11.337501+0000","last_undegraded":"2023-11-28T16:59:11.337501+0000","last_fullsized":"2023-11-28T16:59:11.337501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:56.437961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.359027+0000","last_change":"2023-11-28T16:59:11.365374+0000","last_active":"2023-11-28T16:59:12.359027+0000","last_peered":"2023-11-28T16:59:12.359027+0000","last_clean":"2023-11-28T16:59:12.359027+0000","last_became_active":"2023-11-28T16:59:11.364918+0000","last_became_peered":"2023-11-28T16:59:11.364918+0000","last_unstale":"2023-11-28T16:59:12.359027+0000","last_undegraded":"2023-11-28T16:59:12.359027+0000","last_fullsized":"2023-11-28T16:59:12.359027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:30.723764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.369061+0000","last_change":"2023-11-28T16:59:10.350881+0000","last_active":"2023-11-28T16:59:11.369061+0000","last_peered":"2023-11-28T16:59:11.369061+0000","last_clean":"2023-11-28T16:59:11.369061+0000","last_became_active":"2023-11-28T16:59:10.350488+0000","last_became_peered":"2023-11-28T16:59:10.350488+0000","last_unstale":"2023-11-28T16:59:11.369061+0000","last_undegraded":"2023-11-28T16:59:11.369061+0000","last_fullsized":"2023-11-28T16:59:11.369061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:54.118824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352667+0000","last_change":"2023-11-28T16:58:57.316240+0000","last_active":"2023-11-28T16:59:11.352667+0000","last_peered":"2023-11-28T16:59:11.352667+0000","last_clean":"2023-11-28T16:59:11.352667+0000","last_became_active":"2023-11-28T16:58:57.315895+0000","last_became_peered":"2023-11-28T16:58:57.315895+0000","last_unstale":"2023-11-28T16:59:11.352667+0000","last_undegraded":"2023-11-28T16:59:11.352667+0000","last_fullsized":"2023-11-28T16:59:11.352667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:01.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.351749+0000","last_change":"2023-11-28T16:58:56.862862+0000","last_active":"2023-11-28T16:59:11.351749+0000","last_peered":"2023-11-28T16:59:11.351749+0000","last_clean":"2023-11-28T16:59:11.351749+0000","last_became_active":"2023-11-28T16:58:56.862564+0000","last_became_peered":"2023-11-28T16:58:56.862564+0000","last_unstale":"2023-11-28T16:59:11.351749+0000","last_undegraded":"2023-11-28T16:59:11.351749+0000","last_fullsized":"2023-11-28T16:59:11.351749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:47:56.522306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.426266+0000","last_change":"2023-11-28T16:59:11.358207+0000","last_active":"2023-11-28T16:59:12.426266+0000","last_peered":"2023-11-28T16:59:12.426266+0000","last_clean":"2023-11-28T16:59:12.426266+0000","last_became_active":"2023-11-28T16:59:11.357938+0000","last_became_peered":"2023-11-28T16:59:11.357938+0000","last_unstale":"2023-11-28T16:59:12.426266+0000","last_undegraded":"2023-11-28T16:59:12.426266+0000","last_fullsized":"2023-11-28T16:59:12.426266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:19.504977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339875+0000","last_change":"2023-11-28T16:59:10.361152+0000","last_active":"2023-11-28T16:59:11.339875+0000","last_peered":"2023-11-28T16:59:11.339875+0000","last_clean":"2023-11-28T16:59:11.339875+0000","last_became_active":"2023-11-28T16:59:10.360533+0000","last_became_peered":"2023-11-28T16:59:10.360533+0000","last_unstale":"2023-11-28T16:59:11.339875+0000","last_undegraded":"2023-11-28T16:59:11.339875+0000","last_fullsized":"2023-11-28T16:59:11.339875+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:04:53.442275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.340452+0000","last_change":"2023-11-28T16:58:57.305378+0000","last_active":"2023-11-28T16:59:11.340452+0000","last_peered":"2023-11-28T16:59:11.340452+0000","last_clean":"2023-11-28T16:59:11.340452+0000","last_became_active":"2023-11-28T16:58:57.304738+0000","last_became_peered":"2023-11-28T16:58:57.304738+0000","last_unstale":"2023-11-28T16:59:11.340452+0000","last_undegraded":"2023-11-28T16:59:11.340452+0000","last_fullsized":"2023-11-28T16:59:11.340452+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352743+0000","last_change":"2023-11-28T16:58:56.860344+0000","last_active":"2023-11-28T16:59:11.352743+0000","last_peered":"2023-11-28T16:59:11.352743+0000","last_clean":"2023-11-28T16:59:11.352743+0000","last_became_active":"2023-11-28T16:58:56.859853+0000","last_became_peered":"2023-11-28T16:58:56.859853+0000","last_unstale":"2023-11-28T16:59:11.352743+0000","last_undegraded":"2023-11-28T16:59:11.352743+0000","last_fullsized":"2023-11-28T16:59:11.352743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:04.116066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.423351+0000","last_change":"2023-11-28T16:59:11.371129+0000","last_active":"2023-11-28T16:59:12.423351+0000","last_peered":"2023-11-28T16:59:12.423351+0000","last_clean":"2023-11-28T16:59:12.423351+0000","last_became_active":"2023-11-28T16:59:11.370756+0000","last_became_peered":"2023-11-28T16:59:11.370756+0000","last_unstale":"2023-11-28T16:59:12.423351+0000","last_undegraded":"2023-11-28T16:59:12.423351+0000","last_fullsized":"2023-11-28T16:59:12.423351+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:00.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341365+0000","last_change":"2023-11-28T16:59:10.353526+0000","last_active":"2023-11-28T16:59:11.341365+0000","last_peered":"2023-11-28T16:59:11.341365+0000","last_clean":"2023-11-28T16:59:11.341365+0000","last_became_active":"2023-11-28T16:59:10.353248+0000","last_became_peered":"2023-11-28T16:59:10.353248+0000","last_unstale":"2023-11-28T16:59:11.341365+0000","last_undegraded":"2023-11-28T16:59:11.341365+0000","last_fullsized":"2023-11-28T16:59:11.341365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:18.577864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.352458+0000","last_change":"2023-11-28T16:58:57.306938+0000","last_active":"2023-11-28T16:59:11.352458+0000","last_peered":"2023-11-28T16:59:11.352458+0000","last_clean":"2023-11-28T16:59:11.352458+0000","last_became_active":"2023-11-28T16:58:57.306452+0000","last_became_peered":"2023-11-28T16:58:57.306452+0000","last_unstale":"2023-11-28T16:59:11.352458+0000","last_undegraded":"2023-11-28T16:59:11.352458+0000","last_fullsized":"2023-11-28T16:59:11.352458+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:11:08.141712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.343760+0000","last_change":"2023-11-28T16:58:56.858723+0000","last_active":"2023-11-28T16:59:11.343760+0000","last_peered":"2023-11-28T16:59:11.343760+0000","last_clean":"2023-11-28T16:59:11.343760+0000","last_became_active":"2023-11-28T16:58:56.858282+0000","last_became_peered":"2023-11-28T16:58:56.858282+0000","last_unstale":"2023-11-28T16:59:11.343760+0000","last_undegraded":"2023-11-28T16:59:11.343760+0000","last_fullsized":"2023-11-28T16:59:11.343760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:27.574430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.360110+0000","last_change":"2023-11-28T16:59:11.372344+0000","last_active":"2023-11-28T16:59:12.360110+0000","last_peered":"2023-11-28T16:59:12.360110+0000","last_clean":"2023-11-28T16:59:12.360110+0000","last_became_active":"2023-11-28T16:59:11.371785+0000","last_became_peered":"2023-11-28T16:59:11.371785+0000","last_unstale":"2023-11-28T16:59:12.360110+0000","last_undegraded":"2023-11-28T16:59:12.360110+0000","last_fullsized":"2023-11-28T16:59:12.360110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:30.288758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349549+0000","last_change":"2023-11-28T16:59:10.349480+0000","last_active":"2023-11-28T16:59:11.349549+0000","last_peered":"2023-11-28T16:59:11.349549+0000","last_clean":"2023-11-28T16:59:11.349549+0000","last_became_active":"2023-11-28T16:59:10.349152+0000","last_became_peered":"2023-11-28T16:59:10.349152+0000","last_unstale":"2023-11-28T16:59:11.349549+0000","last_undegraded":"2023-11-28T16:59:11.349549+0000","last_fullsized":"2023-11-28T16:59:11.349549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:14:12.047853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.343760+0000","last_change":"2023-11-28T16:58:57.305002+0000","last_active":"2023-11-28T16:59:11.343760+0000","last_peered":"2023-11-28T16:59:11.343760+0000","last_clean":"2023-11-28T16:59:11.343760+0000","last_became_active":"2023-11-28T16:58:57.304759+0000","last_became_peered":"2023-11-28T16:58:57.304759+0000","last_unstale":"2023-11-28T16:59:11.343760+0000","last_undegraded":"2023-11-28T16:59:11.343760+0000","last_fullsized":"2023-11-28T16:59:11.343760+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:29.196892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.336982+0000","last_change":"2023-11-28T16:58:56.848645+0000","last_active":"2023-11-28T16:59:11.336982+0000","last_peered":"2023-11-28T16:59:11.336982+0000","last_clean":"2023-11-28T16:59:11.336982+0000","last_became_active":"2023-11-28T16:58:56.848300+0000","last_became_peered":"2023-11-28T16:58:56.848300+0000","last_unstale":"2023-11-28T16:59:11.336982+0000","last_undegraded":"2023-11-28T16:59:11.336982+0000","last_fullsized":"2023-11-28T16:59:11.336982+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:34.337823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424816+0000","last_change":"2023-11-28T16:59:11.351505+0000","last_active":"2023-11-28T16:59:12.424816+0000","last_peered":"2023-11-28T16:59:12.424816+0000","last_clean":"2023-11-28T16:59:12.424816+0000","last_became_active":"2023-11-28T16:59:11.350968+0000","last_became_peered":"2023-11-28T16:59:11.350968+0000","last_unstale":"2023-11-28T16:59:12.424816+0000","last_undegraded":"2023-11-28T16:59:12.424816+0000","last_fullsized":"2023-11-28T16:59:12.424816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:45.578795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.339958+0000","last_change":"2023-11-28T16:59:10.361375+0000","last_active":"2023-11-28T16:59:11.339958+0000","last_peered":"2023-11-28T16:59:11.339958+0000","last_clean":"2023-11-28T16:59:11.339958+0000","last_became_active":"2023-11-28T16:59:10.358142+0000","last_became_peered":"2023-11-28T16:59:10.358142+0000","last_unstale":"2023-11-28T16:59:11.339958+0000","last_undegraded":"2023-11-28T16:59:11.339958+0000","last_fullsized":"2023-11-28T16:59:11.339958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:27.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.340993+0000","last_change":"2023-11-28T16:58:57.299433+0000","last_active":"2023-11-28T16:59:11.340993+0000","last_peered":"2023-11-28T16:59:11.340993+0000","last_clean":"2023-11-28T16:59:11.340993+0000","last_became_active":"2023-11-28T16:58:57.299098+0000","last_became_peered":"2023-11-28T16:58:57.299098+0000","last_unstale":"2023-11-28T16:59:11.340993+0000","last_undegraded":"2023-11-28T16:59:11.340993+0000","last_fullsized":"2023-11-28T16:59:11.340993+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:41.636134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349738+0000","last_change":"2023-11-28T16:58:56.855829+0000","last_active":"2023-11-28T16:59:11.349738+0000","last_peered":"2023-11-28T16:59:11.349738+0000","last_clean":"2023-11-28T16:59:11.349738+0000","last_became_active":"2023-11-28T16:58:56.855381+0000","last_became_peered":"2023-11-28T16:58:56.855381+0000","last_unstale":"2023-11-28T16:59:11.349738+0000","last_undegraded":"2023-11-28T16:59:11.349738+0000","last_fullsized":"2023-11-28T16:59:11.349738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:41.581251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.424073+0000","last_change":"2023-11-28T16:59:11.366277+0000","last_active":"2023-11-28T16:59:12.424073+0000","last_peered":"2023-11-28T16:59:12.424073+0000","last_clean":"2023-11-28T16:59:12.424073+0000","last_became_active":"2023-11-28T16:59:11.365897+0000","last_became_peered":"2023-11-28T16:59:11.365897+0000","last_unstale":"2023-11-28T16:59:12.424073+0000","last_undegraded":"2023-11-28T16:59:12.424073+0000","last_fullsized":"2023-11-28T16:59:12.424073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:05.607213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.346924+0000","last_change":"2023-11-28T16:59:10.351761+0000","last_active":"2023-11-28T16:59:11.346924+0000","last_peered":"2023-11-28T16:59:11.346924+0000","last_clean":"2023-11-28T16:59:11.346924+0000","last_became_active":"2023-11-28T16:59:10.351422+0000","last_became_peered":"2023-11-28T16:59:10.351422+0000","last_unstale":"2023-11-28T16:59:11.346924+0000","last_undegraded":"2023-11-28T16:59:11.346924+0000","last_fullsized":"2023-11-28T16:59:11.346924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:47.215842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.349607+0000","last_change":"2023-11-28T16:58:57.316272+0000","last_active":"2023-11-28T16:59:11.349607+0000","last_peered":"2023-11-28T16:59:11.349607+0000","last_clean":"2023-11-28T16:59:11.349607+0000","last_became_active":"2023-11-28T16:58:57.315990+0000","last_became_peered":"2023-11-28T16:58:57.315990+0000","last_unstale":"2023-11-28T16:59:11.349607+0000","last_undegraded":"2023-11-28T16:59:11.349607+0000","last_fullsized":"2023-11-28T16:59:11.349607+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:04.860624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.338701+0000","last_change":"2023-11-28T16:58:56.847748+0000","last_active":"2023-11-28T16:59:11.338701+0000","last_peered":"2023-11-28T16:59:11.338701+0000","last_clean":"2023-11-28T16:59:11.338701+0000","last_became_active":"2023-11-28T16:58:56.847459+0000","last_became_peered":"2023-11-28T16:58:56.847459+0000","last_unstale":"2023-11-28T16:59:11.338701+0000","last_undegraded":"2023-11-28T16:59:11.338701+0000","last_fullsized":"2023-11-28T16:59:11.338701+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:24:03.416274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T16:59:12.426041+0000","last_change":"2023-11-28T16:59:11.378435+0000","last_active":"2023-11-28T16:59:12.426041+0000","last_peered":"2023-11-28T16:59:12.426041+0000","last_clean":"2023-11-28T16:59:12.426041+0000","last_became_active":"2023-11-28T16:59:11.377871+0000","last_became_peered":"2023-11-28T16:59:11.377871+0000","last_unstale":"2023-11-28T16:59:12.426041+0000","last_undegraded":"2023-11-28T16:59:12.426041+0000","last_fullsized":"2023-11-28T16:59:12.426041+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:10.319344+0000","last_clean_scrub_stamp":"2023-11-28T16:59:10.319344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:42.297050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.371311+0000","last_change":"2023-11-28T16:59:10.364983+0000","last_active":"2023-11-28T16:59:11.371311+0000","last_peered":"2023-11-28T16:59:11.371311+0000","last_clean":"2023-11-28T16:59:11.371311+0000","last_became_active":"2023-11-28T16:59:10.364749+0000","last_became_peered":"2023-11-28T16:59:10.364749+0000","last_unstale":"2023-11-28T16:59:11.371311+0000","last_undegraded":"2023-11-28T16:59:11.371311+0000","last_fullsized":"2023-11-28T16:59:11.371311+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:59:09.310075+0000","last_clean_scrub_stamp":"2023-11-28T16:59:09.310075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:04.597944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.337294+0000","last_change":"2023-11-28T16:58:57.306584+0000","last_active":"2023-11-28T16:59:11.337294+0000","last_peered":"2023-11-28T16:59:11.337294+0000","last_clean":"2023-11-28T16:59:11.337294+0000","last_became_active":"2023-11-28T16:58:57.306137+0000","last_became_peered":"2023-11-28T16:58:57.306137+0000","last_unstale":"2023-11-28T16:59:11.337294+0000","last_undegraded":"2023-11-28T16:59:11.337294+0000","last_fullsized":"2023-11-28T16:59:11.337294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:56.827386+0000","last_clean_scrub_stamp":"2023-11-28T16:58:56.827386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:50.842606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.344405+0000","last_change":"2023-11-28T16:58:56.863771+0000","last_active":"2023-11-28T16:59:11.344405+0000","last_peered":"2023-11-28T16:59:11.344405+0000","last_clean":"2023-11-28T16:59:11.344405+0000","last_became_active":"2023-11-28T16:58:56.863302+0000","last_became_peered":"2023-11-28T16:58:56.863302+0000","last_unstale":"2023-11-28T16:59:11.344405+0000","last_undegraded":"2023-11-28T16:59:11.344405+0000","last_fullsized":"2023-11-28T16:59:11.344405+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:58:55.821433+0000","last_clean_scrub_stamp":"2023-11-28T16:58:55.821433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:26.909196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T16:59:11.341161+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:59:11.341161+0000","last_peered":"2023-11-28T16:59:11.341161+0000","last_clean":"2023-11-28T16:59:11.341161+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:59:11.341161+0000","last_undegraded":"2023-11-28T16:59:11.341161+0000","last_fullsized":"2023-11-28T16:59:11.341161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1503232,"data_stored":988979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.745,"15min":0.71599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":5.8499999999999996},"last":0.87},{"interface":"front","average":{"1min":1.022,"5min":0.77800000000000002,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.9800000000000004,"5min":5.9800000000000004,"15min":5.9800000000000004},"last":0.85099999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.73699999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.81100000000000005}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.63200000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.752}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":399775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.69699999999999995},"min":{"1min":0.46200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.84699999999999998,"5min":1.474,"15min":1.474},"last":0.754},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.749,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.754,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.82299999999999995}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.88,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91300000000000003,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.66000000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":1.038,"15min":1.038},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.071,"15min":1.071},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85999999999999999,"5min":1.367,"15min":1.367},"last":0.74099999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.022,"5min":1.401,"15min":1.401},"last":0.52800000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.82299999999999995,"15min":0.873},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86399999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":401628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.503,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.627}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82599999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60599999999999998}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.876,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64800000000000002,"15min":0.67500000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47599999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.69699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":400165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.66800000000000004},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70599999999999996,"15min":0.73499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.234,"15min":1.234},"last":0.65600000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.964,"15min":1.964},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0449999999999999,"5min":1.704,"15min":1.704},"last":0.52500000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92000000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.79600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98199999999999998,"5min":1.254,"15min":1.254},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98399999999999999,"5min":1.548,"15min":1.548},"last":0.88}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.752},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.755},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89500000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":1.218,"15min":1.218},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.0780000000000001,"5min":1.593,"15min":1.593},"last":0.90700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":403170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.626,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64600000000000002,"5min":0.745,"15min":0.745},"last":0.41499999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57999999999999996,"5min":0.874,"15min":0.874},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.5,"15min":0.505},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.304,"15min":1.304},"last":0.502}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":1.502,"15min":1.502},"last":0.627},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":1.21,"15min":1.21},"last":0.39100000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97099999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94999999999999996,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80100000000000005,"15min":0.82799999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.25,"15min":1.25},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0720000000000001,"5min":1.423,"15min":1.423},"last":0.75600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":905216,"data_stored":399045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.44},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.41499999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71499999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.65800000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.872},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83099999999999996}]},{"osd":6,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92500000000000004,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":398623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":8.9499999999999993},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":1.151}]},{"osd":2,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":6.1589999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":1.5189999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78300000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":6.2080000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":5.9249999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.446,"15min":1.446},"last":5.8259999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0980000000000001,"5min":1.47,"15min":1.47},"last":2.2349999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.056,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":6.048},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.57399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.327,"15min":1.327},"last":6.4059999999999997}]},{"osd":6,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98299999999999998,"5min":1.3,"15min":1.3},"last":5.7690000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.526,"15min":1.526},"last":1.2030000000000001}]},{"osd":7,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80600000000000005,"15min":0.83399999999999996},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95399999999999996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":6.3600000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":5.8710000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1499136,"data_stored":989413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45800000000000002,"15min":0.47999999999999998},"min":{"1min":0.26600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.753,"5min":1.085,"15min":1.085},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.73799999999999999},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64400000000000002,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.437},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.66900000000000004},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77400000000000002,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.37}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91400000000000003,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.135,"5min":1.859,"15min":1.859},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.462,"15min":1.462},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1319999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.222,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.119,"5min":1.298,"15min":1.298},"last":0.751},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.323,"15min":1.323},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0680000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.50700000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.155,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:15.879 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T16:59:15.879 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-28T16:59:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc10aabb640 1 Processor -- start 2023-11-28T16:59:16.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc10aabb640 1 -- start start 2023-11-28T16:59:16.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc10aabb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1040c0370 0x7fc10406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc10aabb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1040a8470 0x7fc10406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc10aabb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10406de00 con 0x7fc10414eaf0 2023-11-28T16:59:16.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc10aabb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc104070390 con 0x7fc1040c0370 2023-11-28T16:59:16.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc10aabb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10406db90 con 0x7fc1040a8470 2023-11-28T16:59:16.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc103fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1040c0370 0x7fc10406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc103fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1040c0370 0x7fc10406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36938/0 (socket says 172.21.15.26:36938) 2023-11-28T16:59:16.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc103fff640 1 -- 172.21.15.26:0/4093331390 learned_addr learned my addr 172.21.15.26:0/4093331390 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:16.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc103fff640 1 -- 172.21.15.26:0/4093331390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1040a8470 msgr2=0x7fc10406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:16.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc103fff640 1 --2- 172.21.15.26:0/4093331390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1040a8470 0x7fc10406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc103fff640 1 -- 172.21.15.26:0/4093331390 >> v1:172.21.15.79:6789/0 conn(0x7fc10414eaf0 legacy=0x7fc104151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:16.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.056+0000 7fc103fff640 1 -- 172.21.15.26:0/4093331390 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10414eed0 con 0x7fc1040c0370 2023-11-28T16:59:16.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc103fff640 1 --2- 172.21.15.26:0/4093331390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040c0370 0x7fc10406d110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009870 tx=0x7fc0f001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94304d818da20f7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc1037fe640 1 -- 172.21.15.26:0/4093331390 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00ac620 con 0x7fc1040c0370 2023-11-28T16:59:16.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc1037fe640 1 -- 172.21.15.26:0/4093331390 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f00ac780 con 0x7fc1040c0370 2023-11-28T16:59:16.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc1037fe640 1 -- 172.21.15.26:0/4093331390 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00acb10 con 0x7fc1040c0370 2023-11-28T16:59:16.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 -- 172.21.15.26:0/4093331390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040c0370 msgr2=0x7fc10406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4093331390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040c0370 0x7fc10406d110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009870 tx=0x7fc0f001c3e0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 -- 172.21.15.26:0/4093331390 shutdown_connections 2023-11-28T16:59:16.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4093331390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1040a8470 0x7fc10406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4093331390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040c0370 0x7fc10406d110 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 -- 172.21.15.26:0/4093331390 >> 172.21.15.26:0/4093331390 conn(0x7fc1040c2a60 msgr2=0x7fc1040c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:16.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 -- 172.21.15.26:0/4093331390 shutdown_connections 2023-11-28T16:59:16.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.060+0000 7fc10aabb640 1 -- 172.21.15.26:0/4093331390 wait complete. 2023-11-28T16:59:16.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 Processor -- start 2023-11-28T16:59:16.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 -- start start 2023-11-28T16:59:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040a8470 0x7fc1040c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1040c0370 0x7fc104149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc10414eaf0 0x7fc104149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1041f0f00 con 0x7fc1040a8470 2023-11-28T16:59:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1041f05f0 con 0x7fc1040c0370 2023-11-28T16:59:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040c3cf0 con 0x7fc10414eaf0 2023-11-28T16:59:16.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040a8470 0x7fc1040c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040a8470 0x7fc1040c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36942/0 (socket says 172.21.15.26:36942) 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 -- 172.21.15.26:0/4191773661 learned_addr learned my addr 172.21.15.26:0/4191773661 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc103fff640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1040c0370 0x7fc104149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc109058640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc10414eaf0 0x7fc104149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 -- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc10414eaf0 msgr2=0x7fc104149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc10414eaf0 0x7fc104149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 -- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1040c0370 msgr2=0x7fc104149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1040c0370 0x7fc104149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 -- 172.21.15.26:0/4191773661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00094d0 con 0x7fc1040a8470 2023-11-28T16:59:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc103fff640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1040c0370 0x7fc104149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc108857640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040a8470 0x7fc1040c4950 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800b410 tx=0x7fc0f800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc1017fa640 1 -- 172.21.15.26:0/4191773661 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8004020 con 0x7fc1040a8470 2023-11-28T16:59:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc1017fa640 1 -- 172.21.15.26:0/4191773661 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8004180 con 0x7fc1040a8470 2023-11-28T16:59:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc1017fa640 1 -- 172.21.15.26:0/4191773661 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8011630 con 0x7fc1040a8470 2023-11-28T16:59:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1041f0840 con 0x7fc1040a8470 2023-11-28T16:59:16.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1040c2060 con 0x7fc1040a8470 2023-11-28T16:59:16.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.064+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10404e890 con 0x7fc1040a8470 2023-11-28T16:59:16.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.068+0000 7fc1017fa640 1 -- 172.21.15.26:0/4191773661 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc0f8011790 con 0x7fc1040a8470 2023-11-28T16:59:16.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.068+0000 7fc1017fa640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc0e80668d0 0x7fc0e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.068+0000 7fc1017fa640 1 -- 172.21.15.26:0/4191773661 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc0f80844d0 con 0x7fc1040a8470 2023-11-28T16:59:16.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.068+0000 7fc103fff640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc0e80668d0 0x7fc0e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.068+0000 7fc103fff640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc0e80668d0 0x7fc0e8068d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00ae000 tx=0x7fc0f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.072+0000 7fc1017fa640 1 -- 172.21.15.26:0/4191773661 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0f80513a0 con 0x7fc1040a8470 2023-11-28T16:59:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.292+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fc104070a60 con 0x7fc1040a8470 2023-11-28T16:59:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc1017fa640 1 -- 172.21.15.26:0/4191773661 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v22) v1 ==== 185+0+142 (secure 0 0 0) 0x7fc0f80549c0 con 0x7fc1040a8470 2023-11-28T16:59:16.299 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-11-28T16:59:16.299 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB4G2Zl6DFOJBAAAvKiBlSbmXxi+xvwfEIuzg== 2023-11-28T16:59:16.299 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow" 2023-11-28T16:59:16.299 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-11-28T16:59:16.300 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-28T16:59:16.301 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.1 2023-11-28T16:59:16.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc0e80668d0 msgr2=0x7fc0e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc0e80668d0 0x7fc0e8068d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00ae000 tx=0x7fc0f0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:16.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040a8470 msgr2=0x7fc1040c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040a8470 0x7fc1040c4950 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800b410 tx=0x7fc0f800b8d0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 shutdown_connections 2023-11-28T16:59:16.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc0e80668d0 0x7fc0e8068d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc10414eaf0 0x7fc104149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1040c0370 0x7fc104149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 --2- 172.21.15.26:0/4191773661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1040a8470 0x7fc1040c4950 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 >> 172.21.15.26:0/4191773661 conn(0x7fc1040c2a60 msgr2=0x7fc104151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 shutdown_connections 2023-11-28T16:59:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.296+0000 7fc10aabb640 1 -- 172.21.15.26:0/4191773661 wait complete. 2023-11-28T16:59:16.320 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:16.320 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:16.330 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:16.330 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:16.384 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:16.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f6758217640 1 Processor -- start 2023-11-28T16:59:16.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f6758217640 1 -- start start 2023-11-28T16:59:16.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f6758217640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67500bd720 0x7f6750158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f6758217640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6750155790 con 0x7f675006cd90 2023-11-28T16:59:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f6758217640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67500c4b00 con 0x7f67500ca610 2023-11-28T16:59:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f6758217640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67500c4de0 con 0x7f67500bd720 2023-11-28T16:59:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f67557b2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67500bd720 0x7f6750158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f67557b2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67500bd720 0x7f6750158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36944/0 (socket says 172.21.15.26:36944) 2023-11-28T16:59:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f67567b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f675006cd90 0x7f67500c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41064/0 (socket says 172.21.15.26:41064) 2023-11-28T16:59:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f67557b2640 1 -- 172.21.15.26:0/1256501254 learned_addr learned my addr 172.21.15.26:0/1256501254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:16.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f67557b2640 1 -- 172.21.15.26:0/1256501254 >> v1:172.21.15.79:6789/0 conn(0x7f67500ca610 legacy=0x7f67500c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:16.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f67557b2640 1 -- 172.21.15.26:0/1256501254 >> v1:172.21.15.26:6789/0 conn(0x7f675006cd90 legacy=0x7f67500c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.524+0000 7f67557b2640 1 -- 172.21.15.26:0/1256501254 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750157e30 con 0x7f67500bd720 2023-11-28T16:59:16.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f67557b2640 1 --2- 172.21.15.26:0/1256501254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500bd720 0x7f6750158350 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6740009870 tx=0x7f674001c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80cf0efd30c45f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6754fb1640 1 -- 172.21.15.26:0/1256501254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500c52d0 con 0x7f67500bd720 2023-11-28T16:59:16.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6754fb1640 1 -- 172.21.15.26:0/1256501254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67400a48c0 con 0x7f67500bd720 2023-11-28T16:59:16.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6754fb1640 1 -- 172.21.15.26:0/1256501254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67400a4c50 con 0x7f67500bd720 2023-11-28T16:59:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6758217640 1 -- 172.21.15.26:0/1256501254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500bd720 msgr2=0x7f6750158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6758217640 1 --2- 172.21.15.26:0/1256501254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500bd720 0x7f6750158350 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6740009870 tx=0x7f674001c0c0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6758217640 1 -- 172.21.15.26:0/1256501254 shutdown_connections 2023-11-28T16:59:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6758217640 1 --2- 172.21.15.26:0/1256501254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500bd720 0x7f6750158350 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6758217640 1 -- 172.21.15.26:0/1256501254 >> 172.21.15.26:0/1256501254 conn(0x7f6750071ea0 msgr2=0x7f67500722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6758217640 1 -- 172.21.15.26:0/1256501254 shutdown_connections 2023-11-28T16:59:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.528+0000 7f6758217640 1 -- 172.21.15.26:0/1256501254 wait complete. 2023-11-28T16:59:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 Processor -- start 2023-11-28T16:59:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 -- start start 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f675006cd90 0x7f675014a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67500bd720 0x7f67500ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500ca610 0x7f67500abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67501f23e0 con 0x7f67500ca610 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67501f1e80 con 0x7f675006cd90 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500ae6c0 con 0x7f67500bd720 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500ca610 0x7f67500abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500ca610 0x7f67500abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36960/0 (socket says 172.21.15.26:36960) 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 -- 172.21.15.26:0/668039348 learned_addr learned my addr 172.21.15.26:0/668039348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67557b2640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67500bd720 0x7f67500ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6755fb3640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f675006cd90 0x7f675014a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 -- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67500bd720 msgr2=0x7f67500ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67500bd720 0x7f67500ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 -- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f675006cd90 msgr2=0x7f675014a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f675006cd90 0x7f675014a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 -- 172.21.15.26:0/668039348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400094d0 con 0x7f67500ca610 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67557b2640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67500bd720 0x7f67500ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6755fb3640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f675006cd90 0x7f675014a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67567b4640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500ca610 0x7f67500abf20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f674800c7a0 tx=0x7f674800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67467fc640 1 -- 172.21.15.26:0/668039348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800a640 con 0x7f67500ca610 2023-11-28T16:59:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67467fc640 1 -- 172.21.15.26:0/668039348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674800a7a0 con 0x7f67500ca610 2023-11-28T16:59:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67501f2100 con 0x7f67500ca610 2023-11-28T16:59:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f67467fc640 1 -- 172.21.15.26:0/668039348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800ab10 con 0x7f67500ca610 2023-11-28T16:59:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.532+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67500aec40 con 0x7f67500ca610 2023-11-28T16:59:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.536+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67500aee60 con 0x7f67500ca610 2023-11-28T16:59:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.536+0000 7f67467fc640 1 -- 172.21.15.26:0/668039348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f674800ac70 con 0x7f67500ca610 2023-11-28T16:59:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.536+0000 7f67467fc640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f67340668d0 0x7f6734068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.536+0000 7f67467fc640 1 -- 172.21.15.26:0/668039348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6748083e60 con 0x7f67500ca610 2023-11-28T16:59:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.536+0000 7f6755fb3640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f67340668d0 0x7f6734068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.536+0000 7f6755fb3640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f67340668d0 0x7f6734068d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6750155190 tx=0x7f674c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.540+0000 7f67467fc640 1 -- 172.21.15.26:0/668039348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6748050e80 con 0x7f67500ca610 2023-11-28T16:59:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.696+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f675004e890 con 0x7f67500ca610 2023-11-28T16:59:16.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f67467fc640 1 -- 172.21.15.26:0/668039348 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7f6748017020 con 0x7f67500ca610 2023-11-28T16:59:16.702 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:16.702 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f67340668d0 msgr2=0x7f6734068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f67340668d0 0x7f6734068d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6750155190 tx=0x7f674c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500ca610 msgr2=0x7f67500abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500ca610 0x7f67500abf20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f674800c7a0 tx=0x7f674800cc60 comp rx=0 tx=0).stop 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 shutdown_connections 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67500ca610 0x7f67500abf20 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f67340668d0 0x7f6734068d90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67500bd720 0x7f67500ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 --2- 172.21.15.26:0/668039348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f675006cd90 0x7f675014a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 >> 172.21.15.26:0/668039348 conn(0x7f6750071ea0 msgr2=0x7f675014e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 shutdown_connections 2023-11-28T16:59:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.700+0000 7f6758217640 1 -- 172.21.15.26:0/668039348 wait complete. 2023-11-28T16:59:16.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:58:55.413723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:58:56.230719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:59:08.379611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:59:09.728280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:16.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:16.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a8aaa640 1 Processor -- start 2023-11-28T16:59:16.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a8aaa640 1 -- start start 2023-11-28T16:59:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a8aaa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3a4152e20 0x7fc3a406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a8aaa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a40a8680 con 0x7fc3a40a9220 2023-11-28T16:59:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a8aaa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a414fde0 con 0x7fc3a414fa00 2023-11-28T16:59:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a8aaa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a41533e0 con 0x7fc3a4152e20 2023-11-28T16:59:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc39bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc3a40a9220 0x7fc3a406a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41080/0 (socket says 172.21.15.26:41080) 2023-11-28T16:59:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc39bfff640 1 -- 172.21.15.26:0/1033886936 learned_addr learned my addr 172.21.15.26:0/1033886936 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:16.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a2d9d640 1 --2- 172.21.15.26:0/1033886936 >> v2:172.21.15.79:3300/0 conn(0x7fc3a4152e20 0x7fc3a406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a1d9b640 1 -- 172.21.15.26:0/1033886936 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170349288 0 0) 0x7fc3a40a8680 con 0x7fc3a40a9220 2023-11-28T16:59:16.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a1d9b640 1 -- 172.21.15.26:0/1033886936 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc390003530 con 0x7fc3a40a9220 2023-11-28T16:59:16.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a1d9b640 1 -- 172.21.15.26:0/1033886936 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439888604 0 0) 0x7fc3a414fde0 con 0x7fc3a414fa00 2023-11-28T16:59:16.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a1d9b640 1 -- 172.21.15.26:0/1033886936 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a40a8680 con 0x7fc3a414fa00 2023-11-28T16:59:16.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a2d9d640 1 -- 172.21.15.26:0/1033886936 >> v1:172.21.15.79:6789/0 conn(0x7fc3a414fa00 legacy=0x7fc3a40a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a2d9d640 1 -- 172.21.15.26:0/1033886936 >> v1:172.21.15.26:6789/0 conn(0x7fc3a40a9220 legacy=0x7fc3a406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.868+0000 7fc3a2d9d640 1 -- 172.21.15.26:0/1033886936 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40a9c70 con 0x7fc3a4152e20 2023-11-28T16:59:16.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a2d9d640 1 --2- 172.21.15.26:0/1033886936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 0x7fc3a406acb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009d90 tx=0x7fc39c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=136fceffd53f2b97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a1d9b640 1 -- 172.21.15.26:0/1033886936 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0a5860 con 0x7fc3a4152e20 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a1d9b640 1 -- 172.21.15.26:0/1033886936 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c0a59c0 con 0x7fc3a4152e20 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a1d9b640 1 -- 172.21.15.26:0/1033886936 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0a5d50 con 0x7fc3a4152e20 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/1033886936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 msgr2=0x7fc3a406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/1033886936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 0x7fc3a406acb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009d90 tx=0x7fc39c01c890 comp rx=0 tx=0).stop 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/1033886936 shutdown_connections 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/1033886936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 0x7fc3a406acb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/1033886936 >> 172.21.15.26:0/1033886936 conn(0x7fc3a40c3b70 msgr2=0x7fc3a40c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/1033886936 shutdown_connections 2023-11-28T16:59:16.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.872+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/1033886936 wait complete. 2023-11-28T16:59:16.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 Processor -- start 2023-11-28T16:59:16.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 -- start start 2023-11-28T16:59:16.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40a9220 0x7fc3a40c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a414fa00 0x7fc3a41ec840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 0x7fc3a41ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a406ee60 con 0x7fc3a40a9220 2023-11-28T16:59:16.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41f0810 con 0x7fc3a4152e20 2023-11-28T16:59:16.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40c6d50 con 0x7fc3a414fa00 2023-11-28T16:59:16.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40a9220 0x7fc3a40c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40a9220 0x7fc3a40c06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36976/0 (socket says 172.21.15.26:36976) 2023-11-28T16:59:16.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 -- 172.21.15.26:0/3460646464 learned_addr learned my addr 172.21.15.26:0/3460646464 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:16.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a2d9d640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 0x7fc3a41ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc39bfff640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a414fa00 0x7fc3a41ec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 -- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a414fa00 msgr2=0x7fc3a41ec840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a414fa00 0x7fc3a41ec840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 -- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 msgr2=0x7fc3a41ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 0x7fc3a41ecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 -- 172.21.15.26:0/3460646464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c009a70 con 0x7fc3a40a9220 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a259c640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40a9220 0x7fc3a40c06a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c430 tx=0x7fc39400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc39affd640 1 -- 172.21.15.26:0/3460646464 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940052d0 con 0x7fc3a40a9220 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc39affd640 1 -- 172.21.15.26:0/3460646464 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394005450 con 0x7fc3a40a9220 2023-11-28T16:59:16.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a4072880 con 0x7fc3a40a9220 2023-11-28T16:59:16.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc39affd640 1 -- 172.21.15.26:0/3460646464 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394003840 con 0x7fc3a40a9220 2023-11-28T16:59:16.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.876+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a41efee0 con 0x7fc3a40a9220 2023-11-28T16:59:16.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.880+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a404e890 con 0x7fc3a40a9220 2023-11-28T16:59:16.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.880+0000 7fc39affd640 1 -- 172.21.15.26:0/3460646464 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc3940039a0 con 0x7fc3a40a9220 2023-11-28T16:59:16.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.880+0000 7fc39affd640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3840668d0 0x7fc384068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:16.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.880+0000 7fc39affd640 1 -- 172.21.15.26:0/3460646464 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc394083c80 con 0x7fc3a40a9220 2023-11-28T16:59:16.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.880+0000 7fc39bfff640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3840668d0 0x7fc384068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:16.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.880+0000 7fc39bfff640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3840668d0 0x7fc384068d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4072b50 tx=0x7fc38c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:16.884+0000 7fc39affd640 1 -- 172.21.15.26:0/3460646464 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc394050ca0 con 0x7fc3a40a9220 2023-11-28T16:59:17.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.044+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3a406f9a0 con 0x7fc3a40a9220 2023-11-28T16:59:17.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.044+0000 7fc39affd640 1 -- 172.21.15.26:0/3460646464 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3940170a0 con 0x7fc3a40a9220 2023-11-28T16:59:17.049 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:17.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3840668d0 msgr2=0x7fc384068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3840668d0 0x7fc384068d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4072b50 tx=0x7fc38c007d40 comp rx=0 tx=0).stop 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40a9220 msgr2=0x7fc3a40c06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40a9220 0x7fc3a40c06a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c430 tx=0x7fc39400c8f0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 shutdown_connections 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a4152e20 0x7fc3a41ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3840668d0 0x7fc384068d90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a414fa00 0x7fc3a41ec840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 --2- 172.21.15.26:0/3460646464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40a9220 0x7fc3a40c06a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 >> 172.21.15.26:0/3460646464 conn(0x7fc3a40c3b70 msgr2=0x7fc3a414ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 shutdown_connections 2023-11-28T16:59:17.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.048+0000 7fc3a8aaa640 1 -- 172.21.15.26:0/3460646464 wait complete. 2023-11-28T16:59:17.070 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:59:17.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 Processor -- start 2023-11-28T16:59:17.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 -- start start 2023-11-28T16:59:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08d41561d0 0x7f08d40701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08d4070760 0x7f08d406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d406df20 0x7f08d4158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d4071020 con 0x7f08d41561d0 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d4071300 con 0x7f08d4070760 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08dc1c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40715e0 con 0x7f08d406df20 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08d41561d0 0x7f08d40701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08d41561d0 0x7f08d40701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36980/0 (socket says 172.21.15.26:36980) 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 -- 172.21.15.26:0/1507612220 learned_addr learned my addr 172.21.15.26:0/1507612220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d975f640 1 --2- 172.21.15.26:0/1507612220 >> v2:172.21.15.79:3300/0 conn(0x7f08d4070760 0x7f08d406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08da761640 1 --2- 172.21.15.26:0/1507612220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d406df20 0x7f08d4158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 -- 172.21.15.26:0/1507612220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d406df20 msgr2=0x7f08d4158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 --2- 172.21.15.26:0/1507612220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d406df20 0x7f08d4158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 -- 172.21.15.26:0/1507612220 >> v2:172.21.15.79:3300/0 conn(0x7f08d4070760 msgr2=0x7f08d406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:17.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 --2- 172.21.15.26:0/1507612220 >> v2:172.21.15.79:3300/0 conn(0x7f08d4070760 0x7f08d406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08d9f60640 1 -- 172.21.15.26:0/1507612220 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40718c0 con 0x7f08d41561d0 2023-11-28T16:59:17.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.212+0000 7f08da761640 1 --2- 172.21.15.26:0/1507612220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d406df20 0x7f08d4158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:17.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08d9f60640 1 --2- 172.21.15.26:0/1507612220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d41561d0 0x7f08d40701f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f08d40c7020 tx=0x7f08d001ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0525cc2fd5a798 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08d8f5e640 1 -- 172.21.15.26:0/1507612220 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00ab600 con 0x7f08d41561d0 2023-11-28T16:59:17.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08d8f5e640 1 -- 172.21.15.26:0/1507612220 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d00a7050 con 0x7f08d41561d0 2023-11-28T16:59:17.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08d8f5e640 1 -- 172.21.15.26:0/1507612220 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00ab980 con 0x7f08d41561d0 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 -- 172.21.15.26:0/1507612220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d41561d0 msgr2=0x7f08d40701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/1507612220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d41561d0 0x7f08d40701f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f08d40c7020 tx=0x7f08d001ced0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 -- 172.21.15.26:0/1507612220 shutdown_connections 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/1507612220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d406df20 0x7f08d4158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/1507612220 >> v2:172.21.15.79:3300/0 conn(0x7f08d4070760 0x7f08d406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/1507612220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d41561d0 0x7f08d40701f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 -- 172.21.15.26:0/1507612220 >> 172.21.15.26:0/1507612220 conn(0x7f08d40c2a60 msgr2=0x7f08d40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:17.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 -- 172.21.15.26:0/1507612220 shutdown_connections 2023-11-28T16:59:17.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.216+0000 7f08dc1c4640 1 -- 172.21.15.26:0/1507612220 wait complete. 2023-11-28T16:59:17.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 Processor -- start 2023-11-28T16:59:17.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 -- start start 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d406df20 0x7f08d4150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d4070760 0x7f08d4153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d41561d0 0x7f08d414bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41f1c90 con 0x7f08d4070760 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41f1f70 con 0x7f08d406df20 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d414b0a0 con 0x7f08d41561d0 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d4070760 0x7f08d4153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d4070760 0x7f08d4153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36984/0 (socket says 172.21.15.26:36984) 2023-11-28T16:59:17.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 -- 172.21.15.26:0/2086180186 learned_addr learned my addr 172.21.15.26:0/2086180186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:17.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d9f60640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d406df20 0x7f08d4150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08da761640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d41561d0 0x7f08d414bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 -- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d41561d0 msgr2=0x7f08d414bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d41561d0 0x7f08d414bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 -- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d406df20 msgr2=0x7f08d4150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d406df20 0x7f08d4150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 -- 172.21.15.26:0/2086180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00094d0 con 0x7f08d4070760 2023-11-28T16:59:17.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08d975f640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d4070760 0x7f08d4153140 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f08c400e930 tx=0x7f08c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08ca7fc640 1 -- 172.21.15.26:0/2086180186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4009690 con 0x7f08d4070760 2023-11-28T16:59:17.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08ca7fc640 1 -- 172.21.15.26:0/2086180186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400ca00 con 0x7f08d4070760 2023-11-28T16:59:17.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d414b380 con 0x7f08d4070760 2023-11-28T16:59:17.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08ca7fc640 1 -- 172.21.15.26:0/2086180186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400cd70 con 0x7f08d4070760 2023-11-28T16:59:17.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.220+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d414c9d0 con 0x7f08d4070760 2023-11-28T16:59:17.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.224+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d404e890 con 0x7f08d4070760 2023-11-28T16:59:17.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.224+0000 7f08ca7fc640 1 -- 172.21.15.26:0/2086180186 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f08c4013470 con 0x7f08d4070760 2023-11-28T16:59:17.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.224+0000 7f08ca7fc640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f08b8066900 0x7f08b8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.224+0000 7f08ca7fc640 1 -- 172.21.15.26:0/2086180186 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f08c4084850 con 0x7f08d4070760 2023-11-28T16:59:17.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.224+0000 7f08d9f60640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f08b8066900 0x7f08b8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.224+0000 7f08d9f60640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f08b8066900 0x7f08b8068dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f08d40c6f00 tx=0x7f08d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.228+0000 7f08ca7fc640 1 -- 172.21.15.26:0/2086180186 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08c4051890 con 0x7f08d4070760 2023-11-28T16:59:17.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08d40c2770 con 0x7f08d4070760 2023-11-28T16:59:17.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08ca7fc640 1 -- 172.21.15.26:0/2086180186 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08c4054eb0 con 0x7f08d4070760 2023-11-28T16:59:17.391 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:17.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f08b8066900 msgr2=0x7f08b8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f08b8066900 0x7f08b8068dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f08d40c6f00 tx=0x7f08d0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d4070760 msgr2=0x7f08d4153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d4070760 0x7f08d4153140 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f08c400e930 tx=0x7f08c400edf0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 shutdown_connections 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f08b8066900 0x7f08b8068dc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08d41561d0 0x7f08d414bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08d4070760 0x7f08d4153140 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 --2- 172.21.15.26:0/2086180186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d406df20 0x7f08d4150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 >> 172.21.15.26:0/2086180186 conn(0x7f08d40c2a60 msgr2=0x7f08d4156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 shutdown_connections 2023-11-28T16:59:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.388+0000 7f08dc1c4640 1 -- 172.21.15.26:0/2086180186 wait complete. 2023-11-28T16:59:17.413 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:59:17.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cbadf5640 1 Processor -- start 2023-11-28T16:59:17.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cbadf5640 1 -- start start 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cbadf5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb406b810 0x7f3cb40c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cbadf5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3cb406f0d0 0x7f3cb40bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cbadf5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb4073710 con 0x7f3cb40c2a60 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cbadf5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb41589f0 con 0x7f3cb406f0d0 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cbadf5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41586e0 con 0x7f3cb406b810 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3cb406f0d0 0x7f3cb40bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3cb406f0d0 0x7f3cb40bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36998/0 (socket says 172.21.15.26:36998) 2023-11-28T16:59:17.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb3fff640 1 -- 172.21.15.26:0/135636191 learned_addr learned my addr 172.21.15.26:0/135636191 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:17.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb8b91640 1 --2- 172.21.15.26:0/135636191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb406b810 0x7f3cb40c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb3fff640 1 -- 172.21.15.26:0/135636191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb406b810 msgr2=0x7f3cb40c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:17.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb3fff640 1 --2- 172.21.15.26:0/135636191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb406b810 0x7f3cb40c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb3fff640 1 -- 172.21.15.26:0/135636191 >> v1:172.21.15.79:6789/0 conn(0x7f3cb40c2a60 legacy=0x7f3cb406e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb3fff640 1 -- 172.21.15.26:0/135636191 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40c00b0 con 0x7f3cb406f0d0 2023-11-28T16:59:17.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.556+0000 7f3cb8b91640 1 --2- 172.21.15.26:0/135636191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb406b810 0x7f3cb40c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:17.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cb3fff640 1 --2- 172.21.15.26:0/135636191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406f0d0 0x7f3cb40bfb70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009870 tx=0x7f3ca001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4189502335b45cf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cb37fe640 1 -- 172.21.15.26:0/135636191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00a7070 con 0x7f3cb406f0d0 2023-11-28T16:59:17.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cb37fe640 1 -- 172.21.15.26:0/135636191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca00ab430 con 0x7f3cb406f0d0 2023-11-28T16:59:17.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cb37fe640 1 -- 172.21.15.26:0/135636191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00ab7c0 con 0x7f3cb406f0d0 2023-11-28T16:59:17.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 -- 172.21.15.26:0/135636191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406f0d0 msgr2=0x7f3cb40bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/135636191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406f0d0 0x7f3cb40bfb70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009870 tx=0x7f3ca001c540 comp rx=0 tx=0).stop 2023-11-28T16:59:17.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 -- 172.21.15.26:0/135636191 shutdown_connections 2023-11-28T16:59:17.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/135636191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406f0d0 0x7f3cb40bfb70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/135636191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb406b810 0x7f3cb40c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 -- 172.21.15.26:0/135636191 >> 172.21.15.26:0/135636191 conn(0x7f3cb40c3240 msgr2=0x7f3cb40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:17.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 -- 172.21.15.26:0/135636191 shutdown_connections 2023-11-28T16:59:17.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.560+0000 7f3cbadf5640 1 -- 172.21.15.26:0/135636191 wait complete. 2023-11-28T16:59:17.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 Processor -- start 2023-11-28T16:59:17.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 -- start start 2023-11-28T16:59:17.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406b810 0x7f3cb4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb406f0d0 0x7f3cb414bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb40c2a60 0x7f3cb414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4150550 con 0x7f3cb406b810 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41500c0 con 0x7f3cb406f0d0 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4156d70 con 0x7f3cb40c2a60 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406b810 0x7f3cb4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406b810 0x7f3cb4156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37000/0 (socket says 172.21.15.26:37000) 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 -- 172.21.15.26:0/4246164000 learned_addr learned my addr 172.21.15.26:0/4246164000 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb3fff640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb406f0d0 0x7f3cb414bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb9392640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb40c2a60 0x7f3cb414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 -- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb40c2a60 msgr2=0x7f3cb414c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb40c2a60 0x7f3cb414c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 -- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb406f0d0 msgr2=0x7f3cb414bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb406f0d0 0x7f3cb414bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 -- 172.21.15.26:0/4246164000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00094d0 con 0x7f3cb406b810 2023-11-28T16:59:17.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb8b91640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406b810 0x7f3cb4156380 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d830 tx=0x7f3ca800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb17fa640 1 -- 172.21.15.26:0/4246164000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80096c0 con 0x7f3cb406b810 2023-11-28T16:59:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb17fa640 1 -- 172.21.15.26:0/4246164000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8009820 con 0x7f3cb406b810 2023-11-28T16:59:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb4157050 con 0x7f3cb406b810 2023-11-28T16:59:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cb17fa640 1 -- 172.21.15.26:0/4246164000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8009bd0 con 0x7f3cb406b810 2023-11-28T16:59:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb414fd50 con 0x7f3cb406b810 2023-11-28T16:59:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.564+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb40663f0 con 0x7f3cb406b810 2023-11-28T16:59:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.568+0000 7f3cb17fa640 1 -- 172.21.15.26:0/4246164000 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3ca8014410 con 0x7f3cb406b810 2023-11-28T16:59:17.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.568+0000 7f3cb17fa640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c98066900 0x7f3c98068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.568+0000 7f3cb17fa640 1 -- 172.21.15.26:0/4246164000 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3ca8084f70 con 0x7f3cb406b810 2023-11-28T16:59:17.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.568+0000 7f3cb3fff640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c98066900 0x7f3c98068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.568+0000 7f3cb3fff640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c98066900 0x7f3c98068dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00af000 tx=0x7f3ca0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.572+0000 7f3cb17fa640 1 -- 172.21.15.26:0/4246164000 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ca8051ef0 con 0x7f3cb406b810 2023-11-28T16:59:17.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.728+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3cb414fee0 con 0x7f3cb406b810 2023-11-28T16:59:17.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.728+0000 7f3cb17fa640 1 -- 172.21.15.26:0/4246164000 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ca8055510 con 0x7f3cb406b810 2023-11-28T16:59:17.733 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c98066900 msgr2=0x7f3c98068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c98066900 0x7f3c98068dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00af000 tx=0x7f3ca0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406b810 msgr2=0x7f3cb4156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406b810 0x7f3cb4156380 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d830 tx=0x7f3ca800dcf0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 shutdown_connections 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3c98066900 0x7f3c98068dc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cb40c2a60 0x7f3cb414c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb406f0d0 0x7f3cb414bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 --2- 172.21.15.26:0/4246164000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cb406b810 0x7f3cb4156380 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 >> 172.21.15.26:0/4246164000 conn(0x7f3cb40c3240 msgr2=0x7f3cb414dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 shutdown_connections 2023-11-28T16:59:17.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.732+0000 7f3cbadf5640 1 -- 172.21.15.26:0/4246164000 wait complete. 2023-11-28T16:59:17.754 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:59:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.896+0000 7f729f59e640 1 Processor -- start 2023-11-28T16:59:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.896+0000 7f729f59e640 1 -- start start 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f729f59e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72a006d600 0x7f72a00a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f729f59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00726c0 0x7f72a015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f729f59e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a0156360 con 0x7f72a014fab0 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f729f59e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a0152e90 con 0x7f72a006d600 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f729f59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0152bd0 con 0x7f72a00726c0 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72a006d600 0x7f72a00a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72a006d600 0x7f72a00a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37016/0 (socket says 172.21.15.26:37016) 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 -- 172.21.15.26:0/203837970 learned_addr learned my addr 172.21.15.26:0/203837970 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f729ed9d640 1 --2- 172.21.15.26:0/203837970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00726c0 0x7f72a015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 -- 172.21.15.26:0/203837970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00726c0 msgr2=0x7f72a015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:17.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 --2- 172.21.15.26:0/203837970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00726c0 0x7f72a015cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 -- 172.21.15.26:0/203837970 >> v1:172.21.15.79:6789/0 conn(0x7f72a014fab0 legacy=0x7f72a01524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 -- 172.21.15.26:0/203837970 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a006da90 con 0x7f72a006d600 2023-11-28T16:59:17.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f729ed9d640 1 --2- 172.21.15.26:0/203837970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00726c0 0x7f72a015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:17.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.900+0000 7f7297fff640 1 --2- 172.21.15.26:0/203837970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a006d600 0x7f72a00a4cd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7288009870 tx=0x7f728801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50205d7fb937f3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729dd9b640 1 -- 172.21.15.26:0/203837970 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880ac600 con 0x7f72a006d600 2023-11-28T16:59:17.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729dd9b640 1 -- 172.21.15.26:0/203837970 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72880a8050 con 0x7f72a006d600 2023-11-28T16:59:17.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729dd9b640 1 -- 172.21.15.26:0/203837970 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880ac980 con 0x7f72a006d600 2023-11-28T16:59:17.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- 172.21.15.26:0/203837970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a006d600 msgr2=0x7f72a00a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 --2- 172.21.15.26:0/203837970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a006d600 0x7f72a00a4cd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7288009870 tx=0x7f728801c4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- 172.21.15.26:0/203837970 shutdown_connections 2023-11-28T16:59:17.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 --2- 172.21.15.26:0/203837970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00726c0 0x7f72a015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 --2- 172.21.15.26:0/203837970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a006d600 0x7f72a00a4cd0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- 172.21.15.26:0/203837970 >> 172.21.15.26:0/203837970 conn(0x7f72a00c5a60 msgr2=0x7f72a00c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:17.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- 172.21.15.26:0/203837970 shutdown_connections 2023-11-28T16:59:17.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- 172.21.15.26:0/203837970 wait complete. 2023-11-28T16:59:17.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 Processor -- start 2023-11-28T16:59:17.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- start start 2023-11-28T16:59:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00726c0 0x7f72a0144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a014fab0 0x7f72a0149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a0152160 0x7f72a01f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a01509c0 con 0x7f72a0152160 2023-11-28T16:59:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a015c380 con 0x7f72a00726c0 2023-11-28T16:59:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729f59e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a01455d0 con 0x7f72a014fab0 2023-11-28T16:59:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.904+0000 7f729ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a0152160 0x7f72a01f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a0152160 0x7f72a01f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37020/0 (socket says 172.21.15.26:37020) 2023-11-28T16:59:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 -- 172.21.15.26:0/3047186969 learned_addr learned my addr 172.21.15.26:0/3047186969 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729e59c640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00726c0 0x7f72a0144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f7297fff640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a014fab0 0x7f72a0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 -- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a014fab0 msgr2=0x7f72a0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a014fab0 0x7f72a0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 -- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00726c0 msgr2=0x7f72a0144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00726c0 0x7f72a0144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 -- 172.21.15.26:0/3047186969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880094d0 con 0x7f72a0152160 2023-11-28T16:59:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729ed9d640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a0152160 0x7f72a01f0760 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f729800cef0 tx=0x7f729800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f7296ffd640 1 -- 172.21.15.26:0/3047186969 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800d840 con 0x7f72a0152160 2023-11-28T16:59:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f7296ffd640 1 -- 172.21.15.26:0/3047186969 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800d9c0 con 0x7f72a0152160 2023-11-28T16:59:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f7296ffd640 1 -- 172.21.15.26:0/3047186969 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800dd70 con 0x7f72a0152160 2023-11-28T16:59:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a01550b0 con 0x7f72a0152160 2023-11-28T16:59:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a0155650 con 0x7f72a0152160 2023-11-28T16:59:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a00680c0 con 0x7f72a0152160 2023-11-28T16:59:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f7296ffd640 1 -- 172.21.15.26:0/3047186969 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f729801d360 con 0x7f72a0152160 2023-11-28T16:59:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f7296ffd640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f72800668d0 0x7f7280068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.908+0000 7f7296ffd640 1 -- 172.21.15.26:0/3047186969 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7298085250 con 0x7f72a0152160 2023-11-28T16:59:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.912+0000 7f729e59c640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f72800668d0 0x7f7280068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.912+0000 7f729e59c640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f72800668d0 0x7f7280068d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7290007fd0 tx=0x7f7290009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:17.912+0000 7f7296ffd640 1 -- 172.21.15.26:0/3047186969 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7298052200 con 0x7f72a0152160 2023-11-28T16:59:17.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:59:17.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:59:18.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72a0155840 con 0x7f72a0152160 2023-11-28T16:59:18.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f7296ffd640 1 -- 172.21.15.26:0/3047186969 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7298055820 con 0x7f72a0152160 2023-11-28T16:59:18.076 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:18.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f72800668d0 msgr2=0x7f7280068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f72800668d0 0x7f7280068d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7290007fd0 tx=0x7f7290009040 comp rx=0 tx=0).stop 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a0152160 msgr2=0x7f72a01f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a0152160 0x7f72a01f0760 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f729800cef0 tx=0x7f729800a710 comp rx=0 tx=0).stop 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 shutdown_connections 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a0152160 0x7f72a01f0760 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f72800668d0 0x7f7280068d90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a014fab0 0x7f72a0149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 --2- 172.21.15.26:0/3047186969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00726c0 0x7f72a0144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 >> 172.21.15.26:0/3047186969 conn(0x7f72a00c5a60 msgr2=0x7f72a00c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 shutdown_connections 2023-11-28T16:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.072+0000 7f729f59e640 1 -- 172.21.15.26:0/3047186969 wait complete. 2023-11-28T16:59:18.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:59:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7fafa08e9640 1 Processor -- start 2023-11-28T16:59:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7fafa08e9640 1 -- start start 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7fafa08e9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf9c14fab0 0x7faf9c1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7fafa08e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c152a00 0x7faf9c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7fafa08e9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c156360 con 0x7faf9c06d600 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7fafa08e9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c152e90 con 0x7faf9c14fab0 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7fafa08e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c06da90 con 0x7faf9c152a00 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf9b59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c152a00 0x7faf9c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf9ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf9c14fab0 0x7faf9c1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf93fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faf9c06d600 0x7faf9c0a4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:53534/0 (socket says 172.21.15.26:53534) 2023-11-28T16:59:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf93fff640 1 -- 172.21.15.26:0/803000989 learned_addr learned my addr 172.21.15.26:0/803000989 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf9b59e640 1 -- 172.21.15.26:0/803000989 >> v2:172.21.15.79:3300/0 conn(0x7faf9c14fab0 msgr2=0x7faf9c1524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf9b59e640 1 --2- 172.21.15.26:0/803000989 >> v2:172.21.15.79:3300/0 conn(0x7faf9c14fab0 0x7faf9c1524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf9b59e640 1 -- 172.21.15.26:0/803000989 >> v1:172.21.15.79:6789/0 conn(0x7faf9c06d600 legacy=0x7faf9c0a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.240+0000 7faf9b59e640 1 -- 172.21.15.26:0/803000989 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c155a30 con 0x7faf9c152a00 2023-11-28T16:59:18.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7faf9b59e640 1 --2- 172.21.15.26:0/803000989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c152a00 0x7faf9c15cd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf94009d90 tx=0x7faf9401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d44e1235526e3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:18.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7faf9a59c640 1 -- 172.21.15.26:0/803000989 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940a5870 con 0x7faf9c152a00 2023-11-28T16:59:18.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7faf9a59c640 1 -- 172.21.15.26:0/803000989 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf940a59d0 con 0x7faf9c152a00 2023-11-28T16:59:18.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7faf9a59c640 1 -- 172.21.15.26:0/803000989 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940a5d60 con 0x7faf9c152a00 2023-11-28T16:59:18.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 -- 172.21.15.26:0/803000989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c152a00 msgr2=0x7faf9c15cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 --2- 172.21.15.26:0/803000989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c152a00 0x7faf9c15cd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf94009d90 tx=0x7faf9401c8c0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 -- 172.21.15.26:0/803000989 shutdown_connections 2023-11-28T16:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 --2- 172.21.15.26:0/803000989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c152a00 0x7faf9c15cd60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 --2- 172.21.15.26:0/803000989 >> v2:172.21.15.79:3300/0 conn(0x7faf9c14fab0 0x7faf9c1524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 -- 172.21.15.26:0/803000989 >> 172.21.15.26:0/803000989 conn(0x7faf9c0c5a60 msgr2=0x7faf9c0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 -- 172.21.15.26:0/803000989 shutdown_connections 2023-11-28T16:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.244+0000 7fafa08e9640 1 -- 172.21.15.26:0/803000989 wait complete. 2023-11-28T16:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 Processor -- start 2023-11-28T16:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 -- start start 2023-11-28T16:59:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf9c14fab0 0x7faf9c1f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c14b480 0x7faf9c0a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf9c0a7210 0x7faf9c15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1f1790 con 0x7faf9c14fab0 2023-11-28T16:59:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c155700 con 0x7faf9c0a7210 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c154550 con 0x7faf9c14b480 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf9c14fab0 0x7faf9c1f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf9c14fab0 0x7faf9c1f11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37024/0 (socket says 172.21.15.26:37024) 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 -- 172.21.15.26:0/1084618159 learned_addr learned my addr 172.21.15.26:0/1084618159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 -- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c14b480 msgr2=0x7faf9c0a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c14b480 0x7faf9c0a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 -- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf9c0a7210 msgr2=0x7faf9c15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf9c0a7210 0x7faf9c15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 -- 172.21.15.26:0/1084618159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009a70 con 0x7faf9c14fab0 2023-11-28T16:59:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf9ad9d640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf9c14fab0 0x7faf9c1f11b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00e960 tx=0x7faf8c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf937fe640 1 -- 172.21.15.26:0/1084618159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c009690 con 0x7faf9c14fab0 2023-11-28T16:59:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf937fe640 1 -- 172.21.15.26:0/1084618159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c00c9a0 con 0x7faf9c14fab0 2023-11-28T16:59:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7faf937fe640 1 -- 172.21.15.26:0/1084618159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c00cd10 con 0x7faf9c14fab0 2023-11-28T16:59:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c154b30 con 0x7faf9c14fab0 2023-11-28T16:59:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.248+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c147d20 con 0x7faf9c14fab0 2023-11-28T16:59:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.252+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c0680c0 con 0x7faf9c14fab0 2023-11-28T16:59:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.252+0000 7faf937fe640 1 -- 172.21.15.26:0/1084618159 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faf8c013470 con 0x7faf9c14fab0 2023-11-28T16:59:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.252+0000 7faf937fe640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf7c0668d0 0x7faf7c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.252+0000 7faf937fe640 1 -- 172.21.15.26:0/1084618159 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faf8c084a50 con 0x7faf9c14fab0 2023-11-28T16:59:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.252+0000 7faf93fff640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf7c0668d0 0x7faf7c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.252+0000 7faf93fff640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf7c0668d0 0x7faf7c068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faf84000f70 tx=0x7faf84007a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.256+0000 7faf937fe640 1 -- 172.21.15.26:0/1084618159 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf8c051890 con 0x7faf9c14fab0 2023-11-28T16:59:18.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.416+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7faf9c074970 con 0x7faf9c14fab0 2023-11-28T16:59:18.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.416+0000 7faf937fe640 1 -- 172.21.15.26:0/1084618159 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7faf8c054eb0 con 0x7faf9c14fab0 2023-11-28T16:59:18.420 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf7c0668d0 msgr2=0x7faf7c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf7c0668d0 0x7faf7c068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faf84000f70 tx=0x7faf84007a90 comp rx=0 tx=0).stop 2023-11-28T16:59:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf9c14fab0 msgr2=0x7faf9c1f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf9c14fab0 0x7faf9c1f11b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00e960 tx=0x7faf8c00ee20 comp rx=0 tx=0).stop 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 shutdown_connections 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf9c0a7210 0x7faf9c15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faf7c0668d0 0x7faf7c068d90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf9c14b480 0x7faf9c0a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 --2- 172.21.15.26:0/1084618159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf9c14fab0 0x7faf9c1f11b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 >> 172.21.15.26:0/1084618159 conn(0x7faf9c0c5a60 msgr2=0x7faf9c0c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 shutdown_connections 2023-11-28T16:59:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.420+0000 7fafa08e9640 1 -- 172.21.15.26:0/1084618159 wait complete. 2023-11-28T16:59:18.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:59:18.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246911d640 1 Processor -- start 2023-11-28T16:59:18.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246911d640 1 -- start start 2023-11-28T16:59:18.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246911d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2464156500 0x7f246406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246911d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24640c19e0 0x7f24640c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246911d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246406dec0 con 0x7f246414fcc0 2023-11-28T16:59:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246911d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24640aa340 con 0x7f24640c19e0 2023-11-28T16:59:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246911d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2464156980 con 0x7f2464156500 2023-11-28T16:59:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f2462d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f246414fcc0 0x7f24640aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41088/0 (socket says 172.21.15.26:41088) 2023-11-28T16:59:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f2462d9d640 1 -- 172.21.15.26:0/2697848848 learned_addr learned my addr 172.21.15.26:0/2697848848 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246359e640 1 --2- 172.21.15.26:0/2697848848 >> v2:172.21.15.26:3300/0 conn(0x7f24640c19e0 0x7f24640c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246259c640 1 --2- 172.21.15.26:0/2697848848 >> v2:172.21.15.79:3300/0 conn(0x7f2464156500 0x7f246406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246359e640 1 -- 172.21.15.26:0/2697848848 >> v2:172.21.15.79:3300/0 conn(0x7f2464156500 msgr2=0x7f246406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246359e640 1 --2- 172.21.15.26:0/2697848848 >> v2:172.21.15.79:3300/0 conn(0x7f2464156500 0x7f246406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246359e640 1 -- 172.21.15.26:0/2697848848 >> v1:172.21.15.26:6789/0 conn(0x7f246414fcc0 legacy=0x7f24640aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f246359e640 1 -- 172.21.15.26:0/2697848848 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640ab580 con 0x7f24640c19e0 2023-11-28T16:59:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.584+0000 7f2461d9b640 1 -- 172.21.15.26:0/2697848848 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999163507 0 0) 0x7f246406dec0 con 0x7f246414fcc0 2023-11-28T16:59:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246359e640 1 --2- 172.21.15.26:0/2697848848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640c19e0 0x7f24640c1e50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f246406b4e0 tx=0x7f245c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412bdfeeca470fe3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f2461d9b640 1 -- 172.21.15.26:0/2697848848 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c0a58b0 con 0x7f24640c19e0 2023-11-28T16:59:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f2461d9b640 1 -- 172.21.15.26:0/2697848848 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c0a5a10 con 0x7f24640c19e0 2023-11-28T16:59:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f2461d9b640 1 -- 172.21.15.26:0/2697848848 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c0a5da0 con 0x7f24640c19e0 2023-11-28T16:59:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 -- 172.21.15.26:0/2697848848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640c19e0 msgr2=0x7f24640c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 --2- 172.21.15.26:0/2697848848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640c19e0 0x7f24640c1e50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f246406b4e0 tx=0x7f245c01c8e0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 -- 172.21.15.26:0/2697848848 shutdown_connections 2023-11-28T16:59:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 --2- 172.21.15.26:0/2697848848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640c19e0 0x7f24640c1e50 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 --2- 172.21.15.26:0/2697848848 >> v2:172.21.15.79:3300/0 conn(0x7f2464156500 0x7f246406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 -- 172.21.15.26:0/2697848848 >> 172.21.15.26:0/2697848848 conn(0x7f24640c2ad0 msgr2=0x7f24640c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 -- 172.21.15.26:0/2697848848 shutdown_connections 2023-11-28T16:59:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.588+0000 7f246911d640 1 -- 172.21.15.26:0/2697848848 wait complete. 2023-11-28T16:59:18.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 Processor -- start 2023-11-28T16:59:18.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 -- start start 2023-11-28T16:59:18.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c19e0 0x7f246406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464156500 0x7f24641506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f246415b7b0 0x7f2464150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464151130 con 0x7f2464156500 2023-11-28T16:59:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464157720 con 0x7f246415b7b0 2023-11-28T16:59:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2464152280 con 0x7f24640c19e0 2023-11-28T16:59:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464156500 0x7f24641506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464156500 0x7f24641506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37052/0 (socket says 172.21.15.26:37052) 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 -- 172.21.15.26:0/3109695298 learned_addr learned my addr 172.21.15.26:0/3109695298 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f2462d9d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c19e0 0x7f246406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246359e640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f246415b7b0 0x7f2464150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 -- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c19e0 msgr2=0x7f246406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c19e0 0x7f246406d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 -- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f246415b7b0 msgr2=0x7f2464150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f246415b7b0 0x7f2464150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 -- 172.21.15.26:0/3109695298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c009a70 con 0x7f2464156500 2023-11-28T16:59:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246259c640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464156500 0x7f24641506b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f245800d5f0 tx=0x7f245800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f244b7fe640 1 -- 172.21.15.26:0/3109695298 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24580125f0 con 0x7f2464156500 2023-11-28T16:59:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f244b7fe640 1 -- 172.21.15.26:0/3109695298 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458012750 con 0x7f2464156500 2023-11-28T16:59:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f244b7fe640 1 -- 172.21.15.26:0/3109695298 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458012ae0 con 0x7f2464156500 2023-11-28T16:59:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2464152560 con 0x7f2464156500 2023-11-28T16:59:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24641eea90 con 0x7f2464156500 2023-11-28T16:59:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.592+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24641eecb0 con 0x7f2464156500 2023-11-28T16:59:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.596+0000 7f244b7fe640 1 -- 172.21.15.26:0/3109695298 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2458012c40 con 0x7f2464156500 2023-11-28T16:59:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.596+0000 7f244b7fe640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24500668d0 0x7f2450068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.596+0000 7f244b7fe640 1 -- 172.21.15.26:0/3109695298 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2458084d80 con 0x7f2464156500 2023-11-28T16:59:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.596+0000 7f2462d9d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24500668d0 0x7f2450068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.596+0000 7f2462d9d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24500668d0 0x7f2450068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2454000f70 tx=0x7f2454007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.600+0000 7f244b7fe640 1 -- 172.21.15.26:0/3109695298 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2458051bc0 con 0x7f2464156500 2023-11-28T16:59:18.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.768+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f246404e890 con 0x7f2464156500 2023-11-28T16:59:18.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.768+0000 7f244b7fe640 1 -- 172.21.15.26:0/3109695298 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f24580551e0 con 0x7f2464156500 2023-11-28T16:59:18.773 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24500668d0 msgr2=0x7f2450068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24500668d0 0x7f2450068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2454000f70 tx=0x7f2454007b60 comp rx=0 tx=0).stop 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464156500 msgr2=0x7f24641506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464156500 0x7f24641506b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f245800d5f0 tx=0x7f245800dab0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 shutdown_connections 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f246415b7b0 0x7f2464150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2464156500 0x7f24641506b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f24500668d0 0x7f2450068d90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 --2- 172.21.15.26:0/3109695298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24640c19e0 0x7f246406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:18.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 >> 172.21.15.26:0/3109695298 conn(0x7f24640c2ad0 msgr2=0x7f24640a8470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:18.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 shutdown_connections 2023-11-28T16:59:18.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:18.772+0000 7f246911d640 1 -- 172.21.15.26:0/3109695298 wait complete. 2023-11-28T16:59:18.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T16:59:18.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:18.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:18.824 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:59:18.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:18.825 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:59:18.876 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:18.876 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:18.927 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:59:18.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:59:19.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa3485f5640 1 Processor -- start 2023-11-28T16:59:19.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa3485f5640 1 -- start start 2023-11-28T16:59:19.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa3485f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3401520f0 0x7fa3400c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:19.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa3485f5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa340155660 0x7fa34006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:19.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa3485f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3400c5520 con 0x7fa34006b650 2023-11-28T16:59:19.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa3485f5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34006c020 con 0x7fa340155660 2023-11-28T16:59:19.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa3485f5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3401524d0 con 0x7fa3401520f0 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa345b90640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa340155660 0x7fa34006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa345b90640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa340155660 0x7fa34006b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37058/0 (socket says 172.21.15.26:37058) 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa345b90640 1 -- 172.21.15.26:0/608766422 learned_addr learned my addr 172.21.15.26:0/608766422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa346391640 1 --2- 172.21.15.26:0/608766422 >> v2:172.21.15.79:3300/0 conn(0x7fa3401520f0 0x7fa3400c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa345b90640 1 -- 172.21.15.26:0/608766422 >> v2:172.21.15.79:3300/0 conn(0x7fa3401520f0 msgr2=0x7fa3400c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa345b90640 1 --2- 172.21.15.26:0/608766422 >> v2:172.21.15.79:3300/0 conn(0x7fa3401520f0 0x7fa3400c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa345b90640 1 -- 172.21.15.26:0/608766422 >> v1:172.21.15.79:6789/0 conn(0x7fa34006b650 legacy=0x7fa3400c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.068+0000 7fa345b90640 1 -- 172.21.15.26:0/608766422 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400c9a80 con 0x7fa340155660 2023-11-28T16:59:19.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa345b90640 1 --2- 172.21.15.26:0/608766422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa340155660 0x7fa34006b110 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa34006d200 tx=0x7fa33001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a870a63e55a481e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:19.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa34538f640 1 -- 172.21.15.26:0/608766422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300ab600 con 0x7fa340155660 2023-11-28T16:59:19.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa34538f640 1 -- 172.21.15.26:0/608766422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3300ab760 con 0x7fa340155660 2023-11-28T16:59:19.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa34538f640 1 -- 172.21.15.26:0/608766422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300abaf0 con 0x7fa340155660 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 -- 172.21.15.26:0/608766422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa340155660 msgr2=0x7fa34006b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 --2- 172.21.15.26:0/608766422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa340155660 0x7fa34006b110 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa34006d200 tx=0x7fa33001c400 comp rx=0 tx=0).stop 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 -- 172.21.15.26:0/608766422 shutdown_connections 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 --2- 172.21.15.26:0/608766422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa340155660 0x7fa34006b110 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 --2- 172.21.15.26:0/608766422 >> v2:172.21.15.79:3300/0 conn(0x7fa3401520f0 0x7fa3400c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 -- 172.21.15.26:0/608766422 >> 172.21.15.26:0/608766422 conn(0x7fa3400ca070 msgr2=0x7fa3400ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 -- 172.21.15.26:0/608766422 shutdown_connections 2023-11-28T16:59:19.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.072+0000 7fa3485f5640 1 -- 172.21.15.26:0/608766422 wait complete. 2023-11-28T16:59:19.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 Processor -- start 2023-11-28T16:59:19.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 -- start start 2023-11-28T16:59:19.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa34006b650 0x7fa34014e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:19.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3401520f0 0x7fa3401f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:19.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340155660 0x7fa3401f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:19.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa340152a80 con 0x7fa34006b650 2023-11-28T16:59:19.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34014d530 con 0x7fa340155660 2023-11-28T16:59:19.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34014ea80 con 0x7fa3401520f0 2023-11-28T16:59:19.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa34006b650 0x7fa34014e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa34006b650 0x7fa34014e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37066/0 (socket says 172.21.15.26:37066) 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 -- 172.21.15.26:0/1318465580 learned_addr learned my addr 172.21.15.26:0/1318465580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346b92640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340155660 0x7fa3401f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa345b90640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3401520f0 0x7fa3401f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 -- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3401520f0 msgr2=0x7fa3401f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3401520f0 0x7fa3401f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 -- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340155660 msgr2=0x7fa3401f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340155660 0x7fa3401f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 -- 172.21.15.26:0/1318465580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300094d0 con 0x7fa34006b650 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa346391640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa34006b650 0x7fa34014e3f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00d830 tx=0x7fa33c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa336ffd640 1 -- 172.21.15.26:0/1318465580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c00b6c0 con 0x7fa34006b650 2023-11-28T16:59:19.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa336ffd640 1 -- 172.21.15.26:0/1318465580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c00b820 con 0x7fa34006b650 2023-11-28T16:59:19.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34014ed60 con 0x7fa34006b650 2023-11-28T16:59:19.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa336ffd640 1 -- 172.21.15.26:0/1318465580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c00bb90 con 0x7fa34006b650 2023-11-28T16:59:19.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.076+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3401f1140 con 0x7fa34006b650 2023-11-28T16:59:19.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.080+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa340152850 con 0x7fa34006b650 2023-11-28T16:59:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.080+0000 7fa336ffd640 1 -- 172.21.15.26:0/1318465580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa33c01e460 con 0x7fa34006b650 2023-11-28T16:59:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.080+0000 7fa336ffd640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa3240668d0 0x7fa324068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.080+0000 7fa336ffd640 1 -- 172.21.15.26:0/1318465580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa33c084e50 con 0x7fa34006b650 2023-11-28T16:59:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.080+0000 7fa345b90640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa3240668d0 0x7fa324068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.080+0000 7fa345b90640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa3240668d0 0x7fa324068d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa3300af000 tx=0x7fa3300b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:19.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.084+0000 7fa336ffd640 1 -- 172.21.15.26:0/1318465580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa33c051dd0 con 0x7fa34006b650 2023-11-28T16:59:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.276+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa34004e890 con 0x7fa34006b650 2023-11-28T16:59:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.276+0000 7fa336ffd640 1 -- 172.21.15.26:0/1318465580 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa33c0553f0 con 0x7fa34006b650 2023-11-28T16:59:19.280 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:59:19.280 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T16:59:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa3240668d0 msgr2=0x7fa324068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa3240668d0 0x7fa324068d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa3300af000 tx=0x7fa3300b6040 comp rx=0 tx=0).stop 2023-11-28T16:59:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa34006b650 msgr2=0x7fa34014e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa34006b650 0x7fa34014e3f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00d830 tx=0x7fa33c00dcf0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 shutdown_connections 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340155660 0x7fa3401f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa3240668d0 0x7fa324068d90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3401520f0 0x7fa3401f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 --2- 172.21.15.26:0/1318465580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa34006b650 0x7fa34014e3f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 >> 172.21.15.26:0/1318465580 conn(0x7fa3400ca070 msgr2=0x7fa3400c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 shutdown_connections 2023-11-28T16:59:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:19.280+0000 7fa3485f5640 1 -- 172.21.15.26:0/1318465580 wait complete. 2023-11-28T16:59:19.301 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T16:59:19.301 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:59:19.301 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:59:19.302 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T16:59:19.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:19.302 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T16:59:19.302 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:59:19.302 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T16:59:19.302 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:19.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.302 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:59:19.312 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:59:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:59:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:59:19.313 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42207sec preferred_lft 42207sec 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:19.314 INFO:teuthology.orchestra.run.smithi079.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:59:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:19.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.316 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:59:19.384 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:59:19.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.387 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:59:19.442 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:59:19.442 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:59:19.442 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:59:19.442 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:59:19.442 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:59:19.442 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:59:19.443 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:19.443 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:19.443 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:19.443 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:59:19.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.443 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:59:19.443 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:59:19.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:59:19.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:59:19.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:59:19.444 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:59:19.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.541 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:59:19.551 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:59:19.551 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:19.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:59:19.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:19.616 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:19.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:19.674 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:19.726 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-11-28T16:59:19.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:19.816 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:19.817 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:19.829 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:19.829 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:19.829 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:59:19.829 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs2=/ 2023-11-28T16:59:19.829 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:59:19.833 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:59:19.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:19.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.854 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:59:19.911 INFO:teuthology.orchestra.run.smithi079.stdout:client5927 2023-11-28T16:59:19.911 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:19.911 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:19.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:19.964 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-11-28T16:59:19.981 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:19.981 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-11-28T16:59:20.036 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:20.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:20.037 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-11-28T16:59:20.052 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:20.053 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-11-28T16:59:20.108 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:20.108 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-11-28T16:59:20.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8e14ea640 1 Processor -- start 2023-11-28T16:59:20.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8e14ea640 1 -- start start 2023-11-28T16:59:20.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8e14ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8dc0c8430 0x7fc8dc06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8e14ea640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc06cf70 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8e14ea640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc152160 con 0x7fc8dc151d80 2023-11-28T16:59:20.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8e14ea640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc0c6a30 con 0x7fc8dc0c8430 2023-11-28T16:59:20.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8db7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc8dc0c7f20 0x7fc8dc06bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41090/0 (socket says 172.21.15.26:41090) 2023-11-28T16:59:20.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8db7fe640 1 -- 172.21.15.26:0/2777627868 learned_addr learned my addr 172.21.15.26:0/2777627868 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:20.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8da7fc640 1 --2- 172.21.15.26:0/2777627868 >> v2:172.21.15.79:3300/0 conn(0x7fc8dc0c8430 0x7fc8dc06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530931921 0 0) 0x7fc8dc06cf70 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c4003530 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530109407 0 0) 0x7fc8cc001120 con 0x7fc8dc151d80 2023-11-28T16:59:20.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc06cf70 con 0x7fc8dc151d80 2023-11-28T16:59:20.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8da7fc640 1 -- 172.21.15.26:0/2777627868 >> v1:172.21.15.79:6789/0 conn(0x7fc8dc151d80 legacy=0x7fc8dc0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4160227206 0 0) 0x7fc8dc06cf70 con 0x7fc8dc151d80 2023-11-28T16:59:20.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8da7fc640 1 -- 172.21.15.26:0/2777627868 >> v1:172.21.15.26:6789/0 conn(0x7fc8dc0c7f20 legacy=0x7fc8dc06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.256+0000 7fc8da7fc640 1 -- 172.21.15.26:0/2777627868 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0c72d0 con 0x7fc8dc0c8430 2023-11-28T16:59:20.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8da7fc640 1 --2- 172.21.15.26:0/2777627868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 0x7fc8dc06b720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009740 tx=0x7fc8d001c1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d00109b6a86cc09 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:20.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4001a20 con 0x7fc8dc0c8430 2023-11-28T16:59:20.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d00a7050 con 0x7fc8dc0c8430 2023-11-28T16:59:20.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8d9ffb640 1 -- 172.21.15.26:0/2777627868 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc001810 con 0x7fc8dc0c8430 2023-11-28T16:59:20.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8e14ea640 1 -- 172.21.15.26:0/2777627868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 msgr2=0x7fc8dc06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/2777627868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 0x7fc8dc06b720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009740 tx=0x7fc8d001c1a0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8e14ea640 1 -- 172.21.15.26:0/2777627868 shutdown_connections 2023-11-28T16:59:20.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/2777627868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 0x7fc8dc06b720 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8e14ea640 1 -- 172.21.15.26:0/2777627868 >> 172.21.15.26:0/2777627868 conn(0x7fc8dc0abd00 msgr2=0x7fc8dc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:20.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8e14ea640 1 -- 172.21.15.26:0/2777627868 shutdown_connections 2023-11-28T16:59:20.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.260+0000 7fc8e14ea640 1 -- 172.21.15.26:0/2777627868 wait complete. 2023-11-28T16:59:20.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 Processor -- start 2023-11-28T16:59:20.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 -- start start 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0c7f20 0x7fc8dc1ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 0x7fc8dc0aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8dc151d80 0x7fc8dc14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc155c50 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1edbd0 con 0x7fc8dc0c8430 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc156d20 con 0x7fc8dc151d80 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0c7f20 0x7fc8dc1ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0c7f20 0x7fc8dc1ed690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37068/0 (socket says 172.21.15.26:37068) 2023-11-28T16:59:20.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 -- 172.21.15.26:0/1722077598 learned_addr learned my addr 172.21.15.26:0/1722077598 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8da7fc640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 0x7fc8dc0aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8db7fe640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8dc151d80 0x7fc8dc14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 -- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8dc151d80 msgr2=0x7fc8dc14b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8dc151d80 0x7fc8dc14b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 -- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 msgr2=0x7fc8dc0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 0x7fc8dc0aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 -- 172.21.15.26:0/1722077598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0009420 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8daffd640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0c7f20 0x7fc8dc1ed690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c780 tx=0x7fc8cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8c37fe640 1 -- 172.21.15.26:0/1722077598 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00a7e0 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8c37fe640 1 -- 172.21.15.26:0/1722077598 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc00a940 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8c37fe640 1 -- 172.21.15.26:0/1722077598 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00acd0 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.264+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc157000 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.268+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc0ab150 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.268+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc1574b0 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.268+0000 7fc8c37fe640 1 -- 172.21.15.26:0/1722077598 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8cc012420 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.268+0000 7fc8c37fe640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8c80668d0 0x7fc8c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.268+0000 7fc8c37fe640 1 -- 172.21.15.26:0/1722077598 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc8cc0848e0 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.268+0000 7fc8da7fc640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8c80668d0 0x7fc8c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.268+0000 7fc8da7fc640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8c80668d0 0x7fc8c8068d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00ad000 tx=0x7fc8d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:20.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.272+0000 7fc8c37fe640 1 -- 172.21.15.26:0/1722077598 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8cc0517d0 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.484+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7fc8dc152160 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.484+0000 7fc8c37fe640 1 -- 172.21.15.26:0/1722077598 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v23) v1 ==== 272+0+0 (secure 0 0 0) 0x7fc8dc152160 con 0x7fc8dc0c7f20 2023-11-28T16:59:20.489 INFO:teuthology.orchestra.run.smithi026.stderr:added key for client.testuser 2023-11-28T16:59:20.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8c80668d0 msgr2=0x7fc8c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8c80668d0 0x7fc8c8068d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00ad000 tx=0x7fc8d0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:20.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0c7f20 msgr2=0x7fc8dc1ed690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0c7f20 0x7fc8dc1ed690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c780 tx=0x7fc8cc00cc40 comp rx=0 tx=0).stop 2023-11-28T16:59:20.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 shutdown_connections 2023-11-28T16:59:20.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8c80668d0 0x7fc8c8068d90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8dc151d80 0x7fc8dc14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8dc0c8430 0x7fc8dc0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 --2- 172.21.15.26:0/1722077598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0c7f20 0x7fc8dc1ed690 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 >> 172.21.15.26:0/1722077598 conn(0x7fc8dc0abd00 msgr2=0x7fc8dc150bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:20.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 shutdown_connections 2023-11-28T16:59:20.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.488+0000 7fc8e14ea640 1 -- 172.21.15.26:0/1722077598 wait complete. 2023-11-28T16:59:20.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-28T16:59:20.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.652+0000 7f8eef501640 1 Processor -- start 2023-11-28T16:59:20.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.652+0000 7f8eef501640 1 -- start start 2023-11-28T16:59:20.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eef501640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee8070b80 0x7f8ee8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eef501640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ee80a8470 0x7f8ee806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eef501640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee806d320 con 0x7f8ee814e9d0 2023-11-28T16:59:20.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eef501640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80721b0 con 0x7f8ee80a8470 2023-11-28T16:59:20.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eef501640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80c2830 con 0x7f8ee8070b80 2023-11-28T16:59:20.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eeca9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee8070b80 0x7f8ee8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eed29d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8ee814e9d0 0x7f8ee80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:53552/0 (socket says 172.21.15.26:53552) 2023-11-28T16:59:20.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eed29d640 1 -- 172.21.15.26:0/2202158211 learned_addr learned my addr 172.21.15.26:0/2202158211 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:20.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eeda9e640 1 --2- 172.21.15.26:0/2202158211 >> v2:172.21.15.79:3300/0 conn(0x7f8ee80a8470 0x7f8ee806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eeca9c640 1 -- 172.21.15.26:0/2202158211 >> v2:172.21.15.79:3300/0 conn(0x7f8ee80a8470 msgr2=0x7f8ee806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eeca9c640 1 --2- 172.21.15.26:0/2202158211 >> v2:172.21.15.79:3300/0 conn(0x7f8ee80a8470 0x7f8ee806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eeca9c640 1 -- 172.21.15.26:0/2202158211 >> v1:172.21.15.79:6789/0 conn(0x7f8ee814e9d0 legacy=0x7f8ee80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8edffff640 1 -- 172.21.15.26:0/2202158211 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587301176 0 0) 0x7f8ee806d320 con 0x7f8ee814e9d0 2023-11-28T16:59:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.656+0000 7f8eeca9c640 1 -- 172.21.15.26:0/2202158211 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8072450 con 0x7f8ee8070b80 2023-11-28T16:59:20.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eeca9c640 1 --2- 172.21.15.26:0/2202158211 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee8070b80 0x7f8ee8151e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80097c0 tx=0x7f8ed801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bfbc54eccbf88ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:20.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8edffff640 1 -- 172.21.15.26:0/2202158211 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80ab600 con 0x7f8ee8070b80 2023-11-28T16:59:20.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8edffff640 1 -- 172.21.15.26:0/2202158211 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed80a7050 con 0x7f8ee8070b80 2023-11-28T16:59:20.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8edffff640 1 -- 172.21.15.26:0/2202158211 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80ab980 con 0x7f8ee8070b80 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- 172.21.15.26:0/2202158211 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee8070b80 msgr2=0x7f8ee8151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 --2- 172.21.15.26:0/2202158211 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee8070b80 0x7f8ee8151e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80097c0 tx=0x7f8ed801c3f0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- 172.21.15.26:0/2202158211 shutdown_connections 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 --2- 172.21.15.26:0/2202158211 >> v2:172.21.15.79:3300/0 conn(0x7f8ee80a8470 0x7f8ee806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 --2- 172.21.15.26:0/2202158211 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee8070b80 0x7f8ee8151e60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- 172.21.15.26:0/2202158211 >> 172.21.15.26:0/2202158211 conn(0x7f8ee80c2ad0 msgr2=0x7f8ee80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- 172.21.15.26:0/2202158211 shutdown_connections 2023-11-28T16:59:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- 172.21.15.26:0/2202158211 wait complete. 2023-11-28T16:59:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 Processor -- start 2023-11-28T16:59:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- start start 2023-11-28T16:59:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ee8070b80 0x7f8ee814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee80a8470 0x7f8ee81f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee814e9d0 0x7f8ee81f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81f1020 con 0x7f8ee814e9d0 2023-11-28T16:59:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80c4650 con 0x7f8ee8070b80 2023-11-28T16:59:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.660+0000 7f8eef501640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80c4930 con 0x7f8ee80a8470 2023-11-28T16:59:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee80a8470 0x7f8ee81f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eed29d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ee8070b80 0x7f8ee814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee80a8470 0x7f8ee81f0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:59558/0 (socket says 172.21.15.26:59558) 2023-11-28T16:59:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 -- 172.21.15.26:0/4275725303 learned_addr learned my addr 172.21.15.26:0/4275725303 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeda9e640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee814e9d0 0x7f8ee81f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 -- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ee8070b80 msgr2=0x7f8ee814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ee8070b80 0x7f8ee814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 -- 172.21.15.26:0/4275725303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee814e9d0 msgr2=0x7f8ee81f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee814e9d0 0x7f8ee81f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 -- 172.21.15.26:0/4275725303 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009420 con 0x7f8ee80a8470 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eed29d640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ee8070b80 0x7f8ee814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eeca9c640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee80a8470 0x7f8ee81f0400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80ae040 tx=0x7f8ed801ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eddffb640 1 -- 172.21.15.26:0/4275725303 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80b7450 con 0x7f8ee80a8470 2023-11-28T16:59:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eddffb640 1 -- 172.21.15.26:0/4275725303 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed80b75b0 con 0x7f8ee80a8470 2023-11-28T16:59:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee80c4c10 con 0x7f8ee80a8470 2023-11-28T16:59:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eddffb640 1 -- 172.21.15.26:0/4275725303 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80b7960 con 0x7f8ee80a8470 2023-11-28T16:59:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee80ab2f0 con 0x7f8ee80a8470 2023-11-28T16:59:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee804e890 con 0x7f8ee80a8470 2023-11-28T16:59:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.664+0000 7f8eddffb640 1 -- 172.21.15.26:0/4275725303 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8ed80b7ac0 con 0x7f8ee80a8470 2023-11-28T16:59:20.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.668+0000 7f8eddffb640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ecc0668d0 0x7f8ecc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:20.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.668+0000 7f8eddffb640 1 -- 172.21.15.26:0/4275725303 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ed811ecf0 con 0x7f8ee80a8470 2023-11-28T16:59:20.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.668+0000 7f8eed29d640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ecc0668d0 0x7f8ecc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:20.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.668+0000 7f8eed29d640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ecc0668d0 0x7f8ecc068d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000f70 tx=0x7f8ee4007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:20.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.672+0000 7f8eddffb640 1 -- 172.21.15.26:0/4275725303 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ed80ebcf0 con 0x7f8ee80a8470 2023-11-28T16:59:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f8ee80c4a70 con 0x7f8ee80a8470 2023-11-28T16:59:20.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eddffb640 1 -- 172.21.15.26:0/4275725303 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v23) v1 ==== 85+0+226 (secure 0 0 0) 0x7f8ee80c4a70 con 0x7f8ee80a8470 2023-11-28T16:59:20.887 INFO:teuthology.orchestra.run.smithi026.stdout:[client.testuser] 2023-11-28T16:59:20.888 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w== 2023-11-28T16:59:20.888 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-11-28T16:59:20.888 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow r" 2023-11-28T16:59:20.888 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ecc0668d0 msgr2=0x7f8ecc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ecc0668d0 0x7f8ecc068d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000f70 tx=0x7f8ee4007df0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee80a8470 msgr2=0x7f8ee81f0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee80a8470 0x7f8ee81f0400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80ae040 tx=0x7f8ed801ac30 comp rx=0 tx=0).stop 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 shutdown_connections 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee814e9d0 0x7f8ee81f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ecc0668d0 0x7f8ecc068d90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ee80a8470 0x7f8ee81f0400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 --2- 172.21.15.26:0/4275725303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ee8070b80 0x7f8ee814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 >> 172.21.15.26:0/4275725303 conn(0x7f8ee80c2ad0 msgr2=0x7f8ee8070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 shutdown_connections 2023-11-28T16:59:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:20.884+0000 7f8eef501640 1 -- 172.21.15.26:0/4275725303 wait complete. 2023-11-28T16:59:20.908 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T16:59:20.909 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-11-28T16:59:20.917 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.6SLZ3p1dck 2023-11-28T16:59:20.917 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:20.917 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/tmp/tmp.6SLZ3p1dck 2023-11-28T16:59:20.974 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:20.974 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:21.026 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:21.026 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:21.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:21.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed5a217640 1 Processor -- start 2023-11-28T16:59:21.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed5a217640 1 -- start start 2023-11-28T16:59:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed5a217640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed540ca610 0x7fed540c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed5a217640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fed5406cd90 0x7fed540c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed5a217640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed54155790 con 0x7fed540bd720 2023-11-28T16:59:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed5a217640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540c4b00 con 0x7fed540ca610 2023-11-28T16:59:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed5a217640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540c4de0 con 0x7fed5406cd90 2023-11-28T16:59:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed540ca610 0x7fed540c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed540ca610 0x7fed540c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49022/0 (socket says 172.21.15.26:49022) 2023-11-28T16:59:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed537fe640 1 -- 172.21.15.26:0/3519293897 learned_addr learned my addr 172.21.15.26:0/3519293897 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed53fff640 1 --2- 172.21.15.26:0/3519293897 >> v2:172.21.15.79:3300/0 conn(0x7fed5406cd90 0x7fed540c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed537fe640 1 -- 172.21.15.26:0/3519293897 >> v2:172.21.15.79:3300/0 conn(0x7fed5406cd90 msgr2=0x7fed540c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed537fe640 1 --2- 172.21.15.26:0/3519293897 >> v2:172.21.15.79:3300/0 conn(0x7fed5406cd90 0x7fed540c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed537fe640 1 -- 172.21.15.26:0/3519293897 >> v1:172.21.15.79:6789/0 conn(0x7fed540bd720 legacy=0x7fed54158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:21.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.264+0000 7fed537fe640 1 -- 172.21.15.26:0/3519293897 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54157e30 con 0x7fed540ca610 2023-11-28T16:59:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed537fe640 1 --2- 172.21.15.26:0/3519293897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540ca610 0x7fed540c94c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fed541547a0 tx=0x7fed4401c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f15aa33125cf585 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed527fc640 1 -- 172.21.15.26:0/3519293897 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540c52d0 con 0x7fed540ca610 2023-11-28T16:59:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed527fc640 1 -- 172.21.15.26:0/3519293897 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440a48c0 con 0x7fed540ca610 2023-11-28T16:59:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed527fc640 1 -- 172.21.15.26:0/3519293897 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440a4c50 con 0x7fed540ca610 2023-11-28T16:59:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 -- 172.21.15.26:0/3519293897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540ca610 msgr2=0x7fed540c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 --2- 172.21.15.26:0/3519293897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540ca610 0x7fed540c94c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fed541547a0 tx=0x7fed4401c080 comp rx=0 tx=0).stop 2023-11-28T16:59:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 -- 172.21.15.26:0/3519293897 shutdown_connections 2023-11-28T16:59:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 --2- 172.21.15.26:0/3519293897 >> v2:172.21.15.79:3300/0 conn(0x7fed5406cd90 0x7fed540c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 --2- 172.21.15.26:0/3519293897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540ca610 0x7fed540c94c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 -- 172.21.15.26:0/3519293897 >> 172.21.15.26:0/3519293897 conn(0x7fed54071ea0 msgr2=0x7fed540722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 -- 172.21.15.26:0/3519293897 shutdown_connections 2023-11-28T16:59:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 -- 172.21.15.26:0/3519293897 wait complete. 2023-11-28T16:59:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.268+0000 7fed5a217640 1 Processor -- start 2023-11-28T16:59:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 -- start start 2023-11-28T16:59:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed5406cd90 0x7fed541ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540bd720 0x7fed540ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed540ca610 0x7fed541492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed541eee30 con 0x7fed540bd720 2023-11-28T16:59:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5414b5d0 con 0x7fed540ca610 2023-11-28T16:59:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540ab8a0 con 0x7fed5406cd90 2023-11-28T16:59:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540bd720 0x7fed540ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540bd720 0x7fed540ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49038/0 (socket says 172.21.15.26:49038) 2023-11-28T16:59:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 -- 172.21.15.26:0/4025318980 learned_addr learned my addr 172.21.15.26:0/4025318980 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed537fe640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed5406cd90 0x7fed541ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed53fff640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed540ca610 0x7fed541492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 -- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed5406cd90 msgr2=0x7fed541ee8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed5406cd90 0x7fed541ee8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 -- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed540ca610 msgr2=0x7fed541492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed540ca610 0x7fed541492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 -- 172.21.15.26:0/4025318980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed440094d0 con 0x7fed540bd720 2023-11-28T16:59:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed52ffd640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540bd720 0x7fed540ae180 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c450 tx=0x7fed4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed3bfff640 1 -- 172.21.15.26:0/4025318980 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48012830 con 0x7fed540bd720 2023-11-28T16:59:21.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed3bfff640 1 -- 172.21.15.26:0/4025318980 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed480129b0 con 0x7fed540bd720 2023-11-28T16:59:21.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed54155dd0 con 0x7fed540bd720 2023-11-28T16:59:21.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed3bfff640 1 -- 172.21.15.26:0/4025318980 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48012d60 con 0x7fed540bd720 2023-11-28T16:59:21.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed540a9de0 con 0x7fed540bd720 2023-11-28T16:59:21.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.272+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5404e890 con 0x7fed540bd720 2023-11-28T16:59:21.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.276+0000 7fed3bfff640 1 -- 172.21.15.26:0/4025318980 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fed4801c460 con 0x7fed540bd720 2023-11-28T16:59:21.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.276+0000 7fed3bfff640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed400668d0 0x7fed40068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.276+0000 7fed3bfff640 1 -- 172.21.15.26:0/4025318980 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fed48084470 con 0x7fed540bd720 2023-11-28T16:59:21.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.276+0000 7fed537fe640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed400668d0 0x7fed40068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.276+0000 7fed537fe640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed400668d0 0x7fed40068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fed440ae000 tx=0x7fed44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.280+0000 7fed3bfff640 1 -- 172.21.15.26:0/4025318980 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed480513f0 con 0x7fed540bd720 2023-11-28T16:59:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.444+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed5406cb70 con 0x7fed540bd720 2023-11-28T16:59:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.444+0000 7fed3bfff640 1 -- 172.21.15.26:0/4025318980 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7fed48054a10 con 0x7fed540bd720 2023-11-28T16:59:21.448 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:21.448 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.444+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed400668d0 msgr2=0x7fed40068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed400668d0 0x7fed40068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fed440ae000 tx=0x7fed44009040 comp rx=0 tx=0).stop 2023-11-28T16:59:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540bd720 msgr2=0x7fed540ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540bd720 0x7fed540ae180 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c450 tx=0x7fed4800c910 comp rx=0 tx=0).stop 2023-11-28T16:59:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 shutdown_connections 2023-11-28T16:59:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed540ca610 0x7fed541492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed540bd720 0x7fed540ae180 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed400668d0 0x7fed40068d90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 --2- 172.21.15.26:0/4025318980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed5406cd90 0x7fed541ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 >> 172.21.15.26:0/4025318980 conn(0x7fed54071ea0 msgr2=0x7fed54158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 shutdown_connections 2023-11-28T16:59:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.448+0000 7fed5a217640 1 -- 172.21.15.26:0/4025318980 wait complete. 2023-11-28T16:59:21.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:58:55.413723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:58:56.230719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:59:08.379611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:59:09.728280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:21.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:21.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.612+0000 7f650272a640 1 Processor -- start 2023-11-28T16:59:21.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.612+0000 7f650272a640 1 -- start start 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.612+0000 7f650272a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64fc14eaf0 0x7f64fc151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f650272a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f64fc151f90 0x7f64fc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f650272a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc06de00 con 0x7f64fc0c0370 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f650272a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc070390 con 0x7f64fc151f90 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f650272a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc14eed0 con 0x7f64fc14eaf0 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f64fc151f90 0x7f64fc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f64fc151f90 0x7f64fc06d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49046/0 (socket says 172.21.15.26:49046) 2023-11-28T16:59:21.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 -- 172.21.15.26:0/1831579933 learned_addr learned my addr 172.21.15.26:0/1831579933 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fbfff640 1 --2- 172.21.15.26:0/1831579933 >> v2:172.21.15.79:3300/0 conn(0x7f64fc14eaf0 0x7f64fc151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 -- 172.21.15.26:0/1831579933 >> v2:172.21.15.79:3300/0 conn(0x7f64fc14eaf0 msgr2=0x7f64fc151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 --2- 172.21.15.26:0/1831579933 >> v2:172.21.15.79:3300/0 conn(0x7f64fc14eaf0 0x7f64fc151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 -- 172.21.15.26:0/1831579933 >> v1:172.21.15.79:6789/0 conn(0x7f64fc0c0370 legacy=0x7f64fc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:21.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 -- 172.21.15.26:0/1831579933 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc151270 con 0x7f64fc151f90 2023-11-28T16:59:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64fb7fe640 1 --2- 172.21.15.26:0/1831579933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc151f90 0x7f64fc06d110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0c3b00 tx=0x7f64f001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdef3d24537530a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64faffd640 1 -- 172.21.15.26:0/1831579933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00a7a50 con 0x7f64fc151f90 2023-11-28T16:59:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64faffd640 1 -- 172.21.15.26:0/1831579933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f00a7bb0 con 0x7f64fc151f90 2023-11-28T16:59:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.616+0000 7f64faffd640 1 -- 172.21.15.26:0/1831579933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00af440 con 0x7f64fc151f90 2023-11-28T16:59:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- 172.21.15.26:0/1831579933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc151f90 msgr2=0x7f64fc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 --2- 172.21.15.26:0/1831579933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc151f90 0x7f64fc06d110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0c3b00 tx=0x7f64f001ea80 comp rx=0 tx=0).stop 2023-11-28T16:59:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- 172.21.15.26:0/1831579933 shutdown_connections 2023-11-28T16:59:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 --2- 172.21.15.26:0/1831579933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc151f90 0x7f64fc06d110 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 --2- 172.21.15.26:0/1831579933 >> v2:172.21.15.79:3300/0 conn(0x7f64fc14eaf0 0x7f64fc151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- 172.21.15.26:0/1831579933 >> 172.21.15.26:0/1831579933 conn(0x7f64fc0c2a60 msgr2=0x7f64fc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- 172.21.15.26:0/1831579933 shutdown_connections 2023-11-28T16:59:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- 172.21.15.26:0/1831579933 wait complete. 2023-11-28T16:59:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 Processor -- start 2023-11-28T16:59:21.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- start start 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc0c0370 0x7f64fc148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64fc14eaf0 0x7f64fc0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64fc137c40 0x7f64fc0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1408d0 con 0x7f64fc0c0370 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1380f0 con 0x7f64fc137c40 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f650272a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0c4090 con 0x7f64fc14eaf0 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f64fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc0c0370 0x7f64fc148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f64fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc0c0370 0x7f64fc148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49050/0 (socket says 172.21.15.26:49050) 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f64fbfff640 1 -- 172.21.15.26:0/286917571 learned_addr learned my addr 172.21.15.26:0/286917571 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f6500cc7640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64fc137c40 0x7f64fc0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.620+0000 7f64fb7fe640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64fc14eaf0 0x7f64fc0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64fbfff640 1 -- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64fc14eaf0 msgr2=0x7f64fc0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64fbfff640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64fc14eaf0 0x7f64fc0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64fbfff640 1 -- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64fc137c40 msgr2=0x7f64fc0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64fbfff640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64fc137c40 0x7f64fc0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64fbfff640 1 -- 172.21.15.26:0/286917571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f000b770 con 0x7f64fc0c0370 2023-11-28T16:59:21.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64fbfff640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc0c0370 0x7f64fc148160 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00d800 tx=0x7f64ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64f8ff9640 1 -- 172.21.15.26:0/286917571 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00b6c0 con 0x7f64fc0c0370 2023-11-28T16:59:21.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64f8ff9640 1 -- 172.21.15.26:0/286917571 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00b820 con 0x7f64fc0c0370 2023-11-28T16:59:21.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64f8ff9640 1 -- 172.21.15.26:0/286917571 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00bb90 con 0x7f64fc0c0370 2023-11-28T16:59:21.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc1404b0 con 0x7f64fc0c0370 2023-11-28T16:59:21.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc1f1970 con 0x7f64fc0c0370 2023-11-28T16:59:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc14f1e0 con 0x7f64fc0c0370 2023-11-28T16:59:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.624+0000 7f64f8ff9640 1 -- 172.21.15.26:0/286917571 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f64ec00bcf0 con 0x7f64fc0c0370 2023-11-28T16:59:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.628+0000 7f64f8ff9640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64e80668d0 0x7f64e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.628+0000 7f64f8ff9640 1 -- 172.21.15.26:0/286917571 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f64ec084bb0 con 0x7f64fc0c0370 2023-11-28T16:59:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.628+0000 7f64fb7fe640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64e80668d0 0x7f64e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.628+0000 7f64fb7fe640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64e80668d0 0x7f64e8068d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f64f00b1000 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.628+0000 7f64f8ff9640 1 -- 172.21.15.26:0/286917571 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64ec051b30 con 0x7f64fc0c0370 2023-11-28T16:59:21.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.788+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64fc04e890 con 0x7f64fc0c0370 2023-11-28T16:59:21.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.788+0000 7f64f8ff9640 1 -- 172.21.15.26:0/286917571 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64ec055150 con 0x7f64fc0c0370 2023-11-28T16:59:21.793 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:21.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64e80668d0 msgr2=0x7f64e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64e80668d0 0x7f64e8068d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f64f00b1000 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc0c0370 msgr2=0x7f64fc148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc0c0370 0x7f64fc148160 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00d800 tx=0x7f64ec00dcc0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 shutdown_connections 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64fc137c40 0x7f64fc0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f64e80668d0 0x7f64e8068d90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64fc14eaf0 0x7f64fc0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 --2- 172.21.15.26:0/286917571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64fc0c0370 0x7f64fc148160 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 >> 172.21.15.26:0/286917571 conn(0x7f64fc0c2a60 msgr2=0x7f64fc141b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:21.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 shutdown_connections 2023-11-28T16:59:21.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.792+0000 7f650272a640 1 -- 172.21.15.26:0/286917571 wait complete. 2023-11-28T16:59:21.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:59:21.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.956+0000 7fed6b5f5640 1 Processor -- start 2023-11-28T16:59:21.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.956+0000 7fed6b5f5640 1 -- start start 2023-11-28T16:59:21.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed6b5f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed640aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed6b5f5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed64152d90 con 0x7fed64156600 2023-11-28T16:59:21.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed6b5f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed64152480 con 0x7fed640a86d0 2023-11-28T16:59:21.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed6b5f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640a9760 con 0x7fed6414fd00 2023-11-28T16:59:21.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed68b90640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fed64156600 0x7fed6414f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53108/0 (socket says 172.21.15.26:53108) 2023-11-28T16:59:21.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed68b90640 1 -- 172.21.15.26:0/2418527250 learned_addr learned my addr 172.21.15.26:0/2418527250 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:21.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed69b92640 1 --2- 172.21.15.26:0/2418527250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed640aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493877352 0 0) 0x7fed64152d90 con 0x7fed64156600 2023-11-28T16:59:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed50003530 con 0x7fed64156600 2023-11-28T16:59:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743815705 0 0) 0x7fed64152480 con 0x7fed640a86d0 2023-11-28T16:59:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed64152d90 con 0x7fed640a86d0 2023-11-28T16:59:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2833125301 0 0) 0x7fed50003530 con 0x7fed64156600 2023-11-28T16:59:21.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed69b92640 1 -- 172.21.15.26:0/2418527250 >> v1:172.21.15.79:6789/0 conn(0x7fed640a86d0 legacy=0x7fed640a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed69b92640 1 -- 172.21.15.26:0/2418527250 >> v1:172.21.15.26:6789/0 conn(0x7fed64156600 legacy=0x7fed6414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.960+0000 7fed69b92640 1 -- 172.21.15.26:0/2418527250 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed64152740 con 0x7fed6414fd00 2023-11-28T16:59:21.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed69b92640 1 --2- 172.21.15.26:0/2418527250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed640aae40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009df0 tx=0x7fed5c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=487526206460f7d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54001680 con 0x7fed6414fd00 2023-11-28T16:59:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0a5600 con 0x7fed6414fd00 2023-11-28T16:59:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed5bfff640 1 -- 172.21.15.26:0/2418527250 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0a5970 con 0x7fed6414fd00 2023-11-28T16:59:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 -- 172.21.15.26:0/2418527250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 msgr2=0x7fed640aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/2418527250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed640aae40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009df0 tx=0x7fed5c01c890 comp rx=0 tx=0).stop 2023-11-28T16:59:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 -- 172.21.15.26:0/2418527250 shutdown_connections 2023-11-28T16:59:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/2418527250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed640aae40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 -- 172.21.15.26:0/2418527250 >> 172.21.15.26:0/2418527250 conn(0x7fed640c2a60 msgr2=0x7fed640c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 -- 172.21.15.26:0/2418527250 shutdown_connections 2023-11-28T16:59:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 -- 172.21.15.26:0/2418527250 wait complete. 2023-11-28T16:59:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 Processor -- start 2023-11-28T16:59:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.964+0000 7fed6b5f5640 1 -- start start 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed640a86d0 0x7fed641506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed64151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed64156600 0x7fed6414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6414de60 con 0x7fed640a86d0 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed641eda90 con 0x7fed64156600 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6414d8a0 con 0x7fed6414fd00 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed640a86d0 0x7fed641506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed640a86d0 0x7fed641506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49052/0 (socket says 172.21.15.26:49052) 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 -- 172.21.15.26:0/3092560595 learned_addr learned my addr 172.21.15.26:0/3092560595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69b92640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed64156600 0x7fed6414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed68b90640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed64151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 -- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 msgr2=0x7fed64151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed64151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 -- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed64156600 msgr2=0x7fed6414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed64156600 0x7fed6414acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 -- 172.21.15.26:0/3092560595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c009a70 con 0x7fed640a86d0 2023-11-28T16:59:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69b92640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed64156600 0x7fed6414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed69391640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed640a86d0 0x7fed641506d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c430 tx=0x7fed6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed59ffb640 1 -- 172.21.15.26:0/3092560595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed600052d0 con 0x7fed640a86d0 2023-11-28T16:59:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed59ffb640 1 -- 172.21.15.26:0/3092560595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed60005450 con 0x7fed640a86d0 2023-11-28T16:59:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6414db80 con 0x7fed640a86d0 2023-11-28T16:59:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed59ffb640 1 -- 172.21.15.26:0/3092560595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60003840 con 0x7fed640a86d0 2023-11-28T16:59:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6414b210 con 0x7fed640a86d0 2023-11-28T16:59:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6404e890 con 0x7fed640a86d0 2023-11-28T16:59:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.968+0000 7fed59ffb640 1 -- 172.21.15.26:0/3092560595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fed600039a0 con 0x7fed640a86d0 2023-11-28T16:59:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.972+0000 7fed59ffb640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed48066900 0x7fed48068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.972+0000 7fed59ffb640 1 -- 172.21.15.26:0/3092560595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fed60083e50 con 0x7fed640a86d0 2023-11-28T16:59:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.972+0000 7fed68b90640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed48066900 0x7fed48068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.972+0000 7fed68b90640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed48066900 0x7fed48068dc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fed6414b5e0 tx=0x7fed54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:21.976+0000 7fed59ffb640 1 -- 172.21.15.26:0/3092560595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed60050c90 con 0x7fed640a86d0 2023-11-28T16:59:22.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed64070320 con 0x7fed640a86d0 2023-11-28T16:59:22.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed59ffb640 1 -- 172.21.15.26:0/3092560595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed60017020 con 0x7fed640a86d0 2023-11-28T16:59:22.138 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:22.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed48066900 msgr2=0x7fed48068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed48066900 0x7fed48068dc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fed6414b5e0 tx=0x7fed54009040 comp rx=0 tx=0).stop 2023-11-28T16:59:22.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed640a86d0 msgr2=0x7fed641506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed640a86d0 0x7fed641506d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c430 tx=0x7fed6000c8f0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 shutdown_connections 2023-11-28T16:59:22.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed64156600 0x7fed6414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed48066900 0x7fed48068dc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed6414fd00 0x7fed64151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 --2- 172.21.15.26:0/3092560595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed640a86d0 0x7fed641506d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 >> 172.21.15.26:0/3092560595 conn(0x7fed640c2a60 msgr2=0x7fed6414f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 shutdown_connections 2023-11-28T16:59:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.136+0000 7fed6b5f5640 1 -- 172.21.15.26:0/3092560595 wait complete. 2023-11-28T16:59:22.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:59:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee229d8640 1 Processor -- start 2023-11-28T16:59:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee229d8640 1 -- start start 2023-11-28T16:59:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee229d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee229d8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee1c06dd90 0x7fee1c151930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee229d8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c0725f0 con 0x7fee1c0700f0 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee229d8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c070900 con 0x7fee1c06dd90 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee229d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c06e290 con 0x7fee1c071cd0 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee20f75640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fee1c0700f0 0x7fee1c157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53114/0 (socket says 172.21.15.26:53114) 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee20f75640 1 -- 172.21.15.26:0/3086317748 learned_addr learned my addr 172.21.15.26:0/3086317748 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1bfff640 1 --2- 172.21.15.26:0/3086317748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1b7fe640 1 --2- 172.21.15.26:0/3086317748 >> v2:172.21.15.79:3300/0 conn(0x7fee1c06dd90 0x7fee1c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1affd640 1 -- 172.21.15.26:0/3086317748 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997467701 0 0) 0x7fee1c0725f0 con 0x7fee1c0700f0 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1affd640 1 -- 172.21.15.26:0/3086317748 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee04003530 con 0x7fee1c0700f0 2023-11-28T16:59:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1bfff640 1 -- 172.21.15.26:0/3086317748 >> v2:172.21.15.79:3300/0 conn(0x7fee1c06dd90 msgr2=0x7fee1c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:22.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1bfff640 1 --2- 172.21.15.26:0/3086317748 >> v2:172.21.15.79:3300/0 conn(0x7fee1c06dd90 0x7fee1c151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1bfff640 1 -- 172.21.15.26:0/3086317748 >> v1:172.21.15.26:6789/0 conn(0x7fee1c0700f0 legacy=0x7fee1c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.304+0000 7fee1bfff640 1 -- 172.21.15.26:0/3086317748 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0c2520 con 0x7fee1c071cd0 2023-11-28T16:59:22.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee1bfff640 1 --2- 172.21.15.26:0/3086317748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0720b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0097c0 tx=0x7fee0c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36daee34e32eb5e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:22.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee1affd640 1 -- 172.21.15.26:0/3086317748 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0ab600 con 0x7fee1c071cd0 2023-11-28T16:59:22.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee1affd640 1 -- 172.21.15.26:0/3086317748 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c0a7050 con 0x7fee1c071cd0 2023-11-28T16:59:22.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee1affd640 1 -- 172.21.15.26:0/3086317748 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0ab980 con 0x7fee1c071cd0 2023-11-28T16:59:22.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 -- 172.21.15.26:0/3086317748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 msgr2=0x7fee1c0720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 --2- 172.21.15.26:0/3086317748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0720b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0097c0 tx=0x7fee0c01c330 comp rx=0 tx=0).stop 2023-11-28T16:59:22.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 -- 172.21.15.26:0/3086317748 shutdown_connections 2023-11-28T16:59:22.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 --2- 172.21.15.26:0/3086317748 >> v2:172.21.15.79:3300/0 conn(0x7fee1c06dd90 0x7fee1c151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 --2- 172.21.15.26:0/3086317748 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0720b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 -- 172.21.15.26:0/3086317748 >> 172.21.15.26:0/3086317748 conn(0x7fee1c0c2a60 msgr2=0x7fee1c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:22.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 -- 172.21.15.26:0/3086317748 shutdown_connections 2023-11-28T16:59:22.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.308+0000 7fee229d8640 1 -- 172.21.15.26:0/3086317748 wait complete. 2023-11-28T16:59:22.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 Processor -- start 2023-11-28T16:59:22.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 -- start start 2023-11-28T16:59:22.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee1c06dd90 0x7fee1c147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c0700f0 0x7fee1c1f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c1441b0 con 0x7fee1c06dd90 2023-11-28T16:59:22.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c1f0480 con 0x7fee1c0700f0 2023-11-28T16:59:22.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c147fd0 con 0x7fee1c071cd0 2023-11-28T16:59:22.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee1c06dd90 0x7fee1c147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee1c06dd90 0x7fee1c147110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49062/0 (socket says 172.21.15.26:49062) 2023-11-28T16:59:22.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 -- 172.21.15.26:0/3951707999 learned_addr learned my addr 172.21.15.26:0/3951707999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:22.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee20f75640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1b7fe640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c0700f0 0x7fee1c1f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 -- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 msgr2=0x7fee1c0c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 -- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c0700f0 msgr2=0x7fee1c1f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c0700f0 0x7fee1c1f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 -- 172.21.15.26:0/3951707999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c009420 con 0x7fee1c06dd90 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1b7fe640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c0700f0 0x7fee1c1f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee1bfff640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee1c06dd90 0x7fee1c147110 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fee0c019f60 tx=0x7fee0c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee18ff9640 1 -- 172.21.15.26:0/3951707999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0b5470 con 0x7fee1c06dd90 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee18ff9640 1 -- 172.21.15.26:0/3951707999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c0b55d0 con 0x7fee1c06dd90 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee18ff9640 1 -- 172.21.15.26:0/3951707999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0b5940 con 0x7fee1c06dd90 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c1482b0 con 0x7fee1c06dd90 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c1f09b0 con 0x7fee1c06dd90 2023-11-28T16:59:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.312+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c070d60 con 0x7fee1c06dd90 2023-11-28T16:59:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.316+0000 7fee18ff9640 1 -- 172.21.15.26:0/3951707999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fee0c0b2040 con 0x7fee1c06dd90 2023-11-28T16:59:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.316+0000 7fee18ff9640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee080668d0 0x7fee08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.316+0000 7fee18ff9640 1 -- 172.21.15.26:0/3951707999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fee0c11eaa0 con 0x7fee1c06dd90 2023-11-28T16:59:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.316+0000 7fee1b7fe640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee080668d0 0x7fee08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.316+0000 7fee1b7fe640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee080668d0 0x7fee08068d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fee1c14bc60 tx=0x7fee10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:22.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.320+0000 7fee18ff9640 1 -- 172.21.15.26:0/3951707999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee0c0eb970 con 0x7fee1c06dd90 2023-11-28T16:59:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.476+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee1c1f0ba0 con 0x7fee1c06dd90 2023-11-28T16:59:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.476+0000 7fee18ff9640 1 -- 172.21.15.26:0/3951707999 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee0c0b00a0 con 0x7fee1c06dd90 2023-11-28T16:59:22.482 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:22.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee080668d0 msgr2=0x7fee08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee080668d0 0x7fee08068d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fee1c14bc60 tx=0x7fee10008040 comp rx=0 tx=0).stop 2023-11-28T16:59:22.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee1c06dd90 msgr2=0x7fee1c147110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee1c06dd90 0x7fee1c147110 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fee0c019f60 tx=0x7fee0c0190d0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 shutdown_connections 2023-11-28T16:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee080668d0 0x7fee08068d90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee1c071cd0 0x7fee1c0c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c0700f0 0x7fee1c1f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 --2- 172.21.15.26:0/3951707999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee1c06dd90 0x7fee1c147110 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 >> 172.21.15.26:0/3951707999 conn(0x7fee1c0c2a60 msgr2=0x7fee1c14f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 shutdown_connections 2023-11-28T16:59:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.480+0000 7fee229d8640 1 -- 172.21.15.26:0/3951707999 wait complete. 2023-11-28T16:59:22.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:59:22.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.644+0000 7f0f138dd640 1 Processor -- start 2023-11-28T16:59:22.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.644+0000 7f0f138dd640 1 -- start start 2023-11-28T16:59:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f138dd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c14fcf0 0x7f0f0c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f138dd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f0c0a7330 0x7f0f0c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f138dd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c06f760 con 0x7f0f0c1500d0 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f138dd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c156d10 con 0x7f0f0c0a7330 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f138dd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0adf90 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f11e7a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f0c0a7330 0x7f0f0c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f10e78640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0f0c1500d0 0x7f0f0c0c3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53126/0 (socket says 172.21.15.26:53126) 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f10e78640 1 -- 172.21.15.26:0/916427477 learned_addr learned my addr 172.21.15.26:0/916427477 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f11679640 1 --2- 172.21.15.26:0/916427477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c14fcf0 0x7f0f0c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f11e7a640 1 -- 172.21.15.26:0/916427477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c14fcf0 msgr2=0x7f0f0c1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f11e7a640 1 --2- 172.21.15.26:0/916427477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c14fcf0 0x7f0f0c1567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f11e7a640 1 -- 172.21.15.26:0/916427477 >> v1:172.21.15.26:6789/0 conn(0x7f0f0c1500d0 legacy=0x7f0f0c0c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f11e7a640 1 -- 172.21.15.26:0/916427477 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c06fc90 con 0x7f0f0c0a7330 2023-11-28T16:59:22.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.648+0000 7f0f11e7a640 1 --2- 172.21.15.26:0/916427477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c153f00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009d90 tx=0x7f0f0401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952f4c2fd3aafa72 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:22.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f03fff640 1 -- 172.21.15.26:0/916427477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f040a5950 con 0x7f0f0c0a7330 2023-11-28T16:59:22.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f03fff640 1 -- 172.21.15.26:0/916427477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f040a5ab0 con 0x7f0f0c0a7330 2023-11-28T16:59:22.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f03fff640 1 -- 172.21.15.26:0/916427477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f040a5e40 con 0x7f0f0c0a7330 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- 172.21.15.26:0/916427477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c0a7330 msgr2=0x7f0f0c153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 --2- 172.21.15.26:0/916427477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c153f00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009d90 tx=0x7f0f0401c890 comp rx=0 tx=0).stop 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- 172.21.15.26:0/916427477 shutdown_connections 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 --2- 172.21.15.26:0/916427477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c153f00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 --2- 172.21.15.26:0/916427477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c14fcf0 0x7f0f0c1567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- 172.21.15.26:0/916427477 >> 172.21.15.26:0/916427477 conn(0x7f0f0c06a5a0 msgr2=0x7f0f0c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- 172.21.15.26:0/916427477 shutdown_connections 2023-11-28T16:59:22.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- 172.21.15.26:0/916427477 wait complete. 2023-11-28T16:59:22.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 Processor -- start 2023-11-28T16:59:22.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- start start 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c14fcf0 0x7f0f0c0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c1500d0 0x7f0f0c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1ed820 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0a9f40 con 0x7f0f0c0a7330 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f138dd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0aa220 con 0x7f0f0c1500d0 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f10e78640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c14fcf0 0x7f0f0c0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f10e78640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c14fcf0 0x7f0f0c0c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49092/0 (socket says 172.21.15.26:49092) 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.652+0000 7f0f10e78640 1 -- 172.21.15.26:0/750448123 learned_addr learned my addr 172.21.15.26:0/750448123 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:22.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f11e7a640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c1500d0 0x7f0f0c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f10e78640 1 -- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c1500d0 msgr2=0x7f0f0c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f10e78640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c1500d0 0x7f0f0c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f10e78640 1 -- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f0c0a7330 msgr2=0x7f0f0c14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f11679640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f10e78640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c14e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f10e78640 1 -- 172.21.15.26:0/750448123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04009a70 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f11e7a640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c1500d0 0x7f0f0c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f11679640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f10e78640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c14fcf0 0x7f0f0c0c76a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c500 tx=0x7f0efc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f01ffb640 1 -- 172.21.15.26:0/750448123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc007500 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f01ffb640 1 -- 172.21.15.26:0/750448123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc007660 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f01ffb640 1 -- 172.21.15.26:0/750448123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0059b0 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c0aa500 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c14e6a0 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c04e890 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f01ffb640 1 -- 172.21.15.26:0/750448123 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0efc005b10 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.656+0000 7f0f01ffb640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0ef0066900 0x7f0ef0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.660+0000 7f0f01ffb640 1 -- 172.21.15.26:0/750448123 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0efc083c30 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.660+0000 7f0f11679640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0ef0066900 0x7f0ef0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.660+0000 7f0f11679640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0ef0066900 0x7f0ef0068dc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009840 tx=0x7f0f08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:22.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.660+0000 7f0f01ffb640 1 -- 172.21.15.26:0/750448123 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0efc050bb0 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.816+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f0c06c030 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f01ffb640 1 -- 172.21.15.26:0/750448123 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0efc017070 con 0x7f0f0c14fcf0 2023-11-28T16:59:22.822 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0ef0066900 msgr2=0x7f0ef0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0ef0066900 0x7f0ef0068dc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009840 tx=0x7f0f08008040 comp rx=0 tx=0).stop 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c14fcf0 msgr2=0x7f0f0c0c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c14fcf0 0x7f0f0c0c76a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c500 tx=0x7f0efc00c9c0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 shutdown_connections 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0ef0066900 0x7f0ef0068dc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f0c1500d0 0x7f0f0c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0c14fcf0 0x7f0f0c0c76a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 --2- 172.21.15.26:0/750448123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f0c0a7330 0x7f0f0c14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 >> 172.21.15.26:0/750448123 conn(0x7f0f0c06a5a0 msgr2=0x7f0f0c155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:22.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 shutdown_connections 2023-11-28T16:59:22.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.820+0000 7f0f138dd640 1 -- 172.21.15.26:0/750448123 wait complete. 2023-11-28T16:59:22.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:59:22.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.984+0000 7f2a0f89c640 1 Processor -- start 2023-11-28T16:59:22.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.984+0000 7f2a0f89c640 1 -- start start 2023-11-28T16:59:22.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0f89c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a081561d0 0x7f2a080701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0f89c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a08070760 0x7f2a0806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0f89c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a08071020 con 0x7f2a0806df20 2023-11-28T16:59:22.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0f89c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a08071300 con 0x7f2a081561d0 2023-11-28T16:59:22.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0f89c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080715e0 con 0x7f2a08070760 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0ce37640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a08070760 0x7f2a0806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0ce37640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a08070760 0x7f2a0806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:33730/0 (socket says 172.21.15.26:33730) 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0ce37640 1 -- 172.21.15.26:0/1609274997 learned_addr learned my addr 172.21.15.26:0/1609274997 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0d638640 1 --2- 172.21.15.26:0/1609274997 >> v2:172.21.15.79:3300/0 conn(0x7f2a081561d0 0x7f2a080701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0ce37640 1 -- 172.21.15.26:0/1609274997 >> v2:172.21.15.79:3300/0 conn(0x7f2a081561d0 msgr2=0x7f2a080701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f29fffff640 1 -- 172.21.15.26:0/1609274997 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353963800 0 0) 0x7f2a08071020 con 0x7f2a0806df20 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0ce37640 1 --2- 172.21.15.26:0/1609274997 >> v2:172.21.15.79:3300/0 conn(0x7f2a081561d0 0x7f2a080701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0ce37640 1 -- 172.21.15.26:0/1609274997 >> v1:172.21.15.79:6789/0 conn(0x7f2a0806df20 legacy=0x7f2a08158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.988+0000 7f2a0ce37640 1 -- 172.21.15.26:0/1609274997 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080718c0 con 0x7f2a08070760 2023-11-28T16:59:22.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0ce37640 1 --2- 172.21.15.26:0/1609274997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a08070760 0x7f2a0806d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009870 tx=0x7f29f801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b27ab70c633d62d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:22.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f29fffff640 1 -- 172.21.15.26:0/1609274997 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80ab600 con 0x7f2a08070760 2023-11-28T16:59:22.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f29fffff640 1 -- 172.21.15.26:0/1609274997 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f80a7050 con 0x7f2a08070760 2023-11-28T16:59:22.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f29fffff640 1 -- 172.21.15.26:0/1609274997 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80ab980 con 0x7f2a08070760 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 -- 172.21.15.26:0/1609274997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a08070760 msgr2=0x7f2a0806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/1609274997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a08070760 0x7f2a0806d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009870 tx=0x7f29f801c4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 -- 172.21.15.26:0/1609274997 shutdown_connections 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/1609274997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a08070760 0x7f2a0806d9e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/1609274997 >> v2:172.21.15.79:3300/0 conn(0x7f2a081561d0 0x7f2a080701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 -- 172.21.15.26:0/1609274997 >> 172.21.15.26:0/1609274997 conn(0x7f2a080c2a60 msgr2=0x7f2a080c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 -- 172.21.15.26:0/1609274997 shutdown_connections 2023-11-28T16:59:22.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 -- 172.21.15.26:0/1609274997 wait complete. 2023-11-28T16:59:22.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.992+0000 7f2a0f89c640 1 Processor -- start 2023-11-28T16:59:22.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 -- start start 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a0806df20 0x7f2a081492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08070760 0x7f2a081514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a081561d0 0x7f2a0815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815a5a0 con 0x7f2a081561d0 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081f16f0 con 0x7f2a08070760 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08159f50 con 0x7f2a0806df20 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a0806df20 0x7f2a081492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a0806df20 0x7f2a081492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:33734/0 (socket says 172.21.15.26:33734) 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 -- 172.21.15.26:0/209133753 learned_addr learned my addr 172.21.15.26:0/209133753 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0de39640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a081561d0 0x7f2a0815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:22.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0ce37640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08070760 0x7f2a081514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 -- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08070760 msgr2=0x7f2a081514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08070760 0x7f2a081514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 -- 172.21.15.26:0/209133753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a081561d0 msgr2=0x7f2a0815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a081561d0 0x7f2a0815aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 -- 172.21.15.26:0/209133753 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80094d0 con 0x7f2a0806df20 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0d638640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a0806df20 0x7f2a081492b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400e930 tx=0x7f2a0400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f29fdffb640 1 -- 172.21.15.26:0/209133753 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04009690 con 0x7f2a0806df20 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f29fdffb640 1 -- 172.21.15.26:0/209133753 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0400ca00 con 0x7f2a0806df20 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f29fdffb640 1 -- 172.21.15.26:0/209133753 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0400cd70 con 0x7f2a0806df20 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0815a230 con 0x7f2a0806df20 2023-11-28T16:59:23.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a081497f0 con 0x7f2a0806df20 2023-11-28T16:59:23.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:22.996+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a080c07e0 con 0x7f2a0806df20 2023-11-28T16:59:23.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.000+0000 7f29fdffb640 1 -- 172.21.15.26:0/209133753 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2a040059a0 con 0x7f2a0806df20 2023-11-28T16:59:23.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.000+0000 7f29fdffb640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29ec0668d0 0x7f29ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.000+0000 7f29fdffb640 1 -- 172.21.15.26:0/209133753 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2a040849a0 con 0x7f2a0806df20 2023-11-28T16:59:23.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.000+0000 7f2a0ce37640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29ec0668d0 0x7f29ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.000+0000 7f2a0ce37640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29ec0668d0 0x7f29ec068d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f29f80ad000 tx=0x7f29f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.004+0000 7f29fdffb640 1 -- 172.21.15.26:0/209133753 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a040519d0 con 0x7f2a0806df20 2023-11-28T16:59:23.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.160+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2a0815a090 con 0x7f2a0806df20 2023-11-28T16:59:23.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.160+0000 7f29fdffb640 1 -- 172.21.15.26:0/209133753 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2a0815a090 con 0x7f2a0806df20 2023-11-28T16:59:23.164 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29ec0668d0 msgr2=0x7f29ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29ec0668d0 0x7f29ec068d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f29f80ad000 tx=0x7f29f8008040 comp rx=0 tx=0).stop 2023-11-28T16:59:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a0806df20 msgr2=0x7f2a081492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a0806df20 0x7f2a081492b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400e930 tx=0x7f2a0400edf0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 shutdown_connections 2023-11-28T16:59:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a081561d0 0x7f2a0815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08070760 0x7f2a081514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f29ec0668d0 0x7f29ec068d90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 --2- 172.21.15.26:0/209133753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a0806df20 0x7f2a081492b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 >> 172.21.15.26:0/209133753 conn(0x7f2a080c2a60 msgr2=0x7f2a080c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 shutdown_connections 2023-11-28T16:59:23.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.164+0000 7f2a0f89c640 1 -- 172.21.15.26:0/209133753 wait complete. 2023-11-28T16:59:23.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:59:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.324+0000 7f519c980640 1 Processor -- start 2023-11-28T16:59:23.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.324+0000 7f519c980640 1 -- start start 2023-11-28T16:59:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f519c980640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5198070b80 0x7f5198151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f519c980640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51980a8470 0x7f519806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f519c980640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519806d320 con 0x7f519814e9d0 2023-11-28T16:59:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f519c980640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980721b0 con 0x7f51980a8470 2023-11-28T16:59:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f519c980640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980c2830 con 0x7f5198070b80 2023-11-28T16:59:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51980a8470 0x7f519806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51980a8470 0x7f519806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49120/0 (socket says 172.21.15.26:49120) 2023-11-28T16:59:23.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 -- 172.21.15.26:0/1068758771 learned_addr learned my addr 172.21.15.26:0/1068758771 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:23.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f518ffff640 1 --2- 172.21.15.26:0/1068758771 >> v2:172.21.15.79:3300/0 conn(0x7f5198070b80 0x7f5198151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 -- 172.21.15.26:0/1068758771 >> v2:172.21.15.79:3300/0 conn(0x7f5198070b80 msgr2=0x7f5198151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:23.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 --2- 172.21.15.26:0/1068758771 >> v2:172.21.15.79:3300/0 conn(0x7f5198070b80 0x7f5198151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 -- 172.21.15.26:0/1068758771 >> v1:172.21.15.79:6789/0 conn(0x7f519814e9d0 legacy=0x7f51980c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:23.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 -- 172.21.15.26:0/1068758771 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198072450 con 0x7f51980a8470 2023-11-28T16:59:23.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f518ffff640 1 --2- 172.21.15.26:0/1068758771 >> v2:172.21.15.79:3300/0 conn(0x7f5198070b80 0x7f5198151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:23.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.328+0000 7f5196d9d640 1 --2- 172.21.15.26:0/1068758771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51980a8470 0x7f519806d7b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f519806e420 tx=0x7f519001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff3871f7a8ae217 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f5195d9b640 1 -- 172.21.15.26:0/1068758771 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900a56d0 con 0x7f51980a8470 2023-11-28T16:59:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f5195d9b640 1 -- 172.21.15.26:0/1068758771 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51900a5830 con 0x7f51980a8470 2023-11-28T16:59:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f5195d9b640 1 -- 172.21.15.26:0/1068758771 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900a5bc0 con 0x7f51980a8470 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- 172.21.15.26:0/1068758771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51980a8470 msgr2=0x7f519806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 --2- 172.21.15.26:0/1068758771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51980a8470 0x7f519806d7b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f519806e420 tx=0x7f519001c900 comp rx=0 tx=0).stop 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- 172.21.15.26:0/1068758771 shutdown_connections 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 --2- 172.21.15.26:0/1068758771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51980a8470 0x7f519806d7b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 --2- 172.21.15.26:0/1068758771 >> v2:172.21.15.79:3300/0 conn(0x7f5198070b80 0x7f5198151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- 172.21.15.26:0/1068758771 >> 172.21.15.26:0/1068758771 conn(0x7f51980c2ad0 msgr2=0x7f51980c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- 172.21.15.26:0/1068758771 shutdown_connections 2023-11-28T16:59:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- 172.21.15.26:0/1068758771 wait complete. 2023-11-28T16:59:23.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 Processor -- start 2023-11-28T16:59:23.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- start start 2023-11-28T16:59:23.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5198070b80 0x7f5198143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51980a8470 0x7f519814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519814e9d0 0x7f519814b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51981f1990 con 0x7f519814e9d0 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980aad20 con 0x7f5198070b80 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f519c980640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51980abec0 con 0x7f51980a8470 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.332+0000 7f5196d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519814e9d0 0x7f519814b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519814e9d0 0x7f519814b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49132/0 (socket says 172.21.15.26:49132) 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 -- 172.21.15.26:0/1572379203 learned_addr learned my addr 172.21.15.26:0/1572379203 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f518ffff640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51980a8470 0x7f519814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f519659c640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5198070b80 0x7f5198143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 -- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51980a8470 msgr2=0x7f519814afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51980a8470 0x7f519814afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 -- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5198070b80 msgr2=0x7f5198143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5198070b80 0x7f5198143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 -- 172.21.15.26:0/1572379203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190009b30 con 0x7f519814e9d0 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f5196d9d640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519814e9d0 0x7f519814b4f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51900af040 tx=0x7f51900196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f518effd640 1 -- 172.21.15.26:0/1572379203 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900b8670 con 0x7f519814e9d0 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f518effd640 1 -- 172.21.15.26:0/1572379203 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51900b87d0 con 0x7f519814e9d0 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51980ab900 con 0x7f519814e9d0 2023-11-28T16:59:23.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f518effd640 1 -- 172.21.15.26:0/1572379203 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900b8b40 con 0x7f519814e9d0 2023-11-28T16:59:23.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51980a9ef0 con 0x7f519814e9d0 2023-11-28T16:59:23.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51980aaed0 con 0x7f519814e9d0 2023-11-28T16:59:23.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.336+0000 7f518effd640 1 -- 172.21.15.26:0/1572379203 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f51900b8ca0 con 0x7f519814e9d0 2023-11-28T16:59:23.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.340+0000 7f518effd640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5178066900 0x7f5178068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.340+0000 7f518effd640 1 -- 172.21.15.26:0/1572379203 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f519011f820 con 0x7f519814e9d0 2023-11-28T16:59:23.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.340+0000 7f519659c640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5178066900 0x7f5178068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.340+0000 7f519659c640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5178066900 0x7f5178068dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f51980c0760 tx=0x7f5188009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.344+0000 7f518effd640 1 -- 172.21.15.26:0/1572379203 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51980aaed0 con 0x7f519814e9d0 2023-11-28T16:59:23.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.512+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f51980aae90 con 0x7f519814e9d0 2023-11-28T16:59:23.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.512+0000 7f518effd640 1 -- 172.21.15.26:0/1572379203 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f51900ec840 con 0x7f519814e9d0 2023-11-28T16:59:23.516 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:59:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5178066900 msgr2=0x7f5178068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5178066900 0x7f5178068dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f51980c0760 tx=0x7f5188009060 comp rx=0 tx=0).stop 2023-11-28T16:59:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519814e9d0 msgr2=0x7f519814b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519814e9d0 0x7f519814b4f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51900af040 tx=0x7f51900196a0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 shutdown_connections 2023-11-28T16:59:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519814e9d0 0x7f519814b4f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f5178066900 0x7f5178068dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51980a8470 0x7f519814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 --2- 172.21.15.26:0/1572379203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5198070b80 0x7f5198143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 >> 172.21.15.26:0/1572379203 conn(0x7f51980c2ad0 msgr2=0x7f51980702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 shutdown_connections 2023-11-28T16:59:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.516+0000 7f519c980640 1 -- 172.21.15.26:0/1572379203 wait complete. 2023-11-28T16:59:23.537 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T16:59:23.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:23.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:23.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:59:23.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:23.589 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T16:59:23.643 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:23.643 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:23.694 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:59:23.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:59:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe36355640 1 Processor -- start 2023-11-28T16:59:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe36355640 1 -- start start 2023-11-28T16:59:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe36355640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe30152ce0 0x7efe3006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe36355640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3006d100 0x7efe300c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe36355640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3006bea0 con 0x7efe3006db80 2023-11-28T16:59:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe36355640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe30159b10 con 0x7efe3006d100 2023-11-28T16:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe36355640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe30159550 con 0x7efe30152ce0 2023-11-28T16:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe348f2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3006d100 0x7efe300c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe348f2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3006d100 0x7efe300c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49134/0 (socket says 172.21.15.26:49134) 2023-11-28T16:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe348f2640 1 -- 172.21.15.26:0/542858043 learned_addr learned my addr 172.21.15.26:0/542858043 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.876+0000 7efe2ffff640 1 --2- 172.21.15.26:0/542858043 >> v2:172.21.15.79:3300/0 conn(0x7efe30152ce0 0x7efe3006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe348f2640 1 -- 172.21.15.26:0/542858043 >> v2:172.21.15.79:3300/0 conn(0x7efe30152ce0 msgr2=0x7efe3006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe348f2640 1 --2- 172.21.15.26:0/542858043 >> v2:172.21.15.79:3300/0 conn(0x7efe30152ce0 0x7efe3006c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe348f2640 1 -- 172.21.15.26:0/542858043 >> v1:172.21.15.79:6789/0 conn(0x7efe3006db80 legacy=0x7efe300700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe348f2640 1 -- 172.21.15.26:0/542858043 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30159830 con 0x7efe3006d100 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe348f2640 1 --2- 172.21.15.26:0/542858043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe300c19e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efe300c2800 tx=0x7efe2801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850a432635562efe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe2effd640 1 -- 172.21.15.26:0/542858043 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280a5800 con 0x7efe3006d100 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe2effd640 1 -- 172.21.15.26:0/542858043 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280a5960 con 0x7efe3006d100 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe2effd640 1 -- 172.21.15.26:0/542858043 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280a5cf0 con 0x7efe3006d100 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 -- 172.21.15.26:0/542858043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 msgr2=0x7efe300c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 --2- 172.21.15.26:0/542858043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe300c19e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efe300c2800 tx=0x7efe2801c940 comp rx=0 tx=0).stop 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 -- 172.21.15.26:0/542858043 shutdown_connections 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 --2- 172.21.15.26:0/542858043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe300c19e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 --2- 172.21.15.26:0/542858043 >> v2:172.21.15.79:3300/0 conn(0x7efe30152ce0 0x7efe3006c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 -- 172.21.15.26:0/542858043 >> 172.21.15.26:0/542858043 conn(0x7efe300c2ad0 msgr2=0x7efe300c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 -- 172.21.15.26:0/542858043 shutdown_connections 2023-11-28T16:59:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.880+0000 7efe36355640 1 -- 172.21.15.26:0/542858043 wait complete. 2023-11-28T16:59:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 Processor -- start 2023-11-28T16:59:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 -- start start 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe301457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe3006db80 0x7efe30157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe30152ce0 0x7efe30157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe301f4e30 con 0x7efe3006d100 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe301f1540 con 0x7efe3006db80 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe36355640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe30146330 con 0x7efe30152ce0 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe301457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe301457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49136/0 (socket says 172.21.15.26:49136) 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 -- 172.21.15.26:0/4098914262 learned_addr learned my addr 172.21.15.26:0/4098914262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2f7fe640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe3006db80 0x7efe30157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe348f2640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe30152ce0 0x7efe30157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 -- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe30152ce0 msgr2=0x7efe30157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe30152ce0 0x7efe30157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 -- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe3006db80 msgr2=0x7efe30157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe3006db80 0x7efe30157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 -- 172.21.15.26:0/4098914262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009b30 con 0x7efe3006d100 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe348f2640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe30152ce0 0x7efe30157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2ffff640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe301457a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7efe2000d800 tx=0x7efe2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2cff9640 1 -- 172.21.15.26:0/4098914262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000b6c0 con 0x7efe3006d100 2023-11-28T16:59:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2cff9640 1 -- 172.21.15.26:0/4098914262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2000b820 con 0x7efe3006d100 2023-11-28T16:59:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.884+0000 7efe2cff9640 1 -- 172.21.15.26:0/4098914262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000bb90 con 0x7efe3006d100 2023-11-28T16:59:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.888+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe301f4b50 con 0x7efe3006d100 2023-11-28T16:59:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.888+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe301f1a30 con 0x7efe3006d100 2023-11-28T16:59:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.888+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3004e890 con 0x7efe3006d100 2023-11-28T16:59:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.888+0000 7efe2cff9640 1 -- 172.21.15.26:0/4098914262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efe2000bcf0 con 0x7efe3006d100 2023-11-28T16:59:23.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.888+0000 7efe2cff9640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe1c0668d0 0x7efe1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:23.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.888+0000 7efe2cff9640 1 -- 172.21.15.26:0/4098914262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efe20084cd0 con 0x7efe3006d100 2023-11-28T16:59:23.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.888+0000 7efe2f7fe640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe1c0668d0 0x7efe1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:23.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.892+0000 7efe2f7fe640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe1c0668d0 0x7efe1c068d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efe300c5cf0 tx=0x7efe24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:23.892+0000 7efe2cff9640 1 -- 172.21.15.26:0/4098914262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe20051ba0 con 0x7efe3006d100 2023-11-28T16:59:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe3015cef0 con 0x7efe3006d100 2023-11-28T16:59:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe2cff9640 1 -- 172.21.15.26:0/4098914262 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7efe200551c0 con 0x7efe3006d100 2023-11-28T16:59:24.091 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:59:24.091 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T16:59:24.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe1c0668d0 msgr2=0x7efe1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe1c0668d0 0x7efe1c068d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efe300c5cf0 tx=0x7efe24009040 comp rx=0 tx=0).stop 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 msgr2=0x7efe301457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe301457a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7efe2000d800 tx=0x7efe2000dcc0 comp rx=0 tx=0).stop 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 shutdown_connections 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe1c0668d0 0x7efe1c068d90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe30152ce0 0x7efe30157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe3006db80 0x7efe30157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 --2- 172.21.15.26:0/4098914262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3006d100 0x7efe301457a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 >> 172.21.15.26:0/4098914262 conn(0x7efe300c2ad0 msgr2=0x7efe30151420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 shutdown_connections 2023-11-28T16:59:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:24.088+0000 7efe36355640 1 -- 172.21.15.26:0/4098914262 wait complete. 2023-11-28T16:59:24.111 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T16:59:24.112 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:59:24.112 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-11-28T16:59:24.112 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T16:59:24.112 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:24.112 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T16:59:24.112 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:59:24.112 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.6SLZ3p1dck 2023-11-28T16:59:24.112 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-11-28T16:59:24.121 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.zjrOBEMI0G 2023-11-28T16:59:24.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /tmp/tmp.6SLZ3p1dck /tmp/tmp.zjrOBEMI0G 2023-11-28T16:59:24.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.zjrOBEMI0G 2023-11-28T16:59:24.315 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.zjrOBEMI0G is 226B 2023-11-28T16:59:24.331 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.zjrOBEMI0G 2023-11-28T16:59:24.340 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T16:59:24.340 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:59:24.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.340 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-11-28T16:59:24.390 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:59:24.390 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:59:24.390 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-11-28T16:59:24.391 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42211sec preferred_lft 42211sec 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:1b:cd:da:6f brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:24.392 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:59:24.393 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:24.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.395 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:59:24.457 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-11-28T16:59:24.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.459 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-11-28T16:59:24.511 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-11-28T16:59:24.511 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:59:24.511 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T16:59:24.511 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:59:24.511 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T16:59:24.512 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:59:24.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.512 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-11-28T16:59:24.512 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-11-28T16:59:24.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T16:59:24.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T16:59:24.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T16:59:24.512 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-11-28T16:59:24.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.605 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:59:24.616 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T16:59:24.616 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:59:24.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.616 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-11-28T16:59:24.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:24.678 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:24.730 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T16:59:24.730 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:24.730 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:24.781 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:24.781 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/tmp/tmp.6SLZ3p1dck of=/dev/stdout 2023-11-28T16:59:24.834 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-11-28T16:59:24.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:24.930 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,secret=AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:24.930 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:24.930 INFO:teuthology.orchestra.run.smithi026.stdout:keyring.get_secret failed 2023-11-28T16:59:24.944 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,secret=AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:24.944 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:24.944 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:59:24.945 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: testuser@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs=/ 2023-11-28T16:59:24.945 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:59:24.948 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:59:24.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.949 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-11-28T16:59:24.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:59:24.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:24.970 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:59:25.030 INFO:teuthology.orchestra.run.smithi026.stdout:client6682 2023-11-28T16:59:25.030 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:25.030 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:25.082 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-11-28T16:59:25.092 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.aduOWAs9dQ 2023-11-28T16:59:25.092 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:25.092 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/tmp/tmp.aduOWAs9dQ 2023-11-28T16:59:25.143 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:25.143 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:25.197 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:25.197 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:25.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc3c32640 1 Processor -- start 2023-11-28T16:59:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc3c32640 1 -- start start 2023-11-28T16:59:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc3c32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fbc152ce0 0x7f9fbc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc3c32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fbc06d100 0x7f9fbc0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc3c32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc06bea0 con 0x7f9fbc06db80 2023-11-28T16:59:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc3c32640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc159b10 con 0x7f9fbc152ce0 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc3c32640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc159550 con 0x7f9fbc06d100 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc19ce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fbc152ce0 0x7f9fbc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc19ce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fbc152ce0 0x7f9fbc06c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49152/0 (socket says 172.21.15.26:49152) 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc19ce640 1 -- 172.21.15.26:0/2364895057 learned_addr learned my addr 172.21.15.26:0/2364895057 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc21cf640 1 --2- 172.21.15.26:0/2364895057 >> v2:172.21.15.79:3300/0 conn(0x7f9fbc06d100 0x7f9fbc0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc19ce640 1 -- 172.21.15.26:0/2364895057 >> v2:172.21.15.79:3300/0 conn(0x7f9fbc06d100 msgr2=0x7f9fbc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc19ce640 1 --2- 172.21.15.26:0/2364895057 >> v2:172.21.15.79:3300/0 conn(0x7f9fbc06d100 0x7f9fbc0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc19ce640 1 -- 172.21.15.26:0/2364895057 >> v1:172.21.15.79:6789/0 conn(0x7f9fbc06db80 legacy=0x7f9fbc0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.388+0000 7f9fc19ce640 1 -- 172.21.15.26:0/2364895057 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc159830 con 0x7f9fbc152ce0 2023-11-28T16:59:25.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc19ce640 1 --2- 172.21.15.26:0/2364895057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc152ce0 0x7f9fbc06c940 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc070030 tx=0x7f9fb801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bb59039eb52b69 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc09cc640 1 -- 172.21.15.26:0/2364895057 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a7070 con 0x7f9fbc152ce0 2023-11-28T16:59:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc09cc640 1 -- 172.21.15.26:0/2364895057 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb80ab430 con 0x7f9fbc152ce0 2023-11-28T16:59:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc09cc640 1 -- 172.21.15.26:0/2364895057 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80ab7c0 con 0x7f9fbc152ce0 2023-11-28T16:59:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 -- 172.21.15.26:0/2364895057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc152ce0 msgr2=0x7f9fbc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/2364895057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc152ce0 0x7f9fbc06c940 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc070030 tx=0x7f9fb801c430 comp rx=0 tx=0).stop 2023-11-28T16:59:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 -- 172.21.15.26:0/2364895057 shutdown_connections 2023-11-28T16:59:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/2364895057 >> v2:172.21.15.79:3300/0 conn(0x7f9fbc06d100 0x7f9fbc0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/2364895057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc152ce0 0x7f9fbc06c940 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 -- 172.21.15.26:0/2364895057 >> 172.21.15.26:0/2364895057 conn(0x7f9fbc0c2ad0 msgr2=0x7f9fbc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 -- 172.21.15.26:0/2364895057 shutdown_connections 2023-11-28T16:59:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.392+0000 7f9fc3c32640 1 -- 172.21.15.26:0/2364895057 wait complete. 2023-11-28T16:59:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 Processor -- start 2023-11-28T16:59:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 -- start start 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fbc06d100 0x7f9fbc155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc06db80 0x7f9fbc1f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fbc152ce0 0x7f9fbc15af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc155870 con 0x7f9fbc06db80 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc1554d0 con 0x7f9fbc06d100 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc153460 con 0x7f9fbc152ce0 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc06db80 0x7f9fbc1f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc19ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fbc06d100 0x7f9fbc155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc06db80 0x7f9fbc1f4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49158/0 (socket says 172.21.15.26:49158) 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 -- 172.21.15.26:0/4178730981 learned_addr learned my addr 172.21.15.26:0/4178730981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc21cf640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fbc152ce0 0x7f9fbc15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 -- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fbc152ce0 msgr2=0x7f9fbc15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fbc152ce0 0x7f9fbc15af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 -- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fbc06d100 msgr2=0x7f9fbc155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fbc06d100 0x7f9fbc155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 -- 172.21.15.26:0/4178730981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80094d0 con 0x7f9fbc06db80 2023-11-28T16:59:25.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc21cf640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fbc152ce0 0x7f9fbc15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:25.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc11cd640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc06db80 0x7f9fbc1f4fd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c410 tx=0x7f9fac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fb27fc640 1 -- 172.21.15.26:0/4178730981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011790 con 0x7f9fbc06db80 2023-11-28T16:59:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fb27fc640 1 -- 172.21.15.26:0/4178730981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac0118f0 con 0x7f9fbc06db80 2023-11-28T16:59:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fb27fc640 1 -- 172.21.15.26:0/4178730981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011ce0 con 0x7f9fbc06db80 2023-11-28T16:59:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.396+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc1f5920 con 0x7f9fbc06db80 2023-11-28T16:59:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.400+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc149c50 con 0x7f9fbc06db80 2023-11-28T16:59:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.400+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc04e890 con 0x7f9fbc06db80 2023-11-28T16:59:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.400+0000 7f9fb27fc640 1 -- 172.21.15.26:0/4178730981 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9fac01c460 con 0x7f9fbc06db80 2023-11-28T16:59:25.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.400+0000 7f9fb27fc640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9fa00668d0 0x7f9fa0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.400+0000 7f9fb27fc640 1 -- 172.21.15.26:0/4178730981 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9fac084450 con 0x7f9fbc06db80 2023-11-28T16:59:25.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.400+0000 7f9fc19ce640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9fa00668d0 0x7f9fa0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.404+0000 7f9fc19ce640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9fa00668d0 0x7f9fa0068d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80af000 tx=0x7f9fb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:25.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.404+0000 7f9fb27fc640 1 -- 172.21.15.26:0/4178730981 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fac051320 con 0x7f9fbc06db80 2023-11-28T16:59:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.564+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fbc06cee0 con 0x7f9fbc06db80 2023-11-28T16:59:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.564+0000 7f9fb27fc640 1 -- 172.21.15.26:0/4178730981 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7f9fac054940 con 0x7f9fbc06db80 2023-11-28T16:59:25.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:25.568 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9fa00668d0 msgr2=0x7f9fa0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9fa00668d0 0x7f9fa0068d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80af000 tx=0x7f9fb8008040 comp rx=0 tx=0).stop 2023-11-28T16:59:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc06db80 msgr2=0x7f9fbc1f4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc06db80 0x7f9fbc1f4fd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c410 tx=0x7f9fac00c8d0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 shutdown_connections 2023-11-28T16:59:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f9fa00668d0 0x7f9fa0068d90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fbc152ce0 0x7f9fbc15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc06db80 0x7f9fbc1f4fd0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 --2- 172.21.15.26:0/4178730981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fbc06d100 0x7f9fbc155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 >> 172.21.15.26:0/4178730981 conn(0x7f9fbc0c2ad0 msgr2=0x7f9fbc14c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:25.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 shutdown_connections 2023-11-28T16:59:25.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.568+0000 7f9fc3c32640 1 -- 172.21.15.26:0/4178730981 wait complete. 2023-11-28T16:59:25.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:58:55.413723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:58:56.230719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:59:08.379611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:59:09.728280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:25.590 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:25.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.732+0000 7facef11d640 1 Processor -- start 2023-11-28T16:59:25.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.732+0000 7facef11d640 1 -- start start 2023-11-28T16:59:25.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.732+0000 7facef11d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7face8151d80 0x7face80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.732+0000 7facef11d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face806cf70 con 0x7face80c8430 2023-11-28T16:59:25.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.732+0000 7facef11d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face8152160 con 0x7face80c7f20 2023-11-28T16:59:25.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.732+0000 7facef11d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80c6a30 con 0x7face8151d80 2023-11-28T16:59:25.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7faceceb9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7face8151d80 0x7face80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7face7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7face80c8430 0x7face806b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53136/0 (socket says 172.21.15.26:53136) 2023-11-28T16:59:25.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7face7fff640 1 -- 172.21.15.26:0/1824534437 learned_addr learned my addr 172.21.15.26:0/1824534437 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:25.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7faceceb9640 1 -- 172.21.15.26:0/1824534437 >> v1:172.21.15.79:6789/0 conn(0x7face80c7f20 legacy=0x7face806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7faceceb9640 1 -- 172.21.15.26:0/1824534437 >> v1:172.21.15.26:6789/0 conn(0x7face80c8430 legacy=0x7face806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7faceceb9640 1 -- 172.21.15.26:0/1824534437 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80c72d0 con 0x7face8151d80 2023-11-28T16:59:25.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7face77fe640 1 -- 172.21.15.26:0/1824534437 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858366726 0 0) 0x7face806cf70 con 0x7face80c8430 2023-11-28T16:59:25.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7faceceb9640 1 --2- 172.21.15.26:0/1824534437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face8151d80 0x7face80c49a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7facdc0097c0 tx=0x7facdc01c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f767dcfdadec58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:25.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7face77fe640 1 -- 172.21.15.26:0/1824534437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0ab600 con 0x7face8151d80 2023-11-28T16:59:25.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7face77fe640 1 -- 172.21.15.26:0/1824534437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc0a7050 con 0x7face8151d80 2023-11-28T16:59:25.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.736+0000 7face77fe640 1 -- 172.21.15.26:0/1824534437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0ab980 con 0x7face8151d80 2023-11-28T16:59:25.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- 172.21.15.26:0/1824534437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face8151d80 msgr2=0x7face80c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 --2- 172.21.15.26:0/1824534437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face8151d80 0x7face80c49a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7facdc0097c0 tx=0x7facdc01c2f0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- 172.21.15.26:0/1824534437 shutdown_connections 2023-11-28T16:59:25.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 --2- 172.21.15.26:0/1824534437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face8151d80 0x7face80c49a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- 172.21.15.26:0/1824534437 >> 172.21.15.26:0/1824534437 conn(0x7face80abd00 msgr2=0x7face80ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:25.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- 172.21.15.26:0/1824534437 shutdown_connections 2023-11-28T16:59:25.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- 172.21.15.26:0/1824534437 wait complete. 2023-11-28T16:59:25.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 Processor -- start 2023-11-28T16:59:25.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- start start 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7face80c7f20 0x7face8158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80c8430 0x7face8158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7face8151d80 0x7face81ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face81f1400 con 0x7face80c8430 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face814bf90 con 0x7face8151d80 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7facef11d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80c1320 con 0x7face80c7f20 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80c8430 0x7face8158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80c8430 0x7face8158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49184/0 (socket says 172.21.15.26:49184) 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 -- 172.21.15.26:0/1747321575 learned_addr learned my addr 172.21.15.26:0/1747321575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7faceceb9640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7face80c7f20 0x7face8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7faced6ba640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7face8151d80 0x7face81ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 -- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7face80c7f20 msgr2=0x7face8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7face80c7f20 0x7face8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 -- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7face8151d80 msgr2=0x7face81ee300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7face8151d80 0x7face81ee300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 -- 172.21.15.26:0/1747321575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc009420 con 0x7face80c8430 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7faced6ba640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7face8151d80 0x7face81ee300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.740+0000 7face7fff640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80c8430 0x7face8158580 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7facd400c410 tx=0x7facd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:25.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7face57fa640 1 -- 172.21.15.26:0/1747321575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4005cf0 con 0x7face80c8430 2023-11-28T16:59:25.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7face57fa640 1 -- 172.21.15.26:0/1747321575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4005e50 con 0x7face80c8430 2023-11-28T16:59:25.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7face57fa640 1 -- 172.21.15.26:0/1747321575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4007310 con 0x7face80c8430 2023-11-28T16:59:25.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face81f0eb0 con 0x7face80c8430 2023-11-28T16:59:25.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face81f1120 con 0x7face80c8430 2023-11-28T16:59:25.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face804e890 con 0x7face80c8430 2023-11-28T16:59:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7face57fa640 1 -- 172.21.15.26:0/1747321575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7facd4007470 con 0x7face80c8430 2023-11-28T16:59:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7face57fa640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faccc0668d0 0x7faccc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7face57fa640 1 -- 172.21.15.26:0/1747321575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7facd4083e10 con 0x7face80c8430 2023-11-28T16:59:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.744+0000 7faceceb9640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faccc0668d0 0x7faccc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.748+0000 7faceceb9640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faccc0668d0 0x7faccc068d90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7facdc0ad000 tx=0x7facdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:25.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.748+0000 7face57fa640 1 -- 172.21.15.26:0/1747321575 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facd4087030 con 0x7face80c8430 2023-11-28T16:59:25.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.904+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7face80c10d0 con 0x7face80c8430 2023-11-28T16:59:25.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7face57fa640 1 -- 172.21.15.26:0/1747321575 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7facd40170a0 con 0x7face80c8430 2023-11-28T16:59:25.910 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:25.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faccc0668d0 msgr2=0x7faccc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faccc0668d0 0x7faccc068d90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7facdc0ad000 tx=0x7facdc008040 comp rx=0 tx=0).stop 2023-11-28T16:59:25.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80c8430 msgr2=0x7face8158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:25.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80c8430 0x7face8158580 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7facd400c410 tx=0x7facd400c8d0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 shutdown_connections 2023-11-28T16:59:25.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7face8151d80 0x7face81ee300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80c8430 0x7face8158580 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faccc0668d0 0x7faccc068d90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 --2- 172.21.15.26:0/1747321575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7face80c7f20 0x7face8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:25.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 >> 172.21.15.26:0/1747321575 conn(0x7face80abd00 msgr2=0x7face80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:25.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 shutdown_connections 2023-11-28T16:59:25.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:25.908+0000 7facef11d640 1 -- 172.21.15.26:0/1747321575 wait complete. 2023-11-28T16:59:25.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:59:26.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.072+0000 7f901b6aa640 1 Processor -- start 2023-11-28T16:59:26.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.072+0000 7f901b6aa640 1 -- start start 2023-11-28T16:59:26.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f901b6aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90141561d0 0x7f90140701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f901b6aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9014070760 0x7f901406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f901b6aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9014071020 con 0x7f901406df20 2023-11-28T16:59:26.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f901b6aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9014071300 con 0x7f9014070760 2023-11-28T16:59:26.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f901b6aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140715e0 con 0x7f90141561d0 2023-11-28T16:59:26.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9019446640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90141561d0 0x7f90140701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9018c45640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9014070760 0x7f901406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9019446640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90141561d0 0x7f90140701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:33792/0 (socket says 172.21.15.26:33792) 2023-11-28T16:59:26.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9019446640 1 -- 172.21.15.26:0/3488732980 learned_addr learned my addr 172.21.15.26:0/3488732980 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:26.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9019446640 1 -- 172.21.15.26:0/3488732980 >> v2:172.21.15.79:3300/0 conn(0x7f9014070760 msgr2=0x7f901406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:26.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9019446640 1 --2- 172.21.15.26:0/3488732980 >> v2:172.21.15.79:3300/0 conn(0x7f9014070760 0x7f901406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9019446640 1 -- 172.21.15.26:0/3488732980 >> v1:172.21.15.79:6789/0 conn(0x7f901406df20 legacy=0x7f9014158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9019446640 1 -- 172.21.15.26:0/3488732980 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140718c0 con 0x7f90141561d0 2023-11-28T16:59:26.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.076+0000 7f9018c45640 1 --2- 172.21.15.26:0/3488732980 >> v2:172.21.15.79:3300/0 conn(0x7f9014070760 0x7f901406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:26.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f9019446640 1 --2- 172.21.15.26:0/3488732980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90141561d0 0x7f90140701f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9010009870 tx=0x7f901001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7da748aaecc3f15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f900bfff640 1 -- 172.21.15.26:0/3488732980 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab600 con 0x7f90141561d0 2023-11-28T16:59:26.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f900bfff640 1 -- 172.21.15.26:0/3488732980 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100a7050 con 0x7f90141561d0 2023-11-28T16:59:26.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f900bfff640 1 -- 172.21.15.26:0/3488732980 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab980 con 0x7f90141561d0 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 -- 172.21.15.26:0/3488732980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90141561d0 msgr2=0x7f90140701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 --2- 172.21.15.26:0/3488732980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90141561d0 0x7f90140701f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9010009870 tx=0x7f901001c4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 -- 172.21.15.26:0/3488732980 shutdown_connections 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 --2- 172.21.15.26:0/3488732980 >> v2:172.21.15.79:3300/0 conn(0x7f9014070760 0x7f901406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 --2- 172.21.15.26:0/3488732980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90141561d0 0x7f90140701f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 -- 172.21.15.26:0/3488732980 >> 172.21.15.26:0/3488732980 conn(0x7f90140c2a60 msgr2=0x7f90140c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 -- 172.21.15.26:0/3488732980 shutdown_connections 2023-11-28T16:59:26.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 -- 172.21.15.26:0/3488732980 wait complete. 2023-11-28T16:59:26.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 Processor -- start 2023-11-28T16:59:26.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.080+0000 7f901b6aa640 1 -- start start 2023-11-28T16:59:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901406df20 0x7f90140c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9014070760 0x7f901414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90141561d0 0x7f901414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90140ac050 con 0x7f901406df20 2023-11-28T16:59:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901414f4e0 con 0x7f90141561d0 2023-11-28T16:59:26.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901415cad0 con 0x7f9014070760 2023-11-28T16:59:26.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901406df20 0x7f90140c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901406df20 0x7f90140c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49188/0 (socket says 172.21.15.26:49188) 2023-11-28T16:59:26.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 -- 172.21.15.26:0/297474695 learned_addr learned my addr 172.21.15.26:0/297474695 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:26.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9018c45640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9014070760 0x7f901414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019c47640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90141561d0 0x7f901414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 -- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9014070760 msgr2=0x7f901414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9014070760 0x7f901414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 -- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90141561d0 msgr2=0x7f901414c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90141561d0 0x7f901414c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 -- 172.21.15.26:0/297474695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004009420 con 0x7f901406df20 2023-11-28T16:59:26.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9019446640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901406df20 0x7f90140c52f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f90100ae040 tx=0x7f901001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9009ffb640 1 -- 172.21.15.26:0/297474695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100b6420 con 0x7f901406df20 2023-11-28T16:59:26.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9009ffb640 1 -- 172.21.15.26:0/297474695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100b65a0 con 0x7f901406df20 2023-11-28T16:59:26.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90100094d0 con 0x7f901406df20 2023-11-28T16:59:26.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f9009ffb640 1 -- 172.21.15.26:0/297474695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100b6950 con 0x7f901406df20 2023-11-28T16:59:26.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901414cb00 con 0x7f901406df20 2023-11-28T16:59:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.084+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901415c8a0 con 0x7f901406df20 2023-11-28T16:59:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.088+0000 7f9009ffb640 1 -- 172.21.15.26:0/297474695 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f90100b2040 con 0x7f901406df20 2023-11-28T16:59:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.088+0000 7f9009ffb640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ff80668d0 0x7f8ff8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.088+0000 7f9009ffb640 1 -- 172.21.15.26:0/297474695 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f901011e9b0 con 0x7f901406df20 2023-11-28T16:59:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.088+0000 7f9018c45640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ff80668d0 0x7f8ff8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.088+0000 7f9018c45640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ff80668d0 0x7f8ff8068d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f901414f490 tx=0x7f9004009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.092+0000 7f9009ffb640 1 -- 172.21.15.26:0/297474695 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f901415c8a0 con 0x7f901406df20 2023-11-28T16:59:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.248+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f901415c8a0 con 0x7f901406df20 2023-11-28T16:59:26.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.248+0000 7f9009ffb640 1 -- 172.21.15.26:0/297474695 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f901415c8a0 con 0x7f901406df20 2023-11-28T16:59:26.253 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ff80668d0 msgr2=0x7f8ff8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ff80668d0 0x7f8ff8068d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f901414f490 tx=0x7f9004009190 comp rx=0 tx=0).stop 2023-11-28T16:59:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901406df20 msgr2=0x7f90140c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901406df20 0x7f90140c52f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f90100ae040 tx=0x7f901001acf0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 shutdown_connections 2023-11-28T16:59:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90141561d0 0x7f901414c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8ff80668d0 0x7f8ff8068d90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9014070760 0x7f901414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 --2- 172.21.15.26:0/297474695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f901406df20 0x7f90140c52f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 >> 172.21.15.26:0/297474695 conn(0x7f90140c2a60 msgr2=0x7f9014158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 shutdown_connections 2023-11-28T16:59:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.252+0000 7f901b6aa640 1 -- 172.21.15.26:0/297474695 wait complete. 2023-11-28T16:59:26.274 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:59:26.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 Processor -- start 2023-11-28T16:59:26.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 -- start start 2023-11-28T16:59:26.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2c8151d80 0x7ff2c80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2c80c8430 0x7ff2c806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c7f20 0x7ff2c806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c806cf70 con 0x7ff2c80c8430 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c8152160 con 0x7ff2c8151d80 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2d01aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80c6a30 con 0x7ff2c80c7f20 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2cd745640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2c80c8430 0x7ff2c806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2ce747640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c7f20 0x7ff2c806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2cdf46640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2c8151d80 0x7ff2c80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2ce747640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c7f20 0x7ff2c806bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:33808/0 (socket says 172.21.15.26:33808) 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2cd745640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2c80c8430 0x7ff2c806b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49202/0 (socket says 172.21.15.26:49202) 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2ce747640 1 -- 172.21.15.26:0/4229541265 learned_addr learned my addr 172.21.15.26:0/4229541265 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.420+0000 7ff2cdf46640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2c8151d80 0x7ff2c80c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.26:36730/0 (socket says 172.21.15.26:36730) 2023-11-28T16:59:26.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2cdf46640 1 -- 172.21.15.26:0/4229541265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c7f20 msgr2=0x7ff2c806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:26.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2cdf46640 1 --2- 172.21.15.26:0/4229541265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c7f20 0x7ff2c806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2cdf46640 1 -- 172.21.15.26:0/4229541265 >> v2:172.21.15.26:3300/0 conn(0x7ff2c80c8430 msgr2=0x7ff2c806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:26.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2cdf46640 1 --2- 172.21.15.26:0/4229541265 >> v2:172.21.15.26:3300/0 conn(0x7ff2c80c8430 0x7ff2c806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2cdf46640 1 -- 172.21.15.26:0/4229541265 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c80c72d0 con 0x7ff2c8151d80 2023-11-28T16:59:26.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2cdf46640 1 --2- 172.21.15.26:0/4229541265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c8151d80 0x7ff2c80c49a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff2c808b3e0 tx=0x7ff2c401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ac5d500b93430f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2ccf44640 1 -- 172.21.15.26:0/4229541265 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40ad660 con 0x7ff2c8151d80 2023-11-28T16:59:26.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2ccf44640 1 -- 172.21.15.26:0/4229541265 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c40ad7c0 con 0x7ff2c8151d80 2023-11-28T16:59:26.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.424+0000 7ff2ccf44640 1 -- 172.21.15.26:0/4229541265 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40adb50 con 0x7ff2c8151d80 2023-11-28T16:59:26.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- 172.21.15.26:0/4229541265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c8151d80 msgr2=0x7ff2c80c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/4229541265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c8151d80 0x7ff2c80c49a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff2c808b3e0 tx=0x7ff2c401c3a0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- 172.21.15.26:0/4229541265 shutdown_connections 2023-11-28T16:59:26.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/4229541265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c7f20 0x7ff2c806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/4229541265 >> v2:172.21.15.26:3300/0 conn(0x7ff2c80c8430 0x7ff2c806b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/4229541265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c8151d80 0x7ff2c80c49a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- 172.21.15.26:0/4229541265 >> 172.21.15.26:0/4229541265 conn(0x7ff2c80abd00 msgr2=0x7ff2c80ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:26.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- 172.21.15.26:0/4229541265 shutdown_connections 2023-11-28T16:59:26.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- 172.21.15.26:0/4229541265 wait complete. 2023-11-28T16:59:26.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 Processor -- start 2023-11-28T16:59:26.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- start start 2023-11-28T16:59:26.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c80c7f20 0x7ff2c814de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c8430 0x7ff2c81f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c8151d80 0x7ff2c81502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c814cd80 con 0x7ff2c8151d80 2023-11-28T16:59:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c8150c40 con 0x7ff2c80c7f20 2023-11-28T16:59:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2d01aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80ab3a0 con 0x7ff2c80c8430 2023-11-28T16:59:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c8151d80 0x7ff2c81502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c8151d80 0x7ff2c81502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49204/0 (socket says 172.21.15.26:49204) 2023-11-28T16:59:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 -- 172.21.15.26:0/2647140471 learned_addr learned my addr 172.21.15.26:0/2647140471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2cdf46640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c80c7f20 0x7ff2c814de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2cd745640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c8430 0x7ff2c81f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 -- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c8430 msgr2=0x7ff2c81f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c8430 0x7ff2c81f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 -- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c80c7f20 msgr2=0x7ff2c814de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c80c7f20 0x7ff2c814de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.428+0000 7ff2ce747640 1 -- 172.21.15.26:0/2647140471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009420 con 0x7ff2c8151d80 2023-11-28T16:59:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2ce747640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c8151d80 0x7ff2c81502c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000ef00 tx=0x7ff2c000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2be7fc640 1 -- 172.21.15.26:0/2647140471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0010040 con 0x7ff2c8151d80 2023-11-28T16:59:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2be7fc640 1 -- 172.21.15.26:0/2647140471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c000bb10 con 0x7ff2c8151d80 2023-11-28T16:59:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c81f0e20 con 0x7ff2c8151d80 2023-11-28T16:59:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2be7fc640 1 -- 172.21.15.26:0/2647140471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00039a0 con 0x7ff2c8151d80 2023-11-28T16:59:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c80ab5f0 con 0x7ff2c8151d80 2023-11-28T16:59:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c80ab810 con 0x7ff2c8151d80 2023-11-28T16:59:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2be7fc640 1 -- 172.21.15.26:0/2647140471 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff2c0003b00 con 0x7ff2c8151d80 2023-11-28T16:59:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2be7fc640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2ac0668d0 0x7ff2ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2be7fc640 1 -- 172.21.15.26:0/2647140471 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff2c0084680 con 0x7ff2c8151d80 2023-11-28T16:59:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.432+0000 7ff2cdf46640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2ac0668d0 0x7ff2ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.436+0000 7ff2cdf46640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2ac0668d0 0x7ff2ac068d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40af000 tx=0x7ff2c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.436+0000 7ff2be7fc640 1 -- 172.21.15.26:0/2647140471 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2c00516a0 con 0x7ff2c8151d80 2023-11-28T16:59:26.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2c81f0fb0 con 0x7ff2c8151d80 2023-11-28T16:59:26.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2be7fc640 1 -- 172.21.15.26:0/2647140471 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2c0054cc0 con 0x7ff2c8151d80 2023-11-28T16:59:26.599 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2ac0668d0 msgr2=0x7ff2ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2ac0668d0 0x7ff2ac068d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40af000 tx=0x7ff2c4008040 comp rx=0 tx=0).stop 2023-11-28T16:59:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c8151d80 msgr2=0x7ff2c81502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c8151d80 0x7ff2c81502c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000ef00 tx=0x7ff2c000b480 comp rx=0 tx=0).stop 2023-11-28T16:59:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 shutdown_connections 2023-11-28T16:59:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c8151d80 0x7ff2c81502c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff2ac0668d0 0x7ff2ac068d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2c80c8430 0x7ff2c81f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 --2- 172.21.15.26:0/2647140471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2c80c7f20 0x7ff2c814de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 >> 172.21.15.26:0/2647140471 conn(0x7ff2c80abd00 msgr2=0x7ff2c80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:26.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 shutdown_connections 2023-11-28T16:59:26.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.596+0000 7ff2d01aa640 1 -- 172.21.15.26:0/2647140471 wait complete. 2023-11-28T16:59:26.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:59:26.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fe00046b640 1 Processor -- start 2023-11-28T16:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fe00046b640 1 -- start start 2023-11-28T16:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fe00046b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff8151ee0 0x7fdff8072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fe00046b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff81522c0 con 0x7fdff80c1ae0 2023-11-28T16:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fe00046b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff8155040 con 0x7fdff80c09c0 2023-11-28T16:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fe00046b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff8072870 con 0x7fdff8151ee0 2023-11-28T16:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fdffda06640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdff80c1ae0 0x7fdff806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53144/0 (socket says 172.21.15.26:53144) 2023-11-28T16:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fdffda06640 1 -- 172.21.15.26:0/1146096686 learned_addr learned my addr 172.21.15.26:0/1146096686 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:26.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.764+0000 7fdffe207640 1 --2- 172.21.15.26:0/1146096686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff8151ee0 0x7fdff8072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffd205640 1 -- 172.21.15.26:0/1146096686 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239628220 0 0) 0x7fdff81522c0 con 0x7fdff80c1ae0 2023-11-28T16:59:26.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffd205640 1 -- 172.21.15.26:0/1146096686 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe4003530 con 0x7fdff80c1ae0 2023-11-28T16:59:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffd205640 1 -- 172.21.15.26:0/1146096686 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748162662 0 0) 0x7fdff8155040 con 0x7fdff80c09c0 2023-11-28T16:59:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffd205640 1 -- 172.21.15.26:0/1146096686 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff81522c0 con 0x7fdff80c09c0 2023-11-28T16:59:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffe207640 1 -- 172.21.15.26:0/1146096686 >> v1:172.21.15.79:6789/0 conn(0x7fdff80c09c0 legacy=0x7fdff80c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffe207640 1 -- 172.21.15.26:0/1146096686 >> v1:172.21.15.26:6789/0 conn(0x7fdff80c1ae0 legacy=0x7fdff806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffe207640 1 -- 172.21.15.26:0/1146096686 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff81555c0 con 0x7fdff8151ee0 2023-11-28T16:59:26.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffe207640 1 --2- 172.21.15.26:0/1146096686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff8151ee0 0x7fdff8072330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdff40097f0 tx=0x7fdff401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=badcaad5ef37b0b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffd205640 1 -- 172.21.15.26:0/1146096686 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff40a7070 con 0x7fdff8151ee0 2023-11-28T16:59:26.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffd205640 1 -- 172.21.15.26:0/1146096686 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff40ab430 con 0x7fdff8151ee0 2023-11-28T16:59:26.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.768+0000 7fdffd205640 1 -- 172.21.15.26:0/1146096686 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff40ab7c0 con 0x7fdff8151ee0 2023-11-28T16:59:26.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- 172.21.15.26:0/1146096686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff8151ee0 msgr2=0x7fdff8072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 --2- 172.21.15.26:0/1146096686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff8151ee0 0x7fdff8072330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdff40097f0 tx=0x7fdff401c430 comp rx=0 tx=0).stop 2023-11-28T16:59:26.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- 172.21.15.26:0/1146096686 shutdown_connections 2023-11-28T16:59:26.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 --2- 172.21.15.26:0/1146096686 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff8151ee0 0x7fdff8072330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- 172.21.15.26:0/1146096686 >> 172.21.15.26:0/1146096686 conn(0x7fdff80c3b70 msgr2=0x7fdff80c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:26.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- 172.21.15.26:0/1146096686 shutdown_connections 2023-11-28T16:59:26.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- 172.21.15.26:0/1146096686 wait complete. 2023-11-28T16:59:26.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 Processor -- start 2023-11-28T16:59:26.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- start start 2023-11-28T16:59:26.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff80c09c0 0x7fdff8155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80c1ae0 0x7fdff8148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8151ee0 0x7fdff814a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff8145270 con 0x7fdff8151ee0 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff81f0e90 con 0x7fdff80c1ae0 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fe00046b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff81f1150 con 0x7fdff80c09c0 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fdffea08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8151ee0 0x7fdff814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fdffea08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8151ee0 0x7fdff814a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49220/0 (socket says 172.21.15.26:49220) 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fdffea08640 1 -- 172.21.15.26:0/4109560479 learned_addr learned my addr 172.21.15.26:0/4109560479 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fdffda06640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80c1ae0 0x7fdff8148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.772+0000 7fdffe207640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff80c09c0 0x7fdff8155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffea08640 1 -- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff80c09c0 msgr2=0x7fdff8155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffea08640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff80c09c0 0x7fdff8155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffea08640 1 -- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80c1ae0 msgr2=0x7fdff8148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffea08640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80c1ae0 0x7fdff8148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffea08640 1 -- 172.21.15.26:0/4109560479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4009420 con 0x7fdff8151ee0 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffe207640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff80c09c0 0x7fdff8155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffda06640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80c1ae0 0x7fdff8148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdffea08640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8151ee0 0x7fdff814a890 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdff000c730 tx=0x7fdff000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdfeeffd640 1 -- 172.21.15.26:0/4109560479 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0003b80 con 0x7fdff8151ee0 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdfeeffd640 1 -- 172.21.15.26:0/4109560479 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff0003ce0 con 0x7fdff8151ee0 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdfeeffd640 1 -- 172.21.15.26:0/4109560479 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff000aa90 con 0x7fdff8151ee0 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff81f1430 con 0x7fdff8151ee0 2023-11-28T16:59:26.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff81f19f0 con 0x7fdff8151ee0 2023-11-28T16:59:26.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff804e890 con 0x7fdff8151ee0 2023-11-28T16:59:26.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdfeeffd640 1 -- 172.21.15.26:0/4109560479 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdff000abf0 con 0x7fdff8151ee0 2023-11-28T16:59:26.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdfeeffd640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfdc066900 0x7fdfdc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:26.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.776+0000 7fdfeeffd640 1 -- 172.21.15.26:0/4109560479 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdff0084590 con 0x7fdff8151ee0 2023-11-28T16:59:26.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.780+0000 7fdffe207640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfdc066900 0x7fdfdc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:26.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.780+0000 7fdffe207640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfdc066900 0x7fdfdc068dc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdff40af000 tx=0x7fdff40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:26.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.780+0000 7fdfeeffd640 1 -- 172.21.15.26:0/4109560479 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdff0051460 con 0x7fdff8151ee0 2023-11-28T16:59:26.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.940+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdff806eeb0 con 0x7fdff8151ee0 2023-11-28T16:59:26.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.940+0000 7fdfeeffd640 1 -- 172.21.15.26:0/4109560479 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7fdff0054a80 con 0x7fdff8151ee0 2023-11-28T16:59:26.945 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfdc066900 msgr2=0x7fdfdc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfdc066900 0x7fdfdc068dc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdff40af000 tx=0x7fdff40a7000 comp rx=0 tx=0).stop 2023-11-28T16:59:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8151ee0 msgr2=0x7fdff814a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8151ee0 0x7fdff814a890 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdff000c730 tx=0x7fdff000cbf0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 shutdown_connections 2023-11-28T16:59:26.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8151ee0 0x7fdff814a890 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80c1ae0 0x7fdff8148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdfdc066900 0x7fdfdc068dc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 --2- 172.21.15.26:0/4109560479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdff80c09c0 0x7fdff8155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 >> 172.21.15.26:0/4109560479 conn(0x7fdff80c3b70 msgr2=0x7fdff80c0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 shutdown_connections 2023-11-28T16:59:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:26.944+0000 7fe00046b640 1 -- 172.21.15.26:0/4109560479 wait complete. 2023-11-28T16:59:26.966 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:59:27.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.108+0000 7f7da9a9c640 1 Processor -- start 2023-11-28T16:59:27.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.108+0000 7f7da9a9c640 1 -- start start 2023-11-28T16:59:27.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.108+0000 7f7da9a9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da414eaf0 0x7f7da4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.108+0000 7f7da9a9c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7da4151f90 0x7f7da406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.108+0000 7f7da9a9c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da406de00 con 0x7f7da40c0370 2023-11-28T16:59:27.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.108+0000 7f7da9a9c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da4070390 con 0x7f7da4151f90 2023-11-28T16:59:27.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.108+0000 7f7da9a9c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da414eed0 con 0x7f7da414eaf0 2023-11-28T16:59:27.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7da40c0370 0x7f7da406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53152/0 (socket says 172.21.15.26:53152) 2023-11-28T16:59:27.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da3fff640 1 -- 172.21.15.26:0/2362342565 learned_addr learned my addr 172.21.15.26:0/2362342565 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:27.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da2ffd640 1 --2- 172.21.15.26:0/2362342565 >> v2:172.21.15.79:3300/0 conn(0x7f7da4151f90 0x7f7da406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da37fe640 1 --2- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da414eaf0 0x7f7da4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da27fc640 1 -- 172.21.15.26:0/2362342565 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096658603 0 0) 0x7f7da406de00 con 0x7f7da40c0370 2023-11-28T16:59:27.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da27fc640 1 -- 172.21.15.26:0/2362342565 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d8c003530 con 0x7f7da40c0370 2023-11-28T16:59:27.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da2ffd640 1 -- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da414eaf0 msgr2=0x7f7da4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:27.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da2ffd640 1 --2- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da414eaf0 0x7f7da4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da27fc640 1 -- 172.21.15.26:0/2362342565 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139079176 0 0) 0x7f7d8c003530 con 0x7f7da40c0370 2023-11-28T16:59:27.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da2ffd640 1 -- 172.21.15.26:0/2362342565 >> v1:172.21.15.26:6789/0 conn(0x7f7da40c0370 legacy=0x7f7da406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da2ffd640 1 -- 172.21.15.26:0/2362342565 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4151270 con 0x7f7da4151f90 2023-11-28T16:59:27.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.112+0000 7f7da2ffd640 1 --2- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da4151f90 0x7f7da406d110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7d980097c0 tx=0x7f7d9801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4681b21bbfa2dd5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da27fc640 1 -- 172.21.15.26:0/2362342565 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c001a00 con 0x7f7da4151f90 2023-11-28T16:59:27.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da27fc640 1 -- 172.21.15.26:0/2362342565 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d980a7050 con 0x7f7da4151f90 2023-11-28T16:59:27.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da27fc640 1 -- 172.21.15.26:0/2362342565 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d980ab620 con 0x7f7da4151f90 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da4151f90 msgr2=0x7f7da406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da4151f90 0x7f7da406d110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7d980097c0 tx=0x7f7d9801c250 comp rx=0 tx=0).stop 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- 172.21.15.26:0/2362342565 shutdown_connections 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da4151f90 0x7f7da406d110 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/2362342565 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da414eaf0 0x7f7da4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- 172.21.15.26:0/2362342565 >> 172.21.15.26:0/2362342565 conn(0x7f7da40c2a60 msgr2=0x7f7da40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- 172.21.15.26:0/2362342565 shutdown_connections 2023-11-28T16:59:27.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- 172.21.15.26:0/2362342565 wait complete. 2023-11-28T16:59:27.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 Processor -- start 2023-11-28T16:59:27.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- start start 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da40c0370 0x7f7da414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da414eaf0 0x7f7da40c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da40ab6d0 0x7f7da40c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40abdb0 con 0x7f7da414eaf0 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40c3ed0 con 0x7f7da40ab6d0 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da9a9c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40c45b0 con 0x7f7da40c0370 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da414eaf0 0x7f7da40c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da414eaf0 0x7f7da40c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49230/0 (socket says 172.21.15.26:49230) 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.116+0000 7f7da2ffd640 1 -- 172.21.15.26:0/1396310365 learned_addr learned my addr 172.21.15.26:0/1396310365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da3fff640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da40ab6d0 0x7f7da40c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da37fe640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da40c0370 0x7f7da414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da2ffd640 1 -- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da40c0370 msgr2=0x7f7da414a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da2ffd640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da40c0370 0x7f7da414a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da2ffd640 1 -- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da40ab6d0 msgr2=0x7f7da40c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da2ffd640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da40ab6d0 0x7f7da40c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da2ffd640 1 -- 172.21.15.26:0/1396310365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98009420 con 0x7f7da414eaf0 2023-11-28T16:59:27.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da2ffd640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da414eaf0 0x7f7da40c50a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ae040 tx=0x7f7d98018ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7d8bfff640 1 -- 172.21.15.26:0/1396310365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d980b4430 con 0x7f7da414eaf0 2023-11-28T16:59:27.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7d8bfff640 1 -- 172.21.15.26:0/1396310365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d980b45b0 con 0x7f7da414eaf0 2023-11-28T16:59:27.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da40abfe0 con 0x7f7da414eaf0 2023-11-28T16:59:27.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7d8bfff640 1 -- 172.21.15.26:0/1396310365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d980b4960 con 0x7f7da414eaf0 2023-11-28T16:59:27.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da40c4240 con 0x7f7da414eaf0 2023-11-28T16:59:27.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da40c40a0 con 0x7f7da414eaf0 2023-11-28T16:59:27.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7d8bfff640 1 -- 172.21.15.26:0/1396310365 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7d980b2040 con 0x7f7da414eaf0 2023-11-28T16:59:27.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.120+0000 7f7d8bfff640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7d900668d0 0x7f7d90068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.124+0000 7f7d8bfff640 1 -- 172.21.15.26:0/1396310365 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d9811e540 con 0x7f7da414eaf0 2023-11-28T16:59:27.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.124+0000 7f7da37fe640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7d900668d0 0x7f7d90068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.124+0000 7f7da37fe640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7d900668d0 0x7f7d90068d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7da414d360 tx=0x7f7d94009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.128+0000 7f7d8bfff640 1 -- 172.21.15.26:0/1396310365 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7da40c40a0 con 0x7f7da414eaf0 2023-11-28T16:59:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7da40c4760 con 0x7f7da414eaf0 2023-11-28T16:59:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7d8bfff640 1 -- 172.21.15.26:0/1396310365 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7da40c4760 con 0x7f7da414eaf0 2023-11-28T16:59:27.287 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7d900668d0 msgr2=0x7f7d90068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7d900668d0 0x7f7d90068d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7da414d360 tx=0x7f7d94009190 comp rx=0 tx=0).stop 2023-11-28T16:59:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da414eaf0 msgr2=0x7f7da40c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da414eaf0 0x7f7da40c50a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ae040 tx=0x7f7d98018ff0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 shutdown_connections 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da40ab6d0 0x7f7da40c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da414eaf0 0x7f7da40c50a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7d900668d0 0x7f7d90068d90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 --2- 172.21.15.26:0/1396310365 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7da40c0370 0x7f7da414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 >> 172.21.15.26:0/1396310365 conn(0x7f7da40c2a60 msgr2=0x7f7da4070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 shutdown_connections 2023-11-28T16:59:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.284+0000 7f7da9a9c640 1 -- 172.21.15.26:0/1396310365 wait complete. 2023-11-28T16:59:27.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:59:27.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 Processor -- start 2023-11-28T16:59:27.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 -- start start 2023-11-28T16:59:27.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f261414fcc0 0x7f2614156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f261406d980 0x7f26140aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f26140ab3b0 0x7f26140c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140aa340 con 0x7f261414fcc0 2023-11-28T16:59:27.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2614152fe0 con 0x7f26140ab3b0 2023-11-28T16:59:27.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f261bad6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26141532c0 con 0x7f261406d980 2023-11-28T16:59:27.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f2619872640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f261414fcc0 0x7f2614156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f2619872640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f261414fcc0 0x7f2614156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49240/0 (socket says 172.21.15.26:49240) 2023-11-28T16:59:27.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f2619872640 1 -- 172.21.15.26:0/532626376 learned_addr learned my addr 172.21.15.26:0/532626376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:27.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.452+0000 7f2619071640 1 --2- 172.21.15.26:0/532626376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f261406d980 0x7f26140aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f261a073640 1 --2- 172.21.15.26:0/532626376 >> v2:172.21.15.79:3300/0 conn(0x7f26140ab3b0 0x7f26140c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2619872640 1 -- 172.21.15.26:0/532626376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f261406d980 msgr2=0x7f26140aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2619872640 1 --2- 172.21.15.26:0/532626376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f261406d980 0x7f26140aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2619872640 1 -- 172.21.15.26:0/532626376 >> v2:172.21.15.79:3300/0 conn(0x7f26140ab3b0 msgr2=0x7f26140c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2619872640 1 --2- 172.21.15.26:0/532626376 >> v2:172.21.15.79:3300/0 conn(0x7f26140ab3b0 0x7f26140c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2619872640 1 -- 172.21.15.26:0/532626376 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614155a20 con 0x7f261414fcc0 2023-11-28T16:59:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f261a073640 1 --2- 172.21.15.26:0/532626376 >> v2:172.21.15.79:3300/0 conn(0x7f26140ab3b0 0x7f26140c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2619872640 1 --2- 172.21.15.26:0/532626376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f261414fcc0 0x7f2614156500 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f261406e300 tx=0x7f261001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1448d86423ca0f5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2618870640 1 -- 172.21.15.26:0/532626376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100aa5f0 con 0x7f261414fcc0 2023-11-28T16:59:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2618870640 1 -- 172.21.15.26:0/532626376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26100aa750 con 0x7f261414fcc0 2023-11-28T16:59:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f2618870640 1 -- 172.21.15.26:0/532626376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100aaae0 con 0x7f261414fcc0 2023-11-28T16:59:27.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f261bad6640 1 -- 172.21.15.26:0/532626376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f261414fcc0 msgr2=0x7f2614156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.456+0000 7f261bad6640 1 --2- 172.21.15.26:0/532626376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f261414fcc0 0x7f2614156500 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f261406e300 tx=0x7f261001c4d0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- 172.21.15.26:0/532626376 shutdown_connections 2023-11-28T16:59:27.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 --2- 172.21.15.26:0/532626376 >> v2:172.21.15.79:3300/0 conn(0x7f26140ab3b0 0x7f26140c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 --2- 172.21.15.26:0/532626376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f261406d980 0x7f26140aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 --2- 172.21.15.26:0/532626376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f261414fcc0 0x7f2614156500 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- 172.21.15.26:0/532626376 >> 172.21.15.26:0/532626376 conn(0x7f26140c2ad0 msgr2=0x7f26140c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:27.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- 172.21.15.26:0/532626376 shutdown_connections 2023-11-28T16:59:27.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- 172.21.15.26:0/532626376 wait complete. 2023-11-28T16:59:27.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 Processor -- start 2023-11-28T16:59:27.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- start start 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f261406d980 0x7f261415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140ab3b0 0x7f2614146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26141493c0 0x7f2614146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614147530 con 0x7f26140ab3b0 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26141f0170 con 0x7f261406d980 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261bad6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26141f0450 con 0x7f26141493c0 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140ab3b0 0x7f2614146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140ab3b0 0x7f2614146ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49242/0 (socket says 172.21.15.26:49242) 2023-11-28T16:59:27.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 -- 172.21.15.26:0/2009705978 learned_addr learned my addr 172.21.15.26:0/2009705978 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:27.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619872640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f261406d980 0x7f261415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f261a073640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26141493c0 0x7f2614146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 -- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26141493c0 msgr2=0x7f2614146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26141493c0 0x7f2614146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 -- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f261406d980 msgr2=0x7f261415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f261406d980 0x7f261415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 -- 172.21.15.26:0/2009705978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100094d0 con 0x7f26140ab3b0 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f2619071640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140ab3b0 0x7f2614146ab0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f260400e8b0 tx=0x7f260400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.460+0000 7f260a7fc640 1 -- 172.21.15.26:0/2009705978 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400c940 con 0x7f26140ab3b0 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f260a7fc640 1 -- 172.21.15.26:0/2009705978 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260400caa0 con 0x7f26140ab3b0 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26141f0730 con 0x7f26140ab3b0 2023-11-28T16:59:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f260a7fc640 1 -- 172.21.15.26:0/2009705978 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400ce30 con 0x7f26140ab3b0 2023-11-28T16:59:27.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261415b930 con 0x7f26140ab3b0 2023-11-28T16:59:27.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261404e890 con 0x7f26140ab3b0 2023-11-28T16:59:27.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f260a7fc640 1 -- 172.21.15.26:0/2009705978 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2604013470 con 0x7f26140ab3b0 2023-11-28T16:59:27.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f260a7fc640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f25f80668d0 0x7f25f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f260a7fc640 1 -- 172.21.15.26:0/2009705978 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2604084840 con 0x7f26140ab3b0 2023-11-28T16:59:27.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.464+0000 7f2619872640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f25f80668d0 0x7f25f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.468+0000 7f2619872640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f25f80668d0 0x7f25f8068d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f26100ae000 tx=0x7f26100b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.468+0000 7f260a7fc640 1 -- 172.21.15.26:0/2009705978 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2604051860 con 0x7f26140ab3b0 2023-11-28T16:59:27.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.636+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26141f02b0 con 0x7f26140ab3b0 2023-11-28T16:59:27.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.636+0000 7f260a7fc640 1 -- 172.21.15.26:0/2009705978 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f26141f02b0 con 0x7f26140ab3b0 2023-11-28T16:59:27.641 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:59:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f25f80668d0 msgr2=0x7f25f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f25f80668d0 0x7f25f8068d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f26100ae000 tx=0x7f26100b5040 comp rx=0 tx=0).stop 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140ab3b0 msgr2=0x7f2614146ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140ab3b0 0x7f2614146ab0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f260400e8b0 tx=0x7f260400ed70 comp rx=0 tx=0).stop 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 shutdown_connections 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f25f80668d0 0x7f25f8068d90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26141493c0 0x7f2614146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140ab3b0 0x7f2614146ab0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 --2- 172.21.15.26:0/2009705978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f261406d980 0x7f261415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 >> 172.21.15.26:0/2009705978 conn(0x7f26140c2ad0 msgr2=0x7f26140a8470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 shutdown_connections 2023-11-28T16:59:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.640+0000 7f261bad6640 1 -- 172.21.15.26:0/2009705978 wait complete. 2023-11-28T16:59:27.662 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T16:59:27.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:27.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:27.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:59:27.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:27.725 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:59:27.746 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:27.746 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:27.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:59:27.804 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T16:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.944+0000 7facc55b8640 1 Processor -- start 2023-11-28T16:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.944+0000 7facc55b8640 1 -- start start 2023-11-28T16:59:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facc55b8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7facc014e9d0 0x7facc0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facc55b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facc55b8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc006d320 con 0x7facc0070b80 2023-11-28T16:59:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facc55b8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc00721b0 con 0x7facc014e9d0 2023-11-28T16:59:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facc55b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc00c2830 con 0x7facc00a8470 2023-11-28T16:59:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facbeffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7facc014e9d0 0x7facc0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facb7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7facc0070b80 0x7facc00c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53162/0 (socket says 172.21.15.26:53162) 2023-11-28T16:59:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facb7fff640 1 -- 172.21.15.26:0/1266521388 learned_addr learned my addr 172.21.15.26:0/1266521388 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facbf7fe640 1 --2- 172.21.15.26:0/1266521388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facbeffd640 1 -- 172.21.15.26:0/1266521388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 msgr2=0x7facc006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facbeffd640 1 --2- 172.21.15.26:0/1266521388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facbeffd640 1 -- 172.21.15.26:0/1266521388 >> v1:172.21.15.26:6789/0 conn(0x7facc0070b80 legacy=0x7facc00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facbeffd640 1 -- 172.21.15.26:0/1266521388 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc0072450 con 0x7facc014e9d0 2023-11-28T16:59:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.948+0000 7facbe7fc640 1 -- 172.21.15.26:0/1266521388 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061468696 0 0) 0x7facc006d320 con 0x7facc0070b80 2023-11-28T16:59:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facbeffd640 1 --2- 172.21.15.26:0/1266521388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc014e9d0 0x7facc0151e60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7facb00097c0 tx=0x7facb001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b38392fa38954d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facbe7fc640 1 -- 172.21.15.26:0/1266521388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00ab600 con 0x7facc014e9d0 2023-11-28T16:59:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facbe7fc640 1 -- 172.21.15.26:0/1266521388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00a7050 con 0x7facc014e9d0 2023-11-28T16:59:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facbe7fc640 1 -- 172.21.15.26:0/1266521388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00ab980 con 0x7facc014e9d0 2023-11-28T16:59:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- 172.21.15.26:0/1266521388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc014e9d0 msgr2=0x7facc0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 --2- 172.21.15.26:0/1266521388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc014e9d0 0x7facc0151e60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7facb00097c0 tx=0x7facb001c3f0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- 172.21.15.26:0/1266521388 shutdown_connections 2023-11-28T16:59:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 --2- 172.21.15.26:0/1266521388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 --2- 172.21.15.26:0/1266521388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc014e9d0 0x7facc0151e60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- 172.21.15.26:0/1266521388 >> 172.21.15.26:0/1266521388 conn(0x7facc00c2ad0 msgr2=0x7facc00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:27.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- 172.21.15.26:0/1266521388 shutdown_connections 2023-11-28T16:59:27.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- 172.21.15.26:0/1266521388 wait complete. 2023-11-28T16:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 Processor -- start 2023-11-28T16:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- start start 2023-11-28T16:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc0070b80 0x7facc01f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc014e9d0 0x7facc0141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc00abc10 con 0x7facc0070b80 2023-11-28T16:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc0150b50 con 0x7facc014e9d0 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.952+0000 7facc55b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc015b1f0 con 0x7facc00a8470 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc0070b80 0x7facc01f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc0070b80 0x7facc01f08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49260/0 (socket says 172.21.15.26:49260) 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 -- 172.21.15.26:0/2389206253 learned_addr learned my addr 172.21.15.26:0/2389206253 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbf7fe640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc014e9d0 0x7facc0141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facb7fff640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 -- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 msgr2=0x7facc014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc014fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 -- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc014e9d0 msgr2=0x7facc0141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc014e9d0 0x7facc0141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 -- 172.21.15.26:0/2389206253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009420 con 0x7facc0070b80 2023-11-28T16:59:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbf7fe640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc014e9d0 0x7facc0141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facbeffd640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc0070b80 0x7facc01f08b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7facb00ae040 tx=0x7facb001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facb77fe640 1 -- 172.21.15.26:0/2389206253 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00b7650 con 0x7facc0070b80 2023-11-28T16:59:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facb77fe640 1 -- 172.21.15.26:0/2389206253 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00abe90 con 0x7facc0070b80 2023-11-28T16:59:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc01f1190 con 0x7facc0070b80 2023-11-28T16:59:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facb77fe640 1 -- 172.21.15.26:0/2389206253 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00b7a10 con 0x7facc0070b80 2023-11-28T16:59:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc0145c00 con 0x7facc0070b80 2023-11-28T16:59:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc004e890 con 0x7facc0070b80 2023-11-28T16:59:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facb77fe640 1 -- 172.21.15.26:0/2389206253 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7facb00b7b70 con 0x7facc0070b80 2023-11-28T16:59:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.956+0000 7facb77fe640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faca00668d0 0x7faca0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.960+0000 7facb77fe640 1 -- 172.21.15.26:0/2389206253 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7facb011eec0 con 0x7facc0070b80 2023-11-28T16:59:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.960+0000 7facb7fff640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faca00668d0 0x7faca0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.960+0000 7facb7fff640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faca00668d0 0x7faca0068d90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7facc014ca80 tx=0x7faca8007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:27.960+0000 7facb77fe640 1 -- 172.21.15.26:0/2389206253 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facb00ebd90 con 0x7facc0070b80 2023-11-28T16:59:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.152+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7facc00700a0 con 0x7facc0070b80 2023-11-28T16:59:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.152+0000 7facb77fe640 1 -- 172.21.15.26:0/2389206253 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7facb00b0070 con 0x7facc0070b80 2023-11-28T16:59:28.156 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T16:59:28.156 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T16:59:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faca00668d0 msgr2=0x7faca0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faca00668d0 0x7faca0068d90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7facc014ca80 tx=0x7faca8007b60 comp rx=0 tx=0).stop 2023-11-28T16:59:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc0070b80 msgr2=0x7facc01f08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc0070b80 0x7facc01f08b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7facb00ae040 tx=0x7facb001ac30 comp rx=0 tx=0).stop 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 shutdown_connections 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc014e9d0 0x7facc0141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7faca00668d0 0x7faca0068d90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7facc00a8470 0x7facc014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 --2- 172.21.15.26:0/2389206253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facc0070b80 0x7facc01f08b0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 >> 172.21.15.26:0/2389206253 conn(0x7facc00c2ad0 msgr2=0x7facc0148420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 shutdown_connections 2023-11-28T16:59:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:28.156+0000 7facc55b8640 1 -- 172.21.15.26:0/2389206253 wait complete. 2023-11-28T16:59:28.177 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T16:59:28.178 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T16:59:28.178 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-11-28T16:59:28.178 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T16:59:28.178 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:28.178 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T16:59:28.178 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T16:59:28.178 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.aduOWAs9dQ 2023-11-28T16:59:28.178 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-11-28T16:59:28.188 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.U8P1TCG9yP 2023-11-28T16:59:28.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /tmp/tmp.aduOWAs9dQ /tmp/tmp.U8P1TCG9yP 2023-11-28T16:59:28.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.U8P1TCG9yP 2023-11-28T16:59:28.379 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.U8P1TCG9yP is 226B 2023-11-28T16:59:28.395 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.U8P1TCG9yP 2023-11-28T16:59:28.404 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T16:59:28.404 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:28.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:28.405 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-11-28T16:59:28.459 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-11-28T16:59:28.461 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-11-28T16:59:28.461 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T16:59:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:28.461 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42198sec preferred_lft 42198sec 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:42:23:61:65:43 brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T16:59:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T16:59:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-11-28T16:59:28.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:28.464 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T16:59:28.526 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-11-28T16:59:28.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:28.528 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-11-28T16:59:28.581 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-11-28T16:59:28.581 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T16:59:28.582 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T16:59:28.582 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T16:59:28.582 INFO:teuthology.orchestra.run.smithi079.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T16:59:28.582 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T16:59:28.582 INFO:teuthology.orchestra.run.smithi079.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:28.583 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:28.583 INFO:teuthology.orchestra.run.smithi079.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T16:59:28.583 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T16:59:28.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:28.583 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-11-28T16:59:28.584 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-11-28T16:59:28.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T16:59:28.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T16:59:28.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T16:59:28.584 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-11-28T16:59:28.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:28.678 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:59:28.687 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:59:28.688 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:28.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:28.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-11-28T16:59:28.751 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:28.751 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:28.803 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T16:59:28.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T16:59:28.803 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:28.854 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:28.855 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/tmp/tmp.aduOWAs9dQ of=/dev/stdout 2023-11-28T16:59:28.906 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-11-28T16:59:28.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:28.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:29.000 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,secret=AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:29.000 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:29.000 INFO:teuthology.orchestra.run.smithi079.stdout:keyring.get_secret failed 2023-11-28T16:59:29.013 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,secret=AQBoHGZlvQQOHRAAfOWKSJ0gZb/7JgodLAVx/w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T16:59:29.013 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T16:59:29.013 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-11-28T16:59:29.013 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: testuser@e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee.cephfs2=/ 2023-11-28T16:59:29.013 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.26:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2023-11-28T16:59:29.016 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T16:59:29.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:29.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:29.035 INFO:teuthology.orchestra.run.smithi079.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-11-28T16:59:29.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:59:29.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:29.037 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T16:59:29.093 INFO:teuthology.orchestra.run.smithi079.stdout:client6011 2023-11-28T16:59:29.094 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:29.094 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:29.143 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-11-28T16:59:29.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:29.143 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-11-28T16:59:29.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T16:59:29.157 INFO:teuthology.orchestra.run.smithi026.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-11-28T16:59:29.157 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:29.158 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:29.211 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:29.212 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:29.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.456+0000 7f61d9409640 1 Processor -- start 2023-11-28T16:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.456+0000 7f61d9409640 1 -- start start 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.456+0000 7f61d9409640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61d4070b80 0x7f61d4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.456+0000 7f61d9409640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61d40a8470 0x7f61d406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.456+0000 7f61d9409640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d406d320 con 0x7f61d414e9d0 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.456+0000 7f61d9409640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d40721b0 con 0x7f61d4070b80 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.456+0000 7f61d9409640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d40c2830 con 0x7f61d40a8470 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d2ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f61d414e9d0 0x7f61d40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53174/0 (socket says 172.21.15.26:53174) 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d2ffd640 1 -- 172.21.15.26:0/967805733 learned_addr learned my addr 172.21.15.26:0/967805733 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61cbfff640 1 --2- 172.21.15.26:0/967805733 >> v2:172.21.15.26:3300/0 conn(0x7f61d4070b80 0x7f61d4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d37fe640 1 --2- 172.21.15.26:0/967805733 >> v2:172.21.15.79:3300/0 conn(0x7f61d40a8470 0x7f61d406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d27fc640 1 -- 172.21.15.26:0/967805733 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359031586 0 0) 0x7f61d406d320 con 0x7f61d414e9d0 2023-11-28T16:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d27fc640 1 -- 172.21.15.26:0/967805733 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c0003530 con 0x7f61d414e9d0 2023-11-28T16:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d37fe640 1 -- 172.21.15.26:0/967805733 >> v2:172.21.15.26:3300/0 conn(0x7f61d4070b80 msgr2=0x7f61d4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d37fe640 1 --2- 172.21.15.26:0/967805733 >> v2:172.21.15.26:3300/0 conn(0x7f61d4070b80 0x7f61d4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d37fe640 1 -- 172.21.15.26:0/967805733 >> v1:172.21.15.26:6789/0 conn(0x7f61d414e9d0 legacy=0x7f61d40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d37fe640 1 -- 172.21.15.26:0/967805733 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4072450 con 0x7f61d40a8470 2023-11-28T16:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61cbfff640 1 --2- 172.21.15.26:0/967805733 >> v2:172.21.15.26:3300/0 conn(0x7f61d4070b80 0x7f61d4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.460+0000 7f61d37fe640 1 --2- 172.21.15.26:0/967805733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d40a8470 0x7f61d406d7b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f61d40c3b30 tx=0x7f61cc01c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d104e8676e5b8b4f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d27fc640 1 -- 172.21.15.26:0/967805733 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0a5850 con 0x7f61d40a8470 2023-11-28T16:59:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d27fc640 1 -- 172.21.15.26:0/967805733 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0a59b0 con 0x7f61d40a8470 2023-11-28T16:59:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d27fc640 1 -- 172.21.15.26:0/967805733 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0a5d20 con 0x7f61d40a8470 2023-11-28T16:59:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- 172.21.15.26:0/967805733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d40a8470 msgr2=0x7f61d406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 --2- 172.21.15.26:0/967805733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d40a8470 0x7f61d406d7b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f61d40c3b30 tx=0x7f61cc01c880 comp rx=0 tx=0).stop 2023-11-28T16:59:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- 172.21.15.26:0/967805733 shutdown_connections 2023-11-28T16:59:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 --2- 172.21.15.26:0/967805733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d40a8470 0x7f61d406d7b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 --2- 172.21.15.26:0/967805733 >> v2:172.21.15.26:3300/0 conn(0x7f61d4070b80 0x7f61d4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- 172.21.15.26:0/967805733 >> 172.21.15.26:0/967805733 conn(0x7f61d40c2ad0 msgr2=0x7f61d40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- 172.21.15.26:0/967805733 shutdown_connections 2023-11-28T16:59:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- 172.21.15.26:0/967805733 wait complete. 2023-11-28T16:59:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 Processor -- start 2023-11-28T16:59:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- start start 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4070b80 0x7f61d41eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d40a8470 0x7f61d4152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61d414e9d0 0x7f61d4148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40ac080 con 0x7f61d40a8470 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41ed5c0 con 0x7f61d4070b80 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d9409640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41ecfe0 con 0x7f61d414e9d0 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61cbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d40a8470 0x7f61d4152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61cbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d40a8470 0x7f61d4152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49290/0 (socket says 172.21.15.26:49290) 2023-11-28T16:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61cbfff640 1 -- 172.21.15.26:0/2516922495 learned_addr learned my addr 172.21.15.26:0/2516922495 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.464+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4070b80 0x7f61d41eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61d37fe640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61d414e9d0 0x7f61d4148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cbfff640 1 -- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61d414e9d0 msgr2=0x7f61d4148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cbfff640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61d414e9d0 0x7f61d4148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cbfff640 1 -- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4070b80 msgr2=0x7f61d41eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cbfff640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4070b80 0x7f61d41eda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cbfff640 1 -- 172.21.15.26:0/2516922495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc009420 con 0x7f61d40a8470 2023-11-28T16:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cbfff640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d40a8470 0x7f61d4152a00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00ea30 tx=0x7f61bc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cb7fe640 1 -- 172.21.15.26:0/2516922495 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00cac0 con 0x7f61d40a8470 2023-11-28T16:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cb7fe640 1 -- 172.21.15.26:0/2516922495 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc00cc20 con 0x7f61d40a8470 2023-11-28T16:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc009a70 con 0x7f61d40a8470 2023-11-28T16:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cb7fe640 1 -- 172.21.15.26:0/2516922495 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc013470 con 0x7f61d40a8470 2023-11-28T16:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d41ed250 con 0x7f61d40a8470 2023-11-28T16:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d404e890 con 0x7f61d40a8470 2023-11-28T16:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cb7fe640 1 -- 172.21.15.26:0/2516922495 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f61bc0135d0 con 0x7f61d40a8470 2023-11-28T16:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cb7fe640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61b40668d0 0x7f61b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.468+0000 7f61cb7fe640 1 -- 172.21.15.26:0/2516922495 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f61bc084760 con 0x7f61d40a8470 2023-11-28T16:59:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.472+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61b40668d0 0x7f61b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.472+0000 7f61d2ffd640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61b40668d0 0x7f61b4068d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f61c4005890 tx=0x7f61c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.472+0000 7f61cb7fe640 1 -- 172.21.15.26:0/2516922495 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61bc051630 con 0x7f61d40a8470 2023-11-28T16:59:29.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.632+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d40700a0 con 0x7f61d40a8470 2023-11-28T16:59:29.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.632+0000 7f61cb7fe640 1 -- 172.21.15.26:0/2516922495 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7f61bc054c50 con 0x7f61d40a8470 2023-11-28T16:59:29.637 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:29.637 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61b40668d0 msgr2=0x7f61b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61b40668d0 0x7f61b4068d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f61c4005890 tx=0x7f61c4009040 comp rx=0 tx=0).stop 2023-11-28T16:59:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d40a8470 msgr2=0x7f61d4152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d40a8470 0x7f61d4152a00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00ea30 tx=0x7f61bc00eef0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 shutdown_connections 2023-11-28T16:59:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f61b40668d0 0x7f61b4068d90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f61d414e9d0 0x7f61d4148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61d40a8470 0x7f61d4152a00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 --2- 172.21.15.26:0/2516922495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4070b80 0x7f61d41eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 >> 172.21.15.26:0/2516922495 conn(0x7f61d40c2ad0 msgr2=0x7f61d415b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 shutdown_connections 2023-11-28T16:59:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.636+0000 7f61d9409640 1 -- 172.21.15.26:0/2516922495 wait complete. 2023-11-28T16:59:29.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:58:55.413723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:58:56.230719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:59:08.379611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:59:09.728280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:29.659 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:29.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.800+0000 7fedd969a640 1 Processor -- start 2023-11-28T16:59:29.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.800+0000 7fedd969a640 1 -- start start 2023-11-28T16:59:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd969a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedd40c3fa0 0x7fedd41582d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd969a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd4154740 con 0x7fedd40a7150 2023-11-28T16:59:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd969a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd4154a20 con 0x7fedd4151dd0 2023-11-28T16:59:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd969a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd40c3750 con 0x7fedd40c3fa0 2023-11-28T16:59:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedcbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fedd40a7150 0x7fedd4157bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53186/0 (socket says 172.21.15.26:53186) 2023-11-28T16:59:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedcbfff640 1 -- 172.21.15.26:0/2140631026 learned_addr learned my addr 172.21.15.26:0/2140631026 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd37fe640 1 --2- 172.21.15.26:0/2140631026 >> v2:172.21.15.26:3300/0 conn(0x7fedd40c3fa0 0x7fedd41582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd27fc640 1 -- 172.21.15.26:0/2140631026 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318459464 0 0) 0x7fedd4154740 con 0x7fedd40a7150 2023-11-28T16:59:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd27fc640 1 -- 172.21.15.26:0/2140631026 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc0003530 con 0x7fedd40a7150 2023-11-28T16:59:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd37fe640 1 -- 172.21.15.26:0/2140631026 >> v1:172.21.15.79:6789/0 conn(0x7fedd4151dd0 legacy=0x7fedd40c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd37fe640 1 -- 172.21.15.26:0/2140631026 >> v1:172.21.15.26:6789/0 conn(0x7fedd40a7150 legacy=0x7fedd4157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.804+0000 7fedd37fe640 1 -- 172.21.15.26:0/2140631026 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4154d00 con 0x7fedd40c3fa0 2023-11-28T16:59:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd37fe640 1 --2- 172.21.15.26:0/2140631026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd41582d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009d90 tx=0x7fedcc01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74332956c4f33796 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd27fc640 1 -- 172.21.15.26:0/2140631026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0a5a00 con 0x7fedd40c3fa0 2023-11-28T16:59:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd27fc640 1 -- 172.21.15.26:0/2140631026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc0a5b60 con 0x7fedd40c3fa0 2023-11-28T16:59:29.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd27fc640 1 -- 172.21.15.26:0/2140631026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0ad440 con 0x7fedd40c3fa0 2023-11-28T16:59:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- 172.21.15.26:0/2140631026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 msgr2=0x7fedd41582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 --2- 172.21.15.26:0/2140631026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd41582d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009d90 tx=0x7fedcc01d380 comp rx=0 tx=0).stop 2023-11-28T16:59:29.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- 172.21.15.26:0/2140631026 shutdown_connections 2023-11-28T16:59:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 --2- 172.21.15.26:0/2140631026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd41582d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- 172.21.15.26:0/2140631026 >> 172.21.15.26:0/2140631026 conn(0x7fedd406a5a0 msgr2=0x7fedd406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- 172.21.15.26:0/2140631026 shutdown_connections 2023-11-28T16:59:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- 172.21.15.26:0/2140631026 wait complete. 2023-11-28T16:59:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 Processor -- start 2023-11-28T16:59:29.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- start start 2023-11-28T16:59:29.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd40a7150 0x7fedd414a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd4152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd4151dd0 0x7fedd4152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd414af60 con 0x7fedd40c3fa0 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4153d10 con 0x7fedd40a7150 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.808+0000 7fedd969a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41ec900 con 0x7fedd4151dd0 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd4152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedd2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd40a7150 0x7fedd414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd4152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49300/0 (socket says 172.21.15.26:49300) 2023-11-28T16:59:29.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 -- 172.21.15.26:0/1123005186 learned_addr learned my addr 172.21.15.26:0/1123005186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:29.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedd37fe640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd4151dd0 0x7fedd4152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 -- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd4151dd0 msgr2=0x7fedd4152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd4151dd0 0x7fedd4152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 -- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd40a7150 msgr2=0x7fedd414a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd40a7150 0x7fedd414a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 -- 172.21.15.26:0/1123005186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009a70 con 0x7fedd40c3fa0 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcbfff640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd4152530 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c4d0 tx=0x7fedbc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcb7fe640 1 -- 172.21.15.26:0/1123005186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc005cf0 con 0x7fedd40c3fa0 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcb7fe640 1 -- 172.21.15.26:0/1123005186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc005e50 con 0x7fedd40c3fa0 2023-11-28T16:59:29.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcb7fe640 1 -- 172.21.15.26:0/1123005186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc007270 con 0x7fedd40c3fa0 2023-11-28T16:59:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd41ecbe0 con 0x7fedd40c3fa0 2023-11-28T16:59:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd41ed1a0 con 0x7fedd40c3fa0 2023-11-28T16:59:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd4074970 con 0x7fedd40c3fa0 2023-11-28T16:59:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.812+0000 7fedcb7fe640 1 -- 172.21.15.26:0/1123005186 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fedbc0073d0 con 0x7fedd40c3fa0 2023-11-28T16:59:29.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.816+0000 7fedcb7fe640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedb4066900 0x7fedb4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.816+0000 7fedcb7fe640 1 -- 172.21.15.26:0/1123005186 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fedbc083c20 con 0x7fedd40c3fa0 2023-11-28T16:59:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.816+0000 7fedd2ffd640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedb4066900 0x7fedb4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:29.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.816+0000 7fedd2ffd640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedb4066900 0x7fedb4068dc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007fd0 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:29.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.820+0000 7fedcb7fe640 1 -- 172.21.15.26:0/1123005186 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fedbc050ba0 con 0x7fedd40c3fa0 2023-11-28T16:59:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.976+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedd406e610 con 0x7fedd40c3fa0 2023-11-28T16:59:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.976+0000 7fedcb7fe640 1 -- 172.21.15.26:0/1123005186 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedbc017020 con 0x7fedd40c3fa0 2023-11-28T16:59:29.980 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedb4066900 msgr2=0x7fedb4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedb4066900 0x7fedb4068dc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007fd0 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2023-11-28T16:59:29.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 msgr2=0x7fedd4152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd4152530 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c4d0 tx=0x7fedbc00c990 comp rx=0 tx=0).stop 2023-11-28T16:59:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 shutdown_connections 2023-11-28T16:59:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fedb4066900 0x7fedb4068dc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fedd4151dd0 0x7fedd4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedd40c3fa0 0x7fedd4152530 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 --2- 172.21.15.26:0/1123005186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedd40a7150 0x7fedd414a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 >> 172.21.15.26:0/1123005186 conn(0x7fedd406a5a0 msgr2=0x7fedd40c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 shutdown_connections 2023-11-28T16:59:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:29.980+0000 7fedd969a640 1 -- 172.21.15.26:0/1123005186 wait complete. 2023-11-28T16:59:30.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:59:30.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4044e17640 1 Processor -- start 2023-11-28T16:59:30.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4044e17640 1 -- start start 2023-11-28T16:59:30.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4044e17640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f404014eaf0 0x7f4040151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4044e17640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4040151f90 0x7f404006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4044e17640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404006de00 con 0x7f40400c0370 2023-11-28T16:59:30.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4044e17640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4040070390 con 0x7f404014eaf0 2023-11-28T16:59:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4044e17640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404014eed0 con 0x7f4040151f90 2023-11-28T16:59:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f404014eaf0 0x7f4040151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403ed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f40400c0370 0x7f404006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53190/0 (socket says 172.21.15.26:53190) 2023-11-28T16:59:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403ed9d640 1 -- 172.21.15.26:0/1096081 learned_addr learned my addr 172.21.15.26:0/1096081 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f4037fff640 1 --2- 172.21.15.26:0/1096081 >> v2:172.21.15.79:3300/0 conn(0x7f4040151f90 0x7f404006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403e59c640 1 -- 172.21.15.26:0/1096081 >> v2:172.21.15.79:3300/0 conn(0x7f4040151f90 msgr2=0x7f404006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403e59c640 1 --2- 172.21.15.26:0/1096081 >> v2:172.21.15.79:3300/0 conn(0x7f4040151f90 0x7f404006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403e59c640 1 -- 172.21.15.26:0/1096081 >> v1:172.21.15.26:6789/0 conn(0x7f40400c0370 legacy=0x7f404006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403e59c640 1 -- 172.21.15.26:0/1096081 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040151270 con 0x7f404014eaf0 2023-11-28T16:59:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.144+0000 7f403dd9b640 1 -- 172.21.15.26:0/1096081 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5901811 0 0) 0x7f404006de00 con 0x7f40400c0370 2023-11-28T16:59:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f403e59c640 1 --2- 172.21.15.26:0/1096081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404014eaf0 0x7f4040151a50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f404006e2d0 tx=0x7f403001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34e156de98c92f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f403dd9b640 1 -- 172.21.15.26:0/1096081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300ac640 con 0x7f404014eaf0 2023-11-28T16:59:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f403dd9b640 1 -- 172.21.15.26:0/1096081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40300ac7a0 con 0x7f404014eaf0 2023-11-28T16:59:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f403dd9b640 1 -- 172.21.15.26:0/1096081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300acb30 con 0x7f404014eaf0 2023-11-28T16:59:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 -- 172.21.15.26:0/1096081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404014eaf0 msgr2=0x7f4040151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 --2- 172.21.15.26:0/1096081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404014eaf0 0x7f4040151a50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f404006e2d0 tx=0x7f403001c310 comp rx=0 tx=0).stop 2023-11-28T16:59:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 -- 172.21.15.26:0/1096081 shutdown_connections 2023-11-28T16:59:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 --2- 172.21.15.26:0/1096081 >> v2:172.21.15.79:3300/0 conn(0x7f4040151f90 0x7f404006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 --2- 172.21.15.26:0/1096081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404014eaf0 0x7f4040151a50 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 -- 172.21.15.26:0/1096081 >> 172.21.15.26:0/1096081 conn(0x7f40400c2a60 msgr2=0x7f40400c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 -- 172.21.15.26:0/1096081 shutdown_connections 2023-11-28T16:59:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.148+0000 7f4044e17640 1 -- 172.21.15.26:0/1096081 wait complete. 2023-11-28T16:59:30.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 Processor -- start 2023-11-28T16:59:30.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 -- start start 2023-11-28T16:59:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40400c0370 0x7f404013e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f404014eaf0 0x7f40400c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404013e6e0 0x7f404013d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4040140d20 con 0x7f404013e6e0 2023-11-28T16:59:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40401404a0 con 0x7f404014eaf0 2023-11-28T16:59:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40401ef6c0 con 0x7f40400c0370 2023-11-28T16:59:30.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404013e6e0 0x7f404013d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404013e6e0 0x7f404013d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49306/0 (socket says 172.21.15.26:49306) 2023-11-28T16:59:30.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 -- 172.21.15.26:0/1844968155 learned_addr learned my addr 172.21.15.26:0/1844968155 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403e59c640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40400c0370 0x7f404013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4037fff640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f404014eaf0 0x7f40400c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 -- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40400c0370 msgr2=0x7f404013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40400c0370 0x7f404013e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 -- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f404014eaf0 msgr2=0x7f40400c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f404014eaf0 0x7f40400c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 -- 172.21.15.26:0/1844968155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030009420 con 0x7f404013e6e0 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f403ed9d640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404013e6e0 0x7f404013d610 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f403800c780 tx=0x7f403800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4036ffd640 1 -- 172.21.15.26:0/1844968155 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800ce90 con 0x7f404013e6e0 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4036ffd640 1 -- 172.21.15.26:0/1844968155 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403800a640 con 0x7f404013e6e0 2023-11-28T16:59:30.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4036ffd640 1 -- 172.21.15.26:0/1844968155 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800a9d0 con 0x7f404013e6e0 2023-11-28T16:59:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4040140760 con 0x7f404013e6e0 2023-11-28T16:59:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.152+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40400c2050 con 0x7f404013e6e0 2023-11-28T16:59:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.156+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404004e890 con 0x7f404013e6e0 2023-11-28T16:59:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.156+0000 7f4036ffd640 1 -- 172.21.15.26:0/1844968155 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f403800ab30 con 0x7f404013e6e0 2023-11-28T16:59:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.156+0000 7f4036ffd640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40200668d0 0x7f4020068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.156+0000 7f4036ffd640 1 -- 172.21.15.26:0/1844968155 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4038083b20 con 0x7f404013e6e0 2023-11-28T16:59:30.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.156+0000 7f403e59c640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40200668d0 0x7f4020068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.156+0000 7f403e59c640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40200668d0 0x7f4020068d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f40300ae000 tx=0x7f4030008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.160+0000 7f4036ffd640 1 -- 172.21.15.26:0/1844968155 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4038050aa0 con 0x7f404013e6e0 2023-11-28T16:59:30.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f404014c860 con 0x7f404013e6e0 2023-11-28T16:59:30.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4036ffd640 1 -- 172.21.15.26:0/1844968155 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40380180a0 con 0x7f404013e6e0 2023-11-28T16:59:30.319 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40200668d0 msgr2=0x7f4020068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40200668d0 0x7f4020068d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f40300ae000 tx=0x7f4030008040 comp rx=0 tx=0).stop 2023-11-28T16:59:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404013e6e0 msgr2=0x7f404013d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404013e6e0 0x7f404013d610 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f403800c780 tx=0x7f403800cc40 comp rx=0 tx=0).stop 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 shutdown_connections 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f404013e6e0 0x7f404013d610 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f404014eaf0 0x7f40400c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f40200668d0 0x7f4020068d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 --2- 172.21.15.26:0/1844968155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40400c0370 0x7f404013e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 >> 172.21.15.26:0/1844968155 conn(0x7f40400c2a60 msgr2=0x7f4040154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 shutdown_connections 2023-11-28T16:59:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.316+0000 7f4044e17640 1 -- 172.21.15.26:0/1844968155 wait complete. 2023-11-28T16:59:30.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:59:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7fcc9640 1 Processor -- start 2023-11-28T16:59:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7fcc9640 1 -- start start 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7fcc9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae780a86d0 0x7fae780a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7fcc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae78156600 0x7fae7814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7fcc9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae78152d90 con 0x7fae7814fb30 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7fcc9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae78152480 con 0x7fae780a86d0 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7fcc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780a9760 con 0x7fae78156600 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7e266640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae7814fb30 0x7fae780aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53202/0 (socket says 172.21.15.26:53202) 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7e266640 1 -- 172.21.15.26:0/530109826 learned_addr learned my addr 172.21.15.26:0/530109826 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7da65640 1 --2- 172.21.15.26:0/530109826 >> v2:172.21.15.79:3300/0 conn(0x7fae780a86d0 0x7fae780a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7d264640 1 --2- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae78156600 0x7fae7814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7ca63640 1 -- 172.21.15.26:0/530109826 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563989814 0 0) 0x7fae78152d90 con 0x7fae7814fb30 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7ca63640 1 -- 172.21.15.26:0/530109826 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae64003530 con 0x7fae7814fb30 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7da65640 1 -- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae78156600 msgr2=0x7fae7814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7da65640 1 --2- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae78156600 0x7fae7814f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7da65640 1 -- 172.21.15.26:0/530109826 >> v1:172.21.15.26:6789/0 conn(0x7fae7814fb30 legacy=0x7fae780aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7ca63640 1 -- 172.21.15.26:0/530109826 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481703800 0 0) 0x7fae64003530 con 0x7fae7814fb30 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7da65640 1 -- 172.21.15.26:0/530109826 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78152740 con 0x7fae780a86d0 2023-11-28T16:59:30.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.484+0000 7fae7d264640 1 --2- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae78156600 0x7fae7814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7da65640 1 --2- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 0x7fae780a8f30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fae740097c0 tx=0x7fae7401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1137ae8778681cfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7ca63640 1 -- 172.21.15.26:0/530109826 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70001a00 con 0x7fae780a86d0 2023-11-28T16:59:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7ca63640 1 -- 172.21.15.26:0/530109826 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae740a7050 con 0x7fae780a86d0 2023-11-28T16:59:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7ca63640 1 -- 172.21.15.26:0/530109826 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740ab620 con 0x7fae780a86d0 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 -- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 msgr2=0x7fae780a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 0x7fae780a8f30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fae740097c0 tx=0x7fae7401c3a0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 -- 172.21.15.26:0/530109826 shutdown_connections 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae78156600 0x7fae7814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/530109826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 0x7fae780a8f30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 -- 172.21.15.26:0/530109826 >> 172.21.15.26:0/530109826 conn(0x7fae780c2a60 msgr2=0x7fae780c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 -- 172.21.15.26:0/530109826 shutdown_connections 2023-11-28T16:59:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.488+0000 7fae7fcc9640 1 -- 172.21.15.26:0/530109826 wait complete. 2023-11-28T16:59:30.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 Processor -- start 2023-11-28T16:59:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 -- start start 2023-11-28T16:59:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 0x7fae781ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae7814fb30 0x7fae7814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae78156600 0x7fae781f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae781edf50 con 0x7fae78156600 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae781ed4a0 con 0x7fae780a86d0 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7814ee80 con 0x7fae7814fb30 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7e266640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae78156600 0x7fae781f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae7814fb30 0x7fae7814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7da65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 0x7fae781ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae7814fb30 0x7fae7814e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:33938/0 (socket says 172.21.15.26:33938) 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 -- 172.21.15.26:0/2925457614 learned_addr learned my addr 172.21.15.26:0/2925457614 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 -- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 msgr2=0x7fae781ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 0x7fae781ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 -- 172.21.15.26:0/2925457614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae78156600 msgr2=0x7fae781f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae78156600 0x7fae781f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 -- 172.21.15.26:0/2925457614 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68009420 con 0x7fae7814fb30 2023-11-28T16:59:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7d264640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae7814fb30 0x7fae7814e330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae6800e980 tx=0x7fae6800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae6e7fc640 1 -- 172.21.15.26:0/2925457614 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800ca00 con 0x7fae7814fb30 2023-11-28T16:59:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae6e7fc640 1 -- 172.21.15.26:0/2925457614 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800cb60 con 0x7fae7814fb30 2023-11-28T16:59:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae6e7fc640 1 -- 172.21.15.26:0/2925457614 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68013470 con 0x7fae7814fb30 2023-11-28T16:59:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae74009420 con 0x7fae7814fb30 2023-11-28T16:59:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.492+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae781ed990 con 0x7fae7814fb30 2023-11-28T16:59:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.496+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7804e890 con 0x7fae7814fb30 2023-11-28T16:59:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.496+0000 7fae6e7fc640 1 -- 172.21.15.26:0/2925457614 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fae680135d0 con 0x7fae7814fb30 2023-11-28T16:59:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.496+0000 7fae6e7fc640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae5c0668d0 0x7fae5c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.496+0000 7fae6e7fc640 1 -- 172.21.15.26:0/2925457614 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fae68084970 con 0x7fae7814fb30 2023-11-28T16:59:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.496+0000 7fae7da65640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae5c0668d0 0x7fae5c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.496+0000 7fae7da65640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae5c0668d0 0x7fae5c068d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fae740ad000 tx=0x7fae740a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.500+0000 7fae6e7fc640 1 -- 172.21.15.26:0/2925457614 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae680518f0 con 0x7fae7814fb30 2023-11-28T16:59:30.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.656+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae780c0670 con 0x7fae7814fb30 2023-11-28T16:59:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae6e7fc640 1 -- 172.21.15.26:0/2925457614 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae68054f10 con 0x7fae7814fb30 2023-11-28T16:59:30.662 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae5c0668d0 msgr2=0x7fae5c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae5c0668d0 0x7fae5c068d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fae740ad000 tx=0x7fae740a6000 comp rx=0 tx=0).stop 2023-11-28T16:59:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae7814fb30 msgr2=0x7fae7814e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae7814fb30 0x7fae7814e330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae6800e980 tx=0x7fae6800ee40 comp rx=0 tx=0).stop 2023-11-28T16:59:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 shutdown_connections 2023-11-28T16:59:30.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae78156600 0x7fae781f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae5c0668d0 0x7fae5c068d90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae7814fb30 0x7fae7814e330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 --2- 172.21.15.26:0/2925457614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780a86d0 0x7fae781ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 >> 172.21.15.26:0/2925457614 conn(0x7fae780c2a60 msgr2=0x7fae7814f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:30.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 shutdown_connections 2023-11-28T16:59:30.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.660+0000 7fae7fcc9640 1 -- 172.21.15.26:0/2925457614 wait complete. 2023-11-28T16:59:30.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:59:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.824+0000 7f0e4790f640 1 Processor -- start 2023-11-28T16:59:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e4790f640 1 -- start start 2023-11-28T16:59:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e4790f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e4014eaf0 0x7f0e40151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e4790f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e4790f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4006de00 con 0x7f0e40151f90 2023-11-28T16:59:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e4790f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40070390 con 0x7f0e4014eaf0 2023-11-28T16:59:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e4790f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4014eed0 con 0x7f0e400c0370 2023-11-28T16:59:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e45eac640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e456ab640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e4014eaf0 0x7f0e40151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e45eac640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4006d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:33950/0 (socket says 172.21.15.26:33950) 2023-11-28T16:59:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e45eac640 1 -- 172.21.15.26:0/3654394106 learned_addr learned my addr 172.21.15.26:0/3654394106 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e45eac640 1 -- 172.21.15.26:0/3654394106 >> v2:172.21.15.79:3300/0 conn(0x7f0e4014eaf0 msgr2=0x7f0e40151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e45eac640 1 --2- 172.21.15.26:0/3654394106 >> v2:172.21.15.79:3300/0 conn(0x7f0e4014eaf0 0x7f0e40151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e45eac640 1 -- 172.21.15.26:0/3654394106 >> v1:172.21.15.79:6789/0 conn(0x7f0e40151f90 legacy=0x7f0e4006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.828+0000 7f0e45eac640 1 -- 172.21.15.26:0/3654394106 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40151270 con 0x7f0e400c0370 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e45eac640 1 --2- 172.21.15.26:0/3654394106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4006d820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009e50 tx=0x7f0e3801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=147f6f7aa2e23f96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e37fff640 1 -- 172.21.15.26:0/3654394106 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380a5780 con 0x7f0e400c0370 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e37fff640 1 -- 172.21.15.26:0/3654394106 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e380a58e0 con 0x7f0e400c0370 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e37fff640 1 -- 172.21.15.26:0/3654394106 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380a5c70 con 0x7f0e400c0370 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 -- 172.21.15.26:0/3654394106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 msgr2=0x7f0e4006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 --2- 172.21.15.26:0/3654394106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4006d820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009e50 tx=0x7f0e3801c8c0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 -- 172.21.15.26:0/3654394106 shutdown_connections 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 --2- 172.21.15.26:0/3654394106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4006d820 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 --2- 172.21.15.26:0/3654394106 >> v2:172.21.15.79:3300/0 conn(0x7f0e4014eaf0 0x7f0e40151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 -- 172.21.15.26:0/3654394106 >> 172.21.15.26:0/3654394106 conn(0x7f0e400c2a60 msgr2=0x7f0e400c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 -- 172.21.15.26:0/3654394106 shutdown_connections 2023-11-28T16:59:30.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.832+0000 7f0e4790f640 1 -- 172.21.15.26:0/3654394106 wait complete. 2023-11-28T16:59:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 Processor -- start 2023-11-28T16:59:30.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 -- start start 2023-11-28T16:59:30.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4014eaf0 0x7f0e40144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e401377b0 0x7f0e40144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40145480 con 0x7f0e401377b0 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40137620 con 0x7f0e4014eaf0 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e401eea40 con 0x7f0e400c0370 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e401377b0 0x7f0e40144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e456ab640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e44eaa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4014eaf0 0x7f0e40144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e401377b0 0x7f0e40144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49320/0 (socket says 172.21.15.26:49320) 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 -- 172.21.15.26:0/1342057970 learned_addr learned my addr 172.21.15.26:0/1342057970 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 -- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 msgr2=0x7f0e4014a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4014a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 -- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4014eaf0 msgr2=0x7f0e40144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4014eaf0 0x7f0e40144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 -- 172.21.15.26:0/1342057970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38009b30 con 0x7f0e401377b0 2023-11-28T16:59:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e456ab640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e45eac640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e401377b0 0x7f0e40144f40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0e380af040 tx=0x7f0e38019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e35ffb640 1 -- 172.21.15.26:0/1342057970 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380b8670 con 0x7f0e401377b0 2023-11-28T16:59:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e35ffb640 1 -- 172.21.15.26:0/1342057970 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e380b87d0 con 0x7f0e401377b0 2023-11-28T16:59:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e35ffb640 1 -- 172.21.15.26:0/1342057970 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380b8b80 con 0x7f0e401377b0 2023-11-28T16:59:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e401eed20 con 0x7f0e401377b0 2023-11-28T16:59:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e401ef2e0 con 0x7f0e401377b0 2023-11-28T16:59:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.836+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4004e890 con 0x7f0e401377b0 2023-11-28T16:59:30.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.840+0000 7f0e35ffb640 1 -- 172.21.15.26:0/1342057970 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0e380b8ce0 con 0x7f0e401377b0 2023-11-28T16:59:30.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.840+0000 7f0e35ffb640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e24066900 0x7f0e24068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:30.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.840+0000 7f0e35ffb640 1 -- 172.21.15.26:0/1342057970 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0e3811faa0 con 0x7f0e401377b0 2023-11-28T16:59:30.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.840+0000 7f0e456ab640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e24066900 0x7f0e24068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:30.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.840+0000 7f0e456ab640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e24066900 0x7f0e24068dc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009eb0 tx=0x7f0e3c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:30.844+0000 7f0e35ffb640 1 -- 172.21.15.26:0/1342057970 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e380eca20 con 0x7f0e401377b0 2023-11-28T16:59:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.000+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e40150f70 con 0x7f0e401377b0 2023-11-28T16:59:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e35ffb640 1 -- 172.21.15.26:0/1342057970 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0e38009510 con 0x7f0e401377b0 2023-11-28T16:59:31.006 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e24066900 msgr2=0x7f0e24068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e24066900 0x7f0e24068dc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009eb0 tx=0x7f0e3c009190 comp rx=0 tx=0).stop 2023-11-28T16:59:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e401377b0 msgr2=0x7f0e40144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e401377b0 0x7f0e40144f40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0e380af040 tx=0x7f0e38019660 comp rx=0 tx=0).stop 2023-11-28T16:59:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 shutdown_connections 2023-11-28T16:59:31.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e401377b0 0x7f0e40144f40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4014eaf0 0x7f0e40144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0e24066900 0x7f0e24068dc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 --2- 172.21.15.26:0/1342057970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e400c0370 0x7f0e4014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 >> 172.21.15.26:0/1342057970 conn(0x7f0e400c2a60 msgr2=0x7f0e4014c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:31.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 shutdown_connections 2023-11-28T16:59:31.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.004+0000 7f0e4790f640 1 -- 172.21.15.26:0/1342057970 wait complete. 2023-11-28T16:59:31.027 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:59:31.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.168+0000 7fd817059640 1 Processor -- start 2023-11-28T16:59:31.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.168+0000 7fd817059640 1 -- start start 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd817059640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8100c7d60 0x7fd8100c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd817059640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8100c4d20 0x7fd810154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd817059640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd810151fc0 con 0x7fd810151be0 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd817059640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd810154640 con 0x7fd8100c4d20 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd817059640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c6910 con 0x7fd8100c7d60 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd816057640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd810151be0 0x7fd810158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53206/0 (socket says 172.21.15.26:53206) 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd816057640 1 -- 172.21.15.26:0/798473669 learned_addr learned my addr 172.21.15.26:0/798473669 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8100c7d60 0x7fd8100c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd816858640 1 --2- 172.21.15.26:0/798473669 >> v2:172.21.15.79:3300/0 conn(0x7fd8100c4d20 0x7fd810154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065110322 0 0) 0x7fd80c001120 con 0x7fd810151be0 2023-11-28T16:59:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc003530 con 0x7fd810151be0 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1262460997 0 0) 0x7fd7fc003530 con 0x7fd810151be0 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8100c7d60 msgr2=0x7fd8100c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8100c7d60 0x7fd8100c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 >> v2:172.21.15.79:3300/0 conn(0x7fd8100c4d20 msgr2=0x7fd810154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 --2- 172.21.15.26:0/798473669 >> v2:172.21.15.79:3300/0 conn(0x7fd8100c4d20 0x7fd810154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100c77e0 con 0x7fd810151be0 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fd80c001810 con 0x7fd810151be0 2023-11-28T16:59:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 >> v1:172.21.15.26:6789/0 conn(0x7fd810151be0 legacy=0x7fd810158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc003980 0x7fd7fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7fc0047d0 0x7fd7fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7fc005190 0x7fd7fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810154640 con 0x7fd7fc0047d0 2023-11-28T16:59:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c6910 con 0x7fd7fc003980 2023-11-28T16:59:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc00bf00 con 0x7fd7fc005190 2023-11-28T16:59:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8100c7d60 0x7fd8100c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:31.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7fc0047d0 0x7fd7fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd816057640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc003980 0x7fd7fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd816858640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7fc005190 0x7fd7fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 -- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7fc005190 msgr2=0x7fd7fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:31.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7fc005190 0x7fd7fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 -- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc003980 msgr2=0x7fd7fc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:31.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc003980 0x7fd7fc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.172+0000 7fd815856640 1 -- 172.21.15.26:0/798473669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc003530 con 0x7fd7fc0047d0 2023-11-28T16:59:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd815856640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7fc0047d0 0x7fd7fc004c50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd8100afff0 tx=0x7fd80001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd2330e8ee6914d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800004030 con 0x7fd7fc0047d0 2023-11-28T16:59:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800004190 con 0x7fd7fc0047d0 2023-11-28T16:59:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd815055640 1 -- 172.21.15.26:0/798473669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800004520 con 0x7fd7fc0047d0 2023-11-28T16:59:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd817059640 1 -- 172.21.15.26:0/798473669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7fc0047d0 msgr2=0x7fd7fc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd817059640 1 --2- 172.21.15.26:0/798473669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7fc0047d0 0x7fd7fc004c50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd8100afff0 tx=0x7fd80001ca30 comp rx=0 tx=0).stop 2023-11-28T16:59:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd816858640 1 -- 172.21.15.26:0/798473669 reap_dead start 2023-11-28T16:59:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd817059640 1 -- 172.21.15.26:0/798473669 shutdown_connections 2023-11-28T16:59:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd817059640 1 -- 172.21.15.26:0/798473669 >> 172.21.15.26:0/798473669 conn(0x7fd8100aba30 msgr2=0x7fd8100abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd817059640 1 -- 172.21.15.26:0/798473669 shutdown_connections 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.176+0000 7fd817059640 1 -- 172.21.15.26:0/798473669 wait complete. 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 Processor -- start 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 -- start start 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc0047d0 0x7fd8100c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd81014b6d0 0x7fd81014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd81014b170 0x7fd8101533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101f14e0 con 0x7fd81014b6d0 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c1560 con 0x7fd7fc0047d0 2023-11-28T16:59:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101f0bb0 con 0x7fd81014b170 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd81014b6d0 0x7fd81014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd81014b6d0 0x7fd81014ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49328/0 (socket says 172.21.15.26:49328) 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 -- 172.21.15.26:0/3425054926 learned_addr learned my addr 172.21.15.26:0/3425054926 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd816057640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc0047d0 0x7fd8100c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd816858640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd81014b170 0x7fd8101533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 -- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd81014b170 msgr2=0x7fd8101533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd81014b170 0x7fd8101533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 -- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc0047d0 msgr2=0x7fd8100c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc0047d0 0x7fd8100c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 -- 172.21.15.26:0/3425054926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8101f0e90 con 0x7fd81014b6d0 2023-11-28T16:59:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd816057640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc0047d0 0x7fd8100c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd815856640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd81014b6d0 0x7fd81014ac30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd80001ca70 tx=0x7fd800019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd806ffd640 1 -- 172.21.15.26:0/3425054926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800003620 con 0x7fd81014b6d0 2023-11-28T16:59:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd806ffd640 1 -- 172.21.15.26:0/3425054926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800003780 con 0x7fd81014b6d0 2023-11-28T16:59:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8101f1170 con 0x7fd81014b6d0 2023-11-28T16:59:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd806ffd640 1 -- 172.21.15.26:0/3425054926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800003b10 con 0x7fd81014b6d0 2023-11-28T16:59:31.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8101f1970 con 0x7fd81014b6d0 2023-11-28T16:59:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.180+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8100c81f0 con 0x7fd81014b6d0 2023-11-28T16:59:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.184+0000 7fd806ffd640 1 -- 172.21.15.26:0/3425054926 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd8000b7070 con 0x7fd81014b6d0 2023-11-28T16:59:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.184+0000 7fd806ffd640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f4066900 0x7fd7f4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.184+0000 7fd806ffd640 1 -- 172.21.15.26:0/3425054926 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd80011e570 con 0x7fd81014b6d0 2023-11-28T16:59:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.184+0000 7fd816057640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f4066900 0x7fd7f4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.184+0000 7fd816057640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f4066900 0x7fd7f4068dc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd80c001ec0 tx=0x7fd80c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:31.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.188+0000 7fd806ffd640 1 -- 172.21.15.26:0/3425054926 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8000eb440 con 0x7fd81014b6d0 2023-11-28T16:59:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.352+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd810074970 con 0x7fd81014b6d0 2023-11-28T16:59:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.352+0000 7fd806ffd640 1 -- 172.21.15.26:0/3425054926 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd8000eea60 con 0x7fd81014b6d0 2023-11-28T16:59:31.356 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:31.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f4066900 msgr2=0x7fd7f4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f4066900 0x7fd7f4068dc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd80c001ec0 tx=0x7fd80c009040 comp rx=0 tx=0).stop 2023-11-28T16:59:31.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd81014b6d0 msgr2=0x7fd81014ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd81014b6d0 0x7fd81014ac30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd80001ca70 tx=0x7fd800019830 comp rx=0 tx=0).stop 2023-11-28T16:59:31.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 shutdown_connections 2023-11-28T16:59:31.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd7f4066900 0x7fd7f4068dc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd81014b170 0x7fd8101533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd81014b6d0 0x7fd81014ac30 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 --2- 172.21.15.26:0/3425054926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc0047d0 0x7fd8100c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 >> 172.21.15.26:0/3425054926 conn(0x7fd8100aba30 msgr2=0x7fd8100ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:31.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 shutdown_connections 2023-11-28T16:59:31.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.356+0000 7fd817059640 1 -- 172.21.15.26:0/3425054926 wait complete. 2023-11-28T16:59:31.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:59:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f23aa640 1 Processor -- start 2023-11-28T16:59:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f23aa640 1 -- start start 2023-11-28T16:59:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f23aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8ec0bd720 0x7fe8ec158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f23aa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec155790 con 0x7fe8ec06cd90 2023-11-28T16:59:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f23aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec0c4b00 con 0x7fe8ec0ca610 2023-11-28T16:59:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f23aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec0c4de0 con 0x7fe8ec0bd720 2023-11-28T16:59:31.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f0947640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe8ec06cd90 0x7fe8ec0c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53882/0 (socket says 172.21.15.26:53882) 2023-11-28T16:59:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8f0947640 1 -- 172.21.15.26:0/3385579202 learned_addr learned my addr 172.21.15.26:0/3385579202 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8eb7fe640 1 --2- 172.21.15.26:0/3385579202 >> v2:172.21.15.79:3300/0 conn(0x7fe8ec0bd720 0x7fe8ec158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8eaffd640 1 -- 172.21.15.26:0/3385579202 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410384177 0 0) 0x7fe8ec155790 con 0x7fe8ec06cd90 2023-11-28T16:59:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8eaffd640 1 -- 172.21.15.26:0/3385579202 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d4003530 con 0x7fe8ec06cd90 2023-11-28T16:59:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8eb7fe640 1 -- 172.21.15.26:0/3385579202 >> v1:172.21.15.79:6789/0 conn(0x7fe8ec0ca610 legacy=0x7fe8ec0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8eb7fe640 1 -- 172.21.15.26:0/3385579202 >> v1:172.21.15.26:6789/0 conn(0x7fe8ec06cd90 legacy=0x7fe8ec0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8eaffd640 1 -- 172.21.15.26:0/3385579202 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127704067 0 0) 0x7fe8d4003530 con 0x7fe8ec06cd90 2023-11-28T16:59:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.520+0000 7fe8eb7fe640 1 -- 172.21.15.26:0/3385579202 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec157e30 con 0x7fe8ec0bd720 2023-11-28T16:59:31.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8eb7fe640 1 --2- 172.21.15.26:0/3385579202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0bd720 0x7fe8ec158350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00097c0 tx=0x7fe8e001bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1779f6d4329070a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:31.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8eaffd640 1 -- 172.21.15.26:0/3385579202 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0c52d0 con 0x7fe8ec0bd720 2023-11-28T16:59:31.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8eaffd640 1 -- 172.21.15.26:0/3385579202 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00a54f0 con 0x7fe8ec0bd720 2023-11-28T16:59:31.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8eaffd640 1 -- 172.21.15.26:0/3385579202 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4001a00 con 0x7fe8ec0bd720 2023-11-28T16:59:31.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3385579202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0bd720 msgr2=0x7fe8ec158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3385579202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0bd720 0x7fe8ec158350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00097c0 tx=0x7fe8e001bf60 comp rx=0 tx=0).stop 2023-11-28T16:59:31.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3385579202 shutdown_connections 2023-11-28T16:59:31.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3385579202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0bd720 0x7fe8ec158350 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3385579202 >> 172.21.15.26:0/3385579202 conn(0x7fe8ec071ea0 msgr2=0x7fe8ec0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:31.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3385579202 shutdown_connections 2023-11-28T16:59:31.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.524+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3385579202 wait complete. 2023-11-28T16:59:31.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 Processor -- start 2023-11-28T16:59:31.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 -- start start 2023-11-28T16:59:31.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec06cd90 0x7fe8ec0c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8ec0bd720 0x7fe8ec0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8ec0ca610 0x7fe8ec0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec141eb0 con 0x7fe8ec0ca610 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec1420c0 con 0x7fe8ec06cd90 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0c30e0 con 0x7fe8ec0bd720 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8ec0ca610 0x7fe8ec0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8ec0ca610 0x7fe8ec0adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36234/0 (socket says 172.21.15.26:36234) 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 -- 172.21.15.26:0/3075958808 learned_addr learned my addr 172.21.15.26:0/3075958808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8eb7fe640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8ec0bd720 0x7fe8ec0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8ebfff640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec06cd90 0x7fe8ec0c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 -- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8ec0bd720 msgr2=0x7fe8ec0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8ec0bd720 0x7fe8ec0c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 -- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec06cd90 msgr2=0x7fe8ec0c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec06cd90 0x7fe8ec0c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 -- 172.21.15.26:0/3075958808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e0009420 con 0x7fe8ec0ca610 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8ebfff640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec06cd90 0x7fe8ec0c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f0947640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8ec0ca610 0x7fe8ec0adfe0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40018a0 tx=0x7fe8e400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8e8ff9640 1 -- 172.21.15.26:0/3075958808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4012400 con 0x7fe8ec0ca610 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8e8ff9640 1 -- 172.21.15.26:0/3075958808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e4012560 con 0x7fe8ec0ca610 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec0c33c0 con 0x7fe8ec0ca610 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.528+0000 7fe8e8ff9640 1 -- 172.21.15.26:0/3075958808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4012910 con 0x7fe8ec0ca610 2023-11-28T16:59:31.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.532+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec0c3980 con 0x7fe8ec0ca610 2023-11-28T16:59:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.532+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec0c3ba0 con 0x7fe8ec0ca610 2023-11-28T16:59:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.532+0000 7fe8e8ff9640 1 -- 172.21.15.26:0/3075958808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe8e4012a70 con 0x7fe8ec0ca610 2023-11-28T16:59:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.532+0000 7fe8e8ff9640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8d8066900 0x7fe8d8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.532+0000 7fe8e8ff9640 1 -- 172.21.15.26:0/3075958808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe8e4084f60 con 0x7fe8ec0ca610 2023-11-28T16:59:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.532+0000 7fe8ebfff640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8d8066900 0x7fe8d8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:31.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.532+0000 7fe8ebfff640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8d8066900 0x7fe8d8068dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec14b1c0 tx=0x7fe8dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:31.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.536+0000 7fe8e8ff9640 1 -- 172.21.15.26:0/3075958808 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8e4051e30 con 0x7fe8ec0ca610 2023-11-28T16:59:31.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.704+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8ec04e890 con 0x7fe8ec0ca610 2023-11-28T16:59:31.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.704+0000 7fe8e8ff9640 1 -- 172.21.15.26:0/3075958808 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8e4055450 con 0x7fe8ec0ca610 2023-11-28T16:59:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:59:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8d8066900 msgr2=0x7fe8d8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8d8066900 0x7fe8d8068dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec14b1c0 tx=0x7fe8dc009040 comp rx=0 tx=0).stop 2023-11-28T16:59:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8ec0ca610 msgr2=0x7fe8ec0adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8ec0ca610 0x7fe8ec0adfe0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40018a0 tx=0x7fe8e400a430 comp rx=0 tx=0).stop 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 shutdown_connections 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8ec0ca610 0x7fe8ec0adfe0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe8d8066900 0x7fe8d8068dc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8ec0bd720 0x7fe8ec0c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 --2- 172.21.15.26:0/3075958808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec06cd90 0x7fe8ec0c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 >> 172.21.15.26:0/3075958808 conn(0x7fe8ec071ea0 msgr2=0x7fe8ec156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 shutdown_connections 2023-11-28T16:59:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:31.708+0000 7fe8f23aa640 1 -- 172.21.15.26:0/3075958808 wait complete. 2023-11-28T16:59:31.730 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-28T16:59:31.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:31.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T16:59:31.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T16:59:31.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:31.759 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T16:59:31.810 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:31.811 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:31.821 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:31.821 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:31.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c3d65640 1 Processor -- start 2023-11-28T16:59:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c3d65640 1 -- start start 2023-11-28T16:59:32.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c3d65640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54bc0bd720 0x7f54bc158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c3d65640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc155790 con 0x7f54bc0ca610 2023-11-28T16:59:32.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c3d65640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0c4b00 con 0x7f54bc06cd90 2023-11-28T16:59:32.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c3d65640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0c4de0 con 0x7f54bc0bd720 2023-11-28T16:59:32.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c1b01640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f54bc0ca610 0x7f54bc0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53898/0 (socket says 172.21.15.26:53898) 2023-11-28T16:59:32.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c1b01640 1 -- 172.21.15.26:0/3953120635 learned_addr learned my addr 172.21.15.26:0/3953120635 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c1300640 1 --2- 172.21.15.26:0/3953120635 >> v2:172.21.15.79:3300/0 conn(0x7f54bc0bd720 0x7f54bc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653355100 0 0) 0x7f54bc155790 con 0x7f54bc0ca610 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a8003530 con 0x7f54bc0ca610 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676696113 0 0) 0x7f54bc0c4b00 con 0x7f54bc06cd90 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54bc155790 con 0x7f54bc06cd90 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 371015298 0 0) 0x7f54a8003530 con 0x7f54bc0ca610 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 >> v2:172.21.15.79:3300/0 conn(0x7f54bc0bd720 msgr2=0x7f54bc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 --2- 172.21.15.26:0/3953120635 >> v2:172.21.15.79:3300/0 conn(0x7f54bc0bd720 0x7f54bc158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 >> v1:172.21.15.79:6789/0 conn(0x7f54bc06cd90 legacy=0x7f54bc0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc157e30 con 0x7f54bc0ca610 2023-11-28T16:59:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f54b8001680 con 0x7f54bc0ca610 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 >> v1:172.21.15.26:6789/0 conn(0x7f54bc0ca610 legacy=0x7f54bc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a8003b10 0x7f54a8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54a8005200 0x7f54a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0c4de0 con 0x7f54a80047d0 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a800c160 con 0x7f54a8003b10 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a800c320 con 0x7f54a8005200 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.012+0000 7f54c1300640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c2302640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54a8005200 0x7f54a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c1b01640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a8003b10 0x7f54a8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c1300640 1 -- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54a8005200 msgr2=0x7f54a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c1300640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54a8005200 0x7f54a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c1300640 1 -- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a8003b10 msgr2=0x7f54a8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c1300640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a8003b10 0x7f54a8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c1300640 1 -- 172.21.15.26:0/3953120635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8003530 con 0x7f54a80047d0 2023-11-28T16:59:32.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c2302640 1 -- 172.21.15.26:0/3953120635 reap_dead start 2023-11-28T16:59:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c1300640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54a8004c50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009ae0 tx=0x7f54ac01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17233094b208a375 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0c52d0 con 0x7f54a80047d0 2023-11-28T16:59:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac0a4b90 con 0x7f54a80047d0 2023-11-28T16:59:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c0aff640 1 -- 172.21.15.26:0/3953120635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0ac440 con 0x7f54a80047d0 2023-11-28T16:59:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c3d65640 1 -- 172.21.15.26:0/3953120635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 msgr2=0x7f54a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c3d65640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54a8004c50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009ae0 tx=0x7f54ac01c730 comp rx=0 tx=0).stop 2023-11-28T16:59:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c3d65640 1 -- 172.21.15.26:0/3953120635 shutdown_connections 2023-11-28T16:59:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c3d65640 1 --2- 172.21.15.26:0/3953120635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54a8004c50 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.016+0000 7f54c3d65640 1 -- 172.21.15.26:0/3953120635 >> 172.21.15.26:0/3953120635 conn(0x7f54bc071ea0 msgr2=0x7f54bc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 -- 172.21.15.26:0/3953120635 shutdown_connections 2023-11-28T16:59:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 -- 172.21.15.26:0/3953120635 wait complete. 2023-11-28T16:59:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 Processor -- start 2023-11-28T16:59:32.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 -- start start 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54bc0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54bc0abee0 0x7f54bc1edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54bc1ee140 0x7f54bc14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0aa010 con 0x7f54a80047d0 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1f18d0 con 0x7f54bc0abee0 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0a9db0 con 0x7f54bc1ee140 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54bc0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54bc0c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36258/0 (socket says 172.21.15.26:36258) 2023-11-28T16:59:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 -- 172.21.15.26:0/1708907555 learned_addr learned my addr 172.21.15.26:0/1708907555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1300640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54bc0abee0 0x7f54bc1edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c2302640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54bc1ee140 0x7f54bc14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 -- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54bc1ee140 msgr2=0x7f54bc14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54bc1ee140 0x7f54bc14c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 -- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54bc0abee0 msgr2=0x7f54bc1edc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54bc0abee0 0x7f54bc1edc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 -- 172.21.15.26:0/1708907555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0a9b10 con 0x7f54a80047d0 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c1b01640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54bc0c8450 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e860 tx=0x7f54b800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54b27fc640 1 -- 172.21.15.26:0/1708907555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800ee50 con 0x7f54a80047d0 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54b27fc640 1 -- 172.21.15.26:0/1708907555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b800c8d0 con 0x7f54a80047d0 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.020+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc1f1280 con 0x7f54a80047d0 2023-11-28T16:59:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.024+0000 7f54b27fc640 1 -- 172.21.15.26:0/1708907555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800cc80 con 0x7f54a80047d0 2023-11-28T16:59:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.024+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc0aeec0 con 0x7f54a80047d0 2023-11-28T16:59:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.024+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc04e890 con 0x7f54a80047d0 2023-11-28T16:59:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.024+0000 7f54b27fc640 1 -- 172.21.15.26:0/1708907555 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f54b8013420 con 0x7f54a80047d0 2023-11-28T16:59:32.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.024+0000 7f54b27fc640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54a0066900 0x7f54a0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.024+0000 7f54b27fc640 1 -- 172.21.15.26:0/1708907555 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f54b8084100 con 0x7f54a80047d0 2023-11-28T16:59:32.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.024+0000 7f54c1300640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54a0066900 0x7f54a0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.028+0000 7f54c1300640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54a0066900 0x7f54a0068dc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0ae000 tx=0x7f54ac0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.032+0000 7f54b27fc640 1 -- 172.21.15.26:0/1708907555 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54b8051120 con 0x7f54a80047d0 2023-11-28T16:59:32.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.192+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54bc06cb70 con 0x7f54a80047d0 2023-11-28T16:59:32.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.192+0000 7f54b27fc640 1 -- 172.21.15.26:0/1708907555 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7f54b8054740 con 0x7f54a80047d0 2023-11-28T16:59:32.196 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:32.197 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:32.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54a0066900 msgr2=0x7f54a0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54a0066900 0x7f54a0068dc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0ae000 tx=0x7f54ac0046d0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 msgr2=0x7f54bc0c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54bc0c8450 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e860 tx=0x7f54b800ed20 comp rx=0 tx=0).stop 2023-11-28T16:59:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 shutdown_connections 2023-11-28T16:59:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f54a0066900 0x7f54a0068dc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54bc1ee140 0x7f54bc14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54bc0abee0 0x7f54bc1edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 --2- 172.21.15.26:0/1708907555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a80047d0 0x7f54bc0c8450 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 >> 172.21.15.26:0/1708907555 conn(0x7f54bc071ea0 msgr2=0x7f54bc072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 shutdown_connections 2023-11-28T16:59:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.196+0000 7f54c3d65640 1 -- 172.21.15.26:0/1708907555 wait complete. 2023-11-28T16:59:32.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:58:55.413723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:58:56.230719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:59:08.379611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:59:09.728280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:32.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.360+0000 7f44c479d640 1 Processor -- start 2023-11-28T16:59:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.360+0000 7f44c479d640 1 -- start start 2023-11-28T16:59:32.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c479d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 0x7f44bc06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c479d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc06de00 con 0x7f44bc0c0370 2023-11-28T16:59:32.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c479d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc070390 con 0x7f44bc14eaf0 2023-11-28T16:59:32.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c479d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc14eed0 con 0x7f44bc0a8470 2023-11-28T16:59:32.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1d38640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f44bc0c0370 0x7f44bc06d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53912/0 (socket says 172.21.15.26:53912) 2023-11-28T16:59:32.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1d38640 1 -- 172.21.15.26:0/124415003 learned_addr learned my addr 172.21.15.26:0/124415003 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:32.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2d3a640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 0x7f44bc06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492950795 0 0) 0x7f44bc06de00 con 0x7f44bc0c0370 2023-11-28T16:59:32.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a8003530 con 0x7f44bc0c0370 2023-11-28T16:59:32.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69883673 0 0) 0x7f44a8003530 con 0x7f44bc0c0370 2023-11-28T16:59:32.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 msgr2=0x7f44bc06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 0x7f44bc06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 >> v1:172.21.15.79:6789/0 conn(0x7f44bc14eaf0 legacy=0x7f44bc151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc151270 con 0x7f44bc0c0370 2023-11-28T16:59:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f44ac001680 con 0x7f44bc0c0370 2023-11-28T16:59:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 >> v1:172.21.15.26:6789/0 conn(0x7f44bc0c0370 legacy=0x7f44bc06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a80039b0 0x7f44a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 0x7f44a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44a8005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc14eed0 con 0x7f44a8004d10 2023-11-28T16:59:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a800bbd0 con 0x7f44a80039b0 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a800bd90 con 0x7f44bc0a8470 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2d3a640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44a8005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2539640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a80039b0 0x7f44a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c1d38640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 0x7f44a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2d3a640 1 -- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 msgr2=0x7f44a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2d3a640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc0a8470 0x7f44a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2d3a640 1 -- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a80039b0 msgr2=0x7f44a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2d3a640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a80039b0 0x7f44a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.364+0000 7f44c2d3a640 1 -- 172.21.15.26:0/124415003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a8003530 con 0x7f44a8004d10 2023-11-28T16:59:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c2d3a640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44a8005170 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009fc0 tx=0x7f44b401ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711a6ba6b6bb0de3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a7e80 con 0x7f44a8004d10 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b400f040 con 0x7f44a8004d10 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c1537640 1 -- 172.21.15.26:0/124415003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40af660 con 0x7f44a8004d10 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c479d640 1 -- 172.21.15.26:0/124415003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 msgr2=0x7f44a8005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c479d640 1 --2- 172.21.15.26:0/124415003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44a8005170 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009fc0 tx=0x7f44b401ee70 comp rx=0 tx=0).stop 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c2d3a640 1 -- 172.21.15.26:0/124415003 reap_dead start 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c479d640 1 -- 172.21.15.26:0/124415003 shutdown_connections 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c479d640 1 -- 172.21.15.26:0/124415003 >> 172.21.15.26:0/124415003 conn(0x7f44bc0c2a60 msgr2=0x7f44bc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:32.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c479d640 1 -- 172.21.15.26:0/124415003 shutdown_connections 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c479d640 1 -- 172.21.15.26:0/124415003 wait complete. 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.368+0000 7f44c479d640 1 Processor -- start 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 -- start start 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44bc152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44bc1e9940 0x7f44bc144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc144a60 0x7f44bc13b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc1e9da0 con 0x7f44a8004d10 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc1546e0 con 0x7f44bc1e9940 2023-11-28T16:59:32.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc143480 con 0x7f44bc144a60 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44bc152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44bc152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36268/0 (socket says 172.21.15.26:36268) 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 -- 172.21.15.26:0/1968169595 learned_addr learned my addr 172.21.15.26:0/1968169595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c1d38640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44bc1e9940 0x7f44bc144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2d3a640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc144a60 0x7f44bc13b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 -- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc144a60 msgr2=0x7f44bc13b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc144a60 0x7f44bc13b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 -- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44bc1e9940 msgr2=0x7f44bc144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44bc1e9940 0x7f44bc144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 -- 172.21.15.26:0/1968169595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc143760 con 0x7f44a8004d10 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2d3a640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc144a60 0x7f44bc13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c2539640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44bc152430 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f44b800f610 tx=0x7f44b800fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44b2ffd640 1 -- 172.21.15.26:0/1968169595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80052e0 con 0x7f44a8004d10 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44b2ffd640 1 -- 172.21.15.26:0/1968169595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b8005440 con 0x7f44a8004d10 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44b2ffd640 1 -- 172.21.15.26:0/1968169595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8003820 con 0x7f44a8004d10 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc143a40 con 0x7f44a8004d10 2023-11-28T16:59:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc144000 con 0x7f44a8004d10 2023-11-28T16:59:32.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.372+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc144190 con 0x7f44a8004d10 2023-11-28T16:59:32.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.376+0000 7f44b2ffd640 1 -- 172.21.15.26:0/1968169595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f44b8003980 con 0x7f44a8004d10 2023-11-28T16:59:32.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.376+0000 7f44b2ffd640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f44a00668d0 0x7f44a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.376+0000 7f44b2ffd640 1 -- 172.21.15.26:0/1968169595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f44b80846c0 con 0x7f44a8004d10 2023-11-28T16:59:32.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.376+0000 7f44c1d38640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f44a00668d0 0x7f44a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.376+0000 7f44c1d38640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f44a00668d0 0x7f44a0068d90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f44bc14ad00 tx=0x7f44ac001010 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.380+0000 7f44b2ffd640 1 -- 172.21.15.26:0/1968169595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44b8051500 con 0x7f44a8004d10 2023-11-28T16:59:32.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44bc04e890 con 0x7f44a8004d10 2023-11-28T16:59:32.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44b2ffd640 1 -- 172.21.15.26:0/1968169595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44b8054b20 con 0x7f44a8004d10 2023-11-28T16:59:32.543 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f44a00668d0 msgr2=0x7f44a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f44a00668d0 0x7f44a0068d90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f44bc14ad00 tx=0x7f44ac001010 comp rx=0 tx=0).stop 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 msgr2=0x7f44bc152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44bc152430 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f44b800f610 tx=0x7f44b800fad0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 shutdown_connections 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f44a00668d0 0x7f44a0068d90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44bc144a60 0x7f44bc13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44bc1e9940 0x7f44bc144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 --2- 172.21.15.26:0/1968169595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44a8004d10 0x7f44bc152430 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 >> 172.21.15.26:0/1968169595 conn(0x7f44bc0c2a60 msgr2=0x7f44bc071520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 shutdown_connections 2023-11-28T16:59:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.540+0000 7f44c479d640 1 -- 172.21.15.26:0/1968169595 wait complete. 2023-11-28T16:59:32.564 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:59:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae3225f640 1 Processor -- start 2023-11-28T16:59:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae3225f640 1 -- start start 2023-11-28T16:59:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae3225f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae2c0700f0 0x7fae2c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae3225f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae2c06df30 0x7fae2c0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae3225f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c154b90 con 0x7fae2c154000 2023-11-28T16:59:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae3225f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0a8710 con 0x7fae2c06df30 2023-11-28T16:59:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae3225f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0abd70 con 0x7fae2c0700f0 2023-11-28T16:59:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae2bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae2c06df30 0x7fae2c0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae2bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae2c06df30 0x7fae2c0714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36280/0 (socket says 172.21.15.26:36280) 2023-11-28T16:59:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae2bfff640 1 -- 172.21.15.26:0/3104571298 learned_addr learned my addr 172.21.15.26:0/3104571298 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae23fff640 1 --2- 172.21.15.26:0/3104571298 >> v2:172.21.15.79:3300/0 conn(0x7fae2c0700f0 0x7fae2c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae2bfff640 1 -- 172.21.15.26:0/3104571298 >> v2:172.21.15.79:3300/0 conn(0x7fae2c0700f0 msgr2=0x7fae2c070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae2bfff640 1 --2- 172.21.15.26:0/3104571298 >> v2:172.21.15.79:3300/0 conn(0x7fae2c0700f0 0x7fae2c070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae2bfff640 1 -- 172.21.15.26:0/3104571298 >> v1:172.21.15.79:6789/0 conn(0x7fae2c154000 legacy=0x7fae2c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae2bfff640 1 -- 172.21.15.26:0/3104571298 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0ab820 con 0x7fae2c06df30 2023-11-28T16:59:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.708+0000 7fae23fff640 1 --2- 172.21.15.26:0/3104571298 >> v2:172.21.15.79:3300/0 conn(0x7fae2c0700f0 0x7fae2c070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae2bfff640 1 --2- 172.21.15.26:0/3104571298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c06df30 0x7fae2c0714d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0a8980 tx=0x7fae2401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e374964868b0bca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae2affd640 1 -- 172.21.15.26:0/3104571298 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240a5750 con 0x7fae2c06df30 2023-11-28T16:59:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae2affd640 1 -- 172.21.15.26:0/3104571298 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae240a58b0 con 0x7fae2c06df30 2023-11-28T16:59:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae2affd640 1 -- 172.21.15.26:0/3104571298 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240a5c40 con 0x7fae2c06df30 2023-11-28T16:59:32.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 -- 172.21.15.26:0/3104571298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c06df30 msgr2=0x7fae2c0714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 --2- 172.21.15.26:0/3104571298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c06df30 0x7fae2c0714d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0a8980 tx=0x7fae2401c870 comp rx=0 tx=0).stop 2023-11-28T16:59:32.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 -- 172.21.15.26:0/3104571298 shutdown_connections 2023-11-28T16:59:32.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 --2- 172.21.15.26:0/3104571298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c06df30 0x7fae2c0714d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 --2- 172.21.15.26:0/3104571298 >> v2:172.21.15.79:3300/0 conn(0x7fae2c0700f0 0x7fae2c070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 -- 172.21.15.26:0/3104571298 >> 172.21.15.26:0/3104571298 conn(0x7fae2c0c2a60 msgr2=0x7fae2c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 -- 172.21.15.26:0/3104571298 shutdown_connections 2023-11-28T16:59:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.712+0000 7fae3225f640 1 -- 172.21.15.26:0/3104571298 wait complete. 2023-11-28T16:59:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 Processor -- start 2023-11-28T16:59:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 -- start start 2023-11-28T16:59:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae2c06df30 0x7fae2c1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0700f0 0x7fae2c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae2c154000 0x7fae2c142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c153c10 con 0x7fae2c0700f0 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c145fb0 con 0x7fae2c154000 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c146290 con 0x7fae2c06df30 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0700f0 0x7fae2c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0700f0 0x7fae2c14ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36282/0 (socket says 172.21.15.26:36282) 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 -- 172.21.15.26:0/3416826815 learned_addr learned my addr 172.21.15.26:0/3416826815 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae2b7fe640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae2c06df30 0x7fae2c1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae2bfff640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae2c154000 0x7fae2c142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 -- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae2c06df30 msgr2=0x7fae2c1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae2c06df30 0x7fae2c1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 -- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae2c154000 msgr2=0x7fae2c142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae2c154000 0x7fae2c142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 -- 172.21.15.26:0/3416826815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009b30 con 0x7fae2c0700f0 2023-11-28T16:59:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae2bfff640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae2c154000 0x7fae2c142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae23fff640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0700f0 0x7fae2c14ccb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c7f0 tx=0x7fae1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae28ff9640 1 -- 172.21.15.26:0/3416826815 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14004220 con 0x7fae2c0700f0 2023-11-28T16:59:32.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae28ff9640 1 -- 172.21.15.26:0/3416826815 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae14004380 con 0x7fae2c0700f0 2023-11-28T16:59:32.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae28ff9640 1 -- 172.21.15.26:0/3416826815 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14003840 con 0x7fae2c0700f0 2023-11-28T16:59:32.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c146570 con 0x7fae2c0700f0 2023-11-28T16:59:32.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c143270 con 0x7fae2c0700f0 2023-11-28T16:59:32.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.716+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c145e10 con 0x7fae2c0700f0 2023-11-28T16:59:32.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.720+0000 7fae28ff9640 1 -- 172.21.15.26:0/3416826815 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fae14003bb0 con 0x7fae2c0700f0 2023-11-28T16:59:32.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.720+0000 7fae28ff9640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae0c066900 0x7fae0c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:32.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.720+0000 7fae28ff9640 1 -- 172.21.15.26:0/3416826815 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fae14084690 con 0x7fae2c0700f0 2023-11-28T16:59:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.720+0000 7fae2b7fe640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae0c066900 0x7fae0c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.720+0000 7fae2b7fe640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae0c066900 0x7fae0c068dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00b810 tx=0x7fae1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.724+0000 7fae28ff9640 1 -- 172.21.15.26:0/3416826815 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae2c145e10 con 0x7fae2c0700f0 2023-11-28T16:59:32.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae2c145e10 con 0x7fae2c0700f0 2023-11-28T16:59:32.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae28ff9640 1 -- 172.21.15.26:0/3416826815 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae2c145e10 con 0x7fae2c0700f0 2023-11-28T16:59:32.886 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:32.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae0c066900 msgr2=0x7fae0c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae0c066900 0x7fae0c068dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00b810 tx=0x7fae1c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0700f0 msgr2=0x7fae2c14ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0700f0 0x7fae2c14ccb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c7f0 tx=0x7fae1400ccb0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 shutdown_connections 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae2c154000 0x7fae2c142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0700f0 0x7fae2c14ccb0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fae0c066900 0x7fae0c068dc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 --2- 172.21.15.26:0/3416826815 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae2c06df30 0x7fae2c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 >> 172.21.15.26:0/3416826815 conn(0x7fae2c0c2a60 msgr2=0x7fae2c0a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 shutdown_connections 2023-11-28T16:59:32.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:32.884+0000 7fae3225f640 1 -- 172.21.15.26:0/3416826815 wait complete. 2023-11-28T16:59:32.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:59:33.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.048+0000 7fb2e8e09640 1 Processor -- start 2023-11-28T16:59:33.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.048+0000 7fb2e8e09640 1 -- start start 2023-11-28T16:59:33.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e8e09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb2e414eaf0 0x7fb2e4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e8e09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e4151f90 0x7fb2e406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e8e09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2e40c0370 0x7fb2e406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e8e09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e406de00 con 0x7fb2e40c0370 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e8e09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e4070390 con 0x7fb2e414eaf0 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e8e09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e406db90 con 0x7fb2e4151f90 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2e40c0370 0x7fb2e406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2e40c0370 0x7fb2e406d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36296/0 (socket says 172.21.15.26:36296) 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 -- 172.21.15.26:0/2062209640 learned_addr learned my addr 172.21.15.26:0/2062209640 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e1d9b640 1 --2- 172.21.15.26:0/2062209640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e4151f90 0x7fb2e406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e259c640 1 --2- 172.21.15.26:0/2062209640 >> v2:172.21.15.79:3300/0 conn(0x7fb2e414eaf0 0x7fb2e4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 -- 172.21.15.26:0/2062209640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e4151f90 msgr2=0x7fb2e406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 --2- 172.21.15.26:0/2062209640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e4151f90 0x7fb2e406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 -- 172.21.15.26:0/2062209640 >> v2:172.21.15.79:3300/0 conn(0x7fb2e414eaf0 msgr2=0x7fb2e4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 --2- 172.21.15.26:0/2062209640 >> v2:172.21.15.79:3300/0 conn(0x7fb2e414eaf0 0x7fb2e4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.052+0000 7fb2e2d9d640 1 -- 172.21.15.26:0/2062209640 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e414eed0 con 0x7fb2e40c0370 2023-11-28T16:59:33.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e2d9d640 1 --2- 172.21.15.26:0/2062209640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e406d650 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40c3b00 tx=0x7fb2dc01eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4aea11e96eff4d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e159a640 1 -- 172.21.15.26:0/2062209640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00b2d0 con 0x7fb2e40c0370 2023-11-28T16:59:33.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e159a640 1 -- 172.21.15.26:0/2062209640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00b430 con 0x7fb2e40c0370 2023-11-28T16:59:33.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e159a640 1 -- 172.21.15.26:0/2062209640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0a7b60 con 0x7fb2e40c0370 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 -- 172.21.15.26:0/2062209640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 msgr2=0x7fb2e406d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/2062209640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e406d650 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40c3b00 tx=0x7fb2dc01eab0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 -- 172.21.15.26:0/2062209640 shutdown_connections 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/2062209640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e406d650 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/2062209640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e4151f90 0x7fb2e406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/2062209640 >> v2:172.21.15.79:3300/0 conn(0x7fb2e414eaf0 0x7fb2e4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 -- 172.21.15.26:0/2062209640 >> 172.21.15.26:0/2062209640 conn(0x7fb2e40c2a60 msgr2=0x7fb2e40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 -- 172.21.15.26:0/2062209640 shutdown_connections 2023-11-28T16:59:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 -- 172.21.15.26:0/2062209640 wait complete. 2023-11-28T16:59:33.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 Processor -- start 2023-11-28T16:59:33.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.056+0000 7fb2e8e09640 1 -- start start 2023-11-28T16:59:33.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e4152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2e414eaf0 0x7fb2e40ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e40ab700 0x7fb2e413c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41e98a0 con 0x7fb2e40c0370 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c3fd0 con 0x7fb2e414eaf0 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c3cf0 con 0x7fb2e40ab700 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e4152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e4152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36306/0 (socket says 172.21.15.26:36306) 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 -- 172.21.15.26:0/4053222856 learned_addr learned my addr 172.21.15.26:0/4053222856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e1d9b640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2e414eaf0 0x7fb2e40ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e2d9d640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e40ab700 0x7fb2e413c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 -- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e40ab700 msgr2=0x7fb2e413c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e40ab700 0x7fb2e413c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 -- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2e414eaf0 msgr2=0x7fb2e40ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2e414eaf0 0x7fb2e40ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 -- 172.21.15.26:0/4053222856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc00bd40 con 0x7fb2e40c0370 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e2d9d640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e40ab700 0x7fb2e413c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e1d9b640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2e414eaf0 0x7fb2e40ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e259c640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e4152660 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400d800 tx=0x7fb2d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2d2ffd640 1 -- 172.21.15.26:0/4053222856 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40096a0 con 0x7fb2e40c0370 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2d2ffd640 1 -- 172.21.15.26:0/4053222856 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4009800 con 0x7fb2e40c0370 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e414dcd0 con 0x7fb2e40c0370 2023-11-28T16:59:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2d2ffd640 1 -- 172.21.15.26:0/4053222856 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4009b70 con 0x7fb2e40c0370 2023-11-28T16:59:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e414c320 con 0x7fb2e40c0370 2023-11-28T16:59:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e404e890 con 0x7fb2e40c0370 2023-11-28T16:59:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.060+0000 7fb2d2ffd640 1 -- 172.21.15.26:0/4053222856 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb2d4009cd0 con 0x7fb2e40c0370 2023-11-28T16:59:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.064+0000 7fb2d2ffd640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2c40668d0 0x7fb2c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.064+0000 7fb2d2ffd640 1 -- 172.21.15.26:0/4053222856 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb2d4084f10 con 0x7fb2e40c0370 2023-11-28T16:59:33.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.064+0000 7fb2e1d9b640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2c40668d0 0x7fb2c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.064+0000 7fb2e1d9b640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2c40668d0 0x7fb2c4068d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4148b90 tx=0x7fb2d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.068+0000 7fb2d2ffd640 1 -- 172.21.15.26:0/4053222856 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2d4051de0 con 0x7fb2e40c0370 2023-11-28T16:59:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2e4141dc0 con 0x7fb2e40c0370 2023-11-28T16:59:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2d2ffd640 1 -- 172.21.15.26:0/4053222856 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2d4055400 con 0x7fb2e40c0370 2023-11-28T16:59:33.227 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2c40668d0 msgr2=0x7fb2c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2c40668d0 0x7fb2c4068d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4148b90 tx=0x7fb2d8008040 comp rx=0 tx=0).stop 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 msgr2=0x7fb2e4152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e4152660 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400d800 tx=0x7fb2d400dcc0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 shutdown_connections 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb2c40668d0 0x7fb2c4068d90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2e40ab700 0x7fb2e413c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2e414eaf0 0x7fb2e40ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 --2- 172.21.15.26:0/4053222856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e40c0370 0x7fb2e4152660 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 >> 172.21.15.26:0/4053222856 conn(0x7fb2e40c2a60 msgr2=0x7fb2e406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 shutdown_connections 2023-11-28T16:59:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.224+0000 7fb2e8e09640 1 -- 172.21.15.26:0/4053222856 wait complete. 2023-11-28T16:59:33.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:59:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.388+0000 7fa555ec9640 1 Processor -- start 2023-11-28T16:59:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa555ec9640 1 -- start start 2023-11-28T16:59:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa555ec9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa55014eaf0 0x7fa550151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa555ec9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55006de00 con 0x7fa550151f90 2023-11-28T16:59:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa555ec9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa550070390 con 0x7fa5500c0370 2023-11-28T16:59:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa555ec9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55014eed0 con 0x7fa55014eaf0 2023-11-28T16:59:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa54f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa55014eaf0 0x7fa550151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa547fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa550151f90 0x7fa55006d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53928/0 (socket says 172.21.15.26:53928) 2023-11-28T16:59:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa547fff640 1 -- 172.21.15.26:0/616030463 learned_addr learned my addr 172.21.15.26:0/616030463 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa54f7fe640 1 -- 172.21.15.26:0/616030463 >> v1:172.21.15.79:6789/0 conn(0x7fa5500c0370 legacy=0x7fa55015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa54f7fe640 1 -- 172.21.15.26:0/616030463 >> v1:172.21.15.26:6789/0 conn(0x7fa550151f90 legacy=0x7fa55006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.392+0000 7fa54f7fe640 1 -- 172.21.15.26:0/616030463 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550151270 con 0x7fa55014eaf0 2023-11-28T16:59:33.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa54f7fe640 1 --2- 172.21.15.26:0/616030463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa55014eaf0 0x7fa550151a50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fa5400097c0 tx=0x7fa54001e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95de61401e378c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa54effd640 1 -- 172.21.15.26:0/616030463 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400ad650 con 0x7fa55014eaf0 2023-11-28T16:59:33.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa54effd640 1 -- 172.21.15.26:0/616030463 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5400ad7b0 con 0x7fa55014eaf0 2023-11-28T16:59:33.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa54effd640 1 -- 172.21.15.26:0/616030463 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400adb40 con 0x7fa55014eaf0 2023-11-28T16:59:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 -- 172.21.15.26:0/616030463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa55014eaf0 msgr2=0x7fa550151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 --2- 172.21.15.26:0/616030463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa55014eaf0 0x7fa550151a50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fa5400097c0 tx=0x7fa54001e540 comp rx=0 tx=0).stop 2023-11-28T16:59:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 -- 172.21.15.26:0/616030463 shutdown_connections 2023-11-28T16:59:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 --2- 172.21.15.26:0/616030463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa55014eaf0 0x7fa550151a50 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 -- 172.21.15.26:0/616030463 >> 172.21.15.26:0/616030463 conn(0x7fa5500c2a60 msgr2=0x7fa5500c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 -- 172.21.15.26:0/616030463 shutdown_connections 2023-11-28T16:59:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 -- 172.21.15.26:0/616030463 wait complete. 2023-11-28T16:59:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 Processor -- start 2023-11-28T16:59:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.396+0000 7fa555ec9640 1 -- start start 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5500c0370 0x7fa5500bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa55014eaf0 0x7fa5501f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa55015cbe0 0x7fa5501f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550142ac0 con 0x7fa5500c0370 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500c2800 con 0x7fa55014eaf0 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500c3cd0 con 0x7fa55015cbe0 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5500c0370 0x7fa5500bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5500c0370 0x7fa5500bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36314/0 (socket says 172.21.15.26:36314) 2023-11-28T16:59:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 -- 172.21.15.26:0/4173502535 learned_addr learned my addr 172.21.15.26:0/4173502535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54ffff640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa55015cbe0 0x7fa5501f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa547fff640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa55014eaf0 0x7fa5501f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 -- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa55015cbe0 msgr2=0x7fa5501f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa55015cbe0 0x7fa5501f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 -- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa55014eaf0 msgr2=0x7fa5501f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa55014eaf0 0x7fa5501f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 -- 172.21.15.26:0/4173502535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa540009420 con 0x7fa5500c0370 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa547fff640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa55014eaf0 0x7fa5501f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54f7fe640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5500c0370 0x7fa5500bf5f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa5400af040 tx=0x7fa54001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54cff9640 1 -- 172.21.15.26:0/4173502535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400b6620 con 0x7fa5500c0370 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54cff9640 1 -- 172.21.15.26:0/4173502535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5400b67a0 con 0x7fa5500c0370 2023-11-28T16:59:33.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5500c3fb0 con 0x7fa5500c0370 2023-11-28T16:59:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54cff9640 1 -- 172.21.15.26:0/4173502535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400b6b50 con 0x7fa5500c0370 2023-11-28T16:59:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5500c4570 con 0x7fa5500c0370 2023-11-28T16:59:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55004e890 con 0x7fa5500c0370 2023-11-28T16:59:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.400+0000 7fa54cff9640 1 -- 172.21.15.26:0/4173502535 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa5400ca3a0 con 0x7fa5500c0370 2023-11-28T16:59:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.404+0000 7fa54cff9640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5300668d0 0x7fa530068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.404+0000 7fa54cff9640 1 -- 172.21.15.26:0/4173502535 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa54011fa70 con 0x7fa5500c0370 2023-11-28T16:59:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.404+0000 7fa547fff640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5300668d0 0x7fa530068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.404+0000 7fa547fff640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5300668d0 0x7fa530068d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa5500c5f30 tx=0x7fa538009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.408+0000 7fa54cff9640 1 -- 172.21.15.26:0/4173502535 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5400eca60 con 0x7fa5500c0370 2023-11-28T16:59:33.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.564+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5500707a0 con 0x7fa5500c0370 2023-11-28T16:59:33.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.564+0000 7fa54cff9640 1 -- 172.21.15.26:0/4173502535 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa5400c6020 con 0x7fa5500c0370 2023-11-28T16:59:33.569 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5300668d0 msgr2=0x7fa530068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5300668d0 0x7fa530068d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa5500c5f30 tx=0x7fa538009040 comp rx=0 tx=0).stop 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5500c0370 msgr2=0x7fa5500bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5500c0370 0x7fa5500bf5f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa5400af040 tx=0x7fa54001cd80 comp rx=0 tx=0).stop 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 shutdown_connections 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa5300668d0 0x7fa530068d90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa55015cbe0 0x7fa5501f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa55014eaf0 0x7fa5501f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 --2- 172.21.15.26:0/4173502535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5500c0370 0x7fa5500bf5f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 >> 172.21.15.26:0/4173502535 conn(0x7fa5500c2a60 msgr2=0x7fa550066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:33.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 shutdown_connections 2023-11-28T16:59:33.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.568+0000 7fa555ec9640 1 -- 172.21.15.26:0/4173502535 wait complete. 2023-11-28T16:59:33.590 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:59:33.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe66632640 1 Processor -- start 2023-11-28T16:59:33.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe66632640 1 -- start start 2023-11-28T16:59:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe66632640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe6006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe66632640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6006de00 con 0x7efe6014eaf0 2023-11-28T16:59:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe66632640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe60070390 con 0x7efe600c0370 2023-11-28T16:59:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe66632640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6014eed0 con 0x7efe600a8470 2023-11-28T16:59:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe5ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe6014eaf0 0x7efe60151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53944/0 (socket says 172.21.15.26:53944) 2023-11-28T16:59:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe5ffff640 1 -- 172.21.15.26:0/2194950767 learned_addr learned my addr 172.21.15.26:0/2194950767 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.732+0000 7efe64bcf640 1 --2- 172.21.15.26:0/2194950767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe6006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285097375 0 0) 0x7efe6006de00 con 0x7efe6014eaf0 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe48003530 con 0x7efe6014eaf0 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801370778 0 0) 0x7efe60070390 con 0x7efe600c0370 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe6006de00 con 0x7efe600c0370 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327547015 0 0) 0x7efe48003530 con 0x7efe6014eaf0 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe64bcf640 1 -- 172.21.15.26:0/2194950767 >> v1:172.21.15.79:6789/0 conn(0x7efe600c0370 legacy=0x7efe6006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe64bcf640 1 -- 172.21.15.26:0/2194950767 >> v1:172.21.15.26:6789/0 conn(0x7efe6014eaf0 legacy=0x7efe60151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe64bcf640 1 -- 172.21.15.26:0/2194950767 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60151270 con 0x7efe600a8470 2023-11-28T16:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe64bcf640 1 --2- 172.21.15.26:0/2194950767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe6006d820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe58009dc0 tx=0x7efe5801c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c801e02cc644f002 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50001680 con 0x7efe600a8470 2023-11-28T16:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580a55b0 con 0x7efe600a8470 2023-11-28T16:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.736+0000 7efe5effd640 1 -- 172.21.15.26:0/2194950767 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580a5920 con 0x7efe600a8470 2023-11-28T16:59:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- 172.21.15.26:0/2194950767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 msgr2=0x7efe6006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 --2- 172.21.15.26:0/2194950767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe6006d820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe58009dc0 tx=0x7efe5801c770 comp rx=0 tx=0).stop 2023-11-28T16:59:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- 172.21.15.26:0/2194950767 shutdown_connections 2023-11-28T16:59:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 --2- 172.21.15.26:0/2194950767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe6006d820 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- 172.21.15.26:0/2194950767 >> 172.21.15.26:0/2194950767 conn(0x7efe600c2a60 msgr2=0x7efe600c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- 172.21.15.26:0/2194950767 shutdown_connections 2023-11-28T16:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- 172.21.15.26:0/2194950767 wait complete. 2023-11-28T16:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 Processor -- start 2023-11-28T16:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- start start 2023-11-28T16:59:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe60142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe600c0370 0x7efe6013b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe6014eaf0 0x7efe60138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6013a810 con 0x7efe600c0370 2023-11-28T16:59:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6013c610 con 0x7efe6014eaf0 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe66632640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6013aab0 con 0x7efe600a8470 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe600c0370 0x7efe6013b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe600c0370 0x7efe6013b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36328/0 (socket says 172.21.15.26:36328) 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 -- 172.21.15.26:0/2650970517 learned_addr learned my addr 172.21.15.26:0/2650970517 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5ffff640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe60142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe64bcf640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe6014eaf0 0x7efe60138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 -- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 msgr2=0x7efe60142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe60142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 -- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe6014eaf0 msgr2=0x7efe60138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe6014eaf0 0x7efe60138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.740+0000 7efe5f7fe640 1 -- 172.21.15.26:0/2650970517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009a70 con 0x7efe600c0370 2023-11-28T16:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5f7fe640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe600c0370 0x7efe6013b870 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c430 tx=0x7efe5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5cff9640 1 -- 172.21.15.26:0/2650970517 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540052d0 con 0x7efe600c0370 2023-11-28T16:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5cff9640 1 -- 172.21.15.26:0/2650970517 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54005450 con 0x7efe600c0370 2023-11-28T16:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5cff9640 1 -- 172.21.15.26:0/2650970517 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54003840 con 0x7efe600c0370 2023-11-28T16:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6013ad90 con 0x7efe600c0370 2023-11-28T16:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6013b350 con 0x7efe600c0370 2023-11-28T16:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6013b540 con 0x7efe600c0370 2023-11-28T16:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5cff9640 1 -- 172.21.15.26:0/2650970517 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efe540039a0 con 0x7efe600c0370 2023-11-28T16:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5cff9640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe4c0668d0 0x7efe4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5cff9640 1 -- 172.21.15.26:0/2650970517 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efe54083d10 con 0x7efe600c0370 2023-11-28T16:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.744+0000 7efe5ffff640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe4c0668d0 0x7efe4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.748+0000 7efe5ffff640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe4c0668d0 0x7efe4c068d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efe500011f0 tx=0x7efe50001680 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.748+0000 7efe5cff9640 1 -- 172.21.15.26:0/2650970517 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe54089020 con 0x7efe600c0370 2023-11-28T16:59:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7efe6004e890 con 0x7efe600c0370 2023-11-28T16:59:33.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe5cff9640 1 -- 172.21.15.26:0/2650970517 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7efe540170a0 con 0x7efe600c0370 2023-11-28T16:59:33.908 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe4c0668d0 msgr2=0x7efe4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe4c0668d0 0x7efe4c068d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efe500011f0 tx=0x7efe50001680 comp rx=0 tx=0).stop 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe600c0370 msgr2=0x7efe6013b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe600c0370 0x7efe6013b870 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c430 tx=0x7efe5400c8f0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 shutdown_connections 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe6014eaf0 0x7efe60138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe600c0370 0x7efe6013b870 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efe4c0668d0 0x7efe4c068d90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.904+0000 7efe66632640 1 --2- 172.21.15.26:0/2650970517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe600a8470 0x7efe60142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.908+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 >> 172.21.15.26:0/2650970517 conn(0x7efe600c2a60 msgr2=0x7efe6006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.908+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 shutdown_connections 2023-11-28T16:59:33.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:33.908+0000 7efe66632640 1 -- 172.21.15.26:0/2650970517 wait complete. 2023-11-28T16:59:33.929 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T16:59:34.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.068+0000 7f338952a640 1 Processor -- start 2023-11-28T16:59:34.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.068+0000 7f338952a640 1 -- start start 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f338952a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c2ac0 0x7f3384070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f338952a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33840c5f20 0x7f3384151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f338952a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3384152070 0x7f33840c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f338952a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3384158b20 con 0x7f3384152070 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f338952a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3384070ba0 con 0x7f33840c5f20 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f338952a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384157f10 con 0x7f33840c2ac0 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3384152070 0x7f33840c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3384152070 0x7f33840c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36330/0 (socket says 172.21.15.26:36330) 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 -- 172.21.15.26:0/1768572414 learned_addr learned my addr 172.21.15.26:0/1768572414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f3382ffd640 1 --2- 172.21.15.26:0/1768572414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c2ac0 0x7f3384070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f337bfff640 1 --2- 172.21.15.26:0/1768572414 >> v2:172.21.15.79:3300/0 conn(0x7f33840c5f20 0x7f3384151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 -- 172.21.15.26:0/1768572414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c2ac0 msgr2=0x7f3384070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 --2- 172.21.15.26:0/1768572414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c2ac0 0x7f3384070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 -- 172.21.15.26:0/1768572414 >> v2:172.21.15.79:3300/0 conn(0x7f33840c5f20 msgr2=0x7f3384151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 --2- 172.21.15.26:0/1768572414 >> v2:172.21.15.79:3300/0 conn(0x7f33840c5f20 0x7f3384151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.072+0000 7f33837fe640 1 -- 172.21.15.26:0/1768572414 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33841581f0 con 0x7f3384152070 2023-11-28T16:59:34.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f33837fe640 1 --2- 172.21.15.26:0/1768572414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3384152070 0x7f33840c1290 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f33840ae180 tx=0x7f337c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed813c65c96a8f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f33827fc640 1 -- 172.21.15.26:0/1768572414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840c1fe0 con 0x7f3384152070 2023-11-28T16:59:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f33827fc640 1 -- 172.21.15.26:0/1768572414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c0a5790 con 0x7f3384152070 2023-11-28T16:59:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f33827fc640 1 -- 172.21.15.26:0/1768572414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0a5b20 con 0x7f3384152070 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- 172.21.15.26:0/1768572414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3384152070 msgr2=0x7f33840c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 --2- 172.21.15.26:0/1768572414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3384152070 0x7f33840c1290 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f33840ae180 tx=0x7f337c01c910 comp rx=0 tx=0).stop 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- 172.21.15.26:0/1768572414 shutdown_connections 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 --2- 172.21.15.26:0/1768572414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3384152070 0x7f33840c1290 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 --2- 172.21.15.26:0/1768572414 >> v2:172.21.15.79:3300/0 conn(0x7f33840c5f20 0x7f3384151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 --2- 172.21.15.26:0/1768572414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c2ac0 0x7f3384070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- 172.21.15.26:0/1768572414 >> 172.21.15.26:0/1768572414 conn(0x7f33840a9c10 msgr2=0x7f33840aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- 172.21.15.26:0/1768572414 shutdown_connections 2023-11-28T16:59:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- 172.21.15.26:0/1768572414 wait complete. 2023-11-28T16:59:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 Processor -- start 2023-11-28T16:59:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- start start 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33840c2ac0 0x7f338414da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c5f20 0x7f33841550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384152070 0x7f3384147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841494a0 con 0x7f33840c2ac0 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338414d010 con 0x7f3384152070 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f338952a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384148ee0 con 0x7f33840c5f20 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.076+0000 7f3382ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33840c2ac0 0x7f338414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33840c2ac0 0x7f338414da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36334/0 (socket says 172.21.15.26:36334) 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 -- 172.21.15.26:0/2372146423 learned_addr learned my addr 172.21.15.26:0/2372146423 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f337bfff640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c5f20 0x7f33841550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f33837fe640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384152070 0x7f3384147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 -- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c5f20 msgr2=0x7f33841550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c5f20 0x7f33841550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 -- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384152070 msgr2=0x7f3384147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384152070 0x7f3384147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 -- 172.21.15.26:0/2372146423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c009b30 con 0x7f33840c2ac0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f3382ffd640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33840c2ac0 0x7f338414da40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f337400e930 tx=0x7f337400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f337b7fe640 1 -- 172.21.15.26:0/2372146423 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374009690 con 0x7f33840c2ac0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f337b7fe640 1 -- 172.21.15.26:0/2372146423 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337400ca00 con 0x7f33840c2ac0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33841491c0 con 0x7f33840c2ac0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f337b7fe640 1 -- 172.21.15.26:0/2372146423 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400cd70 con 0x7f33840c2ac0 2023-11-28T16:59:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338414d520 con 0x7f33840c2ac0 2023-11-28T16:59:34.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338404e890 con 0x7f33840c2ac0 2023-11-28T16:59:34.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.080+0000 7f337b7fe640 1 -- 172.21.15.26:0/2372146423 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3374013470 con 0x7f33840c2ac0 2023-11-28T16:59:34.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.084+0000 7f337b7fe640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33640668d0 0x7f3364068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.084+0000 7f337b7fe640 1 -- 172.21.15.26:0/2372146423 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f33740849d0 con 0x7f33840c2ac0 2023-11-28T16:59:34.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.084+0000 7f337bfff640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33640668d0 0x7f3364068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.084+0000 7f337bfff640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33640668d0 0x7f3364068d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f33841531c0 tx=0x7f336c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:34.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.088+0000 7f337b7fe640 1 -- 172.21.15.26:0/2372146423 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3374051a10 con 0x7f33840c2ac0 2023-11-28T16:59:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.256+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33840c8a90 con 0x7f33840c2ac0 2023-11-28T16:59:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.256+0000 7f337b7fe640 1 -- 172.21.15.26:0/2372146423 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3374055030 con 0x7f33840c2ac0 2023-11-28T16:59:34.260 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-11-28T16:59:34.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.256+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33640668d0 msgr2=0x7f3364068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.256+0000 7f338952a640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33640668d0 0x7f3364068d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f33841531c0 tx=0x7f336c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:34.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.256+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33840c2ac0 msgr2=0x7f338414da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.256+0000 7f338952a640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33840c2ac0 0x7f338414da40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f337400e930 tx=0x7f337400edf0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 shutdown_connections 2023-11-28T16:59:34.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384152070 0x7f3384147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33640668d0 0x7f3364068d90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33840c5f20 0x7f33841550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 --2- 172.21.15.26:0/2372146423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33840c2ac0 0x7f338414da40 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 >> 172.21.15.26:0/2372146423 conn(0x7f33840a9c10 msgr2=0x7f33840c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:34.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 shutdown_connections 2023-11-28T16:59:34.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.260+0000 7f338952a640 1 -- 172.21.15.26:0/2372146423 wait complete. 2023-11-28T16:59:34.281 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-28T16:59:34.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:34.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T16:59:34.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T16:59:34.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:34.311 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T16:59:34.368 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T16:59:34.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:59:34.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T16:59:34.525 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T16:59:34.526 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:34.526 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:34.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:59:34.535 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:34.535 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:34.545 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:59:34.545 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.716+0000 7f42eff57640 1 Processor -- start 2023-11-28T16:59:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.716+0000 7f42eff57640 1 -- start start 2023-11-28T16:59:34.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.716+0000 7f42eff57640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42e8152ce0 0x7f42e806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.716+0000 7f42eff57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e80c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.716+0000 7f42eff57640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e806bea0 con 0x7f42e806db80 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.716+0000 7f42eff57640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e8159b10 con 0x7f42e8152ce0 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.716+0000 7f42eff57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8159550 con 0x7f42e806d100 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ee4f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e80c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ed4f2640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42e806db80 0x7f42e80700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39228/0 (socket says 172.21.15.26:39228) 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ee4f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e80c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:46202/0 (socket says 172.21.15.26:46202) 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ed4f2640 1 -- 172.21.15.26:0/1384256020 learned_addr learned my addr 172.21.15.26:0/1384256020 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42edcf3640 1 --2- 172.21.15.26:0/1384256020 >> v2:172.21.15.79:3300/0 conn(0x7f42e8152ce0 0x7f42e806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42eccf1640 1 -- 172.21.15.26:0/1384256020 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778903460 0 0) 0x7f42e806bea0 con 0x7f42e806db80 2023-11-28T16:59:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42eccf1640 1 -- 172.21.15.26:0/1384256020 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d4003530 con 0x7f42e806db80 2023-11-28T16:59:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ee4f4640 1 -- 172.21.15.26:0/1384256020 >> v2:172.21.15.79:3300/0 conn(0x7f42e8152ce0 msgr2=0x7f42e806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ee4f4640 1 --2- 172.21.15.26:0/1384256020 >> v2:172.21.15.79:3300/0 conn(0x7f42e8152ce0 0x7f42e806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ee4f4640 1 -- 172.21.15.26:0/1384256020 >> v1:172.21.15.79:6789/0 conn(0x7f42e806db80 legacy=0x7f42e80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ee4f4640 1 -- 172.21.15.26:0/1384256020 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8159830 con 0x7f42e806d100 2023-11-28T16:59:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42edcf3640 1 --2- 172.21.15.26:0/1384256020 >> v2:172.21.15.79:3300/0 conn(0x7f42e8152ce0 0x7f42e806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42ee4f4640 1 --2- 172.21.15.26:0/1384256020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e80c19e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009d90 tx=0x7f42e001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8113644d3bf0b533 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.720+0000 7f42eccf1640 1 -- 172.21.15.26:0/1384256020 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00a5980 con 0x7f42e806d100 2023-11-28T16:59:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eccf1640 1 -- 172.21.15.26:0/1384256020 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00a5ae0 con 0x7f42e806d100 2023-11-28T16:59:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eccf1640 1 -- 172.21.15.26:0/1384256020 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00a5e50 con 0x7f42e806d100 2023-11-28T16:59:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- 172.21.15.26:0/1384256020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 msgr2=0x7f42e80c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 --2- 172.21.15.26:0/1384256020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e80c19e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009d90 tx=0x7f42e001c8c0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- 172.21.15.26:0/1384256020 shutdown_connections 2023-11-28T16:59:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 --2- 172.21.15.26:0/1384256020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e80c19e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 --2- 172.21.15.26:0/1384256020 >> v2:172.21.15.79:3300/0 conn(0x7f42e8152ce0 0x7f42e806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- 172.21.15.26:0/1384256020 >> 172.21.15.26:0/1384256020 conn(0x7f42e80c2ad0 msgr2=0x7f42e80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- 172.21.15.26:0/1384256020 shutdown_connections 2023-11-28T16:59:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- 172.21.15.26:0/1384256020 wait complete. 2023-11-28T16:59:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 Processor -- start 2023-11-28T16:59:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- start start 2023-11-28T16:59:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e81451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e806db80 0x7f42e81456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42e8152ce0 0x7f42e814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e814a680 con 0x7f42e806db80 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8149ad0 con 0x7f42e8152ce0 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42eff57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8149220 con 0x7f42e806d100 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42ed4f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e806db80 0x7f42e81456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42ed4f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e806db80 0x7f42e81456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36336/0 (socket says 172.21.15.26:36336) 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42ed4f2640 1 -- 172.21.15.26:0/3561461039 learned_addr learned my addr 172.21.15.26:0/3561461039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42edcf3640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e81451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.724+0000 7f42ee4f4640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42e8152ce0 0x7f42e814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42ed4f2640 1 -- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 msgr2=0x7f42e81451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42ed4f2640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e81451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42ed4f2640 1 -- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42e8152ce0 msgr2=0x7f42e814aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42ed4f2640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42e8152ce0 0x7f42e814aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42ed4f2640 1 -- 172.21.15.26:0/3561461039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4009420 con 0x7f42e806db80 2023-11-28T16:59:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42ed4f2640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e806db80 0x7f42e81456f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c420 tx=0x7f42d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42de7fc640 1 -- 172.21.15.26:0/3561461039 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8005cf0 con 0x7f42e806db80 2023-11-28T16:59:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42de7fc640 1 -- 172.21.15.26:0/3561461039 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d8005e70 con 0x7f42e806db80 2023-11-28T16:59:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e0009a70 con 0x7f42e806db80 2023-11-28T16:59:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42de7fc640 1 -- 172.21.15.26:0/3561461039 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d80072f0 con 0x7f42e806db80 2023-11-28T16:59:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e8149fc0 con 0x7f42e806db80 2023-11-28T16:59:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e814a7c0 con 0x7f42e806db80 2023-11-28T16:59:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42de7fc640 1 -- 172.21.15.26:0/3561461039 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f42d8007490 con 0x7f42e806db80 2023-11-28T16:59:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42de7fc640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42cc0668d0 0x7f42cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42de7fc640 1 -- 172.21.15.26:0/3561461039 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f42d8083db0 con 0x7f42e806db80 2023-11-28T16:59:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.728+0000 7f42edcf3640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42cc0668d0 0x7f42cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.732+0000 7f42edcf3640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42cc0668d0 0x7f42cc068d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f42e80a8610 tx=0x7f42e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:34.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.732+0000 7f42de7fc640 1 -- 172.21.15.26:0/3561461039 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42e814a7c0 con 0x7f42e806db80 2023-11-28T16:59:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.924+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42e814a7c0 con 0x7f42e806db80 2023-11-28T16:59:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.924+0000 7f42de7fc640 1 -- 172.21.15.26:0/3561461039 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6128 (secure 0 0 0) 0x7f42e814a7c0 con 0x7f42e806db80 2023-11-28T16:59:34.929 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:34.929 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:57.235192+0000","modified":"2023-11-28T16:59:00.256436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3229750931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3229750931},{"type":"v1","addr":"172.21.15.26:6835","nonce":3229750931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 51 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42cc0668d0 msgr2=0x7f42cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42cc0668d0 0x7f42cc068d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f42e80a8610 tx=0x7f42e4008040 comp rx=0 tx=0).stop 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e806db80 msgr2=0x7f42e81456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e806db80 0x7f42e81456f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c420 tx=0x7f42d800c8e0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 shutdown_connections 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42e8152ce0 0x7f42e814aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e806db80 0x7f42e81456f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42cc0668d0 0x7f42cc068d90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 --2- 172.21.15.26:0/3561461039 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42e806d100 0x7f42e81451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 >> 172.21.15.26:0/3561461039 conn(0x7f42e80c2ad0 msgr2=0x7f42e814e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 shutdown_connections 2023-11-28T16:59:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:34.928+0000 7f42eff57640 1 -- 172.21.15.26:0/3561461039 wait complete. 2023-11-28T16:59:34.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:35.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.088+0000 7f759049a640 1 Processor -- start 2023-11-28T16:59:35.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.088+0000 7f759049a640 1 -- start start 2023-11-28T16:59:35.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f759049a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75880ca610 0x7f75880c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f759049a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 0x7f75880c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f759049a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7588155790 con 0x7f758806cd90 2023-11-28T16:59:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f759049a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880c4b00 con 0x7f75880ca610 2023-11-28T16:59:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f759049a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c4de0 con 0x7f75880bd720 2023-11-28T16:59:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f758806cd90 0x7f7588158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53946/0 (socket says 172.21.15.26:53946) 2023-11-28T16:59:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 -- 172.21.15.26:0/2859215093 learned_addr learned my addr 172.21.15.26:0/2859215093 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758da35640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 0x7f75880c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758e236640 1 --2- 172.21.15.26:0/2859215093 >> v2:172.21.15.79:3300/0 conn(0x7f75880ca610 0x7f75880c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405237310 0 0) 0x7f7588155790 con 0x7f758806cd90 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7574003530 con 0x7f758806cd90 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3989238398 0 0) 0x7f7574003530 con 0x7f758806cd90 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 msgr2=0x7f75880c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 0x7f75880c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 >> v2:172.21.15.79:3300/0 conn(0x7f75880ca610 msgr2=0x7f75880c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 --2- 172.21.15.26:0/2859215093 >> v2:172.21.15.79:3300/0 conn(0x7f75880ca610 0x7f75880c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7588157e30 con 0x7f758806cd90 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f7580001a00 con 0x7f758806cd90 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 >> v1:172.21.15.26:6789/0 conn(0x7f758806cd90 legacy=0x7f7588158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7574003980 0x7f7574003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 0x7f75740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f7574005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c4b00 con 0x7f7574004d10 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c4de0 con 0x7f7574003980 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757400ba10 con 0x7f75880bd720 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f7574005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758da35640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 0x7f75740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758e236640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7574003980 0x7f7574003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 -- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 msgr2=0x7f75740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75880bd720 0x7f75740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 -- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7574003980 msgr2=0x7f7574003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7574003980 0x7f7574003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.092+0000 7f758ea37640 1 -- 172.21.15.26:0/2859215093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574003530 con 0x7f7574004d10 2023-11-28T16:59:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f758ea37640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f7574005190 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f758000a830 tx=0x7f758001d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0d3ca53fdc99d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75880c52d0 con 0x7f7574004d10 2023-11-28T16:59:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75800a6680 con 0x7f7574004d10 2023-11-28T16:59:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f758d234640 1 -- 172.21.15.26:0/2859215093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800a6a50 con 0x7f7574004d10 2023-11-28T16:59:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f759049a640 1 -- 172.21.15.26:0/2859215093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 msgr2=0x7f7574005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f759049a640 1 --2- 172.21.15.26:0/2859215093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f7574005190 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f758000a830 tx=0x7f758001d020 comp rx=0 tx=0).stop 2023-11-28T16:59:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f758ea37640 1 -- 172.21.15.26:0/2859215093 reap_dead start 2023-11-28T16:59:35.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f759049a640 1 -- 172.21.15.26:0/2859215093 shutdown_connections 2023-11-28T16:59:35.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f759049a640 1 -- 172.21.15.26:0/2859215093 >> 172.21.15.26:0/2859215093 conn(0x7f7588071ea0 msgr2=0x7f75880722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:35.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f759049a640 1 -- 172.21.15.26:0/2859215093 shutdown_connections 2023-11-28T16:59:35.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.096+0000 7f759049a640 1 -- 172.21.15.26:0/2859215093 wait complete. 2023-11-28T16:59:35.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 Processor -- start 2023-11-28T16:59:35.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 -- start start 2023-11-28T16:59:35.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f75880c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880bdb00 0x7f75881f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75881ee0e0 0x7f75880be320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c33c0 con 0x7f7574004d10 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880bdf80 con 0x7f75880bdb00 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75881f1d30 con 0x7f75881ee0e0 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f75880c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f75880c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36362/0 (socket says 172.21.15.26:36362) 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 -- 172.21.15.26:0/2131790672 learned_addr learned my addr 172.21.15.26:0/2131790672 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 -- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75881ee0e0 msgr2=0x7f75880be320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75881ee0e0 0x7f75880be320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 -- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880bdb00 msgr2=0x7f75881f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880bdb00 0x7f75881f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 -- 172.21.15.26:0/2131790672 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75881edc50 con 0x7f7574004d10 2023-11-28T16:59:35.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f758e236640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f75880c3ef0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f75840119d0 tx=0x7f7584011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f757effd640 1 -- 172.21.15.26:0/2131790672 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758400fad0 con 0x7f7574004d10 2023-11-28T16:59:35.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f757effd640 1 -- 172.21.15.26:0/2131790672 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758400fc30 con 0x7f7574004d10 2023-11-28T16:59:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75880c2290 con 0x7f7574004d10 2023-11-28T16:59:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f757effd640 1 -- 172.21.15.26:0/2131790672 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584014440 con 0x7f7574004d10 2023-11-28T16:59:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75880c2850 con 0x7f7574004d10 2023-11-28T16:59:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.100+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758804e890 con 0x7f7574004d10 2023-11-28T16:59:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.104+0000 7f757effd640 1 -- 172.21.15.26:0/2131790672 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f75840145a0 con 0x7f7574004d10 2023-11-28T16:59:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.104+0000 7f757effd640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f756c066920 0x7f756c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.104+0000 7f757effd640 1 -- 172.21.15.26:0/2131790672 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7584084f70 con 0x7f7574004d10 2023-11-28T16:59:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.104+0000 7f758da35640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f756c066920 0x7f756c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.104+0000 7f758da35640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f756c066920 0x7f756c068de0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f758815b460 tx=0x7f75780095f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.108+0000 7f757effd640 1 -- 172.21.15.26:0/2131790672 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7584051f80 con 0x7f7574004d10 2023-11-28T16:59:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.264+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f758806cb70 con 0x7f7574004d10 2023-11-28T16:59:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f757effd640 1 -- 172.21.15.26:0/2131790672 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7f75840555a0 con 0x7f7574004d10 2023-11-28T16:59:35.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:35.270 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f756c066920 msgr2=0x7f756c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f756c066920 0x7f756c068de0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f758815b460 tx=0x7f75780095f0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 msgr2=0x7f75880c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f75880c3ef0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f75840119d0 tx=0x7f7584011e90 comp rx=0 tx=0).stop 2023-11-28T16:59:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 shutdown_connections 2023-11-28T16:59:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f756c066920 0x7f756c068de0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75881ee0e0 0x7f75880be320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880bdb00 0x7f75881f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 --2- 172.21.15.26:0/2131790672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7574004d10 0x7f75880c3ef0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 >> 172.21.15.26:0/2131790672 conn(0x7f7588071ea0 msgr2=0x7f7588151850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 shutdown_connections 2023-11-28T16:59:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.268+0000 7f759049a640 1 -- 172.21.15.26:0/2131790672 wait complete. 2023-11-28T16:59:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T16:58:55.413723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T16:58:56.230719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:59:08.379611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:59:09.728280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:35.292 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.436+0000 7fe3d41d8640 1 Processor -- start 2023-11-28T16:59:35.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d41d8640 1 -- start start 2023-11-28T16:59:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d41d8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3cc0a86d0 0x7fe3cc0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d41d8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3cc156600 0x7fe3cc14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d41d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc14fb30 0x7fe3cc0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d41d8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc152d90 con 0x7fe3cc0a86d0 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d41d8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc152480 con 0x7fe3cc156600 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d41d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0a9760 con 0x7fe3cc14fb30 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3cc0a86d0 0x7fe3cc0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3cc0a86d0 0x7fe3cc0a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36364/0 (socket says 172.21.15.26:36364) 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 -- 172.21.15.26:0/2768235493 learned_addr learned my addr 172.21.15.26:0/2768235493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d2775640 1 --2- 172.21.15.26:0/2768235493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc14fb30 0x7fe3cc0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1773640 1 --2- 172.21.15.26:0/2768235493 >> v2:172.21.15.79:3300/0 conn(0x7fe3cc156600 0x7fe3cc14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 -- 172.21.15.26:0/2768235493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc14fb30 msgr2=0x7fe3cc0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 --2- 172.21.15.26:0/2768235493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc14fb30 0x7fe3cc0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 -- 172.21.15.26:0/2768235493 >> v2:172.21.15.79:3300/0 conn(0x7fe3cc156600 msgr2=0x7fe3cc14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:35.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 --2- 172.21.15.26:0/2768235493 >> v2:172.21.15.79:3300/0 conn(0x7fe3cc156600 0x7fe3cc14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.440+0000 7fe3d1f74640 1 -- 172.21.15.26:0/2768235493 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc152740 con 0x7fe3cc0a86d0 2023-11-28T16:59:35.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d1f74640 1 --2- 172.21.15.26:0/2768235493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc0a8f30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009870 tx=0x7fe3c801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccb24740662b460 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d0f72640 1 -- 172.21.15.26:0/2768235493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80ab600 con 0x7fe3cc0a86d0 2023-11-28T16:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d0f72640 1 -- 172.21.15.26:0/2768235493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c80a7050 con 0x7fe3cc0a86d0 2023-11-28T16:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d0f72640 1 -- 172.21.15.26:0/2768235493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80ab980 con 0x7fe3cc0a86d0 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 -- 172.21.15.26:0/2768235493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc0a86d0 msgr2=0x7fe3cc0a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/2768235493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc0a8f30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009870 tx=0x7fe3c801c500 comp rx=0 tx=0).stop 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 -- 172.21.15.26:0/2768235493 shutdown_connections 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/2768235493 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc14fb30 0x7fe3cc0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/2768235493 >> v2:172.21.15.79:3300/0 conn(0x7fe3cc156600 0x7fe3cc14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/2768235493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc0a8f30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 -- 172.21.15.26:0/2768235493 >> 172.21.15.26:0/2768235493 conn(0x7fe3cc0c2a60 msgr2=0x7fe3cc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:35.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 -- 172.21.15.26:0/2768235493 shutdown_connections 2023-11-28T16:59:35.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.444+0000 7fe3d41d8640 1 -- 172.21.15.26:0/2768235493 wait complete. 2023-11-28T16:59:35.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 Processor -- start 2023-11-28T16:59:35.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 -- start start 2023-11-28T16:59:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc14fb30 0x7fe3cc14a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc156600 0x7fe3cc14a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc070ed0 con 0x7fe3cc14fb30 2023-11-28T16:59:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1ed940 con 0x7fe3cc0a86d0 2023-11-28T16:59:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1edc20 con 0x7fe3cc156600 2023-11-28T16:59:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc14fb30 0x7fe3cc14a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc14fb30 0x7fe3cc14a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36370/0 (socket says 172.21.15.26:36370) 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 -- 172.21.15.26:0/619190630 learned_addr learned my addr 172.21.15.26:0/619190630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1f74640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d2775640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc156600 0x7fe3cc14a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 -- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc156600 msgr2=0x7fe3cc14a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc156600 0x7fe3cc14a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 -- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3cc0a86d0 msgr2=0x7fe3cc15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 -- 172.21.15.26:0/619190630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80094d0 con 0x7fe3cc14fb30 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1f74640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d1773640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc14fb30 0x7fe3cc14a3e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00d7d0 tx=0x7fe3bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3c27fc640 1 -- 172.21.15.26:0/619190630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc018070 con 0x7fe3cc14fb30 2023-11-28T16:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3c27fc640 1 -- 172.21.15.26:0/619190630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc004020 con 0x7fe3cc14fb30 2023-11-28T16:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3c27fc640 1 -- 172.21.15.26:0/619190630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0041d0 con 0x7fe3cc14fb30 2023-11-28T16:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc1533a0 con 0x7fe3cc14fb30 2023-11-28T16:59:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.448+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc15b8a0 con 0x7fe3cc14fb30 2023-11-28T16:59:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.452+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc153200 con 0x7fe3cc14fb30 2023-11-28T16:59:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.452+0000 7fe3c27fc640 1 -- 172.21.15.26:0/619190630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe3bc004330 con 0x7fe3cc14fb30 2023-11-28T16:59:35.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.452+0000 7fe3c27fc640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3b0066900 0x7fe3b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.452+0000 7fe3c27fc640 1 -- 172.21.15.26:0/619190630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe3bc084430 con 0x7fe3cc14fb30 2023-11-28T16:59:35.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.452+0000 7fe3d1f74640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3b0066900 0x7fe3b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.452+0000 7fe3d1f74640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3b0066900 0x7fe3b0068dc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80ad000 tx=0x7fe3c80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.456+0000 7fe3c27fc640 1 -- 172.21.15.26:0/619190630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3cc153200 con 0x7fe3cc14fb30 2023-11-28T16:59:35.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.612+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3cc153200 con 0x7fe3cc14fb30 2023-11-28T16:59:35.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3c27fc640 1 -- 172.21.15.26:0/619190630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3cc153200 con 0x7fe3cc14fb30 2023-11-28T16:59:35.618 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3b0066900 msgr2=0x7fe3b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3b0066900 0x7fe3b0068dc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80ad000 tx=0x7fe3c80a6000 comp rx=0 tx=0).stop 2023-11-28T16:59:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc14fb30 msgr2=0x7fe3cc14a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc14fb30 0x7fe3cc14a3e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00d7d0 tx=0x7fe3bc00dc90 comp rx=0 tx=0).stop 2023-11-28T16:59:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 shutdown_connections 2023-11-28T16:59:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe3b0066900 0x7fe3b0068dc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3cc156600 0x7fe3cc14a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3cc14fb30 0x7fe3cc14a3e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 --2- 172.21.15.26:0/619190630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3cc0a86d0 0x7fe3cc15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 >> 172.21.15.26:0/619190630 conn(0x7fe3cc0c2a60 msgr2=0x7fe3cc0c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 shutdown_connections 2023-11-28T16:59:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.616+0000 7fe3d41d8640 1 -- 172.21.15.26:0/619190630 wait complete. 2023-11-28T16:59:35.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T16:59:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.780+0000 7f209ec09640 1 Processor -- start 2023-11-28T16:59:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.780+0000 7f209ec09640 1 -- start start 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209ec09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209806b810 0x7f20980c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209ec09640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20980c2a60 0x7f209806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209ec09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2098073710 con 0x7f209806f0d0 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209ec09640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20981589f0 con 0x7f20980c2a60 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209ec09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20981586e0 con 0x7f209806b810 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209d1a6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20980c2a60 0x7f209806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209d1a6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20980c2a60 0x7f209806e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36380/0 (socket says 172.21.15.26:36380) 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209d1a6640 1 -- 172.21.15.26:0/3618056699 learned_addr learned my addr 172.21.15.26:0/3618056699 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:35.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209c9a5640 1 --2- 172.21.15.26:0/3618056699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209806b810 0x7f20980c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209d1a6640 1 -- 172.21.15.26:0/3618056699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209806b810 msgr2=0x7f20980c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:35.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209d1a6640 1 --2- 172.21.15.26:0/3618056699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209806b810 0x7f20980c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209d1a6640 1 -- 172.21.15.26:0/3618056699 >> v1:172.21.15.79:6789/0 conn(0x7f209806f0d0 legacy=0x7f20980bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.784+0000 7f209d1a6640 1 -- 172.21.15.26:0/3618056699 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980a6010 con 0x7f20980c2a60 2023-11-28T16:59:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209d1a6640 1 --2- 172.21.15.26:0/3618056699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20980c2a60 0x7f209806e550 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2090009e50 tx=0x7f209001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3489a3919e7d75bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f20977fe640 1 -- 172.21.15.26:0/3618056699 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900a56e0 con 0x7f20980c2a60 2023-11-28T16:59:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f20977fe640 1 -- 172.21.15.26:0/3618056699 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20900a5840 con 0x7f20980c2a60 2023-11-28T16:59:35.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f20977fe640 1 -- 172.21.15.26:0/3618056699 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900a5bd0 con 0x7f20980c2a60 2023-11-28T16:59:35.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 -- 172.21.15.26:0/3618056699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20980c2a60 msgr2=0x7f209806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 --2- 172.21.15.26:0/3618056699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20980c2a60 0x7f209806e550 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2090009e50 tx=0x7f209001ca10 comp rx=0 tx=0).stop 2023-11-28T16:59:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 -- 172.21.15.26:0/3618056699 shutdown_connections 2023-11-28T16:59:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 --2- 172.21.15.26:0/3618056699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20980c2a60 0x7f209806e550 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 --2- 172.21.15.26:0/3618056699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209806b810 0x7f20980c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 -- 172.21.15.26:0/3618056699 >> 172.21.15.26:0/3618056699 conn(0x7f20980c3240 msgr2=0x7f20980c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 -- 172.21.15.26:0/3618056699 shutdown_connections 2023-11-28T16:59:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 -- 172.21.15.26:0/3618056699 wait complete. 2023-11-28T16:59:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 Processor -- start 2023-11-28T16:59:35.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.788+0000 7f209ec09640 1 -- start start 2023-11-28T16:59:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209806b810 0x7f2098153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f209806f0d0 0x7f2098159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20980c2a60 0x7f20980aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20980c13a0 con 0x7f209806f0d0 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209815f170 con 0x7f209806b810 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20980abce0 con 0x7f20980c2a60 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f209806f0d0 0x7f2098159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f209806f0d0 0x7f2098159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36392/0 (socket says 172.21.15.26:36392) 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 -- 172.21.15.26:0/931392693 learned_addr learned my addr 172.21.15.26:0/931392693 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:35.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209c9a5640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209806b810 0x7f2098153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209d1a6640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20980c2a60 0x7f20980aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 -- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20980c2a60 msgr2=0x7f20980aa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20980c2a60 0x7f20980aa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 -- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209806b810 msgr2=0x7f2098153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209806b810 0x7f2098153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 -- 172.21.15.26:0/931392693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090009b30 con 0x7f209806f0d0 2023-11-28T16:59:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f2097fff640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f209806f0d0 0x7f2098159030 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f208400c500 tx=0x7f208400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f20957fa640 1 -- 172.21.15.26:0/931392693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084005220 con 0x7f209806f0d0 2023-11-28T16:59:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f20957fa640 1 -- 172.21.15.26:0/931392693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2084005380 con 0x7f209806f0d0 2023-11-28T16:59:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f20957fa640 1 -- 172.21.15.26:0/931392693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084007270 con 0x7f209806f0d0 2023-11-28T16:59:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209815ee90 con 0x7f209806f0d0 2023-11-28T16:59:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2098152c20 con 0x7f209806f0d0 2023-11-28T16:59:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2098152e40 con 0x7f209806f0d0 2023-11-28T16:59:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.792+0000 7f20957fa640 1 -- 172.21.15.26:0/931392693 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f20840073d0 con 0x7f209806f0d0 2023-11-28T16:59:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.796+0000 7f20957fa640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f207c0668d0 0x7f207c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.796+0000 7f20957fa640 1 -- 172.21.15.26:0/931392693 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2084083b10 con 0x7f209806f0d0 2023-11-28T16:59:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.796+0000 7f209c9a5640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f207c0668d0 0x7f207c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:35.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.796+0000 7f209c9a5640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f207c0668d0 0x7f207c068d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f209806d8e0 tx=0x7f208c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:35.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.800+0000 7f20957fa640 1 -- 172.21.15.26:0/931392693 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2084050a10 con 0x7f209806f0d0 2023-11-28T16:59:35.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f209804e890 con 0x7f209806f0d0 2023-11-28T16:59:35.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f20957fa640 1 -- 172.21.15.26:0/931392693 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2084054030 con 0x7f209806f0d0 2023-11-28T16:59:35.959 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f207c0668d0 msgr2=0x7f207c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f207c0668d0 0x7f207c068d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f209806d8e0 tx=0x7f208c009190 comp rx=0 tx=0).stop 2023-11-28T16:59:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f209806f0d0 msgr2=0x7f2098159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f209806f0d0 0x7f2098159030 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f208400c500 tx=0x7f208400c9c0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 shutdown_connections 2023-11-28T16:59:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f207c0668d0 0x7f207c068d90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20980c2a60 0x7f20980aa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f209806f0d0 0x7f2098159030 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 --2- 172.21.15.26:0/931392693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209806b810 0x7f2098153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 >> 172.21.15.26:0/931392693 conn(0x7f20980c3240 msgr2=0x7f20980722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 shutdown_connections 2023-11-28T16:59:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:35.956+0000 7f209ec09640 1 -- 172.21.15.26:0/931392693 wait complete. 2023-11-28T16:59:35.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T16:59:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.120+0000 7fd1372d6640 1 Processor -- start 2023-11-28T16:59:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd1372d6640 1 -- start start 2023-11-28T16:59:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd1372d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd130151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd1372d6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd130151f90 0x7fd13006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd1372d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13006de00 con 0x7fd1300c0370 2023-11-28T16:59:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd1372d6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd130070390 con 0x7fd130151f90 2023-11-28T16:59:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd1372d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13014eed0 con 0x7fd13014eaf0 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd135072640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd130151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd135873640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd1300c0370 0x7fd13006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39238/0 (socket says 172.21.15.26:39238) 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd135873640 1 -- 172.21.15.26:0/3392402035 learned_addr learned my addr 172.21.15.26:0/3392402035 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd134871640 1 --2- 172.21.15.26:0/3392402035 >> v2:172.21.15.79:3300/0 conn(0x7fd130151f90 0x7fd13006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd135072640 1 -- 172.21.15.26:0/3392402035 >> v2:172.21.15.79:3300/0 conn(0x7fd130151f90 msgr2=0x7fd13006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd135072640 1 --2- 172.21.15.26:0/3392402035 >> v2:172.21.15.79:3300/0 conn(0x7fd130151f90 0x7fd13006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd135072640 1 -- 172.21.15.26:0/3392402035 >> v1:172.21.15.79:6789/0 conn(0x7fd1300c0370 legacy=0x7fd13006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.124+0000 7fd135072640 1 -- 172.21.15.26:0/3392402035 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130151270 con 0x7fd13014eaf0 2023-11-28T16:59:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd135072640 1 --2- 172.21.15.26:0/3392402035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd130151a50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0097c0 tx=0x7fd12c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f5c2ab6da81b85f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd127fff640 1 -- 172.21.15.26:0/3392402035 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0ab600 con 0x7fd13014eaf0 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd127fff640 1 -- 172.21.15.26:0/3392402035 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0a7050 con 0x7fd13014eaf0 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd127fff640 1 -- 172.21.15.26:0/3392402035 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0ab980 con 0x7fd13014eaf0 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 -- 172.21.15.26:0/3392402035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 msgr2=0x7fd130151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 --2- 172.21.15.26:0/3392402035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd130151a50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0097c0 tx=0x7fd12c01c330 comp rx=0 tx=0).stop 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 -- 172.21.15.26:0/3392402035 shutdown_connections 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 --2- 172.21.15.26:0/3392402035 >> v2:172.21.15.79:3300/0 conn(0x7fd130151f90 0x7fd13006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 --2- 172.21.15.26:0/3392402035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd130151a50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 -- 172.21.15.26:0/3392402035 >> 172.21.15.26:0/3392402035 conn(0x7fd1300c2a60 msgr2=0x7fd1300c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 -- 172.21.15.26:0/3392402035 shutdown_connections 2023-11-28T16:59:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 -- 172.21.15.26:0/3392402035 wait complete. 2023-11-28T16:59:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.128+0000 7fd1372d6640 1 Processor -- start 2023-11-28T16:59:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 -- start start 2023-11-28T16:59:36.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1300c0370 0x7fd13014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd1300aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1300c23b0 0x7fd1300aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130141170 con 0x7fd1300c0370 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301f1a10 con 0x7fd1300c23b0 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301f14b0 con 0x7fd13014eaf0 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1300c0370 0x7fd13014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1300c0370 0x7fd13014a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36400/0 (socket says 172.21.15.26:36400) 2023-11-28T16:59:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 -- 172.21.15.26:0/2491190006 learned_addr learned my addr 172.21.15.26:0/2491190006 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135873640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1300c23b0 0x7fd1300aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd134871640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd1300aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 -- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 msgr2=0x7fd1300aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd1300aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 -- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1300c23b0 msgr2=0x7fd1300aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1300c23b0 0x7fd1300aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 -- 172.21.15.26:0/2491190006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009420 con 0x7fd1300c0370 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd134871640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd1300aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd135072640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1300c0370 0x7fd13014a280 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd12c019f60 tx=0x7fd12c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd125ffb640 1 -- 172.21.15.26:0/2491190006 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0b7450 con 0x7fd1300c0370 2023-11-28T16:59:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd125ffb640 1 -- 172.21.15.26:0/2491190006 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0b75b0 con 0x7fd1300c0370 2023-11-28T16:59:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1300ab7b0 con 0x7fd1300c0370 2023-11-28T16:59:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd125ffb640 1 -- 172.21.15.26:0/2491190006 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0b7960 con 0x7fd1300c0370 2023-11-28T16:59:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1300aa4d0 con 0x7fd1300c0370 2023-11-28T16:59:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.132+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1300aa310 con 0x7fd1300c0370 2023-11-28T16:59:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.136+0000 7fd125ffb640 1 -- 172.21.15.26:0/2491190006 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd12c0b7ac0 con 0x7fd1300c0370 2023-11-28T16:59:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.136+0000 7fd125ffb640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd114066900 0x7fd114068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.136+0000 7fd125ffb640 1 -- 172.21.15.26:0/2491190006 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd12c11eee0 con 0x7fd1300c0370 2023-11-28T16:59:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.136+0000 7fd134871640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd114066900 0x7fd114068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.136+0000 7fd134871640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd114066900 0x7fd114068dc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd130142780 tx=0x7fd120008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.140+0000 7fd125ffb640 1 -- 172.21.15.26:0/2491190006 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd12c0ebdb0 con 0x7fd1300c0370 2023-11-28T16:59:36.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.296+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd13004e890 con 0x7fd1300c0370 2023-11-28T16:59:36.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.296+0000 7fd125ffb640 1 -- 172.21.15.26:0/2491190006 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd12c0b00a0 con 0x7fd1300c0370 2023-11-28T16:59:36.300 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:36.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd114066900 msgr2=0x7fd114068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd114066900 0x7fd114068dc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd130142780 tx=0x7fd120008040 comp rx=0 tx=0).stop 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1300c0370 msgr2=0x7fd13014a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1300c0370 0x7fd13014a280 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd12c019f60 tx=0x7fd12c01ab70 comp rx=0 tx=0).stop 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 shutdown_connections 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1300c23b0 0x7fd1300aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd114066900 0x7fd114068dc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd13014eaf0 0x7fd1300aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 --2- 172.21.15.26:0/2491190006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1300c0370 0x7fd13014a280 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 >> 172.21.15.26:0/2491190006 conn(0x7fd1300c2a60 msgr2=0x7fd1300bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 shutdown_connections 2023-11-28T16:59:36.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.300+0000 7fd1372d6640 1 -- 172.21.15.26:0/2491190006 wait complete. 2023-11-28T16:59:36.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:59:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 Processor -- start 2023-11-28T16:59:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 -- start start 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb6814e590 0x7ffb68154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb680c7d40 0x7ffb680c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb680c4d00 0x7ffb6806b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb681554a0 con 0x7ffb680c4d00 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6806b3d0 con 0x7ffb680c7d40 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6db6f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6814e970 con 0x7ffb6814e590 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb680c4d00 0x7ffb6806b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb680c4d00 0x7ffb6806b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36406/0 (socket says 172.21.15.26:36406) 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2482950411 learned_addr learned my addr 172.21.15.26:0/2482950411 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb67fff640 1 --2- 172.21.15.26:0/2482950411 >> v2:172.21.15.79:3300/0 conn(0x7ffb680c7d40 0x7ffb680c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6cb6d640 1 --2- 172.21.15.26:0/2482950411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb6814e590 0x7ffb68154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2482950411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb6814e590 msgr2=0x7ffb68154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 --2- 172.21.15.26:0/2482950411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb6814e590 0x7ffb68154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2482950411 >> v2:172.21.15.79:3300/0 conn(0x7ffb680c7d40 msgr2=0x7ffb680c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 --2- 172.21.15.26:0/2482950411 >> v2:172.21.15.79:3300/0 conn(0x7ffb680c7d40 0x7ffb680c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.464+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2482950411 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680bd720 con 0x7ffb680c4d00 2023-11-28T16:59:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6d36e640 1 --2- 172.21.15.26:0/2482950411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb680c4d00 0x7ffb6806b860 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009e50 tx=0x7ffb6001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c457156f51e51d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb677fe640 1 -- 172.21.15.26:0/2482950411 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600a57c0 con 0x7ffb680c4d00 2023-11-28T16:59:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb677fe640 1 -- 172.21.15.26:0/2482950411 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600a5920 con 0x7ffb680c4d00 2023-11-28T16:59:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb677fe640 1 -- 172.21.15.26:0/2482950411 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600a5cb0 con 0x7ffb680c4d00 2023-11-28T16:59:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2482950411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb680c4d00 msgr2=0x7ffb6806b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2482950411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb680c4d00 0x7ffb6806b860 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009e50 tx=0x7ffb6001c940 comp rx=0 tx=0).stop 2023-11-28T16:59:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2482950411 shutdown_connections 2023-11-28T16:59:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2482950411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb680c4d00 0x7ffb6806b860 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2482950411 >> v2:172.21.15.79:3300/0 conn(0x7ffb680c7d40 0x7ffb680c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2482950411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb6814e590 0x7ffb68154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2482950411 >> 172.21.15.26:0/2482950411 conn(0x7ffb680abd70 msgr2=0x7ffb680ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2482950411 shutdown_connections 2023-11-28T16:59:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.468+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2482950411 wait complete. 2023-11-28T16:59:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 Processor -- start 2023-11-28T16:59:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 -- start start 2023-11-28T16:59:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb680c4d00 0x7ffb6814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb680c7d40 0x7ffb680ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb6814e590 0x7ffb68153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb681edda0 con 0x7ffb6814e590 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680af230 con 0x7ffb680c7d40 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680afa20 con 0x7ffb680c4d00 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb6814e590 0x7ffb68153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb6814e590 0x7ffb68153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36410/0 (socket says 172.21.15.26:36410) 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2166183774 learned_addr learned my addr 172.21.15.26:0/2166183774 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6cb6d640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb680c4d00 0x7ffb6814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb67fff640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb680c7d40 0x7ffb680ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb680c4d00 msgr2=0x7ffb6814a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb680c4d00 0x7ffb6814a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb680c7d40 msgr2=0x7ffb680ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb680c7d40 0x7ffb680ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 -- 172.21.15.26:0/2166183774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60009b30 con 0x7ffb6814e590 2023-11-28T16:59:36.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6d36e640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb6814e590 0x7ffb68153110 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ffb6001aff0 tx=0x7ffb600196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb657fa640 1 -- 172.21.15.26:0/2166183774 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600a57c0 con 0x7ffb6814e590 2023-11-28T16:59:36.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb657fa640 1 -- 172.21.15.26:0/2166183774 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600b8880 con 0x7ffb6814e590 2023-11-28T16:59:36.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb680af460 con 0x7ffb6814e590 2023-11-28T16:59:36.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb657fa640 1 -- 172.21.15.26:0/2166183774 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600b8c30 con 0x7ffb6814e590 2023-11-28T16:59:36.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.472+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb680c1020 con 0x7ffb6814e590 2023-11-28T16:59:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.476+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb680c1210 con 0x7ffb6814e590 2023-11-28T16:59:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.476+0000 7ffb657fa640 1 -- 172.21.15.26:0/2166183774 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb600b6440 con 0x7ffb6814e590 2023-11-28T16:59:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.476+0000 7ffb657fa640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffb4c0668d0 0x7ffb4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.476+0000 7ffb657fa640 1 -- 172.21.15.26:0/2166183774 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffb6011ff30 con 0x7ffb6814e590 2023-11-28T16:59:36.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.476+0000 7ffb6cb6d640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffb4c0668d0 0x7ffb4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.480+0000 7ffb6cb6d640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffb4c0668d0 0x7ffb4c068d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffb68154b50 tx=0x7ffb5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.480+0000 7ffb657fa640 1 -- 172.21.15.26:0/2166183774 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb600ecf60 con 0x7ffb6814e590 2023-11-28T16:59:36.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.636+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb68074970 con 0x7ffb6814e590 2023-11-28T16:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.636+0000 7ffb657fa640 1 -- 172.21.15.26:0/2166183774 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7ffb600bc020 con 0x7ffb6814e590 2023-11-28T16:59:36.641 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:36.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffb4c0668d0 msgr2=0x7ffb4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffb4c0668d0 0x7ffb4c068d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffb68154b50 tx=0x7ffb5c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb6814e590 msgr2=0x7ffb68153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb6814e590 0x7ffb68153110 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ffb6001aff0 tx=0x7ffb600196e0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 shutdown_connections 2023-11-28T16:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb6814e590 0x7ffb68153110 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb680c7d40 0x7ffb680ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffb4c0668d0 0x7ffb4c068d90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 --2- 172.21.15.26:0/2166183774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb680c4d00 0x7ffb6814a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 >> 172.21.15.26:0/2166183774 conn(0x7ffb680abd70 msgr2=0x7ffb6814c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 shutdown_connections 2023-11-28T16:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.640+0000 7ffb6db6f640 1 -- 172.21.15.26:0/2166183774 wait complete. 2023-11-28T16:59:36.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:59:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.804+0000 7ff0198fe640 1 Processor -- start 2023-11-28T16:59:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.804+0000 7ff0198fe640 1 -- start start 2023-11-28T16:59:36.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0198fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff014151e20 0x7ff0140c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0198fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff01406ca50 0x7ff0140c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0198fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0140c7da0 0x7ff0140c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0198fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0140c5330 con 0x7ff01406ca50 2023-11-28T16:59:36.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0198fe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01406bd20 con 0x7ff0140c7da0 2023-11-28T16:59:36.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0198fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01406c5c0 con 0x7ff014151e20 2023-11-28T16:59:36.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff01406ca50 0x7ff0140c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff01406ca50 0x7ff0140c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36426/0 (socket says 172.21.15.26:36426) 2023-11-28T16:59:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 -- 172.21.15.26:0/202170849 learned_addr learned my addr 172.21.15.26:0/202170849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0137fe640 1 --2- 172.21.15.26:0/202170849 >> v2:172.21.15.79:3300/0 conn(0x7ff0140c7da0 0x7ff0140c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff012ffd640 1 --2- 172.21.15.26:0/202170849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff014151e20 0x7ff0140c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 -- 172.21.15.26:0/202170849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff014151e20 msgr2=0x7ff0140c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:36.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 --2- 172.21.15.26:0/202170849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff014151e20 0x7ff0140c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 -- 172.21.15.26:0/202170849 >> v2:172.21.15.79:3300/0 conn(0x7ff0140c7da0 msgr2=0x7ff0140c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:36.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 --2- 172.21.15.26:0/202170849 >> v2:172.21.15.79:3300/0 conn(0x7ff0140c7da0 0x7ff0140c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 -- 172.21.15.26:0/202170849 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014155480 con 0x7ff01406ca50 2023-11-28T16:59:36.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff0137fe640 1 --2- 172.21.15.26:0/202170849 >> v2:172.21.15.79:3300/0 conn(0x7ff0140c7da0 0x7ff0140c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:36.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.808+0000 7ff00a7fc640 1 --2- 172.21.15.26:0/202170849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01406ca50 0x7ff0140c68b0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff01406cf10 tx=0x7feffc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c160eadc82163a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0127fc640 1 -- 172.21.15.26:0/202170849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0ab600 con 0x7ff01406ca50 2023-11-28T16:59:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0127fc640 1 -- 172.21.15.26:0/202170849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc0a7050 con 0x7ff01406ca50 2023-11-28T16:59:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0127fc640 1 -- 172.21.15.26:0/202170849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0ab980 con 0x7ff01406ca50 2023-11-28T16:59:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- 172.21.15.26:0/202170849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01406ca50 msgr2=0x7ff0140c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 --2- 172.21.15.26:0/202170849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01406ca50 0x7ff0140c68b0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff01406cf10 tx=0x7feffc01c3b0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- 172.21.15.26:0/202170849 shutdown_connections 2023-11-28T16:59:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 --2- 172.21.15.26:0/202170849 >> v2:172.21.15.79:3300/0 conn(0x7ff0140c7da0 0x7ff0140c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 --2- 172.21.15.26:0/202170849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01406ca50 0x7ff0140c68b0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 --2- 172.21.15.26:0/202170849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff014151e20 0x7ff0140c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- 172.21.15.26:0/202170849 >> 172.21.15.26:0/202170849 conn(0x7ff0140aba70 msgr2=0x7ff0140abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:36.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- 172.21.15.26:0/202170849 shutdown_connections 2023-11-28T16:59:36.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- 172.21.15.26:0/202170849 wait complete. 2023-11-28T16:59:36.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 Processor -- start 2023-11-28T16:59:36.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- start start 2023-11-28T16:59:36.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01406ca50 0x7ff0141566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0140c7da0 0x7ff014146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff014151e20 0x7ff0141474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0141f12a0 con 0x7ff014151e20 2023-11-28T16:59:36.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014157010 con 0x7ff01406ca50 2023-11-28T16:59:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0198fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0141559f0 con 0x7ff0140c7da0 2023-11-28T16:59:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0137fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff014151e20 0x7ff0141474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff012ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01406ca50 0x7ff0141566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0137fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff014151e20 0x7ff0141474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36436/0 (socket says 172.21.15.26:36436) 2023-11-28T16:59:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff0137fe640 1 -- 172.21.15.26:0/2117156392 learned_addr learned my addr 172.21.15.26:0/2117156392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.812+0000 7ff00a7fc640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0140c7da0 0x7ff014146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0137fe640 1 -- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0140c7da0 msgr2=0x7ff014146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0137fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0140c7da0 0x7ff014146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0137fe640 1 -- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01406ca50 msgr2=0x7ff0141566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0137fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01406ca50 0x7ff0141566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0137fe640 1 -- 172.21.15.26:0/2117156392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0094d0 con 0x7ff014151e20 2023-11-28T16:59:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0137fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff014151e20 0x7ff0141474a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c5e0 tx=0x7ff00c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff010ff9640 1 -- 172.21.15.26:0/2117156392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c004220 con 0x7ff014151e20 2023-11-28T16:59:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff010ff9640 1 -- 172.21.15.26:0/2117156392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c0043a0 con 0x7ff014151e20 2023-11-28T16:59:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff010ff9640 1 -- 172.21.15.26:0/2117156392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c004510 con 0x7ff014151e20 2023-11-28T16:59:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0141562a0 con 0x7ff014151e20 2023-11-28T16:59:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0141f0ec0 con 0x7ff014151e20 2023-11-28T16:59:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff014074970 con 0x7ff014151e20 2023-11-28T16:59:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff010ff9640 1 -- 172.21.15.26:0/2117156392 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff00c003860 con 0x7ff014151e20 2023-11-28T16:59:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff010ff9640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feff40668d0 0x7feff4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.816+0000 7ff010ff9640 1 -- 172.21.15.26:0/2117156392 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff00c0844b0 con 0x7ff014151e20 2023-11-28T16:59:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.820+0000 7ff012ffd640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feff40668d0 0x7feff4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.820+0000 7ff012ffd640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feff40668d0 0x7feff4068d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff0140c0e70 tx=0x7ff004009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.824+0000 7ff010ff9640 1 -- 172.21.15.26:0/2117156392 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff00c051430 con 0x7ff014151e20 2023-11-28T16:59:36.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.980+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff0140ab850 con 0x7ff014151e20 2023-11-28T16:59:36.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.980+0000 7ff010ff9640 1 -- 172.21.15.26:0/2117156392 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff00c054a50 con 0x7ff014151e20 2023-11-28T16:59:36.985 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:36.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feff40668d0 msgr2=0x7feff4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feff40668d0 0x7feff4068d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff0140c0e70 tx=0x7ff004009830 comp rx=0 tx=0).stop 2023-11-28T16:59:36.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff014151e20 msgr2=0x7ff0141474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:36.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff014151e20 0x7ff0141474a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c5e0 tx=0x7ff00c00caa0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 shutdown_connections 2023-11-28T16:59:36.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff014151e20 0x7ff0141474a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7feff40668d0 0x7feff4068d90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0140c7da0 0x7ff014146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 --2- 172.21.15.26:0/2117156392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01406ca50 0x7ff0141566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:36.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 >> 172.21.15.26:0/2117156392 conn(0x7ff0140aba70 msgr2=0x7ff0140c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:36.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 shutdown_connections 2023-11-28T16:59:36.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:36.984+0000 7ff0198fe640 1 -- 172.21.15.26:0/2117156392 wait complete. 2023-11-28T16:59:37.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:37.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f910ae79640 1 Processor -- start 2023-11-28T16:59:37.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f910ae79640 1 -- start start 2023-11-28T16:59:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f910ae79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91040ca610 0x7f91040c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f910ae79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91040bd720 0x7f91040c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f910ae79640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9104155790 con 0x7f910406cd90 2023-11-28T16:59:37.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f910ae79640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91040c4b00 con 0x7f91040bd720 2023-11-28T16:59:37.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f910ae79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040c4de0 con 0x7f91040ca610 2023-11-28T16:59:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9108c15640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91040ca610 0x7f91040c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9108c15640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91040ca610 0x7f91040c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:46326/0 (socket says 172.21.15.26:46326) 2023-11-28T16:59:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9108c15640 1 -- 172.21.15.26:0/3528900197 learned_addr learned my addr 172.21.15.26:0/3528900197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9103fff640 1 --2- 172.21.15.26:0/3528900197 >> v2:172.21.15.79:3300/0 conn(0x7f91040bd720 0x7f91040c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9108c15640 1 -- 172.21.15.26:0/3528900197 >> v2:172.21.15.79:3300/0 conn(0x7f91040bd720 msgr2=0x7f91040c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9108c15640 1 --2- 172.21.15.26:0/3528900197 >> v2:172.21.15.79:3300/0 conn(0x7f91040bd720 0x7f91040c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9108c15640 1 -- 172.21.15.26:0/3528900197 >> v1:172.21.15.79:6789/0 conn(0x7f910406cd90 legacy=0x7f9104158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.148+0000 7f9108c15640 1 -- 172.21.15.26:0/3528900197 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9104157e30 con 0x7f91040ca610 2023-11-28T16:59:37.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f9108c15640 1 --2- 172.21.15.26:0/3528900197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91040ca610 0x7f91040c94c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009870 tx=0x7f90f801c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c474b478821a76a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f91037fe640 1 -- 172.21.15.26:0/3528900197 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040c52d0 con 0x7f91040ca610 2023-11-28T16:59:37.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f91037fe640 1 -- 172.21.15.26:0/3528900197 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f80a4940 con 0x7f91040ca610 2023-11-28T16:59:37.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f91037fe640 1 -- 172.21.15.26:0/3528900197 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f80a4cd0 con 0x7f91040ca610 2023-11-28T16:59:37.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 -- 172.21.15.26:0/3528900197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91040ca610 msgr2=0x7f91040c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 --2- 172.21.15.26:0/3528900197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91040ca610 0x7f91040c94c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009870 tx=0x7f90f801c100 comp rx=0 tx=0).stop 2023-11-28T16:59:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 -- 172.21.15.26:0/3528900197 shutdown_connections 2023-11-28T16:59:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 --2- 172.21.15.26:0/3528900197 >> v2:172.21.15.79:3300/0 conn(0x7f91040bd720 0x7f91040c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 --2- 172.21.15.26:0/3528900197 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91040ca610 0x7f91040c94c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 -- 172.21.15.26:0/3528900197 >> 172.21.15.26:0/3528900197 conn(0x7f9104071ea0 msgr2=0x7f91040722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 -- 172.21.15.26:0/3528900197 shutdown_connections 2023-11-28T16:59:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.152+0000 7f910ae79640 1 -- 172.21.15.26:0/3528900197 wait complete. 2023-11-28T16:59:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 Processor -- start 2023-11-28T16:59:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 -- start start 2023-11-28T16:59:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f910406cd90 0x7f91040abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91040bd720 0x7f9104152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040ca610 0x7f9104152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9104154a20 con 0x7f91040ca610 2023-11-28T16:59:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91040bd200 con 0x7f91040bd720 2023-11-28T16:59:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040ac950 con 0x7f910406cd90 2023-11-28T16:59:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040ca610 0x7f9104152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040ca610 0x7f9104152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36448/0 (socket says 172.21.15.26:36448) 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 -- 172.21.15.26:0/1288937745 learned_addr learned my addr 172.21.15.26:0/1288937745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9108c15640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f910406cd90 0x7f91040abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9103fff640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91040bd720 0x7f9104152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 -- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f910406cd90 msgr2=0x7f91040abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f910406cd90 0x7f91040abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 -- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91040bd720 msgr2=0x7f9104152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91040bd720 0x7f9104152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 -- 172.21.15.26:0/1288937745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80094d0 con 0x7f91040ca610 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9108c15640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f910406cd90 0x7f91040abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9103fff640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91040bd720 0x7f9104152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f9109416640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040ca610 0x7f9104152fc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c7a0 tx=0x7f90fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f91017fa640 1 -- 172.21.15.26:0/1288937745 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc003b80 con 0x7f91040ca610 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f91017fa640 1 -- 172.21.15.26:0/1288937745 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc003ce0 con 0x7f91040ca610 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f91017fa640 1 -- 172.21.15.26:0/1288937745 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00aa30 con 0x7f91040ca610 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9104153ff0 con 0x7f91040ca610 2023-11-28T16:59:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.156+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9104153500 con 0x7f91040ca610 2023-11-28T16:59:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.160+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9104066ba0 con 0x7f91040ca610 2023-11-28T16:59:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.160+0000 7f91017fa640 1 -- 172.21.15.26:0/1288937745 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f90fc00ab90 con 0x7f91040ca610 2023-11-28T16:59:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.160+0000 7f91017fa640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90e8066900 0x7f90e8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.160+0000 7f91017fa640 1 -- 172.21.15.26:0/1288937745 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f90fc084570 con 0x7f91040ca610 2023-11-28T16:59:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.160+0000 7f9108c15640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90e8066900 0x7f90e8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.160+0000 7f9108c15640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90e8066900 0x7f90e8068dc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f90f80ae000 tx=0x7f90f80a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.164+0000 7f91017fa640 1 -- 172.21.15.26:0/1288937745 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9104066ba0 con 0x7f91040ca610 2023-11-28T16:59:37.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.356+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9104066ba0 con 0x7f91040ca610 2023-11-28T16:59:37.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f91017fa640 1 -- 172.21.15.26:0/1288937745 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6128 (secure 0 0 0) 0x7f9104066ba0 con 0x7f91040ca610 2023-11-28T16:59:37.362 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:37.362 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:57.235192+0000","modified":"2023-11-28T16:59:00.256436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3229750931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3229750931},{"type":"v1","addr":"172.21.15.26:6835","nonce":3229750931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:37.363 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 51 2023-11-28T16:59:37.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90e8066900 msgr2=0x7f90e8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90e8066900 0x7f90e8068dc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f90f80ae000 tx=0x7f90f80a6070 comp rx=0 tx=0).stop 2023-11-28T16:59:37.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040ca610 msgr2=0x7f9104152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040ca610 0x7f9104152fc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c7a0 tx=0x7f90fc00cc60 comp rx=0 tx=0).stop 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 shutdown_connections 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040ca610 0x7f9104152fc0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91040bd720 0x7f9104152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f90e8066900 0x7f90e8068dc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 --2- 172.21.15.26:0/1288937745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f910406cd90 0x7f91040abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 >> 172.21.15.26:0/1288937745 conn(0x7f9104071ea0 msgr2=0x7f91040ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 shutdown_connections 2023-11-28T16:59:37.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.360+0000 7f910ae79640 1 -- 172.21.15.26:0/1288937745 wait complete. 2023-11-28T16:59:37.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:37.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc823b01640 1 Processor -- start 2023-11-28T16:59:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc823b01640 1 -- start start 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc823b01640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc81c0c2390 0x7fc81c0c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc823b01640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c0c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc823b01640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c0c2840 con 0x7fc81c0acd70 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc823b01640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c0725a0 con 0x7fc81c0c2390 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc823b01640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0722c0 con 0x7fc81c0c1d00 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82109c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc81c0c2390 0x7fc81c0c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82109c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc81c0c2390 0x7fc81c0c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36464/0 (socket says 172.21.15.26:36464) 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82109c640 1 -- 172.21.15.26:0/3341280398 learned_addr learned my addr 172.21.15.26:0/3341280398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82209e640 1 --2- 172.21.15.26:0/3341280398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c0c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82109c640 1 -- 172.21.15.26:0/3341280398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 msgr2=0x7fc81c0c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82109c640 1 --2- 172.21.15.26:0/3341280398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c0c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82109c640 1 -- 172.21.15.26:0/3341280398 >> v1:172.21.15.79:6789/0 conn(0x7fc81c0acd70 legacy=0x7fc81c06cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:37.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82109c640 1 -- 172.21.15.26:0/3341280398 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c152050 con 0x7fc81c0c2390 2023-11-28T16:59:37.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.524+0000 7fc82209e640 1 --2- 172.21.15.26:0/3341280398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c0c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc82109c640 1 --2- 172.21.15.26:0/3341280398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0c2390 0x7fc81c0c2fb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009870 tx=0x7fc80c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b661db364b790986 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc82089b640 1 -- 172.21.15.26:0/3341280398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0ac640 con 0x7fc81c0c2390 2023-11-28T16:59:37.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc82089b640 1 -- 172.21.15.26:0/3341280398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c0ac7a0 con 0x7fc81c0c2390 2023-11-28T16:59:37.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc82089b640 1 -- 172.21.15.26:0/3341280398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0acb30 con 0x7fc81c0c2390 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 -- 172.21.15.26:0/3341280398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0c2390 msgr2=0x7fc81c0c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 --2- 172.21.15.26:0/3341280398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0c2390 0x7fc81c0c2fb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009870 tx=0x7fc80c01c420 comp rx=0 tx=0).stop 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 -- 172.21.15.26:0/3341280398 shutdown_connections 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 --2- 172.21.15.26:0/3341280398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c0c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 --2- 172.21.15.26:0/3341280398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0c2390 0x7fc81c0c2fb0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 -- 172.21.15.26:0/3341280398 >> 172.21.15.26:0/3341280398 conn(0x7fc81c0c3be0 msgr2=0x7fc81c0c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 -- 172.21.15.26:0/3341280398 shutdown_connections 2023-11-28T16:59:37.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.528+0000 7fc823b01640 1 -- 172.21.15.26:0/3341280398 wait complete. 2023-11-28T16:59:37.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 Processor -- start 2023-11-28T16:59:37.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 -- start start 2023-11-28T16:59:37.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0acd70 0x7fc81c148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc81c0c2390 0x7fc81c14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c1f0050 con 0x7fc81c0acd70 2023-11-28T16:59:37.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c14dbe0 con 0x7fc81c0c2390 2023-11-28T16:59:37.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0a93e0 con 0x7fc81c0c1d00 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0acd70 0x7fc81c148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0acd70 0x7fc81c148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36466/0 (socket says 172.21.15.26:36466) 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 -- 172.21.15.26:0/827858388 learned_addr learned my addr 172.21.15.26:0/827858388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82209e640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc81c0c2390 0x7fc81c14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82109c640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 -- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 msgr2=0x7fc81c14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c14e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 -- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc81c0c2390 msgr2=0x7fc81c14e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc81c0c2390 0x7fc81c14e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 -- 172.21.15.26:0/827858388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c0094d0 con 0x7fc81c0acd70 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82209e640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc81c0c2390 0x7fc81c14e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc82189d640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0acd70 0x7fc81c148970 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c3c0 tx=0x7fc81800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc8127fc640 1 -- 172.21.15.26:0/827858388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8180052d0 con 0x7fc81c0acd70 2023-11-28T16:59:37.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc8127fc640 1 -- 172.21.15.26:0/827858388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc818005430 con 0x7fc81c0acd70 2023-11-28T16:59:37.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc8127fc640 1 -- 172.21.15.26:0/827858388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818003840 con 0x7fc81c0acd70 2023-11-28T16:59:37.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c0a8e20 con 0x7fc81c0acd70 2023-11-28T16:59:37.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.532+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c148eb0 con 0x7fc81c0acd70 2023-11-28T16:59:37.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.536+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c0c4930 con 0x7fc81c0acd70 2023-11-28T16:59:37.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.536+0000 7fc8127fc640 1 -- 172.21.15.26:0/827858388 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8180039a0 con 0x7fc81c0acd70 2023-11-28T16:59:37.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.536+0000 7fc8127fc640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8000668d0 0x7fc800068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.536+0000 7fc8127fc640 1 -- 172.21.15.26:0/827858388 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc818083cd0 con 0x7fc81c0acd70 2023-11-28T16:59:37.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.536+0000 7fc82109c640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8000668d0 0x7fc800068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.536+0000 7fc82109c640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8000668d0 0x7fc800068d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0ae000 tx=0x7fc80c0a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.540+0000 7fc8127fc640 1 -- 172.21.15.26:0/827858388 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc818050ba0 con 0x7fc81c0acd70 2023-11-28T16:59:37.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.696+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc81c04e890 con 0x7fc81c0acd70 2023-11-28T16:59:37.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc8127fc640 1 -- 172.21.15.26:0/827858388 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7fc818017090 con 0x7fc81c0acd70 2023-11-28T16:59:37.702 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:37.703 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8000668d0 msgr2=0x7fc800068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8000668d0 0x7fc800068d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0ae000 tx=0x7fc80c0a6070 comp rx=0 tx=0).stop 2023-11-28T16:59:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0acd70 msgr2=0x7fc81c148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0acd70 0x7fc81c148970 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c3c0 tx=0x7fc81800c880 comp rx=0 tx=0).stop 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 shutdown_connections 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc81c0c2390 0x7fc81c14e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc8000668d0 0x7fc800068d90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc81c0c1d00 0x7fc81c14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 --2- 172.21.15.26:0/827858388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81c0acd70 0x7fc81c148970 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 >> 172.21.15.26:0/827858388 conn(0x7fc81c0c3be0 msgr2=0x7fc81c0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 shutdown_connections 2023-11-28T16:59:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.700+0000 7fc823b01640 1 -- 172.21.15.26:0/827858388 wait complete. 2023-11-28T16:59:37.724 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T16:59:37.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 Processor -- start 2023-11-28T16:59:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 -- start start 2023-11-28T16:59:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33ec0ca610 0x7f33ec0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33ec06cd90 0x7f33ec158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec155790 con 0x7f33ec0ca610 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0c4b00 con 0x7f33ec06cd90 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f3609640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0c4de0 con 0x7f33ec0bd720 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33ec0ca610 0x7f33ec0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33ec0ca610 0x7f33ec0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36468/0 (socket says 172.21.15.26:36468) 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 -- 172.21.15.26:0/554100871 learned_addr learned my addr 172.21.15.26:0/554100871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f1ba6640 1 --2- 172.21.15.26:0/554100871 >> v2:172.21.15.79:3300/0 conn(0x7f33ec06cd90 0x7f33ec158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f0ba4640 1 --2- 172.21.15.26:0/554100871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 -- 172.21.15.26:0/554100871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 msgr2=0x7f33ec0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 --2- 172.21.15.26:0/554100871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 -- 172.21.15.26:0/554100871 >> v2:172.21.15.79:3300/0 conn(0x7f33ec06cd90 msgr2=0x7f33ec158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 --2- 172.21.15.26:0/554100871 >> v2:172.21.15.79:3300/0 conn(0x7f33ec06cd90 0x7f33ec158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.864+0000 7f33f13a5640 1 -- 172.21.15.26:0/554100871 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec157e30 con 0x7f33ec0ca610 2023-11-28T16:59:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f13a5640 1 --2- 172.21.15.26:0/554100871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec0c94c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f33ec152370 tx=0x7f33e801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed63d7e6b65b21c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33e3fff640 1 -- 172.21.15.26:0/554100871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0c52d0 con 0x7f33ec0ca610 2023-11-28T16:59:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33e3fff640 1 -- 172.21.15.26:0/554100871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80a4880 con 0x7f33ec0ca610 2023-11-28T16:59:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33e3fff640 1 -- 172.21.15.26:0/554100871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80a4c10 con 0x7f33ec0ca610 2023-11-28T16:59:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 -- 172.21.15.26:0/554100871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 msgr2=0x7f33ec0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 --2- 172.21.15.26:0/554100871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec0c94c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f33ec152370 tx=0x7f33e801c0c0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 -- 172.21.15.26:0/554100871 shutdown_connections 2023-11-28T16:59:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 --2- 172.21.15.26:0/554100871 >> v2:172.21.15.79:3300/0 conn(0x7f33ec06cd90 0x7f33ec158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 --2- 172.21.15.26:0/554100871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 --2- 172.21.15.26:0/554100871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec0c94c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 -- 172.21.15.26:0/554100871 >> 172.21.15.26:0/554100871 conn(0x7f33ec071ea0 msgr2=0x7f33ec0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 -- 172.21.15.26:0/554100871 shutdown_connections 2023-11-28T16:59:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.868+0000 7f33f3609640 1 -- 172.21.15.26:0/554100871 wait complete. 2023-11-28T16:59:37.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 Processor -- start 2023-11-28T16:59:37.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 -- start start 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33ec06cd90 0x7f33ec14d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec1ee660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0c0150 con 0x7f33ec0ca610 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1f2550 con 0x7f33ec06cd90 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1512e0 con 0x7f33ec0bd720 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec1ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec1ee660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36482/0 (socket says 172.21.15.26:36482) 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 -- 172.21.15.26:0/725064262 learned_addr learned my addr 172.21.15.26:0/725064262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f0ba4640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f13a5640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33ec06cd90 0x7f33ec14d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 -- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 msgr2=0x7f33ec0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 -- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33ec06cd90 msgr2=0x7f33ec14d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33ec06cd90 0x7f33ec14d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 -- 172.21.15.26:0/725064262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80094d0 con 0x7f33ec0ca610 2023-11-28T16:59:37.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f1ba6640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec1ee660 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f33e4007e30 tx=0x7f33e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33e1ffb640 1 -- 172.21.15.26:0/725064262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4014420 con 0x7f33ec0ca610 2023-11-28T16:59:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33e1ffb640 1 -- 172.21.15.26:0/725064262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4014580 con 0x7f33ec0ca610 2023-11-28T16:59:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33e1ffb640 1 -- 172.21.15.26:0/725064262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4014930 con 0x7f33ec0ca610 2023-11-28T16:59:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec1515c0 con 0x7f33ec0ca610 2023-11-28T16:59:37.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec0ac220 con 0x7f33ec0ca610 2023-11-28T16:59:37.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.872+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec04e890 con 0x7f33ec0ca610 2023-11-28T16:59:37.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.876+0000 7f33e1ffb640 1 -- 172.21.15.26:0/725064262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f33e4014a90 con 0x7f33ec0ca610 2023-11-28T16:59:37.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.876+0000 7f33e1ffb640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33d00668d0 0x7f33d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:37.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.876+0000 7f33e1ffb640 1 -- 172.21.15.26:0/725064262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f33e4084f50 con 0x7f33ec0ca610 2023-11-28T16:59:37.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.876+0000 7f33f13a5640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33d00668d0 0x7f33d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:37.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.876+0000 7f33f13a5640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33d00668d0 0x7f33d0068d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f33e80ae000 tx=0x7f33e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:37.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:37.880+0000 7f33e1ffb640 1 -- 172.21.15.26:0/725064262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33e4051ed0 con 0x7f33ec0ca610 2023-11-28T16:59:38.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.064+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33ec06cb70 con 0x7f33ec0ca610 2023-11-28T16:59:38.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33e1ffb640 1 -- 172.21.15.26:0/725064262 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6128 (secure 0 0 0) 0x7f33e4009960 con 0x7f33ec0ca610 2023-11-28T16:59:38.070 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:38.071 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:57.235192+0000","modified":"2023-11-28T16:59:00.256436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3229750931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3229750931},{"type":"v1","addr":"172.21.15.26:6835","nonce":3229750931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 51 2023-11-28T16:59:38.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33d00668d0 msgr2=0x7f33d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33d00668d0 0x7f33d0068d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f33e80ae000 tx=0x7f33e8008040 comp rx=0 tx=0).stop 2023-11-28T16:59:38.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 msgr2=0x7f33ec1ee660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec1ee660 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f33e4007e30 tx=0x7f33e400e4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 shutdown_connections 2023-11-28T16:59:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ec0ca610 0x7f33ec1ee660 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f33d00668d0 0x7f33d0068d90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33ec0bd720 0x7f33ec0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 --2- 172.21.15.26:0/725064262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33ec06cd90 0x7f33ec14d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 >> 172.21.15.26:0/725064262 conn(0x7f33ec071ea0 msgr2=0x7f33ec072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 shutdown_connections 2023-11-28T16:59:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.068+0000 7f33f3609640 1 -- 172.21.15.26:0/725064262 wait complete. 2023-11-28T16:59:38.092 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 Processor -- start 2023-11-28T16:59:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 -- start start 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6d0151c50 0x7fa6d00700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6d006bd00 0x7fa6d01546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d01581b0 con 0x7fa6d006bd00 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d0154c30 con 0x7fa6d0151c50 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d7f0f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d006c310 con 0x7fa6d01585d0 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6d006bd00 0x7fa6d01546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6d006bd00 0x7fa6d01546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36488/0 (socket says 172.21.15.26:36488) 2023-11-28T16:59:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 -- 172.21.15.26:0/1159055785 learned_addr learned my addr 172.21.15.26:0/1159055785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d5cab640 1 --2- 172.21.15.26:0/1159055785 >> v2:172.21.15.79:3300/0 conn(0x7fa6d0151c50 0x7fa6d00700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d64ac640 1 --2- 172.21.15.26:0/1159055785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d00c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 -- 172.21.15.26:0/1159055785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 msgr2=0x7fa6d00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 --2- 172.21.15.26:0/1159055785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d00c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 -- 172.21.15.26:0/1159055785 >> v2:172.21.15.79:3300/0 conn(0x7fa6d0151c50 msgr2=0x7fa6d00700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 --2- 172.21.15.26:0/1159055785 >> v2:172.21.15.79:3300/0 conn(0x7fa6d0151c50 0x7fa6d00700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.232+0000 7fa6d54aa640 1 -- 172.21.15.26:0/1159055785 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d006c840 con 0x7fa6d006bd00 2023-11-28T16:59:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d54aa640 1 --2- 172.21.15.26:0/1159055785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d01546f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa6d006ebc0 tx=0x7fa6c001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9414ff5d8fa108 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d4ca9640 1 -- 172.21.15.26:0/1159055785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00ab600 con 0x7fa6d006bd00 2023-11-28T16:59:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d4ca9640 1 -- 172.21.15.26:0/1159055785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c00a7050 con 0x7fa6d006bd00 2023-11-28T16:59:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d4ca9640 1 -- 172.21.15.26:0/1159055785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00ab980 con 0x7fa6d006bd00 2023-11-28T16:59:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/1159055785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 msgr2=0x7fa6d01546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/1159055785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d01546f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa6d006ebc0 tx=0x7fa6c001c3e0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/1159055785 shutdown_connections 2023-11-28T16:59:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/1159055785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/1159055785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d01546f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/1159055785 >> v2:172.21.15.79:3300/0 conn(0x7fa6d0151c50 0x7fa6d00700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/1159055785 >> 172.21.15.26:0/1159055785 conn(0x7fa6d00c2ad0 msgr2=0x7fa6d00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/1159055785 shutdown_connections 2023-11-28T16:59:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.236+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/1159055785 wait complete. 2023-11-28T16:59:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 Processor -- start 2023-11-28T16:59:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 -- start start 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d00a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0151c50 0x7fa6d014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d0152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d014b460 con 0x7fa6d006bd00 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d01ed5e0 con 0x7fa6d0151c50 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d014a160 con 0x7fa6d01585d0 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d00a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d00a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36504/0 (socket says 172.21.15.26:36504) 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 -- 172.21.15.26:0/3339946142 learned_addr learned my addr 172.21.15.26:0/3339946142 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d64ac640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d0152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d54aa640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0151c50 0x7fa6d014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 -- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 msgr2=0x7fa6d0152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d0152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 -- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0151c50 msgr2=0x7fa6d014af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0151c50 0x7fa6d014af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 -- 172.21.15.26:0/3339946142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00094d0 con 0x7fa6d006bd00 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d5cab640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d00a87c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00e8b0 tx=0x7fa6cc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6c67fc640 1 -- 172.21.15.26:0/3339946142 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00c940 con 0x7fa6d006bd00 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6c67fc640 1 -- 172.21.15.26:0/3339946142 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00caa0 con 0x7fa6d006bd00 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6c67fc640 1 -- 172.21.15.26:0/3339946142 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00ce30 con 0x7fa6d006bd00 2023-11-28T16:59:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d014a440 con 0x7fa6d006bd00 2023-11-28T16:59:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d014aa00 con 0x7fa6d006bd00 2023-11-28T16:59:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.240+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d004e890 con 0x7fa6d006bd00 2023-11-28T16:59:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.244+0000 7fa6c67fc640 1 -- 172.21.15.26:0/3339946142 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa6cc013470 con 0x7fa6d006bd00 2023-11-28T16:59:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.244+0000 7fa6c67fc640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa6b40668d0 0x7fa6b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.244+0000 7fa6c67fc640 1 -- 172.21.15.26:0/3339946142 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa6cc084800 con 0x7fa6d006bd00 2023-11-28T16:59:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.244+0000 7fa6d54aa640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa6b40668d0 0x7fa6b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.244+0000 7fa6d54aa640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa6b40668d0 0x7fa6b4068d90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00ad000 tx=0x7fa6c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.248+0000 7fa6c67fc640 1 -- 172.21.15.26:0/3339946142 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6cc051820 con 0x7fa6d006bd00 2023-11-28T16:59:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.436+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6d00c2630 con 0x7fa6d006bd00 2023-11-28T16:59:38.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6c67fc640 1 -- 172.21.15.26:0/3339946142 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6128 (secure 0 0 0) 0x7fa6cc054e40 con 0x7fa6d006bd00 2023-11-28T16:59:38.442 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:38.442 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:58:57.235192+0000","modified":"2023-11-28T16:59:00.256436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6444":{"gid":6444,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3229750931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3229750931},{"type":"v1","addr":"172.21.15.26:6835","nonce":3229750931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:38.442 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 51 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa6b40668d0 msgr2=0x7fa6b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa6b40668d0 0x7fa6b4068d90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00ad000 tx=0x7fa6c0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 msgr2=0x7fa6d00a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d00a87c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00e8b0 tx=0x7fa6cc00ed70 comp rx=0 tx=0).stop 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 shutdown_connections 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa6b40668d0 0x7fa6b4068d90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6d01585d0 0x7fa6d0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0151c50 0x7fa6d014af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 --2- 172.21.15.26:0/3339946142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6d006bd00 0x7fa6d00a87c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 >> 172.21.15.26:0/3339946142 conn(0x7fa6d00c2ad0 msgr2=0x7fa6d0154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 shutdown_connections 2023-11-28T16:59:38.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.440+0000 7fa6d7f0f640 1 -- 172.21.15.26:0/3339946142 wait complete. 2023-11-28T16:59:38.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:38.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe7014dd640 1 Processor -- start 2023-11-28T16:59:38.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe7014dd640 1 -- start start 2023-11-28T16:59:38.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe7014dd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe6fc0ca610 0x7fe6fc0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe7014dd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc155790 con 0x7fe6fc06cd90 2023-11-28T16:59:38.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe7014dd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc0c4b00 con 0x7fe6fc0bd720 2023-11-28T16:59:38.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe7014dd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0c4de0 con 0x7fe6fc0ca610 2023-11-28T16:59:38.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe6faffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe6fc0ca610 0x7fe6fc0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe6fb7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe6fc06cd90 0x7fe6fc0c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53950/0 (socket says 172.21.15.26:53950) 2023-11-28T16:59:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe6fb7fe640 1 -- 172.21.15.26:0/3371384734 learned_addr learned my addr 172.21.15.26:0/3371384734 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe6faffd640 1 -- 172.21.15.26:0/3371384734 >> v1:172.21.15.79:6789/0 conn(0x7fe6fc0bd720 legacy=0x7fe6fc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe6faffd640 1 -- 172.21.15.26:0/3371384734 >> v1:172.21.15.26:6789/0 conn(0x7fe6fc06cd90 legacy=0x7fe6fc0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.604+0000 7fe6faffd640 1 -- 172.21.15.26:0/3371384734 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc157e30 con 0x7fe6fc0ca610 2023-11-28T16:59:38.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe6faffd640 1 --2- 172.21.15.26:0/3371384734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc0c94c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097c0 tx=0x7fe6ec01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6c30b26a332188 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe6fa7fc640 1 -- 172.21.15.26:0/3371384734 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0c52d0 con 0x7fe6fc0ca610 2023-11-28T16:59:38.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe6fa7fc640 1 -- 172.21.15.26:0/3371384734 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0a4730 con 0x7fe6fc0ca610 2023-11-28T16:59:38.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe6fa7fc640 1 -- 172.21.15.26:0/3371384734 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0a4ac0 con 0x7fe6fc0ca610 2023-11-28T16:59:38.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe7014dd640 1 -- 172.21.15.26:0/3371384734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc0ca610 msgr2=0x7fe6fc0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe7014dd640 1 --2- 172.21.15.26:0/3371384734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc0c94c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097c0 tx=0x7fe6ec01c000 comp rx=0 tx=0).stop 2023-11-28T16:59:38.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe7014dd640 1 -- 172.21.15.26:0/3371384734 shutdown_connections 2023-11-28T16:59:38.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe7014dd640 1 --2- 172.21.15.26:0/3371384734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc0c94c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe7014dd640 1 -- 172.21.15.26:0/3371384734 >> 172.21.15.26:0/3371384734 conn(0x7fe6fc071ea0 msgr2=0x7fe6fc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:38.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe7014dd640 1 -- 172.21.15.26:0/3371384734 shutdown_connections 2023-11-28T16:59:38.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.608+0000 7fe7014dd640 1 -- 172.21.15.26:0/3371384734 wait complete. 2023-11-28T16:59:38.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 Processor -- start 2023-11-28T16:59:38.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 -- start start 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc06cd90 0x7fe6fc14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe6fc0bd720 0x7fe6fc1ef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc1efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc157320 con 0x7fe6fc06cd90 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc153590 con 0x7fe6fc0ca610 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc152980 con 0x7fe6fc0bd720 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc06cd90 0x7fe6fc14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc06cd90 0x7fe6fc14aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36520/0 (socket says 172.21.15.26:36520) 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 -- 172.21.15.26:0/465441641 learned_addr learned my addr 172.21.15.26:0/465441641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6fb7fe640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc1efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6f27fc640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe6fc0bd720 0x7fe6fc1ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 -- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe6fc0bd720 msgr2=0x7fe6fc1ef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe6fc0bd720 0x7fe6fc1ef810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 -- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6fc0ca610 msgr2=0x7fe6fc1efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc1efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 -- 172.21.15.26:0/465441641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec009420 con 0x7fe6fc06cd90 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6f27fc640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe6fc0bd720 0x7fe6fc1ef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6fb7fe640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc1efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6faffd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc06cd90 0x7fe6fc14aa60 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0af040 tx=0x7fe6ec0190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6f3fff640 1 -- 172.21.15.26:0/465441641 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ac850 con 0x7fe6fc06cd90 2023-11-28T16:59:38.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6f3fff640 1 -- 172.21.15.26:0/465441641 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0ac9d0 con 0x7fe6fc06cd90 2023-11-28T16:59:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc152c60 con 0x7fe6fc06cd90 2023-11-28T16:59:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe6f3fff640 1 -- 172.21.15.26:0/465441641 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0acd80 con 0x7fe6fc06cd90 2023-11-28T16:59:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.612+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc153220 con 0x7fe6fc06cd90 2023-11-28T16:59:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.616+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc153700 con 0x7fe6fc06cd90 2023-11-28T16:59:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.616+0000 7fe6f3fff640 1 -- 172.21.15.26:0/465441641 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe6ec0b3040 con 0x7fe6fc06cd90 2023-11-28T16:59:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.616+0000 7fe6f3fff640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe6dc0668d0 0x7fe6dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.616+0000 7fe6f3fff640 1 -- 172.21.15.26:0/465441641 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe6fc0cac00 con 0x7fe6fc06cd90 2023-11-28T16:59:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.616+0000 7fe6f27fc640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe6dc0668d0 0x7fe6dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.616+0000 7fe6f27fc640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe6dc0668d0 0x7fe6dc068d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4007fd0 tx=0x7fe6e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.620+0000 7fe6f3fff640 1 -- 172.21.15.26:0/465441641 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6ec0eae90 con 0x7fe6fc06cd90 2023-11-28T16:59:38.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6fc153700 con 0x7fe6fc06cd90 2023-11-28T16:59:38.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe6f3fff640 1 -- 172.21.15.26:0/465441641 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20142 (secure 0 0 0) 0x7fe6ec0ee4b0 con 0x7fe6fc06cd90 2023-11-28T16:59:38.783 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:38.784 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:12.345052+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-28T16:58:55.413723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-28T16:58:56.230719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe6dc0668d0 msgr2=0x7fe6dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe6dc0668d0 0x7fe6dc068d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4007fd0 tx=0x7fe6e4009040 comp rx=0 tx=0).stop 2023-11-28T16:59:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc06cd90 msgr2=0x7fe6fc14aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc06cd90 0x7fe6fc14aa60 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0af040 tx=0x7fe6ec0190c0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 shutdown_connections 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6fc0ca610 0x7fe6fc1efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe6dc0668d0 0x7fe6dc068d90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe6fc0bd720 0x7fe6fc1ef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 --2- 172.21.15.26:0/465441641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6fc06cd90 0x7fe6fc14aa60 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 >> 172.21.15.26:0/465441641 conn(0x7fe6fc071ea0 msgr2=0x7fe6fc066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 shutdown_connections 2023-11-28T16:59:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.780+0000 7fe7014dd640 1 -- 172.21.15.26:0/465441641 wait complete. 2023-11-28T16:59:38.805 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T16:59:38.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.944+0000 7ffaab617640 1 Processor -- start 2023-11-28T16:59:38.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaab617640 1 -- start start 2023-11-28T16:59:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaab617640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffaa414e9d0 0x7ffaa4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaab617640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa406d320 con 0x7ffaa4070b80 2023-11-28T16:59:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaab617640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40721b0 con 0x7ffaa40a8470 2023-11-28T16:59:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaab617640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40c2830 con 0x7ffaa414e9d0 2023-11-28T16:59:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa8bb2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffaa4070b80 0x7ffaa40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53958/0 (socket says 172.21.15.26:53958) 2023-11-28T16:59:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa8bb2640 1 -- 172.21.15.26:0/2126615113 learned_addr learned my addr 172.21.15.26:0/2126615113 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2126615113 >> v2:172.21.15.79:3300/0 conn(0x7ffaa414e9d0 0x7ffaa4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632546229 0 0) 0x7ffaa406d320 con 0x7ffaa4070b80 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90003530 con 0x7ffaa4070b80 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197569890 0 0) 0x7ffaa40721b0 con 0x7ffaa40a8470 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa406d320 con 0x7ffaa40a8470 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382121633 0 0) 0x7ffa90003530 con 0x7ffaa4070b80 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 >> v2:172.21.15.79:3300/0 conn(0x7ffaa414e9d0 msgr2=0x7ffaa4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/2126615113 >> v2:172.21.15.79:3300/0 conn(0x7ffaa414e9d0 0x7ffaa4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 >> v1:172.21.15.79:6789/0 conn(0x7ffaa40a8470 legacy=0x7ffaa406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4072450 con 0x7ffaa4070b80 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7ffa94001600 con 0x7ffaa4070b80 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 >> v1:172.21.15.26:6789/0 conn(0x7ffaa4070b80 legacy=0x7ffaa40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa90003b60 0x7ffa90003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa900047d0 0x7ffa90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa900051e0 0x7ffa9000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40c2830 con 0x7ffa90003b60 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000e320 con 0x7ffa900051e0 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000e4e0 con 0x7ffa900047d0 2023-11-28T16:59:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa90003b60 0x7ffa90003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa8bb2640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa900047d0 0x7ffa90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa9bb4640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa900051e0 0x7ffa9000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa93b3640 1 -- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa900047d0 msgr2=0x7ffa90004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa900047d0 0x7ffa90004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa93b3640 1 -- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa900051e0 msgr2=0x7ffa9000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa900051e0 0x7ffa9000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa93b3640 1 -- 172.21.15.26:0/2126615113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90003530 con 0x7ffa90003b60 2023-11-28T16:59:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.948+0000 7ffaa9bb4640 1 -- 172.21.15.26:0/2126615113 reap_dead start 2023-11-28T16:59:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa90003b60 0x7ffa90003f60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009ae0 tx=0x7ffaa001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927e4b5e791586a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00a5510 con 0x7ffa90003b60 2023-11-28T16:59:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa00a5670 con 0x7ffa90003b60 2023-11-28T16:59:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffa9bfff640 1 -- 172.21.15.26:0/2126615113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00a5820 con 0x7ffa90003b60 2023-11-28T16:59:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaab617640 1 -- 172.21.15.26:0/2126615113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa90003b60 msgr2=0x7ffa90003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaab617640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa90003b60 0x7ffa90003f60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009ae0 tx=0x7ffaa001ca50 comp rx=0 tx=0).stop 2023-11-28T16:59:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaab617640 1 -- 172.21.15.26:0/2126615113 shutdown_connections 2023-11-28T16:59:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaab617640 1 --2- 172.21.15.26:0/2126615113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa90003b60 0x7ffa90003f60 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaab617640 1 -- 172.21.15.26:0/2126615113 >> 172.21.15.26:0/2126615113 conn(0x7ffaa40c2ad0 msgr2=0x7ffaa40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaab617640 1 -- 172.21.15.26:0/2126615113 shutdown_connections 2023-11-28T16:59:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.952+0000 7ffaab617640 1 -- 172.21.15.26:0/2126615113 wait complete. 2023-11-28T16:59:38.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 Processor -- start 2023-11-28T16:59:38.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 -- start start 2023-11-28T16:59:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90003b60 0x7ffaa41ed590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa4151410 0x7ffaa414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa4143390 0x7ffaa4143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41442c0 con 0x7ffaa4143390 2023-11-28T16:59:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4153610 con 0x7ffa90003b60 2023-11-28T16:59:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4143d50 con 0x7ffaa4151410 2023-11-28T16:59:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa4143390 0x7ffaa4143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa4143390 0x7ffaa4143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36544/0 (socket says 172.21.15.26:36544) 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 -- 172.21.15.26:0/2334612738 learned_addr learned my addr 172.21.15.26:0/2334612738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90003b60 0x7ffaa41ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa8bb2640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa4151410 0x7ffaa414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 -- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa4151410 msgr2=0x7ffaa414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa4151410 0x7ffaa414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 -- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90003b60 msgr2=0x7ffaa41ed590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90003b60 0x7ffaa41ed590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:38.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 -- 172.21.15.26:0/2334612738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa41ee4f0 con 0x7ffaa4143390 2023-11-28T16:59:38.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaa9bb4640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa4143390 0x7ffaa4143810 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4070030 tx=0x7ffa9c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffa99ffb640 1 -- 172.21.15.26:0/2334612738 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00ee50 con 0x7ffaa4143390 2023-11-28T16:59:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffa99ffb640 1 -- 172.21.15.26:0/2334612738 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c006d70 con 0x7ffaa4143390 2023-11-28T16:59:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffa99ffb640 1 -- 172.21.15.26:0/2334612738 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c003bc0 con 0x7ffaa4143390 2023-11-28T16:59:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa40c5750 con 0x7ffaa4143390 2023-11-28T16:59:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.956+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa4152970 con 0x7ffaa4143390 2023-11-28T16:59:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.960+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa4067a40 con 0x7ffaa4143390 2023-11-28T16:59:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.960+0000 7ffa99ffb640 1 -- 172.21.15.26:0/2334612738 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffa9c003d20 con 0x7ffaa4143390 2023-11-28T16:59:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.960+0000 7ffa99ffb640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffa88066900 0x7ffa88068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.960+0000 7ffa99ffb640 1 -- 172.21.15.26:0/2334612738 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffa9c084160 con 0x7ffaa4143390 2023-11-28T16:59:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.960+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffa88066900 0x7ffa88068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.960+0000 7ffaa93b3640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffa88066900 0x7ffa88068dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00af000 tx=0x7ffaa00046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:38.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:38.964+0000 7ffa99ffb640 1 -- 172.21.15.26:0/2334612738 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa9c051050 con 0x7ffaa4143390 2023-11-28T16:59:39.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.156+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffaa41527d0 con 0x7ffaa4143390 2023-11-28T16:59:39.159 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-11-28T16:59:39.156+0000 7fcd77275640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T16:59:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.156+0000 7ffa99ffb640 1 -- 172.21.15.26:0/2334612738 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffaa41527d0 con 0x7ffaa4143390 2023-11-28T16:59:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T16:59:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffa88066900 msgr2=0x7ffa88068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffa88066900 0x7ffa88068dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00af000 tx=0x7ffaa00046d0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa4143390 msgr2=0x7ffaa4143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa4143390 0x7ffaa4143810 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4070030 tx=0x7ffa9c00ec00 comp rx=0 tx=0).stop 2023-11-28T16:59:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 shutdown_connections 2023-11-28T16:59:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa4143390 0x7ffaa4143810 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ffa88066900 0x7ffa88068dc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa4151410 0x7ffaa414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 --2- 172.21.15.26:0/2334612738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90003b60 0x7ffaa41ed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 >> 172.21.15.26:0/2334612738 conn(0x7ffaa40c2ad0 msgr2=0x7ffaa414df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 shutdown_connections 2023-11-28T16:59:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.160+0000 7ffaab617640 1 -- 172.21.15.26:0/2334612738 wait complete. 2023-11-28T16:59:39.174 INFO:tasks.ceph.mds.c.smithi026.stderr: -5121> 2023-11-28T16:59:02.820+0000 7feff6a7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:59:39.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T16:59:39.223 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-11-28T16:59:39.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.328+0000 7ff2124aa640 1 Processor -- start 2023-11-28T16:59:39.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.328+0000 7ff2124aa640 1 -- start start 2023-11-28T16:59:39.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff2124aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff20c151d80 0x7ff20c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:39.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff2124aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c0c8430 0x7ff20c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:39.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff2124aa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c06cf70 con 0x7ff20c0c7f20 2023-11-28T16:59:39.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff2124aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c152160 con 0x7ff20c151d80 2023-11-28T16:59:39.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff2124aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c6a30 con 0x7ff20c0c8430 2023-11-28T16:59:39.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20b7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c0c8430 0x7ff20c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:39.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20b7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c0c8430 0x7ff20c06b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:46450/0 (socket says 172.21.15.26:46450) 2023-11-28T16:59:39.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20b7fe640 1 -- 172.21.15.26:0/872521957 learned_addr learned my addr 172.21.15.26:0/872521957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:39.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff210a47640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff20c0c7f20 0x7ff20c06bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:39276/0 (socket says 172.21.15.26:39276) 2023-11-28T16:59:39.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20bfff640 1 --2- 172.21.15.26:0/872521957 >> v2:172.21.15.79:3300/0 conn(0x7ff20c151d80 0x7ff20c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:39.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20b7fe640 1 -- 172.21.15.26:0/872521957 >> v2:172.21.15.79:3300/0 conn(0x7ff20c151d80 msgr2=0x7ff20c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:39.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20b7fe640 1 --2- 172.21.15.26:0/872521957 >> v2:172.21.15.79:3300/0 conn(0x7ff20c151d80 0x7ff20c0c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20b7fe640 1 -- 172.21.15.26:0/872521957 >> v1:172.21.15.79:6789/0 conn(0x7ff20c0c7f20 legacy=0x7ff20c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.332+0000 7ff20b7fe640 1 -- 172.21.15.26:0/872521957 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0c72d0 con 0x7ff20c0c8430 2023-11-28T16:59:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff20b7fe640 1 --2- 172.21.15.26:0/872521957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c0c8430 0x7ff20c06b720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff200009870 tx=0x7ff20001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03609a7f6923271 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff20affd640 1 -- 172.21.15.26:0/872521957 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000ab680 con 0x7ff20c0c8430 2023-11-28T16:59:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff20affd640 1 -- 172.21.15.26:0/872521957 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2000ab7e0 con 0x7ff20c0c8430 2023-11-28T16:59:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff20affd640 1 -- 172.21.15.26:0/872521957 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000abb70 con 0x7ff20c0c8430 2023-11-28T16:59:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- 172.21.15.26:0/872521957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c0c8430 msgr2=0x7ff20c06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 --2- 172.21.15.26:0/872521957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c0c8430 0x7ff20c06b720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff200009870 tx=0x7ff20001c480 comp rx=0 tx=0).stop 2023-11-28T16:59:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- 172.21.15.26:0/872521957 shutdown_connections 2023-11-28T16:59:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 --2- 172.21.15.26:0/872521957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c0c8430 0x7ff20c06b720 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 --2- 172.21.15.26:0/872521957 >> v2:172.21.15.79:3300/0 conn(0x7ff20c151d80 0x7ff20c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- 172.21.15.26:0/872521957 >> 172.21.15.26:0/872521957 conn(0x7ff20c0abd00 msgr2=0x7ff20c0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- 172.21.15.26:0/872521957 shutdown_connections 2023-11-28T16:59:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- 172.21.15.26:0/872521957 wait complete. 2023-11-28T16:59:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 Processor -- start 2023-11-28T16:59:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- start start 2023-11-28T16:59:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff20c0c7f20 0x7ff20c0bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20c0c8430 0x7ff20c0c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c151d80 0x7ff20c0c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c3f80 con 0x7ff20c0c7f20 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0be8a0 con 0x7ff20c0c8430 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.336+0000 7ff2124aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0beb80 con 0x7ff20c151d80 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff20c0c7f20 0x7ff20c0bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff20c0c7f20 0x7ff20c0bf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36568/0 (socket says 172.21.15.26:36568) 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 -- 172.21.15.26:0/4096526915 learned_addr learned my addr 172.21.15.26:0/4096526915 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff210a47640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c151d80 0x7ff20c0c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20b7fe640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20c0c8430 0x7ff20c0c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 -- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c151d80 msgr2=0x7ff20c0c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c151d80 0x7ff20c0c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 -- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20c0c8430 msgr2=0x7ff20c0c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20c0c8430 0x7ff20c0c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 -- 172.21.15.26:0/4096526915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000094d0 con 0x7ff20c0c7f20 2023-11-28T16:59:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff20bfff640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff20c0c7f20 0x7ff20c0bf8a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e930 tx=0x7ff1fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff208ff9640 1 -- 172.21.15.26:0/4096526915 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc009690 con 0x7ff20c0c7f20 2023-11-28T16:59:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff208ff9640 1 -- 172.21.15.26:0/4096526915 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00ca00 con 0x7ff20c0c7f20 2023-11-28T16:59:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff208ff9640 1 -- 172.21.15.26:0/4096526915 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00cd70 con 0x7ff20c0c7f20 2023-11-28T16:59:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c0bee60 con 0x7ff20c0c7f20 2023-11-28T16:59:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c150ef0 con 0x7ff20c0c7f20 2023-11-28T16:59:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c04e890 con 0x7ff20c0c7f20 2023-11-28T16:59:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.340+0000 7ff208ff9640 1 -- 172.21.15.26:0/4096526915 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff1fc013470 con 0x7ff20c0c7f20 2023-11-28T16:59:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.344+0000 7ff208ff9640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff1f8066900 0x7ff1f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.344+0000 7ff208ff9640 1 -- 172.21.15.26:0/4096526915 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6651+0+0 (secure 0 0 0) 0x7ff1fc0849f0 con 0x7ff20c0c7f20 2023-11-28T16:59:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.344+0000 7ff20b7fe640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff1f8066900 0x7ff1f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.344+0000 7ff20b7fe640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff1f8066900 0x7ff1f8068dc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff2000af000 tx=0x7ff2000b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.348+0000 7ff208ff9640 1 -- 172.21.15.26:0/4096526915 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1fc0519e0 con 0x7ff20c0c7f20 2023-11-28T16:59:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:39.540+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff20c0aff40 con 0x7ff20c0c7f20 2023-11-28T16:59:40.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.160+0000 7ff208ff9640 1 -- 172.21.15.26:0/4096526915 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff1fc055000 con 0x7ff20c0c7f20 2023-11-28T16:59:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff1f8066900 msgr2=0x7ff1f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff1f8066900 0x7ff1f8068dc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff2000af000 tx=0x7ff2000b6040 comp rx=0 tx=0).stop 2023-11-28T16:59:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff20c0c7f20 msgr2=0x7ff20c0bf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:40.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff20c0c7f20 0x7ff20c0bf8a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e930 tx=0x7ff1fc00edf0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 shutdown_connections 2023-11-28T16:59:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7ff1f8066900 0x7ff1f8068dc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff20c151d80 0x7ff20c0c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20c0c8430 0x7ff20c0c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 --2- 172.21.15.26:0/4096526915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff20c0c7f20 0x7ff20c0bf8a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 >> 172.21.15.26:0/4096526915 conn(0x7ff20c0abd00 msgr2=0x7ff20c14e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:40.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 shutdown_connections 2023-11-28T16:59:40.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.164+0000 7ff2124aa640 1 -- 172.21.15.26:0/4096526915 wait complete. 2023-11-28T16:59:40.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T16:59:40.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.380+0000 7f0a93580640 1 Processor -- start 2023-11-28T16:59:40.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.380+0000 7f0a93580640 1 -- start start 2023-11-28T16:59:40.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a93580640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a8c0c2da0 0x7f0a8c0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:40.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a93580640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:40.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a93580640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0a5ce0 con 0x7f0a8c0bff20 2023-11-28T16:59:40.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a93580640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0a6210 con 0x7f0a8c0c2da0 2023-11-28T16:59:40.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a93580640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0a5f30 con 0x7f0a8c0c08f0 2023-11-28T16:59:40.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a8c0c2da0 0x7f0a8c0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:40.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a8c0c2da0 0x7f0a8c0c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36584/0 (socket says 172.21.15.26:36584) 2023-11-28T16:59:40.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 -- 172.21.15.26:0/716156034 learned_addr learned my addr 172.21.15.26:0/716156034 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:40.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a91b1d640 1 --2- 172.21.15.26:0/716156034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:40.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 -- 172.21.15.26:0/716156034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 msgr2=0x7f0a8c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:40.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 --2- 172.21.15.26:0/716156034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 -- 172.21.15.26:0/716156034 >> v1:172.21.15.79:6789/0 conn(0x7f0a8c0bff20 legacy=0x7f0a8c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:40.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 -- 172.21.15.26:0/716156034 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c1554d0 con 0x7f0a8c0c2da0 2023-11-28T16:59:40.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.384+0000 7f0a90b1b640 1 --2- 172.21.15.26:0/716156034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0c2da0 0x7f0a8c0c6280 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009870 tx=0x7f0a7c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b815983a4715c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:40.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a83fff640 1 -- 172.21.15.26:0/716156034 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0ad680 con 0x7f0a8c0c2da0 2023-11-28T16:59:40.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a83fff640 1 -- 172.21.15.26:0/716156034 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c0ad7e0 con 0x7f0a8c0c2da0 2023-11-28T16:59:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a83fff640 1 -- 172.21.15.26:0/716156034 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0adb70 con 0x7f0a8c0c2da0 2023-11-28T16:59:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- 172.21.15.26:0/716156034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0c2da0 msgr2=0x7f0a8c0c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 --2- 172.21.15.26:0/716156034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0c2da0 0x7f0a8c0c6280 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009870 tx=0x7f0a7c01c4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- 172.21.15.26:0/716156034 shutdown_connections 2023-11-28T16:59:40.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 --2- 172.21.15.26:0/716156034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 --2- 172.21.15.26:0/716156034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0c2da0 0x7f0a8c0c6280 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- 172.21.15.26:0/716156034 >> 172.21.15.26:0/716156034 conn(0x7f0a8c0a8640 msgr2=0x7f0a8c0a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:40.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- 172.21.15.26:0/716156034 shutdown_connections 2023-11-28T16:59:40.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- 172.21.15.26:0/716156034 wait complete. 2023-11-28T16:59:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 Processor -- start 2023-11-28T16:59:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- start start 2023-11-28T16:59:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0bff20 0x7f0a8c1f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a8c0c2da0 0x7f0a8c153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1f12d0 con 0x7f0a8c0bff20 2023-11-28T16:59:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c150760 con 0x7f0a8c0c2da0 2023-11-28T16:59:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a93580640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1f0ff0 con 0x7f0a8c0c08f0 2023-11-28T16:59:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a9131c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0bff20 0x7f0a8c1f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a9131c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0bff20 0x7f0a8c1f05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36588/0 (socket says 172.21.15.26:36588) 2023-11-28T16:59:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a9131c640 1 -- 172.21.15.26:0/1855987325 learned_addr learned my addr 172.21.15.26:0/1855987325 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a90b1b640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.388+0000 7f0a91b1d640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a8c0c2da0 0x7f0a8c153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a9131c640 1 -- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 msgr2=0x7f0a8c1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a9131c640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a9131c640 1 -- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a8c0c2da0 msgr2=0x7f0a8c153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a9131c640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a8c0c2da0 0x7f0a8c153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a9131c640 1 -- 172.21.15.26:0/1855987325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c0094d0 con 0x7f0a8c0bff20 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a9131c640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0bff20 0x7f0a8c1f05f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c530 tx=0x7f0a8800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a81ffb640 1 -- 172.21.15.26:0/1855987325 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88005220 con 0x7f0a8c0bff20 2023-11-28T16:59:40.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a81ffb640 1 -- 172.21.15.26:0/1855987325 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88005380 con 0x7f0a8c0bff20 2023-11-28T16:59:40.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c150110 con 0x7f0a8c0bff20 2023-11-28T16:59:40.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a81ffb640 1 -- 172.21.15.26:0/1855987325 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88007270 con 0x7f0a8c0bff20 2023-11-28T16:59:40.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c14f0c0 con 0x7f0a8c0bff20 2023-11-28T16:59:40.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c04e890 con 0x7f0a8c0bff20 2023-11-28T16:59:40.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a81ffb640 1 -- 172.21.15.26:0/1855987325 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0a880073d0 con 0x7f0a8c0bff20 2023-11-28T16:59:40.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a81ffb640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0a700668d0 0x7f0a70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:40.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.392+0000 7f0a81ffb640 1 -- 172.21.15.26:0/1855987325 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f0a88083fd0 con 0x7f0a8c0bff20 2023-11-28T16:59:40.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.396+0000 7f0a90b1b640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0a700668d0 0x7f0a70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:40.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.396+0000 7f0a90b1b640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0a700668d0 0x7f0a70068d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0af000 tx=0x7f0a7c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:40.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.396+0000 7f0a81ffb640 1 -- 172.21.15.26:0/1855987325 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a88050f00 con 0x7f0a8c0bff20 2023-11-28T16:59:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:40.560+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a8c0c06d0 con 0x7f0a8c0bff20 2023-11-28T16:59:41.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a81ffb640 1 -- 172.21.15.26:0/1855987325 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a88054520 con 0x7f0a8c0bff20 2023-11-28T16:59:41.482 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-11-28T16:59:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0a700668d0 msgr2=0x7f0a70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0a700668d0 0x7f0a70068d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0af000 tx=0x7f0a7c0a7000 comp rx=0 tx=0).stop 2023-11-28T16:59:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0bff20 msgr2=0x7f0a8c1f05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0bff20 0x7f0a8c1f05f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c530 tx=0x7f0a8800c9f0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 shutdown_connections 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a8c0c2da0 0x7f0a8c153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f0a700668d0 0x7f0a70068d90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a8c0c08f0 0x7f0a8c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 --2- 172.21.15.26:0/1855987325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c0bff20 0x7f0a8c1f05f0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 >> 172.21.15.26:0/1855987325 conn(0x7f0a8c0a8640 msgr2=0x7f0a8c0c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 shutdown_connections 2023-11-28T16:59:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.480+0000 7f0a93580640 1 -- 172.21.15.26:0/1855987325 wait complete. 2023-11-28T16:59:41.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T16:59:41.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.660+0000 7fee978e3640 1 Processor -- start 2023-11-28T16:59:41.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.660+0000 7fee978e3640 1 -- start start 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee978e3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee900c0d30 0x7fee900c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee978e3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9006e2d0 con 0x7fee900a5ff0 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee978e3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900c5de0 con 0x7fee9006db60 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee978e3640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900a63d0 con 0x7fee900c0d30 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee94e7e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee900c0d30 0x7fee900c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee9567f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fee900a5ff0 0x7fee900c2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54922/0 (socket says 172.21.15.26:54922) 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee9567f640 1 -- 172.21.15.26:0/3249337914 learned_addr learned my addr 172.21.15.26:0/3249337914 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee94e7e640 1 -- 172.21.15.26:0/3249337914 >> v1:172.21.15.79:6789/0 conn(0x7fee9006db60 legacy=0x7fee900c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee94e7e640 1 -- 172.21.15.26:0/3249337914 >> v1:172.21.15.26:6789/0 conn(0x7fee900a5ff0 legacy=0x7fee900c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee94e7e640 1 -- 172.21.15.26:0/3249337914 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900c6050 con 0x7fee900c0d30 2023-11-28T16:59:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.664+0000 7fee87fff640 1 -- 172.21.15.26:0/3249337914 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558965286 0 0) 0x7fee9006e2d0 con 0x7fee900a5ff0 2023-11-28T16:59:41.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee94e7e640 1 --2- 172.21.15.26:0/3249337914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee900c4a30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fee800097c0 tx=0x7fee8001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa44d85c72a57b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:41.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee87fff640 1 -- 172.21.15.26:0/3249337914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee800ac410 con 0x7fee900c0d30 2023-11-28T16:59:41.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee87fff640 1 -- 172.21.15.26:0/3249337914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee800ac570 con 0x7fee900c0d30 2023-11-28T16:59:41.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee87fff640 1 -- 172.21.15.26:0/3249337914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee800ac900 con 0x7fee900c0d30 2023-11-28T16:59:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- 172.21.15.26:0/3249337914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 msgr2=0x7fee900c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 --2- 172.21.15.26:0/3249337914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee900c4a30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fee800097c0 tx=0x7fee8001c410 comp rx=0 tx=0).stop 2023-11-28T16:59:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- 172.21.15.26:0/3249337914 shutdown_connections 2023-11-28T16:59:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 --2- 172.21.15.26:0/3249337914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee900c4a30 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- 172.21.15.26:0/3249337914 >> 172.21.15.26:0/3249337914 conn(0x7fee900a8640 msgr2=0x7fee900a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- 172.21.15.26:0/3249337914 shutdown_connections 2023-11-28T16:59:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- 172.21.15.26:0/3249337914 wait complete. 2023-11-28T16:59:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 Processor -- start 2023-11-28T16:59:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- start start 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee9006db60 0x7fee90153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee900a5ff0 0x7fee900aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee901edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900ab710 con 0x7fee900c0d30 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90153930 con 0x7fee900a5ff0 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.668+0000 7fee978e3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee90154a20 con 0x7fee9006db60 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee901edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee901edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34580/0 (socket says 172.21.15.26:34580) 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 -- 172.21.15.26:0/250930521 learned_addr learned my addr 172.21.15.26:0/250930521 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee9567f640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee9006db60 0x7fee90153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee94e7e640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee900a5ff0 0x7fee900aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 -- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee9006db60 msgr2=0x7fee90153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee9006db60 0x7fee90153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 -- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee900a5ff0 msgr2=0x7fee900aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee900a5ff0 0x7fee900aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 -- 172.21.15.26:0/250930521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80009420 con 0x7fee900c0d30 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee95e80640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee901edda0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c780 tx=0x7fee8800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee85ffb640 1 -- 172.21.15.26:0/250930521 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88004b70 con 0x7fee900c0d30 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee85ffb640 1 -- 172.21.15.26:0/250930521 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800ce90 con 0x7fee900c0d30 2023-11-28T16:59:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee85ffb640 1 -- 172.21.15.26:0/250930521 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800a850 con 0x7fee900c0d30 2023-11-28T16:59:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90151e50 con 0x7fee900c0d30 2023-11-28T16:59:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90154f30 con 0x7fee900c0d30 2023-11-28T16:59:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9004e890 con 0x7fee900c0d30 2023-11-28T16:59:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.672+0000 7fee85ffb640 1 -- 172.21.15.26:0/250930521 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fee8800a9b0 con 0x7fee900c0d30 2023-11-28T16:59:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.676+0000 7fee85ffb640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee740668d0 0x7fee74068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.676+0000 7fee85ffb640 1 -- 172.21.15.26:0/250930521 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6213+0+0 (secure 0 0 0) 0x7fee88084690 con 0x7fee900c0d30 2023-11-28T16:59:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.676+0000 7fee9567f640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee740668d0 0x7fee74068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.676+0000 7fee9567f640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee740668d0 0x7fee74068d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fee8c007fd0 tx=0x7fee8c007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:41.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.676+0000 7fee85ffb640 1 -- 172.21.15.26:0/250930521 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee88051770 con 0x7fee900c0d30 2023-11-28T16:59:41.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:41.836+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee90151fe0 con 0x7fee900c0d30 2023-11-28T16:59:42.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee85ffb640 1 -- 172.21.15.26:0/250930521 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7fee88054d90 con 0x7fee900c0d30 2023-11-28T16:59:42.498 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee740668d0 msgr2=0x7fee74068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee740668d0 0x7fee74068d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fee8c007fd0 tx=0x7fee8c007d60 comp rx=0 tx=0).stop 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 msgr2=0x7fee901edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee901edda0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c780 tx=0x7fee8800cc40 comp rx=0 tx=0).stop 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 shutdown_connections 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee900c0d30 0x7fee901edda0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee900a5ff0 0x7fee900aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fee740668d0 0x7fee74068d90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 --2- 172.21.15.26:0/250930521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee9006db60 0x7fee90153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.496+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 >> 172.21.15.26:0/250930521 conn(0x7fee900a8640 msgr2=0x7fee900a8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:42.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.500+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 shutdown_connections 2023-11-28T16:59:42.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.500+0000 7fee978e3640 1 -- 172.21.15.26:0/250930521 wait complete. 2023-11-28T16:59:42.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.672+0000 7fe18ec6b640 1 Processor -- start 2023-11-28T16:59:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.672+0000 7fe18ec6b640 1 -- start start 2023-11-28T16:59:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ec6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe18814e9d0 0x7fe188151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ec6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe188070b80 0x7fe1880c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ec6b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1880c1f20 0x7fe18806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ec6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18806d320 con 0x7fe18814e9d0 2023-11-28T16:59:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ec6b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1880721b0 con 0x7fe1880c1f20 2023-11-28T16:59:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ec6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880c2830 con 0x7fe188070b80 2023-11-28T16:59:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe18814e9d0 0x7fe188151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe18814e9d0 0x7fe188151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34586/0 (socket says 172.21.15.26:34586) 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 -- 172.21.15.26:0/321290639 learned_addr learned my addr 172.21.15.26:0/321290639 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18d208640 1 --2- 172.21.15.26:0/321290639 >> v2:172.21.15.79:3300/0 conn(0x7fe1880c1f20 0x7fe18806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe187fff640 1 --2- 172.21.15.26:0/321290639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe188070b80 0x7fe1880c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 -- 172.21.15.26:0/321290639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe188070b80 msgr2=0x7fe1880c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 --2- 172.21.15.26:0/321290639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe188070b80 0x7fe1880c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 -- 172.21.15.26:0/321290639 >> v2:172.21.15.79:3300/0 conn(0x7fe1880c1f20 msgr2=0x7fe18806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 --2- 172.21.15.26:0/321290639 >> v2:172.21.15.79:3300/0 conn(0x7fe1880c1f20 0x7fe18806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18ca07640 1 -- 172.21.15.26:0/321290639 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188072450 con 0x7fe18814e9d0 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe18d208640 1 --2- 172.21.15.26:0/321290639 >> v2:172.21.15.79:3300/0 conn(0x7fe1880c1f20 0x7fe18806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:42.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.676+0000 7fe187fff640 1 --2- 172.21.15.26:0/321290639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe188070b80 0x7fe1880c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ca07640 1 --2- 172.21.15.26:0/321290639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe18814e9d0 0x7fe188151e60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe1880704f0 tx=0x7fe17c01e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9176b6f5cbf325dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe1877fe640 1 -- 172.21.15.26:0/321290639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0ab620 con 0x7fe18814e9d0 2023-11-28T16:59:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe1877fe640 1 -- 172.21.15.26:0/321290639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0ab780 con 0x7fe18814e9d0 2023-11-28T16:59:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe1877fe640 1 -- 172.21.15.26:0/321290639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0abb10 con 0x7fe18814e9d0 2023-11-28T16:59:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 -- 172.21.15.26:0/321290639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe18814e9d0 msgr2=0x7fe188151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/321290639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe18814e9d0 0x7fe188151e60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe1880704f0 tx=0x7fe17c01e680 comp rx=0 tx=0).stop 2023-11-28T16:59:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 -- 172.21.15.26:0/321290639 shutdown_connections 2023-11-28T16:59:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/321290639 >> v2:172.21.15.79:3300/0 conn(0x7fe1880c1f20 0x7fe18806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/321290639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe188070b80 0x7fe1880c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/321290639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe18814e9d0 0x7fe188151e60 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 -- 172.21.15.26:0/321290639 >> 172.21.15.26:0/321290639 conn(0x7fe1880c2ad0 msgr2=0x7fe1880c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 -- 172.21.15.26:0/321290639 shutdown_connections 2023-11-28T16:59:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 -- 172.21.15.26:0/321290639 wait complete. 2023-11-28T16:59:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 Processor -- start 2023-11-28T16:59:42.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.680+0000 7fe18ec6b640 1 -- start start 2023-11-28T16:59:42.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe188070b80 0x7fe1881e9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:42.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1880c1f20 0x7fe1880ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:42.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe18814e9d0 0x7fe188149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:42.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880abc60 con 0x7fe188070b80 2023-11-28T16:59:42.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880a9f00 con 0x7fe1880c1f20 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880aa1a0 con 0x7fe18814e9d0 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe188070b80 0x7fe1881e9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe188070b80 0x7fe1881e9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34588/0 (socket says 172.21.15.26:34588) 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 -- 172.21.15.26:0/2321185189 learned_addr learned my addr 172.21.15.26:0/2321185189 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18d208640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe18814e9d0 0x7fe188149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe187fff640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1880c1f20 0x7fe1880ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 -- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe18814e9d0 msgr2=0x7fe188149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe18814e9d0 0x7fe188149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 -- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1880c1f20 msgr2=0x7fe1880ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1880c1f20 0x7fe1880ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 -- 172.21.15.26:0/2321185189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0094d0 con 0x7fe188070b80 2023-11-28T16:59:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ca07640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe188070b80 0x7fe1881e9900 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe17c01ef20 tx=0x7fe17c01b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:42.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe1857fa640 1 -- 172.21.15.26:0/2321185189 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0bd5f0 con 0x7fe188070b80 2023-11-28T16:59:42.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe1857fa640 1 -- 172.21.15.26:0/2321185189 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0bd750 con 0x7fe188070b80 2023-11-28T16:59:42.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1880aa480 con 0x7fe188070b80 2023-11-28T16:59:42.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe1857fa640 1 -- 172.21.15.26:0/2321185189 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0bdae0 con 0x7fe188070b80 2023-11-28T16:59:42.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1880abe90 con 0x7fe188070b80 2023-11-28T16:59:42.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18804e890 con 0x7fe188070b80 2023-11-28T16:59:42.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.684+0000 7fe1857fa640 1 -- 172.21.15.26:0/2321185189 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe17c0bdc40 con 0x7fe188070b80 2023-11-28T16:59:42.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.688+0000 7fe1857fa640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe16c0668d0 0x7fe16c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:42.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.688+0000 7fe1857fa640 1 -- 172.21.15.26:0/2321185189 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe17c120c40 con 0x7fe188070b80 2023-11-28T16:59:42.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.688+0000 7fe187fff640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe16c0668d0 0x7fe16c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.688+0000 7fe187fff640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe16c0668d0 0x7fe16c068d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe18815b460 tx=0x7fe174008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:42.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.692+0000 7fe1857fa640 1 -- 172.21.15.26:0/2321185189 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe17c0ede10 con 0x7fe188070b80 2023-11-28T16:59:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.848+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1880700a0 con 0x7fe188070b80 2023-11-28T16:59:42.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe1857fa640 1 -- 172.21.15.26:0/2321185189 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fe17c0c2020 con 0x7fe188070b80 2023-11-28T16:59:42.854 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:42.855 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":76,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:42.490525+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/3229750931":"2023-11-29T16:59:39.159003+0000","172.21.15.26:6833/3229750931":"2023-11-29T16:59:39.159003+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:42.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe16c0668d0 msgr2=0x7fe16c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:42.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe16c0668d0 0x7fe16c068d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe18815b460 tx=0x7fe174008040 comp rx=0 tx=0).stop 2023-11-28T16:59:42.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe188070b80 msgr2=0x7fe1881e9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:42.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe188070b80 0x7fe1881e9900 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe17c01ef20 tx=0x7fe17c01b420 comp rx=0 tx=0).stop 2023-11-28T16:59:42.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 shutdown_connections 2023-11-28T16:59:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe16c0668d0 0x7fe16c068d90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe18814e9d0 0x7fe188149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1880c1f20 0x7fe1880ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 --2- 172.21.15.26:0/2321185189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe188070b80 0x7fe1881e9900 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 >> 172.21.15.26:0/2321185189 conn(0x7fe1880c2ad0 msgr2=0x7fe18806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:42.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 shutdown_connections 2023-11-28T16:59:42.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:42.852+0000 7fe18ec6b640 1 -- 172.21.15.26:0/2321185189 wait complete. 2023-11-28T16:59:42.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T16:56:05.635220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T16:59:08.379611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T16:59:09.728280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T16:59:42.876 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T16:59:43.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77d609a640 1 Processor -- start 2023-11-28T16:59:43.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77d609a640 1 -- start start 2023-11-28T16:59:43.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77d609a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77d00c1bd0 0x7f77d0151c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77d609a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d0152150 0x7f77d01588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77d609a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d0157d20 con 0x7f77d006c5c0 2023-11-28T16:59:43.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77d609a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d006deb0 con 0x7f77d00c1bd0 2023-11-28T16:59:43.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77d609a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d006e100 con 0x7f77d0152150 2023-11-28T16:59:43.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d0152150 0x7f77d01588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d0152150 0x7f77d01588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:40378/0 (socket says 172.21.15.26:40378) 2023-11-28T16:59:43.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cffff640 1 -- 172.21.15.26:0/2943762974 learned_addr learned my addr 172.21.15.26:0/2943762974 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:43.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77ceffd640 1 --1- 172.21.15.26:0/2943762974 >> v1:172.21.15.79:6789/0 conn(0x7f77d006c5c0 0x7f77d01581b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:47590/0 (socket says 172.21.15.26:47590) 2023-11-28T16:59:43.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cf7fe640 1 --2- 172.21.15.26:0/2943762974 >> v2:172.21.15.79:3300/0 conn(0x7f77d00c1bd0 0x7f77d0151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cffff640 1 -- 172.21.15.26:0/2943762974 >> v2:172.21.15.79:3300/0 conn(0x7f77d00c1bd0 msgr2=0x7f77d0151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:43.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cffff640 1 --2- 172.21.15.26:0/2943762974 >> v2:172.21.15.79:3300/0 conn(0x7f77d00c1bd0 0x7f77d0151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cffff640 1 -- 172.21.15.26:0/2943762974 >> v1:172.21.15.79:6789/0 conn(0x7f77d006c5c0 legacy=0x7f77d01581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cffff640 1 -- 172.21.15.26:0/2943762974 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00700f0 con 0x7f77d0152150 2023-11-28T16:59:43.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.028+0000 7f77cf7fe640 1 --2- 172.21.15.26:0/2943762974 >> v2:172.21.15.79:3300/0 conn(0x7f77d00c1bd0 0x7f77d0151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:43.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77cffff640 1 --2- 172.21.15.26:0/2943762974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d0152150 0x7f77d01588c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009e50 tx=0x7f77c801c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00131943cba76a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77ce7fc640 1 -- 172.21.15.26:0/2943762974 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c80a57d0 con 0x7f77d0152150 2023-11-28T16:59:43.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77ce7fc640 1 -- 172.21.15.26:0/2943762974 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c80a5930 con 0x7f77d0152150 2023-11-28T16:59:43.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77ce7fc640 1 -- 172.21.15.26:0/2943762974 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c80a5cc0 con 0x7f77d0152150 2023-11-28T16:59:43.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 -- 172.21.15.26:0/2943762974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d0152150 msgr2=0x7f77d01588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 --2- 172.21.15.26:0/2943762974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d0152150 0x7f77d01588c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009e50 tx=0x7f77c801c8f0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 -- 172.21.15.26:0/2943762974 shutdown_connections 2023-11-28T16:59:43.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 --2- 172.21.15.26:0/2943762974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d0152150 0x7f77d01588c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 --2- 172.21.15.26:0/2943762974 >> v2:172.21.15.79:3300/0 conn(0x7f77d00c1bd0 0x7f77d0151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 -- 172.21.15.26:0/2943762974 >> 172.21.15.26:0/2943762974 conn(0x7f77d00c2a60 msgr2=0x7f77d00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:43.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 -- 172.21.15.26:0/2943762974 shutdown_connections 2023-11-28T16:59:43.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.032+0000 7f77d609a640 1 -- 172.21.15.26:0/2943762974 wait complete. 2023-11-28T16:59:43.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 Processor -- start 2023-11-28T16:59:43.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 -- start start 2023-11-28T16:59:43.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d006c5c0 0x7f77d01ed310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77d00c1bd0 0x7f77d014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d0152150 0x7f77d014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d00c56b0 con 0x7f77d0152150 2023-11-28T16:59:43.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d014e3b0 con 0x7f77d00c1bd0 2023-11-28T16:59:43.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d014e690 con 0x7f77d006c5c0 2023-11-28T16:59:43.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d0152150 0x7f77d014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d006c5c0 0x7f77d01ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d006c5c0 0x7f77d01ed310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:40394/0 (socket says 172.21.15.26:40394) 2023-11-28T16:59:43.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 -- 172.21.15.26:0/838026820 learned_addr learned my addr 172.21.15.26:0/838026820 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:43.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77ceffd640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77d00c1bd0 0x7f77d014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 -- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77d00c1bd0 msgr2=0x7f77d014f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77d00c1bd0 0x7f77d014f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 -- 172.21.15.26:0/838026820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d0152150 msgr2=0x7f77d014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d0152150 0x7f77d014fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 -- 172.21.15.26:0/838026820 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009420 con 0x7f77d006c5c0 2023-11-28T16:59:43.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cffff640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d0152150 0x7f77d014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:43.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77cf7fe640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d006c5c0 0x7f77d01ed310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77c000ebe0 tx=0x7f77c000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77b7fff640 1 -- 172.21.15.26:0/838026820 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000eee0 con 0x7f77d006c5c0 2023-11-28T16:59:43.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77b7fff640 1 -- 172.21.15.26:0/838026820 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000cc30 con 0x7f77d006c5c0 2023-11-28T16:59:43.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77b7fff640 1 -- 172.21.15.26:0/838026820 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0013470 con 0x7f77d006c5c0 2023-11-28T16:59:43.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c8009b30 con 0x7f77d006c5c0 2023-11-28T16:59:43.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.036+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d014dad0 con 0x7f77d006c5c0 2023-11-28T16:59:43.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.040+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d004e890 con 0x7f77d006c5c0 2023-11-28T16:59:43.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.040+0000 7f77b7fff640 1 -- 172.21.15.26:0/838026820 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f77c00135d0 con 0x7f77d006c5c0 2023-11-28T16:59:43.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.040+0000 7f77b7fff640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77bc0668d0 0x7f77bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.040+0000 7f77b7fff640 1 -- 172.21.15.26:0/838026820 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f77c0084700 con 0x7f77d006c5c0 2023-11-28T16:59:43.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.040+0000 7f77ceffd640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77bc0668d0 0x7f77bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.040+0000 7f77ceffd640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77bc0668d0 0x7f77bc068d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f77d014a010 tx=0x7f77c4007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.044+0000 7f77b7fff640 1 -- 172.21.15.26:0/838026820 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77c0051980 con 0x7f77d006c5c0 2023-11-28T16:59:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.204+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77d01528a0 con 0x7f77d006c5c0 2023-11-28T16:59:43.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.204+0000 7f77b7fff640 1 -- 172.21.15.26:0/838026820 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77c0054fa0 con 0x7f77d006c5c0 2023-11-28T16:59:43.208 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-11-28T16:59:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77bc0668d0 msgr2=0x7f77bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77bc0668d0 0x7f77bc068d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f77d014a010 tx=0x7f77c4007e50 comp rx=0 tx=0).stop 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d006c5c0 msgr2=0x7f77d01ed310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d006c5c0 0x7f77d01ed310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77c000ebe0 tx=0x7f77c000c520 comp rx=0 tx=0).stop 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 shutdown_connections 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d0152150 0x7f77d014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77d00c1bd0 0x7f77d014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f77bc0668d0 0x7f77bc068d90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 --2- 172.21.15.26:0/838026820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77d006c5c0 0x7f77d01ed310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 >> 172.21.15.26:0/838026820 conn(0x7f77d00c2a60 msgr2=0x7f77d0149590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 shutdown_connections 2023-11-28T16:59:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.208+0000 7f77d609a640 1 -- 172.21.15.26:0/838026820 wait complete. 2023-11-28T16:59:43.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T16:59:43.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d343a640 1 Processor -- start 2023-11-28T16:59:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d343a640 1 -- start start 2023-11-28T16:59:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d343a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 0x7f16cc0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d343a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc151e90 con 0x7f16cc0c4ca0 2023-11-28T16:59:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d343a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0c71a0 con 0x7f16cc151ab0 2023-11-28T16:59:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d343a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0c6900 con 0x7f16cc0c7ce0 2023-11-28T16:59:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d2c39640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f16cc0c4ca0 0x7f16cc06b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54932/0 (socket says 172.21.15.26:54932) 2023-11-28T16:59:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d2c39640 1 -- 172.21.15.26:0/1844072839 learned_addr learned my addr 172.21.15.26:0/1844072839 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1c37640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 0x7f16cc0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648468178 0 0) 0x7f16cc151e90 con 0x7f16cc0c4ca0 2023-11-28T16:59:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b8003530 con 0x7f16cc0c4ca0 2023-11-28T16:59:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2686514514 0 0) 0x7f16b8003530 con 0x7f16cc0c4ca0 2023-11-28T16:59:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 msgr2=0x7f16cc0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 0x7f16cc0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 >> v1:172.21.15.79:6789/0 conn(0x7f16cc151ab0 legacy=0x7f16cc154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0c6be0 con 0x7f16cc0c4ca0 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f16c4001a00 con 0x7f16cc0c4ca0 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 >> v1:172.21.15.26:6789/0 conn(0x7f16cc0c4ca0 legacy=0x7f16cc06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 0x7f16b80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16b8004d10 0x7f16b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0c6900 con 0x7f16b8003ef0 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800baa0 con 0x7f16b8004d10 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800bc60 con 0x7f16cc0c7ce0 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.376+0000 7f16d1c37640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d2438640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 0x7f16b80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d2c39640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16b8004d10 0x7f16b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1c37640 1 -- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 msgr2=0x7f16b80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1c37640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc0c7ce0 0x7f16b80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1c37640 1 -- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16b8004d10 msgr2=0x7f16b8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1c37640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16b8004d10 0x7f16b8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1c37640 1 -- 172.21.15.26:0/1844072839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8003530 con 0x7f16b8003ef0 2023-11-28T16:59:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1c37640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16b80047d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009ab0 tx=0x7f16bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325e17be3559cde2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0a5620 con 0x7f16b8003ef0 2023-11-28T16:59:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0a5780 con 0x7f16b8003ef0 2023-11-28T16:59:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.380+0000 7f16d1436640 1 -- 172.21.15.26:0/1844072839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0a5b30 con 0x7f16b8003ef0 2023-11-28T16:59:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- 172.21.15.26:0/1844072839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 msgr2=0x7f16b80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 --2- 172.21.15.26:0/1844072839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16b80047d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009ab0 tx=0x7f16bc01ca30 comp rx=0 tx=0).stop 2023-11-28T16:59:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2c39640 1 -- 172.21.15.26:0/1844072839 reap_dead start 2023-11-28T16:59:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- 172.21.15.26:0/1844072839 shutdown_connections 2023-11-28T16:59:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- 172.21.15.26:0/1844072839 >> 172.21.15.26:0/1844072839 conn(0x7f16cc0abba0 msgr2=0x7f16cc0abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- 172.21.15.26:0/1844072839 shutdown_connections 2023-11-28T16:59:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- 172.21.15.26:0/1844072839 wait complete. 2023-11-28T16:59:43.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 Processor -- start 2023-11-28T16:59:43.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- start start 2023-11-28T16:59:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16cc1ead20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc154100 0x7f16cc1ea260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16cc0aaaf0 0x7f16cc1ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0af950 con 0x7f16b8003ef0 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc1ed150 con 0x7f16cc0aaaf0 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d343a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc1ece20 con 0x7f16cc154100 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16cc1ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16cc1ead20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34618/0 (socket says 172.21.15.26:34618) 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 -- 172.21.15.26:0/3145681475 learned_addr learned my addr 172.21.15.26:0/3145681475 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d1c37640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc154100 0x7f16cc1ea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2c39640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16cc0aaaf0 0x7f16cc1ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 -- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc154100 msgr2=0x7f16cc1ea260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc154100 0x7f16cc1ea260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 -- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16cc0aaaf0 msgr2=0x7f16cc1ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16cc0aaaf0 0x7f16cc1ed5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 -- 172.21.15.26:0/3145681475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc1ea7a0 con 0x7f16b8003ef0 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2c39640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16cc0aaaf0 0x7f16cc1ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.384+0000 7f16d2438640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16cc1ead20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f16c8011b70 tx=0x7f16c800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16c2ffd640 1 -- 172.21.15.26:0/3145681475 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800fc50 con 0x7f16b8003ef0 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16c2ffd640 1 -- 172.21.15.26:0/3145681475 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800fdb0 con 0x7f16b8003ef0 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16c2ffd640 1 -- 172.21.15.26:0/3145681475 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8005310 con 0x7f16b8003ef0 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc153610 con 0x7f16b8003ef0 2023-11-28T16:59:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc153bd0 con 0x7f16b8003ef0 2023-11-28T16:59:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc067a10 con 0x7f16b8003ef0 2023-11-28T16:59:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16c2ffd640 1 -- 172.21.15.26:0/3145681475 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f16c8003600 con 0x7f16b8003ef0 2023-11-28T16:59:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16c2ffd640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16b0066900 0x7f16b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16c2ffd640 1 -- 172.21.15.26:0/3145681475 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f16c8087c90 con 0x7f16b8003ef0 2023-11-28T16:59:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.388+0000 7f16d1c37640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16b0066900 0x7f16b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.392+0000 7f16d1c37640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16b0066900 0x7f16b0068dc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0af000 tx=0x7f16bc0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.392+0000 7f16c2ffd640 1 -- 172.21.15.26:0/3145681475 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16c8054f00 con 0x7f16b8003ef0 2023-11-28T16:59:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.552+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16cc074970 con 0x7f16b8003ef0 2023-11-28T16:59:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.552+0000 7f16c2ffd640 1 -- 172.21.15.26:0/3145681475 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v76) v1 ==== 105+0+11 (secure 0 0 0) 0x7f16c80190b0 con 0x7f16b8003ef0 2023-11-28T16:59:43.556 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-11-28T16:59:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16b0066900 msgr2=0x7f16b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16b0066900 0x7f16b0068dc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0af000 tx=0x7f16bc0046d0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 msgr2=0x7f16cc1ead20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16cc1ead20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f16c8011b70 tx=0x7f16c800f5a0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 shutdown_connections 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16cc0aaaf0 0x7f16cc1ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f16b0066900 0x7f16b0068dc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16cc154100 0x7f16cc1ea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 --2- 172.21.15.26:0/3145681475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b8003ef0 0x7f16cc1ead20 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 >> 172.21.15.26:0/3145681475 conn(0x7f16cc0abba0 msgr2=0x7f16cc14de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 shutdown_connections 2023-11-28T16:59:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.556+0000 7f16d343a640 1 -- 172.21.15.26:0/3145681475 wait complete. 2023-11-28T16:59:43.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T16:59:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed90fc4640 1 Processor -- start 2023-11-28T16:59:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed90fc4640 1 -- start start 2023-11-28T16:59:43.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed90fc4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fed8c0a86d0 0x7fed8c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed90fc4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed8c14fd00 0x7fed8c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed90fc4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c152d90 con 0x7fed8c156600 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed90fc4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c152480 con 0x7fed8c14fd00 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed90fc4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0a9760 con 0x7fed8c0a86d0 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.720+0000 7fed8ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed8c14fd00 0x7fed8c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed8c14fd00 0x7fed8c0aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34632/0 (socket says 172.21.15.26:34632) 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8ad9d640 1 -- 172.21.15.26:0/1245795718 learned_addr learned my addr 172.21.15.26:0/1245795718 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8a59c640 1 --2- 172.21.15.26:0/1245795718 >> v2:172.21.15.79:3300/0 conn(0x7fed8c0a86d0 0x7fed8c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8ad9d640 1 -- 172.21.15.26:0/1245795718 >> v2:172.21.15.79:3300/0 conn(0x7fed8c0a86d0 msgr2=0x7fed8c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:43.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8ad9d640 1 --2- 172.21.15.26:0/1245795718 >> v2:172.21.15.79:3300/0 conn(0x7fed8c0a86d0 0x7fed8c0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8ad9d640 1 -- 172.21.15.26:0/1245795718 >> v1:172.21.15.79:6789/0 conn(0x7fed8c156600 legacy=0x7fed8c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8ad9d640 1 -- 172.21.15.26:0/1245795718 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c152740 con 0x7fed8c14fd00 2023-11-28T16:59:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed8ad9d640 1 --2- 172.21.15.26:0/1245795718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c0aae40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fed84009e50 tx=0x7fed8401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8038a9cf0f4851e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed89d9b640 1 -- 172.21.15.26:0/1245795718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed840a5780 con 0x7fed8c14fd00 2023-11-28T16:59:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed89d9b640 1 -- 172.21.15.26:0/1245795718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed840a58e0 con 0x7fed8c14fd00 2023-11-28T16:59:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.724+0000 7fed89d9b640 1 -- 172.21.15.26:0/1245795718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed840a5c70 con 0x7fed8c14fd00 2023-11-28T16:59:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- 172.21.15.26:0/1245795718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 msgr2=0x7fed8c0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 --2- 172.21.15.26:0/1245795718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c0aae40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fed84009e50 tx=0x7fed8401c9d0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- 172.21.15.26:0/1245795718 shutdown_connections 2023-11-28T16:59:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 --2- 172.21.15.26:0/1245795718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c0aae40 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 --2- 172.21.15.26:0/1245795718 >> v2:172.21.15.79:3300/0 conn(0x7fed8c0a86d0 0x7fed8c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- 172.21.15.26:0/1245795718 >> 172.21.15.26:0/1245795718 conn(0x7fed8c0c2a60 msgr2=0x7fed8c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- 172.21.15.26:0/1245795718 shutdown_connections 2023-11-28T16:59:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- 172.21.15.26:0/1245795718 wait complete. 2023-11-28T16:59:43.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 Processor -- start 2023-11-28T16:59:43.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- start start 2023-11-28T16:59:43.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c0a86d0 0x7fed8c06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c13ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed8c156600 0x7fed8c1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1f0d60 con 0x7fed8c14fd00 2023-11-28T16:59:43.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1f1290 con 0x7fed8c0a86d0 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed90fc4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1f0fb0 con 0x7fed8c156600 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed83fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c13ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed83fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c13ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34636/0 (socket says 172.21.15.26:34636) 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed83fff640 1 -- 172.21.15.26:0/762251095 learned_addr learned my addr 172.21.15.26:0/762251095 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed8a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c0a86d0 0x7fed8c06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.728+0000 7fed8ad9d640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed8c156600 0x7fed8c1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed83fff640 1 -- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed8c156600 msgr2=0x7fed8c1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed83fff640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed8c156600 0x7fed8c1404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed83fff640 1 -- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c0a86d0 msgr2=0x7fed8c06d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed83fff640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c0a86d0 0x7fed8c06d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed83fff640 1 -- 172.21.15.26:0/762251095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84009b30 con 0x7fed8c14fd00 2023-11-28T16:59:43.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed83fff640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c13ffb0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c500 tx=0x7fed7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed82ffd640 1 -- 172.21.15.26:0/762251095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed740052d0 con 0x7fed8c14fd00 2023-11-28T16:59:43.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed82ffd640 1 -- 172.21.15.26:0/762251095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed74005430 con 0x7fed8c14fd00 2023-11-28T16:59:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c071380 con 0x7fed8c14fd00 2023-11-28T16:59:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed82ffd640 1 -- 172.21.15.26:0/762251095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74012830 con 0x7fed8c14fd00 2023-11-28T16:59:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c06d6f0 con 0x7fed8c14fd00 2023-11-28T16:59:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c1ece30 con 0x7fed8c14fd00 2023-11-28T16:59:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.732+0000 7fed82ffd640 1 -- 172.21.15.26:0/762251095 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fed74012990 con 0x7fed8c14fd00 2023-11-28T16:59:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.736+0000 7fed82ffd640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed6c066900 0x7fed6c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.736+0000 7fed82ffd640 1 -- 172.21.15.26:0/762251095 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fed74083ef0 con 0x7fed8c14fd00 2023-11-28T16:59:43.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.736+0000 7fed8a59c640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed6c066900 0x7fed6c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:43.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.736+0000 7fed8a59c640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed6c066900 0x7fed6c068dc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0c5220 tx=0x7fed7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:43.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.740+0000 7fed82ffd640 1 -- 172.21.15.26:0/762251095 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed740510f0 con 0x7fed8c14fd00 2023-11-28T16:59:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.896+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fed8c04e890 con 0x7fed8c14fd00 2023-11-28T16:59:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.896+0000 7fed82ffd640 1 -- 172.21.15.26:0/762251095 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v76) v1 ==== 101+0+11 (secure 0 0 0) 0x7fed74054710 con 0x7fed8c14fd00 2023-11-28T16:59:43.901 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-11-28T16:59:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed6c066900 msgr2=0x7fed6c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed6c066900 0x7fed6c068dc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0c5220 tx=0x7fed7c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 msgr2=0x7fed8c13ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c13ffb0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c500 tx=0x7fed7400c9c0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 shutdown_connections 2023-11-28T16:59:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fed6c066900 0x7fed6c068dc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed8c156600 0x7fed8c1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c14fd00 0x7fed8c13ffb0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 --2- 172.21.15.26:0/762251095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c0a86d0 0x7fed8c06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 >> 172.21.15.26:0/762251095 conn(0x7fed8c0c2a60 msgr2=0x7fed8c0c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 shutdown_connections 2023-11-28T16:59:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:43.900+0000 7fed90fc4640 1 -- 172.21.15.26:0/762251095 wait complete. 2023-11-28T16:59:43.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:44.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22bde32640 1 Processor -- start 2023-11-28T16:59:44.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22bde32640 1 -- start start 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22bde32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b806a5a0 0x7f22b80c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22bde32640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22b80c1ae0 0x7f22b806a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22bde32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b81551d0 con 0x7f22b80c0510 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22bde32640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b806e9c0 con 0x7f22b80c1ae0 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22bde32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80a86e0 con 0x7f22b806a5a0 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22b80c1ae0 0x7f22b806a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22b80c1ae0 0x7f22b806a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34644/0 (socket says 172.21.15.26:34644) 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b6ffd640 1 -- 172.21.15.26:0/1510389657 learned_addr learned my addr 172.21.15.26:0/1510389657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:44.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b77fe640 1 --2- 172.21.15.26:0/1510389657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b806a5a0 0x7f22b80c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b6ffd640 1 -- 172.21.15.26:0/1510389657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b806a5a0 msgr2=0x7f22b80c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b6ffd640 1 --2- 172.21.15.26:0/1510389657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b806a5a0 0x7f22b80c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b6ffd640 1 -- 172.21.15.26:0/1510389657 >> v1:172.21.15.79:6789/0 conn(0x7f22b80c0510 legacy=0x7f22b80c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.064+0000 7f22b6ffd640 1 -- 172.21.15.26:0/1510389657 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8072840 con 0x7f22b80c1ae0 2023-11-28T16:59:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22b6ffd640 1 --2- 172.21.15.26:0/1510389657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c1ae0 0x7f22b806a980 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009870 tx=0x7f22ac01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae199b406ddba1eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22b67fc640 1 -- 172.21.15.26:0/1510389657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0ab600 con 0x7f22b80c1ae0 2023-11-28T16:59:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22b67fc640 1 -- 172.21.15.26:0/1510389657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac0a7050 con 0x7f22b80c1ae0 2023-11-28T16:59:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22b67fc640 1 -- 172.21.15.26:0/1510389657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0ab980 con 0x7f22b80c1ae0 2023-11-28T16:59:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 -- 172.21.15.26:0/1510389657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c1ae0 msgr2=0x7f22b806a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 --2- 172.21.15.26:0/1510389657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c1ae0 0x7f22b806a980 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009870 tx=0x7f22ac01c540 comp rx=0 tx=0).stop 2023-11-28T16:59:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 -- 172.21.15.26:0/1510389657 shutdown_connections 2023-11-28T16:59:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 --2- 172.21.15.26:0/1510389657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c1ae0 0x7f22b806a980 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 --2- 172.21.15.26:0/1510389657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b806a5a0 0x7f22b80c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 -- 172.21.15.26:0/1510389657 >> 172.21.15.26:0/1510389657 conn(0x7f22b80c3be0 msgr2=0x7f22b80c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 -- 172.21.15.26:0/1510389657 shutdown_connections 2023-11-28T16:59:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.068+0000 7f22bde32640 1 -- 172.21.15.26:0/1510389657 wait complete. 2023-11-28T16:59:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 Processor -- start 2023-11-28T16:59:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 -- start start 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b806a5a0 0x7f22b81f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c0510 0x7f22b80c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80c1ae0 0x7f22b80c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b814e2d0 con 0x7f22b80c0510 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8143380 con 0x7f22b806a5a0 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8156640 con 0x7f22b80c1ae0 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c0510 0x7f22b80c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b806a5a0 0x7f22b81f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c0510 0x7f22b80c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34658/0 (socket says 172.21.15.26:34658) 2023-11-28T16:59:44.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 -- 172.21.15.26:0/3820803794 learned_addr learned my addr 172.21.15.26:0/3820803794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:44.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b7fff640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80c1ae0 0x7f22b80c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 -- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80c1ae0 msgr2=0x7f22b80c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80c1ae0 0x7f22b80c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 -- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b806a5a0 msgr2=0x7f22b81f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b806a5a0 0x7f22b81f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 -- 172.21.15.26:0/3820803794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0094d0 con 0x7f22b80c0510 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b77fe640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b806a5a0 0x7f22b81f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22b6ffd640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c0510 0x7f22b80c5d60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f22ac01abf0 tx=0x7f22ac0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f229ffff640 1 -- 172.21.15.26:0/3820803794 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0b6440 con 0x7f22b80c0510 2023-11-28T16:59:44.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f229ffff640 1 -- 172.21.15.26:0/3820803794 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac0b65a0 con 0x7f22b80c0510 2023-11-28T16:59:44.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f229ffff640 1 -- 172.21.15.26:0/3820803794 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0b6950 con 0x7f22b80c0510 2023-11-28T16:59:44.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b814dd70 con 0x7f22b80c0510 2023-11-28T16:59:44.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b814dff0 con 0x7f22b80c0510 2023-11-28T16:59:44.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.072+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b804e890 con 0x7f22b80c0510 2023-11-28T16:59:44.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.076+0000 7f229ffff640 1 -- 172.21.15.26:0/3820803794 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f22ac0b2040 con 0x7f22b80c0510 2023-11-28T16:59:44.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.076+0000 7f229ffff640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f22a40668d0 0x7f22a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.076+0000 7f229ffff640 1 -- 172.21.15.26:0/3820803794 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f22ac11e070 con 0x7f22b80c0510 2023-11-28T16:59:44.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.076+0000 7f22b77fe640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f22a40668d0 0x7f22a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.076+0000 7f22b77fe640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f22a40668d0 0x7f22a4068d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f22b81eee60 tx=0x7f22a8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.080+0000 7f229ffff640 1 -- 172.21.15.26:0/3820803794 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22ac0eb2f0 con 0x7f22b80c0510 2023-11-28T16:59:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22b80721a0 con 0x7f22b80c0510 2023-11-28T16:59:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f229ffff640 1 -- 172.21.15.26:0/3820803794 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f22ac0ee910 con 0x7f22b80c0510 2023-11-28T16:59:44.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:44.275 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7047,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/101094954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":101094954},{"type":"v1","addr":"172.21.15.26:6835","nonce":101094954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:44.275 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 53 2023-11-28T16:59:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f22a40668d0 msgr2=0x7f22a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f22a40668d0 0x7f22a4068d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f22b81eee60 tx=0x7f22a8009190 comp rx=0 tx=0).stop 2023-11-28T16:59:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c0510 msgr2=0x7f22b80c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c0510 0x7f22b80c5d60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f22ac01abf0 tx=0x7f22ac0192e0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 shutdown_connections 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f22a40668d0 0x7f22a4068d90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80c1ae0 0x7f22b80c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b80c0510 0x7f22b80c5d60 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 --2- 172.21.15.26:0/3820803794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b806a5a0 0x7f22b81f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 >> 172.21.15.26:0/3820803794 conn(0x7f22b80c3be0 msgr2=0x7f22b80a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 shutdown_connections 2023-11-28T16:59:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.272+0000 7f22bde32640 1 -- 172.21.15.26:0/3820803794 wait complete. 2023-11-28T16:59:44.296 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61c5d1640 1 Processor -- start 2023-11-28T16:59:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61c5d1640 1 -- start start 2023-11-28T16:59:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61c5d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc61406e7c0 0x7fc61406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61c5d1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6141580b0 0x7fc614158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61c5d1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61406e280 con 0x7fc614155360 2023-11-28T16:59:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61c5d1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6140c2150 con 0x7fc6141580b0 2023-11-28T16:59:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61c5d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc614157c60 con 0x7fc61406e7c0 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc619b6c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc61406e7c0 0x7fc61406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61ab6e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6141580b0 0x7fc614158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61a36d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc614155360 0x7fc61406b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:47626/0 (socket says 172.21.15.26:47626) 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.436+0000 7fc61a36d640 1 -- 172.21.15.26:0/2280503541 learned_addr learned my addr 172.21.15.26:0/2280503541 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc619b6c640 1 -- 172.21.15.26:0/2280503541 >> v2:172.21.15.79:3300/0 conn(0x7fc6141580b0 msgr2=0x7fc614158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc619b6c640 1 --2- 172.21.15.26:0/2280503541 >> v2:172.21.15.79:3300/0 conn(0x7fc6141580b0 0x7fc614158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc619b6c640 1 -- 172.21.15.26:0/2280503541 >> v1:172.21.15.79:6789/0 conn(0x7fc614155360 legacy=0x7fc61406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc619b6c640 1 -- 172.21.15.26:0/2280503541 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140c1bd0 con 0x7fc61406e7c0 2023-11-28T16:59:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc619b6c640 1 --2- 172.21.15.26:0/2280503541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc61406e7c0 0x7fc61406ec40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6040097c0 tx=0x7fc60401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3690675faaa4bd05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc61936b640 1 -- 172.21.15.26:0/2280503541 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040ad640 con 0x7fc61406e7c0 2023-11-28T16:59:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc61936b640 1 -- 172.21.15.26:0/2280503541 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6040ad7a0 con 0x7fc61406e7c0 2023-11-28T16:59:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc61936b640 1 -- 172.21.15.26:0/2280503541 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040adb30 con 0x7fc61406e7c0 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc61c5d1640 1 -- 172.21.15.26:0/2280503541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc61406e7c0 msgr2=0x7fc61406ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.440+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/2280503541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc61406e7c0 0x7fc61406ec40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6040097c0 tx=0x7fc60401c480 comp rx=0 tx=0).stop 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- 172.21.15.26:0/2280503541 shutdown_connections 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/2280503541 >> v2:172.21.15.79:3300/0 conn(0x7fc6141580b0 0x7fc614158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/2280503541 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc61406e7c0 0x7fc61406ec40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- 172.21.15.26:0/2280503541 >> 172.21.15.26:0/2280503541 conn(0x7fc6140c3240 msgr2=0x7fc6140c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- 172.21.15.26:0/2280503541 shutdown_connections 2023-11-28T16:59:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- 172.21.15.26:0/2280503541 wait complete. 2023-11-28T16:59:44.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 Processor -- start 2023-11-28T16:59:44.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- start start 2023-11-28T16:59:44.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406e7c0 0x7fc614071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc614155360 0x7fc614151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6141580b0 0x7fc614151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140a7d90 con 0x7fc6141580b0 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140a74f0 con 0x7fc61406e7c0 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61c5d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140a77d0 con 0x7fc614155360 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6141580b0 0x7fc614151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6141580b0 0x7fc614151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34664/0 (socket says 172.21.15.26:34664) 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 -- 172.21.15.26:0/1186614904 learned_addr learned my addr 172.21.15.26:0/1186614904 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc619b6c640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc614155360 0x7fc614151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61a36d640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406e7c0 0x7fc614071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 -- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc614155360 msgr2=0x7fc614151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc614155360 0x7fc614151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 -- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406e7c0 msgr2=0x7fc614071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406e7c0 0x7fc614071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 -- 172.21.15.26:0/1186614904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604009420 con 0x7fc6141580b0 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.444+0000 7fc61ab6e640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6141580b0 0x7fc614151b80 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00efc0 tx=0x7fc60c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc60affd640 1 -- 172.21.15.26:0/1186614904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c014480 con 0x7fc6141580b0 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc60affd640 1 -- 172.21.15.26:0/1186614904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00f040 con 0x7fc6141580b0 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc60affd640 1 -- 172.21.15.26:0/1186614904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c014820 con 0x7fc6141580b0 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6140a7ab0 con 0x7fc6141580b0 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc614072af0 con 0x7fc6141580b0 2023-11-28T16:59:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61404e890 con 0x7fc6141580b0 2023-11-28T16:59:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc60affd640 1 -- 172.21.15.26:0/1186614904 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc60c014980 con 0x7fc6141580b0 2023-11-28T16:59:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc60affd640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc5f8066900 0x7fc5f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc60affd640 1 -- 172.21.15.26:0/1186614904 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc60c084ea0 con 0x7fc6141580b0 2023-11-28T16:59:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.448+0000 7fc61a36d640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc5f8066900 0x7fc5f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.452+0000 7fc61a36d640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc5f8066900 0x7fc5f8068dc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc610005890 tx=0x7fc610009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.452+0000 7fc60affd640 1 -- 172.21.15.26:0/1186614904 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc60c052110 con 0x7fc6141580b0 2023-11-28T16:59:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.612+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6141512f0 con 0x7fc6141580b0 2023-11-28T16:59:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.612+0000 7fc60affd640 1 -- 172.21.15.26:0/1186614904 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fc60c055730 con 0x7fc6141580b0 2023-11-28T16:59:44.617 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:44.618 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":76,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:42.490525+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/3229750931":"2023-11-29T16:59:39.159003+0000","172.21.15.26:6833/3229750931":"2023-11-29T16:59:39.159003+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc5f8066900 msgr2=0x7fc5f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc5f8066900 0x7fc5f8068dc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc610005890 tx=0x7fc610009040 comp rx=0 tx=0).stop 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6141580b0 msgr2=0x7fc614151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6141580b0 0x7fc614151b80 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00efc0 tx=0x7fc60c00c490 comp rx=0 tx=0).stop 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 shutdown_connections 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6141580b0 0x7fc614151b80 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc5f8066900 0x7fc5f8068dc0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc614155360 0x7fc614151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 --2- 172.21.15.26:0/1186614904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406e7c0 0x7fc614071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 >> 172.21.15.26:0/1186614904 conn(0x7fc6140c3240 msgr2=0x7fc614153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 shutdown_connections 2023-11-28T16:59:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.616+0000 7fc61c5d1640 1 -- 172.21.15.26:0/1186614904 wait complete. 2023-11-28T16:59:44.639 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-28T16:59:44.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fed1d640 1 Processor -- start 2023-11-28T16:59:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fed1d640 1 -- start start 2023-11-28T16:59:44.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fed1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f80c2ac0 0x7fa7f8070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fed1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7f80c5f20 0x7fa7f8151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fed1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f8158b20 con 0x7fa7f8152070 2023-11-28T16:59:44.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fed1d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f8070ba0 con 0x7fa7f80c5f20 2023-11-28T16:59:44.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fed1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f8157f10 con 0x7fa7f80c2ac0 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fcab9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f80c2ac0 0x7fa7f8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fcab9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f80c2ac0 0x7fa7f8070660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.26:40478/0 (socket says 172.21.15.26:40478) 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fcab9640 1 -- 172.21.15.26:0/138510608 learned_addr learned my addr 172.21.15.26:0/138510608 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7f7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7f80c5f20 0x7fa7f8151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fcab9640 1 -- 172.21.15.26:0/138510608 >> v2:172.21.15.79:3300/0 conn(0x7fa7f80c5f20 msgr2=0x7fa7f8151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fcab9640 1 --2- 172.21.15.26:0/138510608 >> v2:172.21.15.79:3300/0 conn(0x7fa7f80c5f20 0x7fa7f8151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fcab9640 1 -- 172.21.15.26:0/138510608 >> v1:172.21.15.79:6789/0 conn(0x7fa7f8152070 legacy=0x7fa7f80c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7f77fe640 1 -- 172.21.15.26:0/138510608 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155275662 0 0) 0x7fa7f8158b20 con 0x7fa7f8152070 2023-11-28T16:59:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.780+0000 7fa7fcab9640 1 -- 172.21.15.26:0/138510608 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f81581f0 con 0x7fa7f80c2ac0 2023-11-28T16:59:44.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fcab9640 1 --2- 172.21.15.26:0/138510608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f80c2ac0 0x7fa7f8070660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97cecc3cb482c3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7f77fe640 1 -- 172.21.15.26:0/138510608 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0ab680 con 0x7fa7f80c2ac0 2023-11-28T16:59:44.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7f77fe640 1 -- 172.21.15.26:0/138510608 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0ab7e0 con 0x7fa7f80c2ac0 2023-11-28T16:59:44.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7f77fe640 1 -- 172.21.15.26:0/138510608 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0abb70 con 0x7fa7f80c2ac0 2023-11-28T16:59:44.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 -- 172.21.15.26:0/138510608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f80c2ac0 msgr2=0x7fa7f8070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/138510608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f80c2ac0 0x7fa7f8070660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec01c480 comp rx=0 tx=0).stop 2023-11-28T16:59:44.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 -- 172.21.15.26:0/138510608 shutdown_connections 2023-11-28T16:59:44.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/138510608 >> v2:172.21.15.79:3300/0 conn(0x7fa7f80c5f20 0x7fa7f8151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/138510608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f80c2ac0 0x7fa7f8070660 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 -- 172.21.15.26:0/138510608 >> 172.21.15.26:0/138510608 conn(0x7fa7f80a9c10 msgr2=0x7fa7f80aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 -- 172.21.15.26:0/138510608 shutdown_connections 2023-11-28T16:59:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.784+0000 7fa7fed1d640 1 -- 172.21.15.26:0/138510608 wait complete. 2023-11-28T16:59:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 Processor -- start 2023-11-28T16:59:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 -- start start 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f80c2ac0 0x7fa7f8147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80c5f20 0x7fa7f81460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f8152070 0x7fa7f8146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81488e0 con 0x7fa7f80c5f20 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f806e8d0 con 0x7fa7f80c2ac0 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81474f0 con 0x7fa7f8152070 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80c5f20 0x7fa7f81460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80c5f20 0x7fa7f81460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34668/0 (socket says 172.21.15.26:34668) 2023-11-28T16:59:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 -- 172.21.15.26:0/1637243163 learned_addr learned my addr 172.21.15.26:0/1637243163 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fcab9640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f80c2ac0 0x7fa7f8147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fd2ba640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f8152070 0x7fa7f8146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 -- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f8152070 msgr2=0x7fa7f8146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f8152070 0x7fa7f8146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 -- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f80c2ac0 msgr2=0x7fa7f8147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f80c2ac0 0x7fa7f8147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 -- 172.21.15.26:0/1637243163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0094d0 con 0x7fa7f80c5f20 2023-11-28T16:59:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fd2ba640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f8152070 0x7fa7f8146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fcab9640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f80c2ac0 0x7fa7f8147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f7fff640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80c5f20 0x7fa7f81460c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400e930 tx=0x7fa7e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f57fa640 1 -- 172.21.15.26:0/1637243163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4009690 con 0x7fa7f80c5f20 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f57fa640 1 -- 172.21.15.26:0/1637243163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400ca00 con 0x7fa7f80c5f20 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7f57fa640 1 -- 172.21.15.26:0/1637243163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400cd70 con 0x7fa7f80c5f20 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f806eb20 con 0x7fa7f80c5f20 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.788+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f8148040 con 0x7fa7f80c5f20 2023-11-28T16:59:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.792+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f804e890 con 0x7fa7f80c5f20 2023-11-28T16:59:44.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.792+0000 7fa7f57fa640 1 -- 172.21.15.26:0/1637243163 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa7e4013470 con 0x7fa7f80c5f20 2023-11-28T16:59:44.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.792+0000 7fa7f57fa640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa7dc0668d0 0x7fa7dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:44.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.792+0000 7fa7f57fa640 1 -- 172.21.15.26:0/1637243163 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa7e40846a0 con 0x7fa7f80c5f20 2023-11-28T16:59:44.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.792+0000 7fa7fcab9640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa7dc0668d0 0x7fa7dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.792+0000 7fa7fcab9640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa7dc0668d0 0x7fa7dc068d90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0af000 tx=0x7fa7ec0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.796+0000 7fa7f57fa640 1 -- 172.21.15.26:0/1637243163 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7e4051930 con 0x7fa7f80c5f20 2023-11-28T16:59:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.988+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7f8150250 con 0x7fa7f80c5f20 2023-11-28T16:59:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7f57fa640 1 -- 172.21.15.26:0/1637243163 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4908 (secure 0 0 0) 0x7fa7e4054f50 con 0x7fa7f80c5f20 2023-11-28T16:59:44.994 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:44.994 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7047,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/101094954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":101094954},{"type":"v1","addr":"172.21.15.26:6835","nonce":101094954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:44.995 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 53 2023-11-28T16:59:44.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa7dc0668d0 msgr2=0x7fa7dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa7dc0668d0 0x7fa7dc068d90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0af000 tx=0x7fa7ec0a7000 comp rx=0 tx=0).stop 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80c5f20 msgr2=0x7fa7f81460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80c5f20 0x7fa7f81460c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400e930 tx=0x7fa7e400edf0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 shutdown_connections 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa7dc0668d0 0x7fa7dc068d90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7f8152070 0x7fa7f8146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80c5f20 0x7fa7f81460c0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 --2- 172.21.15.26:0/1637243163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f80c2ac0 0x7fa7f8147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 >> 172.21.15.26:0/1637243163 conn(0x7fa7f80a9c10 msgr2=0x7fa7f80aa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 shutdown_connections 2023-11-28T16:59:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:44.992+0000 7fa7fed1d640 1 -- 172.21.15.26:0/1637243163 wait complete. 2023-11-28T16:59:45.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T16:59:45.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8697f2640 1 Processor -- start 2023-11-28T16:59:45.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8697f2640 1 -- start start 2023-11-28T16:59:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8697f2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 0x7fe86406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8697f2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8640c03e0 0x7fe864154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8697f2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8641553d0 con 0x7fe8640c0e30 2023-11-28T16:59:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8697f2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe864155670 con 0x7fe8640c03e0 2023-11-28T16:59:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8697f2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86406cab0 con 0x7fe86414e7b0 2023-11-28T16:59:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe868ff1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8640c03e0 0x7fe864154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8637fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe8640c0e30 0x7fe864070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54934/0 (socket says 172.21.15.26:54934) 2023-11-28T16:59:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe8637fe640 1 -- 172.21.15.26:0/1991030352 learned_addr learned my addr 172.21.15.26:0/1991030352 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe863fff640 1 --2- 172.21.15.26:0/1991030352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 0x7fe86406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe868ff1640 1 -- 172.21.15.26:0/1991030352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 msgr2=0x7fe86406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe868ff1640 1 --2- 172.21.15.26:0/1991030352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 0x7fe86406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe868ff1640 1 -- 172.21.15.26:0/1991030352 >> v1:172.21.15.26:6789/0 conn(0x7fe8640c0e30 legacy=0x7fe864070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe862ffd640 1 -- 172.21.15.26:0/1991030352 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403673799 0 0) 0x7fe8641553d0 con 0x7fe8640c0e30 2023-11-28T16:59:45.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.156+0000 7fe868ff1640 1 -- 172.21.15.26:0/1991030352 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86406cd90 con 0x7fe8640c03e0 2023-11-28T16:59:45.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe868ff1640 1 --2- 172.21.15.26:0/1991030352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe864154890 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009dc0 tx=0x7fe85c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a9616cbdd3b2e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe862ffd640 1 -- 172.21.15.26:0/1991030352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0a5840 con 0x7fe8640c03e0 2023-11-28T16:59:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe862ffd640 1 -- 172.21.15.26:0/1991030352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c0a59a0 con 0x7fe8640c03e0 2023-11-28T16:59:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe862ffd640 1 -- 172.21.15.26:0/1991030352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0a5d30 con 0x7fe8640c03e0 2023-11-28T16:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 -- 172.21.15.26:0/1991030352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 msgr2=0x7fe864154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 --2- 172.21.15.26:0/1991030352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe864154890 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009dc0 tx=0x7fe85c01c870 comp rx=0 tx=0).stop 2023-11-28T16:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 -- 172.21.15.26:0/1991030352 shutdown_connections 2023-11-28T16:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 --2- 172.21.15.26:0/1991030352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe864154890 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 --2- 172.21.15.26:0/1991030352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 0x7fe86406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 -- 172.21.15.26:0/1991030352 >> 172.21.15.26:0/1991030352 conn(0x7fe8640c5fd0 msgr2=0x7fe8640c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 -- 172.21.15.26:0/1991030352 shutdown_connections 2023-11-28T16:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 -- 172.21.15.26:0/1991030352 wait complete. 2023-11-28T16:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.160+0000 7fe8697f2640 1 Processor -- start 2023-11-28T16:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 -- start start 2023-11-28T16:59:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe8640ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c0e30 0x7fe8640a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 0x7fe8641538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640c4520 con 0x7fe8640c03e0 2023-11-28T16:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641f1310 con 0x7fe8640c0e30 2023-11-28T16:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640c3c60 con 0x7fe86414e7b0 2023-11-28T16:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe8640ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe8640ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34680/0 (socket says 172.21.15.26:34680) 2023-11-28T16:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 -- 172.21.15.26:0/95726036 learned_addr learned my addr 172.21.15.26:0/95726036 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8637fe640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c0e30 0x7fe8640a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 -- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 msgr2=0x7fe8641538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 0x7fe8641538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 -- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c0e30 msgr2=0x7fe8640a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c0e30 0x7fe8640a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 -- 172.21.15.26:0/95726036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c009a70 con 0x7fe8640c03e0 2023-11-28T16:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8637fe640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c0e30 0x7fe8640a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe863fff640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe8640ab560 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e870 tx=0x7fe85400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe860ff9640 1 -- 172.21.15.26:0/95726036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854009510 con 0x7fe8640c03e0 2023-11-28T16:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe860ff9640 1 -- 172.21.15.26:0/95726036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85400eec0 con 0x7fe8640c03e0 2023-11-28T16:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe860ff9640 1 -- 172.21.15.26:0/95726036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400cb40 con 0x7fe8640c03e0 2023-11-28T16:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8640c3f40 con 0x7fe8640c03e0 2023-11-28T16:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8640a9f00 con 0x7fe8640c03e0 2023-11-28T16:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.164+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8640c4130 con 0x7fe8640c03e0 2023-11-28T16:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.168+0000 7fe860ff9640 1 -- 172.21.15.26:0/95726036 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe85400ccc0 con 0x7fe8640c03e0 2023-11-28T16:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.168+0000 7fe860ff9640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe850066920 0x7fe850068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.168+0000 7fe860ff9640 1 -- 172.21.15.26:0/95726036 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe8540844e0 con 0x7fe8640c03e0 2023-11-28T16:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.168+0000 7fe8637fe640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe850066920 0x7fe850068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.168+0000 7fe8637fe640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe850066920 0x7fe850068de0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe8640abaa0 tx=0x7fe858009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.172+0000 7fe860ff9640 1 -- 172.21.15.26:0/95726036 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8540517a0 con 0x7fe8640c03e0 2023-11-28T16:59:45.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.360+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe86404e890 con 0x7fe8640c03e0 2023-11-28T16:59:45.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.360+0000 7fe860ff9640 1 -- 172.21.15.26:0/95726036 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4908 (secure 0 0 0) 0x7fe854054dc0 con 0x7fe8640c03e0 2023-11-28T16:59:45.365 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:45.365 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7047,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/101094954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":101094954},{"type":"v1","addr":"172.21.15.26:6835","nonce":101094954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T16:59:10.726492+0000","modified":"2023-11-28T16:59:13.745199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2026162766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2026162766},{"type":"v1","addr":"172.21.15.79:6835","nonce":2026162766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T16:59:45.365 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 53 2023-11-28T16:59:45.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe850066920 msgr2=0x7fe850068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe850066920 0x7fe850068de0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe8640abaa0 tx=0x7fe858009040 comp rx=0 tx=0).stop 2023-11-28T16:59:45.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 msgr2=0x7fe8640ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe8640ab560 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e870 tx=0x7fe85400ec70 comp rx=0 tx=0).stop 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 shutdown_connections 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe850066920 0x7fe850068de0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe86414e7b0 0x7fe8641538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640c0e30 0x7fe8640a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 --2- 172.21.15.26:0/95726036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8640c03e0 0x7fe8640ab560 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 >> 172.21.15.26:0/95726036 conn(0x7fe8640c5fd0 msgr2=0x7fe864071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 shutdown_connections 2023-11-28T16:59:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.364+0000 7fe8697f2640 1 -- 172.21.15.26:0/95726036 wait complete. 2023-11-28T16:59:45.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2d00c79640 1 Processor -- start 2023-11-28T16:59:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2d00c79640 1 -- start start 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2d00c79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc0ca610 0x7f2cfc0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2d00c79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cfc0bd720 0x7f2cfc0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2d00c79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cfc155790 con 0x7f2cfc06cd90 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2d00c79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c4b00 con 0x7f2cfc0bd720 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2d00c79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c4de0 con 0x7f2cfc0ca610 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cfad9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2cfc06cd90 0x7f2cfc158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54938/0 (socket says 172.21.15.26:54938) 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cfad9d640 1 -- 172.21.15.26:0/1663812914 learned_addr learned my addr 172.21.15.26:0/1663812914 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cf9d9b640 1 --2- 172.21.15.26:0/1663812914 >> v2:172.21.15.26:3300/0 conn(0x7f2cfc0bd720 0x7f2cfc0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cfa59c640 1 --2- 172.21.15.26:0/1663812914 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc0ca610 0x7f2cfc0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cf9d9b640 1 -- 172.21.15.26:0/1663812914 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc0ca610 msgr2=0x7f2cfc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cf9d9b640 1 --2- 172.21.15.26:0/1663812914 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc0ca610 0x7f2cfc0c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cf9d9b640 1 -- 172.21.15.26:0/1663812914 >> v1:172.21.15.26:6789/0 conn(0x7f2cfc06cd90 legacy=0x7f2cfc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cf9d9b640 1 -- 172.21.15.26:0/1663812914 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc157e30 con 0x7f2cfc0bd720 2023-11-28T16:59:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.528+0000 7f2cf959a640 1 -- 172.21.15.26:0/1663812914 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738282093 0 0) 0x7f2cfc155790 con 0x7f2cfc06cd90 2023-11-28T16:59:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2cf9d9b640 1 --2- 172.21.15.26:0/1663812914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0bd720 0x7f2cfc0c9a00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00097c0 tx=0x7f2cf001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575dbd2ab8e70fa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2cf959a640 1 -- 172.21.15.26:0/1663812914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0c52d0 con 0x7f2cfc0bd720 2023-11-28T16:59:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2cf959a640 1 -- 172.21.15.26:0/1663812914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf00a4880 con 0x7f2cfc0bd720 2023-11-28T16:59:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2cf959a640 1 -- 172.21.15.26:0/1663812914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00a4c10 con 0x7f2cfc0bd720 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 -- 172.21.15.26:0/1663812914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0bd720 msgr2=0x7f2cfc0c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 --2- 172.21.15.26:0/1663812914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0bd720 0x7f2cfc0c9a00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00097c0 tx=0x7f2cf001c040 comp rx=0 tx=0).stop 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 -- 172.21.15.26:0/1663812914 shutdown_connections 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 --2- 172.21.15.26:0/1663812914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0bd720 0x7f2cfc0c9a00 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 --2- 172.21.15.26:0/1663812914 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc0ca610 0x7f2cfc0c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 -- 172.21.15.26:0/1663812914 >> 172.21.15.26:0/1663812914 conn(0x7f2cfc071ea0 msgr2=0x7f2cfc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 -- 172.21.15.26:0/1663812914 shutdown_connections 2023-11-28T16:59:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 -- 172.21.15.26:0/1663812914 wait complete. 2023-11-28T16:59:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.532+0000 7f2d00c79640 1 Processor -- start 2023-11-28T16:59:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 -- start start 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc06cd90 0x7f2cfc1f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cfc0bd720 0x7f2cfc0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0ca610 0x7f2cfc0add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c1a10 con 0x7f2cfc0ca610 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc1f23a0 con 0x7f2cfc0bd720 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc14afc0 con 0x7f2cfc06cd90 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0ca610 0x7f2cfc0add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0ca610 0x7f2cfc0add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34696/0 (socket says 172.21.15.26:34696) 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 -- 172.21.15.26:0/3625835330 learned_addr learned my addr 172.21.15.26:0/3625835330 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfa59c640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc06cd90 0x7f2cfc1f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cf9d9b640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cfc0bd720 0x7f2cfc0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 -- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc06cd90 msgr2=0x7f2cfc1f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc06cd90 0x7f2cfc1f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 -- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cfc0bd720 msgr2=0x7f2cfc0ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cfc0bd720 0x7f2cfc0ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 -- 172.21.15.26:0/3625835330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0009420 con 0x7f2cfc0ca610 2023-11-28T16:59:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2cfad9d640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0ca610 0x7f2cfc0add10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4001570 tx=0x7f2cf400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2ceaffd640 1 -- 172.21.15.26:0/3625835330 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400a640 con 0x7f2cfc0ca610 2023-11-28T16:59:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2ceaffd640 1 -- 172.21.15.26:0/3625835330 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf400a7a0 con 0x7f2cfc0ca610 2023-11-28T16:59:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2ceaffd640 1 -- 172.21.15.26:0/3625835330 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400ab50 con 0x7f2cfc0ca610 2023-11-28T16:59:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc14b560 con 0x7f2cfc0ca610 2023-11-28T16:59:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc1f1e90 con 0x7f2cfc0ca610 2023-11-28T16:59:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.536+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc1f2510 con 0x7f2cfc0ca610 2023-11-28T16:59:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.540+0000 7f2ceaffd640 1 -- 172.21.15.26:0/3625835330 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2cf400acb0 con 0x7f2cfc0ca610 2023-11-28T16:59:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.540+0000 7f2ceaffd640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2cdc0668d0 0x7f2cdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.540+0000 7f2ceaffd640 1 -- 172.21.15.26:0/3625835330 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2cf4083960 con 0x7f2cfc0ca610 2023-11-28T16:59:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.540+0000 7f2cfa59c640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2cdc0668d0 0x7f2cdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.540+0000 7f2cfa59c640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2cdc0668d0 0x7f2cdc068d90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0079c0 tx=0x7f2cec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.544+0000 7f2ceaffd640 1 -- 172.21.15.26:0/3625835330 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cf4050be0 con 0x7f2cfc0ca610 2023-11-28T16:59:45.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.700+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cfc04e890 con 0x7f2cfc0ca610 2023-11-28T16:59:45.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.700+0000 7f2ceaffd640 1 -- 172.21.15.26:0/3625835330 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f2cf4018020 con 0x7f2cfc0ca610 2023-11-28T16:59:45.707 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:45.707 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":76,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:42.490525+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T16:59:08.379611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-28T16:59:09.728280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6835/3229750931":"2023-11-29T16:59:39.159003+0000","172.21.15.26:6833/3229750931":"2023-11-29T16:59:39.159003+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2cdc0668d0 msgr2=0x7f2cdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2cdc0668d0 0x7f2cdc068d90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0079c0 tx=0x7f2cec008040 comp rx=0 tx=0).stop 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0ca610 msgr2=0x7f2cfc0add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0ca610 0x7f2cfc0add10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4001570 tx=0x7f2cf400cc70 comp rx=0 tx=0).stop 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 shutdown_connections 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc0ca610 0x7f2cfc0add10 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cfc0bd720 0x7f2cfc0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2cdc0668d0 0x7f2cdc068d90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 --2- 172.21.15.26:0/3625835330 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cfc06cd90 0x7f2cfc1f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 >> 172.21.15.26:0/3625835330 conn(0x7f2cfc071ea0 msgr2=0x7f2cfc153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:45.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 shutdown_connections 2023-11-28T16:59:45.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.704+0000 7f2d00c79640 1 -- 172.21.15.26:0/3625835330 wait complete. 2023-11-28T16:59:45.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 Processor -- start 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 -- start start 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b814e9d0 0x7f98b8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98b8070b80 0x7f98b80c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98b80c1f20 0x7f98b806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b806d320 con 0x7f98b8070b80 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b80721b0 con 0x7f98b80c1f20 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98bceea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80c2830 con 0x7f98b814e9d0 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98b8070b80 0x7f98b80c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98b8070b80 0x7f98b80c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34702/0 (socket says 172.21.15.26:34702) 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 -- 172.21.15.26:0/485542599 learned_addr learned my addr 172.21.15.26:0/485542599 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98b659c640 1 --2- 172.21.15.26:0/485542599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b814e9d0 0x7f98b8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98b6d9d640 1 --2- 172.21.15.26:0/485542599 >> v2:172.21.15.79:3300/0 conn(0x7f98b80c1f20 0x7f98b806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 -- 172.21.15.26:0/485542599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b814e9d0 msgr2=0x7f98b8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 --2- 172.21.15.26:0/485542599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b814e9d0 0x7f98b8151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 -- 172.21.15.26:0/485542599 >> v2:172.21.15.79:3300/0 conn(0x7f98b80c1f20 msgr2=0x7f98b806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 --2- 172.21.15.26:0/485542599 >> v2:172.21.15.79:3300/0 conn(0x7f98b80c1f20 0x7f98b806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.868+0000 7f98affff640 1 -- 172.21.15.26:0/485542599 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8072450 con 0x7f98b8070b80 2023-11-28T16:59:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98affff640 1 --2- 172.21.15.26:0/485542599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b80c19e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f98b80704f0 tx=0x7f98a001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635b88880f54bd79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98b5d9b640 1 -- 172.21.15.26:0/485542599 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a00ab600 con 0x7f98b8070b80 2023-11-28T16:59:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98b5d9b640 1 -- 172.21.15.26:0/485542599 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a00a7050 con 0x7f98b8070b80 2023-11-28T16:59:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98b5d9b640 1 -- 172.21.15.26:0/485542599 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a00ab980 con 0x7f98b8070b80 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 -- 172.21.15.26:0/485542599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 msgr2=0x7f98b80c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 --2- 172.21.15.26:0/485542599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b80c19e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f98b80704f0 tx=0x7f98a001c470 comp rx=0 tx=0).stop 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 -- 172.21.15.26:0/485542599 shutdown_connections 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 --2- 172.21.15.26:0/485542599 >> v2:172.21.15.79:3300/0 conn(0x7f98b80c1f20 0x7f98b806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 --2- 172.21.15.26:0/485542599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b80c19e0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 --2- 172.21.15.26:0/485542599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b814e9d0 0x7f98b8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 -- 172.21.15.26:0/485542599 >> 172.21.15.26:0/485542599 conn(0x7f98b80c2ad0 msgr2=0x7f98b80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 -- 172.21.15.26:0/485542599 shutdown_connections 2023-11-28T16:59:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.872+0000 7f98bceea640 1 -- 172.21.15.26:0/485542599 wait complete. 2023-11-28T16:59:45.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 Processor -- start 2023-11-28T16:59:45.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 -- start start 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b80c1f20 0x7f98b80c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b814e9d0 0x7f98b81ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8150ab0 con 0x7f98b8070b80 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8147da0 con 0x7f98b814e9d0 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8149f00 con 0x7f98b80c1f20 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b814fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34708/0 (socket says 172.21.15.26:34708) 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 -- 172.21.15.26:0/1250667518 learned_addr learned my addr 172.21.15.26:0/1250667518 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b6d9d640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b814e9d0 0x7f98b81ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98affff640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b80c1f20 0x7f98b80c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 -- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b80c1f20 msgr2=0x7f98b80c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b80c1f20 0x7f98b80c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 -- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b814e9d0 msgr2=0x7f98b81ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b814e9d0 0x7f98b81ecf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 -- 172.21.15.26:0/1250667518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a00094d0 con 0x7f98b8070b80 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b6d9d640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b814e9d0 0x7f98b81ecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98b659c640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b814fd90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f98a800e870 tx=0x7f98a800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98aeffd640 1 -- 172.21.15.26:0/1250667518 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8009510 con 0x7f98b8070b80 2023-11-28T16:59:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98aeffd640 1 -- 172.21.15.26:0/1250667518 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a800eec0 con 0x7f98b8070b80 2023-11-28T16:59:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b814f900 con 0x7f98b8070b80 2023-11-28T16:59:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98aeffd640 1 -- 172.21.15.26:0/1250667518 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800cb40 con 0x7f98b8070b80 2023-11-28T16:59:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.876+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b80c5bd0 con 0x7f98b8070b80 2023-11-28T16:59:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.880+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b814f3f0 con 0x7f98b8070b80 2023-11-28T16:59:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.880+0000 7f98aeffd640 1 -- 172.21.15.26:0/1250667518 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f98a800cca0 con 0x7f98b8070b80 2023-11-28T16:59:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.880+0000 7f98aeffd640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f98980668d0 0x7f9898068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.880+0000 7f98aeffd640 1 -- 172.21.15.26:0/1250667518 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f98a80845e0 con 0x7f98b8070b80 2023-11-28T16:59:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.880+0000 7f98affff640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f98980668d0 0x7f9898068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:45.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.880+0000 7f98affff640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f98980668d0 0x7f9898068d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f98b806e350 tx=0x7f98a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:45.884+0000 7f98aeffd640 1 -- 172.21.15.26:0/1250667518 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98b814f3f0 con 0x7f98b8070b80 2023-11-28T16:59:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.076+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f98b814f3f0 con 0x7f98b8070b80 2023-11-28T16:59:46.078 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-11-28T16:59:46.076+0000 7fcd77275640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T16:59:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.076+0000 7f98aeffd640 1 -- 172.21.15.26:0/1250667518 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 163+0+0 (secure 0 0 0) 0x7f98b814f3f0 con 0x7f98b8070b80 2023-11-28T16:59:46.081 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f98980668d0 msgr2=0x7f9898068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f98980668d0 0x7f9898068d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f98b806e350 tx=0x7f98a0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 msgr2=0x7f98b814fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b814fd90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f98a800e870 tx=0x7f98a800ec70 comp rx=0 tx=0).stop 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 shutdown_connections 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b814e9d0 0x7f98b81ecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f98980668d0 0x7f9898068d90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98b80c1f20 0x7f98b80c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 --2- 172.21.15.26:0/1250667518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b8070b80 0x7f98b814fd90 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 >> 172.21.15.26:0/1250667518 conn(0x7f98b80c2ad0 msgr2=0x7f98b806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:46.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 shutdown_connections 2023-11-28T16:59:46.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.080+0000 7f98bceea640 1 -- 172.21.15.26:0/1250667518 wait complete. 2023-11-28T16:59:46.094 INFO:tasks.ceph.mds.b.smithi079.stderr: -4537> 2023-11-28T16:59:12.825+0000 7f9577396640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T16:59:46.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-28T16:59:46.144 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-11-28T16:59:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f747999d640 1 Processor -- start 2023-11-28T16:59:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f747999d640 1 -- start start 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f747999d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f747406c5c0 0x7f74741581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f747999d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74740c24a0 0x7f74741586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f747999d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7474157d20 con 0x7f74740c1bd0 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f747999d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747406deb0 con 0x7f74740c24a0 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f747999d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7474158c30 con 0x7f747406c5c0 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f7472ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f74740c1bd0 0x7f7474151c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54952/0 (socket says 172.21.15.26:54952) 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f7472ffd640 1 -- 172.21.15.26:0/3062533986 learned_addr learned my addr 172.21.15.26:0/3062533986 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f74737fe640 1 --2- 172.21.15.26:0/3062533986 >> v2:172.21.15.26:3300/0 conn(0x7f74740c24a0 0x7f74741586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f746bfff640 1 --2- 172.21.15.26:0/3062533986 >> v2:172.21.15.79:3300/0 conn(0x7f747406c5c0 0x7f74741581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f74727fc640 1 -- 172.21.15.26:0/3062533986 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417824840 0 0) 0x7f7474157d20 con 0x7f74740c1bd0 2023-11-28T16:59:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f74727fc640 1 -- 172.21.15.26:0/3062533986 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7460003530 con 0x7f74740c1bd0 2023-11-28T16:59:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f74737fe640 1 -- 172.21.15.26:0/3062533986 >> v2:172.21.15.79:3300/0 conn(0x7f747406c5c0 msgr2=0x7f74741581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f74737fe640 1 --2- 172.21.15.26:0/3062533986 >> v2:172.21.15.79:3300/0 conn(0x7f747406c5c0 0x7f74741581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f74737fe640 1 -- 172.21.15.26:0/3062533986 >> v1:172.21.15.26:6789/0 conn(0x7f74740c1bd0 legacy=0x7f7474151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:46.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f74737fe640 1 -- 172.21.15.26:0/3062533986 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747406e100 con 0x7f74740c24a0 2023-11-28T16:59:46.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.248+0000 7f746bfff640 1 --2- 172.21.15.26:0/3062533986 >> v2:172.21.15.79:3300/0 conn(0x7f747406c5c0 0x7f74741581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:46.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f74737fe640 1 --2- 172.21.15.26:0/3062533986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74740c24a0 0x7f74741586f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f747406e8b0 tx=0x7f746c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c0cb09a5a13952 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:46.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f74727fc640 1 -- 172.21.15.26:0/3062533986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0a58b0 con 0x7f74740c24a0 2023-11-28T16:59:46.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f74727fc640 1 -- 172.21.15.26:0/3062533986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c0a5a10 con 0x7f74740c24a0 2023-11-28T16:59:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f74727fc640 1 -- 172.21.15.26:0/3062533986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0a5da0 con 0x7f74740c24a0 2023-11-28T16:59:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 -- 172.21.15.26:0/3062533986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74740c24a0 msgr2=0x7f74741586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 --2- 172.21.15.26:0/3062533986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74740c24a0 0x7f74741586f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f747406e8b0 tx=0x7f746c01c7f0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 -- 172.21.15.26:0/3062533986 shutdown_connections 2023-11-28T16:59:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 --2- 172.21.15.26:0/3062533986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74740c24a0 0x7f74741586f0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 --2- 172.21.15.26:0/3062533986 >> v2:172.21.15.79:3300/0 conn(0x7f747406c5c0 0x7f74741581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 -- 172.21.15.26:0/3062533986 >> 172.21.15.26:0/3062533986 conn(0x7f74740c2a60 msgr2=0x7f74740c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 -- 172.21.15.26:0/3062533986 shutdown_connections 2023-11-28T16:59:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.252+0000 7f747999d640 1 -- 172.21.15.26:0/3062533986 wait complete. 2023-11-28T16:59:46.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 Processor -- start 2023-11-28T16:59:46.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 -- start start 2023-11-28T16:59:46.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f747406c5c0 0x7f74740bf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74740c1bd0 0x7f7474138700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74740c24a0 0x7f7474141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474138c40 con 0x7f747406c5c0 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747414bed0 con 0x7f74740c24a0 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740bfee0 con 0x7f74740c1bd0 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f747406c5c0 0x7f74740bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f747406c5c0 0x7f74740bf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34722/0 (socket says 172.21.15.26:34722) 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 -- 172.21.15.26:0/386389873 learned_addr learned my addr 172.21.15.26:0/386389873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f74737fe640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74740c24a0 0x7f7474141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f746bfff640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74740c1bd0 0x7f7474138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 -- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74740c1bd0 msgr2=0x7f7474138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74740c1bd0 0x7f7474138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 -- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74740c24a0 msgr2=0x7f7474141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74740c24a0 0x7f7474141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 -- 172.21.15.26:0/386389873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009a70 con 0x7f747406c5c0 2023-11-28T16:59:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f746bfff640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74740c1bd0 0x7f7474138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7472ffd640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f747406c5c0 0x7f74740bf850 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f746400c420 tx=0x7f746400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:46.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7470ff9640 1 -- 172.21.15.26:0/386389873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464005cf0 con 0x7f747406c5c0 2023-11-28T16:59:46.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7470ff9640 1 -- 172.21.15.26:0/386389873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464005e50 con 0x7f747406c5c0 2023-11-28T16:59:46.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f7470ff9640 1 -- 172.21.15.26:0/386389873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640072d0 con 0x7f747406c5c0 2023-11-28T16:59:46.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74740c01c0 con 0x7f747406c5c0 2023-11-28T16:59:46.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747413e3e0 con 0x7f747406c5c0 2023-11-28T16:59:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.256+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747404e890 con 0x7f747406c5c0 2023-11-28T16:59:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.260+0000 7f7470ff9640 1 -- 172.21.15.26:0/386389873 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7464007430 con 0x7f747406c5c0 2023-11-28T16:59:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.260+0000 7f7470ff9640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74540668d0 0x7f7454068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.260+0000 7f7470ff9640 1 -- 172.21.15.26:0/386389873 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f7464083920 con 0x7f747406c5c0 2023-11-28T16:59:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.260+0000 7f746bfff640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74540668d0 0x7f7454068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:46.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.260+0000 7f746bfff640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74540668d0 0x7f7454068d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f74740c0460 tx=0x7f745c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.264+0000 7f7470ff9640 1 -- 172.21.15.26:0/386389873 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7464050bd0 con 0x7f747406c5c0 2023-11-28T16:59:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:46.452+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f74741392f0 con 0x7f747406c5c0 2023-11-28T16:59:47.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f7470ff9640 1 -- 172.21.15.26:0/386389873 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7464017020 con 0x7f747406c5c0 2023-11-28T16:59:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74540668d0 msgr2=0x7f7454068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74540668d0 0x7f7454068d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f74740c0460 tx=0x7f745c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f747406c5c0 msgr2=0x7f74740bf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f747406c5c0 0x7f74740bf850 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f746400c420 tx=0x7f746400c8e0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 shutdown_connections 2023-11-28T16:59:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74740c24a0 0x7f7474141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f74540668d0 0x7f7454068d90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74740c1bd0 0x7f7474138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 --2- 172.21.15.26:0/386389873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f747406c5c0 0x7f74740bf850 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 >> 172.21.15.26:0/386389873 conn(0x7f74740c2a60 msgr2=0x7f74741536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:47.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 shutdown_connections 2023-11-28T16:59:47.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.080+0000 7f747999d640 1 -- 172.21.15.26:0/386389873 wait complete. 2023-11-28T16:59:47.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-28T16:59:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.256+0000 7f382859d640 1 Processor -- start 2023-11-28T16:59:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.256+0000 7f382859d640 1 -- start start 2023-11-28T16:59:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f382859d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f382014e8b0 0x7f3820155170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f382859d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38200c8a80 0x7f38200c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f382859d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38200c63a0 0x7f3820157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f382859d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382006f460 con 0x7f38200c63a0 2023-11-28T16:59:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f382859d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382006fda0 con 0x7f38200c8a80 2023-11-28T16:59:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f382859d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820070360 con 0x7f382014e8b0 2023-11-28T16:59:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38200c63a0 0x7f3820157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38200c63a0 0x7f3820157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34734/0 (socket says 172.21.15.26:34734) 2023-11-28T16:59:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 -- 172.21.15.26:0/3039256354 learned_addr learned my addr 172.21.15.26:0/3039256354 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3825b38640 1 --2- 172.21.15.26:0/3039256354 >> v2:172.21.15.79:3300/0 conn(0x7f38200c8a80 0x7f38200c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826339640 1 --2- 172.21.15.26:0/3039256354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f382014e8b0 0x7f3820155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 -- 172.21.15.26:0/3039256354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f382014e8b0 msgr2=0x7f3820155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 --2- 172.21.15.26:0/3039256354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f382014e8b0 0x7f3820155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 -- 172.21.15.26:0/3039256354 >> v2:172.21.15.79:3300/0 conn(0x7f38200c8a80 msgr2=0x7f38200c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:47.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 --2- 172.21.15.26:0/3039256354 >> v2:172.21.15.79:3300/0 conn(0x7f38200c8a80 0x7f38200c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.260+0000 7f3826b3a640 1 -- 172.21.15.26:0/3039256354 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38201556b0 con 0x7f38200c63a0 2023-11-28T16:59:47.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f3826b3a640 1 --2- 172.21.15.26:0/3039256354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38200c63a0 0x7f3820157e90 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f382006e0a0 tx=0x7f381801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453ba80e0a3f0ba9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f3825337640 1 -- 172.21.15.26:0/3039256354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820158be0 con 0x7f38200c63a0 2023-11-28T16:59:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f3825337640 1 -- 172.21.15.26:0/3039256354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180a57c0 con 0x7f38200c63a0 2023-11-28T16:59:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f3825337640 1 -- 172.21.15.26:0/3039256354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180a5b50 con 0x7f38200c63a0 2023-11-28T16:59:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- 172.21.15.26:0/3039256354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38200c63a0 msgr2=0x7f3820157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 --2- 172.21.15.26:0/3039256354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38200c63a0 0x7f3820157e90 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f382006e0a0 tx=0x7f381801c940 comp rx=0 tx=0).stop 2023-11-28T16:59:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- 172.21.15.26:0/3039256354 shutdown_connections 2023-11-28T16:59:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 --2- 172.21.15.26:0/3039256354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38200c63a0 0x7f3820157e90 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 --2- 172.21.15.26:0/3039256354 >> v2:172.21.15.79:3300/0 conn(0x7f38200c8a80 0x7f38200c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 --2- 172.21.15.26:0/3039256354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f382014e8b0 0x7f3820155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- 172.21.15.26:0/3039256354 >> 172.21.15.26:0/3039256354 conn(0x7f38200c7f60 msgr2=0x7f38200c8370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- 172.21.15.26:0/3039256354 shutdown_connections 2023-11-28T16:59:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- 172.21.15.26:0/3039256354 wait complete. 2023-11-28T16:59:47.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 Processor -- start 2023-11-28T16:59:47.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- start start 2023-11-28T16:59:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38200c63a0 0x7f38200c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200c8a80 0x7f3820146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f382014e8b0 0x7f3820147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200c3200 con 0x7f382014e8b0 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200c2d70 con 0x7f38200c8a80 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f382859d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200c44b0 con 0x7f38200c63a0 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.264+0000 7f3826b3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f382014e8b0 0x7f3820147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f382014e8b0 0x7f3820147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34744/0 (socket says 172.21.15.26:34744) 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 -- 172.21.15.26:0/2761263302 learned_addr learned my addr 172.21.15.26:0/2761263302 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826339640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38200c63a0 0x7f38200c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3825b38640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200c8a80 0x7f3820146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 -- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38200c63a0 msgr2=0x7f38200c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38200c63a0 0x7f38200c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 -- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200c8a80 msgr2=0x7f3820146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200c8a80 0x7f3820146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 -- 172.21.15.26:0/2761263302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009b30 con 0x7f382014e8b0 2023-11-28T16:59:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3825b38640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200c8a80 0x7f3820146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3826b3a640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f382014e8b0 0x7f3820147420 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f38180af040 tx=0x7f38180196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3816ffd640 1 -- 172.21.15.26:0/2761263302 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b8670 con 0x7f382014e8b0 2023-11-28T16:59:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3816ffd640 1 -- 172.21.15.26:0/2761263302 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180b87d0 con 0x7f382014e8b0 2023-11-28T16:59:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38200c4790 con 0x7f382014e8b0 2023-11-28T16:59:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3816ffd640 1 -- 172.21.15.26:0/2761263302 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b8b80 con 0x7f382014e8b0 2023-11-28T16:59:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3820147960 con 0x7f382014e8b0 2023-11-28T16:59:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38200c2ee0 con 0x7f382014e8b0 2023-11-28T16:59:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3816ffd640 1 -- 172.21.15.26:0/2761263302 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f38180b8ce0 con 0x7f382014e8b0 2023-11-28T16:59:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.268+0000 7f3816ffd640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38040668d0 0x7f3804068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.272+0000 7f3816ffd640 1 -- 172.21.15.26:0/2761263302 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f381811fa70 con 0x7f382014e8b0 2023-11-28T16:59:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.272+0000 7f3826339640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38040668d0 0x7f3804068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.272+0000 7f3826339640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38040668d0 0x7f3804068d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f381c00b930 tx=0x7f381c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.272+0000 7f3816ffd640 1 -- 172.21.15.26:0/2761263302 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38180ecd60 con 0x7f382014e8b0 2023-11-28T16:59:47.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:47.436+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f382004e890 con 0x7f382014e8b0 2023-11-28T16:59:48.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:59:48.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T16:59:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.296+0000 7f3816ffd640 1 -- 172.21.15.26:0/2761263302 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v78) v1 ==== 184+0+0 (secure 0 0 0) 0x7f38180f0380 con 0x7f382014e8b0 2023-11-28T16:59:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_metadata' removed 2023-11-28T16:59:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38040668d0 msgr2=0x7f3804068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38040668d0 0x7f3804068d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f381c00b930 tx=0x7f381c008040 comp rx=0 tx=0).stop 2023-11-28T16:59:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f382014e8b0 msgr2=0x7f3820147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f382014e8b0 0x7f3820147420 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f38180af040 tx=0x7f38180196e0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 shutdown_connections 2023-11-28T16:59:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f382014e8b0 0x7f3820147420 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200c8a80 0x7f3820146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f38040668d0 0x7f3804068d90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 --2- 172.21.15.26:0/2761263302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38200c63a0 0x7f38200c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 >> 172.21.15.26:0/2761263302 conn(0x7f38200c7f60 msgr2=0x7f38200c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 shutdown_connections 2023-11-28T16:59:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.300+0000 7f382859d640 1 -- 172.21.15.26:0/2761263302 wait complete. 2023-11-28T16:59:48.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-28T16:59:48.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42857aa640 1 Processor -- start 2023-11-28T16:59:48.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42857aa640 1 -- start start 2023-11-28T16:59:48.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42857aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42800abde0 0x7f42800c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:48.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42857aa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42801545a0 0x7f42801549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:48.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42857aa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428014e770 con 0x7f428014e390 2023-11-28T16:59:48.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42857aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428006b2e0 con 0x7f42800abde0 2023-11-28T16:59:48.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42857aa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42801518d0 con 0x7f42801545a0 2023-11-28T16:59:48.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f42767fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42800abde0 0x7f42800c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:48.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f427effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f428014e390 0x7f42800c1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54954/0 (socket says 172.21.15.26:54954) 2023-11-28T16:59:48.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f427effd640 1 -- 172.21.15.26:0/1106227507 learned_addr learned my addr 172.21.15.26:0/1106227507 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:48.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.476+0000 7f427f7fe640 1 --2- 172.21.15.26:0/1106227507 >> v2:172.21.15.79:3300/0 conn(0x7f42801545a0 0x7f42801549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:48.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42767fc640 1 -- 172.21.15.26:0/1106227507 >> v2:172.21.15.79:3300/0 conn(0x7f42801545a0 msgr2=0x7f42801549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:48.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42767fc640 1 --2- 172.21.15.26:0/1106227507 >> v2:172.21.15.79:3300/0 conn(0x7f42801545a0 0x7f42801549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42767fc640 1 -- 172.21.15.26:0/1106227507 >> v1:172.21.15.26:6789/0 conn(0x7f428014e390 legacy=0x7f42800c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:48.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f427e7fc640 1 -- 172.21.15.26:0/1106227507 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059508777 0 0) 0x7f428014e770 con 0x7f428014e390 2023-11-28T16:59:48.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42767fc640 1 -- 172.21.15.26:0/1106227507 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280151bb0 con 0x7f42800abde0 2023-11-28T16:59:48.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42767fc640 1 --2- 172.21.15.26:0/1106227507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f42800c2610 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f42800abd70 tx=0x7f427001d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9383c42f917d6716 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:48.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f427e7fc640 1 -- 172.21.15.26:0/1106227507 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700ae680 con 0x7f42800abde0 2023-11-28T16:59:48.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f427e7fc640 1 -- 172.21.15.26:0/1106227507 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42700ae7e0 con 0x7f42800abde0 2023-11-28T16:59:48.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f427e7fc640 1 -- 172.21.15.26:0/1106227507 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700aeb70 con 0x7f42800abde0 2023-11-28T16:59:48.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 -- 172.21.15.26:0/1106227507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 msgr2=0x7f42800c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:48.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 --2- 172.21.15.26:0/1106227507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f42800c2610 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f42800abd70 tx=0x7f427001d4e0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 -- 172.21.15.26:0/1106227507 shutdown_connections 2023-11-28T16:59:48.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 --2- 172.21.15.26:0/1106227507 >> v2:172.21.15.79:3300/0 conn(0x7f42801545a0 0x7f42801549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 --2- 172.21.15.26:0/1106227507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f42800c2610 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 -- 172.21.15.26:0/1106227507 >> 172.21.15.26:0/1106227507 conn(0x7f428006a5a0 msgr2=0x7f428006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:48.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 -- 172.21.15.26:0/1106227507 shutdown_connections 2023-11-28T16:59:48.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.480+0000 7f42857aa640 1 -- 172.21.15.26:0/1106227507 wait complete. 2023-11-28T16:59:48.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 Processor -- start 2023-11-28T16:59:48.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 -- start start 2023-11-28T16:59:48.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f4280146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:48.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f428014e390 0x7f4280150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:48.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42801545a0 0x7f42801508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:48.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280152980 con 0x7f42800abde0 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280150de0 con 0x7f428014e390 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4280153d60 con 0x7f42801545a0 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f4280146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f4280146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34764/0 (socket says 172.21.15.26:34764) 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 -- 172.21.15.26:0/626399834 learned_addr learned my addr 172.21.15.26:0/626399834 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 -- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42801545a0 msgr2=0x7f42801508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42801545a0 0x7f42801508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 -- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f428014e390 msgr2=0x7f4280150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f428014e390 0x7f4280150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 -- 172.21.15.26:0/626399834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009420 con 0x7f42800abde0 2023-11-28T16:59:48.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f427effd640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f4280146c80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f426800c520 tx=0x7f426800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:48.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f4277fff640 1 -- 172.21.15.26:0/626399834 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680074e0 con 0x7f42800abde0 2023-11-28T16:59:48.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f4277fff640 1 -- 172.21.15.26:0/626399834 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4268007640 con 0x7f42800abde0 2023-11-28T16:59:48.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f4277fff640 1 -- 172.21.15.26:0/626399834 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680049f0 con 0x7f42800abde0 2023-11-28T16:59:48.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280154270 con 0x7f42800abde0 2023-11-28T16:59:48.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.484+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428013e460 con 0x7f42800abde0 2023-11-28T16:59:48.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.488+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428013e2c0 con 0x7f42800abde0 2023-11-28T16:59:48.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.488+0000 7f4277fff640 1 -- 172.21.15.26:0/626399834 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4268004b50 con 0x7f42800abde0 2023-11-28T16:59:48.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.488+0000 7f4277fff640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42600668d0 0x7f4260068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:48.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.488+0000 7f4277fff640 1 -- 172.21.15.26:0/626399834 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f42680832b0 con 0x7f42800abde0 2023-11-28T16:59:48.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.488+0000 7f42767fc640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42600668d0 0x7f4260068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:48.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.492+0000 7f42767fc640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42600668d0 0x7f4260068d90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f42700b0000 tx=0x7f4270004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:48.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.492+0000 7f4277fff640 1 -- 172.21.15.26:0/626399834 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f428013e2c0 con 0x7f42800abde0 2023-11-28T16:59:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:48.652+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f428013e2c0 con 0x7f42800abde0 2023-11-28T16:59:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.516+0000 7f4277fff640 1 -- 172.21.15.26:0/626399834 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v79) v1 ==== 172+0+0 (secure 0 0 0) 0x7f428013e2c0 con 0x7f42800abde0 2023-11-28T16:59:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs2_data' removed 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42600668d0 msgr2=0x7f4260068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42600668d0 0x7f4260068d90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f42700b0000 tx=0x7f4270004740 comp rx=0 tx=0).stop 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 msgr2=0x7f4280146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f4280146c80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f426800c520 tx=0x7f426800c9e0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 shutdown_connections 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f42600668d0 0x7f4260068d90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42801545a0 0x7f42801508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f428014e390 0x7f4280150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 --2- 172.21.15.26:0/626399834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42800abde0 0x7f4280146c80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 >> 172.21.15.26:0/626399834 conn(0x7f428006a5a0 msgr2=0x7f42800c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:49.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 shutdown_connections 2023-11-28T16:59:49.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.524+0000 7f42857aa640 1 -- 172.21.15.26:0/626399834 wait complete. 2023-11-28T16:59:49.558 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T16:59:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e869a640 1 Processor -- start 2023-11-28T16:59:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e869a640 1 -- start start 2023-11-28T16:59:49.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e869a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3e00a86d0 0x7fc3e00a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:49.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e869a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e0152d90 con 0x7fc3e0156600 2023-11-28T16:59:49.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e869a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e0152480 con 0x7fc3e014fd00 2023-11-28T16:59:49.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e869a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e00a9760 con 0x7fc3e00a86d0 2023-11-28T16:59:49.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e5c35640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc3e0156600 0x7fc3e014f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54966/0 (socket says 172.21.15.26:54966) 2023-11-28T16:59:49.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e5c35640 1 -- 172.21.15.26:0/2778895546 learned_addr learned my addr 172.21.15.26:0/2778895546 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e6436640 1 --2- 172.21.15.26:0/2778895546 >> v2:172.21.15.79:3300/0 conn(0x7fc3e00a86d0 0x7fc3e00a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e5434640 1 -- 172.21.15.26:0/2778895546 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418508363 0 0) 0x7fc3e0152d90 con 0x7fc3e0156600 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e5434640 1 -- 172.21.15.26:0/2778895546 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3cc003530 con 0x7fc3e0156600 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e5434640 1 -- 172.21.15.26:0/2778895546 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244667189 0 0) 0x7fc3e0152480 con 0x7fc3e014fd00 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e5434640 1 -- 172.21.15.26:0/2778895546 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e0152d90 con 0x7fc3e014fd00 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e6436640 1 -- 172.21.15.26:0/2778895546 >> v1:172.21.15.79:6789/0 conn(0x7fc3e014fd00 legacy=0x7fc3e00aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e6436640 1 -- 172.21.15.26:0/2778895546 >> v1:172.21.15.26:6789/0 conn(0x7fc3e0156600 legacy=0x7fc3e014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.704+0000 7fc3e6436640 1 -- 172.21.15.26:0/2778895546 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0152740 con 0x7fc3e00a86d0 2023-11-28T16:59:49.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e6436640 1 --2- 172.21.15.26:0/2778895546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 0x7fc3e00a8f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0097f0 tx=0x7fc3dc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52671de2964dee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e5434640 1 -- 172.21.15.26:0/2778895546 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc004230 con 0x7fc3e00a86d0 2023-11-28T16:59:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e5434640 1 -- 172.21.15.26:0/2778895546 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc0a7050 con 0x7fc3e00a86d0 2023-11-28T16:59:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e5434640 1 -- 172.21.15.26:0/2778895546 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc003620 con 0x7fc3e00a86d0 2023-11-28T16:59:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e869a640 1 -- 172.21.15.26:0/2778895546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 msgr2=0x7fc3e00a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2778895546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 0x7fc3e00a8f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0097f0 tx=0x7fc3dc01c480 comp rx=0 tx=0).stop 2023-11-28T16:59:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e869a640 1 -- 172.21.15.26:0/2778895546 shutdown_connections 2023-11-28T16:59:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2778895546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 0x7fc3e00a8f30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e869a640 1 -- 172.21.15.26:0/2778895546 >> 172.21.15.26:0/2778895546 conn(0x7fc3e00c2a60 msgr2=0x7fc3e00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e869a640 1 -- 172.21.15.26:0/2778895546 shutdown_connections 2023-11-28T16:59:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.708+0000 7fc3e869a640 1 -- 172.21.15.26:0/2778895546 wait complete. 2023-11-28T16:59:49.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 Processor -- start 2023-11-28T16:59:49.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 -- start start 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 0x7fc3e01eca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3e014fd00 0x7fc3e0146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3e0156600 0x7fc3e0070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e00710e0 con 0x7fc3e014fd00 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0147b90 con 0x7fc3e00a86d0 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0148940 con 0x7fc3e0156600 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3e014fd00 0x7fc3e0146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3e014fd00 0x7fc3e0146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34780/0 (socket says 172.21.15.26:34780) 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 -- 172.21.15.26:0/2297838084 learned_addr learned my addr 172.21.15.26:0/2297838084 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e6436640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 0x7fc3e01eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e6c37640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3e0156600 0x7fc3e0070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 -- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3e0156600 msgr2=0x7fc3e0070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3e0156600 0x7fc3e0070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 -- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 msgr2=0x7fc3e01eca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 0x7fc3e01eca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 -- 172.21.15.26:0/2297838084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc009420 con 0x7fc3e014fd00 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e6c37640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3e0156600 0x7fc3e0070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e5c35640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3e014fd00 0x7fc3e0146c00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c520 tx=0x7fc3d000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3d6ffd640 1 -- 172.21.15.26:0/2297838084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0005cf0 con 0x7fc3e014fd00 2023-11-28T16:59:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3d6ffd640 1 -- 172.21.15.26:0/2297838084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d0005e50 con 0x7fc3e014fd00 2023-11-28T16:59:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3d6ffd640 1 -- 172.21.15.26:0/2297838084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0007270 con 0x7fc3e014fd00 2023-11-28T16:59:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e0071dc0 con 0x7fc3e014fd00 2023-11-28T16:59:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.712+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e0148380 con 0x7fc3e014fd00 2023-11-28T16:59:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.716+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e004e890 con 0x7fc3e014fd00 2023-11-28T16:59:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.716+0000 7fc3d6ffd640 1 -- 172.21.15.26:0/2297838084 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc3d00073d0 con 0x7fc3e014fd00 2023-11-28T16:59:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.716+0000 7fc3d6ffd640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3c40668d0 0x7fc3c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:49.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.716+0000 7fc3d6ffd640 1 -- 172.21.15.26:0/2297838084 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc3d0083610 con 0x7fc3e014fd00 2023-11-28T16:59:49.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.716+0000 7fc3e6436640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3c40668d0 0x7fc3c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:49.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.716+0000 7fc3e6436640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3c40668d0 0x7fc3c4068d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0ad000 tx=0x7fc3dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.720+0000 7fc3d6ffd640 1 -- 172.21.15.26:0/2297838084 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3d0054620 con 0x7fc3e014fd00 2023-11-28T16:59:49.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.880+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc3e0147140 con 0x7fc3e014fd00 2023-11-28T16:59:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3d6ffd640 1 -- 172.21.15.26:0/2297838084 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc3d00541b0 con 0x7fc3e014fd00 2023-11-28T16:59:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3c40668d0 msgr2=0x7fc3c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3c40668d0 0x7fc3c4068d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0ad000 tx=0x7fc3dc008040 comp rx=0 tx=0).stop 2023-11-28T16:59:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3e014fd00 msgr2=0x7fc3e0146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3e014fd00 0x7fc3e0146c00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c520 tx=0x7fc3d000c9e0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 shutdown_connections 2023-11-28T16:59:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc3c40668d0 0x7fc3c4068d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3e0156600 0x7fc3e0070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3e014fd00 0x7fc3e0146c00 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 --2- 172.21.15.26:0/2297838084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e00a86d0 0x7fc3e01eca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:49.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 >> 172.21.15.26:0/2297838084 conn(0x7fc3e00c2a60 msgr2=0x7fc3e0151200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:49.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 shutdown_connections 2023-11-28T16:59:49.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:49.884+0000 7fc3e869a640 1 -- 172.21.15.26:0/2297838084 wait complete. 2023-11-28T16:59:49.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-28T16:59:50.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.048+0000 7f31daadd640 1 Processor -- start 2023-11-28T16:59:50.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.048+0000 7f31daadd640 1 -- start start 2023-11-28T16:59:50.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.048+0000 7f31daadd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31d414fcc0 0x7f31d4156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:50.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.048+0000 7f31daadd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c19e0 0x7f31d40c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:50.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.048+0000 7f31daadd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40ab580 con 0x7f31d406d980 2023-11-28T16:59:50.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.048+0000 7f31daadd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40aa340 con 0x7f31d414fcc0 2023-11-28T16:59:50.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.048+0000 7f31daadd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4152fe0 con 0x7f31d40c19e0 2023-11-28T16:59:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f31d406d980 0x7f31d40aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:47660/0 (socket says 172.21.15.26:47660) 2023-11-28T16:59:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d3fff640 1 -- 172.21.15.26:0/677180267 learned_addr learned my addr 172.21.15.26:0/677180267 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d8879640 1 --2- 172.21.15.26:0/677180267 >> v2:172.21.15.79:3300/0 conn(0x7f31d414fcc0 0x7f31d4156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d907a640 1 --2- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c19e0 0x7f31d40c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d8879640 1 -- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c19e0 msgr2=0x7f31d40c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d8879640 1 --2- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c19e0 0x7f31d40c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d8879640 1 -- 172.21.15.26:0/677180267 >> v1:172.21.15.79:6789/0 conn(0x7f31d406d980 legacy=0x7f31d40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d8879640 1 -- 172.21.15.26:0/677180267 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d41532c0 con 0x7f31d414fcc0 2023-11-28T16:59:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d37fe640 1 -- 172.21.15.26:0/677180267 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460698823 0 0) 0x7f31d40ab580 con 0x7f31d406d980 2023-11-28T16:59:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d8879640 1 --2- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d414fcc0 0x7f31d4156500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31c80097c0 tx=0x7f31c801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a775ebe8bfd0e3ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d37fe640 1 -- 172.21.15.26:0/677180267 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80ad660 con 0x7f31d414fcc0 2023-11-28T16:59:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d37fe640 1 -- 172.21.15.26:0/677180267 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c80ad7c0 con 0x7f31d414fcc0 2023-11-28T16:59:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.052+0000 7f31d37fe640 1 -- 172.21.15.26:0/677180267 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80adb50 con 0x7f31d414fcc0 2023-11-28T16:59:50.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d414fcc0 msgr2=0x7f31d4156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:50.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 --2- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d414fcc0 0x7f31d4156500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31c80097c0 tx=0x7f31c801c450 comp rx=0 tx=0).stop 2023-11-28T16:59:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- 172.21.15.26:0/677180267 shutdown_connections 2023-11-28T16:59:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 --2- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c19e0 0x7f31d40c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 --2- 172.21.15.26:0/677180267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d414fcc0 0x7f31d4156500 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- 172.21.15.26:0/677180267 >> 172.21.15.26:0/677180267 conn(0x7f31d40c2ad0 msgr2=0x7f31d40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- 172.21.15.26:0/677180267 shutdown_connections 2023-11-28T16:59:50.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- 172.21.15.26:0/677180267 wait complete. 2023-11-28T16:59:50.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 Processor -- start 2023-11-28T16:59:50.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- start start 2023-11-28T16:59:50.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d406d980 0x7f31d40c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d40c19e0 0x7f31d41f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c4a20 0x7f31d415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41f1060 con 0x7f31d406d980 2023-11-28T16:59:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c5d80 con 0x7f31d40c19e0 2023-11-28T16:59:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31daadd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c3c60 con 0x7f31d40c4a20 2023-11-28T16:59:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31d8879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d406d980 0x7f31d40c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:50.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31d8879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d406d980 0x7f31d40c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34782/0 (socket says 172.21.15.26:34782) 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31d8879640 1 -- 172.21.15.26:0/16716959 learned_addr learned my addr 172.21.15.26:0/16716959 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31d3fff640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d40c19e0 0x7f31d41f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.056+0000 7f31d907a640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c4a20 0x7f31d415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d8879640 1 -- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c4a20 msgr2=0x7f31d415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d8879640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c4a20 0x7f31d415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d8879640 1 -- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d40c19e0 msgr2=0x7f31d41f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d8879640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d40c19e0 0x7f31d41f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d8879640 1 -- 172.21.15.26:0/16716959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8009420 con 0x7f31d406d980 2023-11-28T16:59:50.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d907a640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c4a20 0x7f31d415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:50.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d8879640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d406d980 0x7f31d40c56a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f31c80b0040 tx=0x7f31c801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d17fa640 1 -- 172.21.15.26:0/16716959 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80be070 con 0x7f31d406d980 2023-11-28T16:59:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d17fa640 1 -- 172.21.15.26:0/16716959 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c80b9450 con 0x7f31d406d980 2023-11-28T16:59:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d40c3f40 con 0x7f31d406d980 2023-11-28T16:59:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d17fa640 1 -- 172.21.15.26:0/16716959 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80b9800 con 0x7f31d406d980 2023-11-28T16:59:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d40c4500 con 0x7f31d406d980 2023-11-28T16:59:50.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d406dd80 con 0x7f31d406d980 2023-11-28T16:59:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d17fa640 1 -- 172.21.15.26:0/16716959 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f31c80b9960 con 0x7f31d406d980 2023-11-28T16:59:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d17fa640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f31b8066900 0x7f31b8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d17fa640 1 -- 172.21.15.26:0/16716959 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f31c811e3e0 con 0x7f31d406d980 2023-11-28T16:59:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.060+0000 7f31d3fff640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f31b8066900 0x7f31b8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.064+0000 7f31d3fff640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f31b8066900 0x7f31b8068dc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f31d41f0000 tx=0x7f31c0007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:50.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.064+0000 7f31d17fa640 1 -- 172.21.15.26:0/16716959 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31c80eb8d0 con 0x7f31d406d980 2023-11-28T16:59:50.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.280+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f31d40c46f0 con 0x7f31d406d980 2023-11-28T16:59:50.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31d17fa640 1 -- 172.21.15.26:0/16716959 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v224) v1 ==== 159+0+0 (secure 0 0 0) 0x7f31c80eeef0 con 0x7f31d406d980 2023-11-28T16:59:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f31b8066900 msgr2=0x7f31b8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f31b8066900 0x7f31b8068dc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f31d41f0000 tx=0x7f31c0007d60 comp rx=0 tx=0).stop 2023-11-28T16:59:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d406d980 msgr2=0x7f31d40c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d406d980 0x7f31d40c56a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f31c80b0040 tx=0x7f31c801ac90 comp rx=0 tx=0).stop 2023-11-28T16:59:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 shutdown_connections 2023-11-28T16:59:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f31b8066900 0x7f31b8068dc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d40c4a20 0x7f31d415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d40c19e0 0x7f31d41f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 --2- 172.21.15.26:0/16716959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d406d980 0x7f31d40c56a0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 >> 172.21.15.26:0/16716959 conn(0x7f31d40c2ad0 msgr2=0x7f31d406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 shutdown_connections 2023-11-28T16:59:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:50.528+0000 7f31daadd640 1 -- 172.21.15.26:0/16716959 wait complete. 2023-11-28T16:59:50.554 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-11-28T16:59:50.554 INFO:tasks.cephfs_test_runner: 2023-11-28T16:59:50.554 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T16:59:50.554 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T16:59:50.554 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-28T16:59:50.555 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner: 2023-11-28T16:59:50.556 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner:Ran 3 tests in 188.575s 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner: 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner: 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-28T16:59:50.557 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T16:59:50.558 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-28T16:59:50.559 INFO:tasks.cephfs_test_runner: 2023-11-28T16:59:50.559 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T16:59:50.670 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=34a568bd8c9749f496f58e1d56e91ac8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T16:59:50.672 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T16:59:50.681 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-28T16:59:50.709 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-28T16:59:50.710 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-11-28T16:59:50.710 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:50.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T16:59:50.739 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-11-28T16:59:50.739 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T16:59:50.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354664k,nr_inodes=4088666,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T16:59:50.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:50.750 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-11-28T16:59:50.791 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T16:59:50.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:50.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T16:59:50.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:50.857 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-11-28T16:59:51.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:51.080 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-11-28T16:59:51.089 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T16:59:51.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:51.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T16:59:51.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T16:59:51.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-11-28T16:59:51.357 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T16:59:51.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T16:59:51.368 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:51.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec978d640 1 Processor -- start 2023-11-28T16:59:51.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec978d640 1 -- start start 2023-11-28T16:59:51.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec978d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdec40c48e0 0x7fdec40c8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec978d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdec406b4e0 0x7fdec415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec978d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40c7850 con 0x7fdec406b100 2023-11-28T16:59:51.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec978d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40aff30 con 0x7fdec406b4e0 2023-11-28T16:59:51.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec978d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec41554f0 con 0x7fdec40c48e0 2023-11-28T16:59:51.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdec406b4e0 0x7fdec415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec2ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdec406b100 0x7fdec40c7e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.26:59502/0 (socket says 172.21.15.26:59502) 2023-11-28T16:59:51.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec2ffd640 1 -- 172.21.15.26:0/4114581596 learned_addr learned my addr 172.21.15.26:0/4114581596 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:51.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdeba7fc640 1 --2- 172.21.15.26:0/4114581596 >> v2:172.21.15.79:3300/0 conn(0x7fdec40c48e0 0x7fdec40c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec37fe640 1 -- 172.21.15.26:0/4114581596 >> v2:172.21.15.79:3300/0 conn(0x7fdec40c48e0 msgr2=0x7fdec40c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec37fe640 1 --2- 172.21.15.26:0/4114581596 >> v2:172.21.15.79:3300/0 conn(0x7fdec40c48e0 0x7fdec40c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec37fe640 1 -- 172.21.15.26:0/4114581596 >> v1:172.21.15.79:6789/0 conn(0x7fdec406b100 legacy=0x7fdec40c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdec37fe640 1 -- 172.21.15.26:0/4114581596 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec406b970 con 0x7fdec406b4e0 2023-11-28T16:59:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.512+0000 7fdeba7fc640 1 --2- 172.21.15.26:0/4114581596 >> v2:172.21.15.79:3300/0 conn(0x7fdec40c48e0 0x7fdec40c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec37fe640 1 --2- 172.21.15.26:0/4114581596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec406b4e0 0x7fdec415ee30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdec40acb10 tx=0x7fdebc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20cec6434b6d871 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec27fc640 1 -- 172.21.15.26:0/4114581596 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0a5740 con 0x7fdec406b4e0 2023-11-28T16:59:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec27fc640 1 -- 172.21.15.26:0/4114581596 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0a58a0 con 0x7fdec406b4e0 2023-11-28T16:59:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec27fc640 1 -- 172.21.15.26:0/4114581596 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0a5c30 con 0x7fdec406b4e0 2023-11-28T16:59:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 -- 172.21.15.26:0/4114581596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec406b4e0 msgr2=0x7fdec415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 --2- 172.21.15.26:0/4114581596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec406b4e0 0x7fdec415ee30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdec40acb10 tx=0x7fdebc01c880 comp rx=0 tx=0).stop 2023-11-28T16:59:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 -- 172.21.15.26:0/4114581596 shutdown_connections 2023-11-28T16:59:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 --2- 172.21.15.26:0/4114581596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec406b4e0 0x7fdec415ee30 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 --2- 172.21.15.26:0/4114581596 >> v2:172.21.15.79:3300/0 conn(0x7fdec40c48e0 0x7fdec40c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 -- 172.21.15.26:0/4114581596 >> 172.21.15.26:0/4114581596 conn(0x7fdec40ca360 msgr2=0x7fdec40ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 -- 172.21.15.26:0/4114581596 shutdown_connections 2023-11-28T16:59:51.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 -- 172.21.15.26:0/4114581596 wait complete. 2023-11-28T16:59:51.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 Processor -- start 2023-11-28T16:59:51.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.516+0000 7fdec978d640 1 -- start start 2023-11-28T16:59:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdec406b100 0x7fdec413fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdec406b4e0 0x7fdec4145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec40c48e0 0x7fdec40c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41436d0 con 0x7fdec40c48e0 2023-11-28T16:59:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4142da0 con 0x7fdec406b100 2023-11-28T16:59:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4143080 con 0x7fdec406b4e0 2023-11-28T16:59:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec40c48e0 0x7fdec40c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec40c48e0 0x7fdec40c1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56762/0 (socket says 172.21.15.26:56762) 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 -- 172.21.15.26:0/974203566 learned_addr learned my addr 172.21.15.26:0/974203566 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec2ffd640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdec406b100 0x7fdec413fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdeba7fc640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdec406b4e0 0x7fdec4145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 -- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdec406b4e0 msgr2=0x7fdec4145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdec406b4e0 0x7fdec4145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 -- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdec406b100 msgr2=0x7fdec413fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdec406b100 0x7fdec413fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 -- 172.21.15.26:0/974203566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc009a70 con 0x7fdec40c48e0 2023-11-28T16:59:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec37fe640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec40c48e0 0x7fdec40c1280 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fdebc019490 tx=0x7fdebc019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdebbfff640 1 -- 172.21.15.26:0/974203566 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b9650 con 0x7fdec40c48e0 2023-11-28T16:59:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdebbfff640 1 -- 172.21.15.26:0/974203566 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0b97b0 con 0x7fdec40c48e0 2023-11-28T16:59:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec4143360 con 0x7fdec40c48e0 2023-11-28T16:59:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdebbfff640 1 -- 172.21.15.26:0/974203566 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b9b60 con 0x7fdec40c48e0 2023-11-28T16:59:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4141380 con 0x7fdec40c48e0 2023-11-28T16:59:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec41434f0 con 0x7fdec40c48e0 2023-11-28T16:59:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.520+0000 7fdebbfff640 1 -- 172.21.15.26:0/974203566 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdebc0b9cc0 con 0x7fdec40c48e0 2023-11-28T16:59:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.524+0000 7fdebbfff640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdea40668d0 0x7fdea4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.524+0000 7fdebbfff640 1 -- 172.21.15.26:0/974203566 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdebc11f260 con 0x7fdec40c48e0 2023-11-28T16:59:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.524+0000 7fdec2ffd640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdea40668d0 0x7fdea4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.524+0000 7fdec2ffd640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdea40668d0 0x7fdea4068d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005890 tx=0x7fdeb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.528+0000 7fdebbfff640 1 -- 172.21.15.26:0/974203566 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdebc0ec750 con 0x7fdec40c48e0 2023-11-28T16:59:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.684+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdec4142f10 con 0x7fdea40668d0 2023-11-28T16:59:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdebbfff640 1 -- 172.21.15.26:0/974203566 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50111 (secure 0 0 0) 0x7fdec4142f10 con 0x7fdea40668d0 2023-11-28T16:59:51.690 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdea40668d0 msgr2=0x7fdea4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdea40668d0 0x7fdea4068d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005890 tx=0x7fdeb4009040 comp rx=0 tx=0).stop 2023-11-28T16:59:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec40c48e0 msgr2=0x7fdec40c1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec40c48e0 0x7fdec40c1280 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fdebc019490 tx=0x7fdebc019620 comp rx=0 tx=0).stop 2023-11-28T16:59:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 shutdown_connections 2023-11-28T16:59:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdec40c48e0 0x7fdec40c1280 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fdea40668d0 0x7fdea4068d90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdec406b4e0 0x7fdec4145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 --2- 172.21.15.26:0/974203566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdec406b100 0x7fdec413fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 >> 172.21.15.26:0/974203566 conn(0x7fdec40ca360 msgr2=0x7fdec40ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 shutdown_connections 2023-11-28T16:59:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.688+0000 7fdec978d640 1 -- 172.21.15.26:0/974203566 wait complete. 2023-11-28T16:59:51.711 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-28T16:59:51.628584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254020,"kb_used_data":8736,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720700,"statfs":{"total":773094113280,"available":772833996800,"internally_reserved":0,"allocated":8945664,"data_stored":4622199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001608"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-28T16:59:47.179483+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:59:47.179483+0000","last_peered":"2023-11-28T16:59:47.179483+0000","last_clean":"2023-11-28T16:59:47.179483+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:59:47.179483+0000","last_undegraded":"2023-11-28T16:59:47.179483+0000","last_fullsized":"2023-11-28T16:59:47.179483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":1021278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.745,"15min":0.71599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":5.8499999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.77800000000000002,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.9800000000000004,"5min":5.9800000000000004,"15min":5.9800000000000004},"last":0.83499999999999996}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.87},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94499999999999995}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.63200000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.84499999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.628}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.69699999999999995},"min":{"1min":0.46200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.84699999999999998,"5min":1.474,"15min":1.474},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.749,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.754,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.623}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.88,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91300000000000003,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":1.038,"15min":1.038},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.071,"15min":1.071},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85999999999999999,"5min":1.367,"15min":1.367},"last":0.498}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.022,"5min":1.401,"15min":1.401},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.82299999999999995,"15min":0.873},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86399999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.748},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66400000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.503,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.74199999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.628},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82599999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.876,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72999999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64800000000000002,"15min":0.67500000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47399999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.66800000000000004},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70599999999999996,"15min":0.73499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.234,"15min":1.234},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.964,"15min":1.964},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0449999999999999,"5min":1.704,"15min":1.704},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92000000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.79600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98199999999999998,"5min":1.254,"15min":1.254},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98399999999999999,"5min":1.548,"15min":1.548},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.755},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89500000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":1.218,"15min":1.218},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.0780000000000001,"5min":1.593,"15min":1.593},"last":0.96199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.626,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64600000000000002,"5min":0.745,"15min":0.745},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57999999999999996,"5min":0.874,"15min":0.874},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.5,"15min":0.505},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.304,"15min":1.304},"last":0.54200000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":1.502,"15min":1.502},"last":0.501},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":1.21,"15min":1.21},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97099999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94999999999999996,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80100000000000005,"15min":0.82799999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.25,"15min":1.25},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0720000000000001,"5min":1.423,"15min":1.423},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.433,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.503,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.67500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.439},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.39600000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.54400000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":0.998,"15min":0.998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.56699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88700000000000001,"5min":1.042,"15min":1.042},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85699999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91100000000000003,"5min":1.012,"15min":1.012},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84099999999999997,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76400000000000001,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88400000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94499999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":424955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78300000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.446,"15min":1.446},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0980000000000001,"5min":1.47,"15min":1.47},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.056,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.57399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.327,"15min":1.327},"last":0.63}]},{"osd":6,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98299999999999998,"5min":1.3,"15min":1.3},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.526,"15min":1.526},"last":0.73399999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80600000000000005,"15min":0.83399999999999996},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95399999999999996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":1021278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45800000000000002,"15min":0.47999999999999998},"min":{"1min":0.26600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.753,"5min":1.085,"15min":1.085},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.73799999999999999},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64400000000000002,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.66900000000000004},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77400000000000002,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91400000000000003,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.135,"5min":1.859,"15min":1.859},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.462,"15min":1.462},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1319999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.222,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.119,"5min":1.298,"15min":1.298},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.323,"15min":1.323},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0680000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.505},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.50700000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.155,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:51.713 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:51.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.852+0000 7f17bbc46640 1 Processor -- start 2023-11-28T16:59:51.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.852+0000 7f17bbc46640 1 -- start start 2023-11-28T16:59:51.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.852+0000 7f17bbc46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17b406db80 0x7f17b406c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.852+0000 7f17bbc46640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.852+0000 7f17bbc46640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b406bea0 con 0x7f17b4152ce0 2023-11-28T16:59:51.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17bbc46640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b4159b10 con 0x7f17b406db80 2023-11-28T16:59:51.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17bbc46640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4159550 con 0x7f17b406d100 2023-11-28T16:59:51.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17b406db80 0x7f17b406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17b406db80 0x7f17b406c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56772/0 (socket says 172.21.15.26:56772) 2023-11-28T16:59:51.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 -- 172.21.15.26:0/1823029623 learned_addr learned my addr 172.21.15.26:0/1823029623 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:51.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17ba1e3640 1 --2- 172.21.15.26:0/1823029623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 -- 172.21.15.26:0/1823029623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 msgr2=0x7f17b40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:51.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 --2- 172.21.15.26:0/1823029623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 -- 172.21.15.26:0/1823029623 >> v1:172.21.15.79:6789/0 conn(0x7f17b4152ce0 legacy=0x7f17b40700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b89e0640 1 -- 172.21.15.26:0/1823029623 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817106004 0 0) 0x7f17b406bea0 con 0x7f17b4152ce0 2023-11-28T16:59:51.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 -- 172.21.15.26:0/1823029623 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4159830 con 0x7f17b406db80 2023-11-28T16:59:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b91e1640 1 --2- 172.21.15.26:0/1823029623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b406c940 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009870 tx=0x7f17a401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452d42cda845c575 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.856+0000 7f17b89e0640 1 -- 172.21.15.26:0/1823029623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40aa610 con 0x7f17b406db80 2023-11-28T16:59:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17b89e0640 1 -- 172.21.15.26:0/1823029623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a40a6040 con 0x7f17b406db80 2023-11-28T16:59:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17b89e0640 1 -- 172.21.15.26:0/1823029623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40aa990 con 0x7f17b406db80 2023-11-28T16:59:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- 172.21.15.26:0/1823029623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 msgr2=0x7f17b406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 --2- 172.21.15.26:0/1823029623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b406c940 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009870 tx=0x7f17a401c4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- 172.21.15.26:0/1823029623 shutdown_connections 2023-11-28T16:59:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 --2- 172.21.15.26:0/1823029623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 --2- 172.21.15.26:0/1823029623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b406c940 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- 172.21.15.26:0/1823029623 >> 172.21.15.26:0/1823029623 conn(0x7f17b40c2ad0 msgr2=0x7f17b40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:51.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- 172.21.15.26:0/1823029623 shutdown_connections 2023-11-28T16:59:51.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- 172.21.15.26:0/1823029623 wait complete. 2023-11-28T16:59:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 Processor -- start 2023-11-28T16:59:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- start start 2023-11-28T16:59:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b4152ce0 0x7f17b41f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40c4b70 con 0x7f17b406db80 2023-11-28T16:59:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b415cfc0 con 0x7f17b4152ce0 2023-11-28T16:59:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17bbc46640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b41f57a0 con 0x7f17b406d100 2023-11-28T16:59:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17b91e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17b91e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b4153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56782/0 (socket says 172.21.15.26:56782) 2023-11-28T16:59:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17b91e1640 1 -- 172.21.15.26:0/4081773447 learned_addr learned my addr 172.21.15.26:0/4081773447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.860+0000 7f17b99e2640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17ba1e3640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b4152ce0 0x7f17b41f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17b91e1640 1 -- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 msgr2=0x7f17b40c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17b91e1640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17b91e1640 1 -- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b4152ce0 msgr2=0x7f17b41f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:51.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17b91e1640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b4152ce0 0x7f17b41f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:51.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17b91e1640 1 -- 172.21.15.26:0/4081773447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40094d0 con 0x7f17b406db80 2023-11-28T16:59:51.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17b91e1640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b4153f20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f17a401ab60 tx=0x7f17a401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:51.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17aa7fc640 1 -- 172.21.15.26:0/4081773447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40bd5f0 con 0x7f17b406db80 2023-11-28T16:59:51.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17aa7fc640 1 -- 172.21.15.26:0/4081773447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a40bd750 con 0x7f17b406db80 2023-11-28T16:59:51.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b40c4790 con 0x7f17b406db80 2023-11-28T16:59:51.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17aa7fc640 1 -- 172.21.15.26:0/4081773447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40bdb00 con 0x7f17b406db80 2023-11-28T16:59:51.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b4151cf0 con 0x7f17b406db80 2023-11-28T16:59:51.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b40c4cb0 con 0x7f17b406db80 2023-11-28T16:59:51.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17aa7fc640 1 -- 172.21.15.26:0/4081773447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f17a40b33f0 con 0x7f17b406db80 2023-11-28T16:59:51.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17aa7fc640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1798066900 0x7f1798068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:51.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.864+0000 7f17aa7fc640 1 -- 172.21.15.26:0/4081773447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f17a411ed10 con 0x7f17b406db80 2023-11-28T16:59:51.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.868+0000 7f17b99e2640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1798066900 0x7f1798068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:51.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.868+0000 7f17b99e2640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1798066900 0x7f1798068dc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f17b0007fd0 tx=0x7f17b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:51.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:51.868+0000 7f17aa7fc640 1 -- 172.21.15.26:0/4081773447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17b40c4cb0 con 0x7f17b406db80 2023-11-28T16:59:52.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.024+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17b41564e0 con 0x7f1798066900 2023-11-28T16:59:52.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17aa7fc640 1 -- 172.21.15.26:0/4081773447 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50111 (secure 0 0 0) 0x7f17b0001470 con 0x7f1798066900 2023-11-28T16:59:52.031 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1798066900 msgr2=0x7f1798068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1798066900 0x7f1798068dc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f17b0007fd0 tx=0x7f17b0009040 comp rx=0 tx=0).stop 2023-11-28T16:59:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 msgr2=0x7f17b4153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b4153f20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f17a401ab60 tx=0x7f17a401acf0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 shutdown_connections 2023-11-28T16:59:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b4152ce0 0x7f17b41f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b406db80 0x7f17b4153f20 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f1798066900 0x7f1798068dc0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 --2- 172.21.15.26:0/4081773447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17b406d100 0x7f17b40c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 >> 172.21.15.26:0/4081773447 conn(0x7f17b40c2ad0 msgr2=0x7f17b414c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 shutdown_connections 2023-11-28T16:59:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.028+0000 7f17bbc46640 1 -- 172.21.15.26:0/4081773447 wait complete. 2023-11-28T16:59:52.051 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-28T16:59:51.628584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254020,"kb_used_data":8736,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720700,"statfs":{"total":773094113280,"available":772833996800,"internally_reserved":0,"allocated":8945664,"data_stored":4622199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001608"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-28T16:59:47.179483+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:59:47.179483+0000","last_peered":"2023-11-28T16:59:47.179483+0000","last_clean":"2023-11-28T16:59:47.179483+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:59:47.179483+0000","last_undegraded":"2023-11-28T16:59:47.179483+0000","last_fullsized":"2023-11-28T16:59:47.179483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":1021278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.745,"15min":0.71599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":5.8499999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.77800000000000002,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.9800000000000004,"5min":5.9800000000000004,"15min":5.9800000000000004},"last":0.83499999999999996}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.87},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94499999999999995}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.63200000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.84499999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.628}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.69699999999999995},"min":{"1min":0.46200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.84699999999999998,"5min":1.474,"15min":1.474},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.749,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.754,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.623}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.88,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91300000000000003,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":1.038,"15min":1.038},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.071,"15min":1.071},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85999999999999999,"5min":1.367,"15min":1.367},"last":0.498}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.022,"5min":1.401,"15min":1.401},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.82299999999999995,"15min":0.873},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86399999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.748},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66400000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.503,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.74199999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.628},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82599999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.876,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72999999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64800000000000002,"15min":0.67500000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47399999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.66800000000000004},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70599999999999996,"15min":0.73499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.234,"15min":1.234},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.964,"15min":1.964},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0449999999999999,"5min":1.704,"15min":1.704},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92000000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.79600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98199999999999998,"5min":1.254,"15min":1.254},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98399999999999999,"5min":1.548,"15min":1.548},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.755},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89500000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":1.218,"15min":1.218},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.0780000000000001,"5min":1.593,"15min":1.593},"last":0.96199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.626,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64600000000000002,"5min":0.745,"15min":0.745},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57999999999999996,"5min":0.874,"15min":0.874},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.5,"15min":0.505},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.304,"15min":1.304},"last":0.54200000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":1.502,"15min":1.502},"last":0.501},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":1.21,"15min":1.21},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97099999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94999999999999996,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80100000000000005,"15min":0.82799999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.25,"15min":1.25},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0720000000000001,"5min":1.423,"15min":1.423},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.433,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.503,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.67500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.439},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.39600000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.54400000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":0.998,"15min":0.998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.56699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88700000000000001,"5min":1.042,"15min":1.042},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85699999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91100000000000003,"5min":1.012,"15min":1.012},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84099999999999997,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76400000000000001,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88400000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94499999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":424955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78300000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.446,"15min":1.446},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0980000000000001,"5min":1.47,"15min":1.47},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.056,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.57399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.327,"15min":1.327},"last":0.63}]},{"osd":6,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98299999999999998,"5min":1.3,"15min":1.3},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.526,"15min":1.526},"last":0.73399999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80600000000000005,"15min":0.83399999999999996},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95399999999999996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":1021278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45800000000000002,"15min":0.47999999999999998},"min":{"1min":0.26600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.753,"5min":1.085,"15min":1.085},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.73799999999999999},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64400000000000002,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.66900000000000004},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77400000000000002,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91400000000000003,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.135,"5min":1.859,"15min":1.859},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.462,"15min":1.462},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1319999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.222,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.119,"5min":1.298,"15min":1.298},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.323,"15min":1.323},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0680000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.505},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.50700000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.155,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:52.053 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T16:59:52.053 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f5510f640 1 Processor -- start 2023-11-28T16:59:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f5510f640 1 -- start start 2023-11-28T16:59:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f5510f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f5014f850 0x7f4f5006cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f5510f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500a9460 0x7f4f50152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f5510f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f500c2880 con 0x7f4f500c2050 2023-11-28T16:59:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f5510f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5006e010 con 0x7f4f5014f850 2023-11-28T16:59:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f5510f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500a84e0 con 0x7f4f500a9460 2023-11-28T16:59:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f5014f850 0x7f4f5006cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4f59e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4f500c2050 0x7f4f501527c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52030/0 (socket says 172.21.15.26:52030) 2023-11-28T16:59:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4f59e640 1 -- 172.21.15.26:0/1763037803 learned_addr learned my addr 172.21.15.26:0/1763037803 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4e59c640 1 --2- 172.21.15.26:0/1763037803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500a9460 0x7f4f50152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4ed9d640 1 -- 172.21.15.26:0/1763037803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500a9460 msgr2=0x7f4f50152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4ed9d640 1 --2- 172.21.15.26:0/1763037803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500a9460 0x7f4f50152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4ed9d640 1 -- 172.21.15.26:0/1763037803 >> v1:172.21.15.26:6789/0 conn(0x7f4f500c2050 legacy=0x7f4f501527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.192+0000 7f4f4ed9d640 1 -- 172.21.15.26:0/1763037803 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500a87a0 con 0x7f4f5014f850 2023-11-28T16:59:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f4ed9d640 1 --2- 172.21.15.26:0/1763037803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f5006cfa0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4f400097c0 tx=0x7f4f4001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda0f2aa8cb72aab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f4dd9b640 1 -- 172.21.15.26:0/1763037803 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400ab600 con 0x7f4f5014f850 2023-11-28T16:59:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f4dd9b640 1 -- 172.21.15.26:0/1763037803 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f400a7050 con 0x7f4f5014f850 2023-11-28T16:59:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f4dd9b640 1 -- 172.21.15.26:0/1763037803 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400ab980 con 0x7f4f5014f850 2023-11-28T16:59:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f5510f640 1 -- 172.21.15.26:0/1763037803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 msgr2=0x7f4f5006cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f5510f640 1 --2- 172.21.15.26:0/1763037803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f5006cfa0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4f400097c0 tx=0x7f4f4001c330 comp rx=0 tx=0).stop 2023-11-28T16:59:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f5510f640 1 -- 172.21.15.26:0/1763037803 shutdown_connections 2023-11-28T16:59:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f5510f640 1 --2- 172.21.15.26:0/1763037803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500a9460 0x7f4f50152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f5510f640 1 --2- 172.21.15.26:0/1763037803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f5006cfa0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f5510f640 1 -- 172.21.15.26:0/1763037803 >> 172.21.15.26:0/1763037803 conn(0x7f4f500c5f60 msgr2=0x7f4f500c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.196+0000 7f4f5510f640 1 -- 172.21.15.26:0/1763037803 shutdown_connections 2023-11-28T16:59:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 -- 172.21.15.26:0/1763037803 wait complete. 2023-11-28T16:59:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 Processor -- start 2023-11-28T16:59:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 -- start start 2023-11-28T16:59:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f500a9460 0x7f4f500c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500c2050 0x7f4f500c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f501506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5015c9b0 con 0x7f4f5014f850 2023-11-28T16:59:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5014c950 con 0x7f4f500a9460 2023-11-28T16:59:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f5510f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5015c6d0 con 0x7f4f500c2050 2023-11-28T16:59:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f501506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4e59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500c2050 0x7f4f500c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4f59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f501506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56810/0 (socket says 172.21.15.26:56810) 2023-11-28T16:59:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4f59e640 1 -- 172.21.15.26:0/3959441633 learned_addr learned my addr 172.21.15.26:0/3959441633 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4ed9d640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f500a9460 0x7f4f500c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4e59c640 1 -- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f500a9460 msgr2=0x7f4f500c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4e59c640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f500a9460 0x7f4f500c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4e59c640 1 -- 172.21.15.26:0/3959441633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 msgr2=0x7f4f501506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4e59c640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f501506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4e59c640 1 -- 172.21.15.26:0/3959441633 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40009420 con 0x7f4f500c2050 2023-11-28T16:59:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4f59e640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f501506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.200+0000 7f4f4e59c640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500c2050 0x7f4f500c5360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e870 tx=0x7f4f4400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:52.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f377fe640 1 -- 172.21.15.26:0/3959441633 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400ee60 con 0x7f4f500c2050 2023-11-28T16:59:52.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f377fe640 1 -- 172.21.15.26:0/3959441633 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400c940 con 0x7f4f500c2050 2023-11-28T16:59:52.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f377fe640 1 -- 172.21.15.26:0/3959441633 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400ccd0 con 0x7f4f500c2050 2023-11-28T16:59:52.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f50150190 con 0x7f4f500c2050 2023-11-28T16:59:52.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5014c2d0 con 0x7f4f500c2050 2023-11-28T16:59:52.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5015c530 con 0x7f4f500c2050 2023-11-28T16:59:52.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f377fe640 1 -- 172.21.15.26:0/3959441633 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4f44013470 con 0x7f4f500c2050 2023-11-28T16:59:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f377fe640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f3c0668d0 0x7f4f3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f377fe640 1 -- 172.21.15.26:0/3959441633 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4f44084120 con 0x7f4f500c2050 2023-11-28T16:59:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.204+0000 7f4f4ed9d640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f3c0668d0 0x7f4f3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.208+0000 7f4f4ed9d640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f3c0668d0 0x7f4f3c068d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4f400ad000 tx=0x7f4f40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:52.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.212+0000 7f4f377fe640 1 -- 172.21.15.26:0/3959441633 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f5015c530 con 0x7f4f500c2050 2023-11-28T16:59:52.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.368+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f5015f420 con 0x7f4f3c0668d0 2023-11-28T16:59:52.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.368+0000 7f4f377fe640 1 -- 172.21.15.26:0/3959441633 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50111 (secure 0 0 0) 0x7f4f400ab7c0 con 0x7f4f3c0668d0 2023-11-28T16:59:52.373 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:52.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f3c0668d0 msgr2=0x7f4f3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f3c0668d0 0x7f4f3c068d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4f400ad000 tx=0x7f4f40008040 comp rx=0 tx=0).stop 2023-11-28T16:59:52.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500c2050 msgr2=0x7f4f500c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500c2050 0x7f4f500c5360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e870 tx=0x7f4f4400ed30 comp rx=0 tx=0).stop 2023-11-28T16:59:52.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 shutdown_connections 2023-11-28T16:59:52.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5014f850 0x7f4f501506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f4f3c0668d0 0x7f4f3c068d90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f500c2050 0x7f4f500c5360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 --2- 172.21.15.26:0/3959441633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f500a9460 0x7f4f500c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 >> 172.21.15.26:0/3959441633 conn(0x7f4f500c5f60 msgr2=0x7f4f50145e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 shutdown_connections 2023-11-28T16:59:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.372+0000 7f4f5510f640 1 -- 172.21.15.26:0/3959441633 wait complete. 2023-11-28T16:59:52.394 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-28T16:59:51.628584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254020,"kb_used_data":8736,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720700,"statfs":{"total":773094113280,"available":772833996800,"internally_reserved":0,"allocated":8945664,"data_stored":4622199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001608"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-28T16:59:47.179483+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:59:47.179483+0000","last_peered":"2023-11-28T16:59:47.179483+0000","last_clean":"2023-11-28T16:59:47.179483+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:59:47.179483+0000","last_undegraded":"2023-11-28T16:59:47.179483+0000","last_fullsized":"2023-11-28T16:59:47.179483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":1021278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.745,"15min":0.71599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":5.8499999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.77800000000000002,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.9800000000000004,"5min":5.9800000000000004,"15min":5.9800000000000004},"last":0.83499999999999996}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.87},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94499999999999995}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.63200000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.84499999999999997}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.628}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.69699999999999995},"min":{"1min":0.46200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.84699999999999998,"5min":1.474,"15min":1.474},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.749,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.754,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.623}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.88,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91300000000000003,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":1.038,"15min":1.038},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.071,"15min":1.071},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85999999999999999,"5min":1.367,"15min":1.367},"last":0.498}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.022,"5min":1.401,"15min":1.401},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.82299999999999995,"15min":0.873},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86399999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.748},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66400000000000003}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.503,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.74199999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.628},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82599999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.876,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72999999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64800000000000002,"15min":0.67500000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47399999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.66800000000000004},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70599999999999996,"15min":0.73499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.234,"15min":1.234},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.964,"15min":1.964},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0449999999999999,"5min":1.704,"15min":1.704},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92000000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.79600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98199999999999998,"5min":1.254,"15min":1.254},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98399999999999999,"5min":1.548,"15min":1.548},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.755},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89500000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":1.218,"15min":1.218},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.0780000000000001,"5min":1.593,"15min":1.593},"last":0.96199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.626,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64600000000000002,"5min":0.745,"15min":0.745},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57999999999999996,"5min":0.874,"15min":0.874},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.5,"15min":0.505},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.304,"15min":1.304},"last":0.54200000000000004}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":1.502,"15min":1.502},"last":0.501},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":1.21,"15min":1.21},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97099999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94999999999999996,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80100000000000005,"15min":0.82799999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.25,"15min":1.25},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0720000000000001,"5min":1.423,"15min":1.423},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.433,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.503,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.67500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.439},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.39600000000000002}]},{"osd":4,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.54400000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":0.998,"15min":0.998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.56699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88700000000000001,"5min":1.042,"15min":1.042},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85699999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91100000000000003,"5min":1.012,"15min":1.012},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84099999999999997,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76400000000000001,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88400000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94499999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":424955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78300000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.446,"15min":1.446},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0980000000000001,"5min":1.47,"15min":1.47},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.056,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.57399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.327,"15min":1.327},"last":0.63}]},{"osd":6,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98299999999999998,"5min":1.3,"15min":1.3},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.526,"15min":1.526},"last":0.73399999999999999}]},{"osd":7,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80600000000000005,"15min":0.83399999999999996},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95399999999999996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":1021278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45800000000000002,"15min":0.47999999999999998},"min":{"1min":0.26600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.753,"5min":1.085,"15min":1.085},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.73799999999999999},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64400000000000002,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.66900000000000004},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77400000000000002,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91400000000000003,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.135,"5min":1.859,"15min":1.859},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.462,"15min":1.462},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1319999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.222,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.119,"5min":1.298,"15min":1.298},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.323,"15min":1.323},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0680000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.505},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.50700000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.155,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:52.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T16:59:52.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cdd56640 1 Processor -- start 2023-11-28T16:59:52.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cdd56640 1 -- start start 2023-11-28T16:59:52.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cdd56640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65c80c8380 0x7f65c80c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cdd56640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c8154fe0 0x7f65c815f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cdd56640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c81521b0 con 0x7f65c80c6940 2023-11-28T16:59:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cdd56640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80c4c60 con 0x7f65c80c8380 2023-11-28T16:59:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cdd56640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80c4f40 con 0x7f65c8154fe0 2023-11-28T16:59:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65c7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65c80c8380 0x7f65c80c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65ccd54640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f65c80c6940 0x7f65c8158790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52044/0 (socket says 172.21.15.26:52044) 2023-11-28T16:59:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65ccd54640 1 -- 172.21.15.26:0/1531378292 learned_addr learned my addr 172.21.15.26:0/1531378292 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65cd555640 1 --2- 172.21.15.26:0/1531378292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c8154fe0 0x7f65c815f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65c7fff640 1 -- 172.21.15.26:0/1531378292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c8154fe0 msgr2=0x7f65c815f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65c7fff640 1 --2- 172.21.15.26:0/1531378292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c8154fe0 0x7f65c815f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65c7fff640 1 -- 172.21.15.26:0/1531378292 >> v1:172.21.15.26:6789/0 conn(0x7f65c80c6940 legacy=0x7f65c8158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65c7fff640 1 -- 172.21.15.26:0/1531378292 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80c5220 con 0x7f65c80c8380 2023-11-28T16:59:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.536+0000 7f65c77fe640 1 -- 172.21.15.26:0/1531378292 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252888280 0 0) 0x7f65c81521b0 con 0x7f65c80c6940 2023-11-28T16:59:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65c7fff640 1 --2- 172.21.15.26:0/1531378292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c80c8380 0x7f65c80c6d20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f65b40097a0 tx=0x7f65b401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68076248d96f3568 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65c77fe640 1 -- 172.21.15.26:0/1531378292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40ab600 con 0x7f65c80c8380 2023-11-28T16:59:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65c77fe640 1 -- 172.21.15.26:0/1531378292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b40a7050 con 0x7f65c80c8380 2023-11-28T16:59:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65c77fe640 1 -- 172.21.15.26:0/1531378292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40ab980 con 0x7f65c80c8380 2023-11-28T16:59:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 -- 172.21.15.26:0/1531378292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c80c8380 msgr2=0x7f65c80c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 --2- 172.21.15.26:0/1531378292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c80c8380 0x7f65c80c6d20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f65b40097a0 tx=0x7f65b401c3a0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 -- 172.21.15.26:0/1531378292 shutdown_connections 2023-11-28T16:59:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 --2- 172.21.15.26:0/1531378292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c8154fe0 0x7f65c815f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 --2- 172.21.15.26:0/1531378292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c80c8380 0x7f65c80c6d20 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 -- 172.21.15.26:0/1531378292 >> 172.21.15.26:0/1531378292 conn(0x7f65c80ca140 msgr2=0x7f65c80ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:52.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 -- 172.21.15.26:0/1531378292 shutdown_connections 2023-11-28T16:59:52.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.540+0000 7f65cdd56640 1 -- 172.21.15.26:0/1531378292 wait complete. 2023-11-28T16:59:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 Processor -- start 2023-11-28T16:59:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 -- start start 2023-11-28T16:59:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c80c6940 0x7f65c8148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c80c8380 0x7f65c8145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c8154fe0 0x7f65c81f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80ac820 con 0x7f65c8154fe0 2023-11-28T16:59:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81519e0 con 0x7f65c80c6940 2023-11-28T16:59:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80aa320 con 0x7f65c80c8380 2023-11-28T16:59:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c8154fe0 0x7f65c81f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c8154fe0 0x7f65c81f08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56824/0 (socket says 172.21.15.26:56824) 2023-11-28T16:59:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 -- 172.21.15.26:0/2439180908 learned_addr learned my addr 172.21.15.26:0/2439180908 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65ccd54640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c80c6940 0x7f65c8148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65c7fff640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c80c8380 0x7f65c8145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 -- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c80c8380 msgr2=0x7f65c8145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c80c8380 0x7f65c8145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 -- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c80c6940 msgr2=0x7f65c8148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c80c6940 0x7f65c8148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 -- 172.21.15.26:0/2439180908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40093b0 con 0x7f65c8154fe0 2023-11-28T16:59:52.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cd555640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c8154fe0 0x7f65c81f08a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009d30 tx=0x7f65c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65c57fa640 1 -- 172.21.15.26:0/2439180908 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0009ba0 con 0x7f65c8154fe0 2023-11-28T16:59:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65c57fa640 1 -- 172.21.15.26:0/2439180908 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c000f040 con 0x7f65c8154fe0 2023-11-28T16:59:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65c57fa640 1 -- 172.21.15.26:0/2439180908 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00146c0 con 0x7f65c8154fe0 2023-11-28T16:59:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c80aa570 con 0x7f65c8154fe0 2023-11-28T16:59:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.544+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c80c2090 con 0x7f65c8154fe0 2023-11-28T16:59:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.548+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c804e890 con 0x7f65c8154fe0 2023-11-28T16:59:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.548+0000 7f65c57fa640 1 -- 172.21.15.26:0/2439180908 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f65c0014820 con 0x7f65c8154fe0 2023-11-28T16:59:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.548+0000 7f65c57fa640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65ac066900 0x7f65ac068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.548+0000 7f65c57fa640 1 -- 172.21.15.26:0/2439180908 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f65c0084ab0 con 0x7f65c8154fe0 2023-11-28T16:59:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.548+0000 7f65ccd54640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65ac066900 0x7f65ac068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.548+0000 7f65ccd54640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65ac066900 0x7f65ac068dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f65bc007fd0 tx=0x7f65bc007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.552+0000 7f65c57fa640 1 -- 172.21.15.26:0/2439180908 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65c0052030 con 0x7f65c8154fe0 2023-11-28T16:59:52.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.708+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c80c7900 con 0x7f65c8154fe0 2023-11-28T16:59:52.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.708+0000 7f65c57fa640 1 -- 172.21.15.26:0/2439180908 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13045 (secure 0 0 0) 0x7f65c0018090 con 0x7f65c8154fe0 2023-11-28T16:59:52.713 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:52.713 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":79,"fsid":"e7b00ebb-20e3-4761-8df9-f3cdee8ca1ee","created":"2023-11-28T16:55:52.454865+0000","modified":"2023-11-28T16:59:49.517981+0000","last_up_change":"2023-11-28T16:56:04.457974+0000","last_in_change":"2023-11-28T16:55:55.074883+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T16:56:05.635220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56c25a03-ca34-49ee-9eeb-6e459cf21572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6801","nonce":3368065621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6803","nonce":3368065621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6807","nonce":3368065621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3368065621},{"type":"v1","addr":"172.21.15.26:6805","nonce":3368065621}]},"public_addr":"172.21.15.26:6801/3368065621","cluster_addr":"172.21.15.26:6803/3368065621","heartbeat_back_addr":"172.21.15.26:6807/3368065621","heartbeat_front_addr":"172.21.15.26:6805/3368065621","state":["exists","up"]},{"osd":1,"uuid":"d5224fc5-6a4d-4163-b586-713d635b9a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6810","nonce":428800688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6814","nonce":428800688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6822","nonce":428800688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":428800688},{"type":"v1","addr":"172.21.15.26:6818","nonce":428800688}]},"public_addr":"172.21.15.26:6810/428800688","cluster_addr":"172.21.15.26:6814/428800688","heartbeat_back_addr":"172.21.15.26:6822/428800688","heartbeat_front_addr":"172.21.15.26:6818/428800688","state":["exists","up"]},{"osd":2,"uuid":"da986cc2-83f7-417f-900d-580649b3b2b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6825","nonce":210401114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6827","nonce":210401114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6831","nonce":210401114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":210401114},{"type":"v1","addr":"172.21.15.26:6829","nonce":210401114}]},"public_addr":"172.21.15.26:6825/210401114","cluster_addr":"172.21.15.26:6827/210401114","heartbeat_back_addr":"172.21.15.26:6831/210401114","heartbeat_front_addr":"172.21.15.26:6829/210401114","state":["exists","up"]},{"osd":3,"uuid":"10ab208d-8315-4e67-ac5b-1fe2b251e52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6811","nonce":3338490031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6815","nonce":3338490031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6823","nonce":3338490031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":3338490031},{"type":"v1","addr":"172.21.15.26:6819","nonce":3338490031}]},"public_addr":"172.21.15.26:6811/3338490031","cluster_addr":"172.21.15.26:6815/3338490031","heartbeat_back_addr":"172.21.15.26:6823/3338490031","heartbeat_front_addr":"172.21.15.26:6819/3338490031","state":["exists","up"]},{"osd":4,"uuid":"95aace8e-79bd-4c68-8370-9676f847bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6809","nonce":3750285918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6811","nonce":3750285918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6815","nonce":3750285918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3750285918},{"type":"v1","addr":"172.21.15.79:6813","nonce":3750285918}]},"public_addr":"172.21.15.79:6809/3750285918","cluster_addr":"172.21.15.79:6811/3750285918","heartbeat_back_addr":"172.21.15.79:6815/3750285918","heartbeat_front_addr":"172.21.15.79:6813/3750285918","state":["exists","up"]},{"osd":5,"uuid":"3d99691f-134a-4c22-ba2b-71a58c467287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6801","nonce":1334116605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6803","nonce":1334116605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6807","nonce":1334116605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1334116605},{"type":"v1","addr":"172.21.15.79:6805","nonce":1334116605}]},"public_addr":"172.21.15.79:6801/1334116605","cluster_addr":"172.21.15.79:6803/1334116605","heartbeat_back_addr":"172.21.15.79:6807/1334116605","heartbeat_front_addr":"172.21.15.79:6805/1334116605","state":["exists","up"]},{"osd":6,"uuid":"465da986-7b35-48b9-b557-3703dc726b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6817","nonce":179635764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6819","nonce":179635764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6823","nonce":179635764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":179635764},{"type":"v1","addr":"172.21.15.79:6821","nonce":179635764}]},"public_addr":"172.21.15.79:6817/179635764","cluster_addr":"172.21.15.79:6819/179635764","heartbeat_back_addr":"172.21.15.79:6823/179635764","heartbeat_front_addr":"172.21.15.79:6821/179635764","state":["exists","up"]},{"osd":7,"uuid":"f2c5d659-554b-4abf-99f7-1f7c5707eb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6825","nonce":3002149091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6827","nonce":3002149091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6831","nonce":3002149091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":3002149091},{"type":"v1","addr":"172.21.15.79:6829","nonce":3002149091}]},"public_addr":"172.21.15.79:6825/3002149091","cluster_addr":"172.21.15.79:6827/3002149091","heartbeat_back_addr":"172.21.15.79:6831/3002149091","heartbeat_front_addr":"172.21.15.79:6829/3002149091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.593950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.847180+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.736241+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.793170+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.648310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.856439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.855784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T16:56:00.874034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6835/2026162766":"2023-11-29T16:59:46.078232+0000","172.21.15.79:6834/2026162766":"2023-11-29T16:59:46.078232+0000","172.21.15.26:6835/3229750931":"2023-11-29T16:59:39.159003+0000","172.21.15.26:6833/3229750931":"2023-11-29T16:59:39.159003+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T16:59:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65ac066900 msgr2=0x7f65ac068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65ac066900 0x7f65ac068dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f65bc007fd0 tx=0x7f65bc007d60 comp rx=0 tx=0).stop 2023-11-28T16:59:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c8154fe0 msgr2=0x7f65c81f08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c8154fe0 0x7f65c81f08a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009d30 tx=0x7f65c000c490 comp rx=0 tx=0).stop 2023-11-28T16:59:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 shutdown_connections 2023-11-28T16:59:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c8154fe0 0x7f65c81f08a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f65ac066900 0x7f65ac068dc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65c80c8380 0x7f65c8145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 --2- 172.21.15.26:0/2439180908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c80c6940 0x7f65c8148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 >> 172.21.15.26:0/2439180908 conn(0x7f65c80ca140 msgr2=0x7f65c814dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 shutdown_connections 2023-11-28T16:59:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:52.712+0000 7f65cdd56640 1 -- 172.21.15.26:0/2439180908 wait complete. 2023-11-28T16:59:53.735 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T16:59:53.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:53.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185fcd6640 1 Processor -- start 2023-11-28T16:59:53.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185fcd6640 1 -- start start 2023-11-28T16:59:53.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185fcd6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f18580c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:53.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185fcd6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185806fda0 con 0x7f18580c63a0 2023-11-28T16:59:53.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185fcd6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1858070360 con 0x7f185814e8b0 2023-11-28T16:59:53.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185fcd6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185806f460 con 0x7f18580c8a80 2023-11-28T16:59:53.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185e273640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f18580c63a0 0x7f1858157e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52050/0 (socket says 172.21.15.26:52050) 2023-11-28T16:59:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185e273640 1 -- 172.21.15.26:0/3646133587 learned_addr learned my addr 172.21.15.26:0/3646133587 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185d271640 1 --2- 172.21.15.26:0/3646133587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f18580c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742675656 0 0) 0x7f185806fda0 con 0x7f18580c63a0 2023-11-28T16:59:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1844003530 con 0x7f18580c63a0 2023-11-28T16:59:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071323430 0 0) 0x7f1858070360 con 0x7f185814e8b0 2023-11-28T16:59:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.892+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f185806fda0 con 0x7f185814e8b0 2023-11-28T16:59:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185d271640 1 -- 172.21.15.26:0/3646133587 >> v1:172.21.15.79:6789/0 conn(0x7f185814e8b0 legacy=0x7f1858155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185d271640 1 -- 172.21.15.26:0/3646133587 >> v1:172.21.15.26:6789/0 conn(0x7f18580c63a0 legacy=0x7f1858157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1411468981 0 0) 0x7f1844003530 con 0x7f18580c63a0 2023-11-28T16:59:53.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185d271640 1 -- 172.21.15.26:0/3646133587 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185806f640 con 0x7f18580c8a80 2023-11-28T16:59:53.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185d271640 1 --2- 172.21.15.26:0/3646133587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f18580c5e60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18480097f0 tx=0x7f184801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba3f2d5b2a7bbb2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:53.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850001a00 con 0x7f18580c8a80 2023-11-28T16:59:53.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18480a7050 con 0x7f18580c8a80 2023-11-28T16:59:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185ca70640 1 -- 172.21.15.26:0/3646133587 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480ab620 con 0x7f18580c8a80 2023-11-28T16:59:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185fcd6640 1 -- 172.21.15.26:0/3646133587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 msgr2=0x7f18580c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185fcd6640 1 --2- 172.21.15.26:0/3646133587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f18580c5e60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18480097f0 tx=0x7f184801c350 comp rx=0 tx=0).stop 2023-11-28T16:59:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185fcd6640 1 -- 172.21.15.26:0/3646133587 shutdown_connections 2023-11-28T16:59:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185fcd6640 1 --2- 172.21.15.26:0/3646133587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f18580c5e60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.896+0000 7f185fcd6640 1 -- 172.21.15.26:0/3646133587 >> 172.21.15.26:0/3646133587 conn(0x7f18580c7f60 msgr2=0x7f18580c8370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 -- 172.21.15.26:0/3646133587 shutdown_connections 2023-11-28T16:59:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 -- 172.21.15.26:0/3646133587 wait complete. 2023-11-28T16:59:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 Processor -- start 2023-11-28T16:59:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 -- start start 2023-11-28T16:59:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18580c63a0 0x7f1858142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f185814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185814e8b0 0x7f185814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185814a340 con 0x7f18580c63a0 2023-11-28T16:59:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185814c570 con 0x7f185814e8b0 2023-11-28T16:59:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185814ab50 con 0x7f18580c8a80 2023-11-28T16:59:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18580c63a0 0x7f1858142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18580c63a0 0x7f1858142f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56830/0 (socket says 172.21.15.26:56830) 2023-11-28T16:59:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 -- 172.21.15.26:0/3230784459 learned_addr learned my addr 172.21.15.26:0/3230784459 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185e273640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185814e8b0 0x7f185814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185d271640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f185814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 -- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 msgr2=0x7f185814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f185814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 -- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185814e8b0 msgr2=0x7f185814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185814e8b0 0x7f185814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 -- 172.21.15.26:0/3230784459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848009420 con 0x7f18580c63a0 2023-11-28T16:59:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185e273640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185814e8b0 0x7f185814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185d271640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18580c8a80 0x7f185814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185da72640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18580c63a0 0x7f1858142f10 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f185400c430 tx=0x7f185400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540052d0 con 0x7f18580c63a0 2023-11-28T16:59:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854005450 con 0x7f18580c63a0 2023-11-28T16:59:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854003840 con 0x7f18580c63a0 2023-11-28T16:59:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.900+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185814a590 con 0x7f18580c63a0 2023-11-28T16:59:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1858143ae0 con 0x7f18580c63a0 2023-11-28T16:59:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f185804e890 con 0x7f18580c63a0 2023-11-28T16:59:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f18540039a0 con 0x7f18580c63a0 2023-11-28T16:59:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f184e7fc640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f183c0668d0 0x7f183c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1854083f20 con 0x7f18580c63a0 2023-11-28T16:59:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f184e7fc640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f183c06c7d0 0x7f183c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 --> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f183c06f2a0 con 0x7f183c06c7d0 2023-11-28T16:59:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1854084290 con 0x7f18580c63a0 2023-11-28T16:59:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f185d271640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f183c0668d0 0x7f183c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:53.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f185e273640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f183c06c7d0 0x7f183c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.904+0000 7f185e273640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f183c06c7d0 0x7f183c06ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.908+0000 7f185d271640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f183c0668d0 0x7f183c068d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f18480ad000 tx=0x7f1848008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:53.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.908+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== osd.0 v2:172.21.15.26:6800/3368065621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f183c06f2a0 con 0x7f183c06c7d0 2023-11-28T16:59:53.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 --> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f18580aab20 con 0x7f183c06c7d0 2023-11-28T16:59:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f184e7fc640 1 -- 172.21.15.26:0/3230784459 <== osd.0 v2:172.21.15.26:6800/3368065621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f18580aab20 con 0x7f183c06c7d0 2023-11-28T16:59:53.924 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:53.924 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:53.925 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:53.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f183c06c7d0 msgr2=0x7f183c06ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:6800/3368065621,v1:172.21.15.26:6801/3368065621] conn(0x7f183c06c7d0 0x7f183c06ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:53.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f183c0668d0 msgr2=0x7f183c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f183c0668d0 0x7f183c068d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f18480ad000 tx=0x7f1848008040 comp rx=0 tx=0).stop 2023-11-28T16:59:53.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18580c63a0 msgr2=0x7f1858142f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:53.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 --2- 172.21.15.26:0/3230784459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18580c63a0 0x7f1858142f10 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f185400c430 tx=0x7f185400c8f0 comp rx=0 tx=0).stop 2023-11-28T16:59:53.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185e273640 1 -- 172.21.15.26:0/3230784459 reap_dead start 2023-11-28T16:59:53.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 shutdown_connections 2023-11-28T16:59:53.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 >> 172.21.15.26:0/3230784459 conn(0x7f18580c7f60 msgr2=0x7f18580c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 shutdown_connections 2023-11-28T16:59:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:53.920+0000 7f185fcd6640 1 -- 172.21.15.26:0/3230784459 wait complete. 2023-11-28T16:59:53.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T16:59:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc941fb8640 1 Processor -- start 2023-11-28T16:59:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc941fb8640 1 -- start start 2023-11-28T16:59:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc941fb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 0x7fc93c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc941fb8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c06d320 con 0x7fc93c0a8470 2023-11-28T16:59:54.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc941fb8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c0721b0 con 0x7fc93c070b80 2023-11-28T16:59:54.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc941fb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0c2830 con 0x7fc93c14e9d0 2023-11-28T16:59:54.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc93c0a8470 0x7fc93c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52066/0 (socket says 172.21.15.26:52066) 2023-11-28T16:59:54.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93bfff640 1 -- 172.21.15.26:0/2983915383 learned_addr learned my addr 172.21.15.26:0/2983915383 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:54.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 0x7fc93c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463293480 0 0) 0x7fc93c06d320 con 0x7fc93c0a8470 2023-11-28T16:59:54.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc928003530 con 0x7fc93c0a8470 2023-11-28T16:59:54.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184645605 0 0) 0x7fc93c0721b0 con 0x7fc93c070b80 2023-11-28T16:59:54.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc93c06d320 con 0x7fc93c070b80 2023-11-28T16:59:54.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461918635 0 0) 0x7fc928003530 con 0x7fc93c0a8470 2023-11-28T16:59:54.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 msgr2=0x7fc93c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:54.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 0x7fc93c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 >> v1:172.21.15.79:6789/0 conn(0x7fc93c070b80 legacy=0x7fc93c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c072450 con 0x7fc93c0a8470 2023-11-28T16:59:54.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7fc934001a00 con 0x7fc93c0a8470 2023-11-28T16:59:54.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 >> v1:172.21.15.26:6789/0 conn(0x7fc93c0a8470 legacy=0x7fc93c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc928003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 0x7fc9280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928004d10 0x7fc928005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0c2830 con 0x7fc928003b40 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92800dd30 con 0x7fc928004d10 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92800dec0 con 0x7fc93c14e9d0 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc928003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc933fff640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 0x7fc9280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.084+0000 7fc93bfff640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928004d10 0x7fc928005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93b7fe640 1 -- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 msgr2=0x7fc9280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:54.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c14e9d0 0x7fc9280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93b7fe640 1 -- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928004d10 msgr2=0x7fc928005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:54.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928004d10 0x7fc928005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93b7fe640 1 -- 172.21.15.26:0/2983915383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc928003530 con 0x7fc928003b40 2023-11-28T16:59:54.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93bfff640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928004d10 0x7fc928005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:54.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc928003f40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009b10 tx=0x7fc92c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282429519b995288 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0a6420 con 0x7fc928003b40 2023-11-28T16:59:54.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c0a6580 con 0x7fc928003b40 2023-11-28T16:59:54.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93affd640 1 -- 172.21.15.26:0/2983915383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0a6930 con 0x7fc928003b40 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc941fb8640 1 -- 172.21.15.26:0/2983915383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 msgr2=0x7fc928003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc941fb8640 1 --2- 172.21.15.26:0/2983915383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc928003f40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009b10 tx=0x7fc92c01ca50 comp rx=0 tx=0).stop 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc93bfff640 1 -- 172.21.15.26:0/2983915383 reap_dead start 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc941fb8640 1 -- 172.21.15.26:0/2983915383 shutdown_connections 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc941fb8640 1 -- 172.21.15.26:0/2983915383 >> 172.21.15.26:0/2983915383 conn(0x7fc93c0c2ad0 msgr2=0x7fc93c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc941fb8640 1 -- 172.21.15.26:0/2983915383 shutdown_connections 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.088+0000 7fc941fb8640 1 -- 172.21.15.26:0/2983915383 wait complete. 2023-11-28T16:59:54.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 Processor -- start 2023-11-28T16:59:54.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 -- start start 2023-11-28T16:59:54.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc93c1f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c0c43e0 0x7fc93c146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93c146790 0x7fc93c144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0c5d50 con 0x7fc928003b40 2023-11-28T16:59:54.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1f16d0 con 0x7fc93c146790 2023-11-28T16:59:54.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0c5820 con 0x7fc93c0c43e0 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc93c1f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc93c1f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56854/0 (socket says 172.21.15.26:56854) 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 -- 172.21.15.26:0/444637293 learned_addr learned my addr 172.21.15.26:0/444637293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc933fff640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c0c43e0 0x7fc93c146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93bfff640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93c146790 0x7fc93c144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 -- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c0c43e0 msgr2=0x7fc93c146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c0c43e0 0x7fc93c146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 -- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93c146790 msgr2=0x7fc93c144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93c146790 0x7fc93c144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 -- 172.21.15.26:0/444637293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0c05b0 con 0x7fc928003b40 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc933fff640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c0c43e0 0x7fc93c146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc93b7fe640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc93c1f0cf0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc92c01c880 tx=0x7fc928005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc938ff9640 1 -- 172.21.15.26:0/444637293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00f000 con 0x7fc928003b40 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc938ff9640 1 -- 172.21.15.26:0/444637293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c0a6cf0 con 0x7fc928003b40 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc938ff9640 1 -- 172.21.15.26:0/444637293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0b9630 con 0x7fc928003b40 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.092+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c0a9e60 con 0x7fc928003b40 2023-11-28T16:59:54.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.096+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c0c5a70 con 0x7fc928003b40 2023-11-28T16:59:54.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.096+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c04e890 con 0x7fc928003b40 2023-11-28T16:59:54.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.096+0000 7fc938ff9640 1 -- 172.21.15.26:0/444637293 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc92c0a7400 con 0x7fc928003b40 2023-11-28T16:59:54.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.096+0000 7fc938ff9640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc91c0668d0 0x7fc91c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.096+0000 7fc938ff9640 1 -- 172.21.15.26:0/444637293 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc92c11da30 con 0x7fc928003b40 2023-11-28T16:59:54.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.096+0000 7fc933fff640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc91c0668d0 0x7fc91c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.096+0000 7fc933fff640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc91c0668d0 0x7fc91c068d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0c47e0 tx=0x7fc924009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.100+0000 7fc938ff9640 1 -- 172.21.15.26:0/444637293 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc92c0eafb0 con 0x7fc928003b40 2023-11-28T16:59:54.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.256+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc93c0700a0 con 0x7fc91c0668d0 2023-11-28T16:59:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc938ff9640 1 -- 172.21.15.26:0/444637293 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc93c0700a0 con 0x7fc91c0668d0 2023-11-28T16:59:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc91c0668d0 msgr2=0x7fc91c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc91c0668d0 0x7fc91c068d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0c47e0 tx=0x7fc924009040 comp rx=0 tx=0).stop 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 msgr2=0x7fc93c1f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc93c1f0cf0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc92c01c880 tx=0x7fc928005800 comp rx=0 tx=0).stop 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 shutdown_connections 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93c146790 0x7fc93c144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fc91c0668d0 0x7fc91c068d90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93c0c43e0 0x7fc93c146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 --2- 172.21.15.26:0/444637293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc928003b40 0x7fc93c1f0cf0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 >> 172.21.15.26:0/444637293 conn(0x7fc93c0c2ad0 msgr2=0x7fc93c06d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 shutdown_connections 2023-11-28T16:59:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.260+0000 7fc941fb8640 1 -- 172.21.15.26:0/444637293 wait complete. 2023-11-28T16:59:54.283 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T16:59:54.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:54.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838c817640 1 Processor -- start 2023-11-28T16:59:54.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838c817640 1 -- start start 2023-11-28T16:59:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838c817640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f838806b0c0 0x7f8388155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838c817640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83881559d0 con 0x7f8388154ea0 2023-11-28T16:59:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838c817640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838806d910 con 0x7f8388070260 2023-11-28T16:59:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838c817640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83881557c0 con 0x7f838806b0c0 2023-11-28T16:59:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8388154ea0 0x7f838814e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52070/0 (socket says 172.21.15.26:52070) 2023-11-28T16:59:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f8385d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f838806b0c0 0x7f8388155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838659c640 1 -- 172.21.15.26:0/2320469868 learned_addr learned my addr 172.21.15.26:0/2320469868 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f838559a640 1 -- 172.21.15.26:0/2320469868 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207121955 0 0) 0x7f83881559d0 con 0x7f8388154ea0 2023-11-28T16:59:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f8385d9b640 1 -- 172.21.15.26:0/2320469868 >> v1:172.21.15.79:6789/0 conn(0x7f8388070260 legacy=0x7f83880706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f8385d9b640 1 -- 172.21.15.26:0/2320469868 >> v1:172.21.15.26:6789/0 conn(0x7f8388154ea0 legacy=0x7f838814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.428+0000 7f8385d9b640 1 -- 172.21.15.26:0/2320469868 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880c1230 con 0x7f838806b0c0 2023-11-28T16:59:54.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f8385d9b640 1 --2- 172.21.15.26:0/2320469868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f8388155280 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f837c0097c0 tx=0x7f837c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5d8d6c526b2ead server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838559a640 1 -- 172.21.15.26:0/2320469868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0ac620 con 0x7f838806b0c0 2023-11-28T16:59:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838559a640 1 -- 172.21.15.26:0/2320469868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c0ac780 con 0x7f838806b0c0 2023-11-28T16:59:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838559a640 1 -- 172.21.15.26:0/2320469868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0acb10 con 0x7f838806b0c0 2023-11-28T16:59:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838c817640 1 -- 172.21.15.26:0/2320469868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 msgr2=0x7f8388155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838c817640 1 --2- 172.21.15.26:0/2320469868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f8388155280 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f837c0097c0 tx=0x7f837c01c3c0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838c817640 1 -- 172.21.15.26:0/2320469868 shutdown_connections 2023-11-28T16:59:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838c817640 1 --2- 172.21.15.26:0/2320469868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f8388155280 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838c817640 1 -- 172.21.15.26:0/2320469868 >> 172.21.15.26:0/2320469868 conn(0x7f838806a5a0 msgr2=0x7f838806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838c817640 1 -- 172.21.15.26:0/2320469868 shutdown_connections 2023-11-28T16:59:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.432+0000 7f838c817640 1 -- 172.21.15.26:0/2320469868 wait complete. 2023-11-28T16:59:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 Processor -- start 2023-11-28T16:59:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 -- start start 2023-11-28T16:59:54.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f83881ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388070260 0x7f838806c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8388154ea0 0x7f838814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8388144b80 con 0x7f838806b0c0 2023-11-28T16:59:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8388145300 con 0x7f8388154ea0 2023-11-28T16:59:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838814fc70 con 0x7f8388070260 2023-11-28T16:59:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f83881ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f83881ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56866/0 (socket says 172.21.15.26:56866) 2023-11-28T16:59:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 -- 172.21.15.26:0/3598176967 learned_addr learned my addr 172.21.15.26:0/3598176967 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f8386d9d640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8388154ea0 0x7f838814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f8385d9b640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388070260 0x7f838806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 -- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388070260 msgr2=0x7f838806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388070260 0x7f838806c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 -- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8388154ea0 msgr2=0x7f838814bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8388154ea0 0x7f838814bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 -- 172.21.15.26:0/3598176967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009420 con 0x7f838806b0c0 2023-11-28T16:59:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838659c640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f83881ed5e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f837800c410 tx=0x7f837800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780074e0 con 0x7f838806b0c0 2023-11-28T16:59:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378007640 con 0x7f838806b0c0 2023-11-28T16:59:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378004a30 con 0x7f838806b0c0 2023-11-28T16:59:54.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8388145dd0 con 0x7f838806b0c0 2023-11-28T16:59:54.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8388145af0 con 0x7f838806b0c0 2023-11-28T16:59:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.436+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f838806dda0 con 0x7f838806b0c0 2023-11-28T16:59:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8378004b90 con 0x7f838806b0c0 2023-11-28T16:59:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8376ffd640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f83680668d0 0x7f8368068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8378084890 con 0x7f838806b0c0 2023-11-28T16:59:54.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8376ffd640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f836806c7d0 0x7f836806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 --> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f836806f2a0 con 0x7f836806c7d0 2023-11-28T16:59:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8378084c00 con 0x7f838806b0c0 2023-11-28T16:59:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8385d9b640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f83680668d0 0x7f8368068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8386d9d640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f836806c7d0 0x7f836806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8386d9d640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f836806c7d0 0x7f836806ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8385d9b640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f83680668d0 0x7f8368068d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f837c0ae000 tx=0x7f837c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.440+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== osd.1 v2:172.21.15.26:6808/428800688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f836806f2a0 con 0x7f836806c7d0 2023-11-28T16:59:54.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 --> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f838814fad0 con 0x7f836806c7d0 2023-11-28T16:59:54.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f8376ffd640 1 -- 172.21.15.26:0/3598176967 <== osd.1 v2:172.21.15.26:6808/428800688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f838814fad0 con 0x7f836806c7d0 2023-11-28T16:59:54.459 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:54.459 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:54.459 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:54.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f836806c7d0 msgr2=0x7f836806ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:6808/428800688,v1:172.21.15.26:6810/428800688] conn(0x7f836806c7d0 0x7f836806ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f83680668d0 msgr2=0x7f8368068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f83680668d0 0x7f8368068d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f837c0ae000 tx=0x7f837c0a7000 comp rx=0 tx=0).stop 2023-11-28T16:59:54.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 msgr2=0x7f83881ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 --2- 172.21.15.26:0/3598176967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f838806b0c0 0x7f83881ed5e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f837800c410 tx=0x7f837800c8d0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f8386d9d640 1 -- 172.21.15.26:0/3598176967 reap_dead start 2023-11-28T16:59:54.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 shutdown_connections 2023-11-28T16:59:54.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 >> 172.21.15.26:0/3598176967 conn(0x7f838806a5a0 msgr2=0x7f838814d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 shutdown_connections 2023-11-28T16:59:54.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.456+0000 7f838c817640 1 -- 172.21.15.26:0/3598176967 wait complete. 2023-11-28T16:59:54.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T16:59:54.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0214755640 1 Processor -- start 2023-11-28T16:59:54.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0214755640 1 -- start start 2023-11-28T16:59:54.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0214755640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0214755640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c072780 con 0x7f020c0700a0 2023-11-28T16:59:54.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0214755640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0ac160 con 0x7f020c0aacd0 2023-11-28T16:59:54.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0214755640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0abe80 con 0x7f020c154870 2023-11-28T16:59:54.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0212cf2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f020c0700a0 0x7f020c06ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52086/0 (socket says 172.21.15.26:52086) 2023-11-28T16:59:54.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0212cf2640 1 -- 172.21.15.26:0/2541856348 learned_addr learned my addr 172.21.15.26:0/2541856348 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:54.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0211cf0640 1 --2- 172.21.15.26:0/2541856348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680166211 0 0) 0x7f020c072780 con 0x7f020c0700a0 2023-11-28T16:59:54.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f8003530 con 0x7f020c0700a0 2023-11-28T16:59:54.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157836651 0 0) 0x7f020c0ac160 con 0x7f020c0aacd0 2023-11-28T16:59:54.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c072780 con 0x7f020c0aacd0 2023-11-28T16:59:54.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0211cf0640 1 -- 172.21.15.26:0/2541856348 >> v1:172.21.15.79:6789/0 conn(0x7f020c0aacd0 legacy=0x7f020c154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0211cf0640 1 -- 172.21.15.26:0/2541856348 >> v1:172.21.15.26:6789/0 conn(0x7f020c0700a0 legacy=0x7f020c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529129351 0 0) 0x7f01f8003530 con 0x7f020c0700a0 2023-11-28T16:59:54.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.620+0000 7f0211cf0640 1 -- 172.21.15.26:0/2541856348 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c154cf0 con 0x7f020c154870 2023-11-28T16:59:54.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0211cf0640 1 --2- 172.21.15.26:0/2541856348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c06c950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a990 tx=0x7f01fc01c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfaf3dbb554240a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204001a00 con 0x7f020c154870 2023-11-28T16:59:54.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0a6440 con 0x7f020c154870 2023-11-28T16:59:54.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f02114ef640 1 -- 172.21.15.26:0/2541856348 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0a67d0 con 0x7f020c154870 2023-11-28T16:59:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0214755640 1 -- 172.21.15.26:0/2541856348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 msgr2=0x7f020c06c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0214755640 1 --2- 172.21.15.26:0/2541856348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c06c950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a990 tx=0x7f01fc01c5f0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0214755640 1 -- 172.21.15.26:0/2541856348 shutdown_connections 2023-11-28T16:59:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0214755640 1 --2- 172.21.15.26:0/2541856348 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c06c950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0214755640 1 -- 172.21.15.26:0/2541856348 >> 172.21.15.26:0/2541856348 conn(0x7f020c0c2ad0 msgr2=0x7f020c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0214755640 1 -- 172.21.15.26:0/2541856348 shutdown_connections 2023-11-28T16:59:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.624+0000 7f0214755640 1 -- 172.21.15.26:0/2541856348 wait complete. 2023-11-28T16:59:54.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 Processor -- start 2023-11-28T16:59:54.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 -- start start 2023-11-28T16:59:54.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f020c0700a0 0x7f020c0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0aacd0 0x7f020c145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c150bc0 con 0x7f020c0aacd0 2023-11-28T16:59:54.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0c5490 con 0x7f020c0700a0 2023-11-28T16:59:54.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c1ecfe0 con 0x7f020c154870 2023-11-28T16:59:54.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0aacd0 0x7f020c145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0aacd0 0x7f020c145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56878/0 (socket says 172.21.15.26:56878) 2023-11-28T16:59:54.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 -- 172.21.15.26:0/1105510093 learned_addr learned my addr 172.21.15.26:0/1105510093 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:54.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f02124f1640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f020c0700a0 0x7f020c0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0212cf2640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 -- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 msgr2=0x7f020c0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 -- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f020c0700a0 msgr2=0x7f020c0c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f020c0700a0 0x7f020c0c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 -- 172.21.15.26:0/1105510093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc00a5c0 con 0x7f020c0aacd0 2023-11-28T16:59:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0211cf0640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0aacd0 0x7f020c145ef0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a8e0 tx=0x7f01fc019390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0202ffd640 1 -- 172.21.15.26:0/1105510093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0b7070 con 0x7f020c0aacd0 2023-11-28T16:59:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0202ffd640 1 -- 172.21.15.26:0/1105510093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0a6af0 con 0x7f020c0aacd0 2023-11-28T16:59:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c1ed2c0 con 0x7f020c0aacd0 2023-11-28T16:59:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0202ffd640 1 -- 172.21.15.26:0/1105510093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0a6e60 con 0x7f020c0aacd0 2023-11-28T16:59:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.628+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c1ed880 con 0x7f020c0aacd0 2023-11-28T16:59:54.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.632+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c1eda70 con 0x7f020c0aacd0 2023-11-28T16:59:54.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.632+0000 7f0202ffd640 1 -- 172.21.15.26:0/1105510093 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f01fc0b1450 con 0x7f020c0aacd0 2023-11-28T16:59:54.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.632+0000 7f0202ffd640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01f00668d0 0x7f01f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.632+0000 7f0202ffd640 1 -- 172.21.15.26:0/1105510093 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f01fc11e100 con 0x7f020c0aacd0 2023-11-28T16:59:54.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.632+0000 7f02124f1640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01f00668d0 0x7f01f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.632+0000 7f02124f1640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01f00668d0 0x7f01f0068d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02080011f0 tx=0x7f0208009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.636+0000 7f0202ffd640 1 -- 172.21.15.26:0/1105510093 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01fc0eb7a0 con 0x7f020c0aacd0 2023-11-28T16:59:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.792+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f020c06cd80 con 0x7f01f00668d0 2023-11-28T16:59:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.792+0000 7f0202ffd640 1 -- 172.21.15.26:0/1105510093 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f020c06cd80 con 0x7f01f00668d0 2023-11-28T16:59:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T16:59:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01f00668d0 msgr2=0x7f01f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01f00668d0 0x7f01f0068d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02080011f0 tx=0x7f0208009040 comp rx=0 tx=0).stop 2023-11-28T16:59:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0aacd0 msgr2=0x7f020c145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0aacd0 0x7f020c145ef0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a8e0 tx=0x7f01fc019390 comp rx=0 tx=0).stop 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 shutdown_connections 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f01f00668d0 0x7f01f0068d90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f020c154870 0x7f020c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0aacd0 0x7f020c145ef0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 --2- 172.21.15.26:0/1105510093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f020c0700a0 0x7f020c0c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 >> 172.21.15.26:0/1105510093 conn(0x7f020c0c2ad0 msgr2=0x7f020c0bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 shutdown_connections 2023-11-28T16:59:54.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.796+0000 7f0214755640 1 -- 172.21.15.26:0/1105510093 wait complete. 2023-11-28T16:59:54.818 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T16:59:54.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:54.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.960+0000 7f259a232640 1 Processor -- start 2023-11-28T16:59:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.960+0000 7f259a232640 1 -- start start 2023-11-28T16:59:54.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f259a232640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2594154ea0 0x7f2594155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f259a232640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594070260 0x7f25940706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f259a232640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25941559d0 con 0x7f259406b0c0 2023-11-28T16:59:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f259a232640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25941557c0 con 0x7f2594154ea0 2023-11-28T16:59:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f259a232640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259406d910 con 0x7f2594070260 2023-11-28T16:59:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f2592ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f259406b0c0 0x7f259414e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52100/0 (socket says 172.21.15.26:52100) 2023-11-28T16:59:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f2592ffd640 1 -- 172.21.15.26:0/357778208 learned_addr learned my addr 172.21.15.26:0/357778208 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f25937fe640 1 --2- 172.21.15.26:0/357778208 >> v2:172.21.15.79:3300/0 conn(0x7f2594154ea0 0x7f2594155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f2593fff640 1 --2- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594070260 0x7f25940706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f25927fc640 1 -- 172.21.15.26:0/357778208 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010038528 0 0) 0x7f25941559d0 con 0x7f259406b0c0 2023-11-28T16:59:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f25927fc640 1 -- 172.21.15.26:0/357778208 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f257c003530 con 0x7f259406b0c0 2023-11-28T16:59:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f25937fe640 1 -- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594070260 msgr2=0x7f25940706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f25937fe640 1 --2- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594070260 0x7f25940706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f25937fe640 1 -- 172.21.15.26:0/357778208 >> v1:172.21.15.26:6789/0 conn(0x7f259406b0c0 legacy=0x7f259414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.964+0000 7f25937fe640 1 -- 172.21.15.26:0/357778208 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940c1230 con 0x7f2594154ea0 2023-11-28T16:59:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f25937fe640 1 --2- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594154ea0 0x7f2594155280 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f25840097c0 tx=0x7f258401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab0615138c8dcec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f25927fc640 1 -- 172.21.15.26:0/357778208 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840ac620 con 0x7f2594154ea0 2023-11-28T16:59:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f25927fc640 1 -- 172.21.15.26:0/357778208 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25840ac780 con 0x7f2594154ea0 2023-11-28T16:59:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f25927fc640 1 -- 172.21.15.26:0/357778208 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840acb10 con 0x7f2594154ea0 2023-11-28T16:59:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 -- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594154ea0 msgr2=0x7f2594155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 --2- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594154ea0 0x7f2594155280 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f25840097c0 tx=0x7f258401c3c0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 -- 172.21.15.26:0/357778208 shutdown_connections 2023-11-28T16:59:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 --2- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594070260 0x7f25940706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 --2- 172.21.15.26:0/357778208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594154ea0 0x7f2594155280 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 -- 172.21.15.26:0/357778208 >> 172.21.15.26:0/357778208 conn(0x7f259406a5a0 msgr2=0x7f259406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 -- 172.21.15.26:0/357778208 shutdown_connections 2023-11-28T16:59:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 -- 172.21.15.26:0/357778208 wait complete. 2023-11-28T16:59:54.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 Processor -- start 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.968+0000 7f259a232640 1 -- start start 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f259406b0c0 0x7f25940ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594070260 0x7f25941ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594154ea0 0x7f25941ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594149aa0 con 0x7f259406b0c0 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594148530 con 0x7f2594070260 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594149750 con 0x7f2594154ea0 2023-11-28T16:59:54.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f259406b0c0 0x7f25940ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f259406b0c0 0x7f25940ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56880/0 (socket says 172.21.15.26:56880) 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 -- 172.21.15.26:0/2761305422 learned_addr learned my addr 172.21.15.26:0/2761305422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f2593fff640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594154ea0 0x7f25941ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f2592ffd640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594070260 0x7f25941ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 -- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594154ea0 msgr2=0x7f25941ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2594154ea0 0x7f25941ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 -- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594070260 msgr2=0x7f25941ecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594070260 0x7f25941ecc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 -- 172.21.15.26:0/2761305422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584009420 con 0x7f259406b0c0 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f2592ffd640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2594070260 0x7f25941ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f25937fe640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f259406b0c0 0x7f25940ab410 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f25840af040 tx=0x7f2584019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840ac620 con 0x7f259406b0c0 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25840b5410 con 0x7f259406b0c0 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840b57e0 con 0x7f259406b0c0 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2594149ec0 con 0x7f259406b0c0 2023-11-28T16:59:54.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2594148780 con 0x7f259406b0c0 2023-11-28T16:59:54.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.972+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f259406dda0 con 0x7f259406b0c0 2023-11-28T16:59:54.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25840b3040 con 0x7f259406b0c0 2023-11-28T16:59:54.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f257bfff640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2580066900 0x7f2580068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f258411e540 con 0x7f259406b0c0 2023-11-28T16:59:54.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f257bfff640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f258006c800 0x7f258006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:54.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 --> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f258006f2d0 con 0x7f258006c800 2023-11-28T16:59:54.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f258411e8b0 con 0x7f259406b0c0 2023-11-28T16:59:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f2592ffd640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2580066900 0x7f2580068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f2593fff640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f258006c800 0x7f258006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f2592ffd640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2580066900 0x7f2580068dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f25940bfcd0 tx=0x7f2588009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f2593fff640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f258006c800 0x7f258006ec20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:54.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.976+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== osd.2 v2:172.21.15.26:6824/210401114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f258006f2d0 con 0x7f258006c800 2023-11-28T16:59:54.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 --> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f25941489a0 con 0x7f258006c800 2023-11-28T16:59:54.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f257bfff640 1 -- 172.21.15.26:0/2761305422 <== osd.2 v2:172.21.15.26:6824/210401114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f25941489a0 con 0x7f258006c800 2023-11-28T16:59:54.995 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:54.995 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:54.995 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:54.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f258006c800 msgr2=0x7f258006ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:6824/210401114,v1:172.21.15.26:6825/210401114] conn(0x7f258006c800 0x7f258006ec20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:54.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2580066900 msgr2=0x7f2580068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2580066900 0x7f2580068dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f25940bfcd0 tx=0x7f2588009040 comp rx=0 tx=0).stop 2023-11-28T16:59:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f259406b0c0 msgr2=0x7f25940ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 --2- 172.21.15.26:0/2761305422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f259406b0c0 0x7f25940ab410 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f25840af040 tx=0x7f2584019160 comp rx=0 tx=0).stop 2023-11-28T16:59:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f2593fff640 1 -- 172.21.15.26:0/2761305422 reap_dead start 2023-11-28T16:59:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 shutdown_connections 2023-11-28T16:59:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 >> 172.21.15.26:0/2761305422 conn(0x7f259406a5a0 msgr2=0x7f259415b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 shutdown_connections 2023-11-28T16:59:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:54.992+0000 7f259a232640 1 -- 172.21.15.26:0/2761305422 wait complete. 2023-11-28T16:59:55.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T16:59:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f452a640 1 Processor -- start 2023-11-28T16:59:55.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f452a640 1 -- start start 2023-11-28T16:59:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f452a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52ec070b80 0x7f52ec151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f452a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52ec0a8470 0x7f52ec06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f452a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec06d320 con 0x7f52ec14e9d0 2023-11-28T16:59:55.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f452a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec0721b0 con 0x7f52ec0a8470 2023-11-28T16:59:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f452a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec0c2830 con 0x7f52ec070b80 2023-11-28T16:59:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f22c6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f52ec14e9d0 0x7f52ec0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52108/0 (socket says 172.21.15.26:52108) 2023-11-28T16:59:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f22c6640 1 -- 172.21.15.26:0/969102330 learned_addr learned my addr 172.21.15.26:0/969102330 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f2ac7640 1 --2- 172.21.15.26:0/969102330 >> v2:172.21.15.26:3300/0 conn(0x7f52ec0a8470 0x7f52ec06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f1ac5640 1 --2- 172.21.15.26:0/969102330 >> v2:172.21.15.79:3300/0 conn(0x7f52ec070b80 0x7f52ec151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f12c4640 1 -- 172.21.15.26:0/969102330 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128813216 0 0) 0x7f52ec06d320 con 0x7f52ec14e9d0 2023-11-28T16:59:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f12c4640 1 -- 172.21.15.26:0/969102330 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d8003530 con 0x7f52ec14e9d0 2023-11-28T16:59:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f2ac7640 1 -- 172.21.15.26:0/969102330 >> v2:172.21.15.79:3300/0 conn(0x7f52ec070b80 msgr2=0x7f52ec151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f2ac7640 1 --2- 172.21.15.26:0/969102330 >> v2:172.21.15.79:3300/0 conn(0x7f52ec070b80 0x7f52ec151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f2ac7640 1 -- 172.21.15.26:0/969102330 >> v1:172.21.15.26:6789/0 conn(0x7f52ec14e9d0 legacy=0x7f52ec0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.156+0000 7f52f2ac7640 1 -- 172.21.15.26:0/969102330 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec072450 con 0x7f52ec0a8470 2023-11-28T16:59:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f2ac7640 1 --2- 172.21.15.26:0/969102330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0a8470 0x7f52ec06d7b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f52ec06e420 tx=0x7f52e401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6016b24be3cdd721 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f12c4640 1 -- 172.21.15.26:0/969102330 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40a5850 con 0x7f52ec0a8470 2023-11-28T16:59:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f12c4640 1 -- 172.21.15.26:0/969102330 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e40a59b0 con 0x7f52ec0a8470 2023-11-28T16:59:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f12c4640 1 -- 172.21.15.26:0/969102330 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40a5d40 con 0x7f52ec0a8470 2023-11-28T16:59:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 -- 172.21.15.26:0/969102330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0a8470 msgr2=0x7f52ec06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 --2- 172.21.15.26:0/969102330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0a8470 0x7f52ec06d7b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f52ec06e420 tx=0x7f52e401c880 comp rx=0 tx=0).stop 2023-11-28T16:59:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 -- 172.21.15.26:0/969102330 shutdown_connections 2023-11-28T16:59:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 --2- 172.21.15.26:0/969102330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0a8470 0x7f52ec06d7b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 --2- 172.21.15.26:0/969102330 >> v2:172.21.15.79:3300/0 conn(0x7f52ec070b80 0x7f52ec151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 -- 172.21.15.26:0/969102330 >> 172.21.15.26:0/969102330 conn(0x7f52ec0c2ad0 msgr2=0x7f52ec0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:55.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 -- 172.21.15.26:0/969102330 shutdown_connections 2023-11-28T16:59:55.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.160+0000 7f52f452a640 1 -- 172.21.15.26:0/969102330 wait complete. 2023-11-28T16:59:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 Processor -- start 2023-11-28T16:59:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 -- start start 2023-11-28T16:59:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52ec070b80 0x7f52ec0c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec0a8470 0x7f52ec0c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec14e9d0 0x7f52ec14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec13aae0 con 0x7f52ec14e9d0 2023-11-28T16:59:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec14d290 con 0x7f52ec0a8470 2023-11-28T16:59:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1eb810 con 0x7f52ec070b80 2023-11-28T16:59:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec14e9d0 0x7f52ec14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec14e9d0 0x7f52ec14d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56898/0 (socket says 172.21.15.26:56898) 2023-11-28T16:59:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 -- 172.21.15.26:0/3696104773 learned_addr learned my addr 172.21.15.26:0/3696104773 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f1ac5640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec0a8470 0x7f52ec0c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f22c6640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52ec070b80 0x7f52ec0c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 -- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52ec070b80 msgr2=0x7f52ec0c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52ec070b80 0x7f52ec0c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 -- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec0a8470 msgr2=0x7f52ec0c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec0a8470 0x7f52ec0c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 -- 172.21.15.26:0/3696104773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4009a70 con 0x7f52ec14e9d0 2023-11-28T16:59:55.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f1ac5640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec0a8470 0x7f52ec0c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:55.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f2ac7640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec14e9d0 0x7f52ec14d720 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f52e40b0040 tx=0x7f52e4019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52e2ffd640 1 -- 172.21.15.26:0/3696104773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40ad850 con 0x7f52ec14e9d0 2023-11-28T16:59:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52e2ffd640 1 -- 172.21.15.26:0/3696104773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e40ad9b0 con 0x7f52ec14e9d0 2023-11-28T16:59:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52e2ffd640 1 -- 172.21.15.26:0/3696104773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40adda0 con 0x7f52ec14e9d0 2023-11-28T16:59:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec1ebaf0 con 0x7f52ec14e9d0 2023-11-28T16:59:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec139cb0 con 0x7f52ec14e9d0 2023-11-28T16:59:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.164+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec14d060 con 0x7f52ec14e9d0 2023-11-28T16:59:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.168+0000 7f52e2ffd640 1 -- 172.21.15.26:0/3696104773 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f52e40b4050 con 0x7f52ec14e9d0 2023-11-28T16:59:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.168+0000 7f52e2ffd640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f52d00668d0 0x7f52d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.168+0000 7f52e2ffd640 1 -- 172.21.15.26:0/3696104773 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f52e411eff0 con 0x7f52ec14e9d0 2023-11-28T16:59:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.168+0000 7f52f22c6640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f52d00668d0 0x7f52d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.168+0000 7f52f22c6640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f52d00668d0 0x7f52d0068d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f52e80011f0 tx=0x7f52e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.172+0000 7f52e2ffd640 1 -- 172.21.15.26:0/3696104773 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52ec14d060 con 0x7f52ec14e9d0 2023-11-28T16:59:55.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f52ec15ba50 con 0x7f52d00668d0 2023-11-28T16:59:55.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52e2ffd640 1 -- 172.21.15.26:0/3696104773 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f52ec15ba50 con 0x7f52d00668d0 2023-11-28T16:59:55.334 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T16:59:55.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f52d00668d0 msgr2=0x7f52d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f52d00668d0 0x7f52d0068d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f52e80011f0 tx=0x7f52e8009040 comp rx=0 tx=0).stop 2023-11-28T16:59:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec14e9d0 msgr2=0x7f52ec14d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec14e9d0 0x7f52ec14d720 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f52e40b0040 tx=0x7f52e4019620 comp rx=0 tx=0).stop 2023-11-28T16:59:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 shutdown_connections 2023-11-28T16:59:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec14e9d0 0x7f52ec14d720 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec0a8470 0x7f52ec0c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f52d00668d0 0x7f52d0068d90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 --2- 172.21.15.26:0/3696104773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52ec070b80 0x7f52ec0c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 >> 172.21.15.26:0/3696104773 conn(0x7f52ec0c2ad0 msgr2=0x7f52ec070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:55.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 shutdown_connections 2023-11-28T16:59:55.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.332+0000 7f52f452a640 1 -- 172.21.15.26:0/3696104773 wait complete. 2023-11-28T16:59:55.355 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T16:59:55.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8bbc9a640 1 Processor -- start 2023-11-28T16:59:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8bbc9a640 1 -- start start 2023-11-28T16:59:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8bbc9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8b40a5ff0 0x7fd8b40c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8bbc9a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b406e2d0 con 0x7fd8b40c0d30 2023-11-28T16:59:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8bbc9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b40c5de0 con 0x7fd8b406db60 2023-11-28T16:59:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8bbc9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b40a63d0 con 0x7fd8b40a5ff0 2023-11-28T16:59:55.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8b9235640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd8b40c0d30 0x7fd8b40c4a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52116/0 (socket says 172.21.15.26:52116) 2023-11-28T16:59:55.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8b9235640 1 -- 172.21.15.26:0/2379588546 learned_addr learned my addr 172.21.15.26:0/2379588546 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:55.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8b9a36640 1 --2- 172.21.15.26:0/2379588546 >> v2:172.21.15.79:3300/0 conn(0x7fd8b40a5ff0 0x7fd8b40c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8b9a36640 1 -- 172.21.15.26:0/2379588546 >> v1:172.21.15.79:6789/0 conn(0x7fd8b406db60 legacy=0x7fd8b40c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8b8a34640 1 -- 172.21.15.26:0/2379588546 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088630341 0 0) 0x7fd8b406e2d0 con 0x7fd8b40c0d30 2023-11-28T16:59:55.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8b9a36640 1 -- 172.21.15.26:0/2379588546 >> v1:172.21.15.26:6789/0 conn(0x7fd8b40c0d30 legacy=0x7fd8b40c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.500+0000 7fd8b9a36640 1 -- 172.21.15.26:0/2379588546 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40c6050 con 0x7fd8b40a5ff0 2023-11-28T16:59:55.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8b9a36640 1 --2- 172.21.15.26:0/2379588546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 0x7fd8b40c2720 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097c0 tx=0x7fd8b001e5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=936ed1b8535c6b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8b8a34640 1 -- 172.21.15.26:0/2379588546 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00ad670 con 0x7fd8b40a5ff0 2023-11-28T16:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8b8a34640 1 -- 172.21.15.26:0/2379588546 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b00ad7d0 con 0x7fd8b40a5ff0 2023-11-28T16:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8b8a34640 1 -- 172.21.15.26:0/2379588546 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00adb60 con 0x7fd8b40a5ff0 2023-11-28T16:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/2379588546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 msgr2=0x7fd8b40c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8bbc9a640 1 --2- 172.21.15.26:0/2379588546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 0x7fd8b40c2720 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097c0 tx=0x7fd8b001e5d0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/2379588546 shutdown_connections 2023-11-28T16:59:55.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8bbc9a640 1 --2- 172.21.15.26:0/2379588546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 0x7fd8b40c2720 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/2379588546 >> 172.21.15.26:0/2379588546 conn(0x7fd8b40a8640 msgr2=0x7fd8b40a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/2379588546 shutdown_connections 2023-11-28T16:59:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.504+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/2379588546 wait complete. 2023-11-28T16:59:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 Processor -- start 2023-11-28T16:59:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 -- start start 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8b406db60 0x7fd8b40bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 0x7fd8b41f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8b40c0d30 0x7fd8b41f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b41f0100 con 0x7fd8b406db60 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b415b8a0 con 0x7fd8b40a5ff0 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40a72b0 con 0x7fd8b40c0d30 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8b406db60 0x7fd8b40bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8b406db60 0x7fd8b40bff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56904/0 (socket says 172.21.15.26:56904) 2023-11-28T16:59:55.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 -- 172.21.15.26:0/887911772 learned_addr learned my addr 172.21.15.26:0/887911772 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:55.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9235640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 0x7fd8b41f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8ba237640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8b40c0d30 0x7fd8b41f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 -- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8b40c0d30 msgr2=0x7fd8b41f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8b40c0d30 0x7fd8b41f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 -- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 msgr2=0x7fd8b41f0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 0x7fd8b41f0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 -- 172.21.15.26:0/887911772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0009420 con 0x7fd8b406db60 2023-11-28T16:59:55.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9235640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b40a5ff0 0x7fd8b41f0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:55.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8b9a36640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8b406db60 0x7fd8b40bff20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00af040 tx=0x7fd8b001ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00b6620 con 0x7fd8b406db60 2023-11-28T16:59:55.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b00b6780 con 0x7fd8b406db60 2023-11-28T16:59:55.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b414f320 con 0x7fd8b406db60 2023-11-28T16:59:55.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00b6b30 con 0x7fd8b406db60 2023-11-28T16:59:55.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.508+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b414f600 con 0x7fd8b406db60 2023-11-28T16:59:55.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8b415e570 con 0x7fd8b406db60 2023-11-28T16:59:55.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd8b00b6c90 con 0x7fd8b406db60 2023-11-28T16:59:55.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8aa7fc640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd8980668d0 0x7fd898068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd8b011f290 con 0x7fd8b406db60 2023-11-28T16:59:55.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8aa7fc640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7fd89806c7d0 0x7fd89806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 --> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd89806f2a0 con 0x7fd89806c7d0 2023-11-28T16:59:55.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b011f600 con 0x7fd8b406db60 2023-11-28T16:59:55.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8b9235640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd8980668d0 0x7fd898068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8ba237640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7fd89806c7d0 0x7fd89806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8ba237640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7fd89806c7d0 0x7fd89806ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8b9235640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd8980668d0 0x7fd898068d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40a8e00 tx=0x7fd8a4007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.512+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== osd.3 v2:172.21.15.26:6809/3338490031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd89806f2a0 con 0x7fd89806c7d0 2023-11-28T16:59:55.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 --> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd8b41f0240 con 0x7fd89806c7d0 2023-11-28T16:59:55.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8aa7fc640 1 -- 172.21.15.26:0/887911772 <== osd.3 v2:172.21.15.26:6809/3338490031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd8b41f0240 con 0x7fd89806c7d0 2023-11-28T16:59:55.531 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:55.532 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:55.532 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:55.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7fd89806c7d0 msgr2=0x7fd89806ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:6809/3338490031,v1:172.21.15.26:6811/3338490031] conn(0x7fd89806c7d0 0x7fd89806ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd8980668d0 msgr2=0x7fd898068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fd8980668d0 0x7fd898068d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40a8e00 tx=0x7fd8a4007c60 comp rx=0 tx=0).stop 2023-11-28T16:59:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8b406db60 msgr2=0x7fd8b40bff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 --2- 172.21.15.26:0/887911772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8b406db60 0x7fd8b40bff20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00af040 tx=0x7fd8b001ce10 comp rx=0 tx=0).stop 2023-11-28T16:59:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8ba237640 1 -- 172.21.15.26:0/887911772 reap_dead start 2023-11-28T16:59:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 shutdown_connections 2023-11-28T16:59:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 >> 172.21.15.26:0/887911772 conn(0x7fd8b40a8640 msgr2=0x7fd8b40c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 shutdown_connections 2023-11-28T16:59:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.528+0000 7fd8bbc9a640 1 -- 172.21.15.26:0/887911772 wait complete. 2023-11-28T16:59:55.549 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T16:59:55.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc78780640 1 Processor -- start 2023-11-28T16:59:55.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc78780640 1 -- start start 2023-11-28T16:59:55.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc78780640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc70070b80 0x7efc70151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc78780640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7006d320 con 0x7efc7014e9d0 2023-11-28T16:59:55.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc78780640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc700721b0 con 0x7efc700a8470 2023-11-28T16:59:55.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc78780640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc700c2830 con 0x7efc70070b80 2023-11-28T16:59:55.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7651c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efc7014e9d0 0x7efc700c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52122/0 (socket says 172.21.15.26:52122) 2023-11-28T16:59:55.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7651c640 1 -- 172.21.15.26:0/3406090900 learned_addr learned my addr 172.21.15.26:0/3406090900 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:55.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3406090900 >> v2:172.21.15.79:3300/0 conn(0x7efc70070b80 0x7efc70151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954130775 0 0) 0x7efc7006d320 con 0x7efc7014e9d0 2023-11-28T16:59:55.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc5c003530 con 0x7efc7014e9d0 2023-11-28T16:59:55.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1457183434 0 0) 0x7efc5c003530 con 0x7efc7014e9d0 2023-11-28T16:59:55.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 >> v2:172.21.15.79:3300/0 conn(0x7efc70070b80 msgr2=0x7efc70151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:55.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 --2- 172.21.15.26:0/3406090900 >> v2:172.21.15.79:3300/0 conn(0x7efc70070b80 0x7efc70151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 >> v1:172.21.15.79:6789/0 conn(0x7efc700a8470 legacy=0x7efc7006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70072450 con 0x7efc7014e9d0 2023-11-28T16:59:55.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7efc6c001680 con 0x7efc7014e9d0 2023-11-28T16:59:55.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 >> v1:172.21.15.26:6789/0 conn(0x7efc7014e9d0 legacy=0x7efc700c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c003980 0x7efc5c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c005190 0x7efc5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc700c2830 con 0x7efc5c0047d0 2023-11-28T16:59:55.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c00c090 con 0x7efc5c003980 2023-11-28T16:59:55.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c00c250 con 0x7efc5c005190 2023-11-28T16:59:55.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc7651c640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c003980 0x7efc5c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc76d1d640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c005190 0x7efc5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc75d1b640 1 -- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c005190 msgr2=0x7efc5c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:55.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c005190 0x7efc5c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc75d1b640 1 -- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c003980 msgr2=0x7efc5c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:55.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c003980 0x7efc5c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc75d1b640 1 -- 172.21.15.26:0/3406090900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c003530 con 0x7efc5c0047d0 2023-11-28T16:59:55.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.692+0000 7efc76d1d640 1 -- 172.21.15.26:0/3406090900 reap_dead start 2023-11-28T16:59:55.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7efc60009ab0 tx=0x7efc6001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d0da3d8e0fe9ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600a5620 con 0x7efc5c0047d0 2023-11-28T16:59:55.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600a5780 con 0x7efc5c0047d0 2023-11-28T16:59:55.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc7551a640 1 -- 172.21.15.26:0/3406090900 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600a5b30 con 0x7efc5c0047d0 2023-11-28T16:59:55.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc78780640 1 -- 172.21.15.26:0/3406090900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5c0047d0 msgr2=0x7efc5c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc78780640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7efc60009ab0 tx=0x7efc6001ca30 comp rx=0 tx=0).stop 2023-11-28T16:59:55.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc78780640 1 -- 172.21.15.26:0/3406090900 shutdown_connections 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc78780640 1 --2- 172.21.15.26:0/3406090900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc78780640 1 -- 172.21.15.26:0/3406090900 >> 172.21.15.26:0/3406090900 conn(0x7efc700c2ad0 msgr2=0x7efc700c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc78780640 1 -- 172.21.15.26:0/3406090900 shutdown_connections 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.696+0000 7efc78780640 1 -- 172.21.15.26:0/3406090900 wait complete. 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 Processor -- start 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 -- start start 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c0047d0 0x7efc7014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7014ab70 0x7efc70154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc701552f0 0x7efc70145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70149070 con 0x7efc7014ab70 2023-11-28T16:59:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70148030 con 0x7efc701552f0 2023-11-28T16:59:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc701497e0 con 0x7efc5c0047d0 2023-11-28T16:59:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7014ab70 0x7efc70154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7014ab70 0x7efc70154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56910/0 (socket says 172.21.15.26:56910) 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 -- 172.21.15.26:0/3502188157 learned_addr learned my addr 172.21.15.26:0/3502188157 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc76d1d640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc701552f0 0x7efc70145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc7651c640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c0047d0 0x7efc7014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 -- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c0047d0 msgr2=0x7efc7014a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c0047d0 0x7efc7014a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 -- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc701552f0 msgr2=0x7efc70145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc701552f0 0x7efc70145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 -- 172.21.15.26:0/3502188157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc701530d0 con 0x7efc7014ab70 2023-11-28T16:59:55.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc7651c640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c0047d0 0x7efc7014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:55.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc76d1d640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc701552f0 0x7efc70145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:55.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc75d1b640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7014ab70 0x7efc70154db0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7efc6001c860 tx=0x7efc600197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc66ffd640 1 -- 172.21.15.26:0/3502188157 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60004020 con 0x7efc7014ab70 2023-11-28T16:59:55.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc66ffd640 1 -- 172.21.15.26:0/3502188157 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600041a0 con 0x7efc7014ab70 2023-11-28T16:59:55.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc66ffd640 1 -- 172.21.15.26:0/3502188157 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600b8660 con 0x7efc7014ab70 2023-11-28T16:59:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc701533b0 con 0x7efc7014ab70 2023-11-28T16:59:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.700+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7014aff0 con 0x7efc7014ab70 2023-11-28T16:59:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.704+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc70067a40 con 0x7efc7014ab70 2023-11-28T16:59:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.704+0000 7efc66ffd640 1 -- 172.21.15.26:0/3502188157 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efc600b4070 con 0x7efc7014ab70 2023-11-28T16:59:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.704+0000 7efc66ffd640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efc54066900 0x7efc54068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.704+0000 7efc66ffd640 1 -- 172.21.15.26:0/3502188157 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efc6011ecb0 con 0x7efc7014ab70 2023-11-28T16:59:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.704+0000 7efc7651c640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efc54066900 0x7efc54068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.704+0000 7efc7651c640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efc54066900 0x7efc54068dc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efc6c007bb0 tx=0x7efc6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.708+0000 7efc66ffd640 1 -- 172.21.15.26:0/3502188157 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc600ec180 con 0x7efc7014ab70 2023-11-28T16:59:55.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.868+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7efc7014edb0 con 0x7efc54066900 2023-11-28T16:59:55.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.868+0000 7efc66ffd640 1 -- 172.21.15.26:0/3502188157 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efc6c007030 con 0x7efc54066900 2023-11-28T16:59:55.872 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T16:59:55.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efc54066900 msgr2=0x7efc54068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efc54066900 0x7efc54068dc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efc6c007bb0 tx=0x7efc6c009040 comp rx=0 tx=0).stop 2023-11-28T16:59:55.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7014ab70 msgr2=0x7efc70154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7014ab70 0x7efc70154db0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7efc6001c860 tx=0x7efc600197d0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 shutdown_connections 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc701552f0 0x7efc70145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7014ab70 0x7efc70154db0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7efc54066900 0x7efc54068dc0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 --2- 172.21.15.26:0/3502188157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc5c0047d0 0x7efc7014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 >> 172.21.15.26:0/3502188157 conn(0x7efc700c2ad0 msgr2=0x7efc7006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:55.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 shutdown_connections 2023-11-28T16:59:55.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:55.872+0000 7efc78780640 1 -- 172.21.15.26:0/3502188157 wait complete. 2023-11-28T16:59:55.893 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T16:59:55.894 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.036+0000 7fe1211d8640 1 Processor -- start 2023-11-28T16:59:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.036+0000 7fe1211d8640 1 -- start start 2023-11-28T16:59:56.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe1211d8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe11c154ea0 0x7fe11c155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe1211d8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c1559d0 con 0x7fe11c070260 2023-11-28T16:59:56.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe1211d8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c06d910 con 0x7fe11c06b0c0 2023-11-28T16:59:56.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe1211d8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c1557c0 con 0x7fe11c154ea0 2023-11-28T16:59:56.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe11b59e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe11c070260 0x7fe11c0706d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52138/0 (socket says 172.21.15.26:52138) 2023-11-28T16:59:56.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe11b59e640 1 -- 172.21.15.26:0/2165742380 learned_addr learned my addr 172.21.15.26:0/2165742380 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:56.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe11ad9d640 1 --2- 172.21.15.26:0/2165742380 >> v2:172.21.15.79:3300/0 conn(0x7fe11c154ea0 0x7fe11c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe11ad9d640 1 -- 172.21.15.26:0/2165742380 >> v1:172.21.15.79:6789/0 conn(0x7fe11c06b0c0 legacy=0x7fe11c14e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:56.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe11a59c640 1 -- 172.21.15.26:0/2165742380 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235571939 0 0) 0x7fe11c1559d0 con 0x7fe11c070260 2023-11-28T16:59:56.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe11ad9d640 1 -- 172.21.15.26:0/2165742380 >> v1:172.21.15.26:6789/0 conn(0x7fe11c070260 legacy=0x7fe11c0706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.040+0000 7fe11ad9d640 1 -- 172.21.15.26:0/2165742380 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0c1230 con 0x7fe11c154ea0 2023-11-28T16:59:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe11ad9d640 1 --2- 172.21.15.26:0/2165742380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c154ea0 0x7fe11c155280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0097c0 tx=0x7fe10c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de066c7e77638c4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe11a59c640 1 -- 172.21.15.26:0/2165742380 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0ad680 con 0x7fe11c154ea0 2023-11-28T16:59:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe11a59c640 1 -- 172.21.15.26:0/2165742380 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c0ad7e0 con 0x7fe11c154ea0 2023-11-28T16:59:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe11a59c640 1 -- 172.21.15.26:0/2165742380 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0adb70 con 0x7fe11c154ea0 2023-11-28T16:59:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 -- 172.21.15.26:0/2165742380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c154ea0 msgr2=0x7fe11c155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 --2- 172.21.15.26:0/2165742380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c154ea0 0x7fe11c155280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0097c0 tx=0x7fe10c01c380 comp rx=0 tx=0).stop 2023-11-28T16:59:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 -- 172.21.15.26:0/2165742380 shutdown_connections 2023-11-28T16:59:56.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 --2- 172.21.15.26:0/2165742380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c154ea0 0x7fe11c155280 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 -- 172.21.15.26:0/2165742380 >> 172.21.15.26:0/2165742380 conn(0x7fe11c06a5a0 msgr2=0x7fe11c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 -- 172.21.15.26:0/2165742380 shutdown_connections 2023-11-28T16:59:56.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 -- 172.21.15.26:0/2165742380 wait complete. 2023-11-28T16:59:56.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 Processor -- start 2023-11-28T16:59:56.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.044+0000 7fe1211d8640 1 -- start start 2023-11-28T16:59:56.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe11c06b0c0 0x7fe11c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c070260 0x7fe11c0c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe11c154ea0 0x7fe11c1f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1543f0 con 0x7fe11c06b0c0 2023-11-28T16:59:56.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c154880 con 0x7fe11c070260 2023-11-28T16:59:56.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1545e0 con 0x7fe11c154ea0 2023-11-28T16:59:56.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe11c06b0c0 0x7fe11c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe11c06b0c0 0x7fe11c15c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56920/0 (socket says 172.21.15.26:56920) 2023-11-28T16:59:56.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 -- 172.21.15.26:0/1164152683 learned_addr learned my addr 172.21.15.26:0/1164152683 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:56.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11b59e640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe11c154ea0 0x7fe11c1f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe113fff640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c070260 0x7fe11c0c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 -- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe11c154ea0 msgr2=0x7fe11c1f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe11c154ea0 0x7fe11c1f01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 -- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c070260 msgr2=0x7fe11c0c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c070260 0x7fe11c0c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 -- 172.21.15.26:0/1164152683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009420 con 0x7fe11c06b0c0 2023-11-28T16:59:56.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe11ad9d640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe11c06b0c0 0x7fe11c15c550 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe10c019fb0 tx=0x7fe10c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0adea0 con 0x7fe11c06b0c0 2023-11-28T16:59:56.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c0b8420 con 0x7fe11c06b0c0 2023-11-28T16:59:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c0c5940 con 0x7fe11c06b0c0 2023-11-28T16:59:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0b87f0 con 0x7fe11c06b0c0 2023-11-28T16:59:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0c1b60 con 0x7fe11c06b0c0 2023-11-28T16:59:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe11c06c220 con 0x7fe11c06b0c0 2023-11-28T16:59:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.048+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe10c0b4040 con 0x7fe11c06b0c0 2023-11-28T16:59:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe1137fe640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0fc0668d0 0x7fe0fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe10c11e740 con 0x7fe11c06b0c0 2023-11-28T16:59:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe1137fe640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7fe0fc06c7d0 0x7fe0fc06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 --> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0fc06f2a0 con 0x7fe0fc06c7d0 2023-11-28T16:59:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe10c120d20 con 0x7fe11c06b0c0 2023-11-28T16:59:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe113fff640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0fc0668d0 0x7fe0fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe11b59e640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7fe0fc06c7d0 0x7fe0fc06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe113fff640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0fc0668d0 0x7fe0fc068d90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe11c14e3a0 tx=0x7fe104007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe11b59e640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7fe0fc06c7d0 0x7fe0fc06ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.052+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== osd.4 v2:172.21.15.79:6808/3750285918 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe0fc06f2a0 con 0x7fe0fc06c7d0 2023-11-28T16:59:56.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 --> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe11c06dda0 con 0x7fe0fc06c7d0 2023-11-28T16:59:56.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1137fe640 1 -- 172.21.15.26:0/1164152683 <== osd.4 v2:172.21.15.79:6808/3750285918 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe114004e10 con 0x7fe0fc06c7d0 2023-11-28T16:59:56.071 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:56.071 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:56.071 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:56.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7fe0fc06c7d0 msgr2=0x7fe0fc06ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6808/3750285918,v1:172.21.15.79:6809/3750285918] conn(0x7fe0fc06c7d0 0x7fe0fc06ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0fc0668d0 msgr2=0x7fe0fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fe0fc0668d0 0x7fe0fc068d90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe11c14e3a0 tx=0x7fe104007e40 comp rx=0 tx=0).stop 2023-11-28T16:59:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe11c06b0c0 msgr2=0x7fe11c15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 --2- 172.21.15.26:0/1164152683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe11c06b0c0 0x7fe11c15c550 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe10c019fb0 tx=0x7fe10c01abc0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe11b59e640 1 -- 172.21.15.26:0/1164152683 reap_dead start 2023-11-28T16:59:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 shutdown_connections 2023-11-28T16:59:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 >> 172.21.15.26:0/1164152683 conn(0x7fe11c06a5a0 msgr2=0x7fe11c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 shutdown_connections 2023-11-28T16:59:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.068+0000 7fe1211d8640 1 -- 172.21.15.26:0/1164152683 wait complete. 2023-11-28T16:59:56.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T16:59:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.228+0000 7f8cabb55640 1 Processor -- start 2023-11-28T16:59:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.228+0000 7f8cabb55640 1 -- start start 2023-11-28T16:59:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8cabb55640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ca406a5a0 0x7f8ca40c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8cabb55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca406a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8cabb55640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca41551d0 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8cabb55640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca406e9c0 con 0x7f8ca406a5a0 2023-11-28T16:59:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8cabb55640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40a86e0 con 0x7f8ca40c0c20 2023-11-28T16:59:56.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca90f0640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8ca40c1ae0 0x7f8ca40c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52152/0 (socket says 172.21.15.26:52152) 2023-11-28T16:59:56.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca90f0640 1 -- 172.21.15.26:0/966912892 learned_addr learned my addr 172.21.15.26:0/966912892 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:56.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca98f1640 1 --2- 172.21.15.26:0/966912892 >> v2:172.21.15.79:3300/0 conn(0x7f8ca406a5a0 0x7f8ca40c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8caa0f2640 1 --2- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca406a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca88ef640 1 -- 172.21.15.26:0/966912892 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783827744 0 0) 0x7f8ca41551d0 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca88ef640 1 -- 172.21.15.26:0/966912892 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c90003530 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca98f1640 1 -- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 msgr2=0x7f8ca406a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca98f1640 1 --2- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca406a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca98f1640 1 -- 172.21.15.26:0/966912892 >> v1:172.21.15.26:6789/0 conn(0x7f8ca40c1ae0 legacy=0x7f8ca40c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.232+0000 7f8ca98f1640 1 -- 172.21.15.26:0/966912892 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4072840 con 0x7f8ca406a5a0 2023-11-28T16:59:56.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8ca98f1640 1 --2- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40c3490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00097c0 tx=0x7f8ca001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc4f671fb0deee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8ca88ef640 1 -- 172.21.15.26:0/966912892 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00ab600 con 0x7f8ca406a5a0 2023-11-28T16:59:56.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8ca88ef640 1 -- 172.21.15.26:0/966912892 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca00a7050 con 0x7f8ca406a5a0 2023-11-28T16:59:56.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8ca88ef640 1 -- 172.21.15.26:0/966912892 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00ab980 con 0x7f8ca406a5a0 2023-11-28T16:59:56.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 -- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 msgr2=0x7f8ca40c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 --2- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40c3490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00097c0 tx=0x7f8ca001c480 comp rx=0 tx=0).stop 2023-11-28T16:59:56.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 -- 172.21.15.26:0/966912892 shutdown_connections 2023-11-28T16:59:56.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 --2- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca406a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 --2- 172.21.15.26:0/966912892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40c3490 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 -- 172.21.15.26:0/966912892 >> 172.21.15.26:0/966912892 conn(0x7f8ca40c3be0 msgr2=0x7f8ca40c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 -- 172.21.15.26:0/966912892 shutdown_connections 2023-11-28T16:59:56.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 -- 172.21.15.26:0/966912892 wait complete. 2023-11-28T16:59:56.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 Processor -- start 2023-11-28T16:59:56.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.236+0000 7f8cabb55640 1 -- start start 2023-11-28T16:59:56.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca41f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ca40c1ae0 0x7f8ca41f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41f0c10 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41ed620 con 0x7f8ca406a5a0 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca4156d50 con 0x7f8ca40c0c20 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ca40c1ae0 0x7f8ca41f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ca40c1ae0 0x7f8ca41f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56926/0 (socket says 172.21.15.26:56926) 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 -- 172.21.15.26:0/1012156683 learned_addr learned my addr 172.21.15.26:0/1012156683 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:56.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8ca98f1640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8ca90f0640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca41f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 -- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 msgr2=0x7f8ca41f0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca41f0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 -- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 msgr2=0x7f8ca40a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 -- 172.21.15.26:0/1012156683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0009420 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8ca98f1640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8ca90f0640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca41f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8caa0f2640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ca40c1ae0 0x7f8ca41f06d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009dd0 tx=0x7f8c9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8c9a7fc640 1 -- 172.21.15.26:0/1012156683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c014480 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8c9a7fc640 1 -- 172.21.15.26:0/1012156683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c00f040 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8c9a7fc640 1 -- 172.21.15.26:0/1012156683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c014840 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca41edb50 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca41ed870 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca4155640 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.240+0000 7f8c9a7fc640 1 -- 172.21.15.26:0/1012156683 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8c9c0149a0 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.244+0000 7f8c9a7fc640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8c880668d0 0x7f8c88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.244+0000 7f8c9a7fc640 1 -- 172.21.15.26:0/1012156683 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8c9c084d40 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.244+0000 7f8ca98f1640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8c880668d0 0x7f8c88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.244+0000 7f8ca98f1640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8c880668d0 0x7f8c88068d90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00ad000 tx=0x7f8ca0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.248+0000 7f8c9a7fc640 1 -- 172.21.15.26:0/1012156683 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ca4155640 con 0x7f8ca40c1ae0 2023-11-28T16:59:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ca406aec0 con 0x7f8c880668d0 2023-11-28T16:59:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8c9a7fc640 1 -- 172.21.15.26:0/1012156683 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8ca00ab7a0 con 0x7f8c880668d0 2023-11-28T16:59:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T16:59:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8c880668d0 msgr2=0x7f8c88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8c880668d0 0x7f8c88068d90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00ad000 tx=0x7f8ca0008040 comp rx=0 tx=0).stop 2023-11-28T16:59:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ca40c1ae0 msgr2=0x7f8ca41f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ca40c1ae0 0x7f8ca41f06d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009dd0 tx=0x7f8c9c00c490 comp rx=0 tx=0).stop 2023-11-28T16:59:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 shutdown_connections 2023-11-28T16:59:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ca40c1ae0 0x7f8ca41f06d0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f8c880668d0 0x7f8c88068d90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ca40c0c20 0x7f8ca41f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 --2- 172.21.15.26:0/1012156683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca406a5a0 0x7f8ca40a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 >> 172.21.15.26:0/1012156683 conn(0x7f8ca40c3be0 msgr2=0x7f8ca4153560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 shutdown_connections 2023-11-28T16:59:56.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.404+0000 7f8cabb55640 1 -- 172.21.15.26:0/1012156683 wait complete. 2023-11-28T16:59:56.429 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T16:59:56.429 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:56.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 Processor -- start 2023-11-28T16:59:56.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 -- start start 2023-11-28T16:59:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3a414e390 0x7fa3a40c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a40abde0 0x7fa3a40c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3a40c1940 0x7fa3a41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a414e770 con 0x7fa3a414e390 2023-11-28T16:59:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a406b2e0 con 0x7fa3a40c1940 2023-11-28T16:59:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a8bc3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41518d0 con 0x7fa3a40abde0 2023-11-28T16:59:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3a414e390 0x7fa3a40c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3a414e390 0x7fa3a40c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56938/0 (socket says 172.21.15.26:56938) 2023-11-28T16:59:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 -- 172.21.15.26:0/681732954 learned_addr learned my addr 172.21.15.26:0/681732954 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a1d9b640 1 --2- 172.21.15.26:0/681732954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a40abde0 0x7fa3a40c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a2d9d640 1 --2- 172.21.15.26:0/681732954 >> v2:172.21.15.79:3300/0 conn(0x7fa3a40c1940 0x7fa3a41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 -- 172.21.15.26:0/681732954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a40abde0 msgr2=0x7fa3a40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 --2- 172.21.15.26:0/681732954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a40abde0 0x7fa3a40c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 -- 172.21.15.26:0/681732954 >> v2:172.21.15.79:3300/0 conn(0x7fa3a40c1940 msgr2=0x7fa3a41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 --2- 172.21.15.26:0/681732954 >> v2:172.21.15.79:3300/0 conn(0x7fa3a40c1940 0x7fa3a41545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.576+0000 7fa3a259c640 1 -- 172.21.15.26:0/681732954 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4151bb0 con 0x7fa3a414e390 2023-11-28T16:59:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a259c640 1 --2- 172.21.15.26:0/681732954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a414e390 0x7fa3a40c2610 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4067300 tx=0x7fa39401e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbad790cc51a1695 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a159a640 1 -- 172.21.15.26:0/681732954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a7960 con 0x7fa3a414e390 2023-11-28T16:59:56.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a159a640 1 -- 172.21.15.26:0/681732954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3940a7ac0 con 0x7fa3a414e390 2023-11-28T16:59:56.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a159a640 1 -- 172.21.15.26:0/681732954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a7e50 con 0x7fa3a414e390 2023-11-28T16:59:56.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/681732954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a414e390 msgr2=0x7fa3a40c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 --2- 172.21.15.26:0/681732954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a414e390 0x7fa3a40c2610 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4067300 tx=0x7fa39401e950 comp rx=0 tx=0).stop 2023-11-28T16:59:56.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/681732954 shutdown_connections 2023-11-28T16:59:56.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 --2- 172.21.15.26:0/681732954 >> v2:172.21.15.79:3300/0 conn(0x7fa3a40c1940 0x7fa3a41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 --2- 172.21.15.26:0/681732954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a40abde0 0x7fa3a40c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 --2- 172.21.15.26:0/681732954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a414e390 0x7fa3a40c2610 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/681732954 >> 172.21.15.26:0/681732954 conn(0x7fa3a406a5a0 msgr2=0x7fa3a406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/681732954 shutdown_connections 2023-11-28T16:59:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.580+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/681732954 wait complete. 2023-11-28T16:59:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 Processor -- start 2023-11-28T16:59:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 -- start start 2023-11-28T16:59:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a40abde0 0x7fa3a41e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a40c1940 0x7fa3a41ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a414e390 0x7fa3a40c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41e9360 con 0x7fa3a40c1940 2023-11-28T16:59:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41ed090 con 0x7fa3a40abde0 2023-11-28T16:59:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40aafe0 con 0x7fa3a414e390 2023-11-28T16:59:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a40c1940 0x7fa3a41ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a40c1940 0x7fa3a41ecb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56942/0 (socket says 172.21.15.26:56942) 2023-11-28T16:59:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 -- 172.21.15.26:0/1914656167 learned_addr learned my addr 172.21.15.26:0/1914656167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a259c640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a40abde0 0x7fa3a41e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 -- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a414e390 msgr2=0x7fa3a40c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a2d9d640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a414e390 0x7fa3a40c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a414e390 0x7fa3a40c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 -- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a40abde0 msgr2=0x7fa3a41e97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a40abde0 0x7fa3a41e97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 -- 172.21.15.26:0/1914656167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39400a670 con 0x7fa3a40c1940 2023-11-28T16:59:56.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a259c640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3a40abde0 0x7fa3a41e97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:56.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a2d9d640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3a414e390 0x7fa3a40c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:56.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a1d9b640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a40c1940 0x7fa3a41ecb50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa39800d800 tx=0x7fa39800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980096a0 con 0x7fa3a40c1940 2023-11-28T16:59:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398009800 con 0x7fa3a40c1940 2023-11-28T16:59:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398009b70 con 0x7fa3a40c1940 2023-11-28T16:59:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a41e8d10 con 0x7fa3a40c1940 2023-11-28T16:59:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a40c58c0 con 0x7fa3a40c1940 2023-11-28T16:59:56.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.584+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3a404e890 con 0x7fa3a40c1940 2023-11-28T16:59:56.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa398009cd0 con 0x7fa3a40c1940 2023-11-28T16:59:56.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa392ffd640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa384066900 0x7fa384068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa398084ef0 con 0x7fa3a40c1940 2023-11-28T16:59:56.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa392ffd640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fa38406c800 0x7fa38406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 --> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa38406f2d0 con 0x7fa38406c800 2023-11-28T16:59:56.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa398085260 con 0x7fa3a40c1940 2023-11-28T16:59:56.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa3a259c640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa384066900 0x7fa384068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa3a2d9d640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fa38406c800 0x7fa38406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa3a259c640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa384066900 0x7fa384068dc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b1000 tx=0x7fa3940a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.588+0000 7fa3a2d9d640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fa38406c800 0x7fa38406ec20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.592+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== osd.5 v2:172.21.15.79:6800/1334116605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa38406f2d0 con 0x7fa38406c800 2023-11-28T16:59:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 --> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa3a41e91c0 con 0x7fa38406c800 2023-11-28T16:59:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa392ffd640 1 -- 172.21.15.26:0/1914656167 <== osd.5 v2:172.21.15.79:6800/1334116605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa39c0039a0 con 0x7fa38406c800 2023-11-28T16:59:56.608 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:56.608 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:56.608 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:56.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fa38406c800 msgr2=0x7fa38406ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6800/1334116605,v1:172.21.15.79:6801/1334116605] conn(0x7fa38406c800 0x7fa38406ec20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa384066900 msgr2=0x7fa384068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fa384066900 0x7fa384068dc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b1000 tx=0x7fa3940a9070 comp rx=0 tx=0).stop 2023-11-28T16:59:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a40c1940 msgr2=0x7fa3a41ecb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 --2- 172.21.15.26:0/1914656167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3a40c1940 0x7fa3a41ecb50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa39800d800 tx=0x7fa39800dcc0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a2d9d640 1 -- 172.21.15.26:0/1914656167 reap_dead start 2023-11-28T16:59:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 shutdown_connections 2023-11-28T16:59:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 >> 172.21.15.26:0/1914656167 conn(0x7fa3a406a5a0 msgr2=0x7fa3a414d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 shutdown_connections 2023-11-28T16:59:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.604+0000 7fa3a8bc3640 1 -- 172.21.15.26:0/1914656167 wait complete. 2023-11-28T16:59:56.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T16:59:56.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcecc279640 1 Processor -- start 2023-11-28T16:59:56.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcecc279640 1 -- start start 2023-11-28T16:59:56.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcecc279640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcec4154870 0x7fcec406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcecc279640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40700a0 0x7fcec406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcecc279640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec4072780 con 0x7fcec40aacd0 2023-11-28T16:59:56.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcecc279640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec40ac160 con 0x7fcec4154870 2023-11-28T16:59:56.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcecc279640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec40abe80 con 0x7fcec40700a0 2023-11-28T16:59:56.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcec9814640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcec4154870 0x7fcec406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fceca015640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcec40aacd0 0x7fcec4154160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52156/0 (socket says 172.21.15.26:52156) 2023-11-28T16:59:56.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fceca015640 1 -- 172.21.15.26:0/2520206931 learned_addr learned my addr 172.21.15.26:0/2520206931 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:56.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fceca816640 1 --2- 172.21.15.26:0/2520206931 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40700a0 0x7fcec406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcec9814640 1 -- 172.21.15.26:0/2520206931 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40700a0 msgr2=0x7fcec406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcec9814640 1 --2- 172.21.15.26:0/2520206931 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40700a0 0x7fcec406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcec9814640 1 -- 172.21.15.26:0/2520206931 >> v1:172.21.15.26:6789/0 conn(0x7fcec40aacd0 legacy=0x7fcec4154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.768+0000 7fcec9814640 1 -- 172.21.15.26:0/2520206931 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec4154cf0 con 0x7fcec4154870 2023-11-28T16:59:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcec9814640 1 --2- 172.21.15.26:0/2520206931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec406c950 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097c0 tx=0x7fceb401d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91075526acb3b0ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcec9013640 1 -- 172.21.15.26:0/2520206931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40ab620 con 0x7fcec4154870 2023-11-28T16:59:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcec9013640 1 -- 172.21.15.26:0/2520206931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb40ab780 con 0x7fcec4154870 2023-11-28T16:59:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcec9013640 1 -- 172.21.15.26:0/2520206931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40abb10 con 0x7fcec4154870 2023-11-28T16:59:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 -- 172.21.15.26:0/2520206931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 msgr2=0x7fcec406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 --2- 172.21.15.26:0/2520206931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec406c950 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097c0 tx=0x7fceb401d4d0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 -- 172.21.15.26:0/2520206931 shutdown_connections 2023-11-28T16:59:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 --2- 172.21.15.26:0/2520206931 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40700a0 0x7fcec406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 --2- 172.21.15.26:0/2520206931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec406c950 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 -- 172.21.15.26:0/2520206931 >> 172.21.15.26:0/2520206931 conn(0x7fcec40c2ad0 msgr2=0x7fcec40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 -- 172.21.15.26:0/2520206931 shutdown_connections 2023-11-28T16:59:56.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.772+0000 7fcecc279640 1 -- 172.21.15.26:0/2520206931 wait complete. 2023-11-28T16:59:56.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 Processor -- start 2023-11-28T16:59:56.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 -- start start 2023-11-28T16:59:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec40700a0 0x7fcec414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40aacd0 0x7fcec4159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec4150bc0 con 0x7fcec4154870 2023-11-28T16:59:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec4156290 con 0x7fcec40700a0 2023-11-28T16:59:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec415a620 con 0x7fcec40aacd0 2023-11-28T16:59:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec415a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56970/0 (socket says 172.21.15.26:56970) 2023-11-28T16:59:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 -- 172.21.15.26:0/1160409226 learned_addr learned my addr 172.21.15.26:0/1160409226 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:56.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca015640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec40700a0 0x7fcec414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcec9814640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40aacd0 0x7fcec4159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 -- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40aacd0 msgr2=0x7fcec4159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40aacd0 0x7fcec4159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 -- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec40700a0 msgr2=0x7fcec414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec40700a0 0x7fcec414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 -- 172.21.15.26:0/1160409226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4009420 con 0x7fcec4154870 2023-11-28T16:59:56.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca015640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec40700a0 0x7fcec414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fceca816640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec415a0e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00efc0 tx=0x7fcebc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcebaffd640 1 -- 172.21.15.26:0/1160409226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc009ba0 con 0x7fcec4154870 2023-11-28T16:59:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcebaffd640 1 -- 172.21.15.26:0/1160409226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc00f040 con 0x7fcec4154870 2023-11-28T16:59:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcebaffd640 1 -- 172.21.15.26:0/1160409226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0146c0 con 0x7fcec4154870 2023-11-28T16:59:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec415b0d0 con 0x7fcec4154870 2023-11-28T16:59:56.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec41f08c0 con 0x7fcec4154870 2023-11-28T16:59:56.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.776+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec404e890 con 0x7fcec4154870 2023-11-28T16:59:56.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.780+0000 7fcebaffd640 1 -- 172.21.15.26:0/1160409226 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcebc014820 con 0x7fcec4154870 2023-11-28T16:59:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.780+0000 7fcebaffd640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcea8066920 0x7fcea8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.780+0000 7fcebaffd640 1 -- 172.21.15.26:0/1160409226 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcebc084e80 con 0x7fcec4154870 2023-11-28T16:59:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.780+0000 7fceca015640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcea8066920 0x7fcea8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:56.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.780+0000 7fceca015640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcea8066920 0x7fcea8068de0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005890 tx=0x7fcec0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:56.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.784+0000 7fcebaffd640 1 -- 172.21.15.26:0/1160409226 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcebc0523d0 con 0x7fcec4154870 2023-11-28T16:59:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcec40ab340 con 0x7fcea8066920 2023-11-28T16:59:56.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcebaffd640 1 -- 172.21.15.26:0/1160409226 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcec0001430 con 0x7fcea8066920 2023-11-28T16:59:56.951 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T16:59:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcea8066920 msgr2=0x7fcea8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcea8066920 0x7fcea8068de0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005890 tx=0x7fcec0009040 comp rx=0 tx=0).stop 2023-11-28T16:59:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 msgr2=0x7fcec415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec415a0e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00efc0 tx=0x7fcebc00c490 comp rx=0 tx=0).stop 2023-11-28T16:59:56.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 shutdown_connections 2023-11-28T16:59:56.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4154870 0x7fcec415a0e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fcea8066920 0x7fcea8068de0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcec40aacd0 0x7fcec4159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 --2- 172.21.15.26:0/1160409226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec40700a0 0x7fcec414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:56.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 >> 172.21.15.26:0/1160409226 conn(0x7fcec40c2ad0 msgr2=0x7fcec4152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:56.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 shutdown_connections 2023-11-28T16:59:56.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:56.948+0000 7fcecc279640 1 -- 172.21.15.26:0/1160409226 wait complete. 2023-11-28T16:59:56.973 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T16:59:56.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:57.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.116+0000 7f95ac49a640 1 Processor -- start 2023-11-28T16:59:57.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.116+0000 7f95ac49a640 1 -- start start 2023-11-28T16:59:57.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95ac49a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95a40a9770 0x7f95a406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95ac49a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95a40c2070 0x7f95a40c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95ac49a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a41569f0 con 0x7f95a4155f00 2023-11-28T16:59:57.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95ac49a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a40abb60 con 0x7f95a40a9770 2023-11-28T16:59:57.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95ac49a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a406c7a0 con 0x7f95a40c2070 2023-11-28T16:59:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95aa236640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f95a4155f00 0x7f95a41562e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52160/0 (socket says 172.21.15.26:52160) 2023-11-28T16:59:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95aa236640 1 -- 172.21.15.26:0/3431434248 learned_addr learned my addr 172.21.15.26:0/3431434248 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95a9a35640 1 --2- 172.21.15.26:0/3431434248 >> v2:172.21.15.26:3300/0 conn(0x7f95a40a9770 0x7f95a406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95aaa37640 1 --2- 172.21.15.26:0/3431434248 >> v2:172.21.15.79:3300/0 conn(0x7f95a40c2070 0x7f95a40c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95a9234640 1 -- 172.21.15.26:0/3431434248 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872775050 0 0) 0x7f95a0001120 con 0x7f95a4155f00 2023-11-28T16:59:57.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95a9234640 1 -- 172.21.15.26:0/3431434248 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9590003530 con 0x7f95a4155f00 2023-11-28T16:59:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95a9a35640 1 -- 172.21.15.26:0/3431434248 >> v2:172.21.15.79:3300/0 conn(0x7f95a40c2070 msgr2=0x7f95a40c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95a9a35640 1 --2- 172.21.15.26:0/3431434248 >> v2:172.21.15.79:3300/0 conn(0x7f95a40c2070 0x7f95a40c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95a9a35640 1 -- 172.21.15.26:0/3431434248 >> v1:172.21.15.26:6789/0 conn(0x7f95a4155f00 legacy=0x7f95a41562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.120+0000 7f95a9a35640 1 -- 172.21.15.26:0/3431434248 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40abdb0 con 0x7f95a40a9770 2023-11-28T16:59:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95a9a35640 1 --2- 172.21.15.26:0/3431434248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40a9770 0x7f95a406cf10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f95940097c0 tx=0x7f959401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09af80359b83ddb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95a9234640 1 -- 172.21.15.26:0/3431434248 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940ab600 con 0x7f95a40a9770 2023-11-28T16:59:57.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95a9234640 1 -- 172.21.15.26:0/3431434248 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95940a7050 con 0x7f95a40a9770 2023-11-28T16:59:57.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95a9234640 1 -- 172.21.15.26:0/3431434248 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940ab980 con 0x7f95a40a9770 2023-11-28T16:59:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 -- 172.21.15.26:0/3431434248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40a9770 msgr2=0x7f95a406cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 --2- 172.21.15.26:0/3431434248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40a9770 0x7f95a406cf10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f95940097c0 tx=0x7f959401c3b0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 -- 172.21.15.26:0/3431434248 shutdown_connections 2023-11-28T16:59:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 --2- 172.21.15.26:0/3431434248 >> v2:172.21.15.79:3300/0 conn(0x7f95a40c2070 0x7f95a40c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 --2- 172.21.15.26:0/3431434248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40a9770 0x7f95a406cf10 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 -- 172.21.15.26:0/3431434248 >> 172.21.15.26:0/3431434248 conn(0x7f95a406a5a0 msgr2=0x7f95a406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 -- 172.21.15.26:0/3431434248 shutdown_connections 2023-11-28T16:59:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 -- 172.21.15.26:0/3431434248 wait complete. 2023-11-28T16:59:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 Processor -- start 2023-11-28T16:59:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.124+0000 7f95ac49a640 1 -- start start 2023-11-28T16:59:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95a40a9770 0x7f95a415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40c2070 0x7f95a4151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a4155f00 0x7f95a4151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40717e0 con 0x7f95a40c2070 2023-11-28T16:59:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a4071220 con 0x7f95a4155f00 2023-11-28T16:59:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40c4810 con 0x7f95a40a9770 2023-11-28T16:59:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40c2070 0x7f95a4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40c2070 0x7f95a4151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56994/0 (socket says 172.21.15.26:56994) 2023-11-28T16:59:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 -- 172.21.15.26:0/1087204351 learned_addr learned my addr 172.21.15.26:0/1087204351 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95aaa37640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a4155f00 0x7f95a4151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95aa236640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95a40a9770 0x7f95a415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 -- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95a40a9770 msgr2=0x7f95a415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95a40a9770 0x7f95a415bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 -- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a4155f00 msgr2=0x7f95a4151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a4155f00 0x7f95a4151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 -- 172.21.15.26:0/1087204351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594009420 con 0x7f95a40c2070 2023-11-28T16:59:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95a9a35640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40c2070 0x7f95a4151050 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f9594019fe0 tx=0x7f9594019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594006e20 con 0x7f95a40c2070 2023-11-28T16:59:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95940b4400 con 0x7f95a40c2070 2023-11-28T16:59:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a40c4af0 con 0x7f95a40c2070 2023-11-28T16:59:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940b47b0 con 0x7f95a40c2070 2023-11-28T16:59:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a40c5de0 con 0x7f95a40c2070 2023-11-28T16:59:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95a40aa690 con 0x7f95a40c2070 2023-11-28T16:59:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.128+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f95940b2040 con 0x7f95a40c2070 2023-11-28T16:59:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f959affd640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95880668d0 0x7f9588068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f959411e8a0 con 0x7f95a40c2070 2023-11-28T16:59:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f959affd640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7f958806c7d0 0x7f958806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 --> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f958806f2a0 con 0x7f958806c7d0 2023-11-28T16:59:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f959411ec10 con 0x7f95a40c2070 2023-11-28T16:59:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f95aa236640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95880668d0 0x7f9588068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f95aaa37640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7f958806c7d0 0x7f958806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f95aa236640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95880668d0 0x7f9588068d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f95a0005890 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f95aaa37640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7f958806c7d0 0x7f958806ebf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.132+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== osd.6 v2:172.21.15.79:6816/179635764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f958806f2a0 con 0x7f958806c7d0 2023-11-28T16:59:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.144+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 --> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95a40c0890 con 0x7f958806c7d0 2023-11-28T16:59:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f959affd640 1 -- 172.21.15.26:0/1087204351 <== osd.6 v2:172.21.15.79:6816/179635764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f959c00f040 con 0x7f958806c7d0 2023-11-28T16:59:57.151 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:57.151 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:57.151 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7f958806c7d0 msgr2=0x7f958806ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6816/179635764,v1:172.21.15.79:6817/179635764] conn(0x7f958806c7d0 0x7f958806ebf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95880668d0 msgr2=0x7f9588068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f95880668d0 0x7f9588068d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f95a0005890 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2023-11-28T16:59:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40c2070 msgr2=0x7f95a4151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 --2- 172.21.15.26:0/1087204351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a40c2070 0x7f95a4151050 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f9594019fe0 tx=0x7f9594019150 comp rx=0 tx=0).stop 2023-11-28T16:59:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95aaa37640 1 -- 172.21.15.26:0/1087204351 reap_dead start 2023-11-28T16:59:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 shutdown_connections 2023-11-28T16:59:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 >> 172.21.15.26:0/1087204351 conn(0x7f95a406a5a0 msgr2=0x7f95a406d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 shutdown_connections 2023-11-28T16:59:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.148+0000 7f95ac49a640 1 -- 172.21.15.26:0/1087204351 wait complete. 2023-11-28T16:59:57.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T16:59:57.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.308+0000 7fb7074ad640 1 Processor -- start 2023-11-28T16:59:57.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.308+0000 7fb7074ad640 1 -- start start 2023-11-28T16:59:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb7074ad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb700152ce0 0x7fb70006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb7074ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70006db80 0x7fb7000700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb7074ad640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70006bea0 con 0x7fb7000705e0 2023-11-28T16:59:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb7074ad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb700159b10 con 0x7fb700152ce0 2023-11-28T16:59:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb7074ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb700159550 con 0x7fb70006db80 2023-11-28T16:59:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb705249640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb700152ce0 0x7fb70006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb705249640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb700152ce0 0x7fb70006c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57002/0 (socket says 172.21.15.26:57002) 2023-11-28T16:59:57.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb705249640 1 -- 172.21.15.26:0/2321782080 learned_addr learned my addr 172.21.15.26:0/2321782080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:57.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb704a48640 1 --2- 172.21.15.26:0/2321782080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70006db80 0x7fb7000700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb705249640 1 -- 172.21.15.26:0/2321782080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70006db80 msgr2=0x7fb7000700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:57.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb705249640 1 --2- 172.21.15.26:0/2321782080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70006db80 0x7fb7000700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb705249640 1 -- 172.21.15.26:0/2321782080 >> v1:172.21.15.79:6789/0 conn(0x7fb7000705e0 legacy=0x7fb7000c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:57.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb705249640 1 -- 172.21.15.26:0/2321782080 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700159830 con 0x7fb700152ce0 2023-11-28T16:59:57.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.312+0000 7fb704a48640 1 --2- 172.21.15.26:0/2321782080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70006db80 0x7fb7000700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:57.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb705249640 1 --2- 172.21.15.26:0/2321782080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb70006c940 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009870 tx=0x7fb6fc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8e02f4a292a4ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb6f7fff640 1 -- 172.21.15.26:0/2321782080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0aa610 con 0x7fb700152ce0 2023-11-28T16:59:57.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb6f7fff640 1 -- 172.21.15.26:0/2321782080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc0a6040 con 0x7fb700152ce0 2023-11-28T16:59:57.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb6f7fff640 1 -- 172.21.15.26:0/2321782080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0aa990 con 0x7fb700152ce0 2023-11-28T16:59:57.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 -- 172.21.15.26:0/2321782080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 msgr2=0x7fb70006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2321782080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb70006c940 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009870 tx=0x7fb6fc01c4b0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 -- 172.21.15.26:0/2321782080 shutdown_connections 2023-11-28T16:59:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2321782080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70006db80 0x7fb7000700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2321782080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb70006c940 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 -- 172.21.15.26:0/2321782080 >> 172.21.15.26:0/2321782080 conn(0x7fb7000c2ad0 msgr2=0x7fb7000c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 -- 172.21.15.26:0/2321782080 shutdown_connections 2023-11-28T16:59:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 -- 172.21.15.26:0/2321782080 wait complete. 2023-11-28T16:59:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 Processor -- start 2023-11-28T16:59:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.316+0000 7fb7074ad640 1 -- start start 2023-11-28T16:59:57.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70006db80 0x7fb700148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7000705e0 0x7fb7001f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb7001f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7001f1640 con 0x7fb700152ce0 2023-11-28T16:59:57.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb700148bd0 con 0x7fb70006db80 2023-11-28T16:59:57.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7001f2550 con 0x7fb7000705e0 2023-11-28T16:59:57.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb7001f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb7001f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57010/0 (socket says 172.21.15.26:57010) 2023-11-28T16:59:57.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 -- 172.21.15.26:0/2820496159 learned_addr learned my addr 172.21.15.26:0/2820496159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:57.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb704a48640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7000705e0 0x7fb7001f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705249640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70006db80 0x7fb700148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 -- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7000705e0 msgr2=0x7fb7001f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7000705e0 0x7fb7001f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 -- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70006db80 msgr2=0x7fb700148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70006db80 0x7fb700148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 -- 172.21.15.26:0/2820496159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc0094d0 con 0x7fb700152ce0 2023-11-28T16:59:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb705a4a640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb7001f4bb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c7a0 tx=0x7fb6f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb6f5ffb640 1 -- 172.21.15.26:0/2820496159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8003b80 con 0x7fb700152ce0 2023-11-28T16:59:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb6f5ffb640 1 -- 172.21.15.26:0/2820496159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8003ce0 con 0x7fb700152ce0 2023-11-28T16:59:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb6f5ffb640 1 -- 172.21.15.26:0/2820496159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800aa30 con 0x7fb700152ce0 2023-11-28T16:59:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7001f1850 con 0x7fb700152ce0 2023-11-28T16:59:57.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7000c5410 con 0x7fb700152ce0 2023-11-28T16:59:57.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70004e890 con 0x7fb700152ce0 2023-11-28T16:59:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.320+0000 7fb6f5ffb640 1 -- 172.21.15.26:0/2820496159 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb6f800ab90 con 0x7fb700152ce0 2023-11-28T16:59:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.324+0000 7fb6f5ffb640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6e40668d0 0x7fb6e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.324+0000 7fb6f5ffb640 1 -- 172.21.15.26:0/2820496159 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb6f8083e00 con 0x7fb700152ce0 2023-11-28T16:59:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.324+0000 7fb705249640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6e40668d0 0x7fb6e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.324+0000 7fb705249640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6e40668d0 0x7fb6e4068d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0ae000 tx=0x7fb6fc0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.328+0000 7fb6f5ffb640 1 -- 172.21.15.26:0/2820496159 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6f8051420 con 0x7fb700152ce0 2023-11-28T16:59:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.484+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb70015cef0 con 0x7fb6e40668d0 2023-11-28T16:59:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.484+0000 7fb6f5ffb640 1 -- 172.21.15.26:0/2820496159 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb70015cef0 con 0x7fb6e40668d0 2023-11-28T16:59:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T16:59:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.484+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6e40668d0 msgr2=0x7fb6e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.484+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6e40668d0 0x7fb6e4068d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0ae000 tx=0x7fb6fc0b5040 comp rx=0 tx=0).stop 2023-11-28T16:59:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 msgr2=0x7fb7001f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb7001f4bb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c7a0 tx=0x7fb6f800cc60 comp rx=0 tx=0).stop 2023-11-28T16:59:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 shutdown_connections 2023-11-28T16:59:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb700152ce0 0x7fb7001f4bb0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fb6e40668d0 0x7fb6e4068d90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7000705e0 0x7fb7001f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 --2- 172.21.15.26:0/2820496159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70006db80 0x7fb700148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 >> 172.21.15.26:0/2820496159 conn(0x7fb7000c2ad0 msgr2=0x7fb7001496e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 shutdown_connections 2023-11-28T16:59:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.488+0000 7fb7074ad640 1 -- 172.21.15.26:0/2820496159 wait complete. 2023-11-28T16:59:57.509 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T16:59:57.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T16:59:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.652+0000 7f2c57e79640 1 Processor -- start 2023-11-28T16:59:57.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.652+0000 7f2c57e79640 1 -- start start 2023-11-28T16:59:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c57e79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5006b0c0 0x7f2c50155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c57e79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c501559d0 con 0x7f2c50070260 2023-11-28T16:59:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c57e79640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5006d910 con 0x7f2c50154ea0 2023-11-28T16:59:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c57e79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50070da0 con 0x7f2c5006b0c0 2023-11-28T16:59:57.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c56416640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2c50070260 0x7f2c50070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52176/0 (socket says 172.21.15.26:52176) 2023-11-28T16:59:57.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c56416640 1 -- 172.21.15.26:0/1541010385 learned_addr learned my addr 172.21.15.26:0/1541010385 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:57.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55414640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5006b0c0 0x7f2c50155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421446880 0 0) 0x7f2c501559d0 con 0x7f2c50070260 2023-11-28T16:59:57.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c3c003530 con 0x7f2c50070260 2023-11-28T16:59:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013228263 0 0) 0x7f2c5006d910 con 0x7f2c50154ea0 2023-11-28T16:59:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c501559d0 con 0x7f2c50154ea0 2023-11-28T16:59:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254517204 0 0) 0x7f2c3c003530 con 0x7f2c50070260 2023-11-28T16:59:57.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5006b0c0 msgr2=0x7f2c50155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:57.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5006b0c0 0x7f2c50155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 >> v1:172.21.15.79:6789/0 conn(0x7f2c50154ea0 legacy=0x7f2c5014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c500c1230 con 0x7f2c50070260 2023-11-28T16:59:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f2c48001a00 con 0x7f2c50070260 2023-11-28T16:59:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 >> v1:172.21.15.26:6789/0 conn(0x7f2c50070260 legacy=0x7f2c50070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 0x7f2c3c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c3c0047d0 0x7f2c3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c3c005190 0x7f2c3c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50070da0 con 0x7f2c3c0047d0 2023-11-28T16:59:57.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c00e270 con 0x7f2c3c005190 2023-11-28T16:59:57.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c00e430 con 0x7f2c3c003b40 2023-11-28T16:59:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55414640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5006b0c0 0x7f2c50155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55414640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c3c0047d0 0x7f2c3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55c15640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 0x7f2c3c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c56416640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c3c005190 0x7f2c3c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55c15640 1 -- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c3c005190 msgr2=0x7f2c3c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55c15640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c3c005190 0x7f2c3c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55c15640 1 -- 172.21.15.26:0/1541010385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c3c0047d0 msgr2=0x7f2c3c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55c15640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c3c0047d0 0x7f2c3c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55c15640 1 -- 172.21.15.26:0/1541010385 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c003530 con 0x7f2c3c003b40 2023-11-28T16:59:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.656+0000 7f2c55414640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c3c0047d0 0x7f2c3c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T16:59:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c55c15640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 0x7f2c3c003f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0018f0 tx=0x7f2c4c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7abd2f7849fc287a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0a7070 con 0x7f2c3c003b40 2023-11-28T16:59:57.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c0050d0 con 0x7f2c3c003b40 2023-11-28T16:59:57.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c54c13640 1 -- 172.21.15.26:0/1541010385 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0054a0 con 0x7f2c3c003b40 2023-11-28T16:59:57.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c57e79640 1 -- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 msgr2=0x7f2c3c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c57e79640 1 --2- 172.21.15.26:0/1541010385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 0x7f2c3c003f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0018f0 tx=0x7f2c4c01c510 comp rx=0 tx=0).stop 2023-11-28T16:59:57.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c56416640 1 -- 172.21.15.26:0/1541010385 reap_dead start 2023-11-28T16:59:57.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c57e79640 1 -- 172.21.15.26:0/1541010385 shutdown_connections 2023-11-28T16:59:57.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c57e79640 1 -- 172.21.15.26:0/1541010385 >> 172.21.15.26:0/1541010385 conn(0x7f2c5006a5a0 msgr2=0x7f2c5006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:57.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c57e79640 1 -- 172.21.15.26:0/1541010385 shutdown_connections 2023-11-28T16:59:57.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.660+0000 7f2c57e79640 1 -- 172.21.15.26:0/1541010385 wait complete. 2023-11-28T16:59:57.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 Processor -- start 2023-11-28T16:59:57.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 -- start start 2023-11-28T16:59:57.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 0x7f2c500c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5014dcf0 0x7f2c50140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5013ebf0 0x7f2c5013f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500c4540 con 0x7f2c5014dcf0 2023-11-28T16:59:57.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500c51c0 con 0x7f2c5013ebf0 2023-11-28T16:59:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500c42a0 con 0x7f2c3c003b40 2023-11-28T16:59:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5014dcf0 0x7f2c50140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5014dcf0 0x7f2c50140c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57030/0 (socket says 172.21.15.26:57030) 2023-11-28T16:59:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 -- 172.21.15.26:0/374907578 learned_addr learned my addr 172.21.15.26:0/374907578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55c15640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 0x7f2c500c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c56416640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5013ebf0 0x7f2c5013f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 -- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 msgr2=0x7f2c500c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c3c003b40 0x7f2c500c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 -- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5013ebf0 msgr2=0x7f2c5013f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5013ebf0 0x7f2c5013f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 -- 172.21.15.26:0/374907578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5013f5b0 con 0x7f2c5014dcf0 2023-11-28T16:59:57.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c56416640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5013ebf0 0x7f2c5013f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T16:59:57.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c55414640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5014dcf0 0x7f2c50140c90 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2c40011b90 tx=0x7f2c4000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40011e90 con 0x7f2c5014dcf0 2023-11-28T16:59:57.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40004020 con 0x7f2c5014dcf0 2023-11-28T16:59:57.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c500c4890 con 0x7f2c5014dcf0 2023-11-28T16:59:57.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400043d0 con 0x7f2c5014dcf0 2023-11-28T16:59:57.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c500c4e50 con 0x7f2c5014dcf0 2023-11-28T16:59:57.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.664+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c50155690 con 0x7f2c5014dcf0 2023-11-28T16:59:57.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2c40003620 con 0x7f2c5014dcf0 2023-11-28T16:59:57.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c467fc640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2c340668d0 0x7f2c34068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2c40084f80 con 0x7f2c5014dcf0 2023-11-28T16:59:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c467fc640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7f2c3406c7d0 0x7f2c3406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 --> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c3406f2a0 con 0x7f2c3406c7d0 2023-11-28T16:59:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c400852f0 con 0x7f2c5014dcf0 2023-11-28T16:59:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c55c15640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2c340668d0 0x7f2c34068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c56416640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7f2c3406c7d0 0x7f2c3406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c55c15640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2c340668d0 0x7f2c34068d90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0ad000 tx=0x7f2c4c001350 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c56416640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7f2c3406c7d0 0x7f2c3406ebf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.668+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== osd.7 v2:172.21.15.79:6824/3002149091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2c3406f2a0 con 0x7f2c3406c7d0 2023-11-28T16:59:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 --> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2c5006dd80 con 0x7f2c3406c7d0 2023-11-28T16:59:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c467fc640 1 -- 172.21.15.26:0/374907578 <== osd.7 v2:172.21.15.79:6824/3002149091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2c48001980 con 0x7f2c3406c7d0 2023-11-28T16:59:57.689 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-11-28T16:59:57.690 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T16:59:57.691 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-11-28T16:59:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7f2c3406c7d0 msgr2=0x7f2c3406ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6824/3002149091,v1:172.21.15.79:6825/3002149091] conn(0x7f2c3406c7d0 0x7f2c3406ebf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2c340668d0 msgr2=0x7f2c34068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f2c340668d0 0x7f2c34068d90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0ad000 tx=0x7f2c4c001350 comp rx=0 tx=0).stop 2023-11-28T16:59:57.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5014dcf0 msgr2=0x7f2c50140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 --2- 172.21.15.26:0/374907578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5014dcf0 0x7f2c50140c90 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2c40011b90 tx=0x7f2c4000f610 comp rx=0 tx=0).stop 2023-11-28T16:59:57.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c56416640 1 -- 172.21.15.26:0/374907578 reap_dead start 2023-11-28T16:59:57.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 shutdown_connections 2023-11-28T16:59:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 >> 172.21.15.26:0/374907578 conn(0x7f2c5006a5a0 msgr2=0x7f2c501577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 shutdown_connections 2023-11-28T16:59:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.684+0000 7f2c57e79640 1 -- 172.21.15.26:0/374907578 wait complete. 2023-11-28T16:59:57.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T16:59:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37b549a640 1 Processor -- start 2023-11-28T16:59:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37b549a640 1 -- start start 2023-11-28T16:59:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37b549a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37b0155170 0x7f37b0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37b549a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b006c570 0x7f37b0158220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37b549a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b01556c0 con 0x7f37b0157670 2023-11-28T16:59:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37b549a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b006ba10 con 0x7f37b0155170 2023-11-28T16:59:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37b549a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0157a50 con 0x7f37b006c570 2023-11-28T16:59:57.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37aeffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37b0157670 0x7f37b006be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52184/0 (socket says 172.21.15.26:52184) 2023-11-28T16:59:57.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37aeffd640 1 -- 172.21.15.26:0/1313447913 learned_addr learned my addr 172.21.15.26:0/1313447913 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:57.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37a7fff640 1 --2- 172.21.15.26:0/1313447913 >> v2:172.21.15.26:3300/0 conn(0x7f37b0155170 0x7f37b0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37af7fe640 1 --2- 172.21.15.26:0/1313447913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b006c570 0x7f37b0158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37ae7fc640 1 -- 172.21.15.26:0/1313447913 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920327979 0 0) 0x7f37b01556c0 con 0x7f37b0157670 2023-11-28T16:59:57.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37ae7fc640 1 -- 172.21.15.26:0/1313447913 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f379c003530 con 0x7f37b0157670 2023-11-28T16:59:57.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37a7fff640 1 -- 172.21.15.26:0/1313447913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b006c570 msgr2=0x7f37b0158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:57.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37a7fff640 1 --2- 172.21.15.26:0/1313447913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b006c570 0x7f37b0158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37a7fff640 1 -- 172.21.15.26:0/1313447913 >> v1:172.21.15.26:6789/0 conn(0x7f37b0157670 legacy=0x7f37b006be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.848+0000 7f37a7fff640 1 -- 172.21.15.26:0/1313447913 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00c4d70 con 0x7f37b0155170 2023-11-28T16:59:57.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37a7fff640 1 --2- 172.21.15.26:0/1313447913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0155170 0x7f37b0157ce0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f37980097c0 tx=0x7f379801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77552654913c1493 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37ae7fc640 1 -- 172.21.15.26:0/1313447913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980ab600 con 0x7f37b0155170 2023-11-28T16:59:57.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37ae7fc640 1 -- 172.21.15.26:0/1313447913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37980a7050 con 0x7f37b0155170 2023-11-28T16:59:57.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37ae7fc640 1 -- 172.21.15.26:0/1313447913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980ab980 con 0x7f37b0155170 2023-11-28T16:59:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 -- 172.21.15.26:0/1313447913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0155170 msgr2=0x7f37b0157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 --2- 172.21.15.26:0/1313447913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0155170 0x7f37b0157ce0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f37980097c0 tx=0x7f379801c330 comp rx=0 tx=0).stop 2023-11-28T16:59:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 -- 172.21.15.26:0/1313447913 shutdown_connections 2023-11-28T16:59:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 --2- 172.21.15.26:0/1313447913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b006c570 0x7f37b0158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 --2- 172.21.15.26:0/1313447913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0155170 0x7f37b0157ce0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 -- 172.21.15.26:0/1313447913 >> 172.21.15.26:0/1313447913 conn(0x7f37b00abe70 msgr2=0x7f37b00ac280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 -- 172.21.15.26:0/1313447913 shutdown_connections 2023-11-28T16:59:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.852+0000 7f37b549a640 1 -- 172.21.15.26:0/1313447913 wait complete. 2023-11-28T16:59:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 Processor -- start 2023-11-28T16:59:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 -- start start 2023-11-28T16:59:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b006c570 0x7f37b01f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b0155170 0x7f37b01518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0157670 0x7f37b0153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b01f1420 con 0x7f37b0157670 2023-11-28T16:59:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0152ba0 con 0x7f37b006c570 2023-11-28T16:59:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00ad850 con 0x7f37b0155170 2023-11-28T16:59:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0157670 0x7f37b0153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0157670 0x7f37b0153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57046/0 (socket says 172.21.15.26:57046) 2023-11-28T16:59:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 -- 172.21.15.26:0/4246752701 learned_addr learned my addr 172.21.15.26:0/4246752701 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37a7fff640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b0155170 0x7f37b01518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37aeffd640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b006c570 0x7f37b01f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 -- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b0155170 msgr2=0x7f37b01518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b0155170 0x7f37b01518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 -- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b006c570 msgr2=0x7f37b01f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b006c570 0x7f37b01f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 -- 172.21.15.26:0/4246752701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009420 con 0x7f37b0157670 2023-11-28T16:59:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37af7fe640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0157670 0x7f37b0153310 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f37a800ec10 tx=0x7f37a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37a77fe640 1 -- 172.21.15.26:0/4246752701 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a800eee0 con 0x7f37b0157670 2023-11-28T16:59:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37a77fe640 1 -- 172.21.15.26:0/4246752701 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a800f040 con 0x7f37b0157670 2023-11-28T16:59:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b006d350 con 0x7f37b0157670 2023-11-28T16:59:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37a77fe640 1 -- 172.21.15.26:0/4246752701 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8014480 con 0x7f37b0157670 2023-11-28T16:59:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b00ade10 con 0x7f37b0157670 2023-11-28T16:59:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.856+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b00ae000 con 0x7f37b0157670 2023-11-28T16:59:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.860+0000 7f37a77fe640 1 -- 172.21.15.26:0/4246752701 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f37a80145e0 con 0x7f37b0157670 2023-11-28T16:59:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.860+0000 7f37a77fe640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37900668d0 0x7f3790068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.860+0000 7f37a77fe640 1 -- 172.21.15.26:0/4246752701 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f37a8084f70 con 0x7f37b0157670 2023-11-28T16:59:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.860+0000 7f37aeffd640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37900668d0 0x7f3790068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.860+0000 7f37aeffd640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37900668d0 0x7f3790068d90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f37a00011f0 tx=0x7f37a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:57.864+0000 7f37a77fe640 1 -- 172.21.15.26:0/4246752701 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37a80523b0 con 0x7f37b0157670 2023-11-28T16:59:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.024+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f37b006d1d0 con 0x7f37900668d0 2023-11-28T16:59:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.024+0000 7f37a77fe640 1 -- 172.21.15.26:0/4246752701 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f37a0001cf0 con 0x7f37900668d0 2023-11-28T16:59:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T16:59:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37900668d0 msgr2=0x7f3790068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37900668d0 0x7f3790068d90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f37a00011f0 tx=0x7f37a0009040 comp rx=0 tx=0).stop 2023-11-28T16:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0157670 msgr2=0x7f37b0153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0157670 0x7f37b0153310 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f37a800ec10 tx=0x7f37a800c490 comp rx=0 tx=0).stop 2023-11-28T16:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 shutdown_connections 2023-11-28T16:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37b0157670 0x7f37b0153310 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f37900668d0 0x7f3790068d90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37b0155170 0x7f37b01518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 --2- 172.21.15.26:0/4246752701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b006c570 0x7f37b01f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 >> 172.21.15.26:0/4246752701 conn(0x7f37b00abe70 msgr2=0x7f37b015e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 shutdown_connections 2023-11-28T16:59:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.028+0000 7f37b549a640 1 -- 172.21.15.26:0/4246752701 wait complete. 2023-11-28T16:59:58.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T16:59:58.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.188+0000 7f3a6bd9d640 1 Processor -- start 2023-11-28T16:59:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6bd9d640 1 -- start start 2023-11-28T16:59:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6bd9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 0x7f3a64158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6bd9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a6406cd90 0x7f3a64158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6bd9d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a64155790 con 0x7f3a640ca610 2023-11-28T16:59:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6bd9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a640c4b00 con 0x7f3a6406cd90 2023-11-28T16:59:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6bd9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640c4de0 con 0x7f3a640bd720 2023-11-28T16:59:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a640ca610 0x7f3a640c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52200/0 (socket says 172.21.15.26:52200) 2023-11-28T16:59:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 -- 172.21.15.26:0/3796844079 learned_addr learned my addr 172.21.15.26:0/3796844079 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T16:59:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349872564 0 0) 0x7f3a64155790 con 0x7f3a640ca610 2023-11-28T16:59:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69338640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 0x7f3a64158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6a33a640 1 --2- 172.21.15.26:0/3796844079 >> v2:172.21.15.79:3300/0 conn(0x7f3a6406cd90 0x7f3a64158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a50003530 con 0x7f3a640ca610 2023-11-28T16:59:58.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2043235135 0 0) 0x7f3a50003530 con 0x7f3a640ca610 2023-11-28T16:59:58.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 msgr2=0x7f3a64158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 0x7f3a64158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 >> v2:172.21.15.79:3300/0 conn(0x7f3a6406cd90 msgr2=0x7f3a64158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:58.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 --2- 172.21.15.26:0/3796844079 >> v2:172.21.15.79:3300/0 conn(0x7f3a6406cd90 0x7f3a64158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a64157e30 con 0x7f3a640ca610 2023-11-28T16:59:58.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 614369045 0 0) 0x7f3a60001680 con 0x7f3a640ca610 2023-11-28T16:59:58.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 >> v1:172.21.15.26:6789/0 conn(0x7f3a640ca610 legacy=0x7f3a640c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a50003980 0x7f3a50003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 0x7f3a500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a50004d10 0x7f3a50005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640c4b00 con 0x7f3a50003980 2023-11-28T16:59:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640c4de0 con 0x7f3a50004d10 2023-11-28T16:59:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5000ba10 con 0x7f3a640bd720 2023-11-28T16:59:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a50003980 0x7f3a50003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69338640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 0x7f3a500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a6a33a640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a50004d10 0x7f3a50005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 -- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 msgr2=0x7f3a500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a640bd720 0x7f3a500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 -- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a50004d10 msgr2=0x7f3a50005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a50004d10 0x7f3a50005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.192+0000 7f3a69b39640 1 -- 172.21.15.26:0/3796844079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50003530 con 0x7f3a50003980 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a69b39640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a50003980 0x7f3a50003da0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c240 tx=0x7f3a6001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e94a9d34a0a2d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:58.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640c52d0 con 0x7f3a50003980 2023-11-28T16:59:58.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a600058e0 con 0x7f3a50003980 2023-11-28T16:59:58.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a68b37640 1 -- 172.21.15.26:0/3796844079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60005cb0 con 0x7f3a50003980 2023-11-28T16:59:58.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/3796844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a50003980 msgr2=0x7f3a50003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a6bd9d640 1 --2- 172.21.15.26:0/3796844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a50003980 0x7f3a50003da0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c240 tx=0x7f3a6001cc60 comp rx=0 tx=0).stop 2023-11-28T16:59:58.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a6a33a640 1 -- 172.21.15.26:0/3796844079 reap_dead start 2023-11-28T16:59:58.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/3796844079 shutdown_connections 2023-11-28T16:59:58.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/3796844079 >> 172.21.15.26:0/3796844079 conn(0x7f3a64071ea0 msgr2=0x7f3a640722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:58.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/3796844079 shutdown_connections 2023-11-28T16:59:58.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.196+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/3796844079 wait complete. 2023-11-28T16:59:58.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 Processor -- start 2023-11-28T16:59:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 -- start start 2023-11-28T16:59:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a50003980 0x7f3a64151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a640bdfb0 0x7f3a640be430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a641ee400 0x7f3a641ee880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640c0e00 con 0x7f3a641ee400 2023-11-28T16:59:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640be970 con 0x7f3a640bdfb0 2023-11-28T16:59:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640bfd60 con 0x7f3a50003980 2023-11-28T16:59:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a641ee400 0x7f3a641ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a641ee400 0x7f3a641ee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57058/0 (socket says 172.21.15.26:57058) 2023-11-28T16:59:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 -- 172.21.15.26:0/1223712056 learned_addr learned my addr 172.21.15.26:0/1223712056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T16:59:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a69b39640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a50003980 0x7f3a64151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 -- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a50003980 msgr2=0x7f3a64151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a50003980 0x7f3a64151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 -- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a640bdfb0 msgr2=0x7f3a640be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a69338640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a640bdfb0 0x7f3a640be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a640bdfb0 0x7f3a640be430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 -- 172.21.15.26:0/1223712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640c0040 con 0x7f3a641ee400 2023-11-28T16:59:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a69b39640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a50003980 0x7f3a64151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a69338640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a640bdfb0 0x7f3a640be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T16:59:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6a33a640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a641ee400 0x7f3a641ee880 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3a6406cb40 tx=0x7f3a5c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/1223712056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00e040 con 0x7f3a641ee400 2023-11-28T16:59:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/1223712056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00f040 con 0x7f3a641ee400 2023-11-28T16:59:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a640c0320 con 0x7f3a641ee400 2023-11-28T16:59:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/1223712056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c015430 con 0x7f3a641ee400 2023-11-28T16:59:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a640c08e0 con 0x7f3a641ee400 2023-11-28T16:59:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.200+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a640c0b00 con 0x7f3a641ee400 2023-11-28T16:59:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.204+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/1223712056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a5c015590 con 0x7f3a641ee400 2023-11-28T16:59:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.204+0000 7f3a5a7fc640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a480668d0 0x7f3a48068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T16:59:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.204+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/1223712056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3a5c084910 con 0x7f3a641ee400 2023-11-28T16:59:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.204+0000 7f3a69b39640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a480668d0 0x7f3a48068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T16:59:58.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.204+0000 7f3a69b39640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a480668d0 0x7f3a48068d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3a600aa000 tx=0x7f3a60001a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T16:59:58.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.208+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/1223712056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a5c051d50 con 0x7f3a641ee400 2023-11-28T16:59:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.364+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a640c9de0 con 0x7f3a480668d0 2023-11-28T16:59:58.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/1223712056 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50061 (secure 0 0 0) 0x7f3a640c9de0 con 0x7f3a480668d0 2023-11-28T16:59:58.370 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T16:59:58.371 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T16:59:58.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a480668d0 msgr2=0x7f3a48068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a480668d0 0x7f3a48068d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3a600aa000 tx=0x7f3a60001a80 comp rx=0 tx=0).stop 2023-11-28T16:59:58.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a641ee400 msgr2=0x7f3a641ee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T16:59:58.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a641ee400 0x7f3a641ee880 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3a6406cb40 tx=0x7f3a5c00f580 comp rx=0 tx=0).stop 2023-11-28T16:59:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 shutdown_connections 2023-11-28T16:59:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a641ee400 0x7f3a641ee880 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a640bdfb0 0x7f3a640be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f3a480668d0 0x7f3a48068d90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 --2- 172.21.15.26:0/1223712056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a50003980 0x7f3a64151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T16:59:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 >> 172.21.15.26:0/1223712056 conn(0x7f3a64071ea0 msgr2=0x7f3a640c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T16:59:58.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 shutdown_connections 2023-11-28T16:59:58.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T16:59:58.368+0000 7f3a6bd9d640 1 -- 172.21.15.26:0/1223712056 wait complete. 2023-11-28T16:59:58.391 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-11-28T16:59:57.629815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254172,"kb_used_data":8872,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720548,"statfs":{"total":773094113280,"available":772833841152,"internally_reserved":0,"allocated":9084928,"data_stored":4673240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.327654"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-28T16:59:48.304294+0000","last_change":"2023-11-28T16:56:06.649432+0000","last_active":"2023-11-28T16:59:48.304294+0000","last_peered":"2023-11-28T16:59:48.304294+0000","last_clean":"2023-11-28T16:59:48.304294+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T16:59:48.304294+0000","last_undegraded":"2023-11-28T16:59:48.304294+0000","last_fullsized":"2023-11-28T16:59:48.304294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T16:56:05.635363+0000","last_clean_scrub_stamp":"2023-11-28T16:56:05.635363+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:33.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1581056,"data_stored":1026931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.745,"15min":0.71599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":5.8499999999999996},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.022,"5min":0.77800000000000002,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.9800000000000004,"5min":5.9800000000000004,"15min":5.9800000000000004},"last":0.72899999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.63200000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.70799999999999996}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.64800000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.69699999999999995},"min":{"1min":0.46200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.84699999999999998,"5min":1.474,"15min":1.474},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.749,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.754,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.88,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91300000000000003,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.88700000000000001}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":1.038,"15min":1.038},"last":0.746},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.92500000000000004}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.071,"15min":1.071},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85999999999999999,"5min":1.367,"15min":1.367},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.022,"5min":1.401,"15min":1.401},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.82299999999999995,"15min":0.873},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86399999999999999,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.85099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.64800000000000002}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.503,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.78500000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82599999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63500000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.876,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64800000000000002,"15min":0.67500000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.871}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66300000000000003,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.70999999999999996,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.66800000000000004},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.495},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70599999999999996,"15min":0.73499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.234,"15min":1.234},"last":0.73099999999999998}]},{"osd":1,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.964,"15min":1.964},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0449999999999999,"5min":1.704,"15min":1.704},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92000000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.747},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.79600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98199999999999998,"5min":1.254,"15min":1.254},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98399999999999999,"5min":1.548,"15min":1.548},"last":0.61399999999999999}]},{"osd":5,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66700000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.755},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89500000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Nov 28 16:59:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":1.218,"15min":1.218},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.0780000000000001,"5min":1.593,"15min":1.593},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.626,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.379},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64600000000000002,"5min":0.745,"15min":0.745},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57999999999999996,"5min":0.874,"15min":0.874},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.5,"15min":0.505},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.304,"15min":1.304},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":1.502,"15min":1.502},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":1.21,"15min":1.21},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97099999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79300000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.747},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94999999999999996,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80100000000000005,"15min":0.82799999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.25,"15min":1.25},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0720000000000001,"5min":1.423,"15min":1.423},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.433,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.503,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42899999999999999}]},{"osd":1,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.67500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.48099999999999998}]},{"osd":4,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.54400000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.88},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":0.998,"15min":0.998},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.56699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88700000000000001,"5min":1.042,"15min":1.042},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85699999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91100000000000003,"5min":1.012,"15min":1.012},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84099999999999997,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76400000000000001,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88400000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94499999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.318},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.502}]},{"osd":2,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78300000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.627}]},{"osd":4,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.446,"15min":1.446},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0980000000000001,"5min":1.47,"15min":1.47},"last":0.64400000000000002}]},{"osd":5,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.056,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.57399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.327,"15min":1.327},"last":0.72299999999999998}]},{"osd":6,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98299999999999998,"5min":1.3,"15min":1.3},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.526,"15min":1.526},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Nov 28 16:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80600000000000005,"15min":0.83399999999999996},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95399999999999996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1026931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45800000000000002,"15min":0.47999999999999998},"min":{"1min":0.26600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.753,"5min":1.085,"15min":1.085},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.73799999999999999},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64400000000000002,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.66900000000000004},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77400000000000002,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91400000000000003,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.135,"5min":1.859,"15min":1.859},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.462,"15min":1.462},"last":0.72899999999999998}]},{"osd":5,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1319999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.222,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.119,"5min":1.298,"15min":1.298},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.323,"15min":1.323},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Nov 28 16:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0680000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.50700000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.155,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T16:59:58.396 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T16:56:05.635363+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=16, tm_min=56, tm_sec=5, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=16, tm_min=59, tm_sec=52, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T16:59:58.396 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T17:00:18.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:00:18.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:00:18.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:00:18.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce29ad6640 1 Processor -- start 2023-11-28T17:00:18.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce29ad6640 1 -- start start 2023-11-28T17:00:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce29ad6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce2414e9d0 0x7fce24151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce29ad6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2406d320 con 0x7fce240a8470 2023-11-28T17:00:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce29ad6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce240721b0 con 0x7fce24070b80 2023-11-28T17:00:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce29ad6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce240c2830 con 0x7fce2414e9d0 2023-11-28T17:00:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce23fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fce240a8470 0x7fce2406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35544/0 (socket says 172.21.15.26:35544) 2023-11-28T17:00:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.548+0000 7fce23fff640 1 -- 172.21.15.26:0/1121448416 learned_addr learned my addr 172.21.15.26:0/1121448416 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T17:00:18.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce237fe640 1 --2- 172.21.15.26:0/1121448416 >> v2:172.21.15.79:3300/0 conn(0x7fce2414e9d0 0x7fce24151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874317320 0 0) 0x7fce2406d320 con 0x7fce240a8470 2023-11-28T17:00:18.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce0c005740 con 0x7fce240a8470 2023-11-28T17:00:18.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972869988 0 0) 0x7fce240721b0 con 0x7fce24070b80 2023-11-28T17:00:18.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce2406d320 con 0x7fce24070b80 2023-11-28T17:00:18.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 605536193 0 0) 0x7fce0c005740 con 0x7fce240a8470 2023-11-28T17:00:18.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce237fe640 1 -- 172.21.15.26:0/1121448416 >> v1:172.21.15.79:6789/0 conn(0x7fce24070b80 legacy=0x7fce240c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce237fe640 1 -- 172.21.15.26:0/1121448416 >> v1:172.21.15.26:6789/0 conn(0x7fce240a8470 legacy=0x7fce2406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce237fe640 1 -- 172.21.15.26:0/1121448416 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24072450 con 0x7fce2414e9d0 2023-11-28T17:00:18.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.552+0000 7fce237fe640 1 --2- 172.21.15.26:0/1121448416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2414e9d0 0x7fce24151e60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce140097c0 tx=0x7fce1401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef06f8c3295378af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:18.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c001a00 con 0x7fce2414e9d0 2023-11-28T17:00:18.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce140a7050 con 0x7fce2414e9d0 2023-11-28T17:00:18.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce227fc640 1 -- 172.21.15.26:0/1121448416 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140ab620 con 0x7fce2414e9d0 2023-11-28T17:00:18.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- 172.21.15.26:0/1121448416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2414e9d0 msgr2=0x7fce24151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 --2- 172.21.15.26:0/1121448416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2414e9d0 0x7fce24151e60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce140097c0 tx=0x7fce1401c310 comp rx=0 tx=0).stop 2023-11-28T17:00:18.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- 172.21.15.26:0/1121448416 shutdown_connections 2023-11-28T17:00:18.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 --2- 172.21.15.26:0/1121448416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2414e9d0 0x7fce24151e60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- 172.21.15.26:0/1121448416 >> 172.21.15.26:0/1121448416 conn(0x7fce240c2ad0 msgr2=0x7fce240c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:00:18.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- 172.21.15.26:0/1121448416 shutdown_connections 2023-11-28T17:00:18.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- 172.21.15.26:0/1121448416 wait complete. 2023-11-28T17:00:18.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 Processor -- start 2023-11-28T17:00:18.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- start start 2023-11-28T17:00:18.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce24070b80 0x7fce24141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce240a8470 0x7fce240bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce2414e9d0 0x7fce24140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2414fb40 con 0x7fce24070b80 2023-11-28T17:00:18.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce240c57f0 con 0x7fce240a8470 2023-11-28T17:00:18.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.556+0000 7fce29ad6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce240c5ad0 con 0x7fce2414e9d0 2023-11-28T17:00:18.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce24070b80 0x7fce24141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce24070b80 0x7fce24141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53722/0 (socket says 172.21.15.26:53722) 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 -- 172.21.15.26:0/3786448431 learned_addr learned my addr 172.21.15.26:0/3786448431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce22ffd640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce240a8470 0x7fce240bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 -- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce2414e9d0 msgr2=0x7fce24140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce2414e9d0 0x7fce24140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 -- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce240a8470 msgr2=0x7fce240bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce240a8470 0x7fce240bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 -- 172.21.15.26:0/3786448431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce14009420 con 0x7fce24070b80 2023-11-28T17:00:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce22ffd640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce240a8470 0x7fce240bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:00:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce237fe640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce24070b80 0x7fce24141a50 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fce140ae040 tx=0x7fce1401ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce0bfff640 1 -- 172.21.15.26:0/3786448431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140abcf0 con 0x7fce24070b80 2023-11-28T17:00:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce0bfff640 1 -- 172.21.15.26:0/3786448431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce140abe50 con 0x7fce24070b80 2023-11-28T17:00:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2414f480 con 0x7fce24070b80 2023-11-28T17:00:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce0bfff640 1 -- 172.21.15.26:0/3786448431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce14004220 con 0x7fce24070b80 2023-11-28T17:00:18.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce241f1030 con 0x7fce24070b80 2023-11-28T17:00:18.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce24067a40 con 0x7fce24070b80 2023-11-28T17:00:18.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.560+0000 7fce0bfff640 1 -- 172.21.15.26:0/3786448431 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fce14004380 con 0x7fce24070b80 2023-11-28T17:00:18.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.564+0000 7fce0bfff640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fce100668d0 0x7fce10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.564+0000 7fce0bfff640 1 -- 172.21.15.26:0/3786448431 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fce1411e6d0 con 0x7fce24070b80 2023-11-28T17:00:18.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.564+0000 7fce22ffd640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fce100668d0 0x7fce10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.564+0000 7fce22ffd640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fce100668d0 0x7fce10068d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fce240c4ef0 tx=0x7fce18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:18.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.568+0000 7fce0bfff640 1 -- 172.21.15.26:0/3786448431 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce140ebba0 con 0x7fce24070b80 2023-11-28T17:00:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.720+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 --> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce2406dec0 con 0x7fce100668d0 2023-11-28T17:00:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.724+0000 7fce0bfff640 1 -- 172.21.15.26:0/3786448431 <== mgr.4105 v2:172.21.15.79:6832/7430110 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50166 (secure 0 0 0) 0x7fce18001d10 con 0x7fce100668d0 2023-11-28T17:00:18.728 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T17:00:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-11-28T17:00:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fce100668d0 msgr2=0x7fce10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fce100668d0 0x7fce10068d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fce240c4ef0 tx=0x7fce18009040 comp rx=0 tx=0).stop 2023-11-28T17:00:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce24070b80 msgr2=0x7fce24141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce24070b80 0x7fce24141a50 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fce140ae040 tx=0x7fce1401ab50 comp rx=0 tx=0).stop 2023-11-28T17:00:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 shutdown_connections 2023-11-28T17:00:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7fce100668d0 0x7fce10068d90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce2414e9d0 0x7fce24140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce240a8470 0x7fce240bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 --2- 172.21.15.26:0/3786448431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce24070b80 0x7fce24141a50 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 >> 172.21.15.26:0/3786448431 conn(0x7fce240c2ad0 msgr2=0x7fce240c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:00:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 shutdown_connections 2023-11-28T17:00:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.728+0000 7fce29ad6640 1 -- 172.21.15.26:0/3786448431 wait complete. 2023-11-28T17:00:18.749 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-28T17:00:17.633981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254160,"kb_used_data":8872,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720560,"statfs":{"total":773094113280,"available":772833853440,"internally_reserved":0,"allocated":9084928,"data_stored":4673240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002655"},"pg_stats":[{"pgid":"1.0","version":"79'119","reported_seq":229,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T17:00:05.972162+0000","last_change":"2023-11-28T17:00:05.972162+0000","last_active":"2023-11-28T17:00:05.972162+0000","last_peered":"2023-11-28T17:00:05.972162+0000","last_clean":"2023-11-28T17:00:05.972162+0000","last_became_active":"2023-11-28T16:56:06.648515+0000","last_became_peered":"2023-11-28T16:56:06.648515+0000","last_unstale":"2023-11-28T17:00:05.972162+0000","last_undegraded":"2023-11-28T17:00:05.972162+0000","last_fullsized":"2023-11-28T17:00:05.972162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2023-11-28T17:00:05.972041+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2023-11-28T17:00:05.972041+0000","last_clean_scrub_stamp":"2023-11-28T17:00:05.972041+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:41:36.596763+0000","scrub_duration":0.0072075610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1581056,"data_stored":1026931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.71799999999999997},"min":{"1min":0.46899999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.9910000000000001,"5min":5.8499999999999996,"15min":5.8499999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.79500000000000004,"15min":0.751},"min":{"1min":0.629,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0600000000000001,"5min":5.9800000000000004,"15min":5.9800000000000004},"last":0.745}]},{"osd":1,"last update":"Tue Nov 28 17:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79100000000000004,"5min":1.746,"15min":1.746},"last":0.70299999999999996}]},{"osd":2,"last update":"Tue Nov 28 17:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9119999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Nov 28 17:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.503,"15min":0.503},"max":{"1min":2.484,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.768,"5min":3.569,"15min":3.569},"last":0.77600000000000002}]},{"osd":4,"last update":"Tue Nov 28 17:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.626},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0349999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76900000000000002,"15min":0.77300000000000002},"min":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88700000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Tue Nov 28 17:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.77100000000000002},"min":{"1min":0.45100000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0169999999999999,"5min":2.794,"15min":2.794},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.004,"5min":2.633,"15min":2.633},"last":0.55500000000000005}]},{"osd":6,"last update":"Tue Nov 28 17:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93000000000000005,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.497},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94999999999999996,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.68000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.42399999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.86599999999999999,"5min":1.474,"15min":1.474},"last":0.745},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.79800000000000004},"min":{"1min":0.53800000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.83499999999999996,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88700000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":1.038,"15min":1.038},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.97099999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.55200000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92800000000000005,"5min":1.071,"15min":1.071},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.498,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91300000000000003,"5min":1.367,"15min":1.367},"last":0.85099999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63800000000000001,"15min":0.65600000000000003},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.68200000000000005},"min":{"1min":0.46300000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95999999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.754},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.0669999999999999,"5min":1.401,"15min":1.401},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":0.86399999999999999},"min":{"1min":0.59999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.0800000000000001,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.05,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.51100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82599999999999996}]},{"osd":1,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65400000000000003,"15min":0.622},"min":{"1min":0.54900000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67300000000000004,"15min":0.68999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91400000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.748}]},{"osd":2,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.51900000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.88,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.745,"15min":0.77300000000000002},"min":{"1min":0.51800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.56399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.81899999999999995}]},{"osd":4,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.67200000000000004},"min":{"1min":0.41499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66700000000000004,"15min":0.70699999999999996},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.92900000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.47399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.876}]},{"osd":7,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.77400000000000002},"min":{"1min":0.47199999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.93999999999999995,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90500000000000003,"5min":1.234,"15min":1.234},"last":0.59899999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71399999999999997,"15min":0.76800000000000002},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94399999999999995,"5min":1.964,"15min":1.964},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.874,"5min":1.704,"15min":1.704},"last":0.61299999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.74099999999999999},"min":{"1min":0.55600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91300000000000003,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.754},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74099999999999999,"15min":0.78900000000000003},"min":{"1min":0.52100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94199999999999995,"5min":1.254,"15min":1.254},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.58299999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95899999999999996,"5min":1.548,"15min":1.548},"last":0.70899999999999996}]},{"osd":5,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.623,"15min":0.64700000000000002},"min":{"1min":0.39800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79900000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.434},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.97599999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.496}]},{"osd":6,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70099999999999996,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84799999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72599999999999998,"15min":0.76900000000000002},"min":{"1min":0.441,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77800000000000002,"15min":0.83599999999999997},"min":{"1min":0.50700000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.86099999999999999,"5min":1.218,"15min":1.218},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.79400000000000004,"15min":0.83599999999999997},"min":{"1min":0.52800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.96199999999999997,"5min":1.593,"15min":1.593},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53400000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.311,"15min":0.311},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73499999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.46700000000000003},"min":{"1min":0.33800000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64200000000000002,"5min":0.874,"15min":0.874},"last":1.4219999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":1.304,"15min":1.304},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.72499999999999998,"5min":1.502,"15min":1.502},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79700000000000004,"5min":1.21,"15min":1.21},"last":1.4530000000000001}]},{"osd":4,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.57099999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88700000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.2549999999999999}]},{"osd":5,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.75700000000000001},"min":{"1min":0.58699999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.82799999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73999999999999999,"15min":0.78200000000000003},"min":{"1min":0.59699999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79900000000000004}]},{"osd":6,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75600000000000001,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":0.81399999999999995},"min":{"1min":0.501,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.3169999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.58399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90000000000000002,"5min":1.25,"15min":1.25},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.80700000000000005},"min":{"1min":0.56100000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.84699999999999998,"5min":1.423,"15min":1.423},"last":1.373}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.433,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.503,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.67500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.61299999999999999}]},{"osd":4,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.54400000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":0.998,"15min":0.998},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.56699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88700000000000001,"5min":1.042,"15min":1.042},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85699999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91100000000000003,"5min":1.012,"15min":1.012},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84099999999999997,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94999999999999996}]},{"osd":7,"last update":"Tue Nov 28 16:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76400000000000001,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88400000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.879},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94499999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.86199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.49199999999999999,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.254},"max":{"1min":8.9499999999999993,"5min":8.9499999999999993,"15min":8.9499999999999993},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46200000000000002},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73699999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.53700000000000003,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.1589999999999998,"5min":6.1589999999999998,"15min":6.1589999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.52500000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.2080000000000002,"5min":6.2080000000000002,"15min":6.2080000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.60599999999999998,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.9249999999999998,"5min":5.9249999999999998,"15min":5.9249999999999998},"last":0.55200000000000005}]},{"osd":4,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.75800000000000001,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.8259999999999996,"5min":5.8259999999999996,"15min":5.8259999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.80000000000000004,"15min":0.78400000000000003},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.012,"5min":0.81899999999999995,"15min":0.81100000000000005},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.4059999999999997,"5min":6.4059999999999997,"15min":6.4059999999999997},"last":0.70199999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.79400000000000004,"15min":0.78000000000000003},"min":{"1min":0.59599999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.88},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.57699999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2030000000000001,"5min":1.526,"15min":1.526},"last":0.79800000000000004}]},{"osd":7,"last update":"Tue Nov 28 17:00:11 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.3600000000000003,"5min":6.3600000000000003,"15min":6.3600000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.81599999999999995,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.8710000000000004,"5min":5.8710000000000004,"15min":5.8710000000000004},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1581056,"data_stored":1026931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 17:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44700000000000001,"15min":0.47699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.84699999999999998,"5min":1.085,"15min":1.085},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Tue Nov 28 17:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.59399999999999997,"15min":0.71799999999999997},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72199999999999998,"5min":5.2869999999999999,"15min":5.2869999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.57299999999999995,"15min":0.65600000000000003},"min":{"1min":0.375,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68799999999999994,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Nov 28 17:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49299999999999999,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58099999999999996,"15min":0.63},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77300000000000002,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.59999999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.75,"15min":0.78300000000000003},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97699999999999998,"5min":1.859,"15min":1.859},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90800000000000003,"5min":1.462,"15min":1.462},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Nov 28 17:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86599999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76800000000000002,"15min":0.80600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94899999999999995,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Tue Nov 28 17:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.56999999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95899999999999996,"5min":1.298,"15min":1.298},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.78200000000000003},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.0640000000000001,"5min":1.323,"15min":1.323},"last":0.92700000000000005}]},{"osd":7,"last update":"Tue Nov 28 17:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94799999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.82499999999999996},"min":{"1min":0.57699999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0169999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.0009999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:00:18.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T17:00:18.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.888+0000 7f74732d6640 1 Processor -- start 2023-11-28T17:00:18.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.888+0000 7f74732d6640 1 -- start start 2023-11-28T17:00:18.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.888+0000 7f74732d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.888+0000 7f74732d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f746c070760 0x7f746c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.888+0000 7f74732d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c071020 con 0x7f746c06df20 2023-11-28T17:00:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.888+0000 7f74732d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c071300 con 0x7f746c070760 2023-11-28T17:00:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.888+0000 7f74732d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0715e0 con 0x7f746c1561d0 2023-11-28T17:00:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7471873640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f746c06df20 0x7f746c158ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35550/0 (socket says 172.21.15.26:35550) 2023-11-28T17:00:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7471873640 1 -- 172.21.15.26:0/827320033 learned_addr learned my addr 172.21.15.26:0/827320033 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-11-28T17:00:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7470871640 1 --2- 172.21.15.26:0/827320033 >> v2:172.21.15.26:3300/0 conn(0x7f746c070760 0x7f746c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7471072640 1 --2- 172.21.15.26:0/827320033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7463fff640 1 -- 172.21.15.26:0/827320033 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020914276 0 0) 0x7f746c071020 con 0x7f746c06df20 2023-11-28T17:00:18.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7463fff640 1 -- 172.21.15.26:0/827320033 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7458003530 con 0x7f746c06df20 2023-11-28T17:00:18.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7470871640 1 -- 172.21.15.26:0/827320033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 msgr2=0x7f746c0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:00:18.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7470871640 1 --2- 172.21.15.26:0/827320033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c0701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7470871640 1 -- 172.21.15.26:0/827320033 >> v1:172.21.15.26:6789/0 conn(0x7f746c06df20 legacy=0x7f746c158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7470871640 1 -- 172.21.15.26:0/827320033 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0718c0 con 0x7f746c070760 2023-11-28T17:00:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7470871640 1 --2- 172.21.15.26:0/827320033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c06d9e0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f745c0097c0 tx=0x7f745c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c6862eee0d3cef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7463fff640 1 -- 172.21.15.26:0/827320033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0ab600 con 0x7f746c070760 2023-11-28T17:00:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7463fff640 1 -- 172.21.15.26:0/827320033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c0a7050 con 0x7f746c070760 2023-11-28T17:00:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.892+0000 7f7463fff640 1 -- 172.21.15.26:0/827320033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0ab980 con 0x7f746c070760 2023-11-28T17:00:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- 172.21.15.26:0/827320033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 msgr2=0x7f746c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 --2- 172.21.15.26:0/827320033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c06d9e0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f745c0097c0 tx=0x7f745c01c3f0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- 172.21.15.26:0/827320033 shutdown_connections 2023-11-28T17:00:18.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 --2- 172.21.15.26:0/827320033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c06d9e0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 --2- 172.21.15.26:0/827320033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c0701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- 172.21.15.26:0/827320033 >> 172.21.15.26:0/827320033 conn(0x7f746c0c2a60 msgr2=0x7f746c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:00:18.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- 172.21.15.26:0/827320033 shutdown_connections 2023-11-28T17:00:18.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- 172.21.15.26:0/827320033 wait complete. 2023-11-28T17:00:18.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 Processor -- start 2023-11-28T17:00:18.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- start start 2023-11-28T17:00:18.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f746c06df20 0x7f746c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c1515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c14ffd0 con 0x7f746c070760 2023-11-28T17:00:18.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c15b2b0 con 0x7f746c06df20 2023-11-28T17:00:18.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f74732d6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c15ce70 con 0x7f746c1561d0 2023-11-28T17:00:18.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c1515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c1515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53734/0 (socket says 172.21.15.26:53734) 2023-11-28T17:00:18.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 -- 172.21.15.26:0/2824679550 learned_addr learned my addr 172.21.15.26:0/2824679550 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T17:00:18.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7471072640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f746c06df20 0x7f746c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7471873640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 -- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 msgr2=0x7f746c1f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c1f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 -- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f746c06df20 msgr2=0x7f746c14f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:18.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f746c06df20 0x7f746c14f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:18.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7470871640 1 -- 172.21.15.26:0/2824679550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c009420 con 0x7f746c070760 2023-11-28T17:00:18.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.896+0000 7f7471072640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f746c06df20 0x7f746c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:00:18.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7470871640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c1515d0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f745c01a020 tx=0x7f745c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:18.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0b4430 con 0x7f746c070760 2023-11-28T17:00:18.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c0b45b0 con 0x7f746c070760 2023-11-28T17:00:18.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c15a980 con 0x7f746c070760 2023-11-28T17:00:18.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0b4960 con 0x7f746c070760 2023-11-28T17:00:18.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c15af40 con 0x7f746c070760 2023-11-28T17:00:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c04e890 con 0x7f746c070760 2023-11-28T17:00:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f745c0b2040 con 0x7f746c070760 2023-11-28T17:00:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7461ffb640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7450066950 0x7f7450068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:18.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f745c11dec0 con 0x7f746c070760 2023-11-28T17:00:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.900+0000 7f7471072640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7450066950 0x7f7450068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.904+0000 7f7471072640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7450066950 0x7f7450068e10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7468009bb0 tx=0x7f7468008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:18.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:18.904+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f745c0eb410 con 0x7f746c070760 2023-11-28T17:00:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.064+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f746c15b3f0 con 0x7f746c070760 2023-11-28T17:00:19.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f745c0eea30 con 0x7f746c070760 2023-11-28T17:00:19.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f7461ffb640 1 -- 172.21.15.26:0/2824679550 <== mon.0 v2:172.21.15.26:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f745c0eb410 con 0x7f746c070760 2023-11-28T17:00:19.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7450066950 msgr2=0x7f7450068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:19.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7450066950 0x7f7450068e10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7468009bb0 tx=0x7f7468008040 comp rx=0 tx=0).stop 2023-11-28T17:00:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 msgr2=0x7f746c1515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c1515d0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f745c01a020 tx=0x7f745c019190 comp rx=0 tx=0).stop 2023-11-28T17:00:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 shutdown_connections 2023-11-28T17:00:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f7450066950 0x7f7450068e10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f746c1561d0 0x7f746c1f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c070760 0x7f746c1515d0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 --2- 172.21.15.26:0/2824679550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f746c06df20 0x7f746c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.068+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 >> 172.21.15.26:0/2824679550 conn(0x7f746c0c2a60 msgr2=0x7f746c157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:00:19.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.072+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 shutdown_connections 2023-11-28T17:00:19.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.072+0000 7f74732d6640 1 -- 172.21.15.26:0/2824679550 wait complete. 2023-11-28T17:00:19.092 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T17:00:19.093 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:00:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.232+0000 7f85e1565640 1 Processor -- start 2023-11-28T17:00:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.232+0000 7f85e1565640 1 -- start start 2023-11-28T17:00:19.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85e1565640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85dc14fcc0 0x7f85dc156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:19.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85e1565640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc06d980 0x7f85dc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:19.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85e1565640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc152fe0 con 0x7f85dc0ab3b0 2023-11-28T17:00:19.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85e1565640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc0aa340 con 0x7f85dc14fcc0 2023-11-28T17:00:19.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85e1565640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1532c0 con 0x7f85dc06d980 2023-11-28T17:00:19.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85daffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85dc14fcc0 0x7f85dc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85daffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85dc14fcc0 0x7f85dc156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53748/0 (socket says 172.21.15.26:53748) 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85daffd640 1 -- 172.21.15.26:0/1781185699 learned_addr learned my addr 172.21.15.26:0/1781185699 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85daffd640 1 -- 172.21.15.26:0/1781185699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc06d980 msgr2=0x7f85dc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85d27fc640 1 --2- 172.21.15.26:0/1781185699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc06d980 0x7f85dc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85daffd640 1 --2- 172.21.15.26:0/1781185699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc06d980 0x7f85dc0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85daffd640 1 -- 172.21.15.26:0/1781185699 >> v1:172.21.15.79:6789/0 conn(0x7f85dc0ab3b0 legacy=0x7f85dc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85daffd640 1 -- 172.21.15.26:0/1781185699 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc155a20 con 0x7f85dc14fcc0 2023-11-28T17:00:19.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.236+0000 7f85d27fc640 1 --2- 172.21.15.26:0/1781185699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc06d980 0x7f85dc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:00:19.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85daffd640 1 --2- 172.21.15.26:0/1781185699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc14fcc0 0x7f85dc156500 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009870 tx=0x7f85cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afec0395201109b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:19.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85da7fc640 1 -- 172.21.15.26:0/1781185699 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0aa5f0 con 0x7f85dc14fcc0 2023-11-28T17:00:19.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85da7fc640 1 -- 172.21.15.26:0/1781185699 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f85cc0aa750 con 0x7f85dc14fcc0 2023-11-28T17:00:19.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85da7fc640 1 -- 172.21.15.26:0/1781185699 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0aab00 con 0x7f85dc14fcc0 2023-11-28T17:00:19.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 -- 172.21.15.26:0/1781185699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc14fcc0 msgr2=0x7f85dc156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:19.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 --2- 172.21.15.26:0/1781185699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc14fcc0 0x7f85dc156500 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009870 tx=0x7f85cc01c4d0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 -- 172.21.15.26:0/1781185699 shutdown_connections 2023-11-28T17:00:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 --2- 172.21.15.26:0/1781185699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc06d980 0x7f85dc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 --2- 172.21.15.26:0/1781185699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc14fcc0 0x7f85dc156500 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 -- 172.21.15.26:0/1781185699 >> 172.21.15.26:0/1781185699 conn(0x7f85dc0c2ad0 msgr2=0x7f85dc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:00:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 -- 172.21.15.26:0/1781185699 shutdown_connections 2023-11-28T17:00:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 -- 172.21.15.26:0/1781185699 wait complete. 2023-11-28T17:00:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 Processor -- start 2023-11-28T17:00:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.240+0000 7f85e1565640 1 -- start start 2023-11-28T17:00:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc06d980 0x7f85dc154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc0ab3b0 0x7f85dc14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc14e2c0 0x7f85dc14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0c5ca0 con 0x7f85dc06d980 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1eaa60 con 0x7f85dc14e2c0 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc14dde0 con 0x7f85dc0ab3b0 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc06d980 0x7f85dc154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc06d980 0x7f85dc154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53754/0 (socket says 172.21.15.26:53754) 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 -- 172.21.15.26:0/1391570788 learned_addr learned my addr 172.21.15.26:0/1391570788 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85d27fc640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc0ab3b0 0x7f85dc14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85db7fe640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc14e2c0 0x7f85dc14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 -- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc0ab3b0 msgr2=0x7f85dc14d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc0ab3b0 0x7f85dc14d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 -- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc14e2c0 msgr2=0x7f85dc14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc14e2c0 0x7f85dc14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 -- 172.21.15.26:0/1391570788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0094d0 con 0x7f85dc06d980 2023-11-28T17:00:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85daffd640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc06d980 0x7f85dc154390 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0ac040 tx=0x7f85cc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85d3fff640 1 -- 172.21.15.26:0/1391570788 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0b38c0 con 0x7f85dc06d980 2023-11-28T17:00:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85d3fff640 1 -- 172.21.15.26:0/1391570788 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f85cc0b3a60 con 0x7f85dc06d980 2023-11-28T17:00:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85d3fff640 1 -- 172.21.15.26:0/1391570788 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0b3e30 con 0x7f85dc06d980 2023-11-28T17:00:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc0c4cc0 con 0x7f85dc06d980 2023-11-28T17:00:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc0c51c0 con 0x7f85dc06d980 2023-11-28T17:00:19.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.244+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc04e890 con 0x7f85dc06d980 2023-11-28T17:00:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.248+0000 7f85d3fff640 1 -- 172.21.15.26:0/1391570788 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f85cc0b2380 con 0x7f85dc06d980 2023-11-28T17:00:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.248+0000 7f85d3fff640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85bc0668d0 0x7f85bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:00:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.248+0000 7f85d3fff640 1 -- 172.21.15.26:0/1391570788 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f85cc0a7070 con 0x7f85dc06d980 2023-11-28T17:00:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.248+0000 7f85d27fc640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85bc0668d0 0x7f85bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:00:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.248+0000 7f85d27fc640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85bc0668d0 0x7f85bc068d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f85dc071d60 tx=0x7f85c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:00:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.252+0000 7f85d3fff640 1 -- 172.21.15.26:0/1391570788 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85cc0ebdf0 con 0x7f85dc06d980 2023-11-28T17:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85dc06ce10 con 0x7f85dc06d980 2023-11-28T17:00:19.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85d3fff640 1 -- 172.21.15.26:0/1391570788 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3690 (secure 0 0 0) 0x7f85cc0ef410 con 0x7f85dc06d980 2023-11-28T17:00:19.443 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-11-28T17:00:19.444 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/219398974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":219398974},{"type":"v1","addr":"172.21.15.26:6834","nonce":219398974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5717,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/334143700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":334143700},{"type":"v1","addr":"172.21.15.79:6837","nonce":334143700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6206,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2061282803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2061282803},{"type":"v1","addr":"172.21.15.79:6835","nonce":2061282803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":7047,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/101094954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":101094954},{"type":"v1","addr":"172.21.15.26:6835","nonce":101094954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2023-11-28T17:00:19.444 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 55 2023-11-28T17:00:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85bc0668d0 msgr2=0x7f85bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85bc0668d0 0x7f85bc068d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f85dc071d60 tx=0x7f85c4008040 comp rx=0 tx=0).stop 2023-11-28T17:00:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc06d980 msgr2=0x7f85dc154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:00:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc06d980 0x7f85dc154390 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0ac040 tx=0x7f85cc01ad10 comp rx=0 tx=0).stop 2023-11-28T17:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 shutdown_connections 2023-11-28T17:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc14e2c0 0x7f85dc14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:6832/7430110,v1:172.21.15.79:6833/7430110] conn(0x7f85bc0668d0 0x7f85bc068d90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85dc0ab3b0 0x7f85dc14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 --2- 172.21.15.26:0/1391570788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85dc06d980 0x7f85dc154390 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 >> 172.21.15.26:0/1391570788 conn(0x7f85dc0c2ad0 msgr2=0x7f85dc0a8470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 shutdown_connections 2023-11-28T17:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-11-28T17:00:19.440+0000 7f85e1565640 1 -- 172.21.15.26:0/1391570788 wait complete. 2023-11-28T17:00:19.464 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T17:00:19.465 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T17:00:19.465 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T17:00:19.465 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:19.477 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T17:00:19.478 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T17:00:19.478 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:19.538 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T17:00:19.538 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T17:00:19.538 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:19.553 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T17:00:19.553 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T17:00:19.554 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:19.614 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T17:00:19.614 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T17:00:19.614 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T17:00:19.615 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:19.674 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T17:00:19.675 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T17:00:19.675 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:25.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-28T17:00:25.777 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T17:00:25.778 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T17:00:25.778 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:25.859 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T17:00:25.860 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T17:00:25.860 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:31.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-28T17:00:31.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-28T17:00:31.962 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T17:00:31.962 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T17:00:31.963 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.023 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T17:00:32.024 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T17:00:32.024 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.111 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T17:00:32.112 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T17:00:32.112 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.203 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T17:00:32.203 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T17:00:32.204 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.279 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T17:00:32.280 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T17:00:32.280 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T17:00:32.280 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.335 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T17:00:32.335 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T17:00:32.335 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.391 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T17:00:32.391 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T17:00:32.391 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T17:00:32.392 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.412 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T17:00:32.413 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T17:00:32.413 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.430 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T17:00:32.430 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T17:00:32.430 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:00:32.487 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T17:00:32.487 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T17:00:32.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-28T17:00:32.519 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T17:00:32.519 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T17:00:32.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T17:00:32.786 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T17:00:33.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T17:00:33.010 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T17:00:33.200 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T17:00:33.200 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T17:00:33.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T17:00:33.427 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T17:00:33.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T17:00:33.722 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T17:00:33.889 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T17:00:33.890 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T17:00:34.012 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T17:00:34.012 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T17:00:34.137 INFO:tasks.ceph:Archiving mon data... 2023-11-28T17:00:34.138 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/data/mon.a.tgz 2023-11-28T17:00:34.138 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-11-28T17:00:34.148 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.jydiVKctnb 2023-11-28T17:00:34.149 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jydiVKctnb 2023-11-28T17:00:34.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.jydiVKctnb 2023-11-28T17:00:34.386 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.jydiVKctnb is 452KB 2023-11-28T17:00:34.451 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.jydiVKctnb 2023-11-28T17:00:34.460 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/data/mon.b.tgz 2023-11-28T17:00:34.461 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-11-28T17:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.0Sm4lFig53 2023-11-28T17:00:34.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0Sm4lFig53 2023-11-28T17:00:34.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.0Sm4lFig53 2023-11-28T17:00:34.727 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.0Sm4lFig53 is 581KB 2023-11-28T17:00:34.793 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.0Sm4lFig53 2023-11-28T17:00:34.801 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/data/mon.c.tgz 2023-11-28T17:00:34.801 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-11-28T17:00:34.850 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.I5WRmbwlaU 2023-11-28T17:00:34.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.I5WRmbwlaU 2023-11-28T17:00:35.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.I5WRmbwlaU 2023-11-28T17:00:35.108 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.I5WRmbwlaU is 581KB 2023-11-28T17:00:35.173 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.I5WRmbwlaU 2023-11-28T17:00:35.181 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T17:00:35.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T17:00:35.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T17:00:35.243 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T17:00:35.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T17:00:35.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T17:00:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T17:00:35.318 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T17:00:35.324 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T17:00:35.326 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/remote/smithi026/crash 2023-11-28T17:00:35.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T17:00:35.363 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/remote/smithi079/crash 2023-11-28T17:00:35.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T17:00:35.385 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T17:00:35.385 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:00:35.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:00:35.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T17:00:35.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T17:00:35.542 INFO:tasks.ceph:Compressing logs... 2023-11-28T17:00:35.542 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T17:00:35.552 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T17:00:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2023-11-28T17:00:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53735.log 2023-11-28T17:00:35.581 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52205.log 2023-11-28T17:00:35.581 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2023-11-28T17:00:35.582 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51904.log 2023-11-28T17:00:35.582 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53735.log.gz 2023-11-28T17:00:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42921.log 2023-11-28T17:00:35.583 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52205.log.gz 2023-11-28T17:00:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46158.log 2023-11-28T17:00:35.584 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51904.log.gz 2023-11-28T17:00:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50292.log 2023-11-28T17:00:35.586 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42921.log.gz 2023-11-28T17:00:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52176.log 2023-11-28T17:00:35.587 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46158.log.gz 2023-11-28T17:00:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51216.log 2023-11-28T17:00:35.587 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50292.log.gz 2023-11-28T17:00:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47399.log 2023-11-28T17:00:35.588 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52176.log.gz 2023-11-28T17:00:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42930.log 2023-11-28T17:00:35.589 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51216.log.gz 2023-11-28T17:00:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52838.log 2023-11-28T17:00:35.590 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47399.log.gz 2023-11-28T17:00:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47835.log 2023-11-28T17:00:35.591 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42930.log.gz 2023-11-28T17:00:35.592 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42923.log 2023-11-28T17:00:35.592 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52838.log.gz 2023-11-28T17:00:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48674.log 2023-11-28T17:00:35.593 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47835.log.gz 2023-11-28T17:00:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46368.log 2023-11-28T17:00:35.594 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42923.log.gz 2023-11-28T17:00:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51450.log 2023-11-28T17:00:35.595 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48674.log.gz 2023-11-28T17:00:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46368.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-28T17:00:35.596 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46368.log.gz 2023-11-28T17:00:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2023-11-28T17:00:35.597 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51450.log.gz 2023-11-28T17:00:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 2023-11-28T17:00:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2023-11-28T17:00:35.599 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2023-11-28T17:00:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52361.log 2023-11-28T17:00:35.600 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2023-11-28T17:00:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.44488.log 2023-11-28T17:00:35.601 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2023-11-28T17:00:35.602 INFO:teuthology.orchestra.run.smithi026.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-28T17:00:35.602 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46590.log 2023-11-28T17:00:35.603 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52361.log.gz 2023-11-28T17:00:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44488.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44488.log.gz 2023-11-28T17:00:35.604 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48996.log 2023-11-28T17:00:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44124.log 2023-11-28T17:00:35.605 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46590.log.gz 2023-11-28T17:00:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51966.log 2023-11-28T17:00:35.606 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48996.log.gz 2023-11-28T17:00:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42704.log 2023-11-28T17:00:35.607 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44124.log.gz 2023-11-28T17:00:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44384.log 2023-11-28T17:00:35.608 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51966.log.gz 2023-11-28T17:00:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45941.log 2023-11-28T17:00:35.609 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42704.log.gz 2023-11-28T17:00:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44384.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44384.log.gz 2023-11-28T17:00:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2023-11-28T17:00:35.611 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2023-11-28T17:00:35.611 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45941.log.gz 2023-11-28T17:00:35.611 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38519.log 2023-11-28T17:00:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50240.log 2023-11-28T17:00:35.612 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2023-11-28T17:00:35.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.44590.log 2023-11-28T17:00:35.614 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44730.log 2023-11-28T17:00:35.614 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2023-11-28T17:00:35.614 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50240.log: gzip -5 88.0% --verbose -- /var/log/ceph/ceph-client.admin.43147.log -- replaced with /var/log/ceph/ceph-client.admin.50240.log.gz 2023-11-28T17:00:35.614 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-11-28T17:00:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46876.log 2023-11-28T17:00:35.616 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44730.log.gz 2023-11-28T17:00:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45127.log 2023-11-28T17:00:35.616 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43147.log.gz 2023-11-28T17:00:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38519.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.38519.log.gz 2023-11-28T17:00:35.617 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.1.44476.log 2023-11-28T17:00:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.testuser.44590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.44590.log.gz 2023-11-28T17:00:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-28T17:00:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.1.44476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44476.log.gz 2023-11-28T17:00:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-28T17:00:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44325.log 2023-11-28T17:00:35.619 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38471.log 2023-11-28T17:00:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.1.44325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44325.log.gz 2023-11-28T17:00:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44372.log 2023-11-28T17:00:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49767.log 2023-11-28T17:00:35.621 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46876.log.gz 2023-11-28T17:00:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45127.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45127.log.gz /var/log/ceph/ceph-client.admin.53417.log 2023-11-28T17:00:35.621 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-11-28T17:00:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2023-11-28T17:00:35.621 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49767.log.gz 2023-11-28T17:00:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53547.log 2023-11-28T17:00:35.622 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53417.log.gz 2023-11-28T17:00:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50396.log 2023-11-28T17:00:35.622 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2023-11-28T17:00:35.624 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53547.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-28T17:00:35.624 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53547.log.gz 2023-11-28T17:00:35.624 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48051.log 2023-11-28T17:00:35.624 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50396.log.gz 2023-11-28T17:00:35.625 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54418.log 2023-11-28T17:00:35.625 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38471.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-28T17:00:35.626 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38471.log.gz 2023-11-28T17:00:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.1.44372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44372.log.gz 2023-11-28T17:00:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38375.log 2023-11-28T17:00:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-28T17:00:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38375.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38375.log.gz 2023-11-28T17:00:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T17:00:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-28T17:00:35.627 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38447.log 2023-11-28T17:00:35.627 INFO:teuthology.orchestra.run.smithi079.stderr: 92.3%/var/log/ceph/ceph-mon.c.log: -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50526.log 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48051.log.gz 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48114.log 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54418.log.gz 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42940.log 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50526.log.gz 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48114.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48114.log.gz 2023-11-28T17:00:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52890.log 2023-11-28T17:00:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T17:00:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38447.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38447.log.gz 2023-11-28T17:00:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44533.log 2023-11-28T17:00:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50065.log 2023-11-28T17:00:35.632 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42940.log.gz 2023-11-28T17:00:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2023-11-28T17:00:35.632 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52890.log.gz 2023-11-28T17:00:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54782.log 2023-11-28T17:00:35.632 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50065.log.gz 2023-11-28T17:00:35.634 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46236.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2023-11-28T17:00:35.634 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47094.log 2023-11-28T17:00:35.634 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38176.log 2023-11-28T17:00:35.635 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54782.log.gz 2023-11-28T17:00:35.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38495.log 2023-11-28T17:00:35.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.1.44533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44533.log.gz 2023-11-28T17:00:35.636 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44177.log 2023-11-28T17:00:35.636 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38495.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38495.log.gz 2023-11-28T17:00:35.636 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T17:00:35.636 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-28T17:00:35.636 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.1.44177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44177.log.gz 2023-11-28T17:00:35.637 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38543.log 2023-11-28T17:00:35.638 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42678.log 2023-11-28T17:00:35.638 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47094.log.gz 2023-11-28T17:00:35.639 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51558.log 2023-11-28T17:00:35.639 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38176.log.gz 2023-11-28T17:00:35.639 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42678.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42678.log.gz 2023-11-28T17:00:35.639 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48140.log 2023-11-28T17:00:35.639 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51558.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51558.log.gz 2023-11-28T17:00:35.639 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50370.log 2023-11-28T17:00:35.642 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44047.log 2023-11-28T17:00:35.642 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38543.log: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-28T17:00:35.642 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38543.log.gz 2023-11-28T17:00:35.642 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44223.log 2023-11-28T17:00:35.642 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.1.44047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44047.log.gz 2023-11-28T17:00:35.643 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38423.log 2023-11-28T17:00:35.643 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52864.log 2023-11-28T17:00:35.644 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48140.log.gz 2023-11-28T17:00:35.644 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2023-11-28T17:00:35.644 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50370.log.gz 2023-11-28T17:00:35.644 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2023-11-28T17:00:35.644 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52864.log.gz 2023-11-28T17:00:35.644 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46642.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2023-11-28T17:00:35.644 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49929.log 2023-11-28T17:00:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49479.log 2023-11-28T17:00:35.645 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2023-11-28T17:00:35.646 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.1.44223.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-28T17:00:35.647 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44223.log.gz 2023-11-28T17:00:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38423.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38423.log.gz 2023-11-28T17:00:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-28T17:00:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38399.log 2023-11-28T17:00:35.648 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49559.log 2023-11-28T17:00:35.648 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49929.log.gz 2023-11-28T17:00:35.648 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49479.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49479.log.gz 2023-11-28T17:00:35.648 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43146.log 2023-11-28T17:00:35.648 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49559.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49559.log.gz 2023-11-28T17:00:35.649 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2023-11-28T17:00:35.649 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43146.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43146.log.gz 2023-11-28T17:00:35.649 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53174.log 2023-11-28T17:00:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.38399.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38399.log.gz 2023-11-28T17:00:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-28T17:00:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45049.log 2023-11-28T17:00:35.651 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2023-11-28T17:00:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46668.log 2023-11-28T17:00:35.651 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53174.log.gz 2023-11-28T17:00:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45049.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.45049.log.gz --verbose 2023-11-28T17:00:35.652 INFO:teuthology.orchestra.run.smithi026.stderr: -- /var/log/ceph/ceph-client.admin.45783.log 2023-11-28T17:00:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46668.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46668.log.gz 2023-11-28T17:00:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52569.log 2023-11-28T17:00:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45783.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.51776.log -- replaced with /var/log/ceph/ceph-client.admin.45783.log.gz 2023-11-28T17:00:35.653 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-11-28T17:00:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52569.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52569.log.gz 2023-11-28T17:00:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42490.log 2023-11-28T17:00:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43356.log 2023-11-28T17:00:35.655 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2023-11-28T17:00:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42490.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42490.log.gz 2023-11-28T17:00:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54574.log 2023-11-28T17:00:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43900.log 2023-11-28T17:00:35.657 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43356.log.gz 2023-11-28T17:00:35.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54574.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54574.log.gz 2023-11-28T17:00:35.658 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49903.log 2023-11-28T17:00:35.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54704.log 2023-11-28T17:00:35.659 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43900.log.gz 2023-11-28T17:00:35.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49903.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49903.log.gz 2023-11-28T17:00:35.660 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2023-11-28T17:00:35.660 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45511.log 2023-11-28T17:00:35.661 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54704.log.gz 2023-11-28T17:00:35.661 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2023-11-28T17:00:35.662 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2023-11-28T17:00:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51372.log 2023-11-28T17:00:35.663 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45511.log.gz 2023-11-28T17:00:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48728.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2023-11-28T17:00:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2023-11-28T17:00:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45835.log 2023-11-28T17:00:35.665 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51372.log.gz 2023-11-28T17:00:35.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48560.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2023-11-28T17:00:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45283.log 2023-11-28T17:00:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45367.log 2023-11-28T17:00:35.667 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45835.log.gz 2023-11-28T17:00:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45283.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45283.log.gz 2023-11-28T17:00:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2023-11-28T17:00:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45367.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45367.log.gz 2023-11-28T17:00:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2023-11-28T17:00:35.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54808.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2023-11-28T17:00:35.670 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52623.log 2023-11-28T17:00:35.671 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2023-11-28T17:00:35.671 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2023-11-28T17:00:35.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43718.log 2023-11-28T17:00:35.672 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52623.log.gz 2023-11-28T17:00:35.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2023-11-28T17:00:35.673 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2023-11-28T17:00:35.674 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51476.log 2023-11-28T17:00:35.674 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43718.log.gz 2023-11-28T17:00:35.675 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44644.log 2023-11-28T17:00:35.675 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2023-11-28T17:00:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2023-11-28T17:00:35.676 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51476.log.gz 2023-11-28T17:00:35.677 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43352.log 2023-11-28T17:00:35.677 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44644.log.gz 2023-11-28T17:00:35.678 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42834.log: gzip -5 88.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz -- 2023-11-28T17:00:35.678 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.43874.log 2023-11-28T17:00:35.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2023-11-28T17:00:35.679 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43352.log.gz 2023-11-28T17:00:35.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43874.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43874.log.gz 2023-11-28T17:00:35.680 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54912.log 2023-11-28T17:00:35.681 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2023-11-28T17:00:35.681 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2023-11-28T17:00:35.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43981.log 2023-11-28T17:00:35.682 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54912.log.gz 2023-11-28T17:00:35.683 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51013.log 2023-11-28T17:00:35.683 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2023-11-28T17:00:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43981.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43981.log.gz 2023-11-28T17:00:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52465.log 2023-11-28T17:00:35.685 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2023-11-28T17:00:35.685 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51013.log.gz 2023-11-28T17:00:35.686 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43588.log 2023-11-28T17:00:35.686 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52465.log.gz 2023-11-28T17:00:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52439.log 2023-11-28T17:00:35.687 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2023-11-28T17:00:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43588.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43588.log.gz 2023-11-28T17:00:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45179.log 2023-11-28T17:00:35.689 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52439.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-28T17:00:35.689 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52439.log.gz 2023-11-28T17:00:35.690 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49048.log 2023-11-28T17:00:35.690 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45179.log.gz 2023-11-28T17:00:35.691 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43666.log 2023-11-28T17:00:35.692 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45433.log 2023-11-28T17:00:35.692 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49048.log.gz 2023-11-28T17:00:35.693 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46772.log 2023-11-28T17:00:35.693 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43666.log.gz 2023-11-28T17:00:35.697 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45433.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2023-11-28T17:00:35.699 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.52977.log 2023-11-28T17:00:35.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51592.log 2023-11-28T17:00:35.699 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2023-11-28T17:00:35.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.testuser.52977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.52977.log.gz 2023-11-28T17:00:35.700 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47939.log 2023-11-28T17:00:35.700 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2023-11-28T17:00:35.700 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51592.log.gz 2023-11-28T17:00:35.700 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53521.log 2023-11-28T17:00:35.700 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47939.log.gz 2023-11-28T17:00:35.701 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53443.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2023-11-28T17:00:35.701 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51138.log 2023-11-28T17:00:35.702 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53521.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53521.log.gz 2023-11-28T17:00:35.702 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52649.log 2023-11-28T17:00:35.703 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51138.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51138.log.gz 2023-11-28T17:00:35.703 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49955.log 2023-11-28T17:00:35.704 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47062.log 2023-11-28T17:00:35.704 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52649.log.gz 2023-11-28T17:00:35.705 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49955.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49955.log.gz 2023-11-28T17:00:35.705 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2023-11-28T17:00:35.706 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47347.log 2023-11-28T17:00:35.706 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47062.log.gz 2023-11-28T17:00:35.707 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42320.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2023-11-28T17:00:35.707 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45915.log 2023-11-28T17:00:35.708 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.4.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-28T17:00:35.709 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52096.log 2023-11-28T17:00:35.709 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47347.log.gz 2023-11-28T17:00:35.709 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45915.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45915.log.gz 2023-11-28T17:00:35.710 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-28T17:00:35.711 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2023-11-28T17:00:35.711 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52096.log.gz 2023-11-28T17:00:35.712 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53891.log 2023-11-28T17:00:35.713 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44756.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2023-11-28T17:00:35.713 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2023-11-28T17:00:35.714 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42782.log 2023-11-28T17:00:35.715 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53891.log.gz 2023-11-28T17:00:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53839.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2023-11-28T17:00:35.716 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54092.log 2023-11-28T17:00:35.717 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50883.log 2023-11-28T17:00:35.717 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42782.log.gz 2023-11-28T17:00:35.718 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54092.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54092.log.gz 2023-11-28T17:00:35.718 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54967.log 2023-11-28T17:00:35.719 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45023.log 2023-11-28T17:00:35.720 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50883.log.gz 2023-11-28T17:00:35.720 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54967.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54967.log.gz 2023-11-28T17:00:35.721 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43353.log 2023-11-28T17:00:35.722 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49611.log 2023-11-28T17:00:35.722 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-28T17:00:35.723 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45023.log.gz 2023-11-28T17:00:35.723 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43353.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43353.log.gz 2023-11-28T17:00:35.723 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53917.log 2023-11-28T17:00:35.724 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48806.log 2023-11-28T17:00:35.725 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49611.log.gz 2023-11-28T17:00:35.725 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53917.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53917.log.gz 2023-11-28T17:00:35.726 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51802.log 2023-11-28T17:00:35.727 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51672.log 2023-11-28T17:00:35.727 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48806.log.gz 2023-11-28T17:00:35.728 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51802.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51802.log.gz 2023-11-28T17:00:35.728 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54678.log 2023-11-28T17:00:35.729 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54652.log 2023-11-28T17:00:35.730 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51672.log.gz 2023-11-28T17:00:35.730 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54678.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54678.log.gz 2023-11-28T17:00:35.730 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51644.log 2023-11-28T17:00:35.731 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47731.log 2023-11-28T17:00:35.732 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54652.log.gz 2023-11-28T17:00:35.732 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51644.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51644.log.gz 2023-11-28T17:00:35.733 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2023-11-28T17:00:35.734 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46746.log 2023-11-28T17:00:35.734 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47731.log.gz 2023-11-28T17:00:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47686.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2023-11-28T17:00:35.736 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51950.log 2023-11-28T17:00:35.737 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53709.log 2023-11-28T17:00:35.737 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46746.log.gz 2023-11-28T17:00:35.738 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.51950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51950.log.gz 2023-11-28T17:00:35.738 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45967.log 2023-11-28T17:00:35.739 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42570.log 2023-11-28T17:00:35.740 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53709.log.gz 2023-11-28T17:00:35.740 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45967.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45967.log.gz 2023-11-28T17:00:35.741 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49206.log 2023-11-28T17:00:35.742 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51424.log 2023-11-28T17:00:35.742 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42570.log.gz 2023-11-28T17:00:35.743 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49206.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49206.log.gz 2023-11-28T17:00:35.743 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50422.log 2023-11-28T17:00:35.744 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2023-11-28T17:00:35.745 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51424.log.gz 2023-11-28T17:00:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50422.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50422.log.gz 2023-11-28T17:00:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49321.log 2023-11-28T17:00:35.747 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43339.log 2023-11-28T17:00:35.748 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2023-11-28T17:00:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49321.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49321.log.gz 2023-11-28T17:00:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46512.log 2023-11-28T17:00:35.750 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43339.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43339.log.gz 2023-11-28T17:00:35.750 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47477.log 2023-11-28T17:00:35.751 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46512.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46512.log.gz 2023-11-28T17:00:35.752 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54548.log 2023-11-28T17:00:35.753 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2023-11-28T17:00:35.753 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47477.log.gz 2023-11-28T17:00:35.754 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54548.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54548.log.gz 2023-11-28T17:00:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2023-11-28T17:00:35.756 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49845.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz /var/log/ceph/ceph-client.admin.47861.log 2023-11-28T17:00:35.756 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-11-28T17:00:35.758 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47660.log 2023-11-28T17:00:35.758 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2023-11-28T17:00:35.759 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46538.log 2023-11-28T17:00:35.759 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47861.log.gz 2023-11-28T17:00:35.761 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51992.log 2023-11-28T17:00:35.761 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47660.log.gz 2023-11-28T17:00:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46538.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46538.log.gz 2023-11-28T17:00:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43770.log 2023-11-28T17:00:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51992.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51992.log.gz 2023-11-28T17:00:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50136.log 2023-11-28T17:00:35.765 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51084.log 2023-11-28T17:00:35.766 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43770.log.gz 2023-11-28T17:00:35.766 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50136.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50136.log.gz 2023-11-28T17:00:35.767 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48272.log 2023-11-28T17:00:35.768 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47010.log 2023-11-28T17:00:35.769 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51084.log.gz 2023-11-28T17:00:35.769 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2023-11-28T17:00:35.770 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48272.log.gz 2023-11-28T17:00:35.770 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47010.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47010.log.gz 2023-11-28T17:00:35.771 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2023-11-28T17:00:35.772 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44834.log 2023-11-28T17:00:35.773 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gz 2023-11-28T17:00:35.773 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42287.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2023-11-28T17:00:35.773 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54222.log 2023-11-28T17:00:35.775 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44834.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44834.log.gz 2023-11-28T17:00:35.775 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33340.log 2023-11-28T17:00:35.776 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54222.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54222.log.gz 2023-11-28T17:00:35.777 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53657.log 2023-11-28T17:00:35.778 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.tmp-client.admin.33340.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33340.log.gz 2023-11-28T17:00:35.778 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48934.log 2023-11-28T17:00:35.779 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53657.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53657.log.gz 2023-11-28T17:00:35.780 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52786.log 2023-11-28T17:00:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42542.log 2023-11-28T17:00:35.781 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48934.log.gz 2023-11-28T17:00:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52786.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52786.log.gz 2023-11-28T17:00:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46314.log 2023-11-28T17:00:35.783 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52413.log 2023-11-28T17:00:35.784 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2023-11-28T17:00:35.784 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46314.log.gz 2023-11-28T17:00:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45749.log 2023-11-28T17:00:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52413.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52413.log.gz 2023-11-28T17:00:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2023-11-28T17:00:35.788 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45749.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45749.log.gz 2023-11-28T17:00:35.788 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2023-11-28T17:00:35.789 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43136.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2023-11-28T17:00:35.790 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46142.log 2023-11-28T17:00:35.791 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50474.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz 2023-11-28T17:00:35.791 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49152.log 2023-11-28T17:00:35.792 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.46142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46142.log.gz 2023-11-28T17:00:35.793 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42860.log 2023-11-28T17:00:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49152.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49152.log.gz 2023-11-28T17:00:35.794 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44332.log 2023-11-28T17:00:35.796 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48246.log 2023-11-28T17:00:35.796 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42860.log.gz 2023-11-28T17:00:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44332.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2023-11-28T17:00:35.797 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2023-11-28T17:00:35.798 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53282.log 2023-11-28T17:00:35.799 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48246.log.gz 2023-11-28T17:00:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50344.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz 2023-11-28T17:00:35.800 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50753.log 2023-11-28T17:00:35.801 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2023-11-28T17:00:35.802 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53282.log.gz 2023-11-28T17:00:35.803 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50753.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50753.log.gz 2023-11-28T17:00:35.803 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-28T17:00:35.804 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38412.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2023-11-28T17:00:35.805 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53334.log 2023-11-28T17:00:35.806 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2023-11-28T17:00:35.807 INFO:teuthology.orchestra.run.smithi079.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-28T17:00:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43142.log 2023-11-28T17:00:35.808 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53334.log.gz 2023-11-28T17:00:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54444.log 2023-11-28T17:00:35.809 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2023-11-28T17:00:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48480.log 2023-11-28T17:00:35.811 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43142.log.gz 2023-11-28T17:00:35.812 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53204.log 2023-11-28T17:00:35.812 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54444.log.gz 2023-11-28T17:00:35.813 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42411.log 2023-11-28T17:00:35.813 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48480.log.gz 2023-11-28T17:00:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53761.log 2023-11-28T17:00:35.815 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53204.log.gz 2023-11-28T17:00:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51398.log 2023-11-28T17:00:35.816 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42411.log.gz 2023-11-28T17:00:35.818 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53761.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53761.log.gz 2023-11-28T17:00:35.818 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54118.log 2023-11-28T17:00:35.819 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54170.log 2023-11-28T17:00:35.819 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51398.log.gz 2023-11-28T17:00:35.821 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45205.log 2023-11-28T17:00:35.821 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54118.log.gz 2023-11-28T17:00:35.822 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51828.log 2023-11-28T17:00:35.822 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54170.log.gz 2023-11-28T17:00:35.823 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45205.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45205.log.gz 2023-11-28T17:00:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51274.log 2023-11-28T17:00:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46616.log 2023-11-28T17:00:35.825 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51828.log.gz 2023-11-28T17:00:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51502.log 2023-11-28T17:00:35.826 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51274.log.gz 2023-11-28T17:00:35.828 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45537.log 2023-11-28T17:00:35.828 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46616.log.gz 2023-11-28T17:00:35.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2023-11-28T17:00:35.830 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51502.log.gz 2023-11-28T17:00:35.830 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53605.log 2023-11-28T17:00:35.831 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45537.log.gz 2023-11-28T17:00:35.832 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2023-11-28T17:00:35.833 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz 2023-11-28T17:00:35.834 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52543.log 2023-11-28T17:00:35.834 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53605.log.gz 2023-11-28T17:00:35.835 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49689.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz -- 2023-11-28T17:00:35.835 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.52122.log 2023-11-28T17:00:35.837 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50961.log 2023-11-28T17:00:35.837 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52543.log.gz 2023-11-28T17:00:35.838 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44540.log 2023-11-28T17:00:35.839 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52122.log.gz 2023-11-28T17:00:35.839 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48194.log 2023-11-28T17:00:35.839 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50961.log.gz 2023-11-28T17:00:35.841 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43338.log 2023-11-28T17:00:35.841 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44540.log.gz 2023-11-28T17:00:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48194.log: gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48194.log.gz -- 2023-11-28T17:00:35.843 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.53988.log 2023-11-28T17:00:35.844 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43128.log 2023-11-28T17:00:35.844 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43338.log.gz 2023-11-28T17:00:35.845 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53988.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-28T17:00:35.846 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53988.log.gz 2023-11-28T17:00:35.847 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50162.log 2023-11-28T17:00:35.847 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43128.log.gz 2023-11-28T17:00:35.848 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51242.log 2023-11-28T17:00:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50162.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50162.log.gz -5 2023-11-28T17:00:35.850 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54196.log 2023-11-28T17:00:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53865.log 2023-11-28T17:00:35.852 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51242.log.gz 2023-11-28T17:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.50120.log 2023-11-28T17:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54196.log.gz 2023-11-28T17:00:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53865.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53865.log.gz 2023-11-28T17:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44618.log 2023-11-28T17:00:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.testuser.50120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.50120.log.gz 2023-11-28T17:00:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43355.log 2023-11-28T17:00:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46798.log 2023-11-28T17:00:35.858 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44618.log.gz 2023-11-28T17:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50033.log 2023-11-28T17:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43355.log.gz 2023-11-28T17:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46798.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.46798.log.gz 2023-11-28T17:00:35.861 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49715.log 2023-11-28T17:00:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50033.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50033.log.gz 2023-11-28T17:00:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46456.log 2023-11-28T17:00:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46850.log 2023-11-28T17:00:35.864 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49715.log.gz 2023-11-28T17:00:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46456.log: gzip -5 --verbose 89.5% -- /var/log/ceph/ceph-client.admin.50552.log -- replaced with /var/log/ceph/ceph-client.admin.46456.log.gz 2023-11-28T17:00:35.865 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-11-28T17:00:35.867 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46850.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.44202.log 2023-11-28T17:00:35.867 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46850.log.gz 2023-11-28T17:00:35.868 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50552.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.50552.log.gz -5 2023-11-28T17:00:35.868 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50318.log 2023-11-28T17:00:35.870 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48088.log 2023-11-28T17:00:35.870 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2023-11-28T17:00:35.871 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52148.log 2023-11-28T17:00:35.871 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50318.log.gz 2023-11-28T17:00:35.873 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43692.log 2023-11-28T17:00:35.873 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48088.log.gz 2023-11-28T17:00:35.874 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2023-11-28T17:00:35.874 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52148.log.gz 2023-11-28T17:00:35.875 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53148.log 2023-11-28T17:00:35.876 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43692.log.gz 2023-11-28T17:00:35.877 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52283.log 2023-11-28T17:00:35.877 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gz 2023-11-28T17:00:35.879 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49505.log 2023-11-28T17:00:35.879 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53148.log.gz 2023-11-28T17:00:35.880 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53122.log 2023-11-28T17:00:35.880 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52283.log.gz 2023-11-28T17:00:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49505.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49505.log.gz -5 2023-11-28T17:00:35.882 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45863.log 2023-11-28T17:00:35.883 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45101.log 2023-11-28T17:00:35.883 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53122.log.gz 2023-11-28T17:00:35.884 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45589.log 2023-11-28T17:00:35.885 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45863.log.gz 2023-11-28T17:00:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45101.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45101.log.gz -5 2023-11-28T17:00:35.886 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54991.log 2023-11-28T17:00:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52387.log 2023-11-28T17:00:35.888 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45589.log.gz 2023-11-28T17:00:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48648.log 2023-11-28T17:00:35.889 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54991.log.gz 2023-11-28T17:00:35.890 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52387.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52387.log.gz 2023-11-28T17:00:35.891 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53683.log 2023-11-28T17:00:35.892 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48648.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48648.log.gz 2023-11-28T17:00:35.892 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44592.log 2023-11-28T17:00:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51724.log 2023-11-28T17:00:35.894 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53683.log.gz 2023-11-28T17:00:35.895 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44592.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44592.log.gz 2023-11-28T17:00:35.896 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51618.log 2023-11-28T17:00:35.897 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42438.log 2023-11-28T17:00:35.897 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51724.log.gz 2023-11-28T17:00:35.899 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43148.log 2023-11-28T17:00:35.899 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51618.log.gz 2023-11-28T17:00:35.900 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42438.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42438.log.gz 2023-11-28T17:00:35.901 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42938.log 2023-11-28T17:00:35.901 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43148.log.gz 2023-11-28T17:00:35.902 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53096.log 2023-11-28T17:00:35.906 INFO:teuthology.orchestra.run.smithi079.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-28T17:00:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52760.log 2023-11-28T17:00:35.907 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42938.log.gz 2023-11-28T17:00:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50987.log 87.9% 2023-11-28T17:00:35.907 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53096.log.gz 2023-11-28T17:00:35.908 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53018.log 2023-11-28T17:00:35.908 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52760.log.gz 2023-11-28T17:00:35.909 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54886.log 2023-11-28T17:00:35.909 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50987.log.gz 2023-11-28T17:00:35.910 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2023-11-28T17:00:35.910 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53018.log.gz 2023-11-28T17:00:35.911 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2023-11-28T17:00:35.912 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54886.log.gz 2023-11-28T17:00:35.913 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46720.log 2023-11-28T17:00:35.913 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2023-11-28T17:00:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45889.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2023-11-28T17:00:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46720.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46720.log.gz 2023-11-28T17:00:35.916 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50656.log 2023-11-28T17:00:35.917 INFO:teuthology.orchestra.run.smithi079.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-28T17:00:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53360.log 2023-11-28T17:00:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50656.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50656.log.gz -5 2023-11-28T17:00:35.919 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47608.log 2023-11-28T17:00:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47783.log 2023-11-28T17:00:35.921 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53360.log.gz 2023-11-28T17:00:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2023-11-28T17:00:35.922 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47608.log.gz 2023-11-28T17:00:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52309.log 2023-11-28T17:00:35.924 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47783.log.gz 2023-11-28T17:00:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48980.log 2023-11-28T17:00:35.925 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2023-11-28T17:00:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52309.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52309.log.gz -- 2023-11-28T17:00:35.927 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph.log 2023-11-28T17:00:35.927 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.48980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48980.log.gz 2023-11-28T17:00:35.928 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54522.log 2023-11-28T17:00:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2023-11-28T17:00:35.931 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54522.log: 87.7% 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T17:00:35.932 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54522.log.gz 2023-11-28T17:00:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46430.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2023-11-28T17:00:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45993.log 2023-11-28T17:00:35.934 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52678.log 2023-11-28T17:00:35.936 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2023-11-28T17:00:35.936 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45993.log.gz 2023-11-28T17:00:35.937 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44514.log 2023-11-28T17:00:35.938 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52678.log.gz 2023-11-28T17:00:35.939 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54014.log 2023-11-28T17:00:35.939 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz 2023-11-28T17:00:35.940 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43131.log 2023-11-28T17:00:35.940 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44514.log.gz 2023-11-28T17:00:35.942 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51164.log 2023-11-28T17:00:35.942 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54014.log.gz 2023-11-28T17:00:35.943 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52044.log 2023-11-28T17:00:35.943 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43131.log.gz 2023-11-28T17:00:35.945 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49877.log 2023-11-28T17:00:35.945 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51164.log.gz 2023-11-28T17:00:35.946 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52044.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52044.log.gz 2023-11-28T17:00:35.946 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2023-11-28T17:00:35.948 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2023-11-28T17:00:35.948 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49877.log.gz 2023-11-28T17:00:35.949 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45075.log 2023-11-28T17:00:35.949 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2023-11-28T17:00:35.951 INFO:teuthology.orchestra.run.smithi079.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-28T17:00:35.951 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54248.log 2023-11-28T17:00:35.952 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2023-11-28T17:00:35.953 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46958.log 2023-11-28T17:00:35.953 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45075.log.gz 2023-11-28T17:00:35.954 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42756.log 2023-11-28T17:00:35.954 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54248.log.gz 2023-11-28T17:00:35.955 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53579.log 2023-11-28T17:00:35.955 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46958.log.gz 2023-11-28T17:00:35.956 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42756.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42756.log.gz 2023-11-28T17:00:35.957 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46564.log 2023-11-28T17:00:35.958 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2023-11-28T17:00:35.958 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53579.log.gz 2023-11-28T17:00:35.959 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50188.log 2023-11-28T17:00:35.960 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46564.log.gz 2023-11-28T17:00:35.961 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52335.log 2023-11-28T17:00:35.961 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2023-11-28T17:00:35.962 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54600.log 2023-11-28T17:00:35.963 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50188.log.gz 2023-11-28T17:00:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46984.log 2023-11-28T17:00:35.964 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52335.log.gz 2023-11-28T17:00:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53631.log 2023-11-28T17:00:35.966 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54600.log.gz 2023-11-28T17:00:35.967 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46984.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46984.log.gz 2023-11-28T17:00:35.967 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44670.log 2023-11-28T17:00:35.969 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44891.log 2023-11-28T17:00:35.969 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53631.log.gz 2023-11-28T17:00:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50779.log 2023-11-28T17:00:35.970 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44670.log.gz 2023-11-28T17:00:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54834.log 2023-11-28T17:00:35.972 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44891.log.gz 2023-11-28T17:00:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54756.log 2023-11-28T17:00:35.973 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50779.log.gz 2023-11-28T17:00:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2023-11-28T17:00:35.975 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54834.log.gz 2023-11-28T17:00:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54756.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54756.log.gz 2023-11-28T17:00:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51306.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2023-11-28T17:00:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45485.log 2023-11-28T17:00:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48400.log 2023-11-28T17:00:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2023-11-28T17:00:35.981 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45485.log.gz 2023-11-28T17:00:35.982 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47321.log 2023-11-28T17:00:35.982 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48400.log.gz 2023-11-28T17:00:35.984 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45809.log 2023-11-28T17:00:35.984 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2023-11-28T17:00:35.985 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50831.log 2023-11-28T17:00:35.985 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47321.log.gz 2023-11-28T17:00:35.987 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45809.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.45809.log.gz --verbose 2023-11-28T17:00:35.987 INFO:teuthology.orchestra.run.smithi026.stderr: -- /var/log/ceph/ceph-client.admin.49178.log 2023-11-28T17:00:35.988 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44280.log 2023-11-28T17:00:35.988 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50831.log.gz 2023-11-28T17:00:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49178.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.42937.log -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2023-11-28T17:00:35.990 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-11-28T17:00:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43848.log 2023-11-28T17:00:35.991 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44280.log.gz 2023-11-28T17:00:35.993 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48336.log 2023-11-28T17:00:35.993 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42937.log.gz 2023-11-28T17:00:35.994 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43848.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43848.log.gz 2023-11-28T17:00:35.995 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52922.log 2023-11-28T17:00:35.995 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48336.log.gz 2023-11-28T17:00:35.996 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2023-11-28T17:00:35.997 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52922.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52922.log.gz 2023-11-28T17:00:35.998 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2023-11-28T17:00:35.999 INFO:teuthology.orchestra.run.smithi079.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-28T17:00:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44306.log 2023-11-28T17:00:36.000 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2023-11-28T17:00:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2023-11-28T17:00:36.001 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2023-11-28T17:00:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54300.log 2023-11-28T17:00:36.002 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44306.log.gz 2023-11-28T17:00:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44358.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2023-11-28T17:00:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54144.log 2023-11-28T17:00:36.005 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54300.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54300.log.gz 2023-11-28T17:00:36.006 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2023-11-28T17:00:36.007 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2023-11-28T17:00:36.008 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54144.log.gz 2023-11-28T17:00:36.008 INFO:teuthology.orchestra.run.smithi026.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-28T17:00:36.009 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49453.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2023-11-28T17:00:36.010 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50007.log 2023-11-28T17:00:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54860.log 2023-11-28T17:00:36.011 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2023-11-28T17:00:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50007.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50007.log.gz 2023-11-28T17:00:36.012 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2023-11-28T17:00:36.012 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42652.log 2023-11-28T17:00:36.013 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54860.log.gz 2023-11-28T17:00:36.014 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43139.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2023-11-28T17:00:36.014 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54328.log 2023-11-28T17:00:36.015 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2023-11-28T17:00:36.015 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42652.log.gz 2023-11-28T17:00:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54328.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54328.log.gz 2023-11-28T17:00:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44254.log 2023-11-28T17:00:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47504.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2023-11-28T17:00:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52597.log 2023-11-28T17:00:36.019 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53962.log 2023-11-28T17:00:36.020 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44254.log.gz 2023-11-28T17:00:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52597.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52597.log.gz 2023-11-28T17:00:36.021 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42464.log 2023-11-28T17:00:36.021 INFO:teuthology.orchestra.run.smithi026.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-28T17:00:36.022 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2023-11-28T17:00:36.022 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53962.log.gz 2023-11-28T17:00:36.023 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46932.log 2023-11-28T17:00:36.024 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42464.log.gz 2023-11-28T17:00:36.024 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42886.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2023-11-28T17:00:36.025 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45231.log 2023-11-28T17:00:36.026 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42385.log 2023-11-28T17:00:36.026 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46932.log.gz 2023-11-28T17:00:36.027 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53813.log 2023-11-28T17:00:36.027 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45231.log.gz 2023-11-28T17:00:36.028 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42385.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42385.log.gz 2023-11-28T17:00:36.028 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T17:00:36.029 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48532.log 2023-11-28T17:00:36.029 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53813.log.gz 2023-11-28T17:00:36.030 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45615.log 2023-11-28T17:00:36.031 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48532.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48532.log.gz 2023-11-28T17:00:36.032 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.47149.log 2023-11-28T17:00:36.032 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T17:00:36.032 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45615.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-28T17:00:36.034 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45615.log.gz 2023-11-28T17:00:36.034 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.testuser.47149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.47149.log.gz 2023-11-28T17:00:36.034 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48588.log 2023-11-28T17:00:36.035 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46210.log 2023-11-28T17:00:36.036 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48588.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48588.log.gz 2023-11-28T17:00:36.036 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2023-11-28T17:00:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54730.log 2023-11-28T17:00:36.038 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46210.log.gz 2023-11-28T17:00:36.038 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47991.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2023-11-28T17:00:36.039 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54380.log 2023-11-28T17:00:36.040 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54730.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-28T17:00:36.040 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54730.log.gz 2023-11-28T17:00:36.041 INFO:teuthology.orchestra.run.smithi079.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-28T17:00:36.041 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54380.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54380.log.gz 2023-11-28T17:00:36.042 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2023-11-28T17:00:36.043 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-11-28T17:00:36.043 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m0.454s 2023-11-28T17:00:36.043 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m1.877s 2023-11-28T17:00:36.044 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.229s 2023-11-28T17:00:36.046 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43536.log 2023-11-28T17:00:36.046 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2023-11-28T17:00:36.046 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2023-11-28T17:00:36.047 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43536.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43536.log.gz 2023-11-28T17:00:36.047 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2023-11-28T17:00:36.048 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44566.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2023-11-28T17:00:36.048 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.51058.log 2023-11-28T17:00:36.049 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53469.log 2023-11-28T17:00:36.050 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2023-11-28T17:00:36.051 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50448.log 2023-11-28T17:00:36.051 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51058.log.gz 2023-11-28T17:00:36.052 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2023-11-28T17:00:36.053 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53469.log.gz 2023-11-28T17:00:36.054 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50448.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50448.log.gz 2023-11-28T17:00:36.054 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46184.log 2023-11-28T17:00:36.056 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2023-11-28T17:00:36.056 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2023-11-28T17:00:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46184.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46184.log.gz 2023-11-28T17:00:36.058 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54040.log 2023-11-28T17:00:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2023-11-28T17:00:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2023-11-28T17:00:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51190.log 2023-11-28T17:00:36.061 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54040.log.gz 2023-11-28T17:00:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44919.log 2023-11-28T17:00:36.062 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2023-11-28T17:00:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51530.log 2023-11-28T17:00:36.064 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51190.log.gz 2023-11-28T17:00:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50578.log 2023-11-28T17:00:36.065 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44919.log.gz 2023-11-28T17:00:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54938.log 2023-11-28T17:00:36.067 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51530.log.gz 2023-11-28T17:00:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54626.log 2023-11-28T17:00:36.068 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50578.log.gz 2023-11-28T17:00:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50909.log 2023-11-28T17:00:36.069 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54938.log.gz 2023-11-28T17:00:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51110.log 2023-11-28T17:00:36.071 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54626.log.gz 2023-11-28T17:00:36.072 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50909.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.50909.log.gz -5 2023-11-28T17:00:36.072 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53230.log 2023-11-28T17:00:36.074 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49981.log 2023-11-28T17:00:36.074 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51110.log.gz 2023-11-28T17:00:36.076 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48754.log 2023-11-28T17:00:36.076 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53230.log.gz 2023-11-28T17:00:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49981.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49981.log.gz 2023-11-28T17:00:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44997.log 2023-11-28T17:00:36.079 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2023-11-28T17:00:36.079 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48754.log.gz 2023-11-28T17:00:36.080 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44997.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49100.log 2023-11-28T17:00:36.080 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44997.log.gz 2023-11-28T17:00:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47243.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-28T17:00:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52018.log 2023-11-28T17:00:36.082 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2023-11-28T17:00:36.083 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49100.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49100.log.gz 2023-11-28T17:00:36.083 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54496.log 2023-11-28T17:00:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52018.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52018.log.gz 2023-11-28T17:00:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44095.log 2023-11-28T17:00:36.086 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 2023-11-28T17:00:36.086 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54496.log.gz 2023-11-28T17:00:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.44095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44095.log.gz 2023-11-28T17:00:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47191.log 2023-11-28T17:00:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48452.log 2023-11-28T17:00:36.088 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2023-11-28T17:00:36.089 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47191.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47191.log.gz 2023-11-28T17:00:36.089 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2023-11-28T17:00:36.090 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43744.log 2023-11-28T17:00:36.091 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48452.log.gz 2023-11-28T17:00:36.091 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53044.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2023-11-28T17:00:36.092 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45153.log 2023-11-28T17:00:36.093 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48884.log 2023-11-28T17:00:36.093 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43744.log.gz 2023-11-28T17:00:36.094 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45153.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45153.log.gz 2023-11-28T17:00:36.094 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2023-11-28T17:00:36.096 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47165.log 2023-11-28T17:00:36.096 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48884.log.gz 2023-11-28T17:00:36.097 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47913.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2023-11-28T17:00:36.097 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53256.log 2023-11-28T17:00:36.098 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42808.log 2023-11-28T17:00:36.099 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47165.log.gz 2023-11-28T17:00:36.100 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53256.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53256.log.gz 2023-11-28T17:00:36.100 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54274.log 2023-11-28T17:00:36.101 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42808.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42808.log.gz 2023-11-28T17:00:36.102 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48832.log 2023-11-28T17:00:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54274.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54274.log.gz 2023-11-28T17:00:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52992.log 2023-11-28T17:00:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48832.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gz 2023-11-28T17:00:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2023-11-28T17:00:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52992.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52992.log.gz 2023-11-28T17:00:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44228.log 2023-11-28T17:00:36.109 INFO:teuthology.orchestra.run.smithi026.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-28T17:00:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43926.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2023-11-28T17:00:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2023-11-28T17:00:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44228.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44228.log.gz 2023-11-28T17:00:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49349.log 2023-11-28T17:00:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49819.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2023-11-28T17:00:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51854.log 2023-11-28T17:00:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42598.log 2023-11-28T17:00:36.113 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49349.log.gz 2023-11-28T17:00:36.113 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2023-11-28T17:00:36.113 INFO:teuthology.orchestra.run.smithi026.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.51854.log.gz 2023-11-28T17:00:36.114 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38294.log 2023-11-28T17:00:36.114 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42598.log.gz 2023-11-28T17:00:36.115 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47809.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2023-11-28T17:00:36.115 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53308.log 2023-11-28T17:00:36.116 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47556.log 2023-11-28T17:00:36.117 INFO:teuthology.orchestra.run.smithi026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38294.log.gz 2023-11-28T17:00:36.117 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53308.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53308.log.gz 2023-11-28T17:00:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49126.log 2023-11-28T17:00:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48166.log 2023-11-28T17:00:36.119 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47556.log.gz 2023-11-28T17:00:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49126.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49126.log.gz 2023-11-28T17:00:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46262.log 2023-11-28T17:00:36.121 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54066.log 2023-11-28T17:00:36.121 INFO:teuthology.orchestra.run.smithi026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48166.log.gz 2023-11-28T17:00:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46262.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46262.log.gz 2023-11-28T17:00:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42935.log 2023-11-28T17:00:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2023-11-28T17:00:36.124 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54066.log.gz 2023-11-28T17:00:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42935.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42935.log.gz 2023-11-28T17:00:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53391.log 2023-11-28T17:00:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51698.log 2023-11-28T17:00:36.126 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2023-11-28T17:00:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53391.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53391.log.gz 2023-11-28T17:00:36.128 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47634.log 2023-11-28T17:00:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47036.log 2023-11-28T17:00:36.129 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51698.log.gz 2023-11-28T17:00:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47634.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47634.log.gz 2023-11-28T17:00:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46824.log 2023-11-28T17:00:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48506.log 2023-11-28T17:00:36.131 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47036.log.gz 2023-11-28T17:00:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46824.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46824.log.gz 2023-11-28T17:00:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47582.log 2023-11-28T17:00:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48506.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48506.log.gz 2023-11-28T17:00:36.134 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2023-11-28T17:00:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47582.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47582.log.gz 2023-11-28T17:00:36.135 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49427.log 2023-11-28T17:00:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45693.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2023-11-28T17:00:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47451.log 2023-11-28T17:00:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2023-11-28T17:00:36.139 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49427.log.gz 2023-11-28T17:00:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47451.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz 2023-11-28T17:00:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42516.log 2023-11-28T17:00:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53787.log 2023-11-28T17:00:36.140 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz 2023-11-28T17:00:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42516.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42516.log.gz 2023-11-28T17:00:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45309.log 2023-11-28T17:00:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42730.log 2023-11-28T17:00:36.142 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53787.log.gz 2023-11-28T17:00:36.143 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45309.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45309.log.gz 2023-11-28T17:00:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45641.log 2023-11-28T17:00:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50727.log 2023-11-28T17:00:36.145 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42730.log.gz 2023-11-28T17:00:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45641.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45641.log.gz 2023-11-28T17:00:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50266.log 2023-11-28T17:00:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49585.log 2023-11-28T17:00:36.148 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50727.log.gz 2023-11-28T17:00:36.149 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50266.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50266.log.gz 2023-11-28T17:00:36.149 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48426.log 2023-11-28T17:00:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49585.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49585.log.gz 2023-11-28T17:00:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2023-11-28T17:00:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48426.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48426.log.gz 2023-11-28T17:00:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2023-11-28T17:00:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46288.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2023-11-28T17:00:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52704.log 2023-11-28T17:00:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43614.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2023-11-28T17:00:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2023-11-28T17:00:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52704.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52704.log.gz 2023-11-28T17:00:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47530.log 2023-11-28T17:00:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47295.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2023-11-28T17:00:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43562.log 2023-11-28T17:00:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47530.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47530.log.gz 2023-11-28T17:00:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46046.log 2023-11-28T17:00:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52257.log 2023-11-28T17:00:36.158 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43562.log.gz 2023-11-28T17:00:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54354.log 2023-11-28T17:00:36.159 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46046.log.gz 2023-11-28T17:00:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52257.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52257.log.gz 2023-11-28T17:00:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47425.log 2023-11-28T17:00:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54354.log: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-28T17:00:36.162 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54354.log.gz 2023-11-28T17:00:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2023-11-28T17:00:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47965.log 2023-11-28T17:00:36.163 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47425.log.gz 2023-11-28T17:00:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.51750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49269.log 88.4% 2023-11-28T17:00:36.164 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2023-11-28T17:00:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46484.log 2023-11-28T17:00:36.165 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47965.log.gz 2023-11-28T17:00:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49269.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49269.log.gz 2023-11-28T17:00:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52231.log 2023-11-28T17:00:36.167 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46484.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46484.log.gz 2023-11-28T17:00:36.167 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49401.log 2023-11-28T17:00:36.168 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53495.log 2023-11-28T17:00:36.168 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52231.log.gz 2023-11-28T17:00:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52070.log 2023-11-28T17:00:36.169 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49401.log.gz 2023-11-28T17:00:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2023-11-28T17:00:36.170 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53495.log.gz 2023-11-28T17:00:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52070.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52070.log.gz 2023-11-28T17:00:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50500.log 2023-11-28T17:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2023-11-28T17:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2023-11-28T17:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55017.log 2023-11-28T17:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50500.log.gz 2023-11-28T17:00:36.174 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46019.log 2023-11-28T17:00:36.174 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2023-11-28T17:00:36.175 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.55017.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55017.log.gz 2023-11-28T17:00:36.175 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2023-11-28T17:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49074.log 2023-11-28T17:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46019.log.gz 2023-11-28T17:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2023-11-28T17:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2023-11-28T17:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48304.log 2023-11-28T17:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49074.log.gz 2023-11-28T17:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2023-11-28T17:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50935.log 2023-11-28T17:00:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2023-11-28T17:00:36.180 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48304.log.gz 2023-11-28T17:00:36.181 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46396.log 2023-11-28T17:00:36.181 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50935.log.gz 2023-11-28T17:00:36.182 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46340.log 2023-11-28T17:00:36.182 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2023-11-28T17:00:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46396.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46396.log.gz 2023-11-28T17:00:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48702.log 2023-11-28T17:00:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50630.log 2023-11-28T17:00:36.184 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46340.log.gz 2023-11-28T17:00:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46096.log 2023-11-28T17:00:36.185 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48702.log.gz 2023-11-28T17:00:36.186 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52491.log 2023-11-28T17:00:36.186 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50630.log.gz 2023-11-28T17:00:36.187 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46096.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46096.log.gz 2023-11-28T17:00:36.187 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50857.log 2023-11-28T17:00:36.188 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48622.log 2023-11-28T17:00:36.188 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52491.log.gz 2023-11-28T17:00:36.189 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.50857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48220.log 2023-11-28T17:00:36.190 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50857.log.gz 2023-11-28T17:00:36.190 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46694.log 2023-11-28T17:00:36.191 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48622.log.gz 2023-11-28T17:00:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.48220.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48220.log.gz 2023-11-28T17:00:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49637.log 2023-11-28T17:00:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54470.log 2023-11-28T17:00:36.193 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46694.log.gz 2023-11-28T17:00:36.193 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53070.log 2023-11-28T17:00:36.194 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49637.log.gz 2023-11-28T17:00:36.194 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.54470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52812.log 2023-11-28T17:00:36.194 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54470.log.gz 2023-11-28T17:00:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.53070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2023-11-28T17:00:36.196 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53070.log.gz 2023-11-28T17:00:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.52812.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52812.log.gz 2023-11-28T17:00:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2023-11-28T17:00:36.198 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49531.log 2023-11-28T17:00:36.198 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2023-11-28T17:00:36.198 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44150.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2023-11-28T17:00:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.49531.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49531.log.gz 2023-11-28T17:00:36.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-28T17:00:36.264 INFO:teuthology.orchestra.run.smithi026.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-28T17:00:36.286 INFO:teuthology.orchestra.run.smithi026.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-28T17:00:36.287 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-11-28T17:00:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m0.732s 2023-11-28T17:00:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m2.569s 2023-11-28T17:00:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m1.015s 2023-11-28T17:00:36.289 INFO:tasks.ceph:Archiving logs... 2023-11-28T17:00:36.289 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/remote/smithi026/log 2023-11-28T17:00:36.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T17:00:36.950 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/remote/smithi079/log 2023-11-28T17:00:36.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T17:00:37.195 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T17:00:37.205 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T17:00:37.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T17:00:37.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T17:00:37.291 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T17:00:37.302 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T17:00:37.302 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T17:00:37.306 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T17:00:37.318 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T17:00:37.318 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2023-11-28T17:00:37.318 INFO:teuthology.orchestra.run.smithi026.stdout:*hv01.front.sepi 44.4.53.2 2 u 26 64 377 0.065 -2.191 1.204 2023-11-28T17:00:37.319 INFO:teuthology.orchestra.run.smithi026.stdout:+hv02.front.sepi 63.231.80.2 3 u 20 64 377 0.074 +0.754 0.676 2023-11-28T17:00:37.319 INFO:teuthology.orchestra.run.smithi026.stdout:+hv03.front.sepi 74.6.168.72 3 u 19 64 377 0.067 +0.308 0.818 2023-11-28T17:00:37.319 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:00:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T17:00:37.321 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2023-11-28T17:00:37.322 INFO:teuthology.orchestra.run.smithi079.stdout:*hv01.front.sepi 44.4.53.2 2 u 23 64 377 0.092 -1.805 0.522 2023-11-28T17:00:37.322 INFO:teuthology.orchestra.run.smithi079.stdout:+hv02.front.sepi 63.231.80.2 3 u 21 64 377 0.097 -0.230 0.472 2023-11-28T17:00:37.322 INFO:teuthology.orchestra.run.smithi079.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.102 -0.828 0.572 2023-11-28T17:00:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:00:37.324 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T17:00:37.335 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T17:00:37.336 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T17:00:37.347 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T17:00:37.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T17:00:37.369 INFO:teuthology.task.internal:Duration was 1024.294082 seconds 2023-11-28T17:00:37.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T17:00:37.381 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T17:00:37.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T17:00:37.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T17:00:37.485 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T17:00:37.485 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2023-11-28T17:00:37.485 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T17:00:37.508 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2023-11-28T17:00:37.508 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T17:00:37.530 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T17:00:37.530 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T17:00:37.556 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T17:00:37.608 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T17:00:37.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T17:00:37.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T17:00:37.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T17:00:37.728 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T17:00:37.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T17:00:37.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T17:00:37.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T17:00:37.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T17:00:37.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T17:00:37.811 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2023-11-28T17:00:37.832 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2023-11-28T17:00:37.850 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T17:00:37.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:00:37.880 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T17:00:37.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:00:37.906 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T17:00:37.916 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T17:00:37.917 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/remote/smithi026 2023-11-28T17:00:37.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T17:00:37.946 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341/remote/smithi079 2023-11-28T17:00:37.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T17:00:37.971 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T17:00:37.972 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T17:00:37.989 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T17:00:38.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T17:00:38.032 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T17:00:38.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T17:00:38.048 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T17:00:38.049 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T17:00:38.052 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T17:00:38.058 INFO:teuthology.orchestra.run.smithi026.stdout: 658046 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 17:00 /home/ubuntu/cephtest 2023-11-28T17:00:38.070 INFO:teuthology.orchestra.run.smithi079.stdout: 658042 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 17:00 /home/ubuntu/cephtest 2023-11-28T17:00:38.072 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T17:00:38.085 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T17:00:38.116 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T17:00:38.142 DEBUG:teuthology.nuke:shortname: smithi026 2023-11-28T17:00:38.142 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T17:00:38.173 DEBUG:teuthology.nuke:shortname: smithi079 2023-11-28T17:00:38.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T17:00:38.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 16:33:46.581883', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLK3cX0awvivqTMUFkURLHddCrMc/pmBFAc5kbAgjc742Jlu9mQEpYaCnrOIp5A6nJfvIrcDJpq5ncDEiBbVJqs='} 2023-11-28T17:00:38.205 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 16:33:46.583841', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkI0GmXf2v+DH9KZbHKOKZwdFQ2zsfNU5G18ubT4762ZNaW6hZTTZhBQV1ZbjUbsu9CmQOg87uJZ9NqbEL0ZSs='} 2023-11-28T17:00:38.232 INFO:teuthology.orchestra.console.smithi026:Power off 2023-11-28T17:00:38.232 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T17:00:38.257 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-11-28T17:00:38.257 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T17:00:38.271 INFO:teuthology.orchestra.console.smithi079:Power off 2023-11-28T17:00:38.272 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T17:00:38.282 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-11-28T17:00:38.293 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-11-28T17:00:38.294 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T17:00:38.319 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-11-28T17:00:42.283 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T17:00:42.321 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T17:00:42.394 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-11-28T17:00:42.432 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-11-28T17:00:46.395 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T17:00:46.434 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T17:00:46.507 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-11-28T17:00:46.544 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-11-28T17:00:46.608 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-11-28T17:00:50.546 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T17:00:50.657 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-11-28T17:00:50.757 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-11-28T17:00:50.863 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1024.2940821647644 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=34a568bd8c9749f496f58e1d56e91ac8 status: fail success: false 2023-11-28T17:00:50.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T17:00:50.939 INFO:teuthology.run:FAIL